2024-05-10T11:01:23.846 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T11:01:23.846 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_dparmar@teuthology --name dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --archive /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935 -- /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/orig.config.yaml 2024-05-10T11:01:23.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T11:01:23.990 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935 branch: wip-63896-from-wip-rishabh-testing-20240501.193033 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: null first_in_suite: false job_id: '7700935' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-63896-from-wip-rishabh-testing-20240501.193033 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: d39fa08867836ac070c47cb66c782fa559fd480b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d39fa08867836ac070c47cb66c782fa559fd480b kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63896-from-wip-rishabh-testing-20240501.193033 sha1: d39fa08867836ac070c47cb66c782fa559fd480b owner: scheduled_dparmar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1698 sha1: d39fa08867836ac070c47cb66c782fa559fd480b sleep_before_teardown: 0 subset: 434/512 suite: fs suite_branch: wip-63896-from-wip-rishabh-testing-20240501.193033 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d39fa08867836ac070c47cb66c782fa559fd480b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1fE0tuvGUT9r4jLvViOll9QjlGjOcJxgmlcC4ZK1BPbiJsdCTaJ5IeV3G6l8dhLk+RTRPD/uZPQRQ/gme5pbk= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERzjNu7/gzS5Z7wD4D+sNaH0YQYXaQZLcmzZzJUKMNGVHu1mSgevgaqEeufpMGtfs2yyfEjAP0p7X56bA6itHo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_07:38:09 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T11:01:23.990 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa; will attempt to use it 2024-05-10T11:01:23.991 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks 2024-05-10T11:01:23.991 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T11:01:23.993 INFO:teuthology.task.internal:Checking packages... 2024-05-10T11:01:24.018 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd39fa08867836ac070c47cb66c782fa559fd480b' 2024-05-10T11:01:24.018 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T11:01:24.019 INFO:teuthology.packaging:ref: None 2024-05-10T11:01:24.019 INFO:teuthology.packaging:tag: None 2024-05-10T11:01:24.019 INFO:teuthology.packaging:branch: wip-63896-from-wip-rishabh-testing-20240501.193033 2024-05-10T11:01:24.019 INFO:teuthology.packaging:sha1: d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T11:01:24.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-63896-from-wip-rishabh-testing-20240501.193033 2024-05-10T11:01:24.236 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3449.gd39fa088 2024-05-10T11:01:24.237 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T11:01:24.244 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T11:01:24.244 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T11:01:24.260 INFO:teuthology.task.internal:Saving configuration 2024-05-10T11:01:24.277 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T11:01:24.283 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T11:01:24.306 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:55:33.693337', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1fE0tuvGUT9r4jLvViOll9QjlGjOcJxgmlcC4ZK1BPbiJsdCTaJ5IeV3G6l8dhLk+RTRPD/uZPQRQ/gme5pbk='} 2024-05-10T11:01:24.327 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:55:33.694625', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERzjNu7/gzS5Z7wD4D+sNaH0YQYXaQZLcmzZzJUKMNGVHu1mSgevgaqEeufpMGtfs2yyfEjAP0p7X56bA6itHo='} 2024-05-10T11:01:24.327 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T11:01:24.333 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-10T11:01:24.333 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-10T11:01:24.333 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T11:01:24.406 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3f80f97f70>, signals=[15]) 2024-05-10T11:01:24.407 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T11:01:24.415 INFO:teuthology.task.internal:Opening connections... 2024-05-10T11:01:24.415 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:01:24.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:01:24.497 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:01:24.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:01:24.571 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T11:01:24.578 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-05-10T11:01:24.596 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-05-10T11:01:24.597 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-05-10T11:01:24.655 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-05-10T11:01:24.655 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-05-10T11:01:24.655 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-05-10T11:01:24.655 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-05-10T11:01:24.655 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-05-10T11:01:24.655 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T11:01:24.656 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T11:01:24.657 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-05-10T11:01:24.678 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-05-10T11:01:24.695 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-05-10T11:01:24.696 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-05-10T11:01:24.752 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-05-10T11:01:24.752 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T11:01:24.753 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T11:01:24.754 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T11:01:24.754 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-05-10T11:01:24.777 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T11:01:24.788 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T11:01:24.794 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T11:01:24.794 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-05-10T11:01:24.797 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-05-10T11:01:24.813 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T11:01:24.819 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T11:01:24.819 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-05-10T11:01:24.854 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-05-10T11:01:24.880 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T11:01:24.935 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T11:01:24.950 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-10T11:01:24.951 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-10T11:01:24.951 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-10T11:01:24.951 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T11:01:24.952 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T11:01:24.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:01:24.969 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-05-10T11:01:24.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:01:24.971 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-05-10T11:01:25.026 INFO:teuthology.orchestra.run.smithi190.stdout:5.14.0-437.el9.x86_64 2024-05-10T11:01:25.027 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.14.0-437.el9.x86_64 2024-05-10T11:01:25.027 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2024-05-10T11:01:25.028 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-437.el9.x86_64 2024-05-10T11:01:25.029 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.14.0-437.el9.x86_64 2024-05-10T11:01:25.029 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2024-05-10T11:01:27.226 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-10T11:01:27.325 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-10T11:01:29.361 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-05-10T11:01:30.868 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 19 MB 00:02 2024-05-10T11:01:34.886 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-10T11:01:35.879 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.2 MB 00:01 2024-05-10T11:01:37.538 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-05-10T11:01:38.761 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 6.4 kB/s | 16 kB 00:02 2024-05-10T11:01:39.550 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-10T11:01:44.981 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-10T11:01:47.054 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T11:01:47.054 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T11:01:47.149 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T11:01:47.153 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:01:47.154 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 78 M 2024-05-10T11:01:47.155 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 123 M 2024-05-10T11:01:47.155 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-05-10T11:01:48.157 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 518 kB/s | 484 kB 00:00 2024-05-10T11:01:48.732 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 10 MB/s | 15 MB 00:01 2024-05-10T11:01:49.474 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-05-10T11:01:50.658 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 11 MB/s | 28 MB 00:02 2024-05-10T11:01:50.658 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-05-10T11:01:50.659 INFO:teuthology.orchestra.run.smithi066.stdout:Total 22 MB/s | 78 MB 00:03 2024-05-10T11:01:51.370 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-05-10T11:01:51.761 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-05-10T11:01:51.761 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-05-10T11:01:52.717 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-05-10T11:01:52.717 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-05-10T11:01:55.260 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-05-10T11:01:55.884 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T11:01:55.966 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T11:01:57.814 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-05-10T11:01:58.754 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T11:01:58.893 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T11:02:03.094 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 7.5 kB/s | 1.7 kB 00:00 2024-05-10T11:02:03.969 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T11:02:04.014 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:02:05.067 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T11:02:05.067 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T11:02:05.161 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T11:02:05.173 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T11:02:05.174 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T11:02:05.174 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:02:05.174 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-05-10T11:02:05.174 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-05-10T11:02:05.174 INFO:teuthology.orchestra.run.smithi190.stdout:Install 4 Packages 2024-05-10T11:02:05.174 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:02:05.175 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 78 M 2024-05-10T11:02:05.175 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 123 M 2024-05-10T11:02:05.175 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-05-10T11:02:06.312 INFO:teuthology.orchestra.run.smithi190.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 559 kB/s | 484 kB 00:00 2024-05-10T11:02:09.115 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:02:18.269 INFO:teuthology.orchestra.run.smithi190.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.2 MB/s | 15 MB 00:12 2024-05-10T11:02:37.925 INFO:teuthology.orchestra.run.smithi190.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 906 kB/s | 28 MB 00:31 2024-05-10T11:02:39.941 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:02:39.981 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:02:40.298 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:02:40.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T11:02:40.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T11:02:40.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T11:02:41.072 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:02:41.073 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-05-10T11:02:41.400 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T11:02:41.479 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T11:02:41.479 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T11:02:41.479 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T11:02:41.479 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T11:02:41.479 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T11:02:41.480 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-10T11:02:41.480 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T11:02:41.480 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T11:02:41.531 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T11:02:41.531 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T11:02:41.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -qi grub2-tools 2024-05-10T11:02:41.571 INFO:teuthology.orchestra.run.smithi066.stdout:Name : grub2-tools 2024-05-10T11:02:41.571 INFO:teuthology.orchestra.run.smithi066.stdout:Epoch : 1 2024-05-10T11:02:41.571 INFO:teuthology.orchestra.run.smithi066.stdout:Version : 2.06 2024-05-10T11:02:41.571 INFO:teuthology.orchestra.run.smithi066.stdout:Release : 68.el9 2024-05-10T11:02:41.572 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: x86_64 2024-05-10T11:02:41.572 INFO:teuthology.orchestra.run.smithi066.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T11:02:41.572 INFO:teuthology.orchestra.run.smithi066.stdout:Group : Unspecified 2024-05-10T11:02:41.572 INFO:teuthology.orchestra.run.smithi066.stdout:Size : 8264254 2024-05-10T11:02:41.572 INFO:teuthology.orchestra.run.smithi066.stdout:License : GPLv3+ 2024-05-10T11:02:41.572 INFO:teuthology.orchestra.run.smithi066.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:Packager : builder@centos.org 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:Vendor : CentOS 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T11:02:41.573 INFO:teuthology.orchestra.run.smithi066.stdout:Summary : Support tools for GRUB. 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout:Description : 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout:hardware devices. 2024-05-10T11:02:41.574 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:02:41.575 INFO:teuthology.orchestra.run.smithi066.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T11:02:41.577 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T11:02:41.577 INFO:teuthology.task.kernel:Updating grub on smithi066 to boot 5.14.0-444.el9.x86_64 2024-05-10T11:02:41.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T11:02:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-05-10T11:02:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T11:02:43.563 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-05-10T11:02:43.565 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-05-10T11:02:43.581 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.4g96KxGXNR 2024-05-10T11:02:43.581 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4g96KxGXNR 2024-05-10T11:02:43.647 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.4g96KxGXNR 2024-05-10T11:02:43.781 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.4g96KxGXNR is 6KB 2024-05-10T11:02:43.829 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.4g96KxGXNR 2024-05-10T11:02:43.844 DEBUG:teuthology.orchestra.run.smithi066:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T11:02:43.905 INFO:teuthology.orchestra.run.smithi066.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T11:02:43.906 INFO:teuthology.orchestra.run.smithi066.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T11:02:43.906 INFO:teuthology.orchestra.run.smithi066.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T11:02:43.906 INFO:teuthology.orchestra.run.smithi066.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T11:02:43.907 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T11:02:44.067 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-05-10T11:02:44.161 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-05-10T11:02:45.233 INFO:teuthology.orchestra.run.smithi190.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 873 kB/s | 34 MB 00:39 2024-05-10T11:02:45.233 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-05-10T11:02:45.233 INFO:teuthology.orchestra.run.smithi190.stdout:Total 1.9 MB/s | 78 MB 00:40 2024-05-10T11:02:45.908 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-05-10T11:02:46.257 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-05-10T11:02:46.257 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-05-10T11:02:47.189 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-05-10T11:02:47.189 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-05-10T11:02:49.589 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-05-10T11:02:50.223 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T11:02:50.316 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T11:02:53.000 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T11:02:53.134 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T11:02:57.880 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T11:02:57.986 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:03:02.699 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:03:14.070 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T11:03:14.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:03:14.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:03:32.364 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:03:32.402 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:03:32.685 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:03:32.685 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T11:03:32.685 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T11:03:32.685 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T11:03:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T11:03:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:03:33.475 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2024-05-10T11:03:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T11:03:33.476 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T11:03:33.476 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T11:03:33.476 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T11:03:33.476 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:03:33.476 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-05-10T11:03:33.881 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T11:03:33.953 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T11:03:33.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T11:03:33.953 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T11:03:33.954 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T11:03:33.954 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T11:03:33.954 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-10T11:03:33.954 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T11:03:33.954 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T11:03:34.003 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T11:03:34.004 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T11:03:34.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo rpm -qi grub2-tools 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Name : grub2-tools 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Epoch : 1 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Version : 2.06 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Release : 68.el9 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: x86_64 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Group : Unspecified 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Size : 8264254 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:License : GPLv3+ 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T11:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:Packager : builder@centos.org 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:Vendor : CentOS 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:Summary : Support tools for GRUB. 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:Description : 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:hardware devices. 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:03:34.035 INFO:teuthology.orchestra.run.smithi190.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T11:03:34.037 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T11:03:34.037 INFO:teuthology.task.kernel:Updating grub on smithi190 to boot 5.14.0-444.el9.x86_64 2024-05-10T11:03:34.037 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T11:03:34.606 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2024-05-10T11:03:35.934 INFO:teuthology.orchestra.run.smithi190.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T11:03:35.966 INFO:teuthology.orchestra.run.smithi190.stderr:done 2024-05-10T11:03:35.968 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-05-10T11:03:35.983 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.IkWFhfblTh 2024-05-10T11:03:35.983 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IkWFhfblTh 2024-05-10T11:03:36.077 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.IkWFhfblTh 2024-05-10T11:03:36.180 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.IkWFhfblTh is 6KB 2024-05-10T11:03:36.199 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.IkWFhfblTh 2024-05-10T11:03:36.213 DEBUG:teuthology.orchestra.run.smithi190:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T11:03:36.275 INFO:teuthology.orchestra.run.smithi190.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T11:03:36.275 INFO:teuthology.orchestra.run.smithi190.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T11:03:36.275 INFO:teuthology.orchestra.run.smithi190.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T11:03:36.275 INFO:teuthology.orchestra.run.smithi190.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T11:03:36.276 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T11:03:36.448 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2024-05-10T11:03:48.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-05-10T11:03:57.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:03:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:04:00.834 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-05-10T11:04:06.451 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-10T11:04:06.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-05-10T11:04:06.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:04:12.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:04:12.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:05:06.507 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T11:05:12.846 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T11:05:15.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-05-10T11:05:15.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:05:16.018 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-05-10T11:05:16.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-05-10T11:05:16.432 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-444.el9.x86_64"... 2024-05-10T11:05:16.432 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-05-10T11:05:16.447 INFO:teuthology.orchestra.run.smithi190.stdout:5.14.0-444.el9.x86_64 2024-05-10T11:05:16.447 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T11:05:16.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T11:05:16.447 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T11:05:17.448 DEBUG:teuthology.parallel:result is None 2024-05-10T11:05:27.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:05:27.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:05:28.265 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-05-10T11:05:28.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:05:28.642 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-10T11:05:28.642 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-05-10T11:05:28.658 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-444.el9.x86_64 2024-05-10T11:05:28.658 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T11:05:28.658 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T11:05:28.658 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T11:05:29.659 DEBUG:teuthology.parallel:result is None 2024-05-10T11:05:29.660 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T11:05:29.667 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T11:05:29.667 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T11:05:29.670 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T11:05:29.691 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T11:05:29.698 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T11:05:29.753 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T11:05:29.753 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T11:05:29.755 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T11:05:29.799 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T11:05:29.805 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T11:05:29.806 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T11:05:29.821 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T11:05:29.888 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T11:05:29.903 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T11:05:29.925 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T11:05:29.958 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T11:05:29.959 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T11:05:29.967 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T11:05:29.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T11:05:29.969 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T11:05:29.997 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T11:05:30.006 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T11:05:30.006 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T11:05:30.039 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T11:05:30.056 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T11:05:30.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T11:05:30.186 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T11:05:30.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T11:05:30.313 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:05:30.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T11:05:30.380 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T11:05:30.426 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T11:05:30.476 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T11:05:30.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T11:05:30.604 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:05:30.604 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T11:05:30.672 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-05-10T11:05:30.674 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-05-10T11:05:30.716 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:05:30.761 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:05:31.271 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T11:05:31.279 INFO:teuthology.task.internal:Starting timer... 2024-05-10T11:05:31.279 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T11:05:31.288 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T11:05:31.297 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-10T11:05:31.298 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-05-10T11:05:31.378 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-05-10T11:05:31.380 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2024-05-10T11:05:31.443 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2024-05-10T11:05:31.445 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T11:05:31.445 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-05-10T11:05:31.478 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-05-10T11:05:31.478 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2024-05-10T11:05:31.500 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2024-05-10T11:05:31.501 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2024-05-10T11:05:31.501 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:05:31.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:05:31.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:05:31.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:05:31.577 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T11:05:31.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-05-10T11:05:31.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2024-05-10T11:05:31.652 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T11:05:31.662 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T11:05:31.683 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T11:05:31.684 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi066.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T11:09:35.786 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-05-10T11:09:35.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:09:35.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:09:35.867 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-05-10T11:09:35.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-10T11:09:35.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-05-10T11:09:35.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T11:09:36.026 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-05-10T11:09:36.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-05-10T11:09:36.101 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T11:09:36.112 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T11:09:36.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T11:09:36.112 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:09:36.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T11:09:36.115 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:09:36.145 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T11:09:36.160 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T11:09:36.170 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T11:09:36.184 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T11:09:36.187 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-05-10T11:09:36.198 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-05-10T11:09:36.208 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2024-05-10T11:09:36.213 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T11:09:36.219 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2024-05-10T11:09:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T11:09:36.233 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T11:09:36.247 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T11:09:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:09:36.290 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:09:36.290 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-05-10T11:09:36.290 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.291 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.291 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.291 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.301 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:09:36.305 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:09:36.305 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-05-10T11:09:36.305 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.306 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.306 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.306 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:09:36.306 INFO:teuthology.run_tasks:Running task install... 2024-05-10T11:09:36.322 DEBUG:teuthology.task.install:project ceph 2024-05-10T11:09:36.322 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}} 2024-05-10T11:09:36.322 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'} 2024-05-10T11:09:36.322 INFO:teuthology.task.install:Using flavor: default 2024-05-10T11:09:36.328 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T11:09:36.328 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T11:09:36.329 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T11:09:36.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T11:09:36.331 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T11:09:36.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T11:09:36.475 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T11:09:36.475 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T11:09:36.550 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T11:09:36.550 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T11:09:36.691 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T11:09:36.692 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:09:36.692 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T11:09:36.720 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T11:09:36.720 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T11:09:36.738 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T11:09:36.738 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:09:36.738 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T11:09:36.765 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T11:09:36.765 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T11:09:36.789 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T11:09:36.832 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T11:09:36.868 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T11:09:36.908 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T11:09:36.934 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-05-10T11:09:36.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-05-10T11:09:36.973 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2024-05-10T11:09:36.974 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2024-05-10T11:09:37.174 INFO:teuthology.orchestra.run.smithi066.stdout:54 files removed 2024-05-10T11:09:37.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T11:09:37.203 INFO:teuthology.orchestra.run.smithi190.stdout:54 files removed 2024-05-10T11:09:37.230 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T11:09:38.086 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 145 kB/s | 84 kB 00:00 2024-05-10T11:09:38.088 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 140 kB/s | 84 kB 00:00 2024-05-10T11:09:38.602 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-05-10T11:09:38.622 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-05-10T11:09:39.027 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-05-10T11:09:39.042 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-10T11:09:39.536 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-05-10T11:09:45.315 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.1 MB 00:06 2024-05-10T11:09:47.207 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-10T11:09:51.458 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-05-10T11:09:52.893 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 16 kB 00:00 2024-05-10T11:09:54.280 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-10T11:09:56.419 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-05-10T11:09:59.711 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-05-10T11:10:00.520 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-05-10T11:10:02.096 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T11:10:02.097 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T11:10:02.108 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T11:10:02.109 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T11:10:02.110 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T11:10:02.111 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T11:10:02.112 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T11:10:02.115 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T11:10:02.115 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T11:10:02.145 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-05-10T11:10:02.182 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-05-10T11:10:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T11:10:02.203 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T11:10:02.204 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T11:10:02.205 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T11:10:02.206 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T11:10:02.207 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T11:10:02.208 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T11:10:02.209 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T11:10:02.210 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T11:10:02.211 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T11:10:02.212 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T11:10:02.213 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T11:10:02.214 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T11:10:02.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T11:10:02.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T11:10:02.217 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout:Install 148 Packages 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 8 Packages 2024-05-10T11:10:02.218 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:10:02.219 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 226 M 2024-05-10T11:10:02.219 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-05-10T11:10:03.054 INFO:teuthology.orchestra.run.smithi066.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-10T11:10:03.380 INFO:teuthology.orchestra.run.smithi066.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 2.7 MB/s | 890 kB 00:00 2024-05-10T11:10:03.463 INFO:teuthology.orchestra.run.smithi066.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 1.7 MB/s | 145 kB 00:00 2024-05-10T11:10:03.780 INFO:teuthology.orchestra.run.smithi066.stdout:(4/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 5.6 MB/s | 5.4 MB 00:00 2024-05-10T11:10:03.847 INFO:teuthology.orchestra.run.smithi066.stdout:(5/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 6.2 MB/s | 2.4 MB 00:00 2024-05-10T11:10:04.006 INFO:teuthology.orchestra.run.smithi066.stdout:(6/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-05-10T11:10:04.247 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-10T11:10:04.589 INFO:teuthology.orchestra.run.smithi066.stdout:(7/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 6.3 MB/s | 4.7 MB 00:00 2024-05-10T11:10:05.398 INFO:teuthology.orchestra.run.smithi066.stdout:(8/156): ceph-common-19.0.0-3449.gd39fa088.el9. 8.2 MB/s | 21 MB 00:02 2024-05-10T11:10:05.473 INFO:teuthology.orchestra.run.smithi066.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 336 kB/s | 25 kB 00:00 2024-05-10T11:10:05.790 INFO:teuthology.orchestra.run.smithi066.stdout:(10/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x8 9.4 MB/s | 17 MB 00:01 2024-05-10T11:10:05.874 INFO:teuthology.orchestra.run.smithi066.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 2.6 MB/s | 225 kB 00:00 2024-05-10T11:10:06.041 INFO:teuthology.orchestra.run.smithi066.stdout:(12/156): ceph-radosgw-19.0.0-3449.gd39fa088.el 7.3 MB/s | 11 MB 00:01 2024-05-10T11:10:06.058 INFO:teuthology.orchestra.run.smithi066.stdout:(13/156): cephfs-shell-19.0.0-3449.gd39fa088.el 147 kB/s | 27 kB 00:00 2024-05-10T11:10:06.116 INFO:teuthology.orchestra.run.smithi066.stdout:(14/156): libcephfs-devel-19.0.0-3449.gd39fa088 422 kB/s | 32 kB 00:00 2024-05-10T11:10:06.150 INFO:teuthology.orchestra.run.smithi066.stdout:(15/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 7.9 MB/s | 746 kB 00:00 2024-05-10T11:10:06.167 INFO:teuthology.orchestra.run.smithi066.stdout:(16/156): libcephsqlite-19.0.0-3449.gd39fa088.e 3.2 MB/s | 163 kB 00:00 2024-05-10T11:10:06.234 INFO:teuthology.orchestra.run.smithi066.stdout:(17/156): librados-devel-19.0.0-3449.gd39fa088. 1.5 MB/s | 127 kB 00:00 2024-05-10T11:10:06.259 INFO:teuthology.orchestra.run.smithi066.stdout:(18/156): libradosstriper1-19.0.0-3449.gd39fa08 5.3 MB/s | 500 kB 00:00 2024-05-10T11:10:06.343 INFO:teuthology.orchestra.run.smithi066.stdout:(19/156): python3-ceph-argparse-19.0.0-3449.gd3 540 kB/s | 45 kB 00:00 2024-05-10T11:10:06.435 INFO:teuthology.orchestra.run.smithi066.stdout:(20/156): python3-ceph-common-19.0.0-3449.gd39f 1.4 MB/s | 135 kB 00:00 2024-05-10T11:10:06.535 INFO:teuthology.orchestra.run.smithi066.stdout:(21/156): python3-cephfs-19.0.0-3449.gd39fa088. 1.6 MB/s | 161 kB 00:00 2024-05-10T11:10:06.636 INFO:teuthology.orchestra.run.smithi066.stdout:(22/156): python3-rados-19.0.0-3449.gd39fa088.e 3.1 MB/s | 321 kB 00:00 2024-05-10T11:10:06.752 INFO:teuthology.orchestra.run.smithi066.stdout:(23/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 10 MB/s | 5.4 MB 00:00 2024-05-10T11:10:06.778 INFO:teuthology.orchestra.run.smithi066.stdout:(24/156): python3-rbd-19.0.0-3449.gd39fa088.el9 2.1 MB/s | 298 kB 00:00 2024-05-10T11:10:06.828 INFO:teuthology.orchestra.run.smithi066.stdout:(25/156): python3-rgw-19.0.0-3449.gd39fa088.el9 1.3 MB/s | 99 kB 00:00 2024-05-10T11:10:06.853 INFO:teuthology.orchestra.run.smithi066.stdout:(26/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-10T11:10:06.945 INFO:teuthology.orchestra.run.smithi066.stdout:(27/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 1.8 MB/s | 170 kB 00:00 2024-05-10T11:10:07.037 INFO:teuthology.orchestra.run.smithi066.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3449.g 374 kB/s | 34 kB 00:00 2024-05-10T11:10:07.145 INFO:teuthology.orchestra.run.smithi066.stdout:(29/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 9.7 MB/s | 3.1 MB 00:00 2024-05-10T11:10:07.195 INFO:teuthology.orchestra.run.smithi066.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 1.0 MB/s | 142 kB 00:00 2024-05-10T11:10:07.571 INFO:teuthology.orchestra.run.smithi066.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 8.3 MB/s | 3.5 MB 00:00 2024-05-10T11:10:07.671 INFO:teuthology.orchestra.run.smithi066.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3449.gd3 2.7 MB/s | 274 kB 00:00 2024-05-10T11:10:07.755 INFO:teuthology.orchestra.run.smithi066.stdout:(33/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 591 kB/s | 49 kB 00:00 2024-05-10T11:10:07.831 INFO:teuthology.orchestra.run.smithi066.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3449.gd 219 kB/s | 16 kB 00:00 2024-05-10T11:10:07.922 INFO:teuthology.orchestra.run.smithi066.stdout:(35/156): ceph-volume-19.0.0-3449.gd39fa088.el9 2.9 MB/s | 273 kB 00:00 2024-05-10T11:10:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:(36/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 6.4 MB/s | 763 kB 00:00 2024-05-10T11:10:08.156 INFO:teuthology.orchestra.run.smithi066.stdout:(37/156): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-05-10T11:10:08.173 INFO:teuthology.orchestra.run.smithi066.stdout:(38/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 137 kB/s | 18 kB 00:00 2024-05-10T11:10:08.324 INFO:teuthology.orchestra.run.smithi066.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 481 kB/s | 80 kB 00:00 2024-05-10T11:10:08.416 INFO:teuthology.orchestra.run.smithi066.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-10T11:10:08.474 INFO:teuthology.orchestra.run.smithi066.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-05-10T11:10:08.525 INFO:teuthology.orchestra.run.smithi066.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-10T11:10:08.983 INFO:teuthology.orchestra.run.smithi066.stdout:(43/156): ceph-test-19.0.0-3449.gd39fa088.el9.x 14 MB/s | 49 MB 00:03 2024-05-10T11:10:09.008 INFO:teuthology.orchestra.run.smithi066.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 220 kB/s | 106 kB 00:00 2024-05-10T11:10:09.042 INFO:teuthology.orchestra.run.smithi066.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-05-10T11:10:09.093 INFO:teuthology.orchestra.run.smithi066.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-10T11:10:09.126 INFO:teuthology.orchestra.run.smithi066.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-10T11:10:09.185 INFO:teuthology.orchestra.run.smithi066.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 673 kB/s | 135 kB 00:00 2024-05-10T11:10:09.364 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-10T11:10:09.901 INFO:teuthology.orchestra.run.smithi066.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 149 kB/s | 107 kB 00:00 2024-05-10T11:10:10.027 INFO:teuthology.orchestra.run.smithi066.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 738 kB/s | 689 kB 00:00 2024-05-10T11:10:10.094 INFO:teuthology.orchestra.run.smithi066.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 975 kB/s | 943 kB 00:00 2024-05-10T11:10:10.477 INFO:teuthology.orchestra.run.smithi066.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 37 kB/s | 21 kB 00:00 2024-05-10T11:10:10.761 INFO:teuthology.orchestra.run.smithi066.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 49 kB/s | 33 kB 00:00 2024-05-10T11:10:10.861 INFO:teuthology.orchestra.run.smithi066.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 376 kB/s | 313 kB 00:00 2024-05-10T11:10:11.311 INFO:teuthology.orchestra.run.smithi066.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-05-10T11:10:11.370 INFO:teuthology.orchestra.run.smithi066.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-05-10T11:10:11.579 INFO:teuthology.orchestra.run.smithi066.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-05-10T11:10:11.674 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T11:10:11.674 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T11:10:11.685 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T11:10:11.686 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T11:10:11.686 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T11:10:11.687 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T11:10:11.689 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T11:10:11.691 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T11:10:11.692 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T11:10:11.753 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-05-10T11:10:11.767 INFO:teuthology.orchestra.run.smithi190.stdout:======================================================================================= 2024-05-10T11:10:11.767 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2024-05-10T11:10:11.767 INFO:teuthology.orchestra.run.smithi190.stdout:======================================================================================= 2024-05-10T11:10:11.767 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2024-05-10T11:10:11.767 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T11:10:11.767 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T11:10:11.768 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T11:10:11.769 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T11:10:11.770 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2024-05-10T11:10:11.771 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T11:10:11.772 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T11:10:11.773 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T11:10:11.774 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T11:10:11.775 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T11:10:11.776 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T11:10:11.777 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T11:10:11.778 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T11:10:11.779 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T11:10:11.780 INFO:teuthology.orchestra.run.smithi190.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout:Installing weak dependencies: 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout:======================================================================================= 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout:Install 148 Packages 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 8 Packages 2024-05-10T11:10:11.781 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:10:11.782 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 226 M 2024-05-10T11:10:11.782 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-05-10T11:10:12.037 INFO:teuthology.orchestra.run.smithi066.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 68 kB/s | 45 kB 00:00 2024-05-10T11:10:12.179 INFO:teuthology.orchestra.run.smithi066.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 185 kB/s | 160 kB 00:00 2024-05-10T11:10:12.588 INFO:teuthology.orchestra.run.smithi066.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 676 kB/s | 662 kB 00:00 2024-05-10T11:10:12.780 INFO:teuthology.orchestra.run.smithi066.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-05-10T11:10:12.841 INFO:teuthology.orchestra.run.smithi190.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-10T11:10:12.955 INFO:teuthology.orchestra.run.smithi066.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 635 kB/s | 582 kB 00:00 2024-05-10T11:10:13.213 INFO:teuthology.orchestra.run.smithi066.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-05-10T11:10:13.216 INFO:teuthology.orchestra.run.smithi190.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 2.3 MB/s | 890 kB 00:00 2024-05-10T11:10:13.325 INFO:teuthology.orchestra.run.smithi190.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 1.3 MB/s | 145 kB 00:00 2024-05-10T11:10:13.525 INFO:teuthology.orchestra.run.smithi190.stdout:(4/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 5.8 MB/s | 5.4 MB 00:00 2024-05-10T11:10:13.639 INFO:teuthology.orchestra.run.smithi066.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 341 kB/s | 292 kB 00:00 2024-05-10T11:10:13.700 INFO:teuthology.orchestra.run.smithi190.stdout:(5/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-05-10T11:10:13.798 INFO:teuthology.orchestra.run.smithi066.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 224 kB/s | 188 kB 00:00 2024-05-10T11:10:13.839 INFO:teuthology.orchestra.run.smithi066.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 59 kB/s | 35 kB 00:00 2024-05-10T11:10:13.859 INFO:teuthology.orchestra.run.smithi190.stdout:(6/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 4.4 MB/s | 2.4 MB 00:00 2024-05-10T11:10:14.234 INFO:teuthology.orchestra.run.smithi190.stdout:(7/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 8.8 MB/s | 4.7 MB 00:00 2024-05-10T11:10:14.889 INFO:teuthology.orchestra.run.smithi066.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.8 MB/s | 4.7 MB 00:01 2024-05-10T11:10:14.931 INFO:teuthology.orchestra.run.smithi066.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-10T11:10:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:(8/156): ceph-common-19.0.0-3449.gd39fa088.el9. 8.9 MB/s | 21 MB 00:02 2024-05-10T11:10:15.059 INFO:teuthology.orchestra.run.smithi190.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 303 kB/s | 25 kB 00:00 2024-05-10T11:10:15.182 INFO:teuthology.orchestra.run.smithi066.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-05-10T11:10:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:(10/156): ceph-radosgw-19.0.0-3449.gd39fa088.el 10 MB/s | 11 MB 00:01 2024-05-10T11:10:15.368 INFO:teuthology.orchestra.run.smithi190.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 2.2 MB/s | 225 kB 00:00 2024-05-10T11:10:15.468 INFO:teuthology.orchestra.run.smithi190.stdout:(12/156): cephfs-shell-19.0.0-3449.gd39fa088.el 270 kB/s | 27 kB 00:00 2024-05-10T11:10:15.552 INFO:teuthology.orchestra.run.smithi190.stdout:(13/156): libcephfs-devel-19.0.0-3449.gd39fa088 380 kB/s | 32 kB 00:00 2024-05-10T11:10:15.652 INFO:teuthology.orchestra.run.smithi190.stdout:(14/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 7.3 MB/s | 746 kB 00:00 2024-05-10T11:10:15.736 INFO:teuthology.orchestra.run.smithi190.stdout:(15/156): libcephsqlite-19.0.0-3449.gd39fa088.e 1.9 MB/s | 163 kB 00:00 2024-05-10T11:10:15.820 INFO:teuthology.orchestra.run.smithi190.stdout:(16/156): librados-devel-19.0.0-3449.gd39fa088. 1.5 MB/s | 127 kB 00:00 2024-05-10T11:10:15.902 INFO:teuthology.orchestra.run.smithi066.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 138 kB/s | 133 kB 00:00 2024-05-10T11:10:15.953 INFO:teuthology.orchestra.run.smithi190.stdout:(17/156): libradosstriper1-19.0.0-3449.gd39fa08 3.7 MB/s | 500 kB 00:00 2024-05-10T11:10:16.182 INFO:teuthology.orchestra.run.smithi066.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 705 kB/s | 911 kB 00:01 2024-05-10T11:10:16.458 INFO:teuthology.orchestra.run.smithi066.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-05-10T11:10:16.495 INFO:teuthology.orchestra.run.smithi190.stdout:(18/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x8 6.4 MB/s | 17 MB 00:02 2024-05-10T11:10:16.571 INFO:teuthology.orchestra.run.smithi190.stdout:(19/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 8.7 MB/s | 5.4 MB 00:00 2024-05-10T11:10:16.596 INFO:teuthology.orchestra.run.smithi190.stdout:(20/156): python3-ceph-argparse-19.0.0-3449.gd3 450 kB/s | 45 kB 00:00 2024-05-10T11:10:16.646 INFO:teuthology.orchestra.run.smithi190.stdout:(21/156): python3-ceph-common-19.0.0-3449.gd39f 1.8 MB/s | 135 kB 00:00 2024-05-10T11:10:16.671 INFO:teuthology.orchestra.run.smithi190.stdout:(22/156): python3-cephfs-19.0.0-3449.gd39fa088. 2.1 MB/s | 161 kB 00:00 2024-05-10T11:10:16.713 INFO:teuthology.orchestra.run.smithi190.stdout:(23/156): python3-rados-19.0.0-3449.gd39fa088.e 4.7 MB/s | 321 kB 00:00 2024-05-10T11:10:16.747 INFO:teuthology.orchestra.run.smithi190.stdout:(24/156): python3-rbd-19.0.0-3449.gd39fa088.el9 3.9 MB/s | 298 kB 00:00 2024-05-10T11:10:16.781 INFO:teuthology.orchestra.run.smithi190.stdout:(25/156): python3-rgw-19.0.0-3449.gd39fa088.el9 1.4 MB/s | 99 kB 00:00 2024-05-10T11:10:16.806 INFO:teuthology.orchestra.run.smithi190.stdout:(26/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-10T11:10:16.898 INFO:teuthology.orchestra.run.smithi190.stdout:(27/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 1.8 MB/s | 170 kB 00:00 2024-05-10T11:10:16.924 INFO:teuthology.orchestra.run.smithi066.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-10T11:10:16.950 INFO:teuthology.orchestra.run.smithi066.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 114 kB/s | 87 kB 00:00 2024-05-10T11:10:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3449.g 373 kB/s | 34 kB 00:00 2024-05-10T11:10:17.057 INFO:teuthology.orchestra.run.smithi190.stdout:(29/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 11 MB/s | 3.1 MB 00:00 2024-05-10T11:10:17.082 INFO:teuthology.orchestra.run.smithi190.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 1.5 MB/s | 142 kB 00:00 2024-05-10T11:10:17.416 INFO:teuthology.orchestra.run.smithi190.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 9.9 MB/s | 3.5 MB 00:00 2024-05-10T11:10:17.491 INFO:teuthology.orchestra.run.smithi190.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3449.gd3 3.6 MB/s | 274 kB 00:00 2024-05-10T11:10:17.566 INFO:teuthology.orchestra.run.smithi190.stdout:(33/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 659 kB/s | 49 kB 00:00 2024-05-10T11:10:17.642 INFO:teuthology.orchestra.run.smithi190.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3449.gd 220 kB/s | 16 kB 00:00 2024-05-10T11:10:17.708 INFO:teuthology.orchestra.run.smithi066.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-05-10T11:10:17.725 INFO:teuthology.orchestra.run.smithi190.stdout:(35/156): ceph-volume-19.0.0-3449.gd39fa088.el9 3.2 MB/s | 273 kB 00:00 2024-05-10T11:10:17.733 INFO:teuthology.orchestra.run.smithi066.stdout:(76/156): python3-devel-3.9.18-3.el9.x86_64.rpm 302 kB/s | 244 kB 00:00 2024-05-10T11:10:17.775 INFO:teuthology.orchestra.run.smithi066.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 300 kB/s | 248 kB 00:00 2024-05-10T11:10:17.842 INFO:teuthology.orchestra.run.smithi190.stdout:(36/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 6.4 MB/s | 763 kB 00:00 2024-05-10T11:10:17.917 INFO:teuthology.orchestra.run.smithi190.stdout:(37/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 243 kB/s | 18 kB 00:00 2024-05-10T11:10:18.018 INFO:teuthology.orchestra.run.smithi190.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 7.9 MB/s | 7.4 MB 00:00 2024-05-10T11:10:18.268 INFO:teuthology.orchestra.run.smithi066.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-05-10T11:10:18.301 INFO:teuthology.orchestra.run.smithi066.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-05-10T11:10:18.585 INFO:teuthology.orchestra.run.smithi066.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 213 kB/s | 172 kB 00:00 2024-05-10T11:10:18.618 INFO:teuthology.orchestra.run.smithi190.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-05-10T11:10:18.877 INFO:teuthology.orchestra.run.smithi066.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 57 kB/s | 35 kB 00:00 2024-05-10T11:10:18.977 INFO:teuthology.orchestra.run.smithi190.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 838 kB/s | 803 kB 00:00 2024-05-10T11:10:19.385 INFO:teuthology.orchestra.run.smithi066.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 313 kB/s | 250 kB 00:00 2024-05-10T11:10:19.469 INFO:teuthology.orchestra.run.smithi066.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-05-10T11:10:19.602 INFO:teuthology.orchestra.run.smithi190.stdout:(41/156): ceph-test-19.0.0-3449.gd39fa088.el9.x 11 MB/s | 49 MB 00:04 2024-05-10T11:10:19.661 INFO:teuthology.orchestra.run.smithi190.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 187 kB/s | 195 kB 00:01 2024-05-10T11:10:19.694 INFO:teuthology.orchestra.run.smithi066.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-05-10T11:10:20.094 INFO:teuthology.orchestra.run.smithi066.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 109 kB/s | 77 kB 00:00 2024-05-10T11:10:20.119 INFO:teuthology.orchestra.run.smithi066.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-05-10T11:10:20.244 INFO:teuthology.orchestra.run.smithi190.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 200 kB/s | 253 kB 00:01 2024-05-10T11:10:20.369 INFO:teuthology.orchestra.run.smithi190.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 150 kB/s | 106 kB 00:00 2024-05-10T11:10:20.561 INFO:teuthology.orchestra.run.smithi066.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 321 kB/s | 269 kB 00:00 2024-05-10T11:10:20.653 INFO:teuthology.orchestra.run.smithi190.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-05-10T11:10:20.853 INFO:teuthology.orchestra.run.smithi066.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 209 kB/s | 159 kB 00:00 2024-05-10T11:10:20.954 INFO:teuthology.orchestra.run.smithi066.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 334 kB/s | 279 kB 00:00 2024-05-10T11:10:21.011 INFO:teuthology.orchestra.run.smithi190.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 176 kB/s | 135 kB 00:00 2024-05-10T11:10:21.111 INFO:teuthology.orchestra.run.smithi190.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-05-10T11:10:21.137 INFO:teuthology.orchestra.run.smithi190.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 163 kB/s | 125 kB 00:00 2024-05-10T11:10:21.204 INFO:teuthology.orchestra.run.smithi190.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-10T11:10:21.237 INFO:teuthology.orchestra.run.smithi066.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 75 kB/s | 51 kB 00:00 2024-05-10T11:10:21.254 INFO:teuthology.orchestra.run.smithi190.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-05-10T11:10:21.280 INFO:teuthology.orchestra.run.smithi190.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 285 kB/s | 21 kB 00:00 2024-05-10T11:10:21.338 INFO:teuthology.orchestra.run.smithi190.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-05-10T11:10:21.380 INFO:teuthology.orchestra.run.smithi190.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-05-10T11:10:21.430 INFO:teuthology.orchestra.run.smithi190.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-05-10T11:10:21.456 INFO:teuthology.orchestra.run.smithi190.stdout:(55/156): python3-urllib3-1.26.5-5.el9.noarch.r 267 kB/s | 215 kB 00:00 2024-05-10T11:10:21.489 INFO:teuthology.orchestra.run.smithi190.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-05-10T11:10:21.540 INFO:teuthology.orchestra.run.smithi190.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-05-10T11:10:21.546 INFO:teuthology.orchestra.run.smithi066.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 77 kB/s | 54 kB 00:00 2024-05-10T11:10:21.573 INFO:teuthology.orchestra.run.smithi190.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-05-10T11:10:21.624 INFO:teuthology.orchestra.run.smithi190.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-05-10T11:10:21.690 INFO:teuthology.orchestra.run.smithi190.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 383 kB/s | 25 kB 00:00 2024-05-10T11:10:21.732 INFO:teuthology.orchestra.run.smithi190.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-05-10T11:10:21.758 INFO:teuthology.orchestra.run.smithi190.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-05-10T11:10:21.783 INFO:teuthology.orchestra.run.smithi190.stdout:(63/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-05-10T11:10:21.833 INFO:teuthology.orchestra.run.smithi190.stdout:(64/156): openblas-0.3.21-2.el9.x86_64.rpm 706 kB/s | 35 kB 00:00 2024-05-10T11:10:21.859 INFO:teuthology.orchestra.run.smithi190.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-10T11:10:21.871 INFO:teuthology.orchestra.run.smithi066.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 66 kB/s | 42 kB 00:00 2024-05-10T11:10:21.884 INFO:teuthology.orchestra.run.smithi190.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-10T11:10:22.142 INFO:teuthology.orchestra.run.smithi190.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-05-10T11:10:22.180 INFO:teuthology.orchestra.run.smithi066.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 70 kB/s | 44 kB 00:00 2024-05-10T11:10:22.184 INFO:teuthology.orchestra.run.smithi190.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-05-10T11:10:22.268 INFO:teuthology.orchestra.run.smithi190.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-05-10T11:10:22.352 INFO:teuthology.orchestra.run.smithi190.stdout:(70/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-05-10T11:10:22.393 INFO:teuthology.orchestra.run.smithi190.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 3.5 MB/s | 911 kB 00:00 2024-05-10T11:10:22.438 INFO:teuthology.orchestra.run.smithi066.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-05-10T11:10:22.461 INFO:teuthology.orchestra.run.smithi190.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-10T11:10:22.577 INFO:teuthology.orchestra.run.smithi190.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-05-10T11:10:22.694 INFO:teuthology.orchestra.run.smithi190.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-10T11:10:22.738 INFO:teuthology.orchestra.run.smithi066.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 255 kB/s | 221 kB 00:00 2024-05-10T11:10:22.794 INFO:teuthology.orchestra.run.smithi190.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-05-10T11:10:22.853 INFO:teuthology.orchestra.run.smithi190.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-05-10T11:10:22.930 INFO:teuthology.orchestra.run.smithi066.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 48 kB/s | 36 kB 00:00 2024-05-10T11:10:22.953 INFO:teuthology.orchestra.run.smithi190.stdout:(77/156): postgresql-server-13.14-1.el9.x86_64. 8.4 MB/s | 5.8 MB 00:00 2024-05-10T11:10:22.979 INFO:teuthology.orchestra.run.smithi190.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-05-10T11:10:23.029 INFO:teuthology.orchestra.run.smithi190.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-05-10T11:10:23.055 INFO:teuthology.orchestra.run.smithi190.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-05-10T11:10:23.089 INFO:teuthology.orchestra.run.smithi066.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-05-10T11:10:23.130 INFO:teuthology.orchestra.run.smithi190.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2024-05-10T11:10:23.197 INFO:teuthology.orchestra.run.smithi190.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-05-10T11:10:23.222 INFO:teuthology.orchestra.run.smithi190.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-10T11:10:23.281 INFO:teuthology.orchestra.run.smithi190.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 922 kB/s | 77 kB 00:00 2024-05-10T11:10:23.306 INFO:teuthology.orchestra.run.smithi190.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 505 kB/s | 42 kB 00:00 2024-05-10T11:10:23.390 INFO:teuthology.orchestra.run.smithi190.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-05-10T11:10:23.415 INFO:teuthology.orchestra.run.smithi190.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-10T11:10:23.498 INFO:teuthology.orchestra.run.smithi190.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-05-10T11:10:23.524 INFO:teuthology.orchestra.run.smithi190.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-05-10T11:10:23.557 INFO:teuthology.orchestra.run.smithi190.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-05-10T11:10:23.573 INFO:teuthology.orchestra.run.smithi066.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 365 kB/s | 305 kB 00:00 2024-05-10T11:10:23.582 INFO:teuthology.orchestra.run.smithi190.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 54 kB 00:00 2024-05-10T11:10:23.606 INFO:teuthology.orchestra.run.smithi066.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 85 kB/s | 58 kB 00:00 2024-05-10T11:10:23.633 INFO:teuthology.orchestra.run.smithi190.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-05-10T11:10:23.658 INFO:teuthology.orchestra.run.smithi190.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 586 kB/s | 44 kB 00:00 2024-05-10T11:10:23.708 INFO:teuthology.orchestra.run.smithi190.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-05-10T11:10:23.733 INFO:teuthology.orchestra.run.smithi190.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-05-10T11:10:23.784 INFO:teuthology.orchestra.run.smithi190.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-05-10T11:10:23.798 INFO:teuthology.orchestra.run.smithi066.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 132 kB/s | 94 kB 00:00 2024-05-10T11:10:23.834 INFO:teuthology.orchestra.run.smithi190.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-05-10T11:10:23.876 INFO:teuthology.orchestra.run.smithi190.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 628 kB/s | 58 kB 00:00 2024-05-10T11:10:23.943 INFO:teuthology.orchestra.run.smithi190.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 864 kB/s | 94 kB 00:00 2024-05-10T11:10:23.968 INFO:teuthology.orchestra.run.smithi190.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 694 kB/s | 64 kB 00:00 2024-05-10T11:10:23.974 INFO:teuthology.orchestra.run.smithi066.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 152 kB/s | 22 kB 00:00 2024-05-10T11:10:24.019 INFO:teuthology.orchestra.run.smithi190.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 594 kB/s | 45 kB 00:00 2024-05-10T11:10:24.191 INFO:teuthology.orchestra.run.smithi066.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-05-10T11:10:24.224 INFO:teuthology.orchestra.run.smithi066.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-05-10T11:10:24.227 INFO:teuthology.orchestra.run.smithi190.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-05-10T11:10:24.258 INFO:teuthology.orchestra.run.smithi066.stdout:(104/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-05-10T11:10:24.503 INFO:teuthology.orchestra.run.smithi190.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-05-10T11:10:24.625 INFO:teuthology.orchestra.run.smithi066.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 53 kB/s | 19 kB 00:00 2024-05-10T11:10:24.761 INFO:teuthology.orchestra.run.smithi190.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-10T11:10:24.795 INFO:teuthology.orchestra.run.smithi190.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-05-10T11:10:24.828 INFO:teuthology.orchestra.run.smithi190.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-05-10T11:10:24.891 INFO:teuthology.orchestra.run.smithi066.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 463 kB/s | 309 kB 00:00 2024-05-10T11:10:24.934 INFO:teuthology.orchestra.run.smithi066.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 738 kB/s | 548 kB 00:00 2024-05-10T11:10:24.937 INFO:teuthology.orchestra.run.smithi190.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 712 kB/s | 309 kB 00:00 2024-05-10T11:10:24.970 INFO:teuthology.orchestra.run.smithi190.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 183 kB/s | 26 kB 00:00 2024-05-10T11:10:25.001 INFO:teuthology.orchestra.run.smithi066.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-05-10T11:10:25.021 INFO:teuthology.orchestra.run.smithi190.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 584 kB/s | 49 kB 00:00 2024-05-10T11:10:25.042 INFO:teuthology.orchestra.run.smithi066.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-05-10T11:10:25.046 INFO:teuthology.orchestra.run.smithi190.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 890 kB/s | 67 kB 00:00 2024-05-10T11:10:25.113 INFO:teuthology.orchestra.run.smithi190.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-05-10T11:10:25.126 INFO:teuthology.orchestra.run.smithi066.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 539 kB/s | 67 kB 00:00 2024-05-10T11:10:25.160 INFO:teuthology.orchestra.run.smithi066.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-05-10T11:10:25.180 INFO:teuthology.orchestra.run.smithi190.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-05-10T11:10:25.247 INFO:teuthology.orchestra.run.smithi190.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 651 kB/s | 43 kB 00:00 2024-05-10T11:10:25.272 INFO:teuthology.orchestra.run.smithi190.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-05-10T11:10:25.314 INFO:teuthology.orchestra.run.smithi190.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-05-10T11:10:25.335 INFO:teuthology.orchestra.run.smithi066.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-05-10T11:10:25.339 INFO:teuthology.orchestra.run.smithi190.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-05-10T11:10:25.390 INFO:teuthology.orchestra.run.smithi190.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-10T11:10:25.402 INFO:teuthology.orchestra.run.smithi066.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-05-10T11:10:25.427 INFO:teuthology.orchestra.run.smithi066.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.7 MB/s | 839 kB 00:00 2024-05-10T11:10:25.432 INFO:teuthology.orchestra.run.smithi190.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-05-10T11:10:25.452 INFO:teuthology.orchestra.run.smithi066.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 370 kB/s | 43 kB 00:00 2024-05-10T11:10:25.509 INFO:teuthology.orchestra.run.smithi190.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-05-10T11:10:25.511 INFO:teuthology.orchestra.run.smithi066.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 296 kB/s | 32 kB 00:00 2024-05-10T11:10:25.532 INFO:teuthology.orchestra.run.smithi190.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-05-10T11:10:25.536 INFO:teuthology.orchestra.run.smithi066.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 137 kB/s | 15 kB 00:00 2024-05-10T11:10:25.566 INFO:teuthology.orchestra.run.smithi190.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2024-05-10T11:10:25.570 INFO:teuthology.orchestra.run.smithi066.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-10T11:10:25.591 INFO:teuthology.orchestra.run.smithi190.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-10T11:10:25.637 INFO:teuthology.orchestra.run.smithi066.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-05-10T11:10:25.641 INFO:teuthology.orchestra.run.smithi190.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-10T11:10:25.659 INFO:teuthology.orchestra.run.smithi190.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-05-10T11:10:25.662 INFO:teuthology.orchestra.run.smithi066.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-10T11:10:25.688 INFO:teuthology.orchestra.run.smithi066.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 301 kB/s | 35 kB 00:00 2024-05-10T11:10:25.709 INFO:teuthology.orchestra.run.smithi190.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-10T11:10:25.727 INFO:teuthology.orchestra.run.smithi190.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-05-10T11:10:25.742 INFO:teuthology.orchestra.run.smithi190.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-05-10T11:10:25.754 INFO:teuthology.orchestra.run.smithi066.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-05-10T11:10:25.768 INFO:teuthology.orchestra.run.smithi190.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-05-10T11:10:25.801 INFO:teuthology.orchestra.run.smithi190.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-05-10T11:10:25.829 INFO:teuthology.orchestra.run.smithi066.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-10T11:10:25.835 INFO:teuthology.orchestra.run.smithi190.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-05-10T11:10:25.852 INFO:teuthology.orchestra.run.smithi190.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 551 kB/s | 46 kB 00:00 2024-05-10T11:10:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 865 kB/s | 144 kB 00:00 2024-05-10T11:10:25.872 INFO:teuthology.orchestra.run.smithi066.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 91 kB/s | 11 kB 00:00 2024-05-10T11:10:25.877 INFO:teuthology.orchestra.run.smithi190.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-10T11:10:25.902 INFO:teuthology.orchestra.run.smithi190.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 861 kB/s | 58 kB 00:00 2024-05-10T11:10:25.922 INFO:teuthology.orchestra.run.smithi066.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 191 kB/s | 18 kB 00:00 2024-05-10T11:10:25.936 INFO:teuthology.orchestra.run.smithi190.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-10T11:10:25.956 INFO:teuthology.orchestra.run.smithi066.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 229 kB/s | 23 kB 00:00 2024-05-10T11:10:25.961 INFO:teuthology.orchestra.run.smithi190.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 195 kB/s | 16 kB 00:00 2024-05-10T11:10:25.973 INFO:teuthology.orchestra.run.smithi066.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-05-10T11:10:25.978 INFO:teuthology.orchestra.run.smithi190.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-10T11:10:26.003 INFO:teuthology.orchestra.run.smithi190.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-05-10T11:10:26.023 INFO:teuthology.orchestra.run.smithi066.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-05-10T11:10:26.030 INFO:teuthology.orchestra.run.smithi190.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-05-10T11:10:26.054 INFO:teuthology.orchestra.run.smithi190.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-05-10T11:10:26.073 INFO:teuthology.orchestra.run.smithi066.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-05-10T11:10:26.088 INFO:teuthology.orchestra.run.smithi190.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 701 kB/s | 59 kB 00:00 2024-05-10T11:10:26.113 INFO:teuthology.orchestra.run.smithi190.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 432 kB/s | 36 kB 00:00 2024-05-10T11:10:26.123 INFO:teuthology.orchestra.run.smithi066.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 788 kB/s | 79 kB 00:00 2024-05-10T11:10:26.139 INFO:teuthology.orchestra.run.smithi190.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 607 kB/s | 51 kB 00:00 2024-05-10T11:10:26.164 INFO:teuthology.orchestra.run.smithi190.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-10T11:10:26.165 INFO:teuthology.orchestra.run.smithi066.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-05-10T11:10:26.183 INFO:teuthology.orchestra.run.smithi066.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 530 kB/s | 58 kB 00:00 2024-05-10T11:10:26.197 INFO:teuthology.orchestra.run.smithi190.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-10T11:10:26.222 INFO:teuthology.orchestra.run.smithi190.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-10T11:10:26.233 INFO:teuthology.orchestra.run.smithi066.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-05-10T11:10:26.248 INFO:teuthology.orchestra.run.smithi190.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-05-10T11:10:26.266 INFO:teuthology.orchestra.run.smithi066.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-05-10T11:10:26.273 INFO:teuthology.orchestra.run.smithi190.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-10T11:10:26.292 INFO:teuthology.orchestra.run.smithi066.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 828 kB/s | 90 kB 00:00 2024-05-10T11:10:26.315 INFO:teuthology.orchestra.run.smithi190.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-10T11:10:26.334 INFO:teuthology.orchestra.run.smithi066.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-05-10T11:10:26.367 INFO:teuthology.orchestra.run.smithi066.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-05-10T11:10:26.409 INFO:teuthology.orchestra.run.smithi066.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-10T11:10:26.435 INFO:teuthology.orchestra.run.smithi066.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-05-10T11:10:26.468 INFO:teuthology.orchestra.run.smithi066.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-05-10T11:10:26.510 INFO:teuthology.orchestra.run.smithi066.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2024-05-10T11:10:26.544 INFO:teuthology.orchestra.run.smithi066.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-10T11:10:26.577 INFO:teuthology.orchestra.run.smithi066.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 823 kB/s | 90 kB 00:00 2024-05-10T11:10:26.644 INFO:teuthology.orchestra.run.smithi066.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-05-10T11:10:26.661 INFO:teuthology.orchestra.run.smithi066.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-05-10T11:10:26.686 INFO:teuthology.orchestra.run.smithi066.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-05-10T11:10:26.715 INFO:teuthology.orchestra.run.smithi190.stdout:(149/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-05-10T11:10:26.782 INFO:teuthology.orchestra.run.smithi190.stdout:(150/156): librados2-19.0.0-3449.gd39fa088.el9. 6.4 MB/s | 3.4 MB 00:00 2024-05-10T11:10:26.862 INFO:teuthology.orchestra.run.smithi066.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-05-10T11:10:27.154 INFO:teuthology.orchestra.run.smithi066.stdout:(149/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 6.7 MB/s | 3.1 MB 00:00 2024-05-10T11:10:27.204 INFO:teuthology.orchestra.run.smithi066.stdout:(150/156): librados2-19.0.0-3449.gd39fa088.el9. 6.3 MB/s | 3.4 MB 00:00 2024-05-10T11:10:27.246 INFO:teuthology.orchestra.run.smithi066.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 6.0 MB/s | 2.3 MB 00:00 2024-05-10T11:10:27.279 INFO:teuthology.orchestra.run.smithi066.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 554 kB/s | 42 kB 00:00 2024-05-10T11:10:27.304 INFO:teuthology.orchestra.run.smithi066.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.1 MB/s | 248 kB 00:00 2024-05-10T11:10:27.383 INFO:teuthology.orchestra.run.smithi190.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-05-10T11:10:27.408 INFO:teuthology.orchestra.run.smithi190.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 67 kB/s | 42 kB 00:00 2024-05-10T11:10:27.438 INFO:teuthology.orchestra.run.smithi066.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 6.4 MB/s | 1.8 MB 00:00 2024-05-10T11:10:27.538 INFO:teuthology.orchestra.run.smithi066.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-05-10T11:10:27.614 INFO:teuthology.orchestra.run.smithi066.stdout:(156/156): openssl-3.2.1-1.el9.x86_64.rpm 4.0 MB/s | 1.3 MB 00:00 2024-05-10T11:10:27.620 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-05-10T11:10:27.660 INFO:teuthology.orchestra.run.smithi066.stdout:Total 8.9 MB/s | 226 MB 00:25 2024-05-10T11:10:27.800 INFO:teuthology.orchestra.run.smithi190.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-05-10T11:10:28.225 INFO:teuthology.orchestra.run.smithi190.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 295 kB/s | 248 kB 00:00 2024-05-10T11:10:28.433 INFO:teuthology.orchestra.run.smithi190.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-10T11:10:28.853 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-05-10T11:10:28.917 INFO:teuthology.orchestra.run.smithi190.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-05-10T11:10:28.924 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-05-10T11:10:28.925 INFO:teuthology.orchestra.run.smithi190.stdout:Total 13 MB/s | 226 MB 00:17 2024-05-10T11:10:29.022 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-05-10T11:10:29.022 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-05-10T11:10:30.136 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-05-10T11:10:30.287 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-05-10T11:10:30.288 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-05-10T11:10:31.298 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-05-10T11:10:31.299 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-05-10T11:10:32.529 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-05-10T11:10:32.530 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-05-10T11:10:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-05-10T11:10:37.769 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T11:10:37.814 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T11:10:37.890 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T11:10:37.928 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T11:10:37.953 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T11:10:38.006 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T11:10:38.351 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T11:10:38.454 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T11:10:38.587 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T11:10:38.614 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T11:10:38.710 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T11:10:38.743 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T11:10:38.786 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-05-10T11:10:38.863 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T11:10:38.901 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T11:10:38.918 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T11:10:38.971 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T11:10:38.982 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T11:10:39.009 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T11:10:39.013 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T11:10:39.039 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T11:10:39.097 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T11:10:39.106 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T11:10:39.135 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T11:10:39.198 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T11:10:39.219 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T11:10:39.240 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T11:10:39.388 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T11:10:39.428 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T11:10:39.523 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T11:10:39.544 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T11:10:39.646 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T11:10:39.674 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T11:10:39.683 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T11:10:39.744 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T11:10:39.774 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T11:10:39.804 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T11:10:39.868 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T11:10:39.945 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T11:10:39.992 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T11:10:40.046 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T11:10:40.070 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T11:10:40.159 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T11:10:40.174 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T11:10:40.196 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T11:10:40.267 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T11:10:40.270 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T11:10:40.289 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T11:10:40.307 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T11:10:40.366 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T11:10:40.401 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T11:10:40.437 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T11:10:40.512 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T11:10:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T11:10:40.628 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T11:10:40.661 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T11:10:40.689 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T11:10:40.716 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T11:10:40.759 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T11:10:40.821 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T11:10:40.850 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T11:10:40.894 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T11:10:40.894 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T11:10:40.972 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T11:10:41.004 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T11:10:41.044 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T11:10:41.049 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T11:10:41.085 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T11:10:41.113 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T11:10:41.158 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T11:10:41.200 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T11:10:41.236 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T11:10:41.278 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T11:10:41.314 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T11:10:41.422 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T11:10:41.478 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T11:10:41.509 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T11:10:41.619 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T11:10:41.722 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T11:10:41.753 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T11:10:41.811 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T11:10:41.885 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T11:10:41.929 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T11:10:41.971 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T11:10:42.004 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T11:10:42.031 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T11:10:42.032 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T11:10:42.100 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T11:10:42.125 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T11:10:42.153 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T11:10:42.160 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T11:10:42.185 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T11:10:42.203 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T11:10:42.220 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T11:10:42.241 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T11:10:42.284 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T11:10:42.296 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T11:10:42.330 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T11:10:42.374 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T11:10:42.403 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T11:10:42.445 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T11:10:42.472 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T11:10:42.502 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T11:10:42.526 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T11:10:42.558 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T11:10:42.600 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T11:10:42.632 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T11:10:42.669 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T11:10:42.706 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T11:10:42.733 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T11:10:42.753 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T11:10:42.787 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T11:10:42.789 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T11:10:42.833 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T11:10:42.874 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T11:10:43.020 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T11:10:43.063 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T11:10:43.093 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T11:10:43.135 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T11:10:43.233 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T11:10:43.268 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T11:10:43.301 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T11:10:43.310 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T11:10:43.342 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T11:10:43.375 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T11:10:43.382 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T11:10:43.411 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T11:10:43.454 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T11:10:43.485 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T11:10:43.492 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T11:10:43.525 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T11:10:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T11:10:43.657 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T11:10:43.685 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T11:10:43.687 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T11:10:43.720 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T11:10:43.745 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T11:10:43.759 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T11:10:43.798 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T11:10:43.800 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T11:10:43.829 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T11:10:43.863 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T11:10:43.872 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T11:10:43.896 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T11:10:43.904 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T11:10:43.938 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T11:10:43.940 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T11:10:43.972 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T11:10:43.986 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T11:10:44.023 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T11:10:44.054 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T11:10:44.066 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T11:10:44.104 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T11:10:44.108 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T11:10:44.134 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T11:10:44.182 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T11:10:44.243 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T11:10:44.293 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T11:10:44.296 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T11:10:44.329 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T11:10:44.344 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T11:10:44.377 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T11:10:44.471 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T11:10:44.511 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T11:10:44.555 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T11:10:44.584 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T11:10:44.609 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T11:10:44.694 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T11:10:44.819 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T11:10:44.850 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T11:10:44.881 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T11:10:44.912 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T11:10:44.951 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T11:10:44.982 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T11:10:45.012 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T11:10:45.072 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T11:10:45.097 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T11:10:45.113 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T11:10:45.138 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T11:10:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T11:10:45.172 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T11:10:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T11:10:45.259 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T11:10:45.295 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T11:10:45.309 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T11:10:45.342 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T11:10:45.350 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T11:10:45.389 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T11:10:45.441 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T11:10:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T11:10:45.488 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T11:10:45.544 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T11:10:45.660 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T11:10:45.691 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T11:10:45.771 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T11:10:46.260 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T11:10:46.308 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T11:10:46.341 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T11:10:46.442 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T11:10:46.467 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T11:10:46.490 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T11:10:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T11:10:46.677 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T11:10:46.719 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T11:10:46.897 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T11:10:46.925 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T11:10:47.010 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T11:10:47.672 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T11:10:47.781 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T11:10:47.931 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T11:10:48.019 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T11:10:48.048 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T11:10:48.081 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T11:10:48.410 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T11:10:48.452 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T11:10:48.543 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T11:10:48.573 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T11:10:48.610 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T11:10:49.024 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T11:10:49.111 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T11:10:49.115 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T11:10:49.139 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T11:10:49.146 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T11:10:49.172 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T11:10:49.209 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T11:10:49.231 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T11:10:49.498 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T11:10:49.544 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T11:10:49.634 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T11:10:49.656 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T11:10:49.693 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T11:10:50.173 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T11:10:50.205 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T11:10:50.276 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T11:10:50.298 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T11:10:51.573 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T11:10:51.611 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T11:10:52.185 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T11:10:52.222 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T11:10:52.314 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T11:10:52.314 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T11:10:52.314 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T11:10:52.314 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:10:52.357 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T11:10:52.544 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T11:10:52.586 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T11:10:53.127 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T11:10:53.164 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T11:10:53.261 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T11:10:53.261 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T11:10:53.262 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T11:10:53.262 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:10:53.299 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T11:11:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T11:11:04.365 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-05-10T11:11:04.365 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-05-10T11:11:04.365 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-05-10T11:11:04.366 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-05-10T11:11:04.366 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-05-10T11:11:04.366 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-05-10T11:11:04.366 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-05-10T11:11:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:04.546 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T11:11:04.564 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T11:11:04.564 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:04.564 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T11:11:04.564 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:04.629 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T11:11:04.629 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2024-05-10T11:11:04.629 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2024-05-10T11:11:04.629 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2024-05-10T11:11:04.629 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2024-05-10T11:11:04.630 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2024-05-10T11:11:04.630 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /root 2024-05-10T11:11:04.630 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2024-05-10T11:11:04.630 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:04.802 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T11:11:04.818 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T11:11:04.818 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:04.818 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T11:11:04.818 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:06.132 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T11:11:06.161 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T11:11:06.161 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:06.161 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T11:11:06.161 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T11:11:06.161 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T11:11:06.161 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:06.315 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T11:11:06.342 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T11:11:06.342 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:06.342 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T11:11:06.342 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T11:11:06.342 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T11:11:06.342 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:06.391 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T11:11:06.416 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T11:11:06.416 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:06.416 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T11:11:06.416 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T11:11:06.416 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T11:11:06.416 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:06.566 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T11:11:06.590 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T11:11:06.590 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:06.590 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T11:11:06.590 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T11:11:06.590 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T11:11:06.591 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:06.883 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T11:11:06.908 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T11:11:06.908 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:06.908 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T11:11:06.908 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T11:11:06.908 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T11:11:06.909 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:07.022 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T11:11:07.034 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T11:11:07.058 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T11:11:07.058 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:07.058 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T11:11:07.058 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T11:11:07.059 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T11:11:07.059 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:07.081 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T11:11:07.145 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T11:11:07.164 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T11:11:07.213 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T11:11:07.268 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T11:11:07.339 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T11:11:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T11:11:07.453 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T11:11:07.475 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T11:11:07.501 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T11:11:07.573 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T11:11:07.579 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T11:11:07.667 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T11:11:07.723 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T11:11:07.786 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T11:11:07.806 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T11:11:07.825 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T11:11:07.844 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T11:11:07.852 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T11:11:07.875 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T11:11:07.903 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T11:11:08.307 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T11:11:08.322 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T11:11:08.334 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T11:11:08.351 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T11:11:08.366 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T11:11:08.383 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T11:11:08.430 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T11:11:08.444 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T11:11:08.465 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T11:11:08.474 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T11:11:09.512 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T11:11:09.542 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T11:11:09.562 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T11:11:09.600 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T11:11:10.509 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T11:11:10.534 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T11:11:10.616 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T11:11:10.642 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T11:11:10.644 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T11:11:10.763 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T11:11:10.812 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T11:11:10.836 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T11:11:10.860 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T11:11:10.860 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:10.860 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T11:11:10.860 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T11:11:10.860 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T11:11:10.860 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:10.895 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T11:11:10.907 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T11:11:10.930 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T11:11:10.961 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T11:11:10.987 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T11:11:10.987 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:10.987 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T11:11:10.987 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T11:11:10.987 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T11:11:10.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:11.005 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T11:11:11.037 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T11:11:11.049 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T11:11:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T11:11:11.149 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T11:11:11.213 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T11:11:11.992 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T11:11:12.023 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T11:11:12.046 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T11:11:12.046 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.046 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T11:11:12.046 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T11:11:12.046 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T11:11:12.046 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:12.090 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T11:11:12.113 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T11:11:12.113 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.113 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T11:11:12.113 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:12.157 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T11:11:12.180 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T11:11:12.181 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.181 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T11:11:12.181 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T11:11:12.181 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T11:11:12.181 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T11:11:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T11:11:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T11:11:12.256 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.256 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T11:11:12.256 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T11:11:12.257 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T11:11:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T11:11:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T11:11:12.331 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.331 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T11:11:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T11:11:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T11:11:12.407 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.407 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T11:11:12.407 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T11:11:12.407 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T11:11:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:12.483 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T11:11:12.507 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T11:11:12.507 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.507 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T11:11:12.507 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T11:11:12.507 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T11:11:12.507 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T11:11:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T11:11:12.749 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T11:11:12.749 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T11:11:12.749 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T11:11:12.749 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T11:11:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:17.111 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T11:11:17.160 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T11:11:17.201 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T11:11:17.234 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T11:11:17.269 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T11:11:17.450 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T11:11:17.498 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T11:11:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T11:11:17.558 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T11:11:17.604 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T11:11:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T11:11:17.670 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T11:11:17.710 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T11:11:17.742 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T11:11:17.772 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T11:11:17.972 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T11:11:18.017 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T11:11:18.039 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T11:11:18.069 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T11:11:18.106 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T11:11:18.250 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T11:11:18.293 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T11:11:18.313 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T11:11:18.718 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T11:11:18.754 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T11:11:18.775 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T11:11:19.129 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T11:11:19.206 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T11:11:19.254 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T11:11:19.337 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T11:11:19.367 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T11:11:19.393 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T11:11:19.393 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T11:11:19.486 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T11:11:19.510 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T11:11:19.511 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T11:11:19.595 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T11:11:19.620 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T11:11:19.625 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T11:11:19.626 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T11:11:19.672 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T11:11:19.767 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T11:11:19.805 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T11:11:19.805 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T11:11:19.815 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T11:11:19.898 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T11:11:19.906 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T11:11:19.945 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T11:11:19.962 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T11:11:19.979 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T11:11:19.979 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T11:11:20.047 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T11:11:20.080 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T11:11:20.080 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T11:11:20.148 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T11:11:20.173 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T11:11:20.178 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T11:11:20.179 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T11:11:20.374 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T11:11:20.374 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T11:11:20.451 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T11:11:20.535 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T11:11:25.559 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T11:11:25.559 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T11:11:25.559 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T11:11:25.559 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T11:11:25.559 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T11:11:25.559 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T11:11:25.560 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T11:11:25.561 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T11:11:25.562 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T11:11:25.563 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T11:11:25.564 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T11:11:25.565 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T11:11:25.566 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T11:11:25.567 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T11:11:25.568 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T11:11:25.569 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T11:11:25.570 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T11:11:25.571 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T11:11:25.571 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T11:11:25.571 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T11:11:25.571 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T11:11:25.571 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T11:11:25.959 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T11:11:25.959 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T11:11:25.959 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T11:11:25.959 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T11:11:25.959 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T11:11:25.960 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T11:11:25.961 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T11:11:25.974 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T11:11:25.975 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T11:11:25.976 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T11:11:25.977 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T11:11:25.978 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T11:11:25.979 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T11:11:25.980 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T11:11:25.981 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T11:11:25.982 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T11:11:25.983 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T11:11:25.984 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T11:11:25.984 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T11:11:28.184 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T11:11:28.184 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:28.184 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T11:11:28.185 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.186 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T11:11:28.187 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T11:11:28.188 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T11:11:28.189 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T11:11:28.190 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T11:11:28.191 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T11:11:28.192 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T11:11:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T11:11:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:28.196 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-05-10T11:11:28.585 DEBUG:teuthology.parallel:result is None 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T11:11:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T11:11:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T11:11:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T11:11:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T11:11:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T11:11:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T11:11:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T11:11:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T11:11:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T11:11:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T11:11:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:28.842 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-05-10T11:11:29.252 DEBUG:teuthology.parallel:result is None 2024-05-10T11:11:29.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T11:11:29.473 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T11:11:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T11:11:29.497 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T11:11:29.497 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T11:11:29.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T11:11:29.718 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T11:11:29.747 INFO:teuthology.orchestra.run.smithi190.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T11:11:29.747 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T11:11:29.747 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T11:11:29.749 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T11:11:29.749 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:29.749 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T11:11:29.778 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:29.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T11:11:29.818 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T11:11:29.818 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:29.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T11:11:29.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T11:11:29.911 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:29.911 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T11:11:29.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T11:11:30.008 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T11:11:30.008 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:30.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T11:11:30.034 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T11:11:30.099 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:30.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T11:11:30.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T11:11:30.193 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T11:11:30.193 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:30.193 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T11:11:30.219 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T11:11:30.284 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:30.284 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T11:11:30.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T11:11:30.377 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T11:11:30.462 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T11:11:30.462 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2024-05-10T11:11:30.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2024-05-10T11:11:30.490 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T11:11:30.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T11:11:30.530 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T11:11:30.555 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T11:11:30.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T11:11:30.596 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T11:11:30.628 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-10T11:11:30.628 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-10T11:11:30.628 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-10T11:11:30.628 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:30.628 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T11:11:30.676 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T11:11:30.788 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T11:11:30.814 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:30.814 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T11:11:30.830 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T11:11:30.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T11:11:30.970 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T11:11:30.970 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T11:11:30.970 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935', 'branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': None, 'first_in_suite': False, 'job_id': '7700935', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1698, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'sleep_before_teardown': 0, 'subset': '434/512', 'suite': 'fs', 'suite_branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1fE0tuvGUT9r4jLvViOll9QjlGjOcJxgmlcC4ZK1BPbiJsdCTaJ5IeV3G6l8dhLk+RTRPD/uZPQRQ/gme5pbk=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERzjNu7/gzS5Z7wD4D+sNaH0YQYXaQZLcmzZzJUKMNGVHu1mSgevgaqEeufpMGtfs2yyfEjAP0p7X56bA6itHo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_07:38:09', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T11:11:30.971 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T11:11:30.973 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T11:11:31.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T11:11:31.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T11:11:31.085 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:31.085 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T11:11:31.109 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T11:11:31.110 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-10 11:11:20.911182347 +0000 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-10 11:09:16.939390223 +0000 2024-05-10T11:11:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-10 11:09:16.939390223 +0000 2024-05-10T11:11:31.167 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-10 11:09:16.939390223 +0000 2024-05-10T11:11:31.167 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T11:11:31.230 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-10T11:11:31.230 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-10T11:11:31.230 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.0002651 s, 1.9 MB/s 2024-05-10T11:11:31.231 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T11:11:31.288 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-05-10T11:11:31.343 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T11:11:31.343 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-10 11:11:20.911182347 +0000 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-10 11:09:17.289387715 +0000 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-10 11:09:17.289387715 +0000 2024-05-10T11:11:31.344 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-10 11:09:17.289387715 +0000 2024-05-10T11:11:31.344 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T11:11:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-10T11:11:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-10T11:11:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000174912 s, 2.9 MB/s 2024-05-10T11:11:31.409 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T11:11:31.466 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-10 11:11:20.912182339 +0000 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-10 11:09:17.646385158 +0000 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-10 11:09:17.646385158 +0000 2024-05-10T11:11:31.522 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-10 11:09:17.646385158 +0000 2024-05-10T11:11:31.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T11:11:31.586 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-10T11:11:31.586 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-10T11:11:31.586 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000177292 s, 2.9 MB/s 2024-05-10T11:11:31.587 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T11:11:31.644 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-10 11:11:20.912182339 +0000 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-10 11:09:17.989382701 +0000 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-10 11:09:17.989382701 +0000 2024-05-10T11:11:31.700 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-10 11:09:17.989382701 +0000 2024-05-10T11:11:31.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T11:11:31.763 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-10T11:11:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-10T11:11:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000187249 s, 2.7 MB/s 2024-05-10T11:11:31.765 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T11:11:31.821 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:31.822 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:31.822 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T11:11:31.839 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T11:11:31.839 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-05-10 11:11:20.333712152 +0000 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-05-10 11:09:12.181178882 +0000 2024-05-10T11:11:31.895 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-05-10 11:09:12.181178882 +0000 2024-05-10T11:11:31.896 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-05-10 11:09:12.181178882 +0000 2024-05-10T11:11:31.896 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T11:11:31.961 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-05-10T11:11:31.961 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-05-10T11:11:31.961 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000212514 s, 2.4 MB/s 2024-05-10T11:11:31.962 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T11:11:32.020 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-05-10 11:11:20.334712125 +0000 2024-05-10T11:11:32.077 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-05-10 11:09:12.551168628 +0000 2024-05-10T11:11:32.078 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-05-10 11:09:12.551168628 +0000 2024-05-10T11:11:32.078 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-05-10 11:09:12.551168628 +0000 2024-05-10T11:11:32.078 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T11:11:32.143 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-05-10T11:11:32.143 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-05-10T11:11:32.143 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00020888 s, 2.5 MB/s 2024-05-10T11:11:32.144 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T11:11:32.202 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-05-10 11:11:20.334712125 +0000 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-05-10 11:09:12.911158650 +0000 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-05-10 11:09:12.911158650 +0000 2024-05-10T11:11:32.259 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-05-10 11:09:12.911158650 +0000 2024-05-10T11:11:32.260 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T11:11:32.324 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-05-10T11:11:32.324 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-05-10T11:11:32.325 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000195094 s, 2.6 MB/s 2024-05-10T11:11:32.326 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T11:11:32.383 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-05-10T11:11:32.439 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T11:11:32.439 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-05-10 11:11:20.335712097 +0000 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-05-10 11:09:13.261148950 +0000 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-05-10 11:09:13.261148950 +0000 2024-05-10T11:11:32.440 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-05-10 11:09:13.261148950 +0000 2024-05-10T11:11:32.440 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T11:11:32.503 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-05-10T11:11:32.503 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-05-10T11:11:32.503 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000190668 s, 2.7 MB/s 2024-05-10T11:11:32.504 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T11:11:32.561 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:32.561 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T11:11:32.561 INFO:tasks.ceph:Generating config... 2024-05-10T11:11:32.562 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-10T11:11:32.562 INFO:tasks.ceph:[client] debug client = 20 2024-05-10T11:11:32.562 INFO:tasks.ceph:[client] debug ms = 1 2024-05-10T11:11:32.562 INFO:tasks.ceph:[client] pid file = 2024-05-10T11:11:32.563 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-10T11:11:32.563 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-10T11:11:32.563 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-10T11:11:32.563 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-10T11:11:32.564 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-10T11:11:32.564 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T11:11:32.564 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T11:11:32.564 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-10T11:11:32.564 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-10T11:11:32.564 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T11:11:32.564 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T11:11:32.565 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-10T11:11:32.565 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T11:11:32.565 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T11:11:32.640 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T11:11:32.643 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T11:11:32.689 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T11:11:32.715 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.66'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2024-05-10T11:11:32.715 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-10T11:11:32.716 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:32.716 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T11:11:32.771 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.66 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool: generated fsid 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:setting min_mon_release = quincy 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 0 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:fsid 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:last_changed 2024-05-10T11:11:32.859413+0000 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-05-10T11:11:32.859413+0000 2024-05-10T11:11:32.858 INFO:teuthology.orchestra.run.smithi066.stdout:min_mon_release 17 (quincy) 2024-05-10T11:11:32.859 INFO:teuthology.orchestra.run.smithi066.stdout:election_strategy: 1 2024-05-10T11:11:32.859 INFO:teuthology.orchestra.run.smithi066.stdout:0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-05-10T11:11:32.859 INFO:teuthology.orchestra.run.smithi066.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-05-10T11:11:32.859 INFO:teuthology.orchestra.run.smithi066.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2024-05-10T11:11:32.859 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T11:11:32.860 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T11:11:32.876 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 62c58463-bf48-494c-be0a-3a4b427ce317... 2024-05-10T11:11:32.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:11:32.918 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-05-10T11:11:32.960 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:11:32.961 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:11:32.962 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:11:32.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-05-10T11:11:32.964 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.965 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:11:32.966 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-05-10T11:11:32.967 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:11:32.968 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: mon down mkfs grace = 300 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-05-10T11:11:32.969 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-05-10T11:11:32.970 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:11:32.971 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.972 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.973 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.974 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-05-10T11:11:32.975 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.976 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-05-10T11:11:32.977 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.978 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:11:32.979 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.980 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:11:32.981 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-05-10T11:11:32.982 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:11:32.983 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:11:32.986 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T11:11:32.986 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T11:11:33.079 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T11:11:33.080 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:33.080 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T11:11:33.096 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:33.096 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T11:11:33.152 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:11:33.152 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:33.152 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T11:11:33.152 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T11:11:33.228 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:11:33.228 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:33.284 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:11:33.284 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:33.284 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T11:11:33.284 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T11:11:33.320 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:11:33.320 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:33.376 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T11:11:33.377 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T11:11:33.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T11:11:33.429 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T11:11:33.432 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T11:11:33.495 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T11:11:33.498 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T11:11:33.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T11:11:33.551 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T11:11:33.554 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-10T11:11:33.579 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T11:11:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T11:11:33.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-10T11:11:33.699 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T11:11:33.751 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T11:11:33.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-10T11:11:33.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T11:11:33.870 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T11:11:33.872 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-10T11:11:33.896 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T11:11:33.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T11:11:33.939 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T11:11:33.952 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-10T11:11:34.034 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-10T11:11:34.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T11:11:34.088 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T11:11:34.100 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-10T11:11:34.181 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-10T11:11:34.193 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T11:11:34.194 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T11:11:34.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T11:11:34.220 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:34.220 INFO:tasks.ceph:role: osd.0 2024-05-10T11:11:34.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:11:34.221 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T11:11:34.296 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:34.297 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:34.802 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-05-10T11:11:34.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-05-10T11:11:34.805 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T11:11:34.933 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T11:11:34.968 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T11:11:35.039 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:35.039 INFO:tasks.ceph:role: osd.1 2024-05-10T11:11:35.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:11:35.039 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T11:11:35.113 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:35.114 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:35.557 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-05-10T11:11:35.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-05-10T11:11:35.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T11:11:35.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T11:11:35.687 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T11:11:35.754 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:35.755 INFO:tasks.ceph:role: osd.2 2024-05-10T11:11:35.755 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:11:35.755 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T11:11:35.830 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:35.830 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:35.830 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:35.830 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:35.830 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:35.831 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:35.831 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:35.831 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:35.831 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:35.831 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:36.309 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-05-10T11:11:36.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-05-10T11:11:36.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T11:11:36.449 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T11:11:36.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T11:11:36.546 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:36.546 INFO:tasks.ceph:role: osd.3 2024-05-10T11:11:36.546 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:11:36.546 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T11:11:36.619 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:36.619 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:36.619 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:36.619 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:36.620 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:36.620 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:36.620 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:36.620 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:36.620 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:36.620 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:37.154 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-05-10T11:11:37.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-05-10T11:11:37.156 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T11:11:37.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T11:11:37.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:37.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:37.431+0000 7f726ba32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T11:11:37.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:37.432+0000 7f726ba32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T11:11:37.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:37.432+0000 7f726ba32640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T11:11:37.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:37.432+0000 7f726ba32640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T11:11:37.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:37.432+0000 7f726ba32640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T11:11:37.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:37.433+0000 7f726ba32640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T11:11:40.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T11:11:40.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:40.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:40.406+0000 7fc8b34b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T11:11:40.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:40.406+0000 7fc8b34b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T11:11:40.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:40.406+0000 7fc8b34b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T11:11:40.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:40.406+0000 7fc8b34b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T11:11:40.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:40.406+0000 7fc8b34b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T11:11:40.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:40.406+0000 7fc8b34b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T11:11:43.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T11:11:43.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:43.377+0000 7fcf3b716640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T11:11:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:43.377+0000 7fcf3b716640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T11:11:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:43.377+0000 7fcf3b716640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T11:11:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:43.377+0000 7fcf3b716640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T11:11:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:43.377+0000 7fcf3b716640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T11:11:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:43.378+0000 7fcf3b716640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T11:11:46.237 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T11:11:46.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:46.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:46.361+0000 7fc1fb955640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T11:11:46.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:46.362+0000 7fc1fb955640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T11:11:46.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:46.362+0000 7fc1fb955640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T11:11:46.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:46.362+0000 7fc1fb955640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T11:11:46.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:46.362+0000 7fc1fb955640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T11:11:46.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:11:46.362+0000 7fc1fb955640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T11:11:49.216 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T11:11:49.247 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T11:11:49.277 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:49.277 INFO:tasks.ceph:role: osd.4 2024-05-10T11:11:49.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:11:49.277 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T11:11:49.354 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:49.355 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:49.874 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-05-10T11:11:49.876 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-05-10T11:11:49.876 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T11:11:50.025 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T11:11:50.058 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T11:11:50.124 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:50.124 INFO:tasks.ceph:role: osd.5 2024-05-10T11:11:50.124 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:11:50.124 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T11:11:50.196 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:50.197 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:50.197 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:50.197 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:50.197 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:50.197 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:50.198 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:50.198 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:50.198 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:50.198 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:50.637 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-05-10T11:11:50.638 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-05-10T11:11:50.639 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T11:11:50.732 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T11:11:50.760 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T11:11:50.825 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:50.825 INFO:tasks.ceph:role: osd.6 2024-05-10T11:11:50.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:11:50.825 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:50.898 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:51.381 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-05-10T11:11:51.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-05-10T11:11:51.383 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T11:11:51.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T11:11:51.560 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T11:11:51.625 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T11:11:51.625 INFO:tasks.ceph:role: osd.7 2024-05-10T11:11:51.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:11:51.625 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T11:11:51.697 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T11:11:51.697 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T11:11:51.698 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T11:11:52.230 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-05-10T11:11:52.232 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-05-10T11:11:52.232 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T11:11:52.368 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T11:11:52.399 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:52.492 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:52.491+0000 7fcdc8e0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T11:11:52.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:52.492+0000 7fcdc8e0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T11:11:52.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:52.492+0000 7fcdc8e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T11:11:52.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:52.492+0000 7fcdc8e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T11:11:52.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:52.492+0000 7fcdc8e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T11:11:52.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:52.492+0000 7fcdc8e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T11:11:55.354 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T11:11:55.381 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:55.470 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:55.468+0000 7fe13601a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T11:11:55.470 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:55.469+0000 7fe13601a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T11:11:55.470 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:55.469+0000 7fe13601a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T11:11:55.470 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:55.469+0000 7fe13601a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T11:11:55.470 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:55.469+0000 7fe13601a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T11:11:55.470 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:55.469+0000 7fe13601a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T11:11:58.331 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T11:11:58.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:11:58.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:58.449+0000 7f127d210640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T11:11:58.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:58.450+0000 7f127d210640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T11:11:58.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:58.450+0000 7f127d210640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T11:11:58.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:58.450+0000 7f127d210640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T11:11:58.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:58.450+0000 7f127d210640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T11:11:58.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:11:58.450+0000 7f127d210640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T11:12:00.972 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:12:00.975 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:12:01.317 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T11:12:01.344 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:12:01.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:01.432+0000 7fe03edbc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T11:12:01.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:01.432+0000 7fe03edbc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T11:12:01.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:01.432+0000 7fe03edbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T11:12:01.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:01.432+0000 7fe03edbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T11:12:01.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:01.432+0000 7fe03edbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T11:12:01.433 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:01.433+0000 7fe03edbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T11:12:04.277 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T11:12:04.304 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T11:12:04.305 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T11:12:04.336 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.336 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-10T11:12:04.406 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.406 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-10T11:12:04.474 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T11:12:04.542 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T11:12:04.609 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T11:12:04.676 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:04.676 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T11:12:04.742 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:04.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T11:12:04.772 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:04.772 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-10T11:12:04.842 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:04.843 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-10T11:12:04.912 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:04.912 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T11:12:04.981 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:04.981 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T11:12:05.049 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:05.050 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T11:12:05.116 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:05.116 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T11:12:05.183 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:05.183 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T11:12:05.201 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:05.201 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-10T11:12:05.263 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:05.263 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T11:12:05.281 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:05.282 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-10T11:12:05.338 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T11:12:05.338 DEBUG:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T11:12:05.340 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA== 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng== 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg== 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2024-05-10T11:12:05.382 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA== 2024-05-10T11:12:05.383 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg== 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.5] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog== 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.6] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA== 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA== 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout:[client.2] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ== 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout:[client.1] 2024-05-10T11:12:05.384 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg== 2024-05-10T11:12:05.385 INFO:teuthology.orchestra.run.smithi066.stdout:[client.3] 2024-05-10T11:12:05.385 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw== 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA== 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng== 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg== 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag== 2024-05-10T11:12:05.403 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw== 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw== 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ== 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g== 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA== 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA== 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2024-05-10T11:12:05.404 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg== 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog== 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA== 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA== 2024-05-10T11:12:05.405 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout:[client.2] 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ== 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg== 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout:[client.3] 2024-05-10T11:12:05.406 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw== 2024-05-10T11:12:05.407 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T11:12:05.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T11:12:05.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.502 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.558 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.612 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.614 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.666 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.772 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T11:12:05.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T11:12:05.875 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.879 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.933 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.935 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T11:12:05.989 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:05.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.042 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.044 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.095 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.097 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.147 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.149 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T11:12:06.200 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.259 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.317 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.373 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T11:12:06.427 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T11:12:06.427 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T11:12:06.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T11:12:06.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T11:12:06.575 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T11:12:06.600 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T11:12:06.699 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T11:12:06.723 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T11:12:06.788 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T11:12:06.886 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T11:12:06.911 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:12:06.914 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T11:12:06.966 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T11:12:06.967 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T11:12:06.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T11:12:06.970 INFO:tasks.ceph.mon.a:Started 2024-05-10T11:12:06.970 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T11:12:06.970 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T11:12:07.009 INFO:tasks.ceph.mon.b:Started 2024-05-10T11:12:07.009 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T11:12:07.009 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T11:12:07.011 INFO:tasks.ceph.mon.c:Started 2024-05-10T11:12:07.011 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T11:12:07.011 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T11:12:07.011 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T11:12:07.014 INFO:tasks.ceph.mgr.y:Started 2024-05-10T11:12:07.014 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T11:12:07.014 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T11:12:07.016 INFO:tasks.ceph.mgr.x:Started 2024-05-10T11:12:07.017 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T11:12:07.017 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T11:12:07.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.121+0000 7fcf63c59640 1 Processor -- start 2024-05-10T11:12:07.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.122+0000 7fcf63c59640 1 -- start start 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.122+0000 7fcf63c59640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 0x7fcf5c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.122+0000 7fcf63c59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf5c0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.122+0000 7fcf63c59640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c0b64b0 con 0x7fcf5c162a80 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.122+0000 7fcf63c59640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c0d08d0 con 0x7fcf5c0cfc00 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.122+0000 7fcf63c59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c0d0bb0 con 0x7fcf5c0c8df0 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf621f6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf5c0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf611f4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 0x7fcf5c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf619f5640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fcf5c162a80 0x7fcf5c0d2ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:60436/0 (socket says 172.21.15.66:60436) 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf611f4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 0x7fcf5c0d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:49986/0 (socket says 172.21.15.66:49986) 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf621f6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf5c0c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:56152/0 (socket says 172.21.15.66:56152) 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf619f5640 1 -- 172.21.15.66:0/504817679 learned_addr learned my addr 172.21.15.66:0/504817679 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:07.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf611f4640 1 -- 172.21.15.66:0/504817679 >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 msgr2=0x7fcf5c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf611f4640 1 -- 172.21.15.66:0/504817679 >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 msgr2=0x7fcf5c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf611f4640 1 --2- 172.21.15.66:0/504817679 >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 0x7fcf5c0d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf621f6640 1 -- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 msgr2=0x7fcf5c0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf621f6640 1 -- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 msgr2=0x7fcf5c0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf621f6640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf5c0c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf611f4640 1 --2- 172.21.15.66:0/504817679 >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 0x7fcf5c0d0090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T11:12:07.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.123+0000 7fcf621f6640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf5c0c9260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T11:12:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.280+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815901727 0 0) 0x7fcf5c0b64b0 con 0x7fcf5c162a80 2024-05-10T11:12:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.280+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf44003520 con 0x7fcf5c162a80 2024-05-10T11:12:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146111753 0 0) 0x7fcf44003520 con 0x7fcf5c162a80 2024-05-10T11:12:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 msgr2=0x7fcf5c0c9260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T11:12:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf5c0c9260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 msgr2=0x7fcf5c0d0090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 --2- 172.21.15.66:0/504817679 >> v2:172.21.15.190:3300/0 conn(0x7fcf5c0cfc00 0x7fcf5c0d0090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c0d05d0 con 0x7fcf5c162a80 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fcf54001670 con 0x7fcf5c162a80 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 >> v1:172.21.15.190:6789/0 conn(0x7fcf5c162a80 legacy=0x7fcf5c0d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44004d40 0x7fcf440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0d08d0 con 0x7fcf440039b0 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0d0bb0 con 0x7fcf44004d40 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4400baf0 con 0x7fcf5c0c8df0 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf619f5640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf621f6640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44004d40 0x7fcf440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf611f4640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf619f5640 1 -- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 msgr2=0x7fcf44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:07.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf619f5640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.281+0000 7fcf619f5640 1 -- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44004d40 msgr2=0x7fcf440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:07.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.282+0000 7fcf619f5640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44004d40 0x7fcf440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.282+0000 7fcf619f5640 1 -- 172.21.15.66:0/504817679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf44003520 con 0x7fcf440039b0 2024-05-10T11:12:07.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.282+0000 7fcf611f4640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c0c8df0 0x7fcf44004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:07.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.282+0000 7fcf619f5640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf44003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf54001050 tx=0x7fcf44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47042ea7ab40d26 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:07.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.283+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5402e070 con 0x7fcf440039b0 2024-05-10T11:12:07.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.283+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54005af0 con 0x7fcf440039b0 2024-05-10T11:12:07.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.283+0000 7fcf609f3640 1 -- 172.21.15.66:0/504817679 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54007d70 con 0x7fcf440039b0 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf63c59640 1 -- 172.21.15.66:0/504817679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 msgr2=0x7fcf44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf63c59640 1 --2- 172.21.15.66:0/504817679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf44003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf54001050 tx=0x7fcf44005830 comp rx=0 tx=0).stop 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf621f6640 1 -- 172.21.15.66:0/504817679 reap_dead start 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf63c59640 1 -- 172.21.15.66:0/504817679 shutdown_connections 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf63c59640 1 -- 172.21.15.66:0/504817679 >> 172.21.15.66:0/504817679 conn(0x7fcf5c0d50f0 msgr2=0x7fcf5c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf63c59640 1 -- 172.21.15.66:0/504817679 shutdown_connections 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.284+0000 7fcf63c59640 1 -- 172.21.15.66:0/504817679 wait complete. 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.286+0000 7fcf63c59640 1 Processor -- start 2024-05-10T11:12:07.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.286+0000 7fcf63c59640 1 -- start start 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf63c59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf5c0b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf63c59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c1f6160 0x7fcf5c1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf63c59640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf5c1504d0 0x7fcf5c0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf63c59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0d5e40 con 0x7fcf440039b0 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf63c59640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0b6140 con 0x7fcf5c1504d0 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf63c59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c162e60 con 0x7fcf5c1f6160 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf619f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf5c0b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf619f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf5c0b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60144/0 (socket says 172.21.15.66:60144) 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf621f6640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf5c1504d0 0x7fcf5c0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf619f5640 1 -- 172.21.15.66:0/981210900 learned_addr learned my addr 172.21.15.66:0/981210900 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.287+0000 7fcf611f4640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c1f6160 0x7fcf5c1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf621f6640 1 -- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c1f6160 msgr2=0x7fcf5c1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf621f6640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c1f6160 0x7fcf5c1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf621f6640 1 -- 172.21.15.66:0/981210900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 msgr2=0x7fcf5c0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf621f6640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf5c0b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf621f6640 1 -- 172.21.15.66:0/981210900 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c1f6620 con 0x7fcf5c1504d0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf611f4640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c1f6160 0x7fcf5c1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf619f5640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf5c0b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.288+0000 7fcf621f6640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf5c1504d0 0x7fcf5c0d13b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c074800 tx=0x7fcf4c00f520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000b5e0 con 0x7fcf5c1504d0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c003990 con 0x7fcf5c1504d0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c1f6900 con 0x7fcf5c1504d0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c003d80 con 0x7fcf5c1504d0 2024-05-10T11:12:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1f6ec0 con 0x7fcf5c1504d0 2024-05-10T11:12:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcf4c0043c0 con 0x7fcf5c1504d0 2024-05-10T11:12:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.289+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcf4c01e400 con 0x7fcf5c1504d0 2024-05-10T11:12:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.290+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c0693f0 con 0x7fcf5c1504d0 2024-05-10T11:12:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.292+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcf4c023020 con 0x7fcf5c1504d0 2024-05-10T11:12:07.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.358+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fcf5c1e91a0 con 0x7fcf5c1504d0 2024-05-10T11:12:07.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.361+0000 7fcf5a7fc640 1 -- 172.21.15.66:0/981210900 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fcf4c015dd0 con 0x7fcf5c1504d0 2024-05-10T11:12:07.362 INFO:teuthology.orchestra.run.smithi066.stderr:adjusted tunables profile to default 2024-05-10T11:12:07.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf5c1504d0 msgr2=0x7fcf5c0d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf5c1504d0 0x7fcf5c0d13b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c074800 tx=0x7fcf4c00f520 comp rx=0 tx=0).stop 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 shutdown_connections 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf5c1504d0 0x7fcf5c0d13b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf5c1f6160 0x7fcf5c1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 --2- 172.21.15.66:0/981210900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf440039b0 0x7fcf5c0b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 >> 172.21.15.66:0/981210900 conn(0x7fcf5c0d50f0 msgr2=0x7fcf5c06e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 shutdown_connections 2024-05-10T11:12:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:07.363+0000 7fcf63c59640 1 -- 172.21.15.66:0/981210900 wait complete. 2024-05-10T11:12:07.378 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T11:12:07.378 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T11:12:07.378 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:07.378 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T11:12:07.391 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:07.391+0000 7f9b67a0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T11:12:07.404 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:07.404 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T11:12:07.413 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:07.412+0000 7f014f3c0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T11:12:07.438 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:07.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T11:12:07.504 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:07.504 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T11:12:07.551 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:07.551+0000 7f9b67a0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T11:12:07.570 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:07.570 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T11:12:07.595 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:07.595 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T11:12:07.605 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:07.605+0000 7f014f3c0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T11:12:07.606 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:07.607+0000 7f9b67a0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T11:12:07.630 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:07.630 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T11:12:07.661 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:07.661+0000 7f014f3c0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T11:12:07.695 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:07.695 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T11:12:07.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ad6cadaf-6a83-4687-a77c-b48d927dcb0e 0 2024-05-10T11:12:07.868 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:07.868+0000 7f9b67a0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T11:12:07.901 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.901+0000 7f5089037640 1 Processor -- start 2024-05-10T11:12:07.901 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.901+0000 7f5089037640 1 -- start start 2024-05-10T11:12:07.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f5089037640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f508406d9e0 0x7f50840ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f5089037640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50840b4530 con 0x7f5084162780 2024-05-10T11:12:07.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f5089037640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50840b4810 con 0x7f508406e8b0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f5089037640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50840b4af0 con 0x7f508406d9e0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f508259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f508406d9e0 0x7f50840ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f508359e640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f508406e8b0 0x7f50840b55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:59002/0 (socket says 172.21.15.190:59002) 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.902+0000 7f508359e640 1 -- 172.21.15.190:0/3848427735 learned_addr learned my addr 172.21.15.190:0/3848427735 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.903+0000 7f508259c640 1 -- 172.21.15.190:0/3848427735 >> v1:172.21.15.190:6789/0 conn(0x7f508406e8b0 legacy=0x7f50840b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.903+0000 7f508259c640 1 -- 172.21.15.190:0/3848427735 >> v1:172.21.15.66:6789/0 conn(0x7f5084162780 legacy=0x7f508406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.903+0000 7f508259c640 1 -- 172.21.15.190:0/3848427735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50840b4dd0 con 0x7f508406d9e0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.903+0000 7f5081d9b640 1 -- 172.21.15.190:0/3848427735 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175332379 0 0) 0x7f50840b4810 con 0x7f508406e8b0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.903+0000 7f508259c640 1 --2- 172.21.15.190:0/3848427735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f508406d9e0 0x7f50840ae890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f50780097d0 tx=0x7f507802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7a1ed3eb1393ee3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5081d9b640 1 -- 172.21.15.190:0/3848427735 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078037070 con 0x7f508406d9e0 2024-05-10T11:12:07.904 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5081d9b640 1 -- 172.21.15.190:0/3848427735 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5078032440 con 0x7f508406d9e0 2024-05-10T11:12:07.905 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5081d9b640 1 -- 172.21.15.190:0/3848427735 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078032810 con 0x7f508406d9e0 2024-05-10T11:12:07.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 -- 172.21.15.190:0/3848427735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f508406d9e0 msgr2=0x7f50840ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 --2- 172.21.15.190:0/3848427735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f508406d9e0 0x7f50840ae890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f50780097d0 tx=0x7f507802a210 comp rx=0 tx=0).stop 2024-05-10T11:12:07.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 -- 172.21.15.190:0/3848427735 shutdown_connections 2024-05-10T11:12:07.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 --2- 172.21.15.190:0/3848427735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f508406d9e0 0x7f50840ae890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 -- 172.21.15.190:0/3848427735 >> 172.21.15.190:0/3848427735 conn(0x7f50840727e0 msgr2=0x7f5084072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:07.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 -- 172.21.15.190:0/3848427735 shutdown_connections 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.904+0000 7f5089037640 1 -- 172.21.15.190:0/3848427735 wait complete. 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 Processor -- start 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 -- start start 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 0x7f50841506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f508406e8b0 0x7f508406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 0x7f508406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5084073300 con 0x7f508406e8b0 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5084162b60 con 0x7f508406d9e0 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.906+0000 7f5089037640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5084073480 con 0x7f5084162780 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 0x7f508406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f5082d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 0x7f50841506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 0x7f508406d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55420/0 (socket says 172.21.15.190:55420) 2024-05-10T11:12:07.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f5082d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 0x7f50841506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50098/0 (socket says 172.21.15.190:50098) 2024-05-10T11:12:07.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 -- 172.21.15.190:0/2871869420 learned_addr learned my addr 172.21.15.190:0/2871869420 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:07.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508259c640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f508406e8b0 0x7f508406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:07.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 -- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 msgr2=0x7f50841506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 0x7f50841506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 -- 172.21.15.190:0/2871869420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f508406e8b0 msgr2=0x7f508406cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f508406e8b0 0x7f508406cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 -- 172.21.15.190:0/2871869420 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5084151240 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f5082d9d640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 0x7f50841506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f508359e640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 0x7f508406d330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c7d0 tx=0x7f507c00cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c018070 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c00a640 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508415b3e0 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c00aa70 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f508415b9a0 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f507c01b070 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.907+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f507c01d780 con 0x7f5084162780 2024-05-10T11:12:07.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.908+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50840693f0 con 0x7f5084162780 2024-05-10T11:12:07.912 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.910+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f507c0078f0 con 0x7f5084162780 2024-05-10T11:12:07.917 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:07.918+0000 7f9b67a0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T11:12:07.926 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:07.926+0000 7f014f3c0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T11:12:07.974 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:07.974+0000 7f014f3c0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T11:12:07.983 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.983+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad6cadaf-6a83-4687-a77c-b48d927dcb0e", "id": 0} v 0) -- 0x7f5084068660 con 0x7f5084162780 2024-05-10T11:12:07.986 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.987+0000 7f506b7fe640 1 -- 172.21.15.190:0/2871869420 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad6cadaf-6a83-4687-a77c-b48d927dcb0e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f507c00ac10 con 0x7f5084162780 2024-05-10T11:12:07.987 INFO:teuthology.orchestra.run.smithi190.stdout:0 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 msgr2=0x7f508406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 0x7f508406d330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c7d0 tx=0x7f507c00cc90 comp rx=0 tx=0).stop 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 shutdown_connections 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5084162780 0x7f508406d330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f508406e8b0 0x7f508406cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 --2- 172.21.15.190:0/2871869420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508406d9e0 0x7f50841506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 >> 172.21.15.190:0/2871869420 conn(0x7f50840727e0 msgr2=0x7f50840b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 shutdown_connections 2024-05-10T11:12:07.988 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:07.988+0000 7f5089037640 1 -- 172.21.15.190:0/2871869420 wait complete. 2024-05-10T11:12:07.999 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new cdb127d7-8507-4ca4-b18a-41dc0755f961 1 2024-05-10T11:12:08.097 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.098+0000 7f19b8c83640 1 Processor -- start 2024-05-10T11:12:08.098 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.098+0000 7f19b8c83640 1 -- start start 2024-05-10T11:12:08.099 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b8c83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b40cc4a0 0x7f19b415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.099 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b8c83640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 0x7f19b40cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.099 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b8c83640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19b415fc20 con 0x7f19b4071540 2024-05-10T11:12:08.099 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b8c83640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f19b415ff00 con 0x7f19b40ce310 2024-05-10T11:12:08.099 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b8c83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f19b41601e0 con 0x7f19b40cc4a0 2024-05-10T11:12:08.099 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b2d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 0x7f19b40cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b40cc4a0 0x7f19b415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b2d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 0x7f19b40cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50110/0 (socket says 172.21.15.190:50110) 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b2d9d640 1 -- 172.21.15.190:0/3582578112 learned_addr learned my addr 172.21.15.190:0/3582578112 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b259c640 1 -- 172.21.15.190:0/3582578112 >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 msgr2=0x7f19b40cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b259c640 1 --2- 172.21.15.190:0/3582578112 >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 0x7f19b40cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b259c640 1 -- 172.21.15.190:0/3582578112 >> v1:172.21.15.66:6789/0 conn(0x7f19b4071540 legacy=0x7f19b40cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b259c640 1 -- 172.21.15.190:0/3582578112 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b41604c0 con 0x7f19b40cc4a0 2024-05-10T11:12:08.100 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.099+0000 7f19b2d9d640 1 --2- 172.21.15.190:0/3582578112 >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 0x7f19b40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:08.101 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.100+0000 7f19b259c640 1 --2- 172.21.15.190:0/3582578112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b40cc4a0 0x7f19b415f5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19a40097a0 tx=0x7f19a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f109330d632392 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.101 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.100+0000 7f19b159a640 1 -- 172.21.15.190:0/3582578112 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4037070 con 0x7f19b40cc4a0 2024-05-10T11:12:08.101 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.100+0000 7f19b159a640 1 -- 172.21.15.190:0/3582578112 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a4032440 con 0x7f19b40cc4a0 2024-05-10T11:12:08.101 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.100+0000 7f19b159a640 1 -- 172.21.15.190:0/3582578112 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4032810 con 0x7f19b40cc4a0 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 -- 172.21.15.190:0/3582578112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b40cc4a0 msgr2=0x7f19b415f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 --2- 172.21.15.190:0/3582578112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b40cc4a0 0x7f19b415f5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19a40097a0 tx=0x7f19a402a180 comp rx=0 tx=0).stop 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 -- 172.21.15.190:0/3582578112 shutdown_connections 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 --2- 172.21.15.190:0/3582578112 >> v2:172.21.15.190:3300/0 conn(0x7f19b40ce310 0x7f19b40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 --2- 172.21.15.190:0/3582578112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b40cc4a0 0x7f19b415f5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 -- 172.21.15.190:0/3582578112 >> 172.21.15.190:0/3582578112 conn(0x7f19b40b3fb0 msgr2=0x7f19b40d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 -- 172.21.15.190:0/3582578112 shutdown_connections 2024-05-10T11:12:08.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.101+0000 7f19b8c83640 1 -- 172.21.15.190:0/3582578112 wait complete. 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.102+0000 7f19b8c83640 1 Processor -- start 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.102+0000 7f19b8c83640 1 -- start start 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b8c83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 0x7f19b40b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b8c83640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b40cc4a0 0x7f19b40c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b8c83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19b40ce310 0x7f19b40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b8c83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41632a0 con 0x7f19b40ce310 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b8c83640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19b4163120 con 0x7f19b40cc4a0 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b8c83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f19b4163420 con 0x7f19b4071540 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 0x7f19b40b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b1d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b40cc4a0 0x7f19b40c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 0x7f19b40b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55436/0 (socket says 172.21.15.190:55436) 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 -- 172.21.15.190:0/633454619 learned_addr learned my addr 172.21.15.190:0/633454619 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b2d9d640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19b40ce310 0x7f19b40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 -- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b40cc4a0 msgr2=0x7f19b40c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b40cc4a0 0x7f19b40c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 -- 172.21.15.190:0/633454619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19b40ce310 msgr2=0x7f19b40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19b40ce310 0x7f19b40ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 -- 172.21.15.190:0/633454619 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b40b7860 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b1d9b640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b40cc4a0 0x7f19b40c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.103+0000 7f19b259c640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 0x7f19b40b5fd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19a40098c0 tx=0x7f19a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4037040 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a4030500 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b40b7b40 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a40308d0 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b40c9c30 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19a4044020 con 0x7f19b4071540 2024-05-10T11:12:08.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.104+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f19a403bc80 con 0x7f19b4071540 2024-05-10T11:12:08.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.105+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b40693f0 con 0x7f19b4071540 2024-05-10T11:12:08.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.108+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f19a403b430 con 0x7f19b4071540 2024-05-10T11:12:08.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.179+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdb127d7-8507-4ca4-b18a-41dc0755f961", "id": 1} v 0) -- 0x7f19b40d2950 con 0x7f19b4071540 2024-05-10T11:12:08.182 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.182+0000 7f19a2ffd640 1 -- 172.21.15.190:0/633454619 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdb127d7-8507-4ca4-b18a-41dc0755f961", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f19a403b610 con 0x7f19b4071540 2024-05-10T11:12:08.182 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-05-10T11:12:08.183 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 msgr2=0x7f19b40b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.183 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 0x7f19b40b5fd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19a40098c0 tx=0x7f19a40046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.183 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 shutdown_connections 2024-05-10T11:12:08.183 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19b40ce310 0x7f19b40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.183 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b40cc4a0 0x7f19b40c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.184 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 --2- 172.21.15.190:0/633454619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19b4071540 0x7f19b40b5fd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.184 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 >> 172.21.15.190:0/633454619 conn(0x7f19b40b3fb0 msgr2=0x7f19b415e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.184 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 shutdown_connections 2024-05-10T11:12:08.184 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.183+0000 7f19b8c83640 1 -- 172.21.15.190:0/633454619 wait complete. 2024-05-10T11:12:08.193 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9 2 2024-05-10T11:12:08.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.295+0000 7f5311054640 1 Processor -- start 2024-05-10T11:12:08.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.295+0000 7f5311054640 1 -- start start 2024-05-10T11:12:08.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f5311054640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f530c0b3bb0 0x7f530c0b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f5311054640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c0b2b50 con 0x7f530c15f4f0 2024-05-10T11:12:08.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f5311054640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c0b2df0 con 0x7f530c06e2d0 2024-05-10T11:12:08.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f5311054640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f530c0b4710 con 0x7f530c0b3bb0 2024-05-10T11:12:08.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f530b59e640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f530c06e2d0 0x7f530c0d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:59006/0 (socket says 172.21.15.190:59006) 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f530b59e640 1 -- 172.21.15.190:0/1312692183 learned_addr learned my addr 172.21.15.190:0/1312692183 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f5303fff640 1 --2- 172.21.15.190:0/1312692183 >> v2:172.21.15.66:3300/0 conn(0x7f530c0b3bb0 0x7f530c0b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832996665 0 0) 0x7f530c0b2df0 con 0x7f530c06e2d0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f8003520 con 0x7f530c06e2d0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998900585 0 0) 0x7f530c0b2b50 con 0x7f530c15f4f0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.296+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530c0b2df0 con 0x7f530c15f4f0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f5303fff640 1 -- 172.21.15.190:0/1312692183 >> v1:172.21.15.190:6789/0 conn(0x7f530c06e2d0 legacy=0x7f530c0d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f5303fff640 1 -- 172.21.15.190:0/1312692183 >> v1:172.21.15.66:6789/0 conn(0x7f530c15f4f0 legacy=0x7f530c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f5303fff640 1 -- 172.21.15.190:0/1312692183 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c0b30d0 con 0x7f530c0b3bb0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f5303fff640 1 --2- 172.21.15.190:0/1312692183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c0b3bb0 0x7f530c0b41d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097a0 tx=0x7f52f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e859a7d30da63e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4037070 con 0x7f530c0b3bb0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f4032440 con 0x7f530c0b3bb0 2024-05-10T11:12:08.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.297+0000 7f530a59c640 1 -- 172.21.15.190:0/1312692183 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4032810 con 0x7f530c0b3bb0 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 -- 172.21.15.190:0/1312692183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c0b3bb0 msgr2=0x7f530c0b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 --2- 172.21.15.190:0/1312692183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c0b3bb0 0x7f530c0b41d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097a0 tx=0x7f52f402a230 comp rx=0 tx=0).stop 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 -- 172.21.15.190:0/1312692183 shutdown_connections 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 --2- 172.21.15.190:0/1312692183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c0b3bb0 0x7f530c0b41d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 -- 172.21.15.190:0/1312692183 >> 172.21.15.190:0/1312692183 conn(0x7f530c09ba20 msgr2=0x7f530c09be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 -- 172.21.15.190:0/1312692183 shutdown_connections 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.298+0000 7f5311054640 1 -- 172.21.15.190:0/1312692183 wait complete. 2024-05-10T11:12:08.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.299+0000 7f5311054640 1 Processor -- start 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.299+0000 7f5311054640 1 -- start start 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5311054640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f530c06e2d0 0x7f530c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5311054640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 0x7f530c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5311054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c15f4f0 0x7f530c1610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5311054640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f530c15f8d0 con 0x7f530c15f4f0 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5311054640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f530c0b3690 con 0x7f530c0b3bb0 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5311054640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f530c0b2060 con 0x7f530c06e2d0 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5303fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 0x7f530c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f530ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f530c06e2d0 0x7f530c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5303fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 0x7f530c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50118/0 (socket says 172.21.15.190:50118) 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f5303fff640 1 -- 172.21.15.190:0/2315349485 learned_addr learned my addr 172.21.15.190:0/2315349485 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.300+0000 7f530b59e640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c15f4f0 0x7f530c1610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f530ad9d640 1 -- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 msgr2=0x7f530c0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f530ad9d640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 0x7f530c0cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f530ad9d640 1 -- 172.21.15.190:0/2315349485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c15f4f0 msgr2=0x7f530c1610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f530ad9d640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c15f4f0 0x7f530c1610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f530ad9d640 1 -- 172.21.15.190:0/2315349485 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c150790 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f5303fff640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 0x7f530c0cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f530ad9d640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f530c06e2d0 0x7f530c14fbd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c390 tx=0x7f52fc00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc017070 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52fc0052d0 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530c160d90 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc003830 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f530c0ca070 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52fc01a070 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.301+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f52fc012420 con 0x7f530c06e2d0 2024-05-10T11:12:08.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.302+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530c160830 con 0x7f530c06e2d0 2024-05-10T11:12:08.305 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.304+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f530c160830 con 0x7f530c06e2d0 2024-05-10T11:12:08.376 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.377+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9", "id": 2} v 0) -- 0x7f530c0693f0 con 0x7f530c06e2d0 2024-05-10T11:12:08.382 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.382+0000 7f53037fe640 1 -- 172.21.15.190:0/2315349485 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f52fc021070 con 0x7f530c06e2d0 2024-05-10T11:12:08.382 INFO:teuthology.orchestra.run.smithi190.stdout:2 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f530c06e2d0 msgr2=0x7f530c14fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f530c06e2d0 0x7f530c14fbd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c390 tx=0x7f52fc00c850 comp rx=0 tx=0).stop 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 shutdown_connections 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f530c15f4f0 0x7f530c1610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530c0b3bb0 0x7f530c0cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 --2- 172.21.15.190:0/2315349485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f530c06e2d0 0x7f530c14fbd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 >> 172.21.15.190:0/2315349485 conn(0x7f530c09ba20 msgr2=0x7f530c15e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 shutdown_connections 2024-05-10T11:12:08.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.383+0000 7f5311054640 1 -- 172.21.15.190:0/2315349485 wait complete. 2024-05-10T11:12:08.393 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 3af283de-9cfe-4cf8-8546-4bb0e32a9094 3 2024-05-10T11:12:08.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.493+0000 7f9ad1409640 1 Processor -- start 2024-05-10T11:12:08.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.493+0000 7f9ad1409640 1 -- start start 2024-05-10T11:12:08.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9ad1409640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9acc160450 0x7f9acc0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9ad1409640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9acc0d0000 con 0x7f9acc0b0b20 2024-05-10T11:12:08.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9ad1409640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9acc073920 con 0x7f9acc073490 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9ad1409640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9acc0d02a0 con 0x7f9acc160450 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9acaffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9acc160450 0x7f9acc0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9acaffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9acc160450 0x7f9acc0d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50126/0 (socket says 172.21.15.190:50126) 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9acaffd640 1 -- 172.21.15.190:0/3408378501 learned_addr learned my addr 172.21.15.190:0/3408378501 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9acaffd640 1 -- 172.21.15.190:0/3408378501 >> v1:172.21.15.190:6789/0 conn(0x7f9acc073490 legacy=0x7f9acc06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9acaffd640 1 -- 172.21.15.190:0/3408378501 >> v1:172.21.15.66:6789/0 conn(0x7f9acc0b0b20 legacy=0x7f9acc0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.494+0000 7f9acaffd640 1 -- 172.21.15.190:0/3408378501 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc0d0580 con 0x7f9acc160450 2024-05-10T11:12:08.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.495+0000 7f9acaffd640 1 --2- 172.21.15.190:0/3408378501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc160450 0x7f9acc0d0d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c13bb5f76ab0b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.495+0000 7f9ac9ffb640 1 -- 172.21.15.190:0/3408378501 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc037070 con 0x7f9acc160450 2024-05-10T11:12:08.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.495+0000 7f9ac9ffb640 1 -- 172.21.15.190:0/3408378501 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc02ae50 con 0x7f9acc160450 2024-05-10T11:12:08.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.495+0000 7f9ac9ffb640 1 -- 172.21.15.190:0/3408378501 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc032860 con 0x7f9acc160450 2024-05-10T11:12:08.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 -- 172.21.15.190:0/3408378501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc160450 msgr2=0x7f9acc0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 --2- 172.21.15.190:0/3408378501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc160450 0x7f9acc0d0d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc02a300 comp rx=0 tx=0).stop 2024-05-10T11:12:08.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 -- 172.21.15.190:0/3408378501 shutdown_connections 2024-05-10T11:12:08.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 --2- 172.21.15.190:0/3408378501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc160450 0x7f9acc0d0d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 -- 172.21.15.190:0/3408378501 >> 172.21.15.190:0/3408378501 conn(0x7f9acc0727e0 msgr2=0x7f9acc072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 -- 172.21.15.190:0/3408378501 shutdown_connections 2024-05-10T11:12:08.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.496+0000 7f9ad1409640 1 -- 172.21.15.190:0/3408378501 wait complete. 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.497+0000 7f9ad1409640 1 Processor -- start 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.497+0000 7f9ad1409640 1 -- start start 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9ad1409640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9acc0b0b20 0x7f9acc141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9ad1409640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9acc160450 0x7f9acc1e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9ad1409640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 0x7f9acc15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9ad1409640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc1609b0 con 0x7f9acc0b0b20 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9ad1409640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc160830 con 0x7f9acc15ea40 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9ad1409640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9acc0d12c0 con 0x7f9acc160450 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9acb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 0x7f9acc15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9aca7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9acc160450 0x7f9acc1e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9acb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 0x7f9acc15eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50138/0 (socket says 172.21.15.190:50138) 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9acb7fe640 1 -- 172.21.15.190:0/260902358 learned_addr learned my addr 172.21.15.190:0/260902358 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.500 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.498+0000 7f9acaffd640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9acc0b0b20 0x7f9acc141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9acb7fe640 1 -- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9acc160450 msgr2=0x7f9acc1e6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9acb7fe640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9acc160450 0x7f9acc1e6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9acb7fe640 1 -- 172.21.15.190:0/260902358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9acc0b0b20 msgr2=0x7f9acc141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9acb7fe640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9acc0b0b20 0x7f9acc141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9acb7fe640 1 -- 172.21.15.190:0/260902358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc142810 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9aca7fc640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9acc160450 0x7f9acc1e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9acb7fe640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 0x7f9acc15eef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c7d0 tx=0x7f9ac400cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4003b70 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4003d30 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400aa90 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc142af0 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1430b0 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ac400ac30 con 0x7f9acc15ea40 2024-05-10T11:12:08.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.499+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9ac4012a90 con 0x7f9acc15ea40 2024-05-10T11:12:08.502 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.500+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9acc0693f0 con 0x7f9acc15ea40 2024-05-10T11:12:08.502 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.502+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9ac4012d30 con 0x7f9acc15ea40 2024-05-10T11:12:08.574 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.574+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3af283de-9cfe-4cf8-8546-4bb0e32a9094", "id": 3} v 0) -- 0x7f9acc068660 con 0x7f9acc15ea40 2024-05-10T11:12:08.579 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.579+0000 7f9ab37fe640 1 -- 172.21.15.190:0/260902358 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3af283de-9cfe-4cf8-8546-4bb0e32a9094", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9ac4012600 con 0x7f9acc15ea40 2024-05-10T11:12:08.579 INFO:teuthology.orchestra.run.smithi190.stdout:3 2024-05-10T11:12:08.580 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.580+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 msgr2=0x7f9acc15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.580 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.580+0000 7f9ad1409640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 0x7f9acc15eef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c7d0 tx=0x7f9ac400cc90 comp rx=0 tx=0).stop 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.580+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 shutdown_connections 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.581+0000 7f9ad1409640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9acc15ea40 0x7f9acc15eef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.581+0000 7f9ad1409640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9acc160450 0x7f9acc1e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.581+0000 7f9ad1409640 1 --2- 172.21.15.190:0/260902358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9acc0b0b20 0x7f9acc141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.581+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 >> 172.21.15.190:0/260902358 conn(0x7f9acc0727e0 msgr2=0x7f9acc06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.581+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 shutdown_connections 2024-05-10T11:12:08.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.581+0000 7f9ad1409640 1 -- 172.21.15.190:0/260902358 wait complete. 2024-05-10T11:12:08.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 31e19cbf-96f8-4397-9cf5-512d3daff538 4 2024-05-10T11:12:08.689 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.689+0000 7f0ab8dd4640 1 Processor -- start 2024-05-10T11:12:08.689 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.689+0000 7f0ab8dd4640 1 -- start start 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.690+0000 7f0ab8dd4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0ab40d1480 0x7f0ab40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.690+0000 7f0ab8dd4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 0x7f0ab40b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.690+0000 7f0ab8dd4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab40cd9b0 con 0x7f0ab415d190 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.690+0000 7f0ab8dd4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab40d1e20 con 0x7f0ab40d1480 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.690+0000 7f0ab8dd4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab40afe60 con 0x7f0ab40b0f00 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 0x7f0ab40b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 0x7f0ab40b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55470/0 (socket says 172.21.15.190:55470) 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/2552927119 learned_addr learned my addr 172.21.15.190:0/2552927119 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.691 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab1d9b640 1 --2- 172.21.15.190:0/2552927119 >> v2:172.21.15.66:3300/0 conn(0x7f0ab40d1480 0x7f0ab40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.692 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/2552927119 >> v2:172.21.15.66:3300/0 conn(0x7f0ab40d1480 msgr2=0x7f0ab40d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:08.692 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 --2- 172.21.15.190:0/2552927119 >> v2:172.21.15.66:3300/0 conn(0x7f0ab40d1480 0x7f0ab40d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.692 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/2552927119 >> v1:172.21.15.66:6789/0 conn(0x7f0ab415d190 legacy=0x7f0ab40b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.692 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.691+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/2552927119 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab40b0140 con 0x7f0ab40b0f00 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.692+0000 7f0ab2d9d640 1 --2- 172.21.15.190:0/2552927119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 0x7f0ab40b1390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009e50 tx=0x7f0aac02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2978b220c045864 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.692+0000 7f0ab159a640 1 -- 172.21.15.190:0/2552927119 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac036070 con 0x7f0ab40b0f00 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.692+0000 7f0ab159a640 1 -- 172.21.15.190:0/2552927119 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac031600 con 0x7f0ab40b0f00 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.692+0000 7f0ab159a640 1 -- 172.21.15.190:0/2552927119 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0319d0 con 0x7f0ab40b0f00 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.692+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/2552927119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 msgr2=0x7f0ab40b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.692+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/2552927119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 0x7f0ab40b1390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009e50 tx=0x7f0aac02a710 comp rx=0 tx=0).stop 2024-05-10T11:12:08.693 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.693+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/2552927119 shutdown_connections 2024-05-10T11:12:08.694 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.693+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/2552927119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40b0f00 0x7f0ab40b1390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.694 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.693+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/2552927119 >> v2:172.21.15.66:3300/0 conn(0x7f0ab40d1480 0x7f0ab40d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.694 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.693+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/2552927119 >> 172.21.15.190:0/2552927119 conn(0x7f0ab409ba20 msgr2=0x7f0ab409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.694 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.693+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/2552927119 shutdown_connections 2024-05-10T11:12:08.694 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.693+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/2552927119 wait complete. 2024-05-10T11:12:08.696 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.694+0000 7f0ab8dd4640 1 Processor -- start 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.694+0000 7f0ab8dd4640 1 -- start start 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab8dd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab40b0f00 0x7f0ab40b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab8dd4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 0x7f0ab4157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab8dd4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 0x7f0ab415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab8dd4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab40b09e0 con 0x7f0ab40b0f00 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab8dd4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab40b0700 con 0x7f0ab415d190 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab8dd4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab40afaf0 con 0x7f0ab40d1480 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab1d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 0x7f0ab4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 0x7f0ab415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab1d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 0x7f0ab4157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55478/0 (socket says 172.21.15.190:55478) 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 0x7f0ab415fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50146/0 (socket says 172.21.15.190:50146) 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab1d9b640 1 -- 172.21.15.190:0/3825145746 learned_addr learned my addr 172.21.15.190:0/3825145746 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.697 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab259c640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab40b0f00 0x7f0ab40b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 msgr2=0x7f0ab4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 0x7f0ab4157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/3825145746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab40b0f00 msgr2=0x7f0ab40b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab40b0f00 0x7f0ab40b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 -- 172.21.15.190:0/3825145746 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab41565c0 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab1d9b640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 0x7f0ab4157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0ab2d9d640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 0x7f0ab415fe40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0aac030000 tx=0x7f0aac004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.695+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac009510 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.696+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac03ab50 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.696+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0443f0 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.696+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab4155a40 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.696+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab4156000 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.696+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0aac04b060 con 0x7f0ab415d190 2024-05-10T11:12:08.698 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.696+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f0aac044b80 con 0x7f0ab415d190 2024-05-10T11:12:08.699 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.697+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab4069e60 con 0x7f0ab415d190 2024-05-10T11:12:08.699 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.698+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0ab4069e60 con 0x7f0ab415d190 2024-05-10T11:12:08.724 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:08.724+0000 7f014f3c0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T11:12:08.735 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:08.735+0000 7f9b67a0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T11:12:08.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.771+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31e19cbf-96f8-4397-9cf5-512d3daff538", "id": 4} v 0) -- 0x7f0ab40693f0 con 0x7f0ab415d190 2024-05-10T11:12:08.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.777+0000 7f0aa2ffd640 1 -- 172.21.15.190:0/3825145746 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31e19cbf-96f8-4397-9cf5-512d3daff538", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f0aac052020 con 0x7f0ab415d190 2024-05-10T11:12:08.776 INFO:teuthology.orchestra.run.smithi190.stdout:4 2024-05-10T11:12:08.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.777+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 msgr2=0x7f0ab415fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.777+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 0x7f0ab415fe40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0aac030000 tx=0x7f0aac004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 shutdown_connections 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ab415d190 0x7f0ab415fe40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab40d1480 0x7f0ab4157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 --2- 172.21.15.190:0/3825145746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab40b0f00 0x7f0ab40b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 >> 172.21.15.190:0/3825145746 conn(0x7f0ab409ba20 msgr2=0x7f0ab4070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 shutdown_connections 2024-05-10T11:12:08.778 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.778+0000 7f0ab8dd4640 1 -- 172.21.15.190:0/3825145746 wait complete. 2024-05-10T11:12:08.788 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 6d6e4210-fc6b-4850-bd03-884be79c58eb 5 2024-05-10T11:12:08.816 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:08.816+0000 7f014f3c0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T11:12:08.829 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:08.829+0000 7f9b67a0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T11:12:08.861 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:08.860+0000 7f014f3c0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T11:12:08.874 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:08.874+0000 7f9b67a0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T11:12:08.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.888+0000 7f4c7015f640 1 Processor -- start 2024-05-10T11:12:08.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c7015f640 1 -- start start 2024-05-10T11:12:08.890 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c7015f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c68162780 0x7f4c680ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.890 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c7015f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c6806e8b0 0x7f4c6806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.890 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c7015f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680b4530 con 0x7f4c68073300 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c7015f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4c680b4810 con 0x7f4c6806e8b0 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c7015f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c680b4af0 con 0x7f4c68162780 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c6defb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c68162780 0x7f4c680ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.889+0000 7f4c6e6fc640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f4c68073300 0x7f4c68162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:59026/0 (socket says 172.21.15.190:59026) 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6e6fc640 1 -- 172.21.15.190:0/156693054 learned_addr learned my addr 172.21.15.190:0/156693054 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6d6fa640 1 --2- 172.21.15.190:0/156693054 >> v2:172.21.15.66:3300/0 conn(0x7f4c6806e8b0 0x7f4c6806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6cef9640 1 -- 172.21.15.190:0/156693054 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462706460 0 0) 0x7f4c680b4530 con 0x7f4c68073300 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6cef9640 1 -- 172.21.15.190:0/156693054 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c54003520 con 0x7f4c68073300 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6defb640 1 -- 172.21.15.190:0/156693054 >> v2:172.21.15.66:3300/0 conn(0x7f4c6806e8b0 msgr2=0x7f4c6806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6defb640 1 --2- 172.21.15.190:0/156693054 >> v2:172.21.15.66:3300/0 conn(0x7f4c6806e8b0 0x7f4c6806d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6defb640 1 -- 172.21.15.190:0/156693054 >> v1:172.21.15.190:6789/0 conn(0x7f4c68073300 legacy=0x7f4c68162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.890+0000 7f4c6defb640 1 -- 172.21.15.190:0/156693054 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c680b4dd0 con 0x7f4c68162780 2024-05-10T11:12:08.891 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c6defb640 1 --2- 172.21.15.190:0/156693054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c68162780 0x7f4c680ae890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c640097a0 tx=0x7f4c6402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c466b84a56027d56 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.892 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c6cef9640 1 -- 172.21.15.190:0/156693054 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64037070 con 0x7f4c68162780 2024-05-10T11:12:08.892 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c6cef9640 1 -- 172.21.15.190:0/156693054 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64032440 con 0x7f4c68162780 2024-05-10T11:12:08.892 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c6cef9640 1 -- 172.21.15.190:0/156693054 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64032810 con 0x7f4c68162780 2024-05-10T11:12:08.892 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 -- 172.21.15.190:0/156693054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c68162780 msgr2=0x7f4c680ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.892 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 --2- 172.21.15.190:0/156693054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c68162780 0x7f4c680ae890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c640097a0 tx=0x7f4c6402a180 comp rx=0 tx=0).stop 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 -- 172.21.15.190:0/156693054 shutdown_connections 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 --2- 172.21.15.190:0/156693054 >> v2:172.21.15.66:3300/0 conn(0x7f4c6806e8b0 0x7f4c6806d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 --2- 172.21.15.190:0/156693054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c68162780 0x7f4c680ae890 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 -- 172.21.15.190:0/156693054 >> 172.21.15.190:0/156693054 conn(0x7f4c680727e0 msgr2=0x7f4c68072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.891+0000 7f4c7015f640 1 -- 172.21.15.190:0/156693054 shutdown_connections 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.892+0000 7f4c7015f640 1 -- 172.21.15.190:0/156693054 wait complete. 2024-05-10T11:12:08.893 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.893+0000 7f4c7015f640 1 Processor -- start 2024-05-10T11:12:08.894 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.893+0000 7f4c7015f640 1 -- start start 2024-05-10T11:12:08.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c6806e8b0 0x7f4c681f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 0x7f4c68145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c68162780 0x7f4c68146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:08.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6806d810 con 0x7f4c68162780 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c68162b60 con 0x7f4c68073300 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6806d990 con 0x7f4c6806e8b0 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6defb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c6806e8b0 0x7f4c681f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 0x7f4c68145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 0x7f4c68145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50160/0 (socket says 172.21.15.190:50160) 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6defb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c6806e8b0 0x7f4c681f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55510/0 (socket says 172.21.15.190:55510) 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 -- 172.21.15.190:0/3945828695 learned_addr learned my addr 172.21.15.190:0/3945828695 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6e6fc640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c68162780 0x7f4c68146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 -- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c6806e8b0 msgr2=0x7f4c681f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c6806e8b0 0x7f4c681f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 -- 172.21.15.190:0/3945828695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c68162780 msgr2=0x7f4c68146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c68162780 0x7f4c68146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 -- 172.21.15.190:0/3945828695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c68149ee0 con 0x7f4c68073300 2024-05-10T11:12:08.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c6d6fa640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 0x7f4c68145bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00e9b0 tx=0x7f4c5c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c017070 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c00c9a0 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6815d4b0 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c00cd90 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.895+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6815da70 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.896+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c5c01a070 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.896+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4c5c01cb10 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.897+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c680693f0 con 0x7f4c68073300 2024-05-10T11:12:08.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.898+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4c5c01c650 con 0x7f4c68073300 2024-05-10T11:12:08.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.971+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6d6e4210-fc6b-4850-bd03-884be79c58eb", "id": 5} v 0) -- 0x7f4c6815e9b0 con 0x7f4c68073300 2024-05-10T11:12:08.976 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c5a7fc640 1 -- 172.21.15.190:0/3945828695 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d6e4210-fc6b-4850-bd03-884be79c58eb", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4c5c005990 con 0x7f4c68073300 2024-05-10T11:12:08.976 INFO:teuthology.orchestra.run.smithi190.stdout:5 2024-05-10T11:12:08.977 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 msgr2=0x7f4c68145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 0x7f4c68145bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00e9b0 tx=0x7f4c5c00ee70 comp rx=0 tx=0).stop 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 shutdown_connections 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c68162780 0x7f4c68146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c68073300 0x7f4c68145bf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 --2- 172.21.15.190:0/3945828695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c6806e8b0 0x7f4c681f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.977+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 >> 172.21.15.190:0/3945828695 conn(0x7f4c680727e0 msgr2=0x7f4c68157400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.978+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 shutdown_connections 2024-05-10T11:12:08.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:08.978+0000 7f4c7015f640 1 -- 172.21.15.190:0/3945828695 wait complete. 2024-05-10T11:12:08.988 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 5059e80f-c0be-4bec-af9d-6917445014e9 6 2024-05-10T11:12:09.035 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:09.035+0000 7f014f3c0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T11:12:09.060 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:09.061+0000 7f9b67a0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T11:12:09.088 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:09.088+0000 7f014f3c0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T11:12:09.110 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:09.110+0000 7f9b67a0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T11:12:09.127 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.127+0000 7f839b6f8640 1 Processor -- start 2024-05-10T11:12:09.127 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.128+0000 7f839b6f8640 1 -- start start 2024-05-10T11:12:09.131 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.128+0000 7f839b6f8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83940cfdf0 0x7f83941680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.128+0000 7f839b6f8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83940cdce0 con 0x7f839415d020 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.128+0000 7f839b6f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83940cdfc0 con 0x7f83940d3a50 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.128+0000 7f839b6f8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f83940ce8f0 con 0x7f83940cfdf0 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f8398c93640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f83940d3a50 0x7f83940cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:59038/0 (socket says 172.21.15.190:59038) 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f8398c93640 1 -- 172.21.15.190:0/1556415788 learned_addr learned my addr 172.21.15.190:0/1556415788 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f8399c95640 1 --2- 172.21.15.190:0/1556415788 >> v2:172.21.15.66:3300/0 conn(0x7f83940cfdf0 0x7f83941680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644940874 0 0) 0x7f83940cdfc0 con 0x7f83940d3a50 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8380003520 con 0x7f83940d3a50 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581031098 0 0) 0x7f83940cdce0 con 0x7f839415d020 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83940cdfc0 con 0x7f839415d020 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006038417 0 0) 0x7f8380003520 con 0x7f83940d3a50 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 >> v2:172.21.15.66:3300/0 conn(0x7f83940cfdf0 msgr2=0x7f83941680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:09.132 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 --2- 172.21.15.190:0/1556415788 >> v2:172.21.15.66:3300/0 conn(0x7f83940cfdf0 0x7f83941680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 >> v1:172.21.15.66:6789/0 conn(0x7f839415d020 legacy=0x7f83940d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83940ce2a0 con 0x7f83940d3a50 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f8384001670 con 0x7f83940d3a50 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 >> v1:172.21.15.190:6789/0 conn(0x7f83940d3a50 legacy=0x7f83940cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f8380003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380004800 0x7f8380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8380005210 0x7f838000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83940ce8f0 con 0x7f8380004800 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f838000c160 con 0x7f8380003b90 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f838000c360 con 0x7f8380005210 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f8399494640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f8380003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.133 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f8399c95640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8380005210 0x7f838000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.129+0000 7f8398c93640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380004800 0x7f8380004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399494640 1 -- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8380005210 msgr2=0x7f838000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399494640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8380005210 0x7f838000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399494640 1 -- 172.21.15.190:0/1556415788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380004800 msgr2=0x7f8380004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399494640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380004800 0x7f8380004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399494640 1 -- 172.21.15.190:0/1556415788 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8380003520 con 0x7f8380003b90 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399c95640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8380005210 0x7f838000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399c95640 1 -- 172.21.15.190:0/1556415788 reap_dead start 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f8399494640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f8380003fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8390007fd0 tx=0x7f8380005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c9d11870596971 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390001540 con 0x7f8380003b90 2024-05-10T11:12:09.134 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83900052d0 con 0x7f8380003b90 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.130+0000 7f838bfff640 1 -- 172.21.15.190:0/1556415788 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839002abe0 con 0x7f8380003b90 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 -- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 msgr2=0x7f8380003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f8380003fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8390007fd0 tx=0x7f8380005830 comp rx=0 tx=0).stop 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 -- 172.21.15.190:0/1556415788 shutdown_connections 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 --2- 172.21.15.190:0/1556415788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f8380003fb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 -- 172.21.15.190:0/1556415788 >> 172.21.15.190:0/1556415788 conn(0x7f83940d2f30 msgr2=0x7f83940d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 -- 172.21.15.190:0/1556415788 shutdown_connections 2024-05-10T11:12:09.135 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.131+0000 7f839b6f8640 1 -- 172.21.15.190:0/1556415788 wait complete. 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.133+0000 7f839b6f8640 1 Processor -- start 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.133+0000 7f839b6f8640 1 -- start start 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f83941587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83940b0570 0x7f83940a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f839415a5b0 0x7f839415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83940ced80 con 0x7f839415a5b0 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f839415d400 con 0x7f8380003b90 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8394158d00 con 0x7f83940b0570 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f83941587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f83941587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50176/0 (socket says 172.21.15.190:50176) 2024-05-10T11:12:09.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 -- 172.21.15.190:0/821846330 learned_addr learned my addr 172.21.15.190:0/821846330 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8398c93640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83940b0570 0x7f83940a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399c95640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f839415a5b0 0x7f839415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 -- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83940b0570 msgr2=0x7f83940a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83940b0570 0x7f83940a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 -- 172.21.15.190:0/821846330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f839415a5b0 msgr2=0x7f839415aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f839415a5b0 0x7f839415aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 -- 172.21.15.190:0/821846330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839409f1d0 con 0x7f8380003b90 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399c95640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f839415a5b0 0x7f839415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8399494640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f83941587c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8390009000 tx=0x7f8390001320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390040020 con 0x7f8380003b90 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83900050d0 con 0x7f8380003b90 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390006c50 con 0x7f8380003b90 2024-05-10T11:12:09.139 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.135+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839409f4b0 con 0x7f8380003b90 2024-05-10T11:12:09.140 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.136+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839409fa70 con 0x7f8380003b90 2024-05-10T11:12:09.140 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.136+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8390043020 con 0x7f8380003b90 2024-05-10T11:12:09.140 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.136+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8390003cd0 con 0x7f8380003b90 2024-05-10T11:12:09.140 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.136+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83940693f0 con 0x7f8380003b90 2024-05-10T11:12:09.140 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.138+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f839004a030 con 0x7f8380003b90 2024-05-10T11:12:09.143 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:09.143+0000 7f014f3c0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T11:12:09.167 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:09.167+0000 7f9b67a0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T11:12:09.209 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.209+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5059e80f-c0be-4bec-af9d-6917445014e9", "id": 6} v 0) -- 0x7f83940cef00 con 0x7f8380003b90 2024-05-10T11:12:09.214 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.214+0000 7f8389ffb640 1 -- 172.21.15.190:0/821846330 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5059e80f-c0be-4bec-af9d-6917445014e9", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8390006df0 con 0x7f8380003b90 2024-05-10T11:12:09.214 INFO:teuthology.orchestra.run.smithi190.stdout:6 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 msgr2=0x7f83941587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f83941587c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8390009000 tx=0x7f8390001320 comp rx=0 tx=0).stop 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 shutdown_connections 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f839415a5b0 0x7f839415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83940b0570 0x7f83940a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 --2- 172.21.15.190:0/821846330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8380003b90 0x7f83941587c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.215+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 >> 172.21.15.190:0/821846330 conn(0x7f83940d2f30 msgr2=0x7f839415b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.216+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 shutdown_connections 2024-05-10T11:12:09.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.216+0000 7f839b6f8640 1 -- 172.21.15.190:0/821846330 wait complete. 2024-05-10T11:12:09.226 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 38cfeccf-7a88-4df2-886c-613c1b72b832 7 2024-05-10T11:12:09.261 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:09.261+0000 7f014f3c0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T11:12:09.284 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:09.285+0000 7f9b67a0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T11:12:09.366 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.366+0000 7f0963cc8640 1 Processor -- start 2024-05-10T11:12:09.366 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.366+0000 7f0963cc8640 1 -- start start 2024-05-10T11:12:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0963cc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0963cc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f095c0b3a80 0x7f095c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0963cc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095c0cd9b0 con 0x7f095c0d19c0 2024-05-10T11:12:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0963cc8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f095c0afe60 con 0x7f095c0b3a80 2024-05-10T11:12:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0963cc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f095c0b0140 con 0x7f095c15d190 2024-05-10T11:12:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55544/0 (socket says 172.21.15.190:55544) 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 -- 172.21.15.190:0/2969715542 learned_addr learned my addr 172.21.15.190:0/2969715542 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961263640 1 --2- 172.21.15.190:0/2969715542 >> v2:172.21.15.66:3300/0 conn(0x7f095c0b3a80 0x7f095c0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 -- 172.21.15.190:0/2969715542 >> v2:172.21.15.66:3300/0 conn(0x7f095c0b3a80 msgr2=0x7f095c0d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 --2- 172.21.15.190:0/2969715542 >> v2:172.21.15.66:3300/0 conn(0x7f095c0b3a80 0x7f095c0d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 -- 172.21.15.190:0/2969715542 >> v1:172.21.15.66:6789/0 conn(0x7f095c0d19c0 legacy=0x7f095c0d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961a64640 1 -- 172.21.15.190:0/2969715542 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c0b0420 con 0x7f095c15d190 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.367+0000 7f0961263640 1 --2- 172.21.15.190:0/2969715542 >> v2:172.21.15.66:3300/0 conn(0x7f095c0b3a80 0x7f095c0d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.368+0000 7f0961a64640 1 --2- 172.21.15.190:0/2969715542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b3540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f094c009850 tx=0x7f094c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8158ca1953178672 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.368+0000 7f0960a62640 1 -- 172.21.15.190:0/2969715542 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c004030 con 0x7f095c15d190 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.368+0000 7f0960a62640 1 -- 172.21.15.190:0/2969715542 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094c0041d0 con 0x7f095c15d190 2024-05-10T11:12:09.370 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.368+0000 7f0960a62640 1 -- 172.21.15.190:0/2969715542 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c003610 con 0x7f095c15d190 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 -- 172.21.15.190:0/2969715542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 msgr2=0x7f095c0b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 --2- 172.21.15.190:0/2969715542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b3540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f094c009850 tx=0x7f094c02a230 comp rx=0 tx=0).stop 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 -- 172.21.15.190:0/2969715542 shutdown_connections 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 --2- 172.21.15.190:0/2969715542 >> v2:172.21.15.66:3300/0 conn(0x7f095c0b3a80 0x7f095c0d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 --2- 172.21.15.190:0/2969715542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b3540 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 -- 172.21.15.190:0/2969715542 >> 172.21.15.190:0/2969715542 conn(0x7f095c09ba20 msgr2=0x7f095c09be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 -- 172.21.15.190:0/2969715542 shutdown_connections 2024-05-10T11:12:09.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.369+0000 7f0963cc8640 1 -- 172.21.15.190:0/2969715542 wait complete. 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.370+0000 7f0963cc8640 1 Processor -- start 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.370+0000 7f0963cc8640 1 -- start start 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0963cc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095c0b3a80 0x7f095c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0963cc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 0x7f095c0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0963cc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0963cc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0afaf0 con 0x7f095c0b3a80 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0963cc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0b09e0 con 0x7f095c0d19c0 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0963cc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f095c15d570 con 0x7f095c15d190 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 0x7f095c0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0962265640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 0x7f095c0b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50192/0 (socket says 172.21.15.190:50192) 2024-05-10T11:12:09.374 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0962265640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55558/0 (socket says 172.21.15.190:55558) 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 -- 172.21.15.190:0/1350443350 learned_addr learned my addr 172.21.15.190:0/1350443350 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961a64640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095c0b3a80 0x7f095c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 -- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 msgr2=0x7f095c0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 -- 172.21.15.190:0/1350443350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095c0b3a80 msgr2=0x7f095c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095c0b3a80 0x7f095c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0961263640 1 -- 172.21.15.190:0/1350443350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c1f3d50 con 0x7f095c0d19c0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.371+0000 7f0962265640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f0961263640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 0x7f095c0b2b60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f095800e810 tx=0x7f095800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095800f040 con 0x7f095c0d19c0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958004030 con 0x7f095c0d19c0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958004400 con 0x7f095c0d19c0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c1f2d30 con 0x7f095c0d19c0 2024-05-10T11:12:09.375 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c1f32b0 con 0x7f095c0d19c0 2024-05-10T11:12:09.376 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f095800ca60 con 0x7f095c0d19c0 2024-05-10T11:12:09.376 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.372+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f0958003c70 con 0x7f095c0d19c0 2024-05-10T11:12:09.376 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.373+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095c0693f0 con 0x7f095c0d19c0 2024-05-10T11:12:09.376 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.375+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0958017020 con 0x7f095c0d19c0 2024-05-10T11:12:09.447 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.447+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38cfeccf-7a88-4df2-886c-613c1b72b832", "id": 7} v 0) -- 0x7f095c071e10 con 0x7f095c0d19c0 2024-05-10T11:12:09.454 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.455+0000 7f09527fc640 1 -- 172.21.15.190:0/1350443350 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38cfeccf-7a88-4df2-886c-613c1b72b832", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f095800ce10 con 0x7f095c0d19c0 2024-05-10T11:12:09.455 INFO:teuthology.orchestra.run.smithi190.stdout:7 2024-05-10T11:12:09.455 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 msgr2=0x7f095c0b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 0x7f095c0b2b60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f095800e810 tx=0x7f095800ecd0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 shutdown_connections 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f095c15d190 0x7f095c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f095c0d19c0 0x7f095c0b2b60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 --2- 172.21.15.190:0/1350443350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095c0b3a80 0x7f095c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 >> 172.21.15.190:0/1350443350 conn(0x7f095c09ba20 msgr2=0x7f095c0704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 shutdown_connections 2024-05-10T11:12:09.456 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:09.456+0000 7f0963cc8640 1 -- 172.21.15.190:0/1350443350 wait complete. 2024-05-10T11:12:09.466 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T11:12:09.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T11:12:09.468 INFO:tasks.ceph.osd.0:Started 2024-05-10T11:12:09.468 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T11:12:09.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T11:12:09.472 INFO:tasks.ceph.osd.1:Started 2024-05-10T11:12:09.472 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T11:12:09.472 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T11:12:09.474 INFO:tasks.ceph.osd.2:Started 2024-05-10T11:12:09.474 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T11:12:09.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T11:12:09.477 INFO:tasks.ceph.osd.3:Started 2024-05-10T11:12:09.477 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T11:12:09.477 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T11:12:09.508 INFO:tasks.ceph.osd.4:Started 2024-05-10T11:12:09.508 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T11:12:09.508 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T11:12:09.510 INFO:tasks.ceph.osd.5:Started 2024-05-10T11:12:09.511 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T11:12:09.511 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T11:12:09.513 INFO:tasks.ceph.osd.6:Started 2024-05-10T11:12:09.513 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T11:12:09.513 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T11:12:09.515 INFO:tasks.ceph.osd.7:Started 2024-05-10T11:12:09.515 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.634+0000 7f50a45f7640 1 Processor -- start 2024-05-10T11:12:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.634+0000 7f50a45f7640 1 -- start start 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a45f7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f509c1467e0 0x7f509c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a45f7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f509c0714f0 con 0x7f509c0d0d40 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a45f7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f509c0717d0 con 0x7f509c06c800 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a45f7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f509c06cc50 con 0x7f509c1467e0 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a2393640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f509c0d0d40 0x7f509c070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48902/0 (socket says 172.21.15.66:48902) 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a2393640 1 -- 172.21.15.66:0/3050730524 learned_addr learned my addr 172.21.15.66:0/3050730524 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a1b92640 1 --2- 172.21.15.66:0/3050730524 >> v2:172.21.15.66:3300/0 conn(0x7f509c1467e0 0x7f509c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.635+0000 7f50a1391640 1 -- 172.21.15.66:0/3050730524 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981935048 0 0) 0x7f509c0714f0 con 0x7f509c0d0d40 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.636+0000 7f50a1391640 1 -- 172.21.15.66:0/3050730524 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5088003520 con 0x7f509c0d0d40 2024-05-10T11:12:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.636+0000 7f50a1b92640 1 -- 172.21.15.66:0/3050730524 >> v1:172.21.15.190:6789/0 conn(0x7f509c06c800 legacy=0x7f509c0afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.636+0000 7f50a1391640 1 -- 172.21.15.66:0/3050730524 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3106988798 0 0) 0x7f509c0717d0 con 0x7f509c06c800 2024-05-10T11:12:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.636+0000 7f50a1b92640 1 -- 172.21.15.66:0/3050730524 >> v1:172.21.15.66:6789/0 conn(0x7f509c0d0d40 legacy=0x7f509c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.636+0000 7f50a1b92640 1 -- 172.21.15.66:0/3050730524 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c0af230 con 0x7f509c1467e0 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.636+0000 7f50a1b92640 1 --2- 172.21.15.66:0/3050730524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c1467e0 0x7f509c06c2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f508c0097a0 tx=0x7f508c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ced30f6bc9eebb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a1391640 1 -- 172.21.15.66:0/3050730524 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c037070 con 0x7f509c1467e0 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a1391640 1 -- 172.21.15.66:0/3050730524 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c032440 con 0x7f509c1467e0 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a1391640 1 -- 172.21.15.66:0/3050730524 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c032810 con 0x7f509c1467e0 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 -- 172.21.15.66:0/3050730524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c1467e0 msgr2=0x7f509c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 --2- 172.21.15.66:0/3050730524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c1467e0 0x7f509c06c2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f508c0097a0 tx=0x7f508c02a230 comp rx=0 tx=0).stop 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 -- 172.21.15.66:0/3050730524 shutdown_connections 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 --2- 172.21.15.66:0/3050730524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c1467e0 0x7f509c06c2c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 -- 172.21.15.66:0/3050730524 >> 172.21.15.66:0/3050730524 conn(0x7f509c0d1d70 msgr2=0x7f509c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 -- 172.21.15.66:0/3050730524 shutdown_connections 2024-05-10T11:12:09.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.637+0000 7f50a45f7640 1 -- 172.21.15.66:0/3050730524 wait complete. 2024-05-10T11:12:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 Processor -- start 2024-05-10T11:12:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 -- start start 2024-05-10T11:12:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f509c06c800 0x7f509c09f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 0x7f509c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c1467e0 0x7f509c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f509c0b02c0 con 0x7f509c0d0d40 2024-05-10T11:12:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f509c0b0140 con 0x7f509c1467e0 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a45f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f509c0b0440 con 0x7f509c06c800 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a1b92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 0x7f509c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.639+0000 7f50a1b92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 0x7f509c0b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60198/0 (socket says 172.21.15.66:60198) 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 -- 172.21.15.66:0/393338943 learned_addr learned my addr 172.21.15.66:0/393338943 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a2393640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f509c06c800 0x7f509c09f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a2b94640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c1467e0 0x7f509c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 -- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f509c06c800 msgr2=0x7f509c09f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f509c06c800 0x7f509c09f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 -- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c1467e0 msgr2=0x7f509c15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c1467e0 0x7f509c15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 -- 172.21.15.66:0/393338943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c1e3150 con 0x7f509c0d0d40 2024-05-10T11:12:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a1b92640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 0x7f509c0b2b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f508c0098c0 tx=0x7f508c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c041020 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c03d6e0 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c037040 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c1e3430 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1e39f0 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.640+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f508c044020 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.641+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f508c046c20 con 0x7f509c0d0d40 2024-05-10T11:12:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.641+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509c0693f0 con 0x7f509c0d0d40 2024-05-10T11:12:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.643+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f508c04b030 con 0x7f509c0d0d40 2024-05-10T11:12:09.698 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:09.697+0000 7f014f3c0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T11:12:09.700 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:09.700+0000 7f9b67a0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T11:12:09.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.705+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f509c145ba0 con 0x7f509c0d0d40 2024-05-10T11:12:09.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.706+0000 7f5092ffd640 1 -- 172.21.15.66:0/393338943 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f508c046400 con 0x7f509c0d0d40 2024-05-10T11:12:09.706 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:09.707 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":10,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:09.449010+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:09.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 msgr2=0x7f509c0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 0x7f509c0b2b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f508c0098c0 tx=0x7f508c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 shutdown_connections 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c1467e0 0x7f509c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f509c0d0d40 0x7f509c0b2b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 --2- 172.21.15.66:0/393338943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f509c06c800 0x7f509c09f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 >> 172.21.15.66:0/393338943 conn(0x7f509c0d1d70 msgr2=0x7f509c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 shutdown_connections 2024-05-10T11:12:09.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:09.707+0000 7f50a45f7640 1 -- 172.21.15.66:0/393338943 wait complete. 2024-05-10T11:12:09.718 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T11:12:09.718 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T11:12:09.838 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:09.838+0000 7f9b67a0d040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T11:12:09.844 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:09.844+0000 7f014f3c0040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T11:12:10.074 INFO:tasks.ceph.osd.0.smithi066.stderr:2024-05-10T11:12:10.073+0000 7f467f20d640 -1 Falling back to public interface 2024-05-10T11:12:10.095 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-05-10T11:12:10.095+0000 7f1b2ee25640 -1 Falling back to public interface 2024-05-10T11:12:10.100 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.100+0000 7f9b67a0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T11:12:10.103 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-05-10T11:12:10.103+0000 7fecf160d640 -1 Falling back to public interface 2024-05-10T11:12:10.106 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-05-10T11:12:10.106+0000 7f9bd7a0e640 -1 Falling back to public interface 2024-05-10T11:12:10.115 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-05-10T11:12:10.115+0000 7f8ce821d640 -1 Falling back to public interface 2024-05-10T11:12:10.120 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-05-10T11:12:10.120+0000 7f5d971a7640 -1 Falling back to public interface 2024-05-10T11:12:10.121 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:10.121+0000 7f014f3c0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T11:12:10.127 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-05-10T11:12:10.127+0000 7fc3cf032640 -1 Falling back to public interface 2024-05-10T11:12:10.131 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-05-10T11:12:10.131+0000 7fb6dc4dd640 -1 Falling back to public interface 2024-05-10T11:12:10.156 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.156+0000 7f9b67a0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T11:12:10.176 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:10.175+0000 7f014f3c0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T11:12:10.271 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.271+0000 7f9b67a0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T11:12:10.299 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:10.298+0000 7f014f3c0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T11:12:10.526 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:10.567 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.567+0000 7f9b67a0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T11:12:10.614 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.615+0000 7f9b67a0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T11:12:10.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.621+0000 7f779f504640 1 Processor -- start 2024-05-10T11:12:10.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.621+0000 7f779f504640 1 -- start start 2024-05-10T11:12:10.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779f504640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77980d31f0 0x7f77980cde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:10.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779f504640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f779815d590 0x7f77980ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:10.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779f504640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77980cec00 con 0x7f779815d1b0 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779f504640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f77980c6b40 con 0x7f77980d31f0 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779f504640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77980ceee0 con 0x7f779815d590 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779ca9f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77980d31f0 0x7f77980cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779ca9f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77980d31f0 0x7f77980cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60212/0 (socket says 172.21.15.66:60212) 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779ca9f640 1 -- 172.21.15.66:0/2419741172 learned_addr learned my addr 172.21.15.66:0/2419741172 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.622+0000 7f779d2a0640 1 --1- 172.21.15.66:0/2419741172 >> v1:172.21.15.66:6789/0 conn(0x7f779815d1b0 0x7f77980d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48908/0 (socket says 172.21.15.66:48908) 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f779daa1640 1 --2- 172.21.15.66:0/2419741172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f779815d590 0x7f77980ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f779ca9f640 1 -- 172.21.15.66:0/2419741172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f779815d590 msgr2=0x7f77980ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f779ca9f640 1 --2- 172.21.15.66:0/2419741172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f779815d590 0x7f77980ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f779ca9f640 1 -- 172.21.15.66:0/2419741172 >> v1:172.21.15.66:6789/0 conn(0x7f779815d1b0 legacy=0x7f77980d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f779ca9f640 1 -- 172.21.15.66:0/2419741172 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77980cf1c0 con 0x7f77980d31f0 2024-05-10T11:12:10.624 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f778ffff640 1 -- 172.21.15.66:0/2419741172 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709902820 0 0) 0x7f77980cec00 con 0x7f779815d1b0 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.623+0000 7f779ca9f640 1 --2- 172.21.15.66:0/2419741172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77980d31f0 0x7f77980cde40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7788009870 tx=0x7f778802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caeea0a8c53c814 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f778ffff640 1 -- 172.21.15.66:0/2419741172 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788037070 con 0x7f77980d31f0 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f778ffff640 1 -- 172.21.15.66:0/2419741172 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778802ae50 con 0x7f77980d31f0 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f778ffff640 1 -- 172.21.15.66:0/2419741172 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788032860 con 0x7f77980d31f0 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 -- 172.21.15.66:0/2419741172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77980d31f0 msgr2=0x7f77980cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 --2- 172.21.15.66:0/2419741172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77980d31f0 0x7f77980cde40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7788009870 tx=0x7f778802a300 comp rx=0 tx=0).stop 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 -- 172.21.15.66:0/2419741172 shutdown_connections 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 --2- 172.21.15.66:0/2419741172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f779815d590 0x7f77980ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 --2- 172.21.15.66:0/2419741172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77980d31f0 0x7f77980cde40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 -- 172.21.15.66:0/2419741172 >> 172.21.15.66:0/2419741172 conn(0x7f779809ba60 msgr2=0x7f779809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:10.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 -- 172.21.15.66:0/2419741172 shutdown_connections 2024-05-10T11:12:10.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.624+0000 7f779f504640 1 -- 172.21.15.66:0/2419741172 wait complete. 2024-05-10T11:12:10.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.625+0000 7f779f504640 1 Processor -- start 2024-05-10T11:12:10.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 -- start start 2024-05-10T11:12:10.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77980d31f0 0x7f77981601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:10.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 0x7f77980ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:10.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f779815d590 0x7f779815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:10.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77980c6fd0 con 0x7f779815d1b0 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77980ce8c0 con 0x7f779815d590 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779f504640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77980c7150 con 0x7f77980d31f0 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779ca9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 0x7f77980ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779ca9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 0x7f77980ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60216/0 (socket says 172.21.15.66:60216) 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779ca9f640 1 -- 172.21.15.66:0/3357735600 learned_addr learned my addr 172.21.15.66:0/3357735600 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.626+0000 7f779d2a0640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77980d31f0 0x7f77981601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779daa1640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f779815d590 0x7f779815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779ca9f640 1 -- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77980d31f0 msgr2=0x7f77981601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779ca9f640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77980d31f0 0x7f77981601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779ca9f640 1 -- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f779815d590 msgr2=0x7f779815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:10.630 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779ca9f640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f779815d590 0x7f779815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779ca9f640 1 -- 172.21.15.66:0/3357735600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77980caca0 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779daa1640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f779815d590 0x7f779815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779ca9f640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 0x7f77980ccb30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7788000c00 tx=0x7f77880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788041070 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778803c660 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77980caf80 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788037040 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.627+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77980cb540 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.628+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7788044070 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.628+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f778803dac0 con 0x7f779815d1b0 2024-05-10T11:12:10.631 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.628+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77980c85d0 con 0x7f779815d1b0 2024-05-10T11:12:10.632 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.630+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7788046450 con 0x7f779815d1b0 2024-05-10T11:12:10.649 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:10.649+0000 7f014f3c0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T11:12:10.693 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.693+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77980c82f0 con 0x7f779815d1b0 2024-05-10T11:12:10.694 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.694+0000 7f778dffb640 1 -- 172.21.15.66:0/3357735600 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f778803dda0 con 0x7f779815d1b0 2024-05-10T11:12:10.694 INFO:teuthology.misc.health.smithi066.stdout: 2024-05-10T11:12:10.694 INFO:teuthology.misc.health.smithi066.stdout:{"epoch":10,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:09.449010+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:10.695 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 msgr2=0x7f77980ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:10.695 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 0x7f77980ccb30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7788000c00 tx=0x7f77880046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.695 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 shutdown_connections 2024-05-10T11:12:10.695 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f779815d590 0x7f779815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.695 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f779815d1b0 0x7f77980ccb30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.696 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 --2- 172.21.15.66:0/3357735600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77980d31f0 0x7f77981601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:10.696 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 >> 172.21.15.66:0/3357735600 conn(0x7f779809ba60 msgr2=0x7f77980c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:10.696 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 shutdown_connections 2024-05-10T11:12:10.696 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:10.695+0000 7f779f504640 1 -- 172.21.15.66:0/3357735600 wait complete. 2024-05-10T11:12:10.700 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:10.700+0000 7f014f3c0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T11:12:10.704 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T11:12:10.773 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.774+0000 7f9b67a0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T11:12:10.865 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:10.864+0000 7f014f3c0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T11:12:10.907 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.908+0000 7f9b67a0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T11:12:10.959 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:10.959+0000 7f9b67a0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T11:12:11.009 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:11.009+0000 7f014f3c0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T11:12:11.029 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:11.030+0000 7f9b67a0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T11:12:11.061 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:11.061+0000 7f014f3c0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T11:12:11.074 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:11.074+0000 7f9b67a0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T11:12:11.135 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:11.134+0000 7f014f3c0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T11:12:11.182 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:11.182+0000 7f014f3c0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T11:12:11.555 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:11.555+0000 7f9b67a0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T11:12:11.669 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:11.669+0000 7f9b67a0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T11:12:11.686 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:11.686+0000 7f014f3c0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T11:12:11.809 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-05-10T11:12:11.809+0000 7f014f3c0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T11:12:12.684 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:12.685+0000 7f9b070e5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T11:12:12.685 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-05-10T11:12:12.685+0000 7f9b070e5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T11:12:13.553 INFO:tasks.ceph.osd.0.smithi066.stderr:2024-05-10T11:12:13.552+0000 7f467f20d640 -1 osd.0 0 log_to_monitors true 2024-05-10T11:12:13.588 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-05-10T11:12:13.588+0000 7f9bd7a0e640 -1 osd.3 0 log_to_monitors true 2024-05-10T11:12:13.611 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-05-10T11:12:13.611+0000 7f8ce821d640 -1 osd.5 0 log_to_monitors true 2024-05-10T11:12:13.637 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-05-10T11:12:13.634+0000 7f1b2ee25640 -1 osd.1 0 log_to_monitors true 2024-05-10T11:12:13.638 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-05-10T11:12:13.635+0000 7fecf160d640 -1 osd.2 0 log_to_monitors true 2024-05-10T11:12:13.676 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-05-10T11:12:13.677+0000 7fc3cf032640 -1 osd.4 0 log_to_monitors true 2024-05-10T11:12:13.676 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-05-10T11:12:13.677+0000 7f5d971a7640 -1 osd.6 0 log_to_monitors true 2024-05-10T11:12:13.679 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-05-10T11:12:13.680+0000 7fb6dc4dd640 -1 osd.7 0 log_to_monitors true 2024-05-10T11:12:15.474 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-05-10T11:12:15.471+0000 7f8ce3be7640 -1 osd.5 0 waiting for initial osdmap 2024-05-10T11:12:15.485 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-05-10T11:12:15.485+0000 7f8cdba18640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:16.676 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-05-10T11:12:16.674+0000 7f1b2b07b640 -1 osd.1 0 waiting for initial osdmap 2024-05-10T11:12:16.689 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-05-10T11:12:16.689+0000 7f1b22687640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:16.822 INFO:tasks.ceph.osd.0.smithi066.stderr:2024-05-10T11:12:16.822+0000 7f467ac38640 -1 osd.0 0 waiting for initial osdmap 2024-05-10T11:12:16.826 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-05-10T11:12:16.826+0000 7fececf24640 -1 osd.2 0 waiting for initial osdmap 2024-05-10T11:12:16.831 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-05-10T11:12:16.831+0000 7f9bd3b18640 -1 osd.3 0 waiting for initial osdmap 2024-05-10T11:12:16.840 INFO:tasks.ceph.osd.0.smithi066.stderr:2024-05-10T11:12:16.840+0000 7f4672a58640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:16.844 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-05-10T11:12:16.844+0000 7f9bcb124640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:16.852 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-05-10T11:12:16.852+0000 7fece4d44640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:17.476 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-05-10T11:12:17.477+0000 7fc3cafc8640 -1 osd.4 0 waiting for initial osdmap 2024-05-10T11:12:17.488 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-05-10T11:12:17.489+0000 7fc3c2de8640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:17.492 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-05-10T11:12:17.492+0000 7fb6d8473640 -1 osd.7 0 waiting for initial osdmap 2024-05-10T11:12:17.497 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-05-10T11:12:17.498+0000 7f5d9313d640 -1 osd.6 0 waiting for initial osdmap 2024-05-10T11:12:17.502 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-05-10T11:12:17.503+0000 7fb6d0293640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:17.507 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-05-10T11:12:17.508+0000 7f5d8af5d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T11:12:17.514 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:17.619 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.619+0000 7f01f4699640 1 Processor -- start 2024-05-10T11:12:17.619 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.619+0000 7f01f4699640 1 -- start start 2024-05-10T11:12:17.621 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f4699640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01ec15f370 0x7f01ec0b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.621 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f4699640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.621 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f4699640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f01ec0b1c50 0x7f01ec0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.621 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f4699640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f01ec15f750 con 0x7f01ec15f370 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f4699640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f01ec0b2980 con 0x7f01ec0b1c50 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f4699640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01ec0b2c60 con 0x7f01ec0cfc20 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01ec15f370 0x7f01ec0b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01ec15f370 0x7f01ec0b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42022/0 (socket says 172.21.15.66:42022) 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 -- 172.21.15.66:0/2838724679 learned_addr learned my addr 172.21.15.66:0/2838724679 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2c36640 1 --2- 172.21.15.66:0/2838724679 >> v2:172.21.15.190:3300/0 conn(0x7f01ec0b1c50 0x7f01ec0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f1c34640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 -- 172.21.15.66:0/2838724679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 msgr2=0x7f01ec0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 -- 172.21.15.66:0/2838724679 >> v2:172.21.15.190:3300/0 conn(0x7f01ec0b1c50 msgr2=0x7f01ec0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 --2- 172.21.15.66:0/2838724679 >> v2:172.21.15.190:3300/0 conn(0x7f01ec0b1c50 0x7f01ec0b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f2435640 1 -- 172.21.15.66:0/2838724679 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec0b2f40 con 0x7f01ec15f370 2024-05-10T11:12:17.622 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.620+0000 7f01f1c34640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:17.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.621+0000 7f01f2435640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec15f370 0x7f01ec0b7e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01ec08d5c0 tx=0x7f01e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19f4cda5c63d0b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:17.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.621+0000 7f01f1433640 1 -- 172.21.15.66:0/2838724679 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8037070 con 0x7f01ec15f370 2024-05-10T11:12:17.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.621+0000 7f01f1433640 1 -- 172.21.15.66:0/2838724679 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e8032440 con 0x7f01ec15f370 2024-05-10T11:12:17.623 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.621+0000 7f01f1433640 1 -- 172.21.15.66:0/2838724679 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8032810 con 0x7f01ec15f370 2024-05-10T11:12:17.625 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 -- 172.21.15.66:0/2838724679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec15f370 msgr2=0x7f01ec0b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:17.625 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec15f370 0x7f01ec0b7e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01ec08d5c0 tx=0x7f01e802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 -- 172.21.15.66:0/2838724679 shutdown_connections 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 --2- 172.21.15.66:0/2838724679 >> v2:172.21.15.190:3300/0 conn(0x7f01ec0b1c50 0x7f01ec0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 --2- 172.21.15.66:0/2838724679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec15f370 0x7f01ec0b7e40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 -- 172.21.15.66:0/2838724679 >> 172.21.15.66:0/2838724679 conn(0x7f01ec0d4ff0 msgr2=0x7f01ec0d5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 -- 172.21.15.66:0/2838724679 shutdown_connections 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.622+0000 7f01f4699640 1 -- 172.21.15.66:0/2838724679 wait complete. 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.623+0000 7f01f4699640 1 Processor -- start 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.623+0000 7f01f4699640 1 -- start start 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f4699640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 0x7f01ec1f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f4699640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0ba590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f4699640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ec15f370 0x7f01ec155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.626 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f4699640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec0d05c0 con 0x7f01ec0b1c50 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f4699640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec0b3500 con 0x7f01ec15f370 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f4699640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01ec0b2600 con 0x7f01ec0cfc20 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 0x7f01ec1f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 0x7f01ec1f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42024/0 (socket says 172.21.15.66:42024) 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 -- 172.21.15.66:0/1404335550 learned_addr learned my addr 172.21.15.66:0/1404335550 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f1c34640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2c36640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ec15f370 0x7f01ec155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 -- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 msgr2=0x7f01ec0ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 -- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ec15f370 msgr2=0x7f01ec155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ec15f370 0x7f01ec155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 -- 172.21.15.66:0/1404335550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec1f9110 con 0x7f01ec0b1c50 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.624+0000 7f01f2435640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 0x7f01ec1f8bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01e802a220 tx=0x7f01e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:17.627 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.625+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8037040 con 0x7f01ec0b1c50 2024-05-10T11:12:17.628 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.625+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e8042070 con 0x7f01ec0b1c50 2024-05-10T11:12:17.628 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.625+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8030880 con 0x7f01ec0b1c50 2024-05-10T11:12:17.628 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.625+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec0c8bd0 con 0x7f01ec0b1c50 2024-05-10T11:12:17.628 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.625+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec0c9470 con 0x7f01ec0b1c50 2024-05-10T11:12:17.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.626+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ec069d20 con 0x7f01ec0b1c50 2024-05-10T11:12:17.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.626+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f01e8030a20 con 0x7f01ec0b1c50 2024-05-10T11:12:17.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.627+0000 7f01e2ffd640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f01d0076240 0x7f01d0078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:17.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.627+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3631+0+0 (secure 0 0 0) 0x7f01e80b7370 con 0x7f01ec0b1c50 2024-05-10T11:12:17.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.627+0000 7f01f1c34640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f01d0076240 0x7f01d0078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:17.629 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.627+0000 7f01f1c34640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f01d0076240 0x7f01d0078700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f01ec158140 tx=0x7f01dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:17.632 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.632+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f01ec1f9110 con 0x7f01ec0b1c50 2024-05-10T11:12:17.830 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.830+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01ec15e770 con 0x7f01ec0b1c50 2024-05-10T11:12:17.831 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.830+0000 7f01e2ffd640 1 -- 172.21.15.66:0/1404335550 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9474 (secure 0 0 0) 0x7f01e8081010 con 0x7f01ec0b1c50 2024-05-10T11:12:17.831 INFO:teuthology.misc.health.smithi066.stdout: 2024-05-10T11:12:17.831 INFO:teuthology.misc.health.smithi066.stdout:{"epoch":14,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:17.019224+0000","last_up_change":"2024-05-10T11:12:17.019224+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f01d0076240 msgr2=0x7f01d0078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f01d0076240 0x7f01d0078700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f01ec158140 tx=0x7f01dc008040 comp rx=0 tx=0).stop 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 msgr2=0x7f01ec1f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 0x7f01ec1f8bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01e802a220 tx=0x7f01e80046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 shutdown_connections 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f01d0076240 0x7f01d0078700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ec15f370 0x7f01ec155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01ec0cfc20 0x7f01ec0ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 --2- 172.21.15.66:0/1404335550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec0b1c50 0x7f01ec1f8bd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 >> 172.21.15.66:0/1404335550 conn(0x7f01ec0d4ff0 msgr2=0x7f01ec1620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 shutdown_connections 2024-05-10T11:12:17.834 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:17.833+0000 7f01f4699640 1 -- 172.21.15.66:0/1404335550 wait complete. 2024-05-10T11:12:17.843 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-05-10T11:12:24.648 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:24.754 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.754+0000 7f58972a2640 1 Processor -- start 2024-05-10T11:12:24.754 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.754+0000 7f58972a2640 1 -- start start 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f58972a2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f589006d3b0 0x7f589006d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f58972a2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f5890161a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f58972a2640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589015fa60 con 0x7f5890159960 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f58972a2640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5890161170 con 0x7f589006d3b0 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f58972a2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f58900af970 con 0x7f5890161600 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589503e640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5890159960 0x7f58900aee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58076/0 (socket says 172.21.15.66:58076) 2024-05-10T11:12:24.756 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589503e640 1 -- 172.21.15.66:0/394493752 learned_addr learned my addr 172.21.15.66:0/394493752 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589483d640 1 --2- 172.21.15.66:0/394493752 >> v2:172.21.15.66:3300/0 conn(0x7f589006d3b0 0x7f589006d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f5887fff640 1 -- 172.21.15.66:0/394493752 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224517668 0 0) 0x7f589015fa60 con 0x7f5890159960 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589583f640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f5890161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f5887fff640 1 -- 172.21.15.66:0/394493752 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f587c003520 con 0x7f5890159960 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589483d640 1 -- 172.21.15.66:0/394493752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 msgr2=0x7f5890161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589483d640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f5890161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.755+0000 7f589483d640 1 -- 172.21.15.66:0/394493752 >> v1:172.21.15.66:6789/0 conn(0x7f5890159960 legacy=0x7f58900aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.756+0000 7f589483d640 1 -- 172.21.15.66:0/394493752 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58900afc50 con 0x7f589006d3b0 2024-05-10T11:12:24.757 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.756+0000 7f589583f640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f5890161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.756+0000 7f589483d640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589006d830 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58800097a0 tx=0x7f588002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdf6a4f6bfc2b38 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.756+0000 7f5887fff640 1 -- 172.21.15.66:0/394493752 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880037070 con 0x7f589006d3b0 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.756+0000 7f5887fff640 1 -- 172.21.15.66:0/394493752 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880032440 con 0x7f589006d3b0 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.756+0000 7f5887fff640 1 -- 172.21.15.66:0/394493752 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880032810 con 0x7f589006d3b0 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 -- 172.21.15.66:0/394493752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 msgr2=0x7f589006d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589006d830 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58800097a0 tx=0x7f588002a180 comp rx=0 tx=0).stop 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 -- 172.21.15.66:0/394493752 shutdown_connections 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f5890161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 --2- 172.21.15.66:0/394493752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589006d830 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 -- 172.21.15.66:0/394493752 >> 172.21.15.66:0/394493752 conn(0x7f5890072830 msgr2=0x7f5890072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 -- 172.21.15.66:0/394493752 shutdown_connections 2024-05-10T11:12:24.759 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.757+0000 7f58972a2640 1 -- 172.21.15.66:0/394493752 wait complete. 2024-05-10T11:12:24.760 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.758+0000 7f58972a2640 1 Processor -- start 2024-05-10T11:12:24.760 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.758+0000 7f58972a2640 1 -- start start 2024-05-10T11:12:24.762 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f58972a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:24.762 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f58972a2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5890159960 0x7f58900cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:24.762 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f58972a2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f589015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f58972a2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58900af510 con 0x7f589006d3b0 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f58972a2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5890160e00 con 0x7f5890159960 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f58972a2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f58900af690 con 0x7f5890161600 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589503e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589503e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589014c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44372/0 (socket says 172.21.15.66:44372) 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589503e640 1 -- 172.21.15.66:0/3781758101 learned_addr learned my addr 172.21.15.66:0/3781758101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589583f640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f589015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589483d640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5890159960 0x7f58900cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589503e640 1 -- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 msgr2=0x7f589015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.759+0000 7f589503e640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f589015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f589503e640 1 -- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5890159960 msgr2=0x7f58900cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f589503e640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5890159960 0x7f58900cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f589503e640 1 -- 172.21.15.66:0/3781758101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58900ce490 con 0x7f589006d3b0 2024-05-10T11:12:24.763 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f589483d640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5890159960 0x7f58900cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f589503e640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589014c090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f588c0010e0 tx=0x7f588c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c017070 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c005d00 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c0072b0 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58900ce710 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.760+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58900cecd0 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.761+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589015d0e0 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.761+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f588c01a070 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.762+0000 7f5885ffb640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58740762d0 0x7f5874078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.762+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f588c0965e0 con 0x7f589006d3b0 2024-05-10T11:12:24.764 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.762+0000 7f589483d640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58740762d0 0x7f5874078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:24.765 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.763+0000 7f589483d640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58740762d0 0x7f5874078790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5880034000 tx=0x7f588002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:24.767 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.767+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f589015d0e0 con 0x7f589006d3b0 2024-05-10T11:12:24.962 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.962+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5890073350 con 0x7f589006d3b0 2024-05-10T11:12:24.963 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.963+0000 7f5885ffb640 1 -- 172.21.15.66:0/3781758101 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f58900ce490 con 0x7f589006d3b0 2024-05-10T11:12:24.963 INFO:teuthology.misc.health.smithi066.stdout: 2024-05-10T11:12:24.963 INFO:teuthology.misc.health.smithi066.stdout:{"epoch":17,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:20.487028+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:24.965 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58740762d0 msgr2=0x7f5874078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:24.965 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58740762d0 0x7f5874078790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5880034000 tx=0x7f588002e000 comp rx=0 tx=0).stop 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 msgr2=0x7f589014c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589014c090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f588c0010e0 tx=0x7f588c00c960 comp rx=0 tx=0).stop 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 shutdown_connections 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58740762d0 0x7f5874078790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5890161600 0x7f589015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5890159960 0x7f58900cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 --2- 172.21.15.66:0/3781758101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f589006d3b0 0x7f589014c090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 >> 172.21.15.66:0/3781758101 conn(0x7f5890072830 msgr2=0x7f5890161c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 shutdown_connections 2024-05-10T11:12:24.966 INFO:teuthology.misc.health.smithi066.stderr:2024-05-10T11:12:24.965+0000 7f58972a2640 1 -- 172.21.15.66:0/3781758101 wait complete. 2024-05-10T11:12:24.975 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T11:12:24.975 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T11:12:24.975 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:12:24.976 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:12:24.978 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:12:24.978 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:12:24.978 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:12:24.980 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:12:24.981 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:12:24.981 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:12:24.984 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:12:24.984 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:12:24.984 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:12:24.987 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:12:24.987 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-10T11:12:24.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:25.056 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:12:25.056 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:12:25.071 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:12:25.071 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:12:25.072 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-05-10T11:12:25.071+0000 7fe56ae98640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T11:12:25.072 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-05-10T11:12:25.072+0000 7fe56ae98640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-05-10T11:12:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.097+0000 7f620a217640 1 Processor -- start 2024-05-10T11:12:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.097+0000 7f620a217640 1 -- start start 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.097+0000 7f620a217640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f620415d290 0x7f6204071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f620a217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 0x7f62040ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f620a217640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6204072330 con 0x7f6204071880 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f620a217640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6204071d70 con 0x7f620415d290 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f620a217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6204072050 con 0x7f62040d3510 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f6203fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 0x7f62040ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f620415d290 0x7f6204071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f620415d290 0x7f6204071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:49534/0 (socket says 172.21.15.66:49534) 2024-05-10T11:12:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 -- 172.21.15.66:0/1472441895 learned_addr learned my addr 172.21.15.66:0/1472441895 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f6202ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6204071880 0x7f62040d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:46508/0 (socket says 172.21.15.66:46508) 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f6203fff640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 0x7f62040ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:40436/0 (socket says 172.21.15.66:40436) 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 -- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 msgr2=0x7f62040ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 0x7f62040ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62027fc640 1 -- 172.21.15.66:0/1472441895 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528448646 0 0) 0x7f6204072330 con 0x7f6204071880 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 -- 172.21.15.66:0/1472441895 >> v1:172.21.15.190:6789/0 conn(0x7f6204071880 legacy=0x7f62040d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f62037fe640 1 -- 172.21.15.66:0/1472441895 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62040cda70 con 0x7f620415d290 2024-05-10T11:12:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.098+0000 7f6203fff640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 0x7f62040ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.099+0000 7f62037fe640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f620415d290 0x7f6204071340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d92aa33397f0461 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.099+0000 7f62027fc640 1 -- 172.21.15.66:0/1472441895 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4037070 con 0x7f620415d290 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.099+0000 7f62027fc640 1 -- 172.21.15.66:0/1472441895 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f4032440 con 0x7f620415d290 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.099+0000 7f62027fc640 1 -- 172.21.15.66:0/1472441895 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4032810 con 0x7f620415d290 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 -- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f620415d290 msgr2=0x7f6204071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f620415d290 0x7f6204071340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f402a270 comp rx=0 tx=0).stop 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 -- 172.21.15.66:0/1472441895 shutdown_connections 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62040d3510 0x7f62040ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 --2- 172.21.15.66:0/1472441895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f620415d290 0x7f6204071340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 -- 172.21.15.66:0/1472441895 >> 172.21.15.66:0/1472441895 conn(0x7f620409ba20 msgr2=0x7f620409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 -- 172.21.15.66:0/1472441895 shutdown_connections 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.100+0000 7f620a217640 1 -- 172.21.15.66:0/1472441895 wait complete. 2024-05-10T11:12:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.101+0000 7f620a217640 1 Processor -- start 2024-05-10T11:12:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.101+0000 7f620a217640 1 -- start start 2024-05-10T11:12:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f620a217640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 0x7f62041570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f620a217640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62040d3510 0x7f62040b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f620a217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f620415d290 0x7f62040b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f620a217640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62040d1c20 con 0x7f6204071880 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f620a217640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f62040d1aa0 con 0x7f62040d3510 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f620a217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f620414a3b0 con 0x7f620415d290 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 0x7f62041570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 0x7f62041570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44418/0 (socket says 172.21.15.66:44418) 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 -- 172.21.15.66:0/2615902059 learned_addr learned my addr 172.21.15.66:0/2615902059 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f6203fff640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f620415d290 0x7f62040b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f6202ffd640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62040d3510 0x7f62040b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 -- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f620415d290 msgr2=0x7f62040b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f620415d290 0x7f62040b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 -- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62040d3510 msgr2=0x7f62040b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62040d3510 0x7f62040b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.102+0000 7f62037fe640 1 -- 172.21.15.66:0/2615902059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6204159ab0 con 0x7f6204071880 2024-05-10T11:12:25.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.103+0000 7f62037fe640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 0x7f62041570e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.103+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4037040 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.103+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f4004030 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.103+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4004400 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.103+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6204159d90 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.103+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6204157620 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.104+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62040693f0 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.104+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f61f403a070 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.105+0000 7f61ebfff640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61f0076300 0x7f61f00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.105+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f61f40b7670 con 0x7f6204071880 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.105+0000 7f6202ffd640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61f0076300 0x7f61f00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.106+0000 7f6202ffd640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61f0076300 0x7f61f00787c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6204156bb0 tx=0x7f61f8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.109+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f61f4041020 con 0x7f6204071880 2024-05-10T11:12:25.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.338+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62040b26c0 con 0x7f6204071880 2024-05-10T11:12:25.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.338+0000 7f61ebfff640 1 -- 172.21.15.66:0/2615902059 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f61f40893a0 con 0x7f6204071880 2024-05-10T11:12:25.339 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:25.339 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-10T11:12:25.340 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 2 2024-05-10T11:12:25.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61f0076300 msgr2=0x7f61f00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:25.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61f0076300 0x7f61f00787c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6204156bb0 tx=0x7f61f8007de0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 msgr2=0x7f62041570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:25.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 0x7f62041570e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f40046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 shutdown_connections 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61f0076300 0x7f61f00787c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f620415d290 0x7f62040b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62040d3510 0x7f62040b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 --2- 172.21.15.66:0/2615902059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204071880 0x7f62041570e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.340+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 >> 172.21.15.66:0/2615902059 conn(0x7f620409ba20 msgr2=0x7f62040b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.341+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 shutdown_connections 2024-05-10T11:12:25.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:25.341+0000 7f620a217640 1 -- 172.21.15.66:0/2615902059 wait complete. 2024-05-10T11:12:27.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:27.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.468+0000 7f57b5faf640 1 Processor -- start 2024-05-10T11:12:27.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.468+0000 7f57b5faf640 1 -- start start 2024-05-10T11:12:27.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57b5faf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57b015f8c0 0x7f57b006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57b5faf640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b00b0a90 con 0x7f57b015f4e0 2024-05-10T11:12:27.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57b5faf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b00b3540 con 0x7f57b006e620 2024-05-10T11:12:27.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57b5faf640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f57b00b23f0 con 0x7f57b015f8c0 2024-05-10T11:12:27.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57af7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f57b015f4e0 0x7f57b006d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58094/0 (socket says 172.21.15.66:58094) 2024-05-10T11:12:27.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57af7fe640 1 -- 172.21.15.66:0/724693651 learned_addr learned my addr 172.21.15.66:0/724693651 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:27.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57aeffd640 1 --2- 172.21.15.66:0/724693651 >> v2:172.21.15.66:3300/0 conn(0x7f57b015f8c0 0x7f57b006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57aeffd640 1 -- 172.21.15.66:0/724693651 >> v1:172.21.15.190:6789/0 conn(0x7f57b006e620 legacy=0x7f57b00d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:27.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57aeffd640 1 -- 172.21.15.66:0/724693651 >> v1:172.21.15.66:6789/0 conn(0x7f57b015f4e0 legacy=0x7f57b006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57ae7fc640 1 -- 172.21.15.66:0/724693651 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804350050 0 0) 0x7f57b00b0a90 con 0x7f57b015f4e0 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.469+0000 7f57aeffd640 1 -- 172.21.15.66:0/724693651 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b00b3820 con 0x7f57b015f8c0 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.470+0000 7f57aeffd640 1 --2- 172.21.15.66:0/724693651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b006e0e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57a40097a0 tx=0x7f57a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c59e2e7111a2748 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.470+0000 7f57ae7fc640 1 -- 172.21.15.66:0/724693651 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4037070 con 0x7f57b015f8c0 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.470+0000 7f57ae7fc640 1 -- 172.21.15.66:0/724693651 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a4032440 con 0x7f57b015f8c0 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.470+0000 7f57ae7fc640 1 -- 172.21.15.66:0/724693651 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4032810 con 0x7f57b015f8c0 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 -- 172.21.15.66:0/724693651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 msgr2=0x7f57b006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 --2- 172.21.15.66:0/724693651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b006e0e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57a40097a0 tx=0x7f57a402a1a0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 -- 172.21.15.66:0/724693651 shutdown_connections 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 --2- 172.21.15.66:0/724693651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b006e0e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 -- 172.21.15.66:0/724693651 >> 172.21.15.66:0/724693651 conn(0x7f57b00d2df0 msgr2=0x7f57b00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 -- 172.21.15.66:0/724693651 shutdown_connections 2024-05-10T11:12:27.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.471+0000 7f57b5faf640 1 -- 172.21.15.66:0/724693651 wait complete. 2024-05-10T11:12:27.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.472+0000 7f57b5faf640 1 Processor -- start 2024-05-10T11:12:27.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 -- start start 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57b006e620 0x7f57b0156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b015f4e0 0x7f57b015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57b00b3de0 con 0x7f57b015f8c0 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57b00b4150 con 0x7f57b015f4e0 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57b5faf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57b00b45e0 con 0x7f57b006e620 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b014e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44440/0 (socket says 172.21.15.66:44440) 2024-05-10T11:12:27.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.473+0000 7f57affff640 1 -- 172.21.15.66:0/1790315846 learned_addr learned my addr 172.21.15.66:0/1790315846 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57af7fe640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57b006e620 0x7f57b0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57aeffd640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b015f4e0 0x7f57b015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57affff640 1 -- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57b006e620 msgr2=0x7f57b0156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57affff640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57b006e620 0x7f57b0156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57affff640 1 -- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b015f4e0 msgr2=0x7f57b015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57affff640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b015f4e0 0x7f57b015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57affff640 1 -- 172.21.15.66:0/1790315846 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b01605f0 con 0x7f57b015f8c0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57aeffd640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b015f4e0 0x7f57b015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57af7fe640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57b006e620 0x7f57b0156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57affff640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b014e560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f57a800c6b0 tx=0x7f57a800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8003b70 con 0x7f57b015f8c0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a8003d30 con 0x7f57b015f8c0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8005310 con 0x7f57b015f8c0 2024-05-10T11:12:27.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b01608d0 con 0x7f57b015f8c0 2024-05-10T11:12:27.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.474+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b0161620 con 0x7f57b015f8c0 2024-05-10T11:12:27.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.475+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b006a220 con 0x7f57b015f8c0 2024-05-10T11:12:27.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.476+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57a80054b0 con 0x7f57b015f8c0 2024-05-10T11:12:27.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.476+0000 7f5797fff640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f579c0762d0 0x7f579c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.476+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f57a8097060 con 0x7f57b015f8c0 2024-05-10T11:12:27.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.477+0000 7f57af7fe640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f579c0762d0 0x7f579c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.477+0000 7f57af7fe640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f579c0762d0 0x7f579c078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000f60 tx=0x7f57a0007c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:27.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.481+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f57a8060da0 con 0x7f57b015f8c0 2024-05-10T11:12:27.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.712+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57b0050740 con 0x7f57b015f8c0 2024-05-10T11:12:27.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.712+0000 7f5797fff640 1 -- 172.21.15.66:0/1790315846 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f57a80606a0 con 0x7f57b015f8c0 2024-05-10T11:12:27.713 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:27.713 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-10T11:12:27.713 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 3 2024-05-10T11:12:27.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f579c0762d0 msgr2=0x7f579c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f579c0762d0 0x7f579c078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000f60 tx=0x7f57a0007c50 comp rx=0 tx=0).stop 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 msgr2=0x7f57b014e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b014e560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f57a800c6b0 tx=0x7f57a800cb70 comp rx=0 tx=0).stop 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 shutdown_connections 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f579c0762d0 0x7f579c078790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57b015f8c0 0x7f57b014e560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b015f4e0 0x7f57b015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 --2- 172.21.15.66:0/1790315846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57b006e620 0x7f57b0156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 >> 172.21.15.66:0/1790315846 conn(0x7f57b00d2df0 msgr2=0x7f57b00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 shutdown_connections 2024-05-10T11:12:27.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.715+0000 7f57b5faf640 1 -- 172.21.15.66:0/1790315846 wait complete. 2024-05-10T11:12:27.726 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:12:27.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.830+0000 7fe36b903640 1 Processor -- start 2024-05-10T11:12:27.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.830+0000 7fe36b903640 1 -- start start 2024-05-10T11:12:27.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe36b903640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe3640d5d30 0x7fe36416a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe36b903640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3640d30b0 con 0x7fe36415f790 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe36b903640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3640d3390 con 0x7fe36415f3b0 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe36b903640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe3640c8c80 con 0x7fe3640d5d30 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe369ea0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe3640d5d30 0x7fe36416a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe368e9e640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe36415f790 0x7fe3640cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58102/0 (socket says 172.21.15.66:58102) 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe368e9e640 1 -- 172.21.15.66:0/281358288 learned_addr learned my addr 172.21.15.66:0/281358288 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe369ea0640 1 -- 172.21.15.66:0/281358288 >> v1:172.21.15.190:6789/0 conn(0x7fe36415f3b0 legacy=0x7fe3640d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe369ea0640 1 -- 172.21.15.66:0/281358288 >> v1:172.21.15.66:6789/0 conn(0x7fe36415f790 legacy=0x7fe3640cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe369ea0640 1 -- 172.21.15.66:0/281358288 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3640c8f60 con 0x7fe3640d5d30 2024-05-10T11:12:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.831+0000 7fe35bfff640 1 -- 172.21.15.66:0/281358288 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487787629 0 0) 0x7fe3640d30b0 con 0x7fe36415f790 2024-05-10T11:12:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.832+0000 7fe369ea0640 1 --2- 172.21.15.66:0/281358288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3640d5d30 0x7fe36416a0c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009d90 tx=0x7fe35c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d4b2fe69145e72 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.832+0000 7fe35bfff640 1 -- 172.21.15.66:0/281358288 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c007740 con 0x7fe3640d5d30 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.832+0000 7fe35bfff640 1 -- 172.21.15.66:0/281358288 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c0078e0 con 0x7fe3640d5d30 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.832+0000 7fe35bfff640 1 -- 172.21.15.66:0/281358288 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c007cb0 con 0x7fe3640d5d30 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 -- 172.21.15.66:0/281358288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3640d5d30 msgr2=0x7fe36416a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 --2- 172.21.15.66:0/281358288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3640d5d30 0x7fe36416a0c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009d90 tx=0x7fe35c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 -- 172.21.15.66:0/281358288 shutdown_connections 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 --2- 172.21.15.66:0/281358288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3640d5d30 0x7fe36416a0c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 -- 172.21.15.66:0/281358288 >> 172.21.15.66:0/281358288 conn(0x7fe3640d5130 msgr2=0x7fe3640d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 -- 172.21.15.66:0/281358288 shutdown_connections 2024-05-10T11:12:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.833+0000 7fe36b903640 1 -- 172.21.15.66:0/281358288 wait complete. 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.834+0000 7fe36b903640 1 Processor -- start 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.834+0000 7fe36b903640 1 -- start start 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36b903640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3640d5d30 0x7fe3640cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36b903640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 0x7fe364152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36b903640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3640b7d20 0x7fe364161b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36b903640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3640d3f80 con 0x7fe36415f3b0 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36b903640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe3640d3e00 con 0x7fe3640b7d20 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36b903640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe3640ca770 con 0x7fe3640d5d30 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 0x7fe364152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 0x7fe364152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44466/0 (socket says 172.21.15.66:44466) 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 -- 172.21.15.66:0/645167933 learned_addr learned my addr 172.21.15.66:0/645167933 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe369ea0640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3640b7d20 0x7fe364161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe36969f640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3640d5d30 0x7fe3640cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 -- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3640d5d30 msgr2=0x7fe3640cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3640d5d30 0x7fe3640cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 -- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3640b7d20 msgr2=0x7fe364161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3640b7d20 0x7fe364161b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 -- 172.21.15.66:0/645167933 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36406de90 con 0x7fe36415f3b0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe369ea0640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3640b7d20 0x7fe364161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe368e9e640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 0x7fe364152400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c410 tx=0x7fe35400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3540074e0 con 0x7fe36415f3b0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.835+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540047e0 con 0x7fe36415f3b0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.836+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36406e170 con 0x7fe36415f3b0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.836+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354004bd0 con 0x7fe36415f3b0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.836+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3640baf60 con 0x7fe36415f3b0 2024-05-10T11:12:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.837+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe36406ebc0 con 0x7fe36415f3b0 2024-05-10T11:12:27.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.837+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe354011070 con 0x7fe36415f3b0 2024-05-10T11:12:27.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.838+0000 7fe359ffb640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe348076300 0x7fe3480787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:27.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.838+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe354096ec0 con 0x7fe36415f3b0 2024-05-10T11:12:27.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.838+0000 7fe36969f640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe348076300 0x7fe3480787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:27.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.838+0000 7fe36969f640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe348076300 0x7fe3480787c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe360004ea0 tx=0x7fe360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:27.842+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe36406ebc0 con 0x7fe36415f3b0 2024-05-10T11:12:28.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.034+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe36406a220 con 0x7fe36415f3b0 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.034+0000 7fe359ffb640 1 -- 172.21.15.66:0/645167933 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fe354060b70 con 0x7fe36415f3b0 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:12:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:12:28.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.036+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe348076300 msgr2=0x7fe3480787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:28.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.036+0000 7fe36b903640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe348076300 0x7fe3480787c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe360004ea0 tx=0x7fe360009040 comp rx=0 tx=0).stop 2024-05-10T11:12:28.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.036+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 msgr2=0x7fe364152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:28.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.036+0000 7fe36b903640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 0x7fe364152400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c410 tx=0x7fe35400c8d0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 shutdown_connections 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe348076300 0x7fe3480787c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3640b7d20 0x7fe364161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe36415f3b0 0x7fe364152400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 --2- 172.21.15.66:0/645167933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3640d5d30 0x7fe3640cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 >> 172.21.15.66:0/645167933 conn(0x7fe3640d5130 msgr2=0x7fe36415e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 shutdown_connections 2024-05-10T11:12:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.037+0000 7fe36b903640 1 -- 172.21.15.66:0/645167933 wait complete. 2024-05-10T11:12:28.047 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:12:28.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:12:28.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.155+0000 7fca52538640 1 Processor -- start 2024-05-10T11:12:28.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.155+0000 7fca52538640 1 -- start start 2024-05-10T11:12:28.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.155+0000 7fca52538640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fca4c15f490 0x7fca4c0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.155+0000 7fca52538640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fca4c0d3d50 0x7fca4c0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca52538640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c0d1080 con 0x7fca4c0d5ca0 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca52538640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fca4c0b4e70 con 0x7fca4c15f490 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca52538640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fca4c0b4820 con 0x7fca4c0d3d50 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fca4c15f490 0x7fca4c0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4b7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fca4c0d5ca0 0x7fca4c0d3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58118/0 (socket says 172.21.15.66:58118) 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4b7fe640 1 -- 172.21.15.66:0/1146388996 learned_addr learned my addr 172.21.15.66:0/1146388996 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca50ad5640 1 --2- 172.21.15.66:0/1146388996 >> v2:172.21.15.190:3300/0 conn(0x7fca4c0d3d50 0x7fca4c0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4bfff640 1 -- 172.21.15.66:0/1146388996 >> v2:172.21.15.190:3300/0 conn(0x7fca4c0d3d50 msgr2=0x7fca4c0b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4bfff640 1 --2- 172.21.15.66:0/1146388996 >> v2:172.21.15.190:3300/0 conn(0x7fca4c0d3d50 0x7fca4c0b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4bfff640 1 -- 172.21.15.66:0/1146388996 >> v1:172.21.15.66:6789/0 conn(0x7fca4c0d5ca0 legacy=0x7fca4c0d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:28.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4bfff640 1 -- 172.21.15.66:0/1146388996 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c0b4b00 con 0x7fca4c15f490 2024-05-10T11:12:28.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.156+0000 7fca4affd640 1 -- 172.21.15.66:0/1146388996 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780343311 0 0) 0x7fca4c0d1080 con 0x7fca4c0d5ca0 2024-05-10T11:12:28.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca4bfff640 1 --2- 172.21.15.66:0/1146388996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c0d2f60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca4c08e490 tx=0x7fca3c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b531d2aae0dd47 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:28.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca4affd640 1 -- 172.21.15.66:0/1146388996 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c037070 con 0x7fca4c15f490 2024-05-10T11:12:28.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca4affd640 1 -- 172.21.15.66:0/1146388996 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c032440 con 0x7fca4c15f490 2024-05-10T11:12:28.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca4affd640 1 -- 172.21.15.66:0/1146388996 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c02ae60 con 0x7fca4c15f490 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 -- 172.21.15.66:0/1146388996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 msgr2=0x7fca4c0d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 --2- 172.21.15.66:0/1146388996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c0d2f60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca4c08e490 tx=0x7fca3c02a110 comp rx=0 tx=0).stop 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 -- 172.21.15.66:0/1146388996 shutdown_connections 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 --2- 172.21.15.66:0/1146388996 >> v2:172.21.15.190:3300/0 conn(0x7fca4c0d3d50 0x7fca4c0b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 --2- 172.21.15.66:0/1146388996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c0d2f60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 -- 172.21.15.66:0/1146388996 >> 172.21.15.66:0/1146388996 conn(0x7fca4c0d50f0 msgr2=0x7fca4c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 -- 172.21.15.66:0/1146388996 shutdown_connections 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.157+0000 7fca52538640 1 -- 172.21.15.66:0/1146388996 wait complete. 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.159+0000 7fca52538640 1 Processor -- start 2024-05-10T11:12:28.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.159+0000 7fca52538640 1 -- start start 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.159+0000 7fca52538640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca4c0d3d50 0x7fca4c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.159+0000 7fca52538640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca4c0d5ca0 0x7fca4c0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.159+0000 7fca52538640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca52538640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c15f9f0 con 0x7fca4c15f490 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca52538640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c15f870 con 0x7fca4c0d5ca0 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca52538640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c0b5840 con 0x7fca4c0d3d50 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44498/0 (socket says 172.21.15.66:44498) 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 -- 172.21.15.66:0/369818188 learned_addr learned my addr 172.21.15.66:0/369818188 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca4bfff640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca4c0d3d50 0x7fca4c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca4b7fe640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca4c0d5ca0 0x7fca4c0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 -- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca4c0d3d50 msgr2=0x7fca4c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:28.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca4c0d3d50 0x7fca4c152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 -- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca4c0d5ca0 msgr2=0x7fca4c0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca4c0d5ca0 0x7fca4c0ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 -- 172.21.15.66:0/369818188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c158490 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca4b7fe640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca4c0d5ca0 0x7fca4c0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca50ad5640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c154600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca44007de0 tx=0x7fca4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44014620 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44019070 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c158770 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44014a20 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.160+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c158d30 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.161+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca4c06a220 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.162+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca44014bc0 con 0x7fca4c15f490 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.163+0000 7fca48ff9640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca380762d0 0x7fca38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:28.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.163+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fca44097bf0 con 0x7fca4c15f490 2024-05-10T11:12:28.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.163+0000 7fca4bfff640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca380762d0 0x7fca38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:28.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.163+0000 7fca4bfff640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca380762d0 0x7fca38078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fca3c034000 tx=0x7fca3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:28.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.167+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fca440618a0 con 0x7fca4c15f490 2024-05-10T11:12:28.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:28.357+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fca4c0b3d20 con 0x7fca4c15f490 2024-05-10T11:12:29.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.078+0000 7fca48ff9640 1 -- 172.21.15.66:0/369818188 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fca440611a0 con 0x7fca4c15f490 2024-05-10T11:12:29.079 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:12:29.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.081+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca380762d0 msgr2=0x7fca38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:29.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.081+0000 7fca52538640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca380762d0 0x7fca38078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fca3c034000 tx=0x7fca3c02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:29.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.081+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 msgr2=0x7fca4c154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:29.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.081+0000 7fca52538640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c154600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca44007de0 tx=0x7fca4400e4b0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.082+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 shutdown_connections 2024-05-10T11:12:29.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.082+0000 7fca52538640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca380762d0 0x7fca38078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.082+0000 7fca52538640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c15f490 0x7fca4c154600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.082+0000 7fca52538640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca4c0d5ca0 0x7fca4c0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.082+0000 7fca52538640 1 --2- 172.21.15.66:0/369818188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca4c0d3d50 0x7fca4c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.082+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 >> 172.21.15.66:0/369818188 conn(0x7fca4c0d50f0 msgr2=0x7fca4c0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:29.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.083+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 shutdown_connections 2024-05-10T11:12:29.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.084+0000 7fca52538640 1 -- 172.21.15.66:0/369818188 wait complete. 2024-05-10T11:12:29.099 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-10T11:12:29.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.214+0000 7f8bf6e64640 1 Processor -- start 2024-05-10T11:12:29.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.214+0000 7f8bf6e64640 1 -- start start 2024-05-10T11:12:29.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf6e64640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8bf00d3df0 0x7f8bf00d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:29.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf6e64640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8bf00b4aa0 0x7f8bf00d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:29.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf6e64640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf00d41d0 con 0x7f8bf00b4f30 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf6e64640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf00cfd50 con 0x7f8bf00d3df0 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf6e64640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf00b5d90 con 0x7f8bf00b4aa0 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf4c00640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8bf00d3df0 0x7f8bf00d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf4c00640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8bf00d3df0 0x7f8bf00d2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44510/0 (socket says 172.21.15.66:44510) 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.215+0000 7f8bf4c00640 1 -- 172.21.15.66:0/1272478375 learned_addr learned my addr 172.21.15.66:0/1272478375 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8beffff640 1 --2- 172.21.15.66:0/1272478375 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00b4aa0 0x7f8bf00d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8bf4c00640 1 -- 172.21.15.66:0/1272478375 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00b4aa0 msgr2=0x7f8bf00d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8bf4c00640 1 --2- 172.21.15.66:0/1272478375 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00b4aa0 0x7f8bf00d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8bf4c00640 1 -- 172.21.15.66:0/1272478375 >> v1:172.21.15.66:6789/0 conn(0x7f8bf00b4f30 legacy=0x7f8bf00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8bf4c00640 1 -- 172.21.15.66:0/1272478375 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf00b54f0 con 0x7f8bf00d3df0 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8bef7fe640 1 -- 172.21.15.66:0/1272478375 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837892003 0 0) 0x7f8bf00d41d0 con 0x7f8bf00b4f30 2024-05-10T11:12:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8beffff640 1 --2- 172.21.15.66:0/1272478375 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00b4aa0 0x7f8bf00d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.216+0000 7f8bf4c00640 1 --2- 172.21.15.66:0/1272478375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00d2d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bf009eae0 tx=0x7f8be802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31c978767d1ef2d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bef7fe640 1 -- 172.21.15.66:0/1272478375 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8036070 con 0x7f8bf00d3df0 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bef7fe640 1 -- 172.21.15.66:0/1272478375 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be8031600 con 0x7f8bf00d3df0 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bef7fe640 1 -- 172.21.15.66:0/1272478375 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80319d0 con 0x7f8bf00d3df0 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 -- 172.21.15.66:0/1272478375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 msgr2=0x7f8bf00d2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/1272478375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00d2d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bf009eae0 tx=0x7f8be802a730 comp rx=0 tx=0).stop 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 -- 172.21.15.66:0/1272478375 shutdown_connections 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/1272478375 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00b4aa0 0x7f8bf00d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/1272478375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00d2d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 -- 172.21.15.66:0/1272478375 >> 172.21.15.66:0/1272478375 conn(0x7f8bf009e450 msgr2=0x7f8bf00d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 -- 172.21.15.66:0/1272478375 shutdown_connections 2024-05-10T11:12:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.217+0000 7f8bf6e64640 1 -- 172.21.15.66:0/1272478375 wait complete. 2024-05-10T11:12:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.219+0000 7f8bf6e64640 1 Processor -- start 2024-05-10T11:12:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.219+0000 7f8bf6e64640 1 -- start start 2024-05-10T11:12:29.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.219+0000 7f8bf6e64640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00b4aa0 0x7f8bf01e2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:29.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.219+0000 7f8bf6e64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bf00b4f30 0x7f8bf00ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:29.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf6e64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00ba700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:29.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf6e64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf00cff80 con 0x7f8bf00d3df0 2024-05-10T11:12:29.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf6e64640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf00b5ab0 con 0x7f8bf00b4aa0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf6e64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf00b6120 con 0x7f8bf00b4f30 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00ba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44524/0 (socket says 172.21.15.66:44524) 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 -- 172.21.15.66:0/2183726022 learned_addr learned my addr 172.21.15.66:0/2183726022 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf4c00640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00b4aa0 0x7f8bf01e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8beffff640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bf00b4f30 0x7f8bf00ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 -- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bf00b4f30 msgr2=0x7f8bf00ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bf00b4f30 0x7f8bf00ba1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 -- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00b4aa0 msgr2=0x7f8bf01e2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00b4aa0 0x7f8bf01e2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 -- 172.21.15.66:0/2183726022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01e5210 con 0x7f8bf00d3df0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf5401640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00ba700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c430 tx=0x7f8be000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0017070 con 0x7f8bf00d3df0 2024-05-10T11:12:29.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00035f0 con 0x7f8bf00d3df0 2024-05-10T11:12:29.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be00039e0 con 0x7f8bf00d3df0 2024-05-10T11:12:29.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf00b8d80 con 0x7f8bf00d3df0 2024-05-10T11:12:29.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.220+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf00b9340 con 0x7f8bf00d3df0 2024-05-10T11:12:29.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.221+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf006a220 con 0x7f8bf00d3df0 2024-05-10T11:12:29.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.222+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8be001a070 con 0x7f8bf00d3df0 2024-05-10T11:12:29.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.223+0000 7f8bed7fa640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bdc0762d0 0x7f8bdc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:29.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.223+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f8be00967c0 con 0x7f8bf00d3df0 2024-05-10T11:12:29.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.223+0000 7f8bf4c00640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bdc0762d0 0x7f8bdc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:29.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.224+0000 7f8bf4c00640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bdc0762d0 0x7f8bdc078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8be8033000 tx=0x7f8be8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:29.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.228+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8be0060390 con 0x7f8bf00d3df0 2024-05-10T11:12:29.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:29.421+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f8bf00d27c0 con 0x7f8bf00d3df0 2024-05-10T11:12:30.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.084+0000 7f8bed7fa640 1 -- 172.21.15.66:0/2183726022 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f8be005fc90 con 0x7f8bf00d3df0 2024-05-10T11:12:30.084 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:12:30.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bdc0762d0 msgr2=0x7f8bdc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:30.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bdc0762d0 0x7f8bdc078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8be8033000 tx=0x7f8be8009000 comp rx=0 tx=0).stop 2024-05-10T11:12:30.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 msgr2=0x7f8bf00ba700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:30.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00ba700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c430 tx=0x7f8be000c8f0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 shutdown_connections 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bdc0762d0 0x7f8bdc078790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf00d3df0 0x7f8bf00ba700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bf00b4f30 0x7f8bf00ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 --2- 172.21.15.66:0/2183726022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00b4aa0 0x7f8bf01e2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.087+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 >> 172.21.15.66:0/2183726022 conn(0x7f8bf009e450 msgr2=0x7f8bf00d59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.088+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 shutdown_connections 2024-05-10T11:12:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.088+0000 7f8bf6e64640 1 -- 172.21.15.66:0/2183726022 wait complete. 2024-05-10T11:12:30.117 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:12:30.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.227+0000 7ff20b7c1640 1 Processor -- start 2024-05-10T11:12:30.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.227+0000 7ff20b7c1640 1 -- start start 2024-05-10T11:12:30.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20b7c1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff20415f410 0x7ff2040d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20b7c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2040d0f10 0x7ff2040b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20b7c1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2040b54d0 0x7ff2040d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20b7c1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff2040d2800 con 0x7ff20415f410 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20b7c1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff2040d2ae0 con 0x7ff2040b54d0 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20b7c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2040d01d0 con 0x7ff2040d0f10 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20955d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff20415f410 0x7ff2040d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20955d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff20415f410 0x7ff2040d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44528/0 (socket says 172.21.15.66:44528) 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff20955d640 1 -- 172.21.15.66:0/1868699175 learned_addr learned my addr 172.21.15.66:0/1868699175 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff209d5e640 1 --2- 172.21.15.66:0/1868699175 >> v2:172.21.15.190:3300/0 conn(0x7ff2040b54d0 0x7ff2040d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.228+0000 7ff208d5c640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2040d0f10 0x7ff2040b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff20955d640 1 -- 172.21.15.66:0/1868699175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2040d0f10 msgr2=0x7ff2040b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff20955d640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2040d0f10 0x7ff2040b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff20955d640 1 -- 172.21.15.66:0/1868699175 >> v2:172.21.15.190:3300/0 conn(0x7ff2040b54d0 msgr2=0x7ff2040d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff20955d640 1 --2- 172.21.15.66:0/1868699175 >> v2:172.21.15.190:3300/0 conn(0x7ff2040b54d0 0x7ff2040d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff20955d640 1 -- 172.21.15.66:0/1868699175 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2040d04b0 con 0x7ff20415f410 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff209d5e640 1 --2- 172.21.15.66:0/1868699175 >> v2:172.21.15.190:3300/0 conn(0x7ff2040b54d0 0x7ff2040d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff208d5c640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2040d0f10 0x7ff2040b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff20955d640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff20415f410 0x7ff2040d09d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff20406c840 tx=0x7ff1fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34b8745da105f47 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff203fff640 1 -- 172.21.15.66:0/1868699175 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc037070 con 0x7ff20415f410 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff203fff640 1 -- 172.21.15.66:0/1868699175 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc032440 con 0x7ff20415f410 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.229+0000 7ff203fff640 1 -- 172.21.15.66:0/1868699175 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc032810 con 0x7ff20415f410 2024-05-10T11:12:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1868699175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff20415f410 msgr2=0x7ff2040d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff20415f410 0x7ff2040d09d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff20406c840 tx=0x7ff1fc02a140 comp rx=0 tx=0).stop 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1868699175 shutdown_connections 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1868699175 >> v2:172.21.15.190:3300/0 conn(0x7ff2040b54d0 0x7ff2040d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2040d0f10 0x7ff2040b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1868699175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff20415f410 0x7ff2040d09d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1868699175 >> 172.21.15.66:0/1868699175 conn(0x7ff20408ed30 msgr2=0x7ff20409e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1868699175 shutdown_connections 2024-05-10T11:12:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.230+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1868699175 wait complete. 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.231+0000 7ff20b7c1640 1 Processor -- start 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.231+0000 7ff20b7c1640 1 -- start start 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20b7c1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2040b54d0 0x7ff20415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20b7c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 0x7ff2040cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20b7c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff20415f410 0x7ff2040ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20b7c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040cffb0 con 0x7ff2040d0f10 2024-05-10T11:12:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20b7c1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040cfe30 con 0x7ff2040b54d0 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20b7c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2040d3c10 con 0x7ff20415f410 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 0x7ff2040cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 0x7ff2040cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44542/0 (socket says 172.21.15.66:44542) 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 -- 172.21.15.66:0/1980474979 learned_addr learned my addr 172.21.15.66:0/1980474979 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20955d640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2040b54d0 0x7ff20415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff209d5e640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff20415f410 0x7ff2040ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 -- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff20415f410 msgr2=0x7ff2040ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff20415f410 0x7ff2040ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 -- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2040b54d0 msgr2=0x7ff20415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2040b54d0 0x7ff20415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff208d5c640 1 -- 172.21.15.66:0/1980474979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20415cde0 con 0x7ff2040d0f10 2024-05-10T11:12:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.232+0000 7ff20955d640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2040b54d0 0x7ff20415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.233+0000 7ff208d5c640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 0x7ff2040cdd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c7f0 tx=0x7ff1f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.233+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8015070 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.233+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f8007a30 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.233+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2040cd1b0 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.233+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8007e00 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.233+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2040cd770 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.234+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2040b4f90 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.235+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff1f8018070 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.235+0000 7ff201ffb640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1f00762d0 0x7ff1f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.235+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7ff1f8097390 con 0x7ff2040d0f10 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.235+0000 7ff20955d640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1f00762d0 0x7ff1f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.236+0000 7ff20955d640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1f00762d0 0x7ff1f0078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc034000 tx=0x7ff1fc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:30.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.240+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff2040b4f90 con 0x7ff2040d0f10 2024-05-10T11:12:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:30.470+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff20406a220 con 0x7ff2040d0f10 2024-05-10T11:12:31.086 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:12:31.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.085+0000 7ff201ffb640 1 -- 172.21.15.66:0/1980474979 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff20415cde0 con 0x7ff2040d0f10 2024-05-10T11:12:31.087 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T11:12:31.091 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:12:31.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.089+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1f00762d0 msgr2=0x7ff1f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:31.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.089+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1f00762d0 0x7ff1f0078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc034000 tx=0x7ff1fc02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:31.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 msgr2=0x7ff2040cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:31.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 0x7ff2040cdd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c7f0 tx=0x7ff1f800cbf0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 shutdown_connections 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1f00762d0 0x7ff1f0078790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff20415f410 0x7ff2040ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040d0f10 0x7ff2040cdd60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 --2- 172.21.15.66:0/1980474979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2040b54d0 0x7ff20415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.090+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 >> 172.21.15.66:0/1980474979 conn(0x7ff20408ed30 msgr2=0x7ff2040b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.091+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 shutdown_connections 2024-05-10T11:12:31.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.091+0000 7ff20b7c1640 1 -- 172.21.15.66:0/1980474979 wait complete. 2024-05-10T11:12:31.130 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-10T11:12:31.131 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-10T11:12:31.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.315+0000 7f829a587640 1 Processor -- start 2024-05-10T11:12:31.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.315+0000 7f829a587640 1 -- start start 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.316+0000 7f829a587640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f82940d35f0 0x7f82940d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.316+0000 7f829a587640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f82940d2df0 0x7f82940d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.316+0000 7f829a587640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82940d3f10 con 0x7f829415f6e0 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.316+0000 7f829a587640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f82940d5b30 con 0x7f82940d35f0 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.316+0000 7f829a587640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f82940b1c60 con 0x7f82940d2df0 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.316+0000 7f8293fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f82940d35f0 0x7f82940d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f82940d35f0 0x7f82940d39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44548/0 (socket says 172.21.15.66:44548) 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 -- 172.21.15.66:0/4005330271 learned_addr learned my addr 172.21.15.66:0/4005330271 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8298b24640 1 --2- 172.21.15.66:0/4005330271 >> v2:172.21.15.190:3300/0 conn(0x7f82940d2df0 0x7f82940d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 -- 172.21.15.66:0/4005330271 >> v2:172.21.15.190:3300/0 conn(0x7f82940d2df0 msgr2=0x7f82940d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 --2- 172.21.15.66:0/4005330271 >> v2:172.21.15.190:3300/0 conn(0x7f82940d2df0 0x7f82940d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 -- 172.21.15.66:0/4005330271 >> v1:172.21.15.190:6789/0 conn(0x7f829415f6e0 legacy=0x7f82940cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 -- 172.21.15.66:0/4005330271 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940d5d80 con 0x7f82940d35f0 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.317+0000 7f8293fff640 1 --2- 172.21.15.66:0/4005330271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f82940d39d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82940d4fa0 tx=0x7f828402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5f6bf127d54b42 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f82937fe640 1 -- 172.21.15.66:0/4005330271 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284037070 con 0x7f82940d35f0 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f82937fe640 1 -- 172.21.15.66:0/4005330271 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8284032440 con 0x7f82940d35f0 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f82937fe640 1 -- 172.21.15.66:0/4005330271 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284032810 con 0x7f82940d35f0 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 -- 172.21.15.66:0/4005330271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 msgr2=0x7f82940d39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 --2- 172.21.15.66:0/4005330271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f82940d39d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82940d4fa0 tx=0x7f828402a150 comp rx=0 tx=0).stop 2024-05-10T11:12:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 -- 172.21.15.66:0/4005330271 shutdown_connections 2024-05-10T11:12:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 --2- 172.21.15.66:0/4005330271 >> v2:172.21.15.190:3300/0 conn(0x7f82940d2df0 0x7f82940d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 --2- 172.21.15.66:0/4005330271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f82940d39d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 -- 172.21.15.66:0/4005330271 >> 172.21.15.66:0/4005330271 conn(0x7f82940d5010 msgr2=0x7f82940d5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 -- 172.21.15.66:0/4005330271 shutdown_connections 2024-05-10T11:12:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.318+0000 7f829a587640 1 -- 172.21.15.66:0/4005330271 wait complete. 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 Processor -- start 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 -- start start 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82940d2df0 0x7f8294160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f8294156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940cce40 0x7f82940cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f82940d2380 con 0x7f82940d35f0 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f82940d2200 con 0x7f82940cce40 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.320+0000 7f829a587640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f82940d0800 con 0x7f82940d2df0 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f8294156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f8294156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44558/0 (socket says 172.21.15.66:44558) 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 -- 172.21.15.66:0/1298832927 learned_addr learned my addr 172.21.15.66:0/1298832927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:31.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f8298b24640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940cce40 0x7f82940cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f8293fff640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82940d2df0 0x7f8294160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 -- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82940d2df0 msgr2=0x7f8294160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82940d2df0 0x7f8294160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 -- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940cce40 msgr2=0x7f82940cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940cce40 0x7f82940cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 -- 172.21.15.66:0/1298832927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940cd900 con 0x7f82940d35f0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f828bfff640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f8294156ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c3c0 tx=0x7f827c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c0052d0 con 0x7f82940d35f0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c005490 con 0x7f82940d35f0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829415fd20 con 0x7f82940d35f0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c007260 con 0x7f82940d35f0 2024-05-10T11:12:31.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.321+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941f5db0 con 0x7f82940d35f0 2024-05-10T11:12:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.322+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829406a220 con 0x7f82940d35f0 2024-05-10T11:12:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.323+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f827c007400 con 0x7f82940d35f0 2024-05-10T11:12:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.323+0000 7f82917fa640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8274076300 0x7f82740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.323+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f827c096a10 con 0x7f82940d35f0 2024-05-10T11:12:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.324+0000 7f8293fff640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8274076300 0x7f82740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.324+0000 7f8293fff640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8274076300 0x7f82740787c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8284034000 tx=0x7f828402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:31.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.328+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f827c060400 con 0x7f82940d35f0 2024-05-10T11:12:31.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:31.529+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f82940d33d0 con 0x7f82940d35f0 2024-05-10T11:12:32.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.097+0000 7f82917fa640 1 -- 172.21.15.66:0/1298832927 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f827c0683f0 con 0x7f82940d35f0 2024-05-10T11:12:32.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.100+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8274076300 msgr2=0x7f82740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:32.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.100+0000 7f829a587640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8274076300 0x7f82740787c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8284034000 tx=0x7f828402e000 comp rx=0 tx=0).stop 2024-05-10T11:12:32.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.100+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 msgr2=0x7f8294156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:32.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.100+0000 7f829a587640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f8294156ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c3c0 tx=0x7f827c00c880 comp rx=0 tx=0).stop 2024-05-10T11:12:32.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 shutdown_connections 2024-05-10T11:12:32.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8274076300 0x7f82740787c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940cce40 0x7f82940cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82940d35f0 0x7f8294156ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 --2- 172.21.15.66:0/1298832927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82940d2df0 0x7f8294160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 >> 172.21.15.66:0/1298832927 conn(0x7f82940d5010 msgr2=0x7f829406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:32.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 shutdown_connections 2024-05-10T11:12:32.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.101+0000 7f829a587640 1 -- 172.21.15.66:0/1298832927 wait complete. 2024-05-10T11:12:32.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:12:32.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.232+0000 7f0421de4640 1 Processor -- start 2024-05-10T11:12:32.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.232+0000 7f0421de4640 1 -- start start 2024-05-10T11:12:32.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f0421de4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f041c0d5ba0 0x7f041c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:32.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f0421de4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f041c0d3cb0 0x7f041c162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f0421de4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c0b62d0 con 0x7f041c0d38d0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f0421de4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f041c0d2e60 con 0x7f041c0d5ba0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f0421de4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f041c0d01a0 con 0x7f041c0d3cb0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f041c0d5ba0 0x7f041c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041b7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f041c0d38d0 0x7f041c0b7ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58134/0 (socket says 172.21.15.66:58134) 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041b7fe640 1 -- 172.21.15.66:0/1848547125 learned_addr learned my addr 172.21.15.66:0/1848547125 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041bfff640 1 --2- 172.21.15.66:0/1848547125 >> v2:172.21.15.190:3300/0 conn(0x7f041c0d3cb0 0x7f041c162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041affd640 1 -- 172.21.15.66:0/1848547125 >> v2:172.21.15.190:3300/0 conn(0x7f041c0d3cb0 msgr2=0x7f041c162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041affd640 1 --2- 172.21.15.66:0/1848547125 >> v2:172.21.15.190:3300/0 conn(0x7f041c0d3cb0 0x7f041c162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041affd640 1 -- 172.21.15.66:0/1848547125 >> v1:172.21.15.66:6789/0 conn(0x7f041c0d38d0 legacy=0x7f041c0b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041affd640 1 -- 172.21.15.66:0/1848547125 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c0d3390 con 0x7f041c0d5ba0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.233+0000 7f041a7fc640 1 -- 172.21.15.66:0/1848547125 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423691534 0 0) 0x7f041c0b62d0 con 0x7f041c0d38d0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.234+0000 7f041affd640 1 --2- 172.21.15.66:0/1848547125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d5ba0 0x7f041c0d20c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f041c0d5030 tx=0x7f041002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa69a838f3a39e79 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:32.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.234+0000 7f041a7fc640 1 -- 172.21.15.66:0/1848547125 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410037070 con 0x7f041c0d5ba0 2024-05-10T11:12:32.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.234+0000 7f041a7fc640 1 -- 172.21.15.66:0/1848547125 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041002add0 con 0x7f041c0d5ba0 2024-05-10T11:12:32.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.234+0000 7f041a7fc640 1 -- 172.21.15.66:0/1848547125 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410032660 con 0x7f041c0d5ba0 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 -- 172.21.15.66:0/1848547125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d5ba0 msgr2=0x7f041c0d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 --2- 172.21.15.66:0/1848547125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d5ba0 0x7f041c0d20c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f041c0d5030 tx=0x7f041002a080 comp rx=0 tx=0).stop 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 -- 172.21.15.66:0/1848547125 shutdown_connections 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 --2- 172.21.15.66:0/1848547125 >> v2:172.21.15.190:3300/0 conn(0x7f041c0d3cb0 0x7f041c162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 --2- 172.21.15.66:0/1848547125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d5ba0 0x7f041c0d20c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 -- 172.21.15.66:0/1848547125 >> 172.21.15.66:0/1848547125 conn(0x7f041c0d5080 msgr2=0x7f041c0d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 -- 172.21.15.66:0/1848547125 shutdown_connections 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.235+0000 7f0421de4640 1 -- 172.21.15.66:0/1848547125 wait complete. 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.236+0000 7f0421de4640 1 Processor -- start 2024-05-10T11:12:32.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.236+0000 7f0421de4640 1 -- start start 2024-05-10T11:12:32.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f0421de4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 0x7f041c0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:32.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f0421de4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f041c0d3cb0 0x7f041c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f0421de4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f041c0d5ba0 0x7f041c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f0421de4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f041c162a50 con 0x7f041c0d38d0 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f0421de4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f041c0cfe30 con 0x7f041c0d5ba0 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f0421de4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f041c162bd0 con 0x7f041c0d3cb0 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 0x7f041c0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 0x7f041c0b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44564/0 (socket says 172.21.15.66:44564) 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 -- 172.21.15.66:0/1003125522 learned_addr learned my addr 172.21.15.66:0/1003125522 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041bfff640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f041c0d5ba0 0x7f041c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041affd640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f041c0d3cb0 0x7f041c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 -- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f041c0d3cb0 msgr2=0x7f041c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:32.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f041c0d3cb0 0x7f041c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 -- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f041c0d5ba0 msgr2=0x7f041c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f041c0d5ba0 0x7f041c0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041b7fe640 1 -- 172.21.15.66:0/1003125522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c0cee60 con 0x7f041c0d38d0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.237+0000 7f041affd640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f041c0d3cb0 0x7f041c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.238+0000 7f041b7fe640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 0x7f041c0b55f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c4d0 tx=0x7f040c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.238+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c018070 con 0x7f041c0d38d0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.238+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c007500 con 0x7f041c0d38d0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.238+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c004a20 con 0x7f041c0d38d0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.238+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c0b5b30 con 0x7f041c0d38d0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.238+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c14f0e0 con 0x7f041c0d38d0 2024-05-10T11:12:32.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.239+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c06a290 con 0x7f041c0d38d0 2024-05-10T11:12:32.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.240+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f040c004bc0 con 0x7f041c0d38d0 2024-05-10T11:12:32.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.240+0000 7f0403fff640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0408076300 0x7f04080787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:32.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.240+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f040c096860 con 0x7f041c0d38d0 2024-05-10T11:12:32.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.240+0000 7f041affd640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0408076300 0x7f04080787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:32.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.241+0000 7f041affd640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0408076300 0x7f04080787c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0410034000 tx=0x7f041002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:32.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.244+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f040c05fad0 con 0x7f041c0d38d0 2024-05-10T11:12:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:32.435+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f041c08cfb0 con 0x7f041c0d38d0 2024-05-10T11:12:34.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.108+0000 7f0403fff640 1 -- 172.21.15.66:0/1003125522 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f040c063dd0 con 0x7f041c0d38d0 2024-05-10T11:12:34.109 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data_ec' created 2024-05-10T11:12:34.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0408076300 msgr2=0x7f04080787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:34.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0408076300 0x7f04080787c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0410034000 tx=0x7f041002e000 comp rx=0 tx=0).stop 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 msgr2=0x7f041c0b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 0x7f041c0b55f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c4d0 tx=0x7f040c00c990 comp rx=0 tx=0).stop 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 shutdown_connections 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0408076300 0x7f04080787c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f041c0d5ba0 0x7f041c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f041c0d3cb0 0x7f041c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 --2- 172.21.15.66:0/1003125522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0d38d0 0x7f041c0b55f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 >> 172.21.15.66:0/1003125522 conn(0x7f041c0d5080 msgr2=0x7f041c0b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 shutdown_connections 2024-05-10T11:12:34.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.112+0000 7f0421de4640 1 -- 172.21.15.66:0/1003125522 wait complete. 2024-05-10T11:12:34.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-10T11:12:34.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.244+0000 7f9432615640 1 Processor -- start 2024-05-10T11:12:34.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.244+0000 7f9432615640 1 -- start start 2024-05-10T11:12:34.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f9432615640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f942c0d3610 0x7f942c0d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f9432615640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942c0b46b0 con 0x7f942c15f600 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f9432615640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942c0b4990 con 0x7f942c0b5750 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f9432615640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f942c0b4c70 con 0x7f942c0d3610 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f942bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f942c15f600 0x7f942c0d0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58136/0 (socket says 172.21.15.66:58136) 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f942bfff640 1 -- 172.21.15.66:0/495798890 learned_addr learned my addr 172.21.15.66:0/495798890 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.245+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806173240 0 0) 0x7f942c0b46b0 con 0x7f942c15f600 2024-05-10T11:12:34.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9418003520 con 0x7f942c15f600 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9423fff640 1 --2- 172.21.15.66:0/495798890 >> v2:172.21.15.190:3300/0 conn(0x7f942c0d3610 0x7f942c0d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4245268237 0 0) 0x7f9418003520 con 0x7f942c15f600 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 >> v2:172.21.15.190:3300/0 conn(0x7f942c0d3610 msgr2=0x7f942c0d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 --2- 172.21.15.66:0/495798890 >> v2:172.21.15.190:3300/0 conn(0x7f942c0d3610 0x7f942c0d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 >> v1:172.21.15.190:6789/0 conn(0x7f942c0b5750 legacy=0x7f942c0b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0b4f50 con 0x7f942c15f600 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f941c001670 con 0x7f942c15f600 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 >> v1:172.21.15.66:6789/0 conn(0x7f942c15f600 legacy=0x7f942c0d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9418003a00 0x7f9418003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418004800 0x7f9418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9418005210 0x7f941800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0b4c70 con 0x7f9418005210 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f941800c160 con 0x7f9418004800 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f941800c360 con 0x7f9418003a00 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9430bb2640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9418005210 0x7f941800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f942bfff640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9418003a00 0x7f9418003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9423fff640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418004800 0x7f9418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9430bb2640 1 -- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9418003a00 msgr2=0x7f9418003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9430bb2640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9418003a00 0x7f9418003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9430bb2640 1 -- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418004800 msgr2=0x7f9418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9430bb2640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418004800 0x7f9418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.246+0000 7f9430bb2640 1 -- 172.21.15.66:0/495798890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418003520 con 0x7f9418005210 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.247+0000 7f9430bb2640 1 -- 172.21.15.66:0/495798890 reap_dead start 2024-05-10T11:12:34.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.247+0000 7f9430bb2640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9418005210 0x7f941800b9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9424001e20 tx=0x7f9418005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfa6715ed22c0d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.247+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424001a70 con 0x7f9418005210 2024-05-10T11:12:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.247+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942402ae40 con 0x7f9418005210 2024-05-10T11:12:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.247+0000 7f942b7fe640 1 -- 172.21.15.66:0/495798890 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424003bb0 con 0x7f9418005210 2024-05-10T11:12:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 -- 172.21.15.66:0/495798890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9418005210 msgr2=0x7f941800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9418005210 0x7f941800b9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9424001e20 tx=0x7f9418005830 comp rx=0 tx=0).stop 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 -- 172.21.15.66:0/495798890 shutdown_connections 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 --2- 172.21.15.66:0/495798890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9418005210 0x7f941800b9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 -- 172.21.15.66:0/495798890 >> 172.21.15.66:0/495798890 conn(0x7f942c09e390 msgr2=0x7f942c0d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 -- 172.21.15.66:0/495798890 shutdown_connections 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.248+0000 7f9432615640 1 -- 172.21.15.66:0/495798890 wait complete. 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.249+0000 7f9432615640 1 Processor -- start 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.249+0000 7f9432615640 1 -- start start 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9432615640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418005210 0x7f942c1f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9432615640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f942c0cd150 0x7f942c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9432615640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 0x7f942c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9432615640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0d3c20 con 0x7f942c15fa80 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9432615640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0d3aa0 con 0x7f9418005210 2024-05-10T11:12:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9432615640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f942c0d3da0 con 0x7f942c0cd150 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 0x7f942c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 0x7f942c15ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44586/0 (socket says 172.21.15.66:44586) 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 -- 172.21.15.66:0/572915390 learned_addr learned my addr 172.21.15.66:0/572915390 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9423fff640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f942c0cd150 0x7f942c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f942bfff640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418005210 0x7f942c1f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 -- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f942c0cd150 msgr2=0x7f942c14bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f942c0cd150 0x7f942c14bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 -- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418005210 msgr2=0x7f942c1f94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418005210 0x7f942c1f94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 -- 172.21.15.66:0/572915390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c1619c0 con 0x7f942c15fa80 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.250+0000 7f9430bb2640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 0x7f942c15ff00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f942402a8f0 tx=0x7f94240014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.251+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424001a70 con 0x7f942c15fa80 2024-05-10T11:12:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.251+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424003e10 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.251+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c1f9a20 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.251+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424007db0 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.251+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c14ec70 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.252+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942c06a220 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.252+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9424007030 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.253+0000 7f94297fa640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f940c0762d0 0x7f940c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.253+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f94240b7000 con 0x7f942c15fa80 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.253+0000 7f942bfff640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f940c0762d0 0x7f940c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.254+0000 7f942bfff640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f940c0762d0 0x7f940c078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f941c0017e0 tx=0x7f941c001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:34.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.257+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f942c1619c0 con 0x7f942c15fa80 2024-05-10T11:12:34.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:34.445+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f942c0d4e10 con 0x7f942c15fa80 2024-05-10T11:12:35.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.110+0000 7f94297fa640 1 -- 172.21.15.66:0/572915390 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f9424039070 con 0x7f942c15fa80 2024-05-10T11:12:35.110 INFO:teuthology.orchestra.run.smithi066.stderr:set pool 4 allow_ec_overwrites to true 2024-05-10T11:12:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.115+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f940c0762d0 msgr2=0x7f940c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.115+0000 7f9432615640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f940c0762d0 0x7f940c078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f941c0017e0 tx=0x7f941c001630 comp rx=0 tx=0).stop 2024-05-10T11:12:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.115+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 msgr2=0x7f942c15ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.115+0000 7f9432615640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 0x7f942c15ff00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f942402a8f0 tx=0x7f94240014a0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.117+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 shutdown_connections 2024-05-10T11:12:35.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.117+0000 7f9432615640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f940c0762d0 0x7f940c078790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.117+0000 7f9432615640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f942c15fa80 0x7f942c15ff00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.117+0000 7f9432615640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f942c0cd150 0x7f942c14bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.117+0000 7f9432615640 1 --2- 172.21.15.66:0/572915390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418005210 0x7f942c1f94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.117+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 >> 172.21.15.66:0/572915390 conn(0x7f942c09e390 msgr2=0x7f942c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.122+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 shutdown_connections 2024-05-10T11:12:35.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.125+0000 7f9432615640 1 -- 172.21.15.66:0/572915390 wait complete. 2024-05-10T11:12:35.146 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-10T11:12:35.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.256+0000 7f1d5e0da640 1 Processor -- start 2024-05-10T11:12:35.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.256+0000 7f1d5e0da640 1 -- start start 2024-05-10T11:12:35.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d5e0da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d580b4f90 0x7f1d580b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:35.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d5e0da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d580d2800 con 0x7f1d580d36d0 2024-05-10T11:12:35.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d5e0da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d580d2ae0 con 0x7f1d5815f410 2024-05-10T11:12:35.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d5e0da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1d580d01d0 con 0x7f1d580b4f90 2024-05-10T11:12:35.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d56ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d580b4f90 0x7f1d580b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:35.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d57fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1d580d36d0 0x7f1d580d1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50616/0 (socket says 172.21.15.66:50616) 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d57fff640 1 -- 172.21.15.66:0/3000496864 learned_addr learned my addr 172.21.15.66:0/3000496864 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d56ffd640 1 -- 172.21.15.66:0/3000496864 >> v1:172.21.15.190:6789/0 conn(0x7f1d5815f410 legacy=0x7f1d580d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d56ffd640 1 -- 172.21.15.66:0/3000496864 >> v1:172.21.15.66:6789/0 conn(0x7f1d580d36d0 legacy=0x7f1d580d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d56ffd640 1 -- 172.21.15.66:0/3000496864 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d580d04b0 con 0x7f1d580b4f90 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.257+0000 7f1d567fc640 1 -- 172.21.15.66:0/3000496864 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991477393 0 0) 0x7f1d580d2800 con 0x7f1d580d36d0 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d56ffd640 1 --2- 172.21.15.66:0/3000496864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580b4f90 0x7f1d580b5410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097a0 tx=0x7f1d4c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebaaa65072ab735 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d567fc640 1 -- 172.21.15.66:0/3000496864 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c037070 con 0x7f1d580b4f90 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d567fc640 1 -- 172.21.15.66:0/3000496864 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c02ae50 con 0x7f1d580b4f90 2024-05-10T11:12:35.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d567fc640 1 -- 172.21.15.66:0/3000496864 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c032660 con 0x7f1d580b4f90 2024-05-10T11:12:35.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 -- 172.21.15.66:0/3000496864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580b4f90 msgr2=0x7f1d580b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:35.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/3000496864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580b4f90 0x7f1d580b5410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097a0 tx=0x7f1d4c02a140 comp rx=0 tx=0).stop 2024-05-10T11:12:35.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 -- 172.21.15.66:0/3000496864 shutdown_connections 2024-05-10T11:12:35.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/3000496864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580b4f90 0x7f1d580b5410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 -- 172.21.15.66:0/3000496864 >> 172.21.15.66:0/3000496864 conn(0x7f1d5808ed30 msgr2=0x7f1d5809e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:35.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 -- 172.21.15.66:0/3000496864 shutdown_connections 2024-05-10T11:12:35.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.258+0000 7f1d5e0da640 1 -- 172.21.15.66:0/3000496864 wait complete. 2024-05-10T11:12:35.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.260+0000 7f1d5e0da640 1 Processor -- start 2024-05-10T11:12:35.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.260+0000 7f1d5e0da640 1 -- start start 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d580b4f90 0x7f1d581587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 0x7f1d580ba480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d5815f410 0x7f1d580b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d580cffb0 con 0x7f1d580d36d0 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d580cfe30 con 0x7f1d5815f410 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d580d10e0 con 0x7f1d580b4f90 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 0x7f1d580ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 0x7f1d580ba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49178/0 (socket says 172.21.15.66:49178) 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 -- 172.21.15.66:0/813186644 learned_addr learned my addr 172.21.15.66:0/813186644 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:35.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d577fe640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d580b4f90 0x7f1d581587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d57fff640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d5815f410 0x7f1d580b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 -- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d580b4f90 msgr2=0x7f1d581587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d580b4f90 0x7f1d581587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 -- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d5815f410 msgr2=0x7f1d580b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d5815f410 0x7f1d580b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 -- 172.21.15.66:0/813186644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d580baf60 con 0x7f1d580d36d0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d56ffd640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 0x7f1d580ba480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098c0 tx=0x7f1d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c042070 con 0x7f1d580d36d0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c03e670 con 0x7f1d580d36d0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d580cd1c0 con 0x7f1d580d36d0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.261+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c037040 con 0x7f1d580d36d0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.262+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d580cd780 con 0x7f1d580d36d0 2024-05-10T11:12:35.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.262+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5806a220 con 0x7f1d580d36d0 2024-05-10T11:12:35.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.263+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d4c045070 con 0x7f1d580d36d0 2024-05-10T11:12:35.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.264+0000 7f1d3ffff640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d440762d0 0x7f1d44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:35.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.264+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f1d4c0b8080 con 0x7f1d580d36d0 2024-05-10T11:12:35.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.264+0000 7f1d577fe640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d440762d0 0x7f1d44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:35.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.265+0000 7f1d577fe640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d440762d0 0x7f1d44078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d48006fd0 tx=0x7f1d48009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:35.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.268+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1d4c081070 con 0x7f1d580d36d0 2024-05-10T11:12:35.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:35.504+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f1d580d6090 con 0x7f1d580d36d0 2024-05-10T11:12:36.073 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-05-10T11:12:36.073+0000 7f3328496640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:12:36.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.133+0000 7f1d3ffff640 1 -- 172.21.15.66:0/813186644 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f1d4c085370 con 0x7f1d580d36d0 2024-05-10T11:12:36.133 INFO:teuthology.orchestra.run.smithi066.stderr:added data pool 4 to fsmap 2024-05-10T11:12:36.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.135+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d440762d0 msgr2=0x7f1d44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.135+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d440762d0 0x7f1d44078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d48006fd0 tx=0x7f1d48009060 comp rx=0 tx=0).stop 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.135+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 msgr2=0x7f1d580ba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.135+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 0x7f1d580ba480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098c0 tx=0x7f1d4c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 shutdown_connections 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d440762d0 0x7f1d44078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d5815f410 0x7f1d580b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d580d36d0 0x7f1d580ba480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 --2- 172.21.15.66:0/813186644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d580b4f90 0x7f1d581587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 >> 172.21.15.66:0/813186644 conn(0x7f1d5808ed30 msgr2=0x7f1d580d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:36.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 shutdown_connections 2024-05-10T11:12:36.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.136+0000 7f1d5e0da640 1 -- 172.21.15.66:0/813186644 wait complete. 2024-05-10T11:12:36.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.258+0000 7f2cba683640 1 Processor -- start 2024-05-10T11:12:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.258+0000 7f2cba683640 1 -- start start 2024-05-10T11:12:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cba683640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2cb406c9d0 0x7f2cb40aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cba683640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb4163bd0 con 0x7f2cb41626d0 2024-05-10T11:12:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cba683640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb4162e10 con 0x7f2cb40af4b0 2024-05-10T11:12:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cba683640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb4162ab0 con 0x7f2cb406c9d0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cabfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2cb406c9d0 0x7f2cb40aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cb3fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2cb41626d0 0x7f2cb406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50620/0 (socket says 172.21.15.66:50620) 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cabfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2cb406c9d0 0x7f2cb40aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49188/0 (socket says 172.21.15.66:49188) 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cb3fff640 1 -- 172.21.15.66:0/1113902687 learned_addr learned my addr 172.21.15.66:0/1113902687 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cabfff640 1 -- 172.21.15.66:0/1113902687 >> v1:172.21.15.190:6789/0 conn(0x7f2cb40af4b0 legacy=0x7f2cb40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cabfff640 1 -- 172.21.15.66:0/1113902687 >> v1:172.21.15.66:6789/0 conn(0x7f2cb41626d0 legacy=0x7f2cb406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cabfff640 1 -- 172.21.15.66:0/1113902687 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb41630f0 con 0x7f2cb406c9d0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.259+0000 7f2cb37fe640 1 -- 172.21.15.66:0/1113902687 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834482111 0 0) 0x7f2cb4163bd0 con 0x7f2cb41626d0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.260+0000 7f2cabfff640 1 --2- 172.21.15.66:0/1113902687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb40aef70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0097a0 tx=0x7f2c9c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e32d77a7f1f408 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.260+0000 7f2cb37fe640 1 -- 172.21.15.66:0/1113902687 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c037070 con 0x7f2cb406c9d0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.260+0000 7f2cb37fe640 1 -- 172.21.15.66:0/1113902687 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c9c02ae50 con 0x7f2cb406c9d0 2024-05-10T11:12:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.260+0000 7f2cb37fe640 1 -- 172.21.15.66:0/1113902687 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c032660 con 0x7f2cb406c9d0 2024-05-10T11:12:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.260+0000 7f2cba683640 1 -- 172.21.15.66:0/1113902687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 msgr2=0x7f2cb40aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.260+0000 7f2cba683640 1 --2- 172.21.15.66:0/1113902687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb40aef70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0097a0 tx=0x7f2c9c02a140 comp rx=0 tx=0).stop 2024-05-10T11:12:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.261+0000 7f2cba683640 1 -- 172.21.15.66:0/1113902687 shutdown_connections 2024-05-10T11:12:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.261+0000 7f2cba683640 1 --2- 172.21.15.66:0/1113902687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb40aef70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.261+0000 7f2cba683640 1 -- 172.21.15.66:0/1113902687 >> 172.21.15.66:0/1113902687 conn(0x7f2cb40d1d70 msgr2=0x7f2cb40d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.261+0000 7f2cba683640 1 -- 172.21.15.66:0/1113902687 shutdown_connections 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.261+0000 7f2cba683640 1 -- 172.21.15.66:0/1113902687 wait complete. 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.262+0000 7f2cba683640 1 Processor -- start 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.262+0000 7f2cba683640 1 -- start start 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.262+0000 7f2cba683640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb4144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.262+0000 7f2cba683640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb40af4b0 0x7f2cb415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.262+0000 7f2cba683640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cb41626d0 0x7f2cb4144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cba683640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb40af920 con 0x7f2cb406c9d0 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cba683640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41636b0 con 0x7f2cb40af4b0 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cba683640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb40afc10 con 0x7f2cb41626d0 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb4144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb4144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49192/0 (socket says 172.21.15.66:49192) 2024-05-10T11:12:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 -- 172.21.15.66:0/2562673008 learned_addr learned my addr 172.21.15.66:0/2562673008 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cabfff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb40af4b0 0x7f2cb415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb8c20640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cb41626d0 0x7f2cb4144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 -- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cb41626d0 msgr2=0x7f2cb4144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cb41626d0 0x7f2cb4144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 -- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb40af4b0 msgr2=0x7f2cb415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb40af4b0 0x7f2cb415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 -- 172.21.15.66:0/2562673008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb4158200 con 0x7f2cb406c9d0 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cabfff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb40af4b0 0x7f2cb415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb8c20640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cb41626d0 0x7f2cb4144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb3fff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb4144130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c460 tx=0x7f2ca400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4018070 con 0x7f2cb406c9d0 2024-05-10T11:12:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca4007500 con 0x7f2cb406c9d0 2024-05-10T11:12:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb415c000 con 0x7f2cb406c9d0 2024-05-10T11:12:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4004a20 con 0x7f2cb406c9d0 2024-05-10T11:12:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.263+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb415c5c0 con 0x7f2cb406c9d0 2024-05-10T11:12:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.264+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb4069b00 con 0x7f2cb406c9d0 2024-05-10T11:12:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.265+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ca401b070 con 0x7f2cb406c9d0 2024-05-10T11:12:36.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.265+0000 7f2cb17fa640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2c94076300 0x7f2c940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.265+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2ca4096c30 con 0x7f2cb406c9d0 2024-05-10T11:12:36.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.266+0000 7f2cabfff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2c94076300 0x7f2c940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.266+0000 7f2cabfff640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2c94076300 0x7f2c940787c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c034000 tx=0x7f2c9c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.270+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2cb4069b00 con 0x7f2cb406c9d0 2024-05-10T11:12:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.499+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cb40693f0 con 0x7f2cb406c9d0 2024-05-10T11:12:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.500+0000 7f2cb17fa640 1 -- 172.21.15.66:0/2562673008 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5183 (secure 0 0 0) 0x7f2ca40601c0 con 0x7f2cb406c9d0 2024-05-10T11:12:36.500 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:36.501 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:35.506640+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:12:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 6 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2c94076300 msgr2=0x7f2c940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2c94076300 0x7f2c940787c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c034000 tx=0x7f2c9c02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 msgr2=0x7f2cb4144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb4144130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c460 tx=0x7f2ca400c920 comp rx=0 tx=0).stop 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 shutdown_connections 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2c94076300 0x7f2c940787c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cb41626d0 0x7f2cb4144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb40af4b0 0x7f2cb415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 --2- 172.21.15.66:0/2562673008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cb406c9d0 0x7f2cb4144130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 >> 172.21.15.66:0/2562673008 conn(0x7f2cb40d1d70 msgr2=0x7f2cb40711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:36.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 shutdown_connections 2024-05-10T11:12:36.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.502+0000 7f2cba683640 1 -- 172.21.15.66:0/2562673008 wait complete. 2024-05-10T11:12:36.514 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.616+0000 7fde26017640 1 Processor -- start 2024-05-10T11:12:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.617+0000 7fde26017640 1 -- start start 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.617+0000 7fde26017640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde200d3510 0x7fde20167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.617+0000 7fde26017640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde20072330 con 0x7fde2015d290 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.617+0000 7fde26017640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde20071d70 con 0x7fde200d1aa0 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.617+0000 7fde26017640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fde20072050 con 0x7fde200d3510 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.617+0000 7fde1f7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fde2015d290 0x7fde20071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50626/0 (socket says 172.21.15.66:50626) 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1f7fe640 1 -- 172.21.15.66:0/1157677019 learned_addr learned my addr 172.21.15.66:0/1157677019 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1ffff640 1 --2- 172.21.15.66:0/1157677019 >> v2:172.21.15.190:3300/0 conn(0x7fde200d3510 0x7fde20167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1e7fc640 1 -- 172.21.15.66:0/1157677019 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2748352048 0 0) 0x7fde20072330 con 0x7fde2015d290 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1e7fc640 1 -- 172.21.15.66:0/1157677019 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde08003520 con 0x7fde2015d290 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1e7fc640 1 -- 172.21.15.66:0/1157677019 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 57851367 0 0) 0x7fde08003520 con 0x7fde2015d290 2024-05-10T11:12:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1ffff640 1 -- 172.21.15.66:0/1157677019 >> v1:172.21.15.190:6789/0 conn(0x7fde200d1aa0 legacy=0x7fde200d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1ffff640 1 -- 172.21.15.66:0/1157677019 >> v1:172.21.15.66:6789/0 conn(0x7fde2015d290 legacy=0x7fde20071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.618+0000 7fde1ffff640 1 -- 172.21.15.66:0/1157677019 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde200cda70 con 0x7fde200d3510 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.619+0000 7fde1ffff640 1 --2- 172.21.15.66:0/1157677019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde20167ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde18009d90 tx=0x7fde1802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29174a254bad0b24 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.619+0000 7fde1e7fc640 1 -- 172.21.15.66:0/1157677019 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10001670 con 0x7fde200d3510 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.619+0000 7fde1e7fc640 1 -- 172.21.15.66:0/1157677019 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18007540 con 0x7fde200d3510 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.619+0000 7fde1e7fc640 1 -- 172.21.15.66:0/1157677019 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180078f0 con 0x7fde200d3510 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.619+0000 7fde26017640 1 -- 172.21.15.66:0/1157677019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 msgr2=0x7fde20167ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.619+0000 7fde26017640 1 --2- 172.21.15.66:0/1157677019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde20167ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde18009d90 tx=0x7fde1802a680 comp rx=0 tx=0).stop 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.620+0000 7fde26017640 1 -- 172.21.15.66:0/1157677019 shutdown_connections 2024-05-10T11:12:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.620+0000 7fde26017640 1 --2- 172.21.15.66:0/1157677019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde20167ca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.620+0000 7fde26017640 1 -- 172.21.15.66:0/1157677019 >> 172.21.15.66:0/1157677019 conn(0x7fde2009ba20 msgr2=0x7fde2009be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.620+0000 7fde26017640 1 -- 172.21.15.66:0/1157677019 shutdown_connections 2024-05-10T11:12:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.620+0000 7fde26017640 1 -- 172.21.15.66:0/1157677019 wait complete. 2024-05-10T11:12:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.621+0000 7fde26017640 1 Processor -- start 2024-05-10T11:12:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.621+0000 7fde26017640 1 -- start start 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 0x7fde2014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde201e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde2015d290 0x7fde201e6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde200cf280 con 0x7fde200d1aa0 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde20071a50 con 0x7fde200d3510 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fde200cf400 con 0x7fde2015d290 2024-05-10T11:12:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 0x7fde2014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 0x7fde2014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49196/0 (socket says 172.21.15.66:49196) 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 -- 172.21.15.66:0/1395957469 learned_addr learned my addr 172.21.15.66:0/1395957469 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1ffff640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde2015d290 0x7fde201e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1effd640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde201e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 -- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde2015d290 msgr2=0x7fde201e6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde2015d290 0x7fde201e6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 -- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 msgr2=0x7fde201e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde201e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 -- 172.21.15.66:0/1395957469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2014fc20 con 0x7fde200d1aa0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde1f7fe640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 0x7fde2014f6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde1000c750 tx=0x7fde1000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10017070 con 0x7fde200d1aa0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde10005ad0 con 0x7fde200d1aa0 2024-05-10T11:12:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde201e71d0 con 0x7fde200d1aa0 2024-05-10T11:12:36.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10007070 con 0x7fde200d1aa0 2024-05-10T11:12:36.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.622+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde201e7a10 con 0x7fde200d1aa0 2024-05-10T11:12:36.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.623+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde200d1f30 con 0x7fde200d1aa0 2024-05-10T11:12:36.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.624+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde1001a070 con 0x7fde200d1aa0 2024-05-10T11:12:36.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.624+0000 7fde07fff640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde0c0762d0 0x7fde0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.625+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde10096e70 con 0x7fde200d1aa0 2024-05-10T11:12:36.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.625+0000 7fde1effd640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde0c0762d0 0x7fde0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.625+0000 7fde1effd640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde0c0762d0 0x7fde0c078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde200b6140 tx=0x7fde14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.629+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fde200d1f30 con 0x7fde200d1aa0 2024-05-10T11:12:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.820+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde200693f0 con 0x7fde200d1aa0 2024-05-10T11:12:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.821+0000 7fde07fff640 1 -- 172.21.15.66:0/1395957469 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7fde201e71d0 con 0x7fde200d1aa0 2024-05-10T11:12:36.822 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:36.822 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde0c0762d0 msgr2=0x7fde0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde0c0762d0 0x7fde0c078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde200b6140 tx=0x7fde14009040 comp rx=0 tx=0).stop 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 msgr2=0x7fde2014f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 0x7fde2014f6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde1000c750 tx=0x7fde1000cc10 comp rx=0 tx=0).stop 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 shutdown_connections 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde0c0762d0 0x7fde0c078790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde2015d290 0x7fde201e6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde200d3510 0x7fde201e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 --2- 172.21.15.66:0/1395957469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde200d1aa0 0x7fde2014f6e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 >> 172.21.15.66:0/1395957469 conn(0x7fde2009ba20 msgr2=0x7fde200b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 shutdown_connections 2024-05-10T11:12:36.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.823+0000 7fde26017640 1 -- 172.21.15.66:0/1395957469 wait complete. 2024-05-10T11:12:36.835 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:36.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.937+0000 7f8a872a0640 1 Processor -- start 2024-05-10T11:12:36.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.937+0000 7f8a872a0640 1 -- start start 2024-05-10T11:12:36.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a872a0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a800b8860 0x7f8a8006e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a872a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 0x7f8a800ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a872a0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a8015fc90 con 0x7f8a800d0230 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a872a0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8006ee50 con 0x7f8a800b8860 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a872a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a800b8c40 con 0x7f8a800cfd80 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a8483b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8a800d0230 0x7f8a800cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50642/0 (socket says 172.21.15.66:50642) 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a8483b640 1 -- 172.21.15.66:0/2707179599 learned_addr learned my addr 172.21.15.66:0/2707179599 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a8583d640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 0x7f8a800ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a8503c640 1 --2- 172.21.15.66:0/2707179599 >> v2:172.21.15.190:3300/0 conn(0x7f8a800b8860 0x7f8a8006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630778235 0 0) 0x7f8a8015fc90 con 0x7f8a800d0230 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a6c003520 con 0x7f8a800d0230 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.938+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1884510070 0 0) 0x7f8a6c003520 con 0x7f8a800d0230 2024-05-10T11:12:36.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 msgr2=0x7f8a800ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 0x7f8a800ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 >> v2:172.21.15.190:3300/0 conn(0x7f8a800b8860 msgr2=0x7f8a8006e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 --2- 172.21.15.66:0/2707179599 >> v2:172.21.15.190:3300/0 conn(0x7f8a800b8860 0x7f8a8006e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a800cd570 con 0x7f8a800d0230 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f8a70001670 con 0x7f8a800d0230 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 >> v1:172.21.15.66:6789/0 conn(0x7f8a800d0230 legacy=0x7f8a800cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 0x7f8a6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c003f30 0x7f8a6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004d40 0x7f8a6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8006ee50 con 0x7f8a6c004d40 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800b8c40 con 0x7f8a6c003f30 2024-05-10T11:12:36.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c00ba10 con 0x7f8a800cfd80 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8503c640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 0x7f8a6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8583d640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004d40 0x7f8a6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8483b640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c003f30 0x7f8a6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8583d640 1 -- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 msgr2=0x7f8a6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8583d640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a800cfd80 0x7f8a6c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8583d640 1 -- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c003f30 msgr2=0x7f8a6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8583d640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c003f30 0x7f8a6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.939+0000 7f8a8583d640 1 -- 172.21.15.66:0/2707179599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c003520 con 0x7f8a6c004d40 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a8583d640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004d40 0x7f8a6c0051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009f90 tx=0x7f8a6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6fe9caf2ff4322 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78009c10 con 0x7f8a6c004d40 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78036070 con 0x7f8a6c004d40 2024-05-10T11:12:36.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a77fff640 1 -- 172.21.15.66:0/2707179599 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78031810 con 0x7f8a6c004d40 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a872a0640 1 -- 172.21.15.66:0/2707179599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004d40 msgr2=0x7f8a6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a872a0640 1 --2- 172.21.15.66:0/2707179599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004d40 0x7f8a6c0051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009f90 tx=0x7f8a6c005830 comp rx=0 tx=0).stop 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a8583d640 1 -- 172.21.15.66:0/2707179599 reap_dead start 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a872a0640 1 -- 172.21.15.66:0/2707179599 shutdown_connections 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.940+0000 7f8a872a0640 1 -- 172.21.15.66:0/2707179599 >> 172.21.15.66:0/2707179599 conn(0x7f8a800d2df0 msgr2=0x7f8a800d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.941+0000 7f8a872a0640 1 -- 172.21.15.66:0/2707179599 shutdown_connections 2024-05-10T11:12:36.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.941+0000 7f8a872a0640 1 -- 172.21.15.66:0/2707179599 wait complete. 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 Processor -- start 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 -- start start 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004d40 0x7f8a80157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 0x7f8a800cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a801f4c30 0x7f8a801f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800cde10 con 0x7f8a800cbed0 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800cdb30 con 0x7f8a801f4c30 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.942+0000 7f8a872a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8006ea60 con 0x7f8a6c004d40 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 0x7f8a800cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 0x7f8a800cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49216/0 (socket says 172.21.15.66:49216) 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 -- 172.21.15.66:0/4027390596 learned_addr learned my addr 172.21.15.66:0/4027390596 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:36.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8583d640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a801f4c30 0x7f8a801f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8503c640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004d40 0x7f8a80157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 -- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004d40 msgr2=0x7f8a80157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004d40 0x7f8a80157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 -- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a801f4c30 msgr2=0x7f8a801f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a801f4c30 0x7f8a801f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 -- 172.21.15.66:0/4027390596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a801f5a20 con 0x7f8a800cbed0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a8483b640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 0x7f8a800cc350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a700017e0 tx=0x7f8a700077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000f9c0 con 0x7f8a800cbed0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70018070 con 0x7f8a800cbed0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a801f84a0 con 0x7f8a800cbed0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000fde0 con 0x7f8a800cbed0 2024-05-10T11:12:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.943+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a801f8a60 con 0x7f8a800cbed0 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.944+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a801f8c60 con 0x7f8a800cbed0 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.945+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a7001c410 con 0x7f8a800cbed0 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.945+0000 7f8a75ffb640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a64076300 0x7f8a640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.945+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a700976a0 con 0x7f8a800cbed0 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.946+0000 7f8a8503c640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a64076300 0x7f8a640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.946+0000 7f8a8503c640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a64076300 0x7f8a640787c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009a60 tx=0x7f8a7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:36.949+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8a801f8c60 con 0x7f8a800cbed0 2024-05-10T11:12:37.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.143+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a8006a220 con 0x7f8a800cbed0 2024-05-10T11:12:37.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.144+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4027390596 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f8a70060d50 con 0x7f8a800cbed0 2024-05-10T11:12:37.145 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:37.145 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:37.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.146+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a64076300 msgr2=0x7f8a640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.146+0000 7f8a872a0640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a64076300 0x7f8a640787c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009a60 tx=0x7f8a7c008040 comp rx=0 tx=0).stop 2024-05-10T11:12:37.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 msgr2=0x7f8a800cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 0x7f8a800cc350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a700017e0 tx=0x7f8a700077a0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 shutdown_connections 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a64076300 0x7f8a640787c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a801f4c30 0x7f8a801f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800cbed0 0x7f8a800cc350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 --2- 172.21.15.66:0/4027390596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004d40 0x7f8a80157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 >> 172.21.15.66:0/4027390596 conn(0x7f8a800d2df0 msgr2=0x7f8a800d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 shutdown_connections 2024-05-10T11:12:37.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.147+0000 7f8a872a0640 1 -- 172.21.15.66:0/4027390596 wait complete. 2024-05-10T11:12:37.173 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:37.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.278+0000 7f8eba8b0640 1 Processor -- start 2024-05-10T11:12:37.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.278+0000 7f8eba8b0640 1 -- start start 2024-05-10T11:12:37.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eba8b0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8eb415f3b0 0x7f8eb40d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eba8b0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8eb415f790 0x7f8eb40d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eba8b0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb40d30b0 con 0x7f8eb40d5d30 2024-05-10T11:12:37.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eba8b0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb40d3390 con 0x7f8eb415f790 2024-05-10T11:12:37.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eba8b0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb40c8c80 con 0x7f8eb415f3b0 2024-05-10T11:12:37.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8eb415f790 0x7f8eb40d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8eb415f790 0x7f8eb40d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49222/0 (socket says 172.21.15.66:49222) 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1155484471 learned_addr learned my addr 172.21.15.66:0/1155484471 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb3fff640 1 --2- 172.21.15.66:0/1155484471 >> v2:172.21.15.190:3300/0 conn(0x7f8eb415f3b0 0x7f8eb40d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1155484471 >> v2:172.21.15.190:3300/0 conn(0x7f8eb415f3b0 msgr2=0x7f8eb40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 --2- 172.21.15.66:0/1155484471 >> v2:172.21.15.190:3300/0 conn(0x7f8eb415f3b0 0x7f8eb40d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1155484471 >> v1:172.21.15.190:6789/0 conn(0x7f8eb40d5d30 legacy=0x7f8eb40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1155484471 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb40c8f60 con 0x7f8eb415f790 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.279+0000 7f8eb3fff640 1 --2- 172.21.15.66:0/1155484471 >> v2:172.21.15.190:3300/0 conn(0x7f8eb415f3b0 0x7f8eb40d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.280+0000 7f8eb37fe640 1 --2- 172.21.15.66:0/1155484471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f790 0x7f8eb40d3c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8eb408e820 tx=0x7f8ea802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e171661832b827 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.280+0000 7f8eb2ffd640 1 -- 172.21.15.66:0/1155484471 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037070 con 0x7f8eb415f790 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.280+0000 7f8eb2ffd640 1 -- 172.21.15.66:0/1155484471 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8032440 con 0x7f8eb415f790 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.280+0000 7f8eb2ffd640 1 -- 172.21.15.66:0/1155484471 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8032810 con 0x7f8eb415f790 2024-05-10T11:12:37.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.280+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1155484471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f790 msgr2=0x7f8eb40d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.280+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1155484471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f790 0x7f8eb40d3c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8eb408e820 tx=0x7f8ea802a230 comp rx=0 tx=0).stop 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.281+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1155484471 shutdown_connections 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.281+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1155484471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f790 0x7f8eb40d3c30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.281+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1155484471 >> v2:172.21.15.190:3300/0 conn(0x7f8eb415f3b0 0x7f8eb40d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.281+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1155484471 >> 172.21.15.66:0/1155484471 conn(0x7f8eb40d5130 msgr2=0x7f8eb40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.281+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1155484471 shutdown_connections 2024-05-10T11:12:37.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.281+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1155484471 wait complete. 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.282+0000 7f8eba8b0640 1 Processor -- start 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.282+0000 7f8eba8b0640 1 -- start start 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40d5d30 0x7f8eb40a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 0x7f8eb406ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb41f8de0 0x7f8eb406e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40d0e60 con 0x7f8eb415f3b0 2024-05-10T11:12:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40d0ce0 con 0x7f8eb41f8de0 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40d0fe0 con 0x7f8eb40d5d30 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 0x7f8eb406ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 0x7f8eb406ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49228/0 (socket says 172.21.15.66:49228) 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1577319360 learned_addr learned my addr 172.21.15.66:0/1577319360 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb8e4d640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb41f8de0 0x7f8eb406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb3fff640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40d5d30 0x7f8eb40a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40d5d30 msgr2=0x7f8eb40a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40d5d30 0x7f8eb40a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb41f8de0 msgr2=0x7f8eb406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb41f8de0 0x7f8eb406e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 -- 172.21.15.66:0/1577319360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb41f5b40 con 0x7f8eb415f3b0 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb8e4d640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb41f8de0 0x7f8eb406e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb3fff640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40d5d30 0x7f8eb40a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb37fe640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 0x7f8eb406ddc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ea802a270 tx=0x7f8ea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037040 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8042070 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.283+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb41f5860 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.284+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8030bb0 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.284+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb41f85e0 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.285+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb406a220 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.285+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ea8047460 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.285+0000 7f8eb0ff9640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8ea00762d0 0x7f8ea0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.286+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ea80b8510 con 0x7f8eb415f3b0 2024-05-10T11:12:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.286+0000 7f8eb3fff640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8ea00762d0 0x7f8ea0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.286+0000 7f8eb3fff640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8ea00762d0 0x7f8ea0078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40ca1b0 tx=0x7f8ea4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:37.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.290+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8ea8081bc0 con 0x7f8eb415f3b0 2024-05-10T11:12:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.522+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8eb40d4960 con 0x7f8eb415f3b0 2024-05-10T11:12:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.523+0000 7f8eb0ff9640 1 -- 172.21.15.66:0/1577319360 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5183 (secure 0 0 0) 0x7f8ea80814c0 con 0x7f8eb415f3b0 2024-05-10T11:12:37.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:37.524 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:35.506640+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:12:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 6 2024-05-10T11:12:37.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8ea00762d0 msgr2=0x7f8ea0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8ea00762d0 0x7f8ea0078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40ca1b0 tx=0x7f8ea4008040 comp rx=0 tx=0).stop 2024-05-10T11:12:37.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 msgr2=0x7f8eb406ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 0x7f8eb406ddc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ea802a270 tx=0x7f8ea80046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 shutdown_connections 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8ea00762d0 0x7f8ea0078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb41f8de0 0x7f8eb406e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8eb415f3b0 0x7f8eb406ddc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 --2- 172.21.15.66:0/1577319360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40d5d30 0x7f8eb40a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 >> 172.21.15.66:0/1577319360 conn(0x7f8eb40d5130 msgr2=0x7f8eb40d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 shutdown_connections 2024-05-10T11:12:37.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.525+0000 7f8eba8b0640 1 -- 172.21.15.66:0/1577319360 wait complete. 2024-05-10T11:12:37.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.640+0000 7f1dd29b7640 1 Processor -- start 2024-05-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.640+0000 7f1dd29b7640 1 -- start start 2024-05-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd29b7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1dcc15d290 0x7f1dcc071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd29b7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1dcc071880 0x7f1dcc0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd29b7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc072330 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd29b7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc071d70 con 0x7f1dcc15d290 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd29b7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc072050 con 0x7f1dcc071880 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcbfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1dcc15d290 0x7f1dcc071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd0f54640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1dcc0d1aa0 0x7f1dcc0cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50652/0 (socket says 172.21.15.66:50652) 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dd0f54640 1 -- 172.21.15.66:0/3427886905 learned_addr learned my addr 172.21.15.66:0/3427886905 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcb7fe640 1 --2- 172.21.15.66:0/3427886905 >> v2:172.21.15.190:3300/0 conn(0x7f1dcc071880 0x7f1dcc0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcbfff640 1 -- 172.21.15.66:0/3427886905 >> v2:172.21.15.190:3300/0 conn(0x7f1dcc071880 msgr2=0x7f1dcc0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcbfff640 1 --2- 172.21.15.66:0/3427886905 >> v2:172.21.15.190:3300/0 conn(0x7f1dcc071880 0x7f1dcc0d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcbfff640 1 -- 172.21.15.66:0/3427886905 >> v1:172.21.15.66:6789/0 conn(0x7f1dcc0d1aa0 legacy=0x7f1dcc0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcaffd640 1 -- 172.21.15.66:0/3427886905 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045678244 0 0) 0x7f1dcc072330 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.641+0000 7f1dcbfff640 1 -- 172.21.15.66:0/3427886905 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc0cda70 con 0x7f1dcc15d290 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.642+0000 7f1dcbfff640 1 --2- 172.21.15.66:0/3427886905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc15d290 0x7f1dcc071340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc06d220 tx=0x7f1dbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfab1ca3372167ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.642+0000 7f1dcaffd640 1 -- 172.21.15.66:0/3427886905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc037070 con 0x7f1dcc15d290 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.642+0000 7f1dcaffd640 1 -- 172.21.15.66:0/3427886905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dbc032440 con 0x7f1dcc15d290 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.642+0000 7f1dcaffd640 1 -- 172.21.15.66:0/3427886905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc032810 con 0x7f1dcc15d290 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 -- 172.21.15.66:0/3427886905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc15d290 msgr2=0x7f1dcc071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/3427886905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc15d290 0x7f1dcc071340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc06d220 tx=0x7f1dbc02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 -- 172.21.15.66:0/3427886905 shutdown_connections 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/3427886905 >> v2:172.21.15.190:3300/0 conn(0x7f1dcc071880 0x7f1dcc0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/3427886905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc15d290 0x7f1dcc071340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 -- 172.21.15.66:0/3427886905 >> 172.21.15.66:0/3427886905 conn(0x7f1dcc09ba20 msgr2=0x7f1dcc09be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 -- 172.21.15.66:0/3427886905 shutdown_connections 2024-05-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.643+0000 7f1dd29b7640 1 -- 172.21.15.66:0/3427886905 wait complete. 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.644+0000 7f1dd29b7640 1 Processor -- start 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.644+0000 7f1dd29b7640 1 -- start start 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd29b7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dcc071880 0x7f1dcc1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd29b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd29b7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dcc15d290 0x7f1dcc0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd29b7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0cf400 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd29b7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0cf280 con 0x7f1dcc15d290 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd29b7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc0cf580 con 0x7f1dcc071880 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49250/0 (socket says 172.21.15.66:49250) 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 -- 172.21.15.66:0/256997545 learned_addr learned my addr 172.21.15.66:0/256997545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcbfff640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dcc071880 0x7f1dcc1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dd0f54640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dcc15d290 0x7f1dcc0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 -- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dcc071880 msgr2=0x7f1dcc1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dcc071880 0x7f1dcc1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 -- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dcc15d290 msgr2=0x7f1dcc0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dcc15d290 0x7f1dcc0c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 -- 172.21.15.66:0/256997545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc0c6cc0 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcbfff640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dcc071880 0x7f1dcc1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dcb7fe640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0c9790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000d7d0 tx=0x7f1dc000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.645+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000b6c0 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.646+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc0019070 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.646+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc06e630 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.646+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000bac0 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.646+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc0c9cd0 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.647+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc0693f0 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.647+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1dc000bc60 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.647+0000 7f1dc8ff9640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1db80762d0 0x7f1db8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.648+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1dc0097da0 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.648+0000 7f1dcbfff640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1db80762d0 0x7f1db8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.648+0000 7f1dcbfff640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1db80762d0 0x7f1db8078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc034000 tx=0x7f1dbc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.652+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1dc0061450 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.845+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dcc0b0d80 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.846+0000 7f1dc8ff9640 1 -- 172.21.15.66:0/256997545 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f1dc0060d50 con 0x7f1dcc0d1aa0 2024-05-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1db80762d0 msgr2=0x7f1db8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1db80762d0 0x7f1db8078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc034000 tx=0x7f1dbc02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 msgr2=0x7f1dcc0c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0c9790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000d7d0 tx=0x7f1dc000dc90 comp rx=0 tx=0).stop 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 shutdown_connections 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1db80762d0 0x7f1db8078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dcc15d290 0x7f1dcc0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0c9790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 --2- 172.21.15.66:0/256997545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dcc071880 0x7f1dcc1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 >> 172.21.15.66:0/256997545 conn(0x7f1dcc09ba20 msgr2=0x7f1dcc0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 shutdown_connections 2024-05-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:37.848+0000 7f1dd29b7640 1 -- 172.21.15.66:0/256997545 wait complete. 2024-05-10T11:12:38.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:12:30.471760+0000', 'modified': '2024-05-10T11:12:35.506640+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.190:6836/3761141260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 3761141260}, {'type': 'v1', 'addr': '172.21.15.190:6836', 'nonce': 3761141260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4293, 'qdb_cluster': [4293]} 2024-05-10T11:12:38.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:12:38.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.370+0000 7f0c2aad1640 1 Processor -- start 2024-05-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.370+0000 7f0c2aad1640 1 -- start start 2024-05-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c2aad1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162750 0x7f0c240d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c2aad1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c240d5cb0 0x7f0c240d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c2aad1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240b45f0 con 0x7f0c24162b30 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c2aad1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0c240b4f20 con 0x7f0c240d5cb0 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c2aad1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0c240d0fe0 con 0x7f0c24162750 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c240d5cb0 0x7f0c240d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c240d5cb0 0x7f0c240d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49266/0 (socket says 172.21.15.66:49266) 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 -- 172.21.15.66:0/1969870185 learned_addr learned my addr 172.21.15.66:0/1969870185 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 -- 172.21.15.66:0/1969870185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162750 msgr2=0x7f0c240d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c2886d640 1 --2- 172.21.15.66:0/1969870185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162750 0x7f0c240d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 --2- 172.21.15.66:0/1969870185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162750 0x7f0c240d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 -- 172.21.15.66:0/1969870185 >> v1:172.21.15.190:6789/0 conn(0x7f0c24162b30 legacy=0x7f0c240d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.371+0000 7f0c23fff640 1 -- 172.21.15.66:0/1969870185 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240b48d0 con 0x7f0c240d5cb0 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.372+0000 7f0c23fff640 1 --2- 172.21.15.66:0/1969870185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c240d5cb0 0x7f0c240d3630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009870 tx=0x7f0c1002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e1c2f4a8073435 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.372+0000 7f0c237fe640 1 -- 172.21.15.66:0/1969870185 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10037070 con 0x7f0c240d5cb0 2024-05-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.372+0000 7f0c237fe640 1 -- 172.21.15.66:0/1969870185 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c10032440 con 0x7f0c240d5cb0 2024-05-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.372+0000 7f0c237fe640 1 -- 172.21.15.66:0/1969870185 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10032810 con 0x7f0c240d5cb0 2024-05-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 -- 172.21.15.66:0/1969870185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c240d5cb0 msgr2=0x7f0c240d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/1969870185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c240d5cb0 0x7f0c240d3630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009870 tx=0x7f0c1002a180 comp rx=0 tx=0).stop 2024-05-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 -- 172.21.15.66:0/1969870185 shutdown_connections 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/1969870185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c240d5cb0 0x7f0c240d3630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/1969870185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162750 0x7f0c240d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 -- 172.21.15.66:0/1969870185 >> 172.21.15.66:0/1969870185 conn(0x7f0c2409e3b0 msgr2=0x7f0c240d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 -- 172.21.15.66:0/1969870185 shutdown_connections 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.373+0000 7f0c2aad1640 1 -- 172.21.15.66:0/1969870185 wait complete. 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.374+0000 7f0c2aad1640 1 Processor -- start 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.374+0000 7f0c2aad1640 1 -- start start 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 0x7f0c240b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162b30 0x7f0c240ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c240b7c40 0x7f0c241f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240d0d30 con 0x7f0c24162750 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240d0bb0 con 0x7f0c240b7c40 2024-05-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0c240b63c0 con 0x7f0c24162b30 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 0x7f0c240b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 0x7f0c240b9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49278/0 (socket says 172.21.15.66:49278) 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 -- 172.21.15.66:0/3189517619 learned_addr learned my addr 172.21.15.66:0/3189517619 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162b30 0x7f0c240ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2906e640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c240b7c40 0x7f0c241f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 -- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162b30 msgr2=0x7f0c240ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162b30 0x7f0c240ba1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 -- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c240b7c40 msgr2=0x7f0c241f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c240b7c40 0x7f0c241f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 -- 172.21.15.66:0/3189517619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240b91a0 con 0x7f0c24162750 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 0x7f0c240b9c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c820 tx=0x7f0c1800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c217fa640 1 -- 172.21.15.66:0/3189517619 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18015070 con 0x7f0c24162750 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c217fa640 1 -- 172.21.15.66:0/3189517619 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c18004240 con 0x7f0c24162750 2024-05-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c240b8100 con 0x7f0c24162750 2024-05-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.375+0000 7f0c217fa640 1 -- 172.21.15.66:0/3189517619 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800ce10 con 0x7f0c24162750 2024-05-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.376+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c240b86c0 con 0x7f0c24162750 2024-05-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.377+0000 7f0c217fa640 1 -- 172.21.15.66:0/3189517619 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c18007830 con 0x7f0c24162750 2024-05-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.378+0000 7f0c217fa640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c080762d0 0x7f0c08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.378+0000 7f0c217fa640 1 -- 172.21.15.66:0/3189517619 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c18097810 con 0x7f0c24162750 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.378+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c080762d0 0x7f0c08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.378+0000 7f0c2d7ef740 1 Processor -- start 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.378+0000 7f0c2d7ef740 1 -- start start 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.378+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c080762d0 0x7f0c08078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c10034000 tx=0x7f0c1002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2ef8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 0x55b4f2ef8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ec8bb0 0x55b4f2ecc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2e328d0 con 0x55b4f2ec8bb0 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2debc10 con 0x55b4f2ef6330 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b4f2e2e890 con 0x55b4f2ef5f50 2024-05-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 0x55b4f2ef8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2906e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ec8bb0 0x55b4f2ecc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 0x55b4f2ef8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:37872/0 (socket says 172.21.15.66:37872) 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 -- 172.21.15.66:0/3105991168 learned_addr learned my addr 172.21.15.66:0/3105991168 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2ef8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 -- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 msgr2=0x55b4f2ef8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2ef8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 -- 172.21.15.66:0/3105991168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ec8bb0 msgr2=0x55b4f2ecc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ec8bb0 0x55b4f2ecc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c23fff640 1 -- 172.21.15.66:0/3105991168 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4f2df35d0 con 0x55b4f2ef6330 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.379+0000 7f0c2906e640 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ec8bb0 0x55b4f2ecc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 0x55b4f2ef8ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c10035040 tx=0x7f0c1002c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee8151f31e7a826 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c0e7fc640 1 -- 172.21.15.66:0/3105991168 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10037040 con 0x55b4f2ef6330 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c0e7fc640 1 -- 172.21.15.66:0/3105991168 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1003e660 con 0x55b4f2ef6330 2024-05-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c0e7fc640 1 -- 172.21.15.66:0/3105991168 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1003ea10 con 0x55b4f2ef6330 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 msgr2=0x55b4f2ef8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 0x55b4f2ef8ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c10035040 tx=0x7f0c1002c000 comp rx=0 tx=0).stop 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3105991168 shutdown_connections 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ec8bb0 0x55b4f2ecc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2ef6330 0x55b4f2ef8ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3105991168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2ef8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3105991168 >> 172.21.15.66:0/3105991168 conn(0x55b4f2ecae20 msgr2=0x55b4f2f13760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.380+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3105991168 shutdown_connections 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.381+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3105991168 wait complete. 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.381+0000 7f0c2d7ef740 1 -- start start 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.381+0000 7f0c2d7ef740 1 Processor -- start 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2eed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2ef4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f16570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2ecdfd0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2def760 con 0x55b4f2efabb0 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b4f2ece2b0 con 0x55b4f2ef6330 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2eed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2d7ef740 10 client.0 _ll_register_callbacks cb 0x55b4f2e28cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2eed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49292/0 (socket says 172.21.15.66:49292) 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 -- 172.21.15.66:0/3598139688 learned_addr learned my addr 172.21.15.66:0/3598139688 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2ef4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2906e640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f16570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 -- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 msgr2=0x55b4f2ef4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2ef4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 -- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 msgr2=0x55b4f2f16570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f16570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.382+0000 7f0c2886d640 1 -- 172.21.15.66:0/3598139688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4f2b442d0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2886d640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2eed7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c1805c7b0 tx=0x7f0c18060d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1258434377ef507b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c037fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c037fe640 1 -- 172.21.15.66:0/3598139688 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1801e040 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c037fe640 1 -- 172.21.15.66:0/3598139688 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c18079b40 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c1003e660 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c037fe640 1 -- 172.21.15.66:0/3598139688 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f0c18060e30 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 10 client.4419 fetch_fsmap learned FSMap version 6 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55b4f2c0e6b0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c037fe640 1 -- 172.21.15.66:0/3598139688 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1003e660 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c037fe640 1 -- 172.21.15.66:0/3598139688 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f0c1808eba0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2024-05-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 20 client.4419 populate_metadata read hostname 'smithi066' 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2f1b580 0x55b4f2f18b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 4 client.4419 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 --> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4f2db6760 con 0x55b4f2f1b580 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.383+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2f1b580 0x55b4f2f18b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.384+0000 7f0c23fff640 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2f1b580 0x55b4f2f18b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ced9872b1b1ac0a server_cookie=5ccc99fd05f25feb in_seq=0 out_seq=0 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.384+0000 7f0c037fe640 10 client.4419 ms_handle_connect on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c037fe640 1 -- 172.21.15.66:0/3598139688 <== mds.0 v2:172.21.15.190:6834/3761141260 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b4f2db6760 con 0x55b4f2f1b580 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c037fe640 10 client.4419 handle_command_reply: tid=0 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 client.4419 shutdown 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 msgr2=0x55b4f2eed7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2eed7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c1805c7b0 tx=0x7f0c18060d30 comp rx=0 tx=0).stop 2024-05-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 shutdown_connections 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2f1b580 0x55b4f2f18b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f16570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2ef4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c037fe640 0 client.4419 ms_handle_reset on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/3598139688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2eed7c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 >> 172.21.15.66:0/3598139688 conn(0x55b4f2ec8bb0 msgr2=0x55b4f2ec7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 shutdown_connections 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/3598139688 wait complete. 2024-05-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.385+0000 7f0c2d7ef740 20 client.4419 trim_cache size 0 max 16384 2024-05-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.404+0000 7f0c2d7ef740 1 Processor -- start 2024-05-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.404+0000 7f0c2d7ef740 1 -- start start 2024-05-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2f379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 0x55b4f2ec7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2ec7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24201d50 con 0x55b4f2ef6330 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c242010b0 con 0x55b4f2efabb0 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0c24201700 con 0x55b4f2ef5f50 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 0x55b4f2ec7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 0x55b4f2ec7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49302/0 (socket says 172.21.15.66:49302) 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 -- 172.21.15.66:0/152840961 learned_addr learned my addr 172.21.15.66:0/152840961 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 -- 172.21.15.66:0/152840961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 msgr2=0x55b4f2f379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2f379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 -- 172.21.15.66:0/152840961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 msgr2=0x55b4f2ec7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2ec7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 -- 172.21.15.66:0/152840961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4f2ef4e80 con 0x55b4f2ef6330 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c23fff640 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 0x55b4f2ec7a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c1002a770 tx=0x7f0c1003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd811f38da5107a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c0dffb640 1 -- 172.21.15.66:0/152840961 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10058070 con 0x55b4f2ef6330 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c0dffb640 1 -- 172.21.15.66:0/152840961 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c100042e0 con 0x55b4f2ef6330 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.405+0000 7f0c0dffb640 1 -- 172.21.15.66:0/152840961 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10037040 con 0x55b4f2ef6330 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/152840961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 msgr2=0x55b4f2ec7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 0x55b4f2ec7a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c1002a770 tx=0x7f0c1003b000 comp rx=0 tx=0).stop 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/152840961 shutdown_connections 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2ec7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef6330 0x55b4f2ec7a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/152840961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef5f50 0x55b4f2f379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/152840961 >> 172.21.15.66:0/152840961 conn(0x55b4f2ec8bb0 msgr2=0x55b4f2ec8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/152840961 shutdown_connections 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/152840961 wait complete. 2024-05-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.406+0000 7f0c2d7ef740 1 -- start start 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 Processor -- start 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2f912b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2f090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f13e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2f1b400 con 0x55b4f2ef5f50 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2f1ab80 con 0x55b4f2efabb0 2024-05-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b4f2f1ba50 con 0x55b4f2ef6330 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2d7ef740 10 client.0 _ll_register_callbacks cb 0x7f0c18006f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2886d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2f912b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2886d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2f912b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49308/0 (socket says 172.21.15.66:49308) 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.407+0000 7f0c2886d640 1 -- 172.21.15.66:0/1351662748 learned_addr learned my addr 172.21.15.66:0/1351662748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2906e640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f13e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2886d640 1 -- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 msgr2=0x55b4f2f090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c23fff640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2f090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2886d640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2f090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2886d640 1 -- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 msgr2=0x55b4f2f13e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2886d640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f13e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2886d640 1 -- 172.21.15.66:0/1351662748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4f2f09630 con 0x55b4f2ef5f50 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2906e640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f13e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2886d640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2f912b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800cfd0 tx=0x7f0c18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d8bf509a8fd39b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c037fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c037fe640 1 -- 172.21.15.66:0/1351662748 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1801e040 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c037fe640 1 -- 172.21.15.66:0/1351662748 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c1805c0a0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c100042e0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c037fe640 1 -- 172.21.15.66:0/1351662748 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f0c18060500 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2d7ef740 10 client.4425 fetch_fsmap learned FSMap version 6 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55b4f2ec9f80 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c037fe640 1 -- 172.21.15.66:0/1351662748 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c100042e0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.408+0000 7f0c037fe640 1 -- 172.21.15.66:0/1351662748 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f0c1805c2a0 con 0x55b4f2ef5f50 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 10 client.4425 fetch_fsmap finished waiting for FSMap version 6 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 20 client.4425 populate_metadata read hostname 'smithi066' 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2eccef0 0x55b4f2f253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 4 client.4425 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 --> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] -- command(tid 0: {"prefix": "status"}) -- 0x55b4f2ed0150 con 0x55b4f2eccef0 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c23fff640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2eccef0 0x55b4f2f253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c23fff640 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2eccef0 0x55b4f2f253b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ab96558f88e8d3 server_cookie=dc4d7a74541275a4 in_seq=0 out_seq=0 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c037fe640 10 client.4425 ms_handle_connect on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c037fe640 1 -- 172.21.15.66:0/1351662748 <== mds.0 v2:172.21.15.190:6834/3761141260 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b4f2ed0150 con 0x55b4f2eccef0 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c037fe640 10 client.4425 handle_command_reply: tid=0 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.409+0000 7f0c2d7ef740 1 client.4425 shutdown 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 msgr2=0x55b4f2f912b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2f912b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800cfd0 tx=0x7f0c18000bc0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 shutdown_connections 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55b4f2eccef0 0x55b4f2f253b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b4f2efabb0 0x55b4f2f13e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b4f2ef6330 0x55b4f2f090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c037fe640 0 client.4425 ms_handle_reset on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 --2- 172.21.15.66:0/1351662748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b4f2ef5f50 0x55b4f2f912b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 >> 172.21.15.66:0/1351662748 conn(0x55b4f2ec8bb0 msgr2=0x55b4f2ecdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 shutdown_connections 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 1 -- 172.21.15.66:0/1351662748 wait complete. 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2d7ef740 20 client.4425 trim_cache size 0 max 16384 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4293, 2024-05-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 7.3234380569999997, 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 6, 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 25, 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 25, 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 13.337209836 2024-05-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c080762d0 msgr2=0x7f0c08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c080762d0 0x7f0c08078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c10034000 tx=0x7f0c1002e000 comp rx=0 tx=0).stop 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 msgr2=0x7f0c240b9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 0x7f0c240b9c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c820 tx=0x7f0c1800cce0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 shutdown_connections 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c080762d0 0x7f0c08078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c240b7c40 0x7f0c241f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c24162b30 0x7f0c240ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 --2- 172.21.15.66:0/3189517619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c24162750 0x7f0c240b9c60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 >> 172.21.15.66:0/3189517619 conn(0x7f0c2409e3b0 msgr2=0x7f0c2406d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 shutdown_connections 2024-05-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.410+0000 7f0c2aad1640 1 -- 172.21.15.66:0/3189517619 wait complete. 2024-05-10T11:12:38.421 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T11:12:38.421 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:38.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 Processor -- start 2024-05-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 -- start start 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7f8162940 0x7fe7f80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe7f80d59d0 0x7fe7f80d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f80b47a0 0x7fe7f80d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f8162d20 con 0x7fe7f80d59d0 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f80d2d20 con 0x7fe7f8162940 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.524+0000 7fe7fd17f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f80d3000 con 0x7fe7f80b47a0 2024-05-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe7f80d59d0 0x7fe7f80d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe7f80d59d0 0x7fe7f80d3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49312/0 (socket says 172.21.15.66:49312) 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 -- 172.21.15.66:0/3756082632 learned_addr learned my addr 172.21.15.66:0/3756082632 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f759e640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f80b47a0 0x7fe7f80d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f6d9d640 1 --2- 172.21.15.66:0/3756082632 >> v2:172.21.15.190:3300/0 conn(0x7fe7f8162940 0x7fe7f80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 -- 172.21.15.66:0/3756082632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f80b47a0 msgr2=0x7fe7f80d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f80b47a0 0x7fe7f80d3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 -- 172.21.15.66:0/3756082632 >> v2:172.21.15.190:3300/0 conn(0x7fe7f8162940 msgr2=0x7fe7f80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 --2- 172.21.15.66:0/3756082632 >> v2:172.21.15.190:3300/0 conn(0x7fe7f8162940 0x7fe7f80b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f659c640 1 -- 172.21.15.66:0/3756082632 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80d32e0 con 0x7fe7f80d59d0 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f759e640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f80b47a0 0x7fe7f80d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.525+0000 7fe7f6d9d640 1 --2- 172.21.15.66:0/3756082632 >> v2:172.21.15.190:3300/0 conn(0x7fe7f8162940 0x7fe7f80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7f659c640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80d3670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7f808d970 tx=0x7fe7ec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd3dc0c1d217a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7f5d9b640 1 -- 172.21.15.66:0/3756082632 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec036070 con 0x7fe7f80d59d0 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7f5d9b640 1 -- 172.21.15.66:0/3756082632 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec031600 con 0x7fe7f80d59d0 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7f5d9b640 1 -- 172.21.15.66:0/3756082632 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0319d0 con 0x7fe7f80d59d0 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 -- 172.21.15.66:0/3756082632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 msgr2=0x7fe7f80d3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80d3670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7f808d970 tx=0x7fe7ec02a610 comp rx=0 tx=0).stop 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 -- 172.21.15.66:0/3756082632 shutdown_connections 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f80b47a0 0x7fe7f80d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/3756082632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80d3670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/3756082632 >> v2:172.21.15.190:3300/0 conn(0x7fe7f8162940 0x7fe7f80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 -- 172.21.15.66:0/3756082632 >> 172.21.15.66:0/3756082632 conn(0x7fe7f809e380 msgr2=0x7fe7f80d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 -- 172.21.15.66:0/3756082632 shutdown_connections 2024-05-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.526+0000 7fe7fd17f640 1 -- 172.21.15.66:0/3756082632 wait complete. 2024-05-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.528+0000 7fe7fd17f640 1 Processor -- start 2024-05-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.528+0000 7fe7fd17f640 1 -- start start 2024-05-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7f80b47a0 0x7fe7f81f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80b9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f8162940 0x7fe7f80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80d2390 con 0x7fe7f80d59d0 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80cfc50 con 0x7fe7f80b47a0 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f80d2510 con 0x7fe7f8162940 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80b9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49320/0 (socket says 172.21.15.66:49320) 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 -- 172.21.15.66:0/2264073054 learned_addr learned my addr 172.21.15.66:0/2264073054 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f759e640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f8162940 0x7fe7f80c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f6d9d640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7f80b47a0 0x7fe7f81f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 -- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f8162940 msgr2=0x7fe7f80c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f8162940 0x7fe7f80c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 -- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7f80b47a0 msgr2=0x7fe7f81f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7f80b47a0 0x7fe7f81f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 -- 172.21.15.66:0/2264073054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80b9b60 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f759e640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f8162940 0x7fe7f80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f6d9d640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7f80b47a0 0x7fe7f81f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7f659c640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80b9410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec034040 tx=0x7fe7ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec036050 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec042070 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f80b9e40 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.529+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec007c50 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.530+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f80b8190 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.531+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f806a220 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.531+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe7ec047460 con 0x7fe7f80d59d0 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.532+0000 7fe7df7fe640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7e40762d0 0x7fe7e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.532+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7ec0b89b0 con 0x7fe7f80d59d0 2024-05-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.532+0000 7fe7f6d9d640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7e40762d0 0x7fe7e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.532+0000 7fe7f6d9d640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7e40762d0 0x7fe7e4078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006fd0 tx=0x7fe7e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.536+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe7ec082060 con 0x7fe7f80d59d0 2024-05-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.764+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7f80d2730 con 0x7fe7f80d59d0 2024-05-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.764+0000 7fe7df7fe640 1 -- 172.21.15.66:0/2264073054 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fe7ec081960 con 0x7fe7f80d59d0 2024-05-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7e40762d0 msgr2=0x7fe7e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7e40762d0 0x7fe7e4078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006fd0 tx=0x7fe7e8008040 comp rx=0 tx=0).stop 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 msgr2=0x7fe7f80b9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80b9410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec034040 tx=0x7fe7ec004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 shutdown_connections 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7e40762d0 0x7fe7e4078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7f8162940 0x7fe7f80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f80d59d0 0x7fe7f80b9410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 --2- 172.21.15.66:0/2264073054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7f80b47a0 0x7fe7f81f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 >> 172.21.15.66:0/2264073054 conn(0x7fe7f809e380 msgr2=0x7fe7f806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 shutdown_connections 2024-05-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38.766+0000 7fe7fd17f640 1 -- 172.21.15.66:0/2264073054 wait complete. 2024-05-10T11:12:38.777 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:12:38.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:12:38.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:12:38.777 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-10T11:12:38.777 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:38.778 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:12:38.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T11:12:38.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:12:38.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T11:12:38.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:38.778 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:38.797 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T11:12:38.797 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:38.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:38.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:38.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:38.994 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:12:39.020 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:12:39.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:39.022 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:12:39.120 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:12:39.120 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:12:39.120 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:12:39.120 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:12:39.120 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:12:39.121 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:39.121 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:39.121 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:12:39.121 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:12:39.121 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:12:39.121 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:39.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:39.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:39.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:39.357 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:12:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:39.374 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-05-10T11:12:39.430 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:39.430 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:39.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T11:12:39.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-10T11:12:39.430 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:39.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:39.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:39.554 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-10T11:12:39.554 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:39.554 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:39.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-10T11:12:39.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T11:12:39.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-10T11:12:39.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-10T11:12:39.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-10T11:12:39.555 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:39.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:39.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:39.685 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:39.685 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:39.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:12:39.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T11:12:39.686 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:39.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:39.766 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-10T11:12:39.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:39.767 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:39.783 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T11:12:39.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:39.783 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:39.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2024-05-10T11:12:39.908 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2024-05-10T11:12:39.965 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2024-05-10T11:12:39.965 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2024-05-10T11:12:39.966 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-0 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-1 2024-05-10T11:12:39.967 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-2 2024-05-10T11:12:39.968 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-3 2024-05-10T11:12:39.968 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2024-05-10T11:12:39.968 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T11:12:39.968 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T11:12:39.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:39.969 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2024-05-10T11:12:40.025 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-10T11:12:40.026 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-10T11:12:40.068 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2024-05-10T11:12:40.095 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2024-05-10T11:12:40.153 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2024-05-10T11:12:40.154 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2024-05-10T11:12:40.155 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-0 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-1 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-2 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-3 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T11:12:40.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:40.156 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2024-05-10T11:12:40.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:2024-05-10T11:12:40.164+0000 7ff4bab21480 -1 init, newargv = 0x55dadf91ee10 newargc=15 2024-05-10T11:12:40.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:ceph-fuse[42324]: starting ceph client 2024-05-10T11:12:40.171 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:ceph-fuse[42324]: starting fuse 2024-05-10T11:12:40.181 INFO:teuthology.orchestra.run.smithi066.stdout:42 2024-05-10T11:12:40.182 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-10T11:12:40.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo stdin-killer -- python3 -c ' 2024-05-10T11:12:40.182 DEBUG:teuthology.orchestra.run.smithi066:> import glob 2024-05-10T11:12:40.182 DEBUG:teuthology.orchestra.run.smithi066:> import re 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> import subprocess 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> def _find_admin_socket(client_name): 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> files = glob.glob(asok_path) 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> # Given a non-glob path, it better be there 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> if "*" not in asok_path: 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> assert(len(files) == 1) 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> return files[0] 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:12:40.183 DEBUG:teuthology.orchestra.run.smithi066:> for f in files: 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> contents = proc_f.read() 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> if mountpoint in contents: 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> return f 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> print(_find_admin_socket("client.admin")) 2024-05-10T11:12:40.184 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:12:40.302 INFO:teuthology.orchestra.run.smithi066.stdout:/var/run/ceph/ceph-client.admin.42324.asok 2024-05-10T11:12:40.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:40.313 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42324.asok 2024-05-10T11:12:40.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:40.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42324.asok status 2024-05-10T11:12:40.452 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:12:40.452 INFO:teuthology.orchestra.run.smithi066.stdout: "metadata": { 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_sha1": "d39fa08867836ac070c47cb66c782fa559fd480b", 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev)", 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "entity_id": "admin", 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": "smithi066", 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "pid": "42324", 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "root": "/" 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_count": 0, 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_pinned_count": 0, 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4437, 2024-05-10T11:12:40.453 INFO:teuthology.orchestra.run.smithi066.stdout: "inst": { 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "name": { 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "client", 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "num": 4437 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 3044735115 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-05-10T11:12:40.454 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 3044735115 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "inst_str": "client.4437 192.168.0.1:0/3044735115", 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "addr_str": "192.168.0.1:0/3044735115", 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "inode_count": 1, 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_epoch": 6, 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch": 25, 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch_barrier": 0, 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "blocklisted": false, 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs" 2024-05-10T11:12:40.455 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:12:40.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:40.461 DEBUG:teuthology.orchestra.run.smithi066:> stat --file-system '--printf=%T 2024-05-10T11:12:40.461 DEBUG:teuthology.orchestra.run.smithi066:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:40.477 INFO:teuthology.orchestra.run.smithi066.stdout:fuseblk 2024-05-10T11:12:40.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:40.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:40.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:40.545 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-10T11:12:40.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:40.661 INFO:teuthology.orchestra.run.smithi066.stdout:# file: . 2024-05-10T11:12:40.661 INFO:teuthology.orchestra.run.smithi066.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-10T11:12:40.661 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:40.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:40.667 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:40.667 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:12:40.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:12:40.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.828+0000 7f29ee37f640 1 Processor -- start 2024-05-10T11:12:40.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.828+0000 7f29ee37f640 1 -- start start 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29ee37f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29e81598c0 0x7f29e806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29ee37f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e806f1c0 con 0x7f29e80c7390 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29ee37f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e806f4a0 con 0x7f29e806ec40 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29ee37f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f29e806f780 con 0x7f29e81598c0 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29e7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29e81598c0 0x7f29e806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29e7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29e81598c0 0x7f29e806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49326/0 (socket says 172.21.15.66:49326) 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29ec91c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f29e80c7390 0x7f29e80cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50654/0 (socket says 172.21.15.66:50654) 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29e7fff640 1 -- 172.21.15.66:0/3872907249 learned_addr learned my addr 172.21.15.66:0/3872907249 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29e7fff640 1 -- 172.21.15.66:0/3872907249 >> v1:172.21.15.190:6789/0 conn(0x7f29e806ec40 legacy=0x7f29e80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29e7fff640 1 -- 172.21.15.66:0/3872907249 >> v1:172.21.15.66:6789/0 conn(0x7f29e80c7390 legacy=0x7f29e80cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:40.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.829+0000 7f29e7fff640 1 -- 172.21.15.66:0/3872907249 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e806fa60 con 0x7f29e81598c0 2024-05-10T11:12:40.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.830+0000 7f29e7fff640 1 --2- 172.21.15.66:0/3872907249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e81598c0 0x7f29e806e700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009870 tx=0x7f29d802c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e422a193abf265 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:40.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.830+0000 7f29e6ffd640 1 -- 172.21.15.66:0/3872907249 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8038070 con 0x7f29e81598c0 2024-05-10T11:12:40.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.830+0000 7f29e6ffd640 1 -- 172.21.15.66:0/3872907249 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d8031710 con 0x7f29e81598c0 2024-05-10T11:12:40.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.830+0000 7f29e6ffd640 1 -- 172.21.15.66:0/3872907249 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8031ae0 con 0x7f29e81598c0 2024-05-10T11:12:40.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 -- 172.21.15.66:0/3872907249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e81598c0 msgr2=0x7f29e806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3872907249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e81598c0 0x7f29e806e700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009870 tx=0x7f29d802c510 comp rx=0 tx=0).stop 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 -- 172.21.15.66:0/3872907249 shutdown_connections 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3872907249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e81598c0 0x7f29e806e700 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 -- 172.21.15.66:0/3872907249 >> 172.21.15.66:0/3872907249 conn(0x7f29e80b2900 msgr2=0x7f29e80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 -- 172.21.15.66:0/3872907249 shutdown_connections 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.831+0000 7f29ee37f640 1 -- 172.21.15.66:0/3872907249 wait complete. 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.832+0000 7f29ee37f640 1 Processor -- start 2024-05-10T11:12:40.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.832+0000 7f29ee37f640 1 -- start start 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ee37f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e806ec40 0x7f29e8156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ee37f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 0x7f29e81f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ee37f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29e81598c0 0x7f29e80cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ee37f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29e8159ca0 con 0x7f29e80c7390 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ee37f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f29e815c6e0 con 0x7f29e806ec40 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ee37f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f29e8159e20 con 0x7f29e81598c0 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 0x7f29e81f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 0x7f29e81f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49338/0 (socket says 172.21.15.66:49338) 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 -- 172.21.15.66:0/3532311912 learned_addr learned my addr 172.21.15.66:0/3532311912 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:40.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e7fff640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e806ec40 0x7f29e8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29ec91c640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29e81598c0 0x7f29e80cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 -- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29e81598c0 msgr2=0x7f29e80cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29e81598c0 0x7f29e80cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 -- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e806ec40 msgr2=0x7f29e8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e806ec40 0x7f29e8156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 -- 172.21.15.66:0/3532311912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e8156770 con 0x7f29e80c7390 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.833+0000 7f29e77fe640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 0x7f29e81f8f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00c400 tx=0x7f29dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.834+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0052d0 con 0x7f29e80c7390 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.834+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc005490 con 0x7f29e80c7390 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.834+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e81f9490 con 0x7f29e80c7390 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.834+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc007260 con 0x7f29e80c7390 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.834+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e80cdeb0 con 0x7f29e80c7390 2024-05-10T11:12:40.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.835+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e806a220 con 0x7f29e80c7390 2024-05-10T11:12:40.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.835+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29dc007400 con 0x7f29e80c7390 2024-05-10T11:12:40.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.836+0000 7f29e4ff9640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29d40762d0 0x7f29d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:40.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.836+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f29dc096d30 con 0x7f29e80c7390 2024-05-10T11:12:40.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.836+0000 7f29e7fff640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29d40762d0 0x7f29d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:40.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.837+0000 7f29e7fff640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29d40762d0 0x7f29d4078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29d8035000 tx=0x7f29d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:40.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:40.840+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f29dc05fd90 con 0x7f29e80c7390 2024-05-10T11:12:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.047+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f29e806e4e0 con 0x7f29e80c7390 2024-05-10T11:12:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.048+0000 7f29e4ff9640 1 -- 172.21.15.66:0/3532311912 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f29dc0683d0 con 0x7f29e80c7390 2024-05-10T11:12:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29d40762d0 msgr2=0x7f29d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29d40762d0 0x7f29d4078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29d8035000 tx=0x7f29d8008030 comp rx=0 tx=0).stop 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 msgr2=0x7f29e81f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 0x7f29e81f8f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00c400 tx=0x7f29dc00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 shutdown_connections 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29d40762d0 0x7f29d4078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29e81598c0 0x7f29e80cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29e80c7390 0x7f29e81f8f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 --2- 172.21.15.66:0/3532311912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e806ec40 0x7f29e8156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 >> 172.21.15.66:0/3532311912 conn(0x7f29e80b2900 msgr2=0x7f29e80c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:41.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 shutdown_connections 2024-05-10T11:12:41.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.050+0000 7f29ee37f640 1 -- 172.21.15.66:0/3532311912 wait complete. 2024-05-10T11:12:41.061 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:41.061 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:12:41.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:12:41.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.222+0000 7f57c5b87640 1 Processor -- start 2024-05-10T11:12:41.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.222+0000 7f57c5b87640 1 -- start start 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57c5b87640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f57c0162750 0x7f57c00d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57c5b87640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57c00d5cb0 0x7f57c00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57c5b87640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c00b45f0 con 0x7f57c0162b30 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57c5b87640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f57c00b4f20 con 0x7f57c00d5cb0 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57c5b87640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f57c00d0fe0 con 0x7f57c0162750 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57beffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57c00d5cb0 0x7f57c00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57bffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f57c0162b30 0x7f57c00d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50660/0 (socket says 172.21.15.66:50660) 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57bffff640 1 -- 172.21.15.66:0/2327155654 learned_addr learned my addr 172.21.15.66:0/2327155654 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57bf7fe640 1 --2- 172.21.15.66:0/2327155654 >> v2:172.21.15.190:3300/0 conn(0x7f57c0162750 0x7f57c00d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57beffd640 1 -- 172.21.15.66:0/2327155654 >> v2:172.21.15.190:3300/0 conn(0x7f57c0162750 msgr2=0x7f57c00d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57beffd640 1 --2- 172.21.15.66:0/2327155654 >> v2:172.21.15.190:3300/0 conn(0x7f57c0162750 0x7f57c00d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57beffd640 1 -- 172.21.15.66:0/2327155654 >> v1:172.21.15.66:6789/0 conn(0x7f57c0162b30 legacy=0x7f57c00d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57be7fc640 1 -- 172.21.15.66:0/2327155654 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768595116 0 0) 0x7f57c00b45f0 con 0x7f57c0162b30 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.223+0000 7f57beffd640 1 -- 172.21.15.66:0/2327155654 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c00b48d0 con 0x7f57c00d5cb0 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.224+0000 7f57bf7fe640 1 --2- 172.21.15.66:0/2327155654 >> v2:172.21.15.190:3300/0 conn(0x7f57c0162750 0x7f57c00d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.224+0000 7f57beffd640 1 --2- 172.21.15.66:0/2327155654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c00d5cb0 0x7f57c00d3630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f57c00b7c40 tx=0x7f57b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdc4e4c11c2478c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.224+0000 7f57be7fc640 1 -- 172.21.15.66:0/2327155654 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4037070 con 0x7f57c00d5cb0 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.224+0000 7f57be7fc640 1 -- 172.21.15.66:0/2327155654 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b4032440 con 0x7f57c00d5cb0 2024-05-10T11:12:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.224+0000 7f57be7fc640 1 -- 172.21.15.66:0/2327155654 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b402ae60 con 0x7f57c00d5cb0 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 -- 172.21.15.66:0/2327155654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c00d5cb0 msgr2=0x7f57c00d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 --2- 172.21.15.66:0/2327155654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c00d5cb0 0x7f57c00d3630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f57c00b7c40 tx=0x7f57b402a110 comp rx=0 tx=0).stop 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 -- 172.21.15.66:0/2327155654 shutdown_connections 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 --2- 172.21.15.66:0/2327155654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c00d5cb0 0x7f57c00d3630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 --2- 172.21.15.66:0/2327155654 >> v2:172.21.15.190:3300/0 conn(0x7f57c0162750 0x7f57c00d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 -- 172.21.15.66:0/2327155654 >> 172.21.15.66:0/2327155654 conn(0x7f57c009e3b0 msgr2=0x7f57c00d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 -- 172.21.15.66:0/2327155654 shutdown_connections 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.225+0000 7f57c5b87640 1 -- 172.21.15.66:0/2327155654 wait complete. 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.226+0000 7f57c5b87640 1 Processor -- start 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.226+0000 7f57c5b87640 1 -- start start 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57c5b87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0162750 0x7f57c0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57c5b87640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 0x7f57c00ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57c5b87640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57c009fef0 0x7f57c00a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57c5b87640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57c00d0d30 con 0x7f57c0162b30 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57c5b87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57c00d0bb0 con 0x7f57c0162750 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57c5b87640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57c00b63c0 con 0x7f57c009fef0 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 0x7f57c00ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 0x7f57c00ba3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49350/0 (socket says 172.21.15.66:49350) 2024-05-10T11:12:41.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 -- 172.21.15.66:0/3464076899 learned_addr learned my addr 172.21.15.66:0/3464076899 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57bf7fe640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0162750 0x7f57c0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57bffff640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57c009fef0 0x7f57c00a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 -- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57c009fef0 msgr2=0x7f57c00a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57c009fef0 0x7f57c00a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 -- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0162750 msgr2=0x7f57c0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0162750 0x7f57c0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57beffd640 1 -- 172.21.15.66:0/3464076899 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c00b8650 con 0x7f57c0162b30 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.227+0000 7f57bffff640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57c009fef0 0x7f57c00a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.228+0000 7f57beffd640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 0x7f57c00ba3a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000c00 tx=0x7f57b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.228+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4037040 con 0x7f57c0162b30 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.228+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b4042070 con 0x7f57c0162b30 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.228+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c00cd8f0 con 0x7f57c0162b30 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.228+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4030a50 con 0x7f57c0162b30 2024-05-10T11:12:41.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.228+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c00cdeb0 con 0x7f57c0162b30 2024-05-10T11:12:41.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.229+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c006a220 con 0x7f57c0162b30 2024-05-10T11:12:41.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.230+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57b4030bf0 con 0x7f57c0162b30 2024-05-10T11:12:41.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.230+0000 7f57a7fff640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57ac0762d0 0x7f57ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.230+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f57b40b8310 con 0x7f57c0162b30 2024-05-10T11:12:41.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.230+0000 7f57bf7fe640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57ac0762d0 0x7f57ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.231+0000 7f57bf7fe640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57ac0762d0 0x7f57ac078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57b000a990 tx=0x7f57b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:41.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.234+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f57b40819c0 con 0x7f57c0162b30 2024-05-10T11:12:41.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.437+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f57c00d1200 con 0x7f57c0162b30 2024-05-10T11:12:41.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.437+0000 7f57a7fff640 1 -- 172.21.15.66:0/3464076899 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f57b40812c0 con 0x7f57c0162b30 2024-05-10T11:12:41.438 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57ac0762d0 msgr2=0x7f57ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57ac0762d0 0x7f57ac078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57b000a990 tx=0x7f57b0008040 comp rx=0 tx=0).stop 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 msgr2=0x7f57c00ba3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 0x7f57c00ba3a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000c00 tx=0x7f57b40046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 shutdown_connections 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57ac0762d0 0x7f57ac078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57c009fef0 0x7f57c00a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57c0162b30 0x7f57c00ba3a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 --2- 172.21.15.66:0/3464076899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0162750 0x7f57c0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 >> 172.21.15.66:0/3464076899 conn(0x7f57c009e3b0 msgr2=0x7f57c006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:41.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 shutdown_connections 2024-05-10T11:12:41.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.439+0000 7f57c5b87640 1 -- 172.21.15.66:0/3464076899 wait complete. 2024-05-10T11:12:41.451 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi066.front.sepia.ceph.com... 2024-05-10T11:12:41.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:41.451 DEBUG:teuthology.orchestra.run.smithi066:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-10T11:12:41.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:ceph-fuse[42324]: fuse finished with error 0 and tester_r 0 2024-05-10T11:12:41.476 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:12:41.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:12:41.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:41.551 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-10T11:12:41.589 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:41.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.732+0000 7f814a454640 1 Processor -- start 2024-05-10T11:12:41.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.732+0000 7f814a454640 1 -- start start 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f814a454640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8144162940 0x7f81440b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f814a454640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440d59d0 0x7f81440d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f814a454640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81440b47a0 0x7f81440d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f814a454640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8144162d20 con 0x7f8144162940 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f814a454640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f81440d2d20 con 0x7f81440b47a0 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f814a454640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f81440d3000 con 0x7f81440d59d0 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8144162940 0x7f81440b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8144162940 0x7f81440b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49358/0 (socket says 172.21.15.66:49358) 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 -- 172.21.15.66:0/3984850775 learned_addr learned my addr 172.21.15.66:0/3984850775 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f81437fe640 1 --2- 172.21.15.66:0/3984850775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440d59d0 0x7f81440d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f81489f1640 1 --2- 172.21.15.66:0/3984850775 >> v2:172.21.15.190:3300/0 conn(0x7f81440b47a0 0x7f81440d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 -- 172.21.15.66:0/3984850775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440d59d0 msgr2=0x7f81440d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 --2- 172.21.15.66:0/3984850775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440d59d0 0x7f81440d3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 -- 172.21.15.66:0/3984850775 >> v2:172.21.15.190:3300/0 conn(0x7f81440b47a0 msgr2=0x7f81440d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 --2- 172.21.15.66:0/3984850775 >> v2:172.21.15.190:3300/0 conn(0x7f81440b47a0 0x7f81440d3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.733+0000 7f8143fff640 1 -- 172.21.15.66:0/3984850775 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81440d32e0 con 0x7f8144162940 2024-05-10T11:12:41.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.734+0000 7f8143fff640 1 --2- 172.21.15.66:0/3984850775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8144162940 0x7f81440b5e20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f81440cf9a0 tx=0x7f813402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d24e546edfe4d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.734+0000 7f8142ffd640 1 -- 172.21.15.66:0/3984850775 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134037070 con 0x7f8144162940 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.734+0000 7f8142ffd640 1 -- 172.21.15.66:0/3984850775 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813402ae00 con 0x7f8144162940 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.734+0000 7f8142ffd640 1 -- 172.21.15.66:0/3984850775 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134032660 con 0x7f8144162940 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 -- 172.21.15.66:0/3984850775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8144162940 msgr2=0x7f81440b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 --2- 172.21.15.66:0/3984850775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8144162940 0x7f81440b5e20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f81440cf9a0 tx=0x7f813402a0b0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 -- 172.21.15.66:0/3984850775 shutdown_connections 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 --2- 172.21.15.66:0/3984850775 >> v2:172.21.15.190:3300/0 conn(0x7f81440b47a0 0x7f81440d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 --2- 172.21.15.66:0/3984850775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440d59d0 0x7f81440d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 --2- 172.21.15.66:0/3984850775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8144162940 0x7f81440b5e20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 -- 172.21.15.66:0/3984850775 >> 172.21.15.66:0/3984850775 conn(0x7f814409e380 msgr2=0x7f81440d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 -- 172.21.15.66:0/3984850775 shutdown_connections 2024-05-10T11:12:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.735+0000 7f814a454640 1 -- 172.21.15.66:0/3984850775 wait complete. 2024-05-10T11:12:41.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.736+0000 7f814a454640 1 Processor -- start 2024-05-10T11:12:41.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.736+0000 7f814a454640 1 -- start start 2024-05-10T11:12:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f814a454640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440b47a0 0x7f814415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f814a454640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 0x7f81441f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f814a454640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8144162940 0x7f81441f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f814a454640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81440d2390 con 0x7f81440d59d0 2024-05-10T11:12:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f814a454640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f81440cfc50 con 0x7f8144162940 2024-05-10T11:12:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f814a454640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f81440d2510 con 0x7f81440b47a0 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 0x7f81441f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 0x7f81441f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49374/0 (socket says 172.21.15.66:49374) 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 -- 172.21.15.66:0/926304867 learned_addr learned my addr 172.21.15.66:0/926304867 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f8143fff640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440b47a0 0x7f814415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81489f1640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8144162940 0x7f81441f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 -- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440b47a0 msgr2=0x7f814415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440b47a0 0x7f814415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 -- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8144162940 msgr2=0x7f81441f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8144162940 0x7f81441f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 -- 172.21.15.66:0/926304867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81440cce00 con 0x7f81440d59d0 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81489f1640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8144162940 0x7f81441f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.737+0000 7f81437fe640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 0x7f81441f8890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f813800c820 tx=0x7f813800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.738+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138015070 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.738+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8138004020 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.738+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81440cd0e0 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.738+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81380043f0 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.738+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81440cd3c0 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.739+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f814406a220 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.739+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8138007830 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.740+0000 7f8140ff9640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81300762d0 0x7f8130078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.740+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f81380976a0 con 0x7f81440d59d0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.740+0000 7f8143fff640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81300762d0 0x7f8130078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:41.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.741+0000 7f8143fff640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81300762d0 0x7f8130078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8134034000 tx=0x7f813402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:41.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.744+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8138060d50 con 0x7f81440d59d0 2024-05-10T11:12:41.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.937+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f814415e1e0 con 0x7f81440d59d0 2024-05-10T11:12:41.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.938+0000 7f8140ff9640 1 -- 172.21.15.66:0/926304867 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f8138060650 con 0x7f81440d59d0 2024-05-10T11:12:41.938 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:41.939 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:41.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81300762d0 msgr2=0x7f8130078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81300762d0 0x7f8130078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8134034000 tx=0x7f813402e000 comp rx=0 tx=0).stop 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 msgr2=0x7f81441f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 0x7f81441f8890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f813800c820 tx=0x7f813800cce0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 shutdown_connections 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81300762d0 0x7f8130078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8144162940 0x7f81441f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81440d59d0 0x7f81441f8890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 --2- 172.21.15.66:0/926304867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81440b47a0 0x7f814415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 >> 172.21.15.66:0/926304867 conn(0x7f814409e380 msgr2=0x7f814415d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 shutdown_connections 2024-05-10T11:12:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:41.940+0000 7f814a454640 1 -- 172.21.15.66:0/926304867 wait complete. 2024-05-10T11:12:41.952 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:42.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.054+0000 7fda6b89c640 1 Processor -- start 2024-05-10T11:12:42.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.055+0000 7fda6b89c640 1 -- start start 2024-05-10T11:12:42.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.055+0000 7fda6b89c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fda6415d290 0x7fda64071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.055+0000 7fda6b89c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda64072330 con 0x7fda64071880 2024-05-10T11:12:42.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.055+0000 7fda6b89c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda64071d70 con 0x7fda640d3510 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.055+0000 7fda6b89c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fda64072050 con 0x7fda6415d290 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda69638640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fda6415d290 0x7fda64071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda68e37640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fda64071880 0x7fda640d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50676/0 (socket says 172.21.15.66:50676) 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda68e37640 1 -- 172.21.15.66:0/3562477599 learned_addr learned my addr 172.21.15.66:0/3562477599 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda69638640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fda6415d290 0x7fda64071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49382/0 (socket says 172.21.15.66:49382) 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda69638640 1 -- 172.21.15.66:0/3562477599 >> v1:172.21.15.190:6789/0 conn(0x7fda640d3510 legacy=0x7fda640ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda69638640 1 -- 172.21.15.66:0/3562477599 >> v1:172.21.15.66:6789/0 conn(0x7fda64071880 legacy=0x7fda640d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.056+0000 7fda69638640 1 -- 172.21.15.66:0/3562477599 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda640cda70 con 0x7fda6415d290 2024-05-10T11:12:42.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda69638640 1 --2- 172.21.15.66:0/3562477599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda64071340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda60009d90 tx=0x7fda6002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25310442d55c3b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda5bfff640 1 -- 172.21.15.66:0/3562477599 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60007740 con 0x7fda6415d290 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda5bfff640 1 -- 172.21.15.66:0/3562477599 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda600078e0 con 0x7fda6415d290 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda5bfff640 1 -- 172.21.15.66:0/3562477599 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60007cb0 con 0x7fda6415d290 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda6b89c640 1 -- 172.21.15.66:0/3562477599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 msgr2=0x7fda64071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda6b89c640 1 --2- 172.21.15.66:0/3562477599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda64071340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda60009d90 tx=0x7fda6002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda6b89c640 1 -- 172.21.15.66:0/3562477599 shutdown_connections 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda6b89c640 1 --2- 172.21.15.66:0/3562477599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda64071340 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.057+0000 7fda6b89c640 1 -- 172.21.15.66:0/3562477599 >> 172.21.15.66:0/3562477599 conn(0x7fda6409ba20 msgr2=0x7fda6409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.058+0000 7fda6b89c640 1 -- 172.21.15.66:0/3562477599 shutdown_connections 2024-05-10T11:12:42.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.058+0000 7fda6b89c640 1 -- 172.21.15.66:0/3562477599 wait complete. 2024-05-10T11:12:42.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.059+0000 7fda6b89c640 1 Processor -- start 2024-05-10T11:12:42.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.059+0000 7fda6b89c640 1 -- start start 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda64071880 0x7fda640b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda640d3510 0x7fda640b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda640b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda640d1c20 con 0x7fda6415d290 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fda640d1aa0 con 0x7fda640d3510 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fda640b8cd0 con 0x7fda64071880 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda640b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda640b7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49388/0 (socket says 172.21.15.66:49388) 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 -- 172.21.15.66:0/1440754404 learned_addr learned my addr 172.21.15.66:0/1440754404 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda68e37640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda640d3510 0x7fda640b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69638640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda64071880 0x7fda640b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 -- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda64071880 msgr2=0x7fda640b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda64071880 0x7fda640b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 -- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda640d3510 msgr2=0x7fda640b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda640d3510 0x7fda640b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 -- 172.21.15.66:0/1440754404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda641f6930 con 0x7fda6415d290 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda69e39640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda640b7e00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c3c0 tx=0x7fda5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c017070 con 0x7fda6415d290 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c0052d0 con 0x7fda6415d290 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c003830 con 0x7fda6415d290 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.060+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda640b8430 con 0x7fda6415d290 2024-05-10T11:12:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.061+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda640ca160 con 0x7fda6415d290 2024-05-10T11:12:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.062+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda640693f0 con 0x7fda6415d290 2024-05-10T11:12:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.062+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda5c01a070 con 0x7fda6415d290 2024-05-10T11:12:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.063+0000 7fda59ffb640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda48076300 0x7fda480787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.063+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda5c096b50 con 0x7fda6415d290 2024-05-10T11:12:42.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.063+0000 7fda69638640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda48076300 0x7fda480787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.064+0000 7fda69638640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda48076300 0x7fda480787c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda60034000 tx=0x7fda60033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:42.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.067+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fda5c060200 con 0x7fda6415d290 2024-05-10T11:12:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.259+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda640b1df0 con 0x7fda6415d290 2024-05-10T11:12:42.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.260+0000 7fda59ffb640 1 -- 172.21.15.66:0/1440754404 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7fda5c0681f0 con 0x7fda6415d290 2024-05-10T11:12:42.260 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:42.261 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:42.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda48076300 msgr2=0x7fda480787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda48076300 0x7fda480787c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda60034000 tx=0x7fda60033040 comp rx=0 tx=0).stop 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 msgr2=0x7fda640b7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda640b7e00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c3c0 tx=0x7fda5c00c880 comp rx=0 tx=0).stop 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 shutdown_connections 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda48076300 0x7fda480787c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda6415d290 0x7fda640b7e00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda640d3510 0x7fda640b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 --2- 172.21.15.66:0/1440754404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda64071880 0x7fda640b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 >> 172.21.15.66:0/1440754404 conn(0x7fda6409ba20 msgr2=0x7fda640b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 shutdown_connections 2024-05-10T11:12:42.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.262+0000 7fda6b89c640 1 -- 172.21.15.66:0/1440754404 wait complete. 2024-05-10T11:12:42.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:12:42.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.379+0000 7f06909c8640 1 Processor -- start 2024-05-10T11:12:42.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.379+0000 7f06909c8640 1 -- start start 2024-05-10T11:12:42.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f06909c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c15f190 0x7f068c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f06909c8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f068c0b1390 0x7f068c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f06909c8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c163a20 con 0x7f068c0b5160 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f06909c8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f068c0b11f0 con 0x7f068c0b1390 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f06909c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f068c0b6b80 con 0x7f068c15f190 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f068ad9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f068c0b5160 0x7f068c0730b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:50680/0 (socket says 172.21.15.66:50680) 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f068ad9d640 1 -- 172.21.15.66:0/1348775867 learned_addr learned my addr 172.21.15.66:0/1348775867 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f0689d9b640 1 --2- 172.21.15.66:0/1348775867 >> v2:172.21.15.190:3300/0 conn(0x7f068c0b1390 0x7f068c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f068a59c640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c15f190 0x7f068c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f068959a640 1 -- 172.21.15.66:0/1348775867 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401193175 0 0) 0x7f068c163a20 con 0x7f068c0b5160 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f068959a640 1 -- 172.21.15.66:0/1348775867 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0678003520 con 0x7f068c0b5160 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f0689d9b640 1 -- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c15f190 msgr2=0x7f068c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f0689d9b640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c15f190 0x7f068c0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f0689d9b640 1 -- 172.21.15.66:0/1348775867 >> v1:172.21.15.66:6789/0 conn(0x7f068c0b5160 legacy=0x7f068c0730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f0689d9b640 1 -- 172.21.15.66:0/1348775867 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c0b6e60 con 0x7f068c0b1390 2024-05-10T11:12:42.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.381+0000 7f068a59c640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c15f190 0x7f068c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:42.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.382+0000 7f0689d9b640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c0b1390 0x7f068c06c2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06740097d0 tx=0x7f067402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ec8efff98fa34c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:42.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.382+0000 7f068959a640 1 -- 172.21.15.66:0/1348775867 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674037070 con 0x7f068c0b1390 2024-05-10T11:12:42.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.382+0000 7f068959a640 1 -- 172.21.15.66:0/1348775867 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674032440 con 0x7f068c0b1390 2024-05-10T11:12:42.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.382+0000 7f068959a640 1 -- 172.21.15.66:0/1348775867 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06740327f0 con 0x7f068c0b1390 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 -- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c0b1390 msgr2=0x7f068c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c0b1390 0x7f068c06c2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06740097d0 tx=0x7f067402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 -- 172.21.15.66:0/1348775867 shutdown_connections 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c0b1390 0x7f068c06c2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 --2- 172.21.15.66:0/1348775867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c15f190 0x7f068c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 -- 172.21.15.66:0/1348775867 >> 172.21.15.66:0/1348775867 conn(0x7f068c0d1ed0 msgr2=0x7f068c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 -- 172.21.15.66:0/1348775867 shutdown_connections 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.383+0000 7f06909c8640 1 -- 172.21.15.66:0/1348775867 wait complete. 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.384+0000 7f06909c8640 1 Processor -- start 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.384+0000 7f06909c8640 1 -- start start 2024-05-10T11:12:42.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f06909c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 0x7f068c15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f06909c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c0b5160 0x7f068c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f06909c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c15f190 0x7f068c0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f06909c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f068c06c800 con 0x7f068c0b1390 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f06909c8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f068c160580 con 0x7f068c15f190 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f06909c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f068c06c980 con 0x7f068c0b5160 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 0x7f068c15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 0x7f068c15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49404/0 (socket says 172.21.15.66:49404) 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 -- 172.21.15.66:0/2141829462 learned_addr learned my addr 172.21.15.66:0/2141829462 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f0689d9b640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c0b5160 0x7f068c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068ad9d640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c15f190 0x7f068c0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 -- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c0b5160 msgr2=0x7f068c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c0b5160 0x7f068c0ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 -- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c15f190 msgr2=0x7f068c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:42.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c15f190 0x7f068c0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.385+0000 7f068a59c640 1 -- 172.21.15.66:0/2141829462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c0cf440 con 0x7f068c0b1390 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.386+0000 7f068a59c640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 0x7f068c15a240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0684009ec0 tx=0x7f068400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.386+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684018020 con 0x7f068c0b1390 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.386+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684014680 con 0x7f068c0b1390 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.386+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c160bc0 con 0x7f068c0b1390 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.386+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684014a50 con 0x7f068c0b1390 2024-05-10T11:12:42.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.386+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c0cf080 con 0x7f068c0b1390 2024-05-10T11:12:42.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.387+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c0693f0 con 0x7f068c0b1390 2024-05-10T11:12:42.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.388+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0684005d10 con 0x7f068c0b1390 2024-05-10T11:12:42.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.388+0000 7f0682ffd640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f066c076300 0x7f066c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:42.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.388+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06840986b0 con 0x7f068c0b1390 2024-05-10T11:12:42.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.388+0000 7f0689d9b640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f066c076300 0x7f066c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:42.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.389+0000 7f0689d9b640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f066c076300 0x7f066c0787c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0674034000 tx=0x7f067402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:42.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.392+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0684022030 con 0x7f068c0b1390 2024-05-10T11:12:42.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:42.620+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f068c1630a0 con 0x7f068c0b1390 2024-05-10T11:12:43.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.157+0000 7f0682ffd640 1 -- 172.21.15.66:0/2141829462 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f0684010040 con 0x7f068c0b1390 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f066c076300 msgr2=0x7f066c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f066c076300 0x7f066c0787c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0674034000 tx=0x7f067402e000 comp rx=0 tx=0).stop 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 msgr2=0x7f068c15a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 0x7f068c15a240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0684009ec0 tx=0x7f068400c490 comp rx=0 tx=0).stop 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 shutdown_connections 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f066c076300 0x7f066c0787c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f068c15f190 0x7f068c0d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f068c0b5160 0x7f068c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 --2- 172.21.15.66:0/2141829462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b1390 0x7f068c15a240 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 >> 172.21.15.66:0/2141829462 conn(0x7f068c0d1ed0 msgr2=0x7f068c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:43.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 shutdown_connections 2024-05-10T11:12:43.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.160+0000 7f06909c8640 1 -- 172.21.15.66:0/2141829462 wait complete. 2024-05-10T11:12:43.174 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-10T11:12:43.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:12:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.287+0000 7f84fdd90640 1 Processor -- start 2024-05-10T11:12:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.287+0000 7f84fdd90640 1 -- start start 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84fdd90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84fdd90640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f84f806c9d0 0x7f84f815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84fdd90640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f8163a20 con 0x7f84f80b1390 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84fdd90640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f84f80b11f0 con 0x7f84f806c9d0 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84fdd90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f84f80b6b80 con 0x7f84f815f190 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f84f806c9d0 0x7f84f815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f6ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f84f80b1390 0x7f84f806c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:57160/0 (socket says 172.21.15.66:57160) 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f6ffd640 1 -- 172.21.15.66:0/3195611511 learned_addr learned my addr 172.21.15.66:0/3195611511 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f77fe640 1 --2- 172.21.15.66:0/3195611511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f7fff640 1 -- 172.21.15.66:0/3195611511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 msgr2=0x7f84f80b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:43.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f7fff640 1 --2- 172.21.15.66:0/3195611511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f7fff640 1 -- 172.21.15.66:0/3195611511 >> v1:172.21.15.190:6789/0 conn(0x7f84f80b1390 legacy=0x7f84f806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:43.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.288+0000 7f84f7fff640 1 -- 172.21.15.66:0/3195611511 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f80b6e60 con 0x7f84f806c9d0 2024-05-10T11:12:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.289+0000 7f84f7fff640 1 --2- 172.21.15.66:0/3195611511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f815f570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009d90 tx=0x7f84f002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53976f9da7e5385e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.289+0000 7f84f67fc640 1 -- 172.21.15.66:0/3195611511 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0031600 con 0x7f84f806c9d0 2024-05-10T11:12:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.289+0000 7f84f67fc640 1 -- 172.21.15.66:0/3195611511 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f00317a0 con 0x7f84f806c9d0 2024-05-10T11:12:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.289+0000 7f84f67fc640 1 -- 172.21.15.66:0/3195611511 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0031b70 con 0x7f84f806c9d0 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 -- 172.21.15.66:0/3195611511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 msgr2=0x7f84f815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 --2- 172.21.15.66:0/3195611511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f815f570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009d90 tx=0x7f84f002a5d0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 -- 172.21.15.66:0/3195611511 shutdown_connections 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 --2- 172.21.15.66:0/3195611511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f815f570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 --2- 172.21.15.66:0/3195611511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 -- 172.21.15.66:0/3195611511 >> 172.21.15.66:0/3195611511 conn(0x7f84f80d1ed0 msgr2=0x7f84f80d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 -- 172.21.15.66:0/3195611511 shutdown_connections 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.290+0000 7f84fdd90640 1 -- 172.21.15.66:0/3195611511 wait complete. 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.291+0000 7f84fdd90640 1 Processor -- start 2024-05-10T11:12:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.291+0000 7f84fdd90640 1 -- start start 2024-05-10T11:12:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84fdd90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f8147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84fdd90640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84f80b1390 0x7f84f8156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84fdd90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84fdd90640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80b52e0 con 0x7f84f806c9d0 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84fdd90640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80b5160 con 0x7f84f80b1390 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84fdd90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f84f80b5460 con 0x7f84f815f190 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f8147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f8147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49418/0 (socket says 172.21.15.66:49418) 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 -- 172.21.15.66:0/2244618932 learned_addr learned my addr 172.21.15.66:0/2244618932 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f6ffd640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84f80b1390 0x7f84f8156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f7fff640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 -- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 msgr2=0x7f84f80b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 -- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84f80b1390 msgr2=0x7f84f8156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84f80b1390 0x7f84f8156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.292+0000 7f84f77fe640 1 -- 172.21.15.66:0/2244618932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f8157290 con 0x7f84f806c9d0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.293+0000 7f84f77fe640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f8147ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f84e800e870 tx=0x7f84e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.293+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8017070 con 0x7f84f806c9d0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.293+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e800c940 con 0x7f84f806c9d0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.293+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e800cd30 con 0x7f84f806c9d0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.293+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f8157570 con 0x7f84f806c9d0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.293+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f8157b30 con 0x7f84f806c9d0 2024-05-10T11:12:43.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.294+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f80693f0 con 0x7f84f806c9d0 2024-05-10T11:12:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.295+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84e801a070 con 0x7f84f806c9d0 2024-05-10T11:12:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.295+0000 7f84dffff640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84e40762d0 0x7f84e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.296+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84e8097ad0 con 0x7f84f806c9d0 2024-05-10T11:12:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.296+0000 7f84f6ffd640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84e40762d0 0x7f84e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.296+0000 7f84f6ffd640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84e40762d0 0x7f84e4078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84f8158860 tx=0x7f84ec007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:43.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.300+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f84e8060aa0 con 0x7f84f806c9d0 2024-05-10T11:12:43.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:43.530+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f84f8163490 con 0x7f84f806c9d0 2024-05-10T11:12:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.162+0000 7f84dffff640 1 -- 172.21.15.66:0/2244618932 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f84e8064da0 con 0x7f84f806c9d0 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84e40762d0 msgr2=0x7f84e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84e40762d0 0x7f84e4078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84f8158860 tx=0x7f84ec007e80 comp rx=0 tx=0).stop 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 msgr2=0x7f84f8147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f8147ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f84e800e870 tx=0x7f84e800ed30 comp rx=0 tx=0).stop 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 shutdown_connections 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84e40762d0 0x7f84e4078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84f815f190 0x7f84f80b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84f80b1390 0x7f84f8156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 --2- 172.21.15.66:0/2244618932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84f806c9d0 0x7f84f8147ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 >> 172.21.15.66:0/2244618932 conn(0x7f84f80d1ed0 msgr2=0x7f84f806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 shutdown_connections 2024-05-10T11:12:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.164+0000 7f84fdd90640 1 -- 172.21.15.66:0/2244618932 wait complete. 2024-05-10T11:12:44.177 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:12:44.177 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.282+0000 7f010855f640 1 Processor -- start 2024-05-10T11:12:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.282+0000 7f010855f640 1 -- start start 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f010855f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01000d3980 0x7f01001626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f010855f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f01000d2270 0x7f0100162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f010855f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000b6160 0x7f01000b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f010855f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f01000b5c30 con 0x7f01000d3980 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f010855f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f01000b5e80 con 0x7f01000d2270 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f010855f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01000d5c50 con 0x7f01000b6160 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f01062fb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01000d3980 0x7f01001626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f01062fb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01000d3980 0x7f01001626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49434/0 (socket says 172.21.15.66:49434) 2024-05-10T11:12:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f01062fb640 1 -- 172.21.15.66:0/1901664685 learned_addr learned my addr 172.21.15.66:0/1901664685 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f0106afc640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000b6160 0x7f01000b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.283+0000 7f0105afa640 1 --2- 172.21.15.66:0/1901664685 >> v2:172.21.15.190:3300/0 conn(0x7f01000d2270 0x7f0100162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01062fb640 1 -- 172.21.15.66:0/1901664685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000b6160 msgr2=0x7f01000b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01062fb640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000b6160 0x7f01000b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01062fb640 1 -- 172.21.15.66:0/1901664685 >> v2:172.21.15.190:3300/0 conn(0x7f01000d2270 msgr2=0x7f0100162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01062fb640 1 --2- 172.21.15.66:0/1901664685 >> v2:172.21.15.190:3300/0 conn(0x7f01000d2270 0x7f0100162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01062fb640 1 -- 172.21.15.66:0/1901664685 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01000d5f30 con 0x7f01000d3980 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f0106afc640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000b6160 0x7f01000b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01062fb640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000d3980 0x7f01001626c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f010008d060 tx=0x7f00f002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9cff45da04fb17 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.284+0000 7f01052f9640 1 -- 172.21.15.66:0/1901664685 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0036070 con 0x7f01000d3980 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f01052f9640 1 -- 172.21.15.66:0/1901664685 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f0031600 con 0x7f01000d3980 2024-05-10T11:12:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f01052f9640 1 -- 172.21.15.66:0/1901664685 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f00319d0 con 0x7f01000d3980 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 -- 172.21.15.66:0/1901664685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000d3980 msgr2=0x7f01001626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000d3980 0x7f01001626c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f010008d060 tx=0x7f00f002a6a0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 -- 172.21.15.66:0/1901664685 shutdown_connections 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000b6160 0x7f01000b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 --2- 172.21.15.66:0/1901664685 >> v2:172.21.15.190:3300/0 conn(0x7f01000d2270 0x7f0100162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 --2- 172.21.15.66:0/1901664685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000d3980 0x7f01001626c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 -- 172.21.15.66:0/1901664685 >> 172.21.15.66:0/1901664685 conn(0x7f01000d5130 msgr2=0x7f01000d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 -- 172.21.15.66:0/1901664685 shutdown_connections 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.285+0000 7f010855f640 1 -- 172.21.15.66:0/1901664685 wait complete. 2024-05-10T11:12:44.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.286+0000 7f010855f640 1 Processor -- start 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.286+0000 7f010855f640 1 -- start start 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f010855f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 0x7f01000b9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f010855f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000d2270 0x7f01000ba880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f010855f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01000d3980 0x7f01000cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f010855f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01000b6890 con 0x7f01000b6160 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f010855f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01000d31f0 con 0x7f01000d3980 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f010855f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01000d3d60 con 0x7f01000d2270 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f01062fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 0x7f01000b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f01062fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 0x7f01000b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49444/0 (socket says 172.21.15.66:49444) 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f01062fb640 1 -- 172.21.15.66:0/2972247554 learned_addr learned my addr 172.21.15.66:0/2972247554 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f0106afc640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01000d3980 0x7f01000cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.287+0000 7f0105afa640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000d2270 0x7f01000ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f01062fb640 1 -- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000d2270 msgr2=0x7f01000ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f01062fb640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000d2270 0x7f01000ba880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f01062fb640 1 -- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01000d3980 msgr2=0x7f01000cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f01062fb640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01000d3980 0x7f01000cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f01062fb640 1 -- 172.21.15.66:0/2972247554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01000b97e0 con 0x7f01000b6160 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f0105afa640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000d2270 0x7f01000ba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f0106afc640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01000d3980 0x7f01000cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f01062fb640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 0x7f01000b9200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f00f0000f80 tx=0x7f00f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0036050 con 0x7f01000b6160 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f0042070 con 0x7f01000b6160 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01000b9ac0 con 0x7f01000b6160 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0009510 con 0x7f01000b6160 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.288+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01000ba080 con 0x7f01000b6160 2024-05-10T11:12:44.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.289+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010006a220 con 0x7f01000b6160 2024-05-10T11:12:44.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.289+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00f0007c70 con 0x7f01000b6160 2024-05-10T11:12:44.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.290+0000 7f00feffd640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00ec0762d0 0x7f00ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.290+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f00f00b8780 con 0x7f01000b6160 2024-05-10T11:12:44.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.290+0000 7f0105afa640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00ec0762d0 0x7f00ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.291+0000 7f0105afa640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00ec0762d0 0x7f00ec078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01001f8420 tx=0x7f00f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.294+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f00f0081e10 con 0x7f01000b6160 2024-05-10T11:12:44.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.527+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f010006d0a0 con 0x7f01000b6160 2024-05-10T11:12:44.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.528+0000 7f00feffd640 1 -- 172.21.15.66:0/2972247554 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f00f0081710 con 0x7f01000b6160 2024-05-10T11:12:44.528 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:44.528 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:12:44.529 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:12:44.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00ec0762d0 msgr2=0x7f00ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00ec0762d0 0x7f00ec078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01001f8420 tx=0x7f00f4008040 comp rx=0 tx=0).stop 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 msgr2=0x7f01000b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 0x7f01000b9200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f00f0000f80 tx=0x7f00f0004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 shutdown_connections 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00ec0762d0 0x7f00ec078790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01000d3980 0x7f01000cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01000d2270 0x7f01000ba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 --2- 172.21.15.66:0/2972247554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01000b6160 0x7f01000b9200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 >> 172.21.15.66:0/2972247554 conn(0x7f01000d5130 msgr2=0x7f0100160320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 shutdown_connections 2024-05-10T11:12:44.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.530+0000 7f010855f640 1 -- 172.21.15.66:0/2972247554 wait complete. 2024-05-10T11:12:44.541 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:44.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.644+0000 7f64cbdaf640 1 Processor -- start 2024-05-10T11:12:44.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.644+0000 7f64cbdaf640 1 -- start start 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64cbdaf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64c415f4e0 0x7f64c406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64cbdaf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 0x7f64c40d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64cbdaf640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c40b0a90 con 0x7f64c415f8c0 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64cbdaf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f64c40b23f0 con 0x7f64c415f4e0 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64cbdaf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f64c40b4150 con 0x7f64c406e620 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64c934a640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f64c415f8c0 0x7f64c406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40902/0 (socket says 172.21.15.66:40902) 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64c934a640 1 -- 172.21.15.66:0/2788989555 learned_addr learned my addr 172.21.15.66:0/2788989555 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:44.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64ca34c640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 0x7f64c40d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/2788989555 >> v2:172.21.15.190:3300/0 conn(0x7f64c415f4e0 0x7f64c406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.645+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289956342 0 0) 0x7f64c40b0a90 con 0x7f64c415f8c0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64b0003520 con 0x7f64c415f8c0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2021166870 0 0) 0x7f64b0003520 con 0x7f64c415f8c0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 msgr2=0x7f64c40d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 0x7f64c40d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 >> v2:172.21.15.190:3300/0 conn(0x7f64c415f4e0 msgr2=0x7f64c406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 --2- 172.21.15.66:0/2788989555 >> v2:172.21.15.190:3300/0 conn(0x7f64c415f4e0 0x7f64c406d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c40b3540 con 0x7f64c415f8c0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f64b4001670 con 0x7f64c415f8c0 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 >> v1:172.21.15.66:6789/0 conn(0x7f64c415f8c0 legacy=0x7f64c406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64b00039b0 0x7f64b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64b0004800 0x7f64b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 0x7f64b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40b23f0 con 0x7f64b00039b0 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40b4150 con 0x7f64b0004800 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f64b000b9c0 con 0x7f64c406e620 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64b00039b0 0x7f64b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c934a640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64b0004800 0x7f64b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64ca34c640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 0x7f64b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c9b4b640 1 -- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 msgr2=0x7f64b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64c406e620 0x7f64b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c9b4b640 1 -- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64b0004800 msgr2=0x7f64b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64b0004800 0x7f64b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.646+0000 7f64c9b4b640 1 -- 172.21.15.66:0/2788989555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b0003520 con 0x7f64b00039b0 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.647+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64b00039b0 0x7f64b0003dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009af0 tx=0x7f64b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326a26296436fb82 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.647+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0036070 con 0x7f64b00039b0 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.647+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c0031400 con 0x7f64b00039b0 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.647+0000 7f64c8b49640 1 -- 172.21.15.66:0/2788989555 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0009690 con 0x7f64b00039b0 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64cbdaf640 1 -- 172.21.15.66:0/2788989555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64b00039b0 msgr2=0x7f64b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/2788989555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64b00039b0 0x7f64b0003dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009af0 tx=0x7f64b0005830 comp rx=0 tx=0).stop 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64ca34c640 1 -- 172.21.15.66:0/2788989555 reap_dead start 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64cbdaf640 1 -- 172.21.15.66:0/2788989555 shutdown_connections 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64cbdaf640 1 -- 172.21.15.66:0/2788989555 >> 172.21.15.66:0/2788989555 conn(0x7f64c40d2df0 msgr2=0x7f64c40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64cbdaf640 1 -- 172.21.15.66:0/2788989555 shutdown_connections 2024-05-10T11:12:44.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.648+0000 7f64cbdaf640 1 -- 172.21.15.66:0/2788989555 wait complete. 2024-05-10T11:12:44.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.649+0000 7f64cbdaf640 1 Processor -- start 2024-05-10T11:12:44.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.649+0000 7f64cbdaf640 1 -- start start 2024-05-10T11:12:44.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64cbdaf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64b00039b0 0x7f64c414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64cbdaf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64c41610b0 0x7f64c414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64cbdaf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 0x7f64c414c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64cbdaf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40b3de0 con 0x7f64c414e900 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64cbdaf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40b3b00 con 0x7f64c41610b0 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64cbdaf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f64c40b45e0 con 0x7f64b00039b0 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 0x7f64c414c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 0x7f64c414c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39680/0 (socket says 172.21.15.66:39680) 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 -- 172.21.15.66:0/271887088 learned_addr learned my addr 172.21.15.66:0/271887088 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64b00039b0 0x7f64c414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64c934a640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64c41610b0 0x7f64c414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 -- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64b00039b0 msgr2=0x7f64c414bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64b00039b0 0x7f64c414bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 -- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64c41610b0 msgr2=0x7f64c414e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64c41610b0 0x7f64c414e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 -- 172.21.15.66:0/271887088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c4160010 con 0x7f64c414e900 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64c934a640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64c41610b0 0x7f64c414e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:44.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ca34c640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 0x7f64c414c380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f64c4072b50 tx=0x7f64bc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.650+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00fe10 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.651+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64bc015430 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.651+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc015820 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.651+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c41602f0 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.651+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c41608b0 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.651+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c406a220 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.652+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64bc0159c0 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.653+0000 7f64ba7fc640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f64a80762d0 0x7f64a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.653+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f64bc0983f0 con 0x7f64c414e900 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.653+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f64a80762d0 0x7f64a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.654+0000 7f64c9b4b640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f64a80762d0 0x7f64a8078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64c0033000 tx=0x7f64c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.657+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f64bc024030 con 0x7f64c414e900 2024-05-10T11:12:44.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.851+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64c40d3b80 con 0x7f64c414e900 2024-05-10T11:12:44.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.852+0000 7f64ba7fc640 1 -- 172.21.15.66:0/271887088 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f64bc019030 con 0x7f64c414e900 2024-05-10T11:12:44.853 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:44.853 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:44.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f64a80762d0 msgr2=0x7f64a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f64a80762d0 0x7f64a8078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64c0033000 tx=0x7f64c0008030 comp rx=0 tx=0).stop 2024-05-10T11:12:44.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 msgr2=0x7f64c414c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 0x7f64c414c380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f64c4072b50 tx=0x7f64bc00f580 comp rx=0 tx=0).stop 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 shutdown_connections 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f64a80762d0 0x7f64a8078790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64c414e900 0x7f64c414c380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64c41610b0 0x7f64c414e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 --2- 172.21.15.66:0/271887088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64b00039b0 0x7f64c414bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 >> 172.21.15.66:0/271887088 conn(0x7f64c40d2df0 msgr2=0x7f64c40d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 shutdown_connections 2024-05-10T11:12:44.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.854+0000 7f64cbdaf640 1 -- 172.21.15.66:0/271887088 wait complete. 2024-05-10T11:12:44.866 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:12:44.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:12:44.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.969+0000 7f364c140640 1 Processor -- start 2024-05-10T11:12:44.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.969+0000 7f364c140640 1 -- start start 2024-05-10T11:12:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.970+0000 7f364c140640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36440d59d0 0x7f36440b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.970+0000 7f364c140640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36440d2d20 con 0x7f3644162940 2024-05-10T11:12:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.970+0000 7f364c140640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36440d3000 con 0x7f36440d3d80 2024-05-10T11:12:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.970+0000 7f364c140640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3644162d20 con 0x7f36440d59d0 2024-05-10T11:12:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.970+0000 7f3649edc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3644162940 0x7f36440d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40918/0 (socket says 172.21.15.66:40918) 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.970+0000 7f3649edc640 1 -- 172.21.15.66:0/1244765071 learned_addr learned my addr 172.21.15.66:0/1244765071 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f364a6dd640 1 --2- 172.21.15.66:0/1244765071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36440d59d0 0x7f36440b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f3648eda640 1 -- 172.21.15.66:0/1244765071 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897734239 0 0) 0x7f36440d2d20 con 0x7f3644162940 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f3648eda640 1 -- 172.21.15.66:0/1244765071 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362c003520 con 0x7f3644162940 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f3648eda640 1 -- 172.21.15.66:0/1244765071 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219244840 0 0) 0x7f362c003520 con 0x7f3644162940 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f364a6dd640 1 -- 172.21.15.66:0/1244765071 >> v1:172.21.15.190:6789/0 conn(0x7f36440d3d80 legacy=0x7f36440d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f364a6dd640 1 -- 172.21.15.66:0/1244765071 >> v1:172.21.15.66:6789/0 conn(0x7f3644162940 legacy=0x7f36440d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.971+0000 7f364a6dd640 1 -- 172.21.15.66:0/1244765071 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36440d32e0 con 0x7f36440d59d0 2024-05-10T11:12:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f364a6dd640 1 --2- 172.21.15.66:0/1244765071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36440d59d0 0x7f36440b5e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3634009dc0 tx=0x7f363402a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9184bd257d2b3e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f3648eda640 1 -- 172.21.15.66:0/1244765071 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634035020 con 0x7f36440d59d0 2024-05-10T11:12:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f3648eda640 1 -- 172.21.15.66:0/1244765071 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3634007540 con 0x7f36440d59d0 2024-05-10T11:12:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f3648eda640 1 -- 172.21.15.66:0/1244765071 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c001670 con 0x7f36440d59d0 2024-05-10T11:12:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f364c140640 1 -- 172.21.15.66:0/1244765071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36440d59d0 msgr2=0x7f36440b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f364c140640 1 --2- 172.21.15.66:0/1244765071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36440d59d0 0x7f36440b5e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3634009dc0 tx=0x7f363402a500 comp rx=0 tx=0).stop 2024-05-10T11:12:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f364c140640 1 -- 172.21.15.66:0/1244765071 shutdown_connections 2024-05-10T11:12:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f364c140640 1 --2- 172.21.15.66:0/1244765071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36440d59d0 0x7f36440b5e20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.972+0000 7f364c140640 1 -- 172.21.15.66:0/1244765071 >> 172.21.15.66:0/1244765071 conn(0x7f364409e380 msgr2=0x7f36440d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.973+0000 7f364c140640 1 -- 172.21.15.66:0/1244765071 shutdown_connections 2024-05-10T11:12:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.973+0000 7f364c140640 1 -- 172.21.15.66:0/1244765071 wait complete. 2024-05-10T11:12:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 Processor -- start 2024-05-10T11:12:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 -- start start 2024-05-10T11:12:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36440d3d80 0x7f36440cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 0x7f364414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3644162940 0x7f364414ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36440d2390 con 0x7f36440d59d0 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f36440cfc50 con 0x7f36440d3d80 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.974+0000 7f364c140640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36440d2510 con 0x7f3644162940 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 0x7f364414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 0x7f364414e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39682/0 (socket says 172.21.15.66:39682) 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 -- 172.21.15.66:0/1948259992 learned_addr learned my addr 172.21.15.66:0/1948259992 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f364a6dd640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3644162940 0x7f364414ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f3649edc640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36440d3d80 0x7f36440cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 -- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3644162940 msgr2=0x7f364414ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3644162940 0x7f364414ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 -- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36440d3d80 msgr2=0x7f36440cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36440d3d80 0x7f36440cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 -- 172.21.15.66:0/1948259992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36440b35a0 con 0x7f36440d59d0 2024-05-10T11:12:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f3649edc640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36440d3d80 0x7f36440cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36496db640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 0x7f364414e4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f363800c540 tx=0x7f363800ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638005480 con 0x7f36440d59d0 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36380035f0 con 0x7f36440d59d0 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380039c0 con 0x7f36440d59d0 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36440b2800 con 0x7f36440d59d0 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.975+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36440b2da0 con 0x7f36440d59d0 2024-05-10T11:12:44.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.976+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364406a220 con 0x7f36440d59d0 2024-05-10T11:12:44.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.977+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3638003b60 con 0x7f36440d59d0 2024-05-10T11:12:44.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.977+0000 7f36427fc640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3630076470 0x7f3630078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:44.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.978+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3638097610 con 0x7f36440d59d0 2024-05-10T11:12:44.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.978+0000 7f3649edc640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3630076470 0x7f3630078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:44.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.978+0000 7f3649edc640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3630076470 0x7f3630078930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f363c001eb0 tx=0x7f363c001c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:44.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:44.982+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3638060c30 con 0x7f36440d59d0 2024-05-10T11:12:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.171+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36440bad90 con 0x7f3630076470 2024-05-10T11:12:45.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.180+0000 7f36427fc640 1 -- 172.21.15.66:0/1948259992 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332567 (secure 0 0 0) 0x7f36440bad90 con 0x7f3630076470 2024-05-10T11:12:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:45.187 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:12:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3630076470 msgr2=0x7f3630078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3630076470 0x7f3630078930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f363c001eb0 tx=0x7f363c001c40 comp rx=0 tx=0).stop 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 msgr2=0x7f364414e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 0x7f364414e4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f363800c540 tx=0x7f363800ca00 comp rx=0 tx=0).stop 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 shutdown_connections 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3630076470 0x7f3630078930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3644162940 0x7f364414ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36440d59d0 0x7f364414e4f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 --2- 172.21.15.66:0/1948259992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36440d3d80 0x7f36440cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 >> 172.21.15.66:0/1948259992 conn(0x7f364409e380 msgr2=0x7f36440d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 shutdown_connections 2024-05-10T11:12:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.184+0000 7f364c140640 1 -- 172.21.15.66:0/1948259992 wait complete. 2024-05-10T11:12:45.195 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-10T11:12:43.685934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219412,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755308,"statfs":{"total":773094113280,"available":772869435392,"internally_reserved":0,"allocated":3317760,"data_stored":2010594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.573589"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186919+0000","last_change":"2024-05-10T11:12:30.107293+0000","last_active":"2024-05-10T11:12:37.186919+0000","last_peered":"2024-05-10T11:12:37.186919+0000","last_clean":"2024-05-10T11:12:37.186919+0000","last_became_active":"2024-05-10T11:12:30.106969+0000","last_became_peered":"2024-05-10T11:12:30.106969+0000","last_unstale":"2024-05-10T11:12:37.186919+0000","last_undegraded":"2024-05-10T11:12:37.186919+0000","last_fullsized":"2024-05-10T11:12:37.186919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186702+0000","last_change":"2024-05-10T11:12:31.115437+0000","last_active":"2024-05-10T11:12:37.186702+0000","last_peered":"2024-05-10T11:12:37.186702+0000","last_clean":"2024-05-10T11:12:37.186702+0000","last_became_active":"2024-05-10T11:12:31.115119+0000","last_became_peered":"2024-05-10T11:12:31.115119+0000","last_unstale":"2024-05-10T11:12:37.186702+0000","last_undegraded":"2024-05-10T11:12:37.186702+0000","last_fullsized":"2024-05-10T11:12:37.186702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187674+0000","last_change":"2024-05-10T11:12:35.422690+0000","last_active":"2024-05-10T11:12:37.187674+0000","last_peered":"2024-05-10T11:12:37.187674+0000","last_clean":"2024-05-10T11:12:37.187674+0000","last_became_active":"2024-05-10T11:12:35.422285+0000","last_became_peered":"2024-05-10T11:12:35.422285+0000","last_unstale":"2024-05-10T11:12:37.187674+0000","last_undegraded":"2024-05-10T11:12:37.187674+0000","last_fullsized":"2024-05-10T11:12:37.187674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186871+0000","last_change":"2024-05-10T11:12:30.100472+0000","last_active":"2024-05-10T11:12:37.186871+0000","last_peered":"2024-05-10T11:12:37.186871+0000","last_clean":"2024-05-10T11:12:37.186871+0000","last_became_active":"2024-05-10T11:12:30.100185+0000","last_became_peered":"2024-05-10T11:12:30.100185+0000","last_unstale":"2024-05-10T11:12:37.186871+0000","last_undegraded":"2024-05-10T11:12:37.186871+0000","last_fullsized":"2024-05-10T11:12:37.186871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186663+0000","last_change":"2024-05-10T11:12:31.118746+0000","last_active":"2024-05-10T11:12:37.186663+0000","last_peered":"2024-05-10T11:12:37.186663+0000","last_clean":"2024-05-10T11:12:37.186663+0000","last_became_active":"2024-05-10T11:12:31.118237+0000","last_became_peered":"2024-05-10T11:12:31.118237+0000","last_unstale":"2024-05-10T11:12:37.186663+0000","last_undegraded":"2024-05-10T11:12:37.186663+0000","last_fullsized":"2024-05-10T11:12:37.186663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132046+0000","last_change":"2024-05-10T11:12:35.138165+0000","last_active":"2024-05-10T11:12:36.132046+0000","last_peered":"2024-05-10T11:12:36.132046+0000","last_clean":"2024-05-10T11:12:36.132046+0000","last_became_active":"2024-05-10T11:12:35.137676+0000","last_became_peered":"2024-05-10T11:12:35.137676+0000","last_unstale":"2024-05-10T11:12:36.132046+0000","last_undegraded":"2024-05-10T11:12:36.132046+0000","last_fullsized":"2024-05-10T11:12:36.132046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:55:00.560547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186717+0000","last_change":"2024-05-10T11:12:30.110920+0000","last_active":"2024-05-10T11:12:37.186717+0000","last_peered":"2024-05-10T11:12:37.186717+0000","last_clean":"2024-05-10T11:12:37.186717+0000","last_became_active":"2024-05-10T11:12:30.110167+0000","last_became_peered":"2024-05-10T11:12:30.110167+0000","last_unstale":"2024-05-10T11:12:37.186717+0000","last_undegraded":"2024-05-10T11:12:37.186717+0000","last_fullsized":"2024-05-10T11:12:37.186717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132994+0000","last_change":"2024-05-10T11:12:31.101959+0000","last_active":"2024-05-10T11:12:36.132994+0000","last_peered":"2024-05-10T11:12:36.132994+0000","last_clean":"2024-05-10T11:12:36.132994+0000","last_became_active":"2024-05-10T11:12:31.101677+0000","last_became_peered":"2024-05-10T11:12:31.101677+0000","last_unstale":"2024-05-10T11:12:36.132994+0000","last_undegraded":"2024-05-10T11:12:36.132994+0000","last_fullsized":"2024-05-10T11:12:36.132994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133684+0000","last_change":"2024-05-10T11:12:35.138098+0000","last_active":"2024-05-10T11:12:36.133684+0000","last_peered":"2024-05-10T11:12:36.133684+0000","last_clean":"2024-05-10T11:12:36.133684+0000","last_became_active":"2024-05-10T11:12:35.137760+0000","last_became_peered":"2024-05-10T11:12:35.137760+0000","last_unstale":"2024-05-10T11:12:36.133684+0000","last_undegraded":"2024-05-10T11:12:36.133684+0000","last_fullsized":"2024-05-10T11:12:36.133684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186379+0000","last_change":"2024-05-10T11:12:30.112117+0000","last_active":"2024-05-10T11:12:37.186379+0000","last_peered":"2024-05-10T11:12:37.186379+0000","last_clean":"2024-05-10T11:12:37.186379+0000","last_became_active":"2024-05-10T11:12:30.111649+0000","last_became_peered":"2024-05-10T11:12:30.111649+0000","last_unstale":"2024-05-10T11:12:37.186379+0000","last_undegraded":"2024-05-10T11:12:37.186379+0000","last_fullsized":"2024-05-10T11:12:37.186379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133328+0000","last_change":"2024-05-10T11:12:31.113857+0000","last_active":"2024-05-10T11:12:36.133328+0000","last_peered":"2024-05-10T11:12:36.133328+0000","last_clean":"2024-05-10T11:12:36.133328+0000","last_became_active":"2024-05-10T11:12:31.113561+0000","last_became_peered":"2024-05-10T11:12:31.113561+0000","last_unstale":"2024-05-10T11:12:36.133328+0000","last_undegraded":"2024-05-10T11:12:36.133328+0000","last_fullsized":"2024-05-10T11:12:36.133328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:57.654437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132469+0000","last_change":"2024-05-10T11:12:35.138373+0000","last_active":"2024-05-10T11:12:36.132469+0000","last_peered":"2024-05-10T11:12:36.132469+0000","last_clean":"2024-05-10T11:12:36.132469+0000","last_became_active":"2024-05-10T11:12:35.137918+0000","last_became_peered":"2024-05-10T11:12:35.137918+0000","last_unstale":"2024-05-10T11:12:36.132469+0000","last_undegraded":"2024-05-10T11:12:36.132469+0000","last_fullsized":"2024-05-10T11:12:36.132469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:47.170283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284980+0000","last_change":"2024-05-10T11:12:31.101194+0000","last_active":"2024-05-10T11:12:36.284980+0000","last_peered":"2024-05-10T11:12:36.284980+0000","last_clean":"2024-05-10T11:12:36.284980+0000","last_became_active":"2024-05-10T11:12:31.100888+0000","last_became_peered":"2024-05-10T11:12:31.100888+0000","last_unstale":"2024-05-10T11:12:36.284980+0000","last_undegraded":"2024-05-10T11:12:36.284980+0000","last_fullsized":"2024-05-10T11:12:36.284980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:00.574123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186570+0000","last_change":"2024-05-10T11:12:30.109646+0000","last_active":"2024-05-10T11:12:37.186570+0000","last_peered":"2024-05-10T11:12:37.186570+0000","last_clean":"2024-05-10T11:12:37.186570+0000","last_became_active":"2024-05-10T11:12:30.109393+0000","last_became_peered":"2024-05-10T11:12:30.109393+0000","last_unstale":"2024-05-10T11:12:37.186570+0000","last_undegraded":"2024-05-10T11:12:37.186570+0000","last_fullsized":"2024-05-10T11:12:37.186570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132986+0000","last_change":"2024-05-10T11:12:35.134377+0000","last_active":"2024-05-10T11:12:36.132986+0000","last_peered":"2024-05-10T11:12:36.132986+0000","last_clean":"2024-05-10T11:12:36.132986+0000","last_became_active":"2024-05-10T11:12:35.133107+0000","last_became_peered":"2024-05-10T11:12:35.133107+0000","last_unstale":"2024-05-10T11:12:36.132986+0000","last_undegraded":"2024-05-10T11:12:36.132986+0000","last_fullsized":"2024-05-10T11:12:36.132986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188108+0000","last_change":"2024-05-10T11:12:31.113901+0000","last_active":"2024-05-10T11:12:37.188108+0000","last_peered":"2024-05-10T11:12:37.188108+0000","last_clean":"2024-05-10T11:12:37.188108+0000","last_became_active":"2024-05-10T11:12:31.113316+0000","last_became_peered":"2024-05-10T11:12:31.113316+0000","last_unstale":"2024-05-10T11:12:37.188108+0000","last_undegraded":"2024-05-10T11:12:37.188108+0000","last_fullsized":"2024-05-10T11:12:37.188108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188842+0000","last_change":"2024-05-10T11:12:30.104152+0000","last_active":"2024-05-10T11:12:37.188842+0000","last_peered":"2024-05-10T11:12:37.188842+0000","last_clean":"2024-05-10T11:12:37.188842+0000","last_became_active":"2024-05-10T11:12:30.103869+0000","last_became_peered":"2024-05-10T11:12:30.103869+0000","last_unstale":"2024-05-10T11:12:37.188842+0000","last_undegraded":"2024-05-10T11:12:37.188842+0000","last_fullsized":"2024-05-10T11:12:37.188842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132702+0000","last_change":"2024-05-10T11:12:35.140690+0000","last_active":"2024-05-10T11:12:36.132702+0000","last_peered":"2024-05-10T11:12:36.132702+0000","last_clean":"2024-05-10T11:12:36.132702+0000","last_became_active":"2024-05-10T11:12:35.140367+0000","last_became_peered":"2024-05-10T11:12:35.140367+0000","last_unstale":"2024-05-10T11:12:36.132702+0000","last_undegraded":"2024-05-10T11:12:36.132702+0000","last_fullsized":"2024-05-10T11:12:36.132702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187425+0000","last_change":"2024-05-10T11:12:31.112506+0000","last_active":"2024-05-10T11:12:37.187425+0000","last_peered":"2024-05-10T11:12:37.187425+0000","last_clean":"2024-05-10T11:12:37.187425+0000","last_became_active":"2024-05-10T11:12:31.112211+0000","last_became_peered":"2024-05-10T11:12:31.112211+0000","last_unstale":"2024-05-10T11:12:37.187425+0000","last_undegraded":"2024-05-10T11:12:37.187425+0000","last_fullsized":"2024-05-10T11:12:37.187425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:30.107759+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:30.107468+0000","last_became_peered":"2024-05-10T11:12:30.107468+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186715+0000","last_change":"2024-05-10T11:12:35.422670+0000","last_active":"2024-05-10T11:12:37.186715+0000","last_peered":"2024-05-10T11:12:37.186715+0000","last_clean":"2024-05-10T11:12:37.186715+0000","last_became_active":"2024-05-10T11:12:35.422307+0000","last_became_peered":"2024-05-10T11:12:35.422307+0000","last_unstale":"2024-05-10T11:12:37.186715+0000","last_undegraded":"2024-05-10T11:12:37.186715+0000","last_fullsized":"2024-05-10T11:12:37.186715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:01.679168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132243+0000","last_change":"2024-05-10T11:12:31.105780+0000","last_active":"2024-05-10T11:12:36.132243+0000","last_peered":"2024-05-10T11:12:36.132243+0000","last_clean":"2024-05-10T11:12:36.132243+0000","last_became_active":"2024-05-10T11:12:31.105471+0000","last_became_peered":"2024-05-10T11:12:31.105471+0000","last_unstale":"2024-05-10T11:12:36.132243+0000","last_undegraded":"2024-05-10T11:12:36.132243+0000","last_fullsized":"2024-05-10T11:12:36.132243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:55.127350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186041+0000","last_change":"2024-05-10T11:12:30.110798+0000","last_active":"2024-05-10T11:12:37.186041+0000","last_peered":"2024-05-10T11:12:37.186041+0000","last_clean":"2024-05-10T11:12:37.186041+0000","last_became_active":"2024-05-10T11:12:30.110468+0000","last_became_peered":"2024-05-10T11:12:30.110468+0000","last_unstale":"2024-05-10T11:12:37.186041+0000","last_undegraded":"2024-05-10T11:12:37.186041+0000","last_fullsized":"2024-05-10T11:12:37.186041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132575+0000","last_change":"2024-05-10T11:12:35.138104+0000","last_active":"2024-05-10T11:12:36.132575+0000","last_peered":"2024-05-10T11:12:36.132575+0000","last_clean":"2024-05-10T11:12:36.132575+0000","last_became_active":"2024-05-10T11:12:35.137693+0000","last_became_peered":"2024-05-10T11:12:35.137693+0000","last_unstale":"2024-05-10T11:12:36.132575+0000","last_undegraded":"2024-05-10T11:12:36.132575+0000","last_fullsized":"2024-05-10T11:12:36.132575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:40.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187558+0000","last_change":"2024-05-10T11:12:31.107722+0000","last_active":"2024-05-10T11:12:37.187558+0000","last_peered":"2024-05-10T11:12:37.187558+0000","last_clean":"2024-05-10T11:12:37.187558+0000","last_became_active":"2024-05-10T11:12:31.107404+0000","last_became_peered":"2024-05-10T11:12:31.107404+0000","last_unstale":"2024-05-10T11:12:37.187558+0000","last_undegraded":"2024-05-10T11:12:37.187558+0000","last_fullsized":"2024-05-10T11:12:37.187558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285637+0000","last_change":"2024-05-10T11:12:30.113757+0000","last_active":"2024-05-10T11:12:36.285637+0000","last_peered":"2024-05-10T11:12:36.285637+0000","last_clean":"2024-05-10T11:12:36.285637+0000","last_became_active":"2024-05-10T11:12:30.113457+0000","last_became_peered":"2024-05-10T11:12:30.113457+0000","last_unstale":"2024-05-10T11:12:36.285637+0000","last_undegraded":"2024-05-10T11:12:36.285637+0000","last_fullsized":"2024-05-10T11:12:36.285637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132184+0000","last_change":"2024-05-10T11:12:35.421589+0000","last_active":"2024-05-10T11:12:36.132184+0000","last_peered":"2024-05-10T11:12:36.132184+0000","last_clean":"2024-05-10T11:12:36.132184+0000","last_became_active":"2024-05-10T11:12:35.421209+0000","last_became_peered":"2024-05-10T11:12:35.421209+0000","last_unstale":"2024-05-10T11:12:36.132184+0000","last_undegraded":"2024-05-10T11:12:36.132184+0000","last_fullsized":"2024-05-10T11:12:36.132184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:43.432104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188363+0000","last_change":"2024-05-10T11:12:31.113183+0000","last_active":"2024-05-10T11:12:37.188363+0000","last_peered":"2024-05-10T11:12:37.188363+0000","last_clean":"2024-05-10T11:12:37.188363+0000","last_became_active":"2024-05-10T11:12:31.112885+0000","last_became_peered":"2024-05-10T11:12:31.112885+0000","last_unstale":"2024-05-10T11:12:37.188363+0000","last_undegraded":"2024-05-10T11:12:37.188363+0000","last_fullsized":"2024-05-10T11:12:37.188363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186681+0000","last_change":"2024-05-10T11:12:30.106330+0000","last_active":"2024-05-10T11:12:37.186681+0000","last_peered":"2024-05-10T11:12:37.186681+0000","last_clean":"2024-05-10T11:12:37.186681+0000","last_became_active":"2024-05-10T11:12:30.106029+0000","last_became_peered":"2024-05-10T11:12:30.106029+0000","last_unstale":"2024-05-10T11:12:37.186681+0000","last_undegraded":"2024-05-10T11:12:37.186681+0000","last_fullsized":"2024-05-10T11:12:37.186681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187168+0000","last_change":"2024-05-10T11:12:35.421780+0000","last_active":"2024-05-10T11:12:37.187168+0000","last_peered":"2024-05-10T11:12:37.187168+0000","last_clean":"2024-05-10T11:12:37.187168+0000","last_became_active":"2024-05-10T11:12:35.421406+0000","last_became_peered":"2024-05-10T11:12:35.421406+0000","last_unstale":"2024-05-10T11:12:37.187168+0000","last_undegraded":"2024-05-10T11:12:37.187168+0000","last_fullsized":"2024-05-10T11:12:37.187168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187694+0000","last_change":"2024-05-10T11:12:31.104014+0000","last_active":"2024-05-10T11:12:37.187694+0000","last_peered":"2024-05-10T11:12:37.187694+0000","last_clean":"2024-05-10T11:12:37.187694+0000","last_became_active":"2024-05-10T11:12:31.103724+0000","last_became_peered":"2024-05-10T11:12:31.103724+0000","last_unstale":"2024-05-10T11:12:37.187694+0000","last_undegraded":"2024-05-10T11:12:37.187694+0000","last_fullsized":"2024-05-10T11:12:37.187694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186832+0000","last_change":"2024-05-10T11:12:30.110419+0000","last_active":"2024-05-10T11:12:37.186832+0000","last_peered":"2024-05-10T11:12:37.186832+0000","last_clean":"2024-05-10T11:12:37.186832+0000","last_became_active":"2024-05-10T11:12:30.109820+0000","last_became_peered":"2024-05-10T11:12:30.109820+0000","last_unstale":"2024-05-10T11:12:37.186832+0000","last_undegraded":"2024-05-10T11:12:37.186832+0000","last_fullsized":"2024-05-10T11:12:37.186832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:57.299078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187509+0000","last_change":"2024-05-10T11:12:35.420791+0000","last_active":"2024-05-10T11:12:37.187509+0000","last_peered":"2024-05-10T11:12:37.187509+0000","last_clean":"2024-05-10T11:12:37.187509+0000","last_became_active":"2024-05-10T11:12:35.420414+0000","last_became_peered":"2024-05-10T11:12:35.420414+0000","last_unstale":"2024-05-10T11:12:37.187509+0000","last_undegraded":"2024-05-10T11:12:37.187509+0000","last_fullsized":"2024-05-10T11:12:37.187509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133388+0000","last_change":"2024-05-10T11:12:31.109103+0000","last_active":"2024-05-10T11:12:36.133388+0000","last_peered":"2024-05-10T11:12:36.133388+0000","last_clean":"2024-05-10T11:12:36.133388+0000","last_became_active":"2024-05-10T11:12:31.108146+0000","last_became_peered":"2024-05-10T11:12:31.108146+0000","last_unstale":"2024-05-10T11:12:36.133388+0000","last_undegraded":"2024-05-10T11:12:36.133388+0000","last_fullsized":"2024-05-10T11:12:36.133388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:12.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187781+0000","last_change":"2024-05-10T11:12:30.101891+0000","last_active":"2024-05-10T11:12:37.187781+0000","last_peered":"2024-05-10T11:12:37.187781+0000","last_clean":"2024-05-10T11:12:37.187781+0000","last_became_active":"2024-05-10T11:12:30.101598+0000","last_became_peered":"2024-05-10T11:12:30.101598+0000","last_unstale":"2024-05-10T11:12:37.187781+0000","last_undegraded":"2024-05-10T11:12:37.187781+0000","last_fullsized":"2024-05-10T11:12:37.187781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188770+0000","last_change":"2024-05-10T11:12:35.135817+0000","last_active":"2024-05-10T11:12:37.188770+0000","last_peered":"2024-05-10T11:12:37.188770+0000","last_clean":"2024-05-10T11:12:37.188770+0000","last_became_active":"2024-05-10T11:12:35.135403+0000","last_became_peered":"2024-05-10T11:12:35.135403+0000","last_unstale":"2024-05-10T11:12:37.188770+0000","last_undegraded":"2024-05-10T11:12:37.188770+0000","last_fullsized":"2024-05-10T11:12:37.188770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133910+0000","last_change":"2024-05-10T11:12:31.103973+0000","last_active":"2024-05-10T11:12:36.133910+0000","last_peered":"2024-05-10T11:12:36.133910+0000","last_clean":"2024-05-10T11:12:36.133910+0000","last_became_active":"2024-05-10T11:12:31.103697+0000","last_became_peered":"2024-05-10T11:12:31.103697+0000","last_unstale":"2024-05-10T11:12:36.133910+0000","last_undegraded":"2024-05-10T11:12:36.133910+0000","last_fullsized":"2024-05-10T11:12:36.133910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:20.650809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133763+0000","last_change":"2024-05-10T11:12:30.112118+0000","last_active":"2024-05-10T11:12:36.133763+0000","last_peered":"2024-05-10T11:12:36.133763+0000","last_clean":"2024-05-10T11:12:36.133763+0000","last_became_active":"2024-05-10T11:12:30.111287+0000","last_became_peered":"2024-05-10T11:12:30.111287+0000","last_unstale":"2024-05-10T11:12:36.133763+0000","last_undegraded":"2024-05-10T11:12:36.133763+0000","last_fullsized":"2024-05-10T11:12:36.133763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187647+0000","last_change":"2024-05-10T11:12:35.140853+0000","last_active":"2024-05-10T11:12:37.187647+0000","last_peered":"2024-05-10T11:12:37.187647+0000","last_clean":"2024-05-10T11:12:37.187647+0000","last_became_active":"2024-05-10T11:12:35.140434+0000","last_became_peered":"2024-05-10T11:12:35.140434+0000","last_unstale":"2024-05-10T11:12:37.187647+0000","last_undegraded":"2024-05-10T11:12:37.187647+0000","last_fullsized":"2024-05-10T11:12:37.187647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187195+0000","last_change":"2024-05-10T11:12:31.110391+0000","last_active":"2024-05-10T11:12:37.187195+0000","last_peered":"2024-05-10T11:12:37.187195+0000","last_clean":"2024-05-10T11:12:37.187195+0000","last_became_active":"2024-05-10T11:12:31.109461+0000","last_became_peered":"2024-05-10T11:12:31.109461+0000","last_unstale":"2024-05-10T11:12:37.187195+0000","last_undegraded":"2024-05-10T11:12:37.187195+0000","last_fullsized":"2024-05-10T11:12:37.187195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186210+0000","last_change":"2024-05-10T11:12:30.109322+0000","last_active":"2024-05-10T11:12:37.186210+0000","last_peered":"2024-05-10T11:12:37.186210+0000","last_clean":"2024-05-10T11:12:37.186210+0000","last_became_active":"2024-05-10T11:12:30.109010+0000","last_became_peered":"2024-05-10T11:12:30.109010+0000","last_unstale":"2024-05-10T11:12:37.186210+0000","last_undegraded":"2024-05-10T11:12:37.186210+0000","last_fullsized":"2024-05-10T11:12:37.186210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186867+0000","last_change":"2024-05-10T11:12:35.138343+0000","last_active":"2024-05-10T11:12:37.186867+0000","last_peered":"2024-05-10T11:12:37.186867+0000","last_clean":"2024-05-10T11:12:37.186867+0000","last_became_active":"2024-05-10T11:12:35.137977+0000","last_became_peered":"2024-05-10T11:12:35.137977+0000","last_unstale":"2024-05-10T11:12:37.186867+0000","last_undegraded":"2024-05-10T11:12:37.186867+0000","last_fullsized":"2024-05-10T11:12:37.186867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:16.923493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186404+0000","last_change":"2024-05-10T11:12:31.107001+0000","last_active":"2024-05-10T11:12:37.186404+0000","last_peered":"2024-05-10T11:12:37.186404+0000","last_clean":"2024-05-10T11:12:37.186404+0000","last_became_active":"2024-05-10T11:12:31.105856+0000","last_became_peered":"2024-05-10T11:12:31.105856+0000","last_unstale":"2024-05-10T11:12:37.186404+0000","last_undegraded":"2024-05-10T11:12:37.186404+0000","last_fullsized":"2024-05-10T11:12:37.186404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186079+0000","last_change":"2024-05-10T11:12:30.106324+0000","last_active":"2024-05-10T11:12:37.186079+0000","last_peered":"2024-05-10T11:12:37.186079+0000","last_clean":"2024-05-10T11:12:37.186079+0000","last_became_active":"2024-05-10T11:12:30.106071+0000","last_became_peered":"2024-05-10T11:12:30.106071+0000","last_unstale":"2024-05-10T11:12:37.186079+0000","last_undegraded":"2024-05-10T11:12:37.186079+0000","last_fullsized":"2024-05-10T11:12:37.186079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:54.121002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187453+0000","last_change":"2024-05-10T11:12:35.420622+0000","last_active":"2024-05-10T11:12:37.187453+0000","last_peered":"2024-05-10T11:12:37.187453+0000","last_clean":"2024-05-10T11:12:37.187453+0000","last_became_active":"2024-05-10T11:12:35.420207+0000","last_became_peered":"2024-05-10T11:12:35.420207+0000","last_unstale":"2024-05-10T11:12:37.187453+0000","last_undegraded":"2024-05-10T11:12:37.187453+0000","last_fullsized":"2024-05-10T11:12:37.187453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186367+0000","last_change":"2024-05-10T11:12:31.119911+0000","last_active":"2024-05-10T11:12:37.186367+0000","last_peered":"2024-05-10T11:12:37.186367+0000","last_clean":"2024-05-10T11:12:37.186367+0000","last_became_active":"2024-05-10T11:12:31.119563+0000","last_became_peered":"2024-05-10T11:12:31.119563+0000","last_unstale":"2024-05-10T11:12:37.186367+0000","last_undegraded":"2024-05-10T11:12:37.186367+0000","last_fullsized":"2024-05-10T11:12:37.186367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132850+0000","last_change":"2024-05-10T11:12:30.111460+0000","last_active":"2024-05-10T11:12:36.132850+0000","last_peered":"2024-05-10T11:12:36.132850+0000","last_clean":"2024-05-10T11:12:36.132850+0000","last_became_active":"2024-05-10T11:12:30.111150+0000","last_became_peered":"2024-05-10T11:12:30.111150+0000","last_unstale":"2024-05-10T11:12:36.132850+0000","last_undegraded":"2024-05-10T11:12:36.132850+0000","last_fullsized":"2024-05-10T11:12:36.132850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186200+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:12:37.186200+0000","last_peered":"2024-05-10T11:12:37.186200+0000","last_clean":"2024-05-10T11:12:37.186200+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:12:37.186200+0000","last_undegraded":"2024-05-10T11:12:37.186200+0000","last_fullsized":"2024-05-10T11:12:37.186200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285379+0000","last_change":"2024-05-10T11:12:35.421543+0000","last_active":"2024-05-10T11:12:36.285379+0000","last_peered":"2024-05-10T11:12:36.285379+0000","last_clean":"2024-05-10T11:12:36.285379+0000","last_became_active":"2024-05-10T11:12:35.421171+0000","last_became_peered":"2024-05-10T11:12:35.421171+0000","last_unstale":"2024-05-10T11:12:36.285379+0000","last_undegraded":"2024-05-10T11:12:36.285379+0000","last_fullsized":"2024-05-10T11:12:36.285379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186499+0000","last_change":"2024-05-10T11:12:31.119926+0000","last_active":"2024-05-10T11:12:37.186499+0000","last_peered":"2024-05-10T11:12:37.186499+0000","last_clean":"2024-05-10T11:12:37.186499+0000","last_became_active":"2024-05-10T11:12:31.119632+0000","last_became_peered":"2024-05-10T11:12:31.119632+0000","last_unstale":"2024-05-10T11:12:37.186499+0000","last_undegraded":"2024-05-10T11:12:37.186499+0000","last_fullsized":"2024-05-10T11:12:37.186499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:17.896621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186772+0000","last_change":"2024-05-10T11:12:30.112153+0000","last_active":"2024-05-10T11:12:37.186772+0000","last_peered":"2024-05-10T11:12:37.186772+0000","last_clean":"2024-05-10T11:12:37.186772+0000","last_became_active":"2024-05-10T11:12:30.111901+0000","last_became_peered":"2024-05-10T11:12:30.111901+0000","last_unstale":"2024-05-10T11:12:37.186772+0000","last_undegraded":"2024-05-10T11:12:37.186772+0000","last_fullsized":"2024-05-10T11:12:37.186772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285207+0000","last_change":"2024-05-10T11:12:35.420749+0000","last_active":"2024-05-10T11:12:36.285207+0000","last_peered":"2024-05-10T11:12:36.285207+0000","last_clean":"2024-05-10T11:12:36.285207+0000","last_became_active":"2024-05-10T11:12:35.420325+0000","last_became_peered":"2024-05-10T11:12:35.420325+0000","last_unstale":"2024-05-10T11:12:36.285207+0000","last_undegraded":"2024-05-10T11:12:36.285207+0000","last_fullsized":"2024-05-10T11:12:36.285207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133116+0000","last_change":"2024-05-10T11:12:31.115139+0000","last_active":"2024-05-10T11:12:36.133116+0000","last_peered":"2024-05-10T11:12:36.133116+0000","last_clean":"2024-05-10T11:12:36.133116+0000","last_became_active":"2024-05-10T11:12:31.114482+0000","last_became_peered":"2024-05-10T11:12:31.114482+0000","last_unstale":"2024-05-10T11:12:36.133116+0000","last_undegraded":"2024-05-10T11:12:36.133116+0000","last_fullsized":"2024-05-10T11:12:36.133116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:02.344229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186711+0000","last_change":"2024-05-10T11:12:30.102023+0000","last_active":"2024-05-10T11:12:37.186711+0000","last_peered":"2024-05-10T11:12:37.186711+0000","last_clean":"2024-05-10T11:12:37.186711+0000","last_became_active":"2024-05-10T11:12:30.101642+0000","last_became_peered":"2024-05-10T11:12:30.101642+0000","last_unstale":"2024-05-10T11:12:37.186711+0000","last_undegraded":"2024-05-10T11:12:37.186711+0000","last_fullsized":"2024-05-10T11:12:37.186711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187660+0000","last_change":"2024-05-10T11:12:35.133498+0000","last_active":"2024-05-10T11:12:37.187660+0000","last_peered":"2024-05-10T11:12:37.187660+0000","last_clean":"2024-05-10T11:12:37.187660+0000","last_became_active":"2024-05-10T11:12:35.133009+0000","last_became_peered":"2024-05-10T11:12:35.133009+0000","last_unstale":"2024-05-10T11:12:37.187660+0000","last_undegraded":"2024-05-10T11:12:37.187660+0000","last_fullsized":"2024-05-10T11:12:37.187660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186836+0000","last_change":"2024-05-10T11:12:31.119096+0000","last_active":"2024-05-10T11:12:37.186836+0000","last_peered":"2024-05-10T11:12:37.186836+0000","last_clean":"2024-05-10T11:12:37.186836+0000","last_became_active":"2024-05-10T11:12:31.118841+0000","last_became_peered":"2024-05-10T11:12:31.118841+0000","last_unstale":"2024-05-10T11:12:37.186836+0000","last_undegraded":"2024-05-10T11:12:37.186836+0000","last_fullsized":"2024-05-10T11:12:37.186836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:51.850619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186580+0000","last_change":"2024-05-10T11:12:30.107841+0000","last_active":"2024-05-10T11:12:37.186580+0000","last_peered":"2024-05-10T11:12:37.186580+0000","last_clean":"2024-05-10T11:12:37.186580+0000","last_became_active":"2024-05-10T11:12:30.107551+0000","last_became_peered":"2024-05-10T11:12:30.107551+0000","last_unstale":"2024-05-10T11:12:37.186580+0000","last_undegraded":"2024-05-10T11:12:37.186580+0000","last_fullsized":"2024-05-10T11:12:37.186580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132082+0000","last_change":"2024-05-10T11:12:35.420691+0000","last_active":"2024-05-10T11:12:36.132082+0000","last_peered":"2024-05-10T11:12:36.132082+0000","last_clean":"2024-05-10T11:12:36.132082+0000","last_became_active":"2024-05-10T11:12:35.420284+0000","last_became_peered":"2024-05-10T11:12:35.420284+0000","last_unstale":"2024-05-10T11:12:36.132082+0000","last_undegraded":"2024-05-10T11:12:36.132082+0000","last_fullsized":"2024-05-10T11:12:36.132082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186722+0000","last_change":"2024-05-10T11:12:31.119535+0000","last_active":"2024-05-10T11:12:37.186722+0000","last_peered":"2024-05-10T11:12:37.186722+0000","last_clean":"2024-05-10T11:12:37.186722+0000","last_became_active":"2024-05-10T11:12:31.119282+0000","last_became_peered":"2024-05-10T11:12:31.119282+0000","last_unstale":"2024-05-10T11:12:37.186722+0000","last_undegraded":"2024-05-10T11:12:37.186722+0000","last_fullsized":"2024-05-10T11:12:37.186722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:58.094353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132416+0000","last_change":"2024-05-10T11:12:30.109801+0000","last_active":"2024-05-10T11:12:36.132416+0000","last_peered":"2024-05-10T11:12:36.132416+0000","last_clean":"2024-05-10T11:12:36.132416+0000","last_became_active":"2024-05-10T11:12:30.109068+0000","last_became_peered":"2024-05-10T11:12:30.109068+0000","last_unstale":"2024-05-10T11:12:36.132416+0000","last_undegraded":"2024-05-10T11:12:36.132416+0000","last_fullsized":"2024-05-10T11:12:36.132416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:58.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.131960+0000","last_change":"2024-05-10T11:12:35.132271+0000","last_active":"2024-05-10T11:12:36.131960+0000","last_peered":"2024-05-10T11:12:36.131960+0000","last_clean":"2024-05-10T11:12:36.131960+0000","last_became_active":"2024-05-10T11:12:35.131925+0000","last_became_peered":"2024-05-10T11:12:35.131925+0000","last_unstale":"2024-05-10T11:12:36.131960+0000","last_undegraded":"2024-05-10T11:12:36.131960+0000","last_fullsized":"2024-05-10T11:12:36.131960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:55.050495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186329+0000","last_change":"2024-05-10T11:12:31.120591+0000","last_active":"2024-05-10T11:12:37.186329+0000","last_peered":"2024-05-10T11:12:37.186329+0000","last_clean":"2024-05-10T11:12:37.186329+0000","last_became_active":"2024-05-10T11:12:31.120238+0000","last_became_peered":"2024-05-10T11:12:31.120238+0000","last_unstale":"2024-05-10T11:12:37.186329+0000","last_undegraded":"2024-05-10T11:12:37.186329+0000","last_fullsized":"2024-05-10T11:12:37.186329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:54:56.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187113+0000","last_change":"2024-05-10T11:12:30.106471+0000","last_active":"2024-05-10T11:12:37.187113+0000","last_peered":"2024-05-10T11:12:37.187113+0000","last_clean":"2024-05-10T11:12:37.187113+0000","last_became_active":"2024-05-10T11:12:30.106152+0000","last_became_peered":"2024-05-10T11:12:30.106152+0000","last_unstale":"2024-05-10T11:12:37.187113+0000","last_undegraded":"2024-05-10T11:12:37.187113+0000","last_fullsized":"2024-05-10T11:12:37.187113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187285+0000","last_change":"2024-05-10T11:12:35.126286+0000","last_active":"2024-05-10T11:12:37.187285+0000","last_peered":"2024-05-10T11:12:37.187285+0000","last_clean":"2024-05-10T11:12:37.187285+0000","last_became_active":"2024-05-10T11:12:35.125717+0000","last_became_peered":"2024-05-10T11:12:35.125717+0000","last_unstale":"2024-05-10T11:12:37.187285+0000","last_undegraded":"2024-05-10T11:12:37.187285+0000","last_fullsized":"2024-05-10T11:12:37.187285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285141+0000","last_change":"2024-05-10T11:12:31.109293+0000","last_active":"2024-05-10T11:12:36.285141+0000","last_peered":"2024-05-10T11:12:36.285141+0000","last_clean":"2024-05-10T11:12:36.285141+0000","last_became_active":"2024-05-10T11:12:31.109011+0000","last_became_peered":"2024-05-10T11:12:31.109011+0000","last_unstale":"2024-05-10T11:12:36.285141+0000","last_undegraded":"2024-05-10T11:12:36.285141+0000","last_fullsized":"2024-05-10T11:12:36.285141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:23.860440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285079+0000","last_change":"2024-05-10T11:12:30.112853+0000","last_active":"2024-05-10T11:12:36.285079+0000","last_peered":"2024-05-10T11:12:36.285079+0000","last_clean":"2024-05-10T11:12:36.285079+0000","last_became_active":"2024-05-10T11:12:30.112518+0000","last_became_peered":"2024-05-10T11:12:30.112518+0000","last_unstale":"2024-05-10T11:12:36.285079+0000","last_undegraded":"2024-05-10T11:12:36.285079+0000","last_fullsized":"2024-05-10T11:12:36.285079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188215+0000","last_change":"2024-05-10T11:12:35.421295+0000","last_active":"2024-05-10T11:12:37.188215+0000","last_peered":"2024-05-10T11:12:37.188215+0000","last_clean":"2024-05-10T11:12:37.188215+0000","last_became_active":"2024-05-10T11:12:35.420917+0000","last_became_peered":"2024-05-10T11:12:35.420917+0000","last_unstale":"2024-05-10T11:12:37.188215+0000","last_undegraded":"2024-05-10T11:12:37.188215+0000","last_fullsized":"2024-05-10T11:12:37.188215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:08:10.900267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186431+0000","last_change":"2024-05-10T11:12:31.118875+0000","last_active":"2024-05-10T11:12:37.186431+0000","last_peered":"2024-05-10T11:12:37.186431+0000","last_clean":"2024-05-10T11:12:37.186431+0000","last_became_active":"2024-05-10T11:12:31.118593+0000","last_became_peered":"2024-05-10T11:12:31.118593+0000","last_unstale":"2024-05-10T11:12:37.186431+0000","last_undegraded":"2024-05-10T11:12:37.186431+0000","last_fullsized":"2024-05-10T11:12:37.186431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:36.209217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133641+0000","last_change":"2024-05-10T11:12:30.112650+0000","last_active":"2024-05-10T11:12:36.133641+0000","last_peered":"2024-05-10T11:12:36.133641+0000","last_clean":"2024-05-10T11:12:36.133641+0000","last_became_active":"2024-05-10T11:12:30.112297+0000","last_became_peered":"2024-05-10T11:12:30.112297+0000","last_unstale":"2024-05-10T11:12:36.133641+0000","last_undegraded":"2024-05-10T11:12:36.133641+0000","last_fullsized":"2024-05-10T11:12:36.133641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188493+0000","last_change":"2024-05-10T11:12:35.420619+0000","last_active":"2024-05-10T11:12:37.188493+0000","last_peered":"2024-05-10T11:12:37.188493+0000","last_clean":"2024-05-10T11:12:37.188493+0000","last_became_active":"2024-05-10T11:12:35.420215+0000","last_became_peered":"2024-05-10T11:12:35.420215+0000","last_unstale":"2024-05-10T11:12:37.188493+0000","last_undegraded":"2024-05-10T11:12:37.188493+0000","last_fullsized":"2024-05-10T11:12:37.188493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:13.010526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187343+0000","last_change":"2024-05-10T11:12:31.109731+0000","last_active":"2024-05-10T11:12:37.187343+0000","last_peered":"2024-05-10T11:12:37.187343+0000","last_clean":"2024-05-10T11:12:37.187343+0000","last_became_active":"2024-05-10T11:12:31.109139+0000","last_became_peered":"2024-05-10T11:12:31.109139+0000","last_unstale":"2024-05-10T11:12:37.187343+0000","last_undegraded":"2024-05-10T11:12:37.187343+0000","last_fullsized":"2024-05-10T11:12:37.187343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187717+0000","last_change":"2024-05-10T11:12:30.100711+0000","last_active":"2024-05-10T11:12:37.187717+0000","last_peered":"2024-05-10T11:12:37.187717+0000","last_clean":"2024-05-10T11:12:37.187717+0000","last_became_active":"2024-05-10T11:12:30.100119+0000","last_became_peered":"2024-05-10T11:12:30.100119+0000","last_unstale":"2024-05-10T11:12:37.187717+0000","last_undegraded":"2024-05-10T11:12:37.187717+0000","last_fullsized":"2024-05-10T11:12:37.187717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133273+0000","last_change":"2024-05-10T11:12:35.421572+0000","last_active":"2024-05-10T11:12:36.133273+0000","last_peered":"2024-05-10T11:12:36.133273+0000","last_clean":"2024-05-10T11:12:36.133273+0000","last_became_active":"2024-05-10T11:12:35.421218+0000","last_became_peered":"2024-05-10T11:12:35.421218+0000","last_unstale":"2024-05-10T11:12:36.133273+0000","last_undegraded":"2024-05-10T11:12:36.133273+0000","last_fullsized":"2024-05-10T11:12:36.133273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186338+0000","last_change":"2024-05-10T11:12:31.119385+0000","last_active":"2024-05-10T11:12:37.186338+0000","last_peered":"2024-05-10T11:12:37.186338+0000","last_clean":"2024-05-10T11:12:37.186338+0000","last_became_active":"2024-05-10T11:12:31.118251+0000","last_became_peered":"2024-05-10T11:12:31.118251+0000","last_unstale":"2024-05-10T11:12:37.186338+0000","last_undegraded":"2024-05-10T11:12:37.186338+0000","last_fullsized":"2024-05-10T11:12:37.186338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:27.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285470+0000","last_change":"2024-05-10T11:12:30.115042+0000","last_active":"2024-05-10T11:12:36.285470+0000","last_peered":"2024-05-10T11:12:36.285470+0000","last_clean":"2024-05-10T11:12:36.285470+0000","last_became_active":"2024-05-10T11:12:30.114856+0000","last_became_peered":"2024-05-10T11:12:30.114856+0000","last_unstale":"2024-05-10T11:12:36.285470+0000","last_undegraded":"2024-05-10T11:12:36.285470+0000","last_fullsized":"2024-05-10T11:12:36.285470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188815+0000","last_change":"2024-05-10T11:12:35.134285+0000","last_active":"2024-05-10T11:12:37.188815+0000","last_peered":"2024-05-10T11:12:37.188815+0000","last_clean":"2024-05-10T11:12:37.188815+0000","last_became_active":"2024-05-10T11:12:35.133864+0000","last_became_peered":"2024-05-10T11:12:35.133864+0000","last_unstale":"2024-05-10T11:12:37.188815+0000","last_undegraded":"2024-05-10T11:12:37.188815+0000","last_fullsized":"2024-05-10T11:12:37.188815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133000+0000","last_change":"2024-05-10T11:12:31.112754+0000","last_active":"2024-05-10T11:12:36.133000+0000","last_peered":"2024-05-10T11:12:36.133000+0000","last_clean":"2024-05-10T11:12:36.133000+0000","last_became_active":"2024-05-10T11:12:31.112193+0000","last_became_peered":"2024-05-10T11:12:31.112193+0000","last_unstale":"2024-05-10T11:12:36.133000+0000","last_undegraded":"2024-05-10T11:12:36.133000+0000","last_fullsized":"2024-05-10T11:12:36.133000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:06.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186601+0000","last_change":"2024-05-10T11:12:30.104162+0000","last_active":"2024-05-10T11:12:37.186601+0000","last_peered":"2024-05-10T11:12:37.186601+0000","last_clean":"2024-05-10T11:12:37.186601+0000","last_became_active":"2024-05-10T11:12:30.103843+0000","last_became_peered":"2024-05-10T11:12:30.103843+0000","last_unstale":"2024-05-10T11:12:37.186601+0000","last_undegraded":"2024-05-10T11:12:37.186601+0000","last_fullsized":"2024-05-10T11:12:37.186601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133886+0000","last_change":"2024-05-10T11:12:35.135088+0000","last_active":"2024-05-10T11:12:36.133886+0000","last_peered":"2024-05-10T11:12:36.133886+0000","last_clean":"2024-05-10T11:12:36.133886+0000","last_became_active":"2024-05-10T11:12:35.134532+0000","last_became_peered":"2024-05-10T11:12:35.134532+0000","last_unstale":"2024-05-10T11:12:36.133886+0000","last_undegraded":"2024-05-10T11:12:36.133886+0000","last_fullsized":"2024-05-10T11:12:36.133886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:42.541074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186828+0000","last_change":"2024-05-10T11:12:31.118512+0000","last_active":"2024-05-10T11:12:37.186828+0000","last_peered":"2024-05-10T11:12:37.186828+0000","last_clean":"2024-05-10T11:12:37.186828+0000","last_became_active":"2024-05-10T11:12:31.117887+0000","last_became_peered":"2024-05-10T11:12:31.117887+0000","last_unstale":"2024-05-10T11:12:37.186828+0000","last_undegraded":"2024-05-10T11:12:37.186828+0000","last_fullsized":"2024-05-10T11:12:37.186828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132913+0000","last_change":"2024-05-10T11:12:30.108984+0000","last_active":"2024-05-10T11:12:36.132913+0000","last_peered":"2024-05-10T11:12:36.132913+0000","last_clean":"2024-05-10T11:12:36.132913+0000","last_became_active":"2024-05-10T11:12:30.108652+0000","last_became_peered":"2024-05-10T11:12:30.108652+0000","last_unstale":"2024-05-10T11:12:36.132913+0000","last_undegraded":"2024-05-10T11:12:36.132913+0000","last_fullsized":"2024-05-10T11:12:36.132913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187375+0000","last_change":"2024-05-10T11:12:35.135736+0000","last_active":"2024-05-10T11:12:37.187375+0000","last_peered":"2024-05-10T11:12:37.187375+0000","last_clean":"2024-05-10T11:12:37.187375+0000","last_became_active":"2024-05-10T11:12:35.133392+0000","last_became_peered":"2024-05-10T11:12:35.133392+0000","last_unstale":"2024-05-10T11:12:37.187375+0000","last_undegraded":"2024-05-10T11:12:37.187375+0000","last_fullsized":"2024-05-10T11:12:37.187375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132810+0000","last_change":"2024-05-10T11:12:31.111452+0000","last_active":"2024-05-10T11:12:36.132810+0000","last_peered":"2024-05-10T11:12:36.132810+0000","last_clean":"2024-05-10T11:12:36.132810+0000","last_became_active":"2024-05-10T11:12:31.111168+0000","last_became_peered":"2024-05-10T11:12:31.111168+0000","last_unstale":"2024-05-10T11:12:36.132810+0000","last_undegraded":"2024-05-10T11:12:36.132810+0000","last_fullsized":"2024-05-10T11:12:36.132810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285516+0000","last_change":"2024-05-10T11:12:30.112912+0000","last_active":"2024-05-10T11:12:36.285516+0000","last_peered":"2024-05-10T11:12:36.285516+0000","last_clean":"2024-05-10T11:12:36.285516+0000","last_became_active":"2024-05-10T11:12:30.111893+0000","last_became_peered":"2024-05-10T11:12:30.111893+0000","last_unstale":"2024-05-10T11:12:36.285516+0000","last_undegraded":"2024-05-10T11:12:36.285516+0000","last_fullsized":"2024-05-10T11:12:36.285516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188183+0000","last_change":"2024-05-10T11:12:35.420832+0000","last_active":"2024-05-10T11:12:37.188183+0000","last_peered":"2024-05-10T11:12:37.188183+0000","last_clean":"2024-05-10T11:12:37.188183+0000","last_became_active":"2024-05-10T11:12:35.420468+0000","last_became_peered":"2024-05-10T11:12:35.420468+0000","last_unstale":"2024-05-10T11:12:37.188183+0000","last_undegraded":"2024-05-10T11:12:37.188183+0000","last_fullsized":"2024-05-10T11:12:37.188183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:03:37.556378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187133+0000","last_change":"2024-05-10T11:12:35.420919+0000","last_active":"2024-05-10T11:12:37.187133+0000","last_peered":"2024-05-10T11:12:37.187133+0000","last_clean":"2024-05-10T11:12:37.187133+0000","last_became_active":"2024-05-10T11:12:35.420486+0000","last_became_peered":"2024-05-10T11:12:35.420486+0000","last_unstale":"2024-05-10T11:12:37.187133+0000","last_undegraded":"2024-05-10T11:12:37.187133+0000","last_fullsized":"2024-05-10T11:12:37.187133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186198+0000","last_change":"2024-05-10T11:12:31.113465+0000","last_active":"2024-05-10T11:12:37.186198+0000","last_peered":"2024-05-10T11:12:37.186198+0000","last_clean":"2024-05-10T11:12:37.186198+0000","last_became_active":"2024-05-10T11:12:31.112391+0000","last_became_peered":"2024-05-10T11:12:31.112391+0000","last_unstale":"2024-05-10T11:12:37.186198+0000","last_undegraded":"2024-05-10T11:12:37.186198+0000","last_fullsized":"2024-05-10T11:12:37.186198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132384+0000","last_change":"2024-05-10T11:12:30.111231+0000","last_active":"2024-05-10T11:12:36.132384+0000","last_peered":"2024-05-10T11:12:36.132384+0000","last_clean":"2024-05-10T11:12:36.132384+0000","last_became_active":"2024-05-10T11:12:30.110915+0000","last_became_peered":"2024-05-10T11:12:30.110915+0000","last_unstale":"2024-05-10T11:12:36.132384+0000","last_undegraded":"2024-05-10T11:12:36.132384+0000","last_fullsized":"2024-05-10T11:12:36.132384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285493+0000","last_change":"2024-05-10T11:12:35.133270+0000","last_active":"2024-05-10T11:12:36.285493+0000","last_peered":"2024-05-10T11:12:36.285493+0000","last_clean":"2024-05-10T11:12:36.285493+0000","last_became_active":"2024-05-10T11:12:35.132883+0000","last_became_peered":"2024-05-10T11:12:35.132883+0000","last_unstale":"2024-05-10T11:12:36.285493+0000","last_undegraded":"2024-05-10T11:12:36.285493+0000","last_fullsized":"2024-05-10T11:12:36.285493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187365+0000","last_change":"2024-05-10T11:12:31.111880+0000","last_active":"2024-05-10T11:12:37.187365+0000","last_peered":"2024-05-10T11:12:37.187365+0000","last_clean":"2024-05-10T11:12:37.187365+0000","last_became_active":"2024-05-10T11:12:31.111561+0000","last_became_peered":"2024-05-10T11:12:31.111561+0000","last_unstale":"2024-05-10T11:12:37.187365+0000","last_undegraded":"2024-05-10T11:12:37.187365+0000","last_fullsized":"2024-05-10T11:12:37.187365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188080+0000","last_change":"2024-05-10T11:12:30.109020+0000","last_active":"2024-05-10T11:12:37.188080+0000","last_peered":"2024-05-10T11:12:37.188080+0000","last_clean":"2024-05-10T11:12:37.188080+0000","last_became_active":"2024-05-10T11:12:30.108553+0000","last_became_peered":"2024-05-10T11:12:30.108553+0000","last_unstale":"2024-05-10T11:12:37.188080+0000","last_undegraded":"2024-05-10T11:12:37.188080+0000","last_fullsized":"2024-05-10T11:12:37.188080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:39.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285277+0000","last_change":"2024-05-10T11:12:30.109083+0000","last_active":"2024-05-10T11:12:36.285277+0000","last_peered":"2024-05-10T11:12:36.285277+0000","last_clean":"2024-05-10T11:12:36.285277+0000","last_became_active":"2024-05-10T11:12:30.108670+0000","last_became_peered":"2024-05-10T11:12:30.108670+0000","last_unstale":"2024-05-10T11:12:36.285277+0000","last_undegraded":"2024-05-10T11:12:36.285277+0000","last_fullsized":"2024-05-10T11:12:36.285277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:58.672933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187664+0000","last_change":"2024-05-10T11:12:31.108203+0000","last_active":"2024-05-10T11:12:37.187664+0000","last_peered":"2024-05-10T11:12:37.187664+0000","last_clean":"2024-05-10T11:12:37.187664+0000","last_became_active":"2024-05-10T11:12:31.105737+0000","last_became_peered":"2024-05-10T11:12:31.105737+0000","last_unstale":"2024-05-10T11:12:37.187664+0000","last_undegraded":"2024-05-10T11:12:37.187664+0000","last_fullsized":"2024-05-10T11:12:37.187664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186596+0000","last_change":"2024-05-10T11:12:35.138676+0000","last_active":"2024-05-10T11:12:37.186596+0000","last_peered":"2024-05-10T11:12:37.186596+0000","last_clean":"2024-05-10T11:12:37.186596+0000","last_became_active":"2024-05-10T11:12:35.138246+0000","last_became_peered":"2024-05-10T11:12:35.138246+0000","last_unstale":"2024-05-10T11:12:37.186596+0000","last_undegraded":"2024-05-10T11:12:37.186596+0000","last_fullsized":"2024-05-10T11:12:37.186596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:10:22.656575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188197+0000","last_change":"2024-05-10T11:12:30.104759+0000","last_active":"2024-05-10T11:12:37.188197+0000","last_peered":"2024-05-10T11:12:37.188197+0000","last_clean":"2024-05-10T11:12:37.188197+0000","last_became_active":"2024-05-10T11:12:30.104499+0000","last_became_peered":"2024-05-10T11:12:30.104499+0000","last_unstale":"2024-05-10T11:12:37.188197+0000","last_undegraded":"2024-05-10T11:12:37.188197+0000","last_fullsized":"2024-05-10T11:12:37.188197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132631+0000","last_change":"2024-05-10T11:12:31.105067+0000","last_active":"2024-05-10T11:12:36.132631+0000","last_peered":"2024-05-10T11:12:36.132631+0000","last_clean":"2024-05-10T11:12:36.132631+0000","last_became_active":"2024-05-10T11:12:31.104796+0000","last_became_peered":"2024-05-10T11:12:31.104796+0000","last_unstale":"2024-05-10T11:12:36.132631+0000","last_undegraded":"2024-05-10T11:12:36.132631+0000","last_fullsized":"2024-05-10T11:12:36.132631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:14.797134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187802+0000","last_change":"2024-05-10T11:12:35.137496+0000","last_active":"2024-05-10T11:12:37.187802+0000","last_peered":"2024-05-10T11:12:37.187802+0000","last_clean":"2024-05-10T11:12:37.187802+0000","last_became_active":"2024-05-10T11:12:35.137075+0000","last_became_peered":"2024-05-10T11:12:35.137075+0000","last_unstale":"2024-05-10T11:12:37.187802+0000","last_undegraded":"2024-05-10T11:12:37.187802+0000","last_fullsized":"2024-05-10T11:12:37.187802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:05.500894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284987+0000","last_change":"2024-05-10T11:12:31.109999+0000","last_active":"2024-05-10T11:12:36.284987+0000","last_peered":"2024-05-10T11:12:36.284987+0000","last_clean":"2024-05-10T11:12:36.284987+0000","last_became_active":"2024-05-10T11:12:31.109735+0000","last_became_peered":"2024-05-10T11:12:31.109735+0000","last_unstale":"2024-05-10T11:12:36.284987+0000","last_undegraded":"2024-05-10T11:12:36.284987+0000","last_fullsized":"2024-05-10T11:12:36.284987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:16.421221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186110+0000","last_change":"2024-05-10T11:12:31.099225+0000","last_active":"2024-05-10T11:12:37.186110+0000","last_peered":"2024-05-10T11:12:37.186110+0000","last_clean":"2024-05-10T11:12:37.186110+0000","last_became_active":"2024-05-10T11:12:31.098939+0000","last_became_peered":"2024-05-10T11:12:31.098939+0000","last_unstale":"2024-05-10T11:12:37.186110+0000","last_undegraded":"2024-05-10T11:12:37.186110+0000","last_fullsized":"2024-05-10T11:12:37.186110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:37.589756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133535+0000","last_change":"2024-05-10T11:12:31.113217+0000","last_active":"2024-05-10T11:12:36.133535+0000","last_peered":"2024-05-10T11:12:36.133535+0000","last_clean":"2024-05-10T11:12:36.133535+0000","last_became_active":"2024-05-10T11:12:31.112918+0000","last_became_peered":"2024-05-10T11:12:31.112918+0000","last_unstale":"2024-05-10T11:12:36.133535+0000","last_undegraded":"2024-05-10T11:12:36.133535+0000","last_fullsized":"2024-05-10T11:12:36.133535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187573+0000","last_change":"2024-05-10T11:12:31.118834+0000","last_active":"2024-05-10T11:12:37.187573+0000","last_peered":"2024-05-10T11:12:37.187573+0000","last_clean":"2024-05-10T11:12:37.187573+0000","last_became_active":"2024-05-10T11:12:31.118516+0000","last_became_peered":"2024-05-10T11:12:31.118516+0000","last_unstale":"2024-05-10T11:12:37.187573+0000","last_undegraded":"2024-05-10T11:12:37.187573+0000","last_fullsized":"2024-05-10T11:12:37.187573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188567+0000","last_change":"2024-05-10T11:12:31.117568+0000","last_active":"2024-05-10T11:12:37.188567+0000","last_peered":"2024-05-10T11:12:37.188567+0000","last_clean":"2024-05-10T11:12:37.188567+0000","last_became_active":"2024-05-10T11:12:31.117238+0000","last_became_peered":"2024-05-10T11:12:31.117238+0000","last_unstale":"2024-05-10T11:12:37.188567+0000","last_undegraded":"2024-05-10T11:12:37.188567+0000","last_fullsized":"2024-05-10T11:12:37.188567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:31.113071+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:31.112773+0000","last_became_peered":"2024-05-10T11:12:31.112773+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285634+0000","last_change":"2024-05-10T11:12:31.111220+0000","last_active":"2024-05-10T11:12:36.285634+0000","last_peered":"2024-05-10T11:12:36.285634+0000","last_clean":"2024-05-10T11:12:36.285634+0000","last_became_active":"2024-05-10T11:12:31.110958+0000","last_became_peered":"2024-05-10T11:12:31.110958+0000","last_unstale":"2024-05-10T11:12:36.285634+0000","last_undegraded":"2024-05-10T11:12:36.285634+0000","last_fullsized":"2024-05-10T11:12:36.285634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:51.025764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188266+0000","last_change":"2024-05-10T11:12:31.116575+0000","last_active":"2024-05-10T11:12:37.188266+0000","last_peered":"2024-05-10T11:12:37.188266+0000","last_clean":"2024-05-10T11:12:37.188266+0000","last_became_active":"2024-05-10T11:12:31.116288+0000","last_became_peered":"2024-05-10T11:12:31.116288+0000","last_unstale":"2024-05-10T11:12:37.188266+0000","last_undegraded":"2024-05-10T11:12:37.188266+0000","last_fullsized":"2024-05-10T11:12:37.188266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132498+0000","last_change":"2024-05-10T11:12:31.117085+0000","last_active":"2024-05-10T11:12:36.132498+0000","last_peered":"2024-05-10T11:12:36.132498+0000","last_clean":"2024-05-10T11:12:36.132498+0000","last_became_active":"2024-05-10T11:12:31.116791+0000","last_became_peered":"2024-05-10T11:12:31.116791+0000","last_unstale":"2024-05-10T11:12:36.132498+0000","last_undegraded":"2024-05-10T11:12:36.132498+0000","last_fullsized":"2024-05-10T11:12:36.132498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187990+0000","last_change":"2024-05-10T11:12:31.117793+0000","last_active":"2024-05-10T11:12:37.187990+0000","last_peered":"2024-05-10T11:12:37.187990+0000","last_clean":"2024-05-10T11:12:37.187990+0000","last_became_active":"2024-05-10T11:12:31.117201+0000","last_became_peered":"2024-05-10T11:12:31.117201+0000","last_unstale":"2024-05-10T11:12:37.187990+0000","last_undegraded":"2024-05-10T11:12:37.187990+0000","last_fullsized":"2024-05-10T11:12:37.187990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133423+0000","last_change":"2024-05-10T11:12:31.111395+0000","last_active":"2024-05-10T11:12:36.133423+0000","last_peered":"2024-05-10T11:12:36.133423+0000","last_clean":"2024-05-10T11:12:36.133423+0000","last_became_active":"2024-05-10T11:12:31.111135+0000","last_became_peered":"2024-05-10T11:12:31.111135+0000","last_unstale":"2024-05-10T11:12:36.133423+0000","last_undegraded":"2024-05-10T11:12:36.133423+0000","last_fullsized":"2024-05-10T11:12:36.133423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187468+0000","last_change":"2024-05-10T11:12:31.111936+0000","last_active":"2024-05-10T11:12:37.187468+0000","last_peered":"2024-05-10T11:12:37.187468+0000","last_clean":"2024-05-10T11:12:37.187468+0000","last_became_active":"2024-05-10T11:12:31.111680+0000","last_became_peered":"2024-05-10T11:12:31.111680+0000","last_unstale":"2024-05-10T11:12:37.187468+0000","last_undegraded":"2024-05-10T11:12:37.187468+0000","last_fullsized":"2024-05-10T11:12:37.187468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285454+0000","last_change":"2024-05-10T11:12:31.106171+0000","last_active":"2024-05-10T11:12:36.285454+0000","last_peered":"2024-05-10T11:12:36.285454+0000","last_clean":"2024-05-10T11:12:36.285454+0000","last_became_active":"2024-05-10T11:12:31.105915+0000","last_became_peered":"2024-05-10T11:12:31.105915+0000","last_unstale":"2024-05-10T11:12:36.285454+0000","last_undegraded":"2024-05-10T11:12:36.285454+0000","last_fullsized":"2024-05-10T11:12:36.285454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:17.016710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186719+0000","last_change":"2024-05-10T11:12:31.116162+0000","last_active":"2024-05-10T11:12:37.186719+0000","last_peered":"2024-05-10T11:12:37.186719+0000","last_clean":"2024-05-10T11:12:37.186719+0000","last_became_active":"2024-05-10T11:12:31.115881+0000","last_became_peered":"2024-05-10T11:12:31.115881+0000","last_unstale":"2024-05-10T11:12:37.186719+0000","last_undegraded":"2024-05-10T11:12:37.186719+0000","last_fullsized":"2024-05-10T11:12:37.186719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:38.516343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186489+0000","last_change":"2024-05-10T11:12:31.104416+0000","last_active":"2024-05-10T11:12:37.186489+0000","last_peered":"2024-05-10T11:12:37.186489+0000","last_clean":"2024-05-10T11:12:37.186489+0000","last_became_active":"2024-05-10T11:12:31.104119+0000","last_became_peered":"2024-05-10T11:12:31.104119+0000","last_unstale":"2024-05-10T11:12:37.186489+0000","last_undegraded":"2024-05-10T11:12:37.186489+0000","last_fullsized":"2024-05-10T11:12:37.186489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:07.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133674+0000","last_change":"2024-05-10T11:12:31.111652+0000","last_active":"2024-05-10T11:12:36.133674+0000","last_peered":"2024-05-10T11:12:36.133674+0000","last_clean":"2024-05-10T11:12:36.133674+0000","last_became_active":"2024-05-10T11:12:31.111385+0000","last_became_peered":"2024-05-10T11:12:31.111385+0000","last_unstale":"2024-05-10T11:12:36.133674+0000","last_undegraded":"2024-05-10T11:12:36.133674+0000","last_fullsized":"2024-05-10T11:12:36.133674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:43.352019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132211+0000","last_change":"2024-05-10T11:12:31.110383+0000","last_active":"2024-05-10T11:12:36.132211+0000","last_peered":"2024-05-10T11:12:36.132211+0000","last_clean":"2024-05-10T11:12:36.132211+0000","last_became_active":"2024-05-10T11:12:31.108601+0000","last_became_peered":"2024-05-10T11:12:31.108601+0000","last_unstale":"2024-05-10T11:12:36.132211+0000","last_undegraded":"2024-05-10T11:12:36.132211+0000","last_fullsized":"2024-05-10T11:12:36.132211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186293+0000","last_change":"2024-05-10T11:12:31.108178+0000","last_active":"2024-05-10T11:12:37.186293+0000","last_peered":"2024-05-10T11:12:37.186293+0000","last_clean":"2024-05-10T11:12:37.186293+0000","last_became_active":"2024-05-10T11:12:31.107907+0000","last_became_peered":"2024-05-10T11:12:31.107907+0000","last_unstale":"2024-05-10T11:12:37.186293+0000","last_undegraded":"2024-05-10T11:12:37.186293+0000","last_fullsized":"2024-05-10T11:12:37.186293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187803+0000","last_change":"2024-05-10T11:12:31.110566+0000","last_active":"2024-05-10T11:12:37.187803+0000","last_peered":"2024-05-10T11:12:37.187803+0000","last_clean":"2024-05-10T11:12:37.187803+0000","last_became_active":"2024-05-10T11:12:31.109454+0000","last_became_peered":"2024-05-10T11:12:31.109454+0000","last_unstale":"2024-05-10T11:12:37.187803+0000","last_undegraded":"2024-05-10T11:12:37.187803+0000","last_fullsized":"2024-05-10T11:12:37.187803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188026+0000","last_change":"2024-05-10T11:12:31.115792+0000","last_active":"2024-05-10T11:12:37.188026+0000","last_peered":"2024-05-10T11:12:37.188026+0000","last_clean":"2024-05-10T11:12:37.188026+0000","last_became_active":"2024-05-10T11:12:31.115100+0000","last_became_peered":"2024-05-10T11:12:31.115100+0000","last_unstale":"2024-05-10T11:12:37.188026+0000","last_undegraded":"2024-05-10T11:12:37.188026+0000","last_fullsized":"2024-05-10T11:12:37.188026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132918+0000","last_change":"2024-05-10T11:12:31.103226+0000","last_active":"2024-05-10T11:12:36.132918+0000","last_peered":"2024-05-10T11:12:36.132918+0000","last_clean":"2024-05-10T11:12:36.132918+0000","last_became_active":"2024-05-10T11:12:31.102693+0000","last_became_peered":"2024-05-10T11:12:31.102693+0000","last_unstale":"2024-05-10T11:12:36.132918+0000","last_undegraded":"2024-05-10T11:12:36.132918+0000","last_fullsized":"2024-05-10T11:12:36.132918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:58.305425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285258+0000","last_change":"2024-05-10T11:12:31.117347+0000","last_active":"2024-05-10T11:12:36.285258+0000","last_peered":"2024-05-10T11:12:36.285258+0000","last_clean":"2024-05-10T11:12:36.285258+0000","last_became_active":"2024-05-10T11:12:31.117080+0000","last_became_peered":"2024-05-10T11:12:31.117080+0000","last_unstale":"2024-05-10T11:12:36.285258+0000","last_undegraded":"2024-05-10T11:12:36.285258+0000","last_fullsized":"2024-05-10T11:12:36.285258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:20:41.148766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285571+0000","last_change":"2024-05-10T11:12:31.113909+0000","last_active":"2024-05-10T11:12:36.285571+0000","last_peered":"2024-05-10T11:12:36.285571+0000","last_clean":"2024-05-10T11:12:36.285571+0000","last_became_active":"2024-05-10T11:12:31.113651+0000","last_became_peered":"2024-05-10T11:12:31.113651+0000","last_unstale":"2024-05-10T11:12:36.285571+0000","last_undegraded":"2024-05-10T11:12:36.285571+0000","last_fullsized":"2024-05-10T11:12:36.285571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:43.952189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186834+0000","last_change":"2024-05-10T11:12:31.117272+0000","last_active":"2024-05-10T11:12:37.186834+0000","last_peered":"2024-05-10T11:12:37.186834+0000","last_clean":"2024-05-10T11:12:37.186834+0000","last_became_active":"2024-05-10T11:12:31.117013+0000","last_became_peered":"2024-05-10T11:12:31.117013+0000","last_unstale":"2024-05-10T11:12:37.186834+0000","last_undegraded":"2024-05-10T11:12:37.186834+0000","last_fullsized":"2024-05-10T11:12:37.186834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:25.498498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187253+0000","last_change":"2024-05-10T11:12:31.118763+0000","last_active":"2024-05-10T11:12:37.187253+0000","last_peered":"2024-05-10T11:12:37.187253+0000","last_clean":"2024-05-10T11:12:37.187253+0000","last_became_active":"2024-05-10T11:12:31.118500+0000","last_became_peered":"2024-05-10T11:12:31.118500+0000","last_unstale":"2024-05-10T11:12:37.187253+0000","last_undegraded":"2024-05-10T11:12:37.187253+0000","last_fullsized":"2024-05-10T11:12:37.187253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186156+0000","last_change":"2024-05-10T11:12:31.121865+0000","last_active":"2024-05-10T11:12:37.186156+0000","last_peered":"2024-05-10T11:12:37.186156+0000","last_clean":"2024-05-10T11:12:37.186156+0000","last_became_active":"2024-05-10T11:12:31.121590+0000","last_became_peered":"2024-05-10T11:12:31.121590+0000","last_unstale":"2024-05-10T11:12:37.186156+0000","last_undegraded":"2024-05-10T11:12:37.186156+0000","last_fullsized":"2024-05-10T11:12:37.186156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:39.407373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133353+0000","last_change":"2024-05-10T11:12:31.118987+0000","last_active":"2024-05-10T11:12:36.133353+0000","last_peered":"2024-05-10T11:12:36.133353+0000","last_clean":"2024-05-10T11:12:36.133353+0000","last_became_active":"2024-05-10T11:12:31.118719+0000","last_became_peered":"2024-05-10T11:12:31.118719+0000","last_unstale":"2024-05-10T11:12:36.133353+0000","last_undegraded":"2024-05-10T11:12:36.133353+0000","last_fullsized":"2024-05-10T11:12:36.133353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:55:31.635937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186264+0000","last_change":"2024-05-10T11:12:31.114654+0000","last_active":"2024-05-10T11:12:37.186264+0000","last_peered":"2024-05-10T11:12:37.186264+0000","last_clean":"2024-05-10T11:12:37.186264+0000","last_became_active":"2024-05-10T11:12:31.114360+0000","last_became_peered":"2024-05-10T11:12:31.114360+0000","last_unstale":"2024-05-10T11:12:37.186264+0000","last_undegraded":"2024-05-10T11:12:37.186264+0000","last_fullsized":"2024-05-10T11:12:37.186264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:43.145552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132883+0000","last_change":"2024-05-10T11:12:31.116369+0000","last_active":"2024-05-10T11:12:36.132883+0000","last_peered":"2024-05-10T11:12:36.132883+0000","last_clean":"2024-05-10T11:12:36.132883+0000","last_became_active":"2024-05-10T11:12:31.114859+0000","last_became_peered":"2024-05-10T11:12:31.114859+0000","last_unstale":"2024-05-10T11:12:36.132883+0000","last_undegraded":"2024-05-10T11:12:36.132883+0000","last_fullsized":"2024-05-10T11:12:36.132883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186153+0000","last_change":"2024-05-10T11:12:31.116456+0000","last_active":"2024-05-10T11:12:37.186153+0000","last_peered":"2024-05-10T11:12:37.186153+0000","last_clean":"2024-05-10T11:12:37.186153+0000","last_became_active":"2024-05-10T11:12:31.115520+0000","last_became_peered":"2024-05-10T11:12:31.115520+0000","last_unstale":"2024-05-10T11:12:37.186153+0000","last_undegraded":"2024-05-10T11:12:37.186153+0000","last_fullsized":"2024-05-10T11:12:37.186153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186576+0000","last_change":"2024-05-10T11:12:31.107221+0000","last_active":"2024-05-10T11:12:37.186576+0000","last_peered":"2024-05-10T11:12:37.186576+0000","last_clean":"2024-05-10T11:12:37.186576+0000","last_became_active":"2024-05-10T11:12:31.106948+0000","last_became_peered":"2024-05-10T11:12:31.106948+0000","last_unstale":"2024-05-10T11:12:37.186576+0000","last_undegraded":"2024-05-10T11:12:37.186576+0000","last_fullsized":"2024-05-10T11:12:37.186576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186697+0000","last_change":"2024-05-10T11:12:31.113410+0000","last_active":"2024-05-10T11:12:37.186697+0000","last_peered":"2024-05-10T11:12:37.186697+0000","last_clean":"2024-05-10T11:12:37.186697+0000","last_became_active":"2024-05-10T11:12:31.112221+0000","last_became_peered":"2024-05-10T11:12:31.112221+0000","last_unstale":"2024-05-10T11:12:37.186697+0000","last_undegraded":"2024-05-10T11:12:37.186697+0000","last_fullsized":"2024-05-10T11:12:37.186697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:47.185372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":693801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":102977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":693857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:12:45.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:12:45.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.338+0000 7fc127704640 1 Processor -- start 2024-05-10T11:12:45.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.338+0000 7fc127704640 1 -- start start 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc127704640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3d80 0x7fc1200b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc127704640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1200d2d20 con 0x7fc120162940 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc127704640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1200d3000 con 0x7fc1200d59d0 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc127704640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc120162d20 con 0x7fc1200d3d80 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc1254a0640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc120162940 0x7fc1200d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40920/0 (socket says 172.21.15.66:40920) 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc1254a0640 1 -- 172.21.15.66:0/2375890344 learned_addr learned my addr 172.21.15.66:0/2375890344 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:45.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc124c9f640 1 --2- 172.21.15.66:0/2375890344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3d80 0x7fc1200b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824401531 0 0) 0x7fc1200d2d20 con 0x7fc120162940 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc10c003520 con 0x7fc120162940 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675080955 0 0) 0x7fc1200d3000 con 0x7fc1200d59d0 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1200d2d20 con 0x7fc1200d59d0 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc124c9f640 1 -- 172.21.15.66:0/2375890344 >> v1:172.21.15.190:6789/0 conn(0x7fc1200d59d0 legacy=0x7fc1200d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc124c9f640 1 -- 172.21.15.66:0/2375890344 >> v1:172.21.15.66:6789/0 conn(0x7fc120162940 legacy=0x7fc1200d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.339+0000 7fc124c9f640 1 -- 172.21.15.66:0/2375890344 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1200d32e0 con 0x7fc1200d3d80 2024-05-10T11:12:45.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.340+0000 7fc124c9f640 1 --2- 172.21.15.66:0/2375890344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3d80 0x7fc1200b5e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc1100097d0 tx=0x7fc11002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c53e9d7c0ec9627 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.340+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110037070 con 0x7fc1200d3d80 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.340+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc110032440 con 0x7fc1200d3d80 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.340+0000 7fc117fff640 1 -- 172.21.15.66:0/2375890344 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110032810 con 0x7fc1200d3d80 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 -- 172.21.15.66:0/2375890344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3d80 msgr2=0x7fc1200b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 --2- 172.21.15.66:0/2375890344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3d80 0x7fc1200b5e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc1100097d0 tx=0x7fc11002a180 comp rx=0 tx=0).stop 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 -- 172.21.15.66:0/2375890344 shutdown_connections 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 --2- 172.21.15.66:0/2375890344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3d80 0x7fc1200b5e20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 -- 172.21.15.66:0/2375890344 >> 172.21.15.66:0/2375890344 conn(0x7fc12009e380 msgr2=0x7fc1200d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 -- 172.21.15.66:0/2375890344 shutdown_connections 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.341+0000 7fc127704640 1 -- 172.21.15.66:0/2375890344 wait complete. 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.342+0000 7fc127704640 1 Processor -- start 2024-05-10T11:12:45.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.342+0000 7fc127704640 1 -- start start 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc127704640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d3d80 0x7fc1200d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc127704640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 0x7fc1200c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc127704640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc120162940 0x7fc1200c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc127704640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc1200d2390 con 0x7fc1200d59d0 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc127704640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1200cfc50 con 0x7fc1200d3d80 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc127704640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc1200d2510 con 0x7fc120162940 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 0x7fc1200c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 0x7fc1200c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39698/0 (socket says 172.21.15.66:39698) 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 -- 172.21.15.66:0/1091752938 learned_addr learned my addr 172.21.15.66:0/1091752938 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:45.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc125ca1640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc120162940 0x7fc1200c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc1254a0640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d3d80 0x7fc1200d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 -- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc120162940 msgr2=0x7fc1200c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc120162940 0x7fc1200c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 -- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d3d80 msgr2=0x7fc1200d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d3d80 0x7fc1200d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.343+0000 7fc124c9f640 1 -- 172.21.15.66:0/1091752938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1200ca170 con 0x7fc1200d59d0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.344+0000 7fc124c9f640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 0x7fc1200c9530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc110035040 tx=0x7fc1100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.344+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110041020 con 0x7fc1200d59d0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.344+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11003d720 con 0x7fc1200d59d0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.344+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1200ca450 con 0x7fc1200d59d0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.344+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110037040 con 0x7fc1200d59d0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.344+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1200caa10 con 0x7fc1200d59d0 2024-05-10T11:12:45.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.345+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1200d45a0 con 0x7fc1200d59d0 2024-05-10T11:12:45.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.346+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc110044020 con 0x7fc1200d59d0 2024-05-10T11:12:45.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.346+0000 7fc115ffb640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc104076300 0x7fc1040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.346+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1100b7f30 con 0x7fc1200d59d0 2024-05-10T11:12:45.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.347+0000 7fc1254a0640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc104076300 0x7fc1040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.347+0000 7fc1254a0640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc104076300 0x7fc1040787c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc11c000f60 tx=0x7fc11c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:45.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.351+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc1200d45a0 con 0x7fc1200d59d0 2024-05-10T11:12:45.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.542+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc12006a220 con 0x7fc104076300 2024-05-10T11:12:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.550+0000 7fc115ffb640 1 -- 172.21.15.66:0/1091752938 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332567 (secure 0 0 0) 0x7fc12006a220 con 0x7fc104076300 2024-05-10T11:12:45.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:45.555 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc104076300 msgr2=0x7fc1040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc104076300 0x7fc1040787c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc11c000f60 tx=0x7fc11c007d30 comp rx=0 tx=0).stop 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 msgr2=0x7fc1200c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 0x7fc1200c9530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc110035040 tx=0x7fc1100046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 shutdown_connections 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc104076300 0x7fc1040787c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc120162940 0x7fc1200c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1200d59d0 0x7fc1200c9530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 --2- 172.21.15.66:0/1091752938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d3d80 0x7fc1200d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 >> 172.21.15.66:0/1091752938 conn(0x7fc12009e380 msgr2=0x7fc1200b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:45.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 shutdown_connections 2024-05-10T11:12:45.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.554+0000 7fc127704640 1 -- 172.21.15.66:0/1091752938 wait complete. 2024-05-10T11:12:45.565 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-10T11:12:43.685934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219412,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755308,"statfs":{"total":773094113280,"available":772869435392,"internally_reserved":0,"allocated":3317760,"data_stored":2010594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.573589"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186919+0000","last_change":"2024-05-10T11:12:30.107293+0000","last_active":"2024-05-10T11:12:37.186919+0000","last_peered":"2024-05-10T11:12:37.186919+0000","last_clean":"2024-05-10T11:12:37.186919+0000","last_became_active":"2024-05-10T11:12:30.106969+0000","last_became_peered":"2024-05-10T11:12:30.106969+0000","last_unstale":"2024-05-10T11:12:37.186919+0000","last_undegraded":"2024-05-10T11:12:37.186919+0000","last_fullsized":"2024-05-10T11:12:37.186919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186702+0000","last_change":"2024-05-10T11:12:31.115437+0000","last_active":"2024-05-10T11:12:37.186702+0000","last_peered":"2024-05-10T11:12:37.186702+0000","last_clean":"2024-05-10T11:12:37.186702+0000","last_became_active":"2024-05-10T11:12:31.115119+0000","last_became_peered":"2024-05-10T11:12:31.115119+0000","last_unstale":"2024-05-10T11:12:37.186702+0000","last_undegraded":"2024-05-10T11:12:37.186702+0000","last_fullsized":"2024-05-10T11:12:37.186702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187674+0000","last_change":"2024-05-10T11:12:35.422690+0000","last_active":"2024-05-10T11:12:37.187674+0000","last_peered":"2024-05-10T11:12:37.187674+0000","last_clean":"2024-05-10T11:12:37.187674+0000","last_became_active":"2024-05-10T11:12:35.422285+0000","last_became_peered":"2024-05-10T11:12:35.422285+0000","last_unstale":"2024-05-10T11:12:37.187674+0000","last_undegraded":"2024-05-10T11:12:37.187674+0000","last_fullsized":"2024-05-10T11:12:37.187674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186871+0000","last_change":"2024-05-10T11:12:30.100472+0000","last_active":"2024-05-10T11:12:37.186871+0000","last_peered":"2024-05-10T11:12:37.186871+0000","last_clean":"2024-05-10T11:12:37.186871+0000","last_became_active":"2024-05-10T11:12:30.100185+0000","last_became_peered":"2024-05-10T11:12:30.100185+0000","last_unstale":"2024-05-10T11:12:37.186871+0000","last_undegraded":"2024-05-10T11:12:37.186871+0000","last_fullsized":"2024-05-10T11:12:37.186871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186663+0000","last_change":"2024-05-10T11:12:31.118746+0000","last_active":"2024-05-10T11:12:37.186663+0000","last_peered":"2024-05-10T11:12:37.186663+0000","last_clean":"2024-05-10T11:12:37.186663+0000","last_became_active":"2024-05-10T11:12:31.118237+0000","last_became_peered":"2024-05-10T11:12:31.118237+0000","last_unstale":"2024-05-10T11:12:37.186663+0000","last_undegraded":"2024-05-10T11:12:37.186663+0000","last_fullsized":"2024-05-10T11:12:37.186663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132046+0000","last_change":"2024-05-10T11:12:35.138165+0000","last_active":"2024-05-10T11:12:36.132046+0000","last_peered":"2024-05-10T11:12:36.132046+0000","last_clean":"2024-05-10T11:12:36.132046+0000","last_became_active":"2024-05-10T11:12:35.137676+0000","last_became_peered":"2024-05-10T11:12:35.137676+0000","last_unstale":"2024-05-10T11:12:36.132046+0000","last_undegraded":"2024-05-10T11:12:36.132046+0000","last_fullsized":"2024-05-10T11:12:36.132046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:55:00.560547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186717+0000","last_change":"2024-05-10T11:12:30.110920+0000","last_active":"2024-05-10T11:12:37.186717+0000","last_peered":"2024-05-10T11:12:37.186717+0000","last_clean":"2024-05-10T11:12:37.186717+0000","last_became_active":"2024-05-10T11:12:30.110167+0000","last_became_peered":"2024-05-10T11:12:30.110167+0000","last_unstale":"2024-05-10T11:12:37.186717+0000","last_undegraded":"2024-05-10T11:12:37.186717+0000","last_fullsized":"2024-05-10T11:12:37.186717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132994+0000","last_change":"2024-05-10T11:12:31.101959+0000","last_active":"2024-05-10T11:12:36.132994+0000","last_peered":"2024-05-10T11:12:36.132994+0000","last_clean":"2024-05-10T11:12:36.132994+0000","last_became_active":"2024-05-10T11:12:31.101677+0000","last_became_peered":"2024-05-10T11:12:31.101677+0000","last_unstale":"2024-05-10T11:12:36.132994+0000","last_undegraded":"2024-05-10T11:12:36.132994+0000","last_fullsized":"2024-05-10T11:12:36.132994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133684+0000","last_change":"2024-05-10T11:12:35.138098+0000","last_active":"2024-05-10T11:12:36.133684+0000","last_peered":"2024-05-10T11:12:36.133684+0000","last_clean":"2024-05-10T11:12:36.133684+0000","last_became_active":"2024-05-10T11:12:35.137760+0000","last_became_peered":"2024-05-10T11:12:35.137760+0000","last_unstale":"2024-05-10T11:12:36.133684+0000","last_undegraded":"2024-05-10T11:12:36.133684+0000","last_fullsized":"2024-05-10T11:12:36.133684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186379+0000","last_change":"2024-05-10T11:12:30.112117+0000","last_active":"2024-05-10T11:12:37.186379+0000","last_peered":"2024-05-10T11:12:37.186379+0000","last_clean":"2024-05-10T11:12:37.186379+0000","last_became_active":"2024-05-10T11:12:30.111649+0000","last_became_peered":"2024-05-10T11:12:30.111649+0000","last_unstale":"2024-05-10T11:12:37.186379+0000","last_undegraded":"2024-05-10T11:12:37.186379+0000","last_fullsized":"2024-05-10T11:12:37.186379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133328+0000","last_change":"2024-05-10T11:12:31.113857+0000","last_active":"2024-05-10T11:12:36.133328+0000","last_peered":"2024-05-10T11:12:36.133328+0000","last_clean":"2024-05-10T11:12:36.133328+0000","last_became_active":"2024-05-10T11:12:31.113561+0000","last_became_peered":"2024-05-10T11:12:31.113561+0000","last_unstale":"2024-05-10T11:12:36.133328+0000","last_undegraded":"2024-05-10T11:12:36.133328+0000","last_fullsized":"2024-05-10T11:12:36.133328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:57.654437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132469+0000","last_change":"2024-05-10T11:12:35.138373+0000","last_active":"2024-05-10T11:12:36.132469+0000","last_peered":"2024-05-10T11:12:36.132469+0000","last_clean":"2024-05-10T11:12:36.132469+0000","last_became_active":"2024-05-10T11:12:35.137918+0000","last_became_peered":"2024-05-10T11:12:35.137918+0000","last_unstale":"2024-05-10T11:12:36.132469+0000","last_undegraded":"2024-05-10T11:12:36.132469+0000","last_fullsized":"2024-05-10T11:12:36.132469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:47.170283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284980+0000","last_change":"2024-05-10T11:12:31.101194+0000","last_active":"2024-05-10T11:12:36.284980+0000","last_peered":"2024-05-10T11:12:36.284980+0000","last_clean":"2024-05-10T11:12:36.284980+0000","last_became_active":"2024-05-10T11:12:31.100888+0000","last_became_peered":"2024-05-10T11:12:31.100888+0000","last_unstale":"2024-05-10T11:12:36.284980+0000","last_undegraded":"2024-05-10T11:12:36.284980+0000","last_fullsized":"2024-05-10T11:12:36.284980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:00.574123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186570+0000","last_change":"2024-05-10T11:12:30.109646+0000","last_active":"2024-05-10T11:12:37.186570+0000","last_peered":"2024-05-10T11:12:37.186570+0000","last_clean":"2024-05-10T11:12:37.186570+0000","last_became_active":"2024-05-10T11:12:30.109393+0000","last_became_peered":"2024-05-10T11:12:30.109393+0000","last_unstale":"2024-05-10T11:12:37.186570+0000","last_undegraded":"2024-05-10T11:12:37.186570+0000","last_fullsized":"2024-05-10T11:12:37.186570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132986+0000","last_change":"2024-05-10T11:12:35.134377+0000","last_active":"2024-05-10T11:12:36.132986+0000","last_peered":"2024-05-10T11:12:36.132986+0000","last_clean":"2024-05-10T11:12:36.132986+0000","last_became_active":"2024-05-10T11:12:35.133107+0000","last_became_peered":"2024-05-10T11:12:35.133107+0000","last_unstale":"2024-05-10T11:12:36.132986+0000","last_undegraded":"2024-05-10T11:12:36.132986+0000","last_fullsized":"2024-05-10T11:12:36.132986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188108+0000","last_change":"2024-05-10T11:12:31.113901+0000","last_active":"2024-05-10T11:12:37.188108+0000","last_peered":"2024-05-10T11:12:37.188108+0000","last_clean":"2024-05-10T11:12:37.188108+0000","last_became_active":"2024-05-10T11:12:31.113316+0000","last_became_peered":"2024-05-10T11:12:31.113316+0000","last_unstale":"2024-05-10T11:12:37.188108+0000","last_undegraded":"2024-05-10T11:12:37.188108+0000","last_fullsized":"2024-05-10T11:12:37.188108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188842+0000","last_change":"2024-05-10T11:12:30.104152+0000","last_active":"2024-05-10T11:12:37.188842+0000","last_peered":"2024-05-10T11:12:37.188842+0000","last_clean":"2024-05-10T11:12:37.188842+0000","last_became_active":"2024-05-10T11:12:30.103869+0000","last_became_peered":"2024-05-10T11:12:30.103869+0000","last_unstale":"2024-05-10T11:12:37.188842+0000","last_undegraded":"2024-05-10T11:12:37.188842+0000","last_fullsized":"2024-05-10T11:12:37.188842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132702+0000","last_change":"2024-05-10T11:12:35.140690+0000","last_active":"2024-05-10T11:12:36.132702+0000","last_peered":"2024-05-10T11:12:36.132702+0000","last_clean":"2024-05-10T11:12:36.132702+0000","last_became_active":"2024-05-10T11:12:35.140367+0000","last_became_peered":"2024-05-10T11:12:35.140367+0000","last_unstale":"2024-05-10T11:12:36.132702+0000","last_undegraded":"2024-05-10T11:12:36.132702+0000","last_fullsized":"2024-05-10T11:12:36.132702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187425+0000","last_change":"2024-05-10T11:12:31.112506+0000","last_active":"2024-05-10T11:12:37.187425+0000","last_peered":"2024-05-10T11:12:37.187425+0000","last_clean":"2024-05-10T11:12:37.187425+0000","last_became_active":"2024-05-10T11:12:31.112211+0000","last_became_peered":"2024-05-10T11:12:31.112211+0000","last_unstale":"2024-05-10T11:12:37.187425+0000","last_undegraded":"2024-05-10T11:12:37.187425+0000","last_fullsized":"2024-05-10T11:12:37.187425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:30.107759+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:30.107468+0000","last_became_peered":"2024-05-10T11:12:30.107468+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186715+0000","last_change":"2024-05-10T11:12:35.422670+0000","last_active":"2024-05-10T11:12:37.186715+0000","last_peered":"2024-05-10T11:12:37.186715+0000","last_clean":"2024-05-10T11:12:37.186715+0000","last_became_active":"2024-05-10T11:12:35.422307+0000","last_became_peered":"2024-05-10T11:12:35.422307+0000","last_unstale":"2024-05-10T11:12:37.186715+0000","last_undegraded":"2024-05-10T11:12:37.186715+0000","last_fullsized":"2024-05-10T11:12:37.186715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:01.679168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132243+0000","last_change":"2024-05-10T11:12:31.105780+0000","last_active":"2024-05-10T11:12:36.132243+0000","last_peered":"2024-05-10T11:12:36.132243+0000","last_clean":"2024-05-10T11:12:36.132243+0000","last_became_active":"2024-05-10T11:12:31.105471+0000","last_became_peered":"2024-05-10T11:12:31.105471+0000","last_unstale":"2024-05-10T11:12:36.132243+0000","last_undegraded":"2024-05-10T11:12:36.132243+0000","last_fullsized":"2024-05-10T11:12:36.132243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:55.127350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186041+0000","last_change":"2024-05-10T11:12:30.110798+0000","last_active":"2024-05-10T11:12:37.186041+0000","last_peered":"2024-05-10T11:12:37.186041+0000","last_clean":"2024-05-10T11:12:37.186041+0000","last_became_active":"2024-05-10T11:12:30.110468+0000","last_became_peered":"2024-05-10T11:12:30.110468+0000","last_unstale":"2024-05-10T11:12:37.186041+0000","last_undegraded":"2024-05-10T11:12:37.186041+0000","last_fullsized":"2024-05-10T11:12:37.186041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132575+0000","last_change":"2024-05-10T11:12:35.138104+0000","last_active":"2024-05-10T11:12:36.132575+0000","last_peered":"2024-05-10T11:12:36.132575+0000","last_clean":"2024-05-10T11:12:36.132575+0000","last_became_active":"2024-05-10T11:12:35.137693+0000","last_became_peered":"2024-05-10T11:12:35.137693+0000","last_unstale":"2024-05-10T11:12:36.132575+0000","last_undegraded":"2024-05-10T11:12:36.132575+0000","last_fullsized":"2024-05-10T11:12:36.132575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:40.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187558+0000","last_change":"2024-05-10T11:12:31.107722+0000","last_active":"2024-05-10T11:12:37.187558+0000","last_peered":"2024-05-10T11:12:37.187558+0000","last_clean":"2024-05-10T11:12:37.187558+0000","last_became_active":"2024-05-10T11:12:31.107404+0000","last_became_peered":"2024-05-10T11:12:31.107404+0000","last_unstale":"2024-05-10T11:12:37.187558+0000","last_undegraded":"2024-05-10T11:12:37.187558+0000","last_fullsized":"2024-05-10T11:12:37.187558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285637+0000","last_change":"2024-05-10T11:12:30.113757+0000","last_active":"2024-05-10T11:12:36.285637+0000","last_peered":"2024-05-10T11:12:36.285637+0000","last_clean":"2024-05-10T11:12:36.285637+0000","last_became_active":"2024-05-10T11:12:30.113457+0000","last_became_peered":"2024-05-10T11:12:30.113457+0000","last_unstale":"2024-05-10T11:12:36.285637+0000","last_undegraded":"2024-05-10T11:12:36.285637+0000","last_fullsized":"2024-05-10T11:12:36.285637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132184+0000","last_change":"2024-05-10T11:12:35.421589+0000","last_active":"2024-05-10T11:12:36.132184+0000","last_peered":"2024-05-10T11:12:36.132184+0000","last_clean":"2024-05-10T11:12:36.132184+0000","last_became_active":"2024-05-10T11:12:35.421209+0000","last_became_peered":"2024-05-10T11:12:35.421209+0000","last_unstale":"2024-05-10T11:12:36.132184+0000","last_undegraded":"2024-05-10T11:12:36.132184+0000","last_fullsized":"2024-05-10T11:12:36.132184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:43.432104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188363+0000","last_change":"2024-05-10T11:12:31.113183+0000","last_active":"2024-05-10T11:12:37.188363+0000","last_peered":"2024-05-10T11:12:37.188363+0000","last_clean":"2024-05-10T11:12:37.188363+0000","last_became_active":"2024-05-10T11:12:31.112885+0000","last_became_peered":"2024-05-10T11:12:31.112885+0000","last_unstale":"2024-05-10T11:12:37.188363+0000","last_undegraded":"2024-05-10T11:12:37.188363+0000","last_fullsized":"2024-05-10T11:12:37.188363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186681+0000","last_change":"2024-05-10T11:12:30.106330+0000","last_active":"2024-05-10T11:12:37.186681+0000","last_peered":"2024-05-10T11:12:37.186681+0000","last_clean":"2024-05-10T11:12:37.186681+0000","last_became_active":"2024-05-10T11:12:30.106029+0000","last_became_peered":"2024-05-10T11:12:30.106029+0000","last_unstale":"2024-05-10T11:12:37.186681+0000","last_undegraded":"2024-05-10T11:12:37.186681+0000","last_fullsized":"2024-05-10T11:12:37.186681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187168+0000","last_change":"2024-05-10T11:12:35.421780+0000","last_active":"2024-05-10T11:12:37.187168+0000","last_peered":"2024-05-10T11:12:37.187168+0000","last_clean":"2024-05-10T11:12:37.187168+0000","last_became_active":"2024-05-10T11:12:35.421406+0000","last_became_peered":"2024-05-10T11:12:35.421406+0000","last_unstale":"2024-05-10T11:12:37.187168+0000","last_undegraded":"2024-05-10T11:12:37.187168+0000","last_fullsized":"2024-05-10T11:12:37.187168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187694+0000","last_change":"2024-05-10T11:12:31.104014+0000","last_active":"2024-05-10T11:12:37.187694+0000","last_peered":"2024-05-10T11:12:37.187694+0000","last_clean":"2024-05-10T11:12:37.187694+0000","last_became_active":"2024-05-10T11:12:31.103724+0000","last_became_peered":"2024-05-10T11:12:31.103724+0000","last_unstale":"2024-05-10T11:12:37.187694+0000","last_undegraded":"2024-05-10T11:12:37.187694+0000","last_fullsized":"2024-05-10T11:12:37.187694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186832+0000","last_change":"2024-05-10T11:12:30.110419+0000","last_active":"2024-05-10T11:12:37.186832+0000","last_peered":"2024-05-10T11:12:37.186832+0000","last_clean":"2024-05-10T11:12:37.186832+0000","last_became_active":"2024-05-10T11:12:30.109820+0000","last_became_peered":"2024-05-10T11:12:30.109820+0000","last_unstale":"2024-05-10T11:12:37.186832+0000","last_undegraded":"2024-05-10T11:12:37.186832+0000","last_fullsized":"2024-05-10T11:12:37.186832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:57.299078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187509+0000","last_change":"2024-05-10T11:12:35.420791+0000","last_active":"2024-05-10T11:12:37.187509+0000","last_peered":"2024-05-10T11:12:37.187509+0000","last_clean":"2024-05-10T11:12:37.187509+0000","last_became_active":"2024-05-10T11:12:35.420414+0000","last_became_peered":"2024-05-10T11:12:35.420414+0000","last_unstale":"2024-05-10T11:12:37.187509+0000","last_undegraded":"2024-05-10T11:12:37.187509+0000","last_fullsized":"2024-05-10T11:12:37.187509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133388+0000","last_change":"2024-05-10T11:12:31.109103+0000","last_active":"2024-05-10T11:12:36.133388+0000","last_peered":"2024-05-10T11:12:36.133388+0000","last_clean":"2024-05-10T11:12:36.133388+0000","last_became_active":"2024-05-10T11:12:31.108146+0000","last_became_peered":"2024-05-10T11:12:31.108146+0000","last_unstale":"2024-05-10T11:12:36.133388+0000","last_undegraded":"2024-05-10T11:12:36.133388+0000","last_fullsized":"2024-05-10T11:12:36.133388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:12.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187781+0000","last_change":"2024-05-10T11:12:30.101891+0000","last_active":"2024-05-10T11:12:37.187781+0000","last_peered":"2024-05-10T11:12:37.187781+0000","last_clean":"2024-05-10T11:12:37.187781+0000","last_became_active":"2024-05-10T11:12:30.101598+0000","last_became_peered":"2024-05-10T11:12:30.101598+0000","last_unstale":"2024-05-10T11:12:37.187781+0000","last_undegraded":"2024-05-10T11:12:37.187781+0000","last_fullsized":"2024-05-10T11:12:37.187781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188770+0000","last_change":"2024-05-10T11:12:35.135817+0000","last_active":"2024-05-10T11:12:37.188770+0000","last_peered":"2024-05-10T11:12:37.188770+0000","last_clean":"2024-05-10T11:12:37.188770+0000","last_became_active":"2024-05-10T11:12:35.135403+0000","last_became_peered":"2024-05-10T11:12:35.135403+0000","last_unstale":"2024-05-10T11:12:37.188770+0000","last_undegraded":"2024-05-10T11:12:37.188770+0000","last_fullsized":"2024-05-10T11:12:37.188770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133910+0000","last_change":"2024-05-10T11:12:31.103973+0000","last_active":"2024-05-10T11:12:36.133910+0000","last_peered":"2024-05-10T11:12:36.133910+0000","last_clean":"2024-05-10T11:12:36.133910+0000","last_became_active":"2024-05-10T11:12:31.103697+0000","last_became_peered":"2024-05-10T11:12:31.103697+0000","last_unstale":"2024-05-10T11:12:36.133910+0000","last_undegraded":"2024-05-10T11:12:36.133910+0000","last_fullsized":"2024-05-10T11:12:36.133910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:20.650809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133763+0000","last_change":"2024-05-10T11:12:30.112118+0000","last_active":"2024-05-10T11:12:36.133763+0000","last_peered":"2024-05-10T11:12:36.133763+0000","last_clean":"2024-05-10T11:12:36.133763+0000","last_became_active":"2024-05-10T11:12:30.111287+0000","last_became_peered":"2024-05-10T11:12:30.111287+0000","last_unstale":"2024-05-10T11:12:36.133763+0000","last_undegraded":"2024-05-10T11:12:36.133763+0000","last_fullsized":"2024-05-10T11:12:36.133763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187647+0000","last_change":"2024-05-10T11:12:35.140853+0000","last_active":"2024-05-10T11:12:37.187647+0000","last_peered":"2024-05-10T11:12:37.187647+0000","last_clean":"2024-05-10T11:12:37.187647+0000","last_became_active":"2024-05-10T11:12:35.140434+0000","last_became_peered":"2024-05-10T11:12:35.140434+0000","last_unstale":"2024-05-10T11:12:37.187647+0000","last_undegraded":"2024-05-10T11:12:37.187647+0000","last_fullsized":"2024-05-10T11:12:37.187647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187195+0000","last_change":"2024-05-10T11:12:31.110391+0000","last_active":"2024-05-10T11:12:37.187195+0000","last_peered":"2024-05-10T11:12:37.187195+0000","last_clean":"2024-05-10T11:12:37.187195+0000","last_became_active":"2024-05-10T11:12:31.109461+0000","last_became_peered":"2024-05-10T11:12:31.109461+0000","last_unstale":"2024-05-10T11:12:37.187195+0000","last_undegraded":"2024-05-10T11:12:37.187195+0000","last_fullsized":"2024-05-10T11:12:37.187195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186210+0000","last_change":"2024-05-10T11:12:30.109322+0000","last_active":"2024-05-10T11:12:37.186210+0000","last_peered":"2024-05-10T11:12:37.186210+0000","last_clean":"2024-05-10T11:12:37.186210+0000","last_became_active":"2024-05-10T11:12:30.109010+0000","last_became_peered":"2024-05-10T11:12:30.109010+0000","last_unstale":"2024-05-10T11:12:37.186210+0000","last_undegraded":"2024-05-10T11:12:37.186210+0000","last_fullsized":"2024-05-10T11:12:37.186210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186867+0000","last_change":"2024-05-10T11:12:35.138343+0000","last_active":"2024-05-10T11:12:37.186867+0000","last_peered":"2024-05-10T11:12:37.186867+0000","last_clean":"2024-05-10T11:12:37.186867+0000","last_became_active":"2024-05-10T11:12:35.137977+0000","last_became_peered":"2024-05-10T11:12:35.137977+0000","last_unstale":"2024-05-10T11:12:37.186867+0000","last_undegraded":"2024-05-10T11:12:37.186867+0000","last_fullsized":"2024-05-10T11:12:37.186867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:16.923493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186404+0000","last_change":"2024-05-10T11:12:31.107001+0000","last_active":"2024-05-10T11:12:37.186404+0000","last_peered":"2024-05-10T11:12:37.186404+0000","last_clean":"2024-05-10T11:12:37.186404+0000","last_became_active":"2024-05-10T11:12:31.105856+0000","last_became_peered":"2024-05-10T11:12:31.105856+0000","last_unstale":"2024-05-10T11:12:37.186404+0000","last_undegraded":"2024-05-10T11:12:37.186404+0000","last_fullsized":"2024-05-10T11:12:37.186404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186079+0000","last_change":"2024-05-10T11:12:30.106324+0000","last_active":"2024-05-10T11:12:37.186079+0000","last_peered":"2024-05-10T11:12:37.186079+0000","last_clean":"2024-05-10T11:12:37.186079+0000","last_became_active":"2024-05-10T11:12:30.106071+0000","last_became_peered":"2024-05-10T11:12:30.106071+0000","last_unstale":"2024-05-10T11:12:37.186079+0000","last_undegraded":"2024-05-10T11:12:37.186079+0000","last_fullsized":"2024-05-10T11:12:37.186079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:54.121002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187453+0000","last_change":"2024-05-10T11:12:35.420622+0000","last_active":"2024-05-10T11:12:37.187453+0000","last_peered":"2024-05-10T11:12:37.187453+0000","last_clean":"2024-05-10T11:12:37.187453+0000","last_became_active":"2024-05-10T11:12:35.420207+0000","last_became_peered":"2024-05-10T11:12:35.420207+0000","last_unstale":"2024-05-10T11:12:37.187453+0000","last_undegraded":"2024-05-10T11:12:37.187453+0000","last_fullsized":"2024-05-10T11:12:37.187453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186367+0000","last_change":"2024-05-10T11:12:31.119911+0000","last_active":"2024-05-10T11:12:37.186367+0000","last_peered":"2024-05-10T11:12:37.186367+0000","last_clean":"2024-05-10T11:12:37.186367+0000","last_became_active":"2024-05-10T11:12:31.119563+0000","last_became_peered":"2024-05-10T11:12:31.119563+0000","last_unstale":"2024-05-10T11:12:37.186367+0000","last_undegraded":"2024-05-10T11:12:37.186367+0000","last_fullsized":"2024-05-10T11:12:37.186367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132850+0000","last_change":"2024-05-10T11:12:30.111460+0000","last_active":"2024-05-10T11:12:36.132850+0000","last_peered":"2024-05-10T11:12:36.132850+0000","last_clean":"2024-05-10T11:12:36.132850+0000","last_became_active":"2024-05-10T11:12:30.111150+0000","last_became_peered":"2024-05-10T11:12:30.111150+0000","last_unstale":"2024-05-10T11:12:36.132850+0000","last_undegraded":"2024-05-10T11:12:36.132850+0000","last_fullsized":"2024-05-10T11:12:36.132850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186200+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:12:37.186200+0000","last_peered":"2024-05-10T11:12:37.186200+0000","last_clean":"2024-05-10T11:12:37.186200+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:12:37.186200+0000","last_undegraded":"2024-05-10T11:12:37.186200+0000","last_fullsized":"2024-05-10T11:12:37.186200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285379+0000","last_change":"2024-05-10T11:12:35.421543+0000","last_active":"2024-05-10T11:12:36.285379+0000","last_peered":"2024-05-10T11:12:36.285379+0000","last_clean":"2024-05-10T11:12:36.285379+0000","last_became_active":"2024-05-10T11:12:35.421171+0000","last_became_peered":"2024-05-10T11:12:35.421171+0000","last_unstale":"2024-05-10T11:12:36.285379+0000","last_undegraded":"2024-05-10T11:12:36.285379+0000","last_fullsized":"2024-05-10T11:12:36.285379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186499+0000","last_change":"2024-05-10T11:12:31.119926+0000","last_active":"2024-05-10T11:12:37.186499+0000","last_peered":"2024-05-10T11:12:37.186499+0000","last_clean":"2024-05-10T11:12:37.186499+0000","last_became_active":"2024-05-10T11:12:31.119632+0000","last_became_peered":"2024-05-10T11:12:31.119632+0000","last_unstale":"2024-05-10T11:12:37.186499+0000","last_undegraded":"2024-05-10T11:12:37.186499+0000","last_fullsized":"2024-05-10T11:12:37.186499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:17.896621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186772+0000","last_change":"2024-05-10T11:12:30.112153+0000","last_active":"2024-05-10T11:12:37.186772+0000","last_peered":"2024-05-10T11:12:37.186772+0000","last_clean":"2024-05-10T11:12:37.186772+0000","last_became_active":"2024-05-10T11:12:30.111901+0000","last_became_peered":"2024-05-10T11:12:30.111901+0000","last_unstale":"2024-05-10T11:12:37.186772+0000","last_undegraded":"2024-05-10T11:12:37.186772+0000","last_fullsized":"2024-05-10T11:12:37.186772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285207+0000","last_change":"2024-05-10T11:12:35.420749+0000","last_active":"2024-05-10T11:12:36.285207+0000","last_peered":"2024-05-10T11:12:36.285207+0000","last_clean":"2024-05-10T11:12:36.285207+0000","last_became_active":"2024-05-10T11:12:35.420325+0000","last_became_peered":"2024-05-10T11:12:35.420325+0000","last_unstale":"2024-05-10T11:12:36.285207+0000","last_undegraded":"2024-05-10T11:12:36.285207+0000","last_fullsized":"2024-05-10T11:12:36.285207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133116+0000","last_change":"2024-05-10T11:12:31.115139+0000","last_active":"2024-05-10T11:12:36.133116+0000","last_peered":"2024-05-10T11:12:36.133116+0000","last_clean":"2024-05-10T11:12:36.133116+0000","last_became_active":"2024-05-10T11:12:31.114482+0000","last_became_peered":"2024-05-10T11:12:31.114482+0000","last_unstale":"2024-05-10T11:12:36.133116+0000","last_undegraded":"2024-05-10T11:12:36.133116+0000","last_fullsized":"2024-05-10T11:12:36.133116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:02.344229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186711+0000","last_change":"2024-05-10T11:12:30.102023+0000","last_active":"2024-05-10T11:12:37.186711+0000","last_peered":"2024-05-10T11:12:37.186711+0000","last_clean":"2024-05-10T11:12:37.186711+0000","last_became_active":"2024-05-10T11:12:30.101642+0000","last_became_peered":"2024-05-10T11:12:30.101642+0000","last_unstale":"2024-05-10T11:12:37.186711+0000","last_undegraded":"2024-05-10T11:12:37.186711+0000","last_fullsized":"2024-05-10T11:12:37.186711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187660+0000","last_change":"2024-05-10T11:12:35.133498+0000","last_active":"2024-05-10T11:12:37.187660+0000","last_peered":"2024-05-10T11:12:37.187660+0000","last_clean":"2024-05-10T11:12:37.187660+0000","last_became_active":"2024-05-10T11:12:35.133009+0000","last_became_peered":"2024-05-10T11:12:35.133009+0000","last_unstale":"2024-05-10T11:12:37.187660+0000","last_undegraded":"2024-05-10T11:12:37.187660+0000","last_fullsized":"2024-05-10T11:12:37.187660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186836+0000","last_change":"2024-05-10T11:12:31.119096+0000","last_active":"2024-05-10T11:12:37.186836+0000","last_peered":"2024-05-10T11:12:37.186836+0000","last_clean":"2024-05-10T11:12:37.186836+0000","last_became_active":"2024-05-10T11:12:31.118841+0000","last_became_peered":"2024-05-10T11:12:31.118841+0000","last_unstale":"2024-05-10T11:12:37.186836+0000","last_undegraded":"2024-05-10T11:12:37.186836+0000","last_fullsized":"2024-05-10T11:12:37.186836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:51.850619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186580+0000","last_change":"2024-05-10T11:12:30.107841+0000","last_active":"2024-05-10T11:12:37.186580+0000","last_peered":"2024-05-10T11:12:37.186580+0000","last_clean":"2024-05-10T11:12:37.186580+0000","last_became_active":"2024-05-10T11:12:30.107551+0000","last_became_peered":"2024-05-10T11:12:30.107551+0000","last_unstale":"2024-05-10T11:12:37.186580+0000","last_undegraded":"2024-05-10T11:12:37.186580+0000","last_fullsized":"2024-05-10T11:12:37.186580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132082+0000","last_change":"2024-05-10T11:12:35.420691+0000","last_active":"2024-05-10T11:12:36.132082+0000","last_peered":"2024-05-10T11:12:36.132082+0000","last_clean":"2024-05-10T11:12:36.132082+0000","last_became_active":"2024-05-10T11:12:35.420284+0000","last_became_peered":"2024-05-10T11:12:35.420284+0000","last_unstale":"2024-05-10T11:12:36.132082+0000","last_undegraded":"2024-05-10T11:12:36.132082+0000","last_fullsized":"2024-05-10T11:12:36.132082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186722+0000","last_change":"2024-05-10T11:12:31.119535+0000","last_active":"2024-05-10T11:12:37.186722+0000","last_peered":"2024-05-10T11:12:37.186722+0000","last_clean":"2024-05-10T11:12:37.186722+0000","last_became_active":"2024-05-10T11:12:31.119282+0000","last_became_peered":"2024-05-10T11:12:31.119282+0000","last_unstale":"2024-05-10T11:12:37.186722+0000","last_undegraded":"2024-05-10T11:12:37.186722+0000","last_fullsized":"2024-05-10T11:12:37.186722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:58.094353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132416+0000","last_change":"2024-05-10T11:12:30.109801+0000","last_active":"2024-05-10T11:12:36.132416+0000","last_peered":"2024-05-10T11:12:36.132416+0000","last_clean":"2024-05-10T11:12:36.132416+0000","last_became_active":"2024-05-10T11:12:30.109068+0000","last_became_peered":"2024-05-10T11:12:30.109068+0000","last_unstale":"2024-05-10T11:12:36.132416+0000","last_undegraded":"2024-05-10T11:12:36.132416+0000","last_fullsized":"2024-05-10T11:12:36.132416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:58.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.131960+0000","last_change":"2024-05-10T11:12:35.132271+0000","last_active":"2024-05-10T11:12:36.131960+0000","last_peered":"2024-05-10T11:12:36.131960+0000","last_clean":"2024-05-10T11:12:36.131960+0000","last_became_active":"2024-05-10T11:12:35.131925+0000","last_became_peered":"2024-05-10T11:12:35.131925+0000","last_unstale":"2024-05-10T11:12:36.131960+0000","last_undegraded":"2024-05-10T11:12:36.131960+0000","last_fullsized":"2024-05-10T11:12:36.131960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:55.050495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186329+0000","last_change":"2024-05-10T11:12:31.120591+0000","last_active":"2024-05-10T11:12:37.186329+0000","last_peered":"2024-05-10T11:12:37.186329+0000","last_clean":"2024-05-10T11:12:37.186329+0000","last_became_active":"2024-05-10T11:12:31.120238+0000","last_became_peered":"2024-05-10T11:12:31.120238+0000","last_unstale":"2024-05-10T11:12:37.186329+0000","last_undegraded":"2024-05-10T11:12:37.186329+0000","last_fullsized":"2024-05-10T11:12:37.186329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:54:56.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187113+0000","last_change":"2024-05-10T11:12:30.106471+0000","last_active":"2024-05-10T11:12:37.187113+0000","last_peered":"2024-05-10T11:12:37.187113+0000","last_clean":"2024-05-10T11:12:37.187113+0000","last_became_active":"2024-05-10T11:12:30.106152+0000","last_became_peered":"2024-05-10T11:12:30.106152+0000","last_unstale":"2024-05-10T11:12:37.187113+0000","last_undegraded":"2024-05-10T11:12:37.187113+0000","last_fullsized":"2024-05-10T11:12:37.187113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187285+0000","last_change":"2024-05-10T11:12:35.126286+0000","last_active":"2024-05-10T11:12:37.187285+0000","last_peered":"2024-05-10T11:12:37.187285+0000","last_clean":"2024-05-10T11:12:37.187285+0000","last_became_active":"2024-05-10T11:12:35.125717+0000","last_became_peered":"2024-05-10T11:12:35.125717+0000","last_unstale":"2024-05-10T11:12:37.187285+0000","last_undegraded":"2024-05-10T11:12:37.187285+0000","last_fullsized":"2024-05-10T11:12:37.187285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285141+0000","last_change":"2024-05-10T11:12:31.109293+0000","last_active":"2024-05-10T11:12:36.285141+0000","last_peered":"2024-05-10T11:12:36.285141+0000","last_clean":"2024-05-10T11:12:36.285141+0000","last_became_active":"2024-05-10T11:12:31.109011+0000","last_became_peered":"2024-05-10T11:12:31.109011+0000","last_unstale":"2024-05-10T11:12:36.285141+0000","last_undegraded":"2024-05-10T11:12:36.285141+0000","last_fullsized":"2024-05-10T11:12:36.285141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:23.860440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285079+0000","last_change":"2024-05-10T11:12:30.112853+0000","last_active":"2024-05-10T11:12:36.285079+0000","last_peered":"2024-05-10T11:12:36.285079+0000","last_clean":"2024-05-10T11:12:36.285079+0000","last_became_active":"2024-05-10T11:12:30.112518+0000","last_became_peered":"2024-05-10T11:12:30.112518+0000","last_unstale":"2024-05-10T11:12:36.285079+0000","last_undegraded":"2024-05-10T11:12:36.285079+0000","last_fullsized":"2024-05-10T11:12:36.285079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188215+0000","last_change":"2024-05-10T11:12:35.421295+0000","last_active":"2024-05-10T11:12:37.188215+0000","last_peered":"2024-05-10T11:12:37.188215+0000","last_clean":"2024-05-10T11:12:37.188215+0000","last_became_active":"2024-05-10T11:12:35.420917+0000","last_became_peered":"2024-05-10T11:12:35.420917+0000","last_unstale":"2024-05-10T11:12:37.188215+0000","last_undegraded":"2024-05-10T11:12:37.188215+0000","last_fullsized":"2024-05-10T11:12:37.188215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:08:10.900267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186431+0000","last_change":"2024-05-10T11:12:31.118875+0000","last_active":"2024-05-10T11:12:37.186431+0000","last_peered":"2024-05-10T11:12:37.186431+0000","last_clean":"2024-05-10T11:12:37.186431+0000","last_became_active":"2024-05-10T11:12:31.118593+0000","last_became_peered":"2024-05-10T11:12:31.118593+0000","last_unstale":"2024-05-10T11:12:37.186431+0000","last_undegraded":"2024-05-10T11:12:37.186431+0000","last_fullsized":"2024-05-10T11:12:37.186431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:36.209217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133641+0000","last_change":"2024-05-10T11:12:30.112650+0000","last_active":"2024-05-10T11:12:36.133641+0000","last_peered":"2024-05-10T11:12:36.133641+0000","last_clean":"2024-05-10T11:12:36.133641+0000","last_became_active":"2024-05-10T11:12:30.112297+0000","last_became_peered":"2024-05-10T11:12:30.112297+0000","last_unstale":"2024-05-10T11:12:36.133641+0000","last_undegraded":"2024-05-10T11:12:36.133641+0000","last_fullsized":"2024-05-10T11:12:36.133641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188493+0000","last_change":"2024-05-10T11:12:35.420619+0000","last_active":"2024-05-10T11:12:37.188493+0000","last_peered":"2024-05-10T11:12:37.188493+0000","last_clean":"2024-05-10T11:12:37.188493+0000","last_became_active":"2024-05-10T11:12:35.420215+0000","last_became_peered":"2024-05-10T11:12:35.420215+0000","last_unstale":"2024-05-10T11:12:37.188493+0000","last_undegraded":"2024-05-10T11:12:37.188493+0000","last_fullsized":"2024-05-10T11:12:37.188493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:13.010526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187343+0000","last_change":"2024-05-10T11:12:31.109731+0000","last_active":"2024-05-10T11:12:37.187343+0000","last_peered":"2024-05-10T11:12:37.187343+0000","last_clean":"2024-05-10T11:12:37.187343+0000","last_became_active":"2024-05-10T11:12:31.109139+0000","last_became_peered":"2024-05-10T11:12:31.109139+0000","last_unstale":"2024-05-10T11:12:37.187343+0000","last_undegraded":"2024-05-10T11:12:37.187343+0000","last_fullsized":"2024-05-10T11:12:37.187343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187717+0000","last_change":"2024-05-10T11:12:30.100711+0000","last_active":"2024-05-10T11:12:37.187717+0000","last_peered":"2024-05-10T11:12:37.187717+0000","last_clean":"2024-05-10T11:12:37.187717+0000","last_became_active":"2024-05-10T11:12:30.100119+0000","last_became_peered":"2024-05-10T11:12:30.100119+0000","last_unstale":"2024-05-10T11:12:37.187717+0000","last_undegraded":"2024-05-10T11:12:37.187717+0000","last_fullsized":"2024-05-10T11:12:37.187717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133273+0000","last_change":"2024-05-10T11:12:35.421572+0000","last_active":"2024-05-10T11:12:36.133273+0000","last_peered":"2024-05-10T11:12:36.133273+0000","last_clean":"2024-05-10T11:12:36.133273+0000","last_became_active":"2024-05-10T11:12:35.421218+0000","last_became_peered":"2024-05-10T11:12:35.421218+0000","last_unstale":"2024-05-10T11:12:36.133273+0000","last_undegraded":"2024-05-10T11:12:36.133273+0000","last_fullsized":"2024-05-10T11:12:36.133273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186338+0000","last_change":"2024-05-10T11:12:31.119385+0000","last_active":"2024-05-10T11:12:37.186338+0000","last_peered":"2024-05-10T11:12:37.186338+0000","last_clean":"2024-05-10T11:12:37.186338+0000","last_became_active":"2024-05-10T11:12:31.118251+0000","last_became_peered":"2024-05-10T11:12:31.118251+0000","last_unstale":"2024-05-10T11:12:37.186338+0000","last_undegraded":"2024-05-10T11:12:37.186338+0000","last_fullsized":"2024-05-10T11:12:37.186338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:27.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285470+0000","last_change":"2024-05-10T11:12:30.115042+0000","last_active":"2024-05-10T11:12:36.285470+0000","last_peered":"2024-05-10T11:12:36.285470+0000","last_clean":"2024-05-10T11:12:36.285470+0000","last_became_active":"2024-05-10T11:12:30.114856+0000","last_became_peered":"2024-05-10T11:12:30.114856+0000","last_unstale":"2024-05-10T11:12:36.285470+0000","last_undegraded":"2024-05-10T11:12:36.285470+0000","last_fullsized":"2024-05-10T11:12:36.285470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188815+0000","last_change":"2024-05-10T11:12:35.134285+0000","last_active":"2024-05-10T11:12:37.188815+0000","last_peered":"2024-05-10T11:12:37.188815+0000","last_clean":"2024-05-10T11:12:37.188815+0000","last_became_active":"2024-05-10T11:12:35.133864+0000","last_became_peered":"2024-05-10T11:12:35.133864+0000","last_unstale":"2024-05-10T11:12:37.188815+0000","last_undegraded":"2024-05-10T11:12:37.188815+0000","last_fullsized":"2024-05-10T11:12:37.188815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133000+0000","last_change":"2024-05-10T11:12:31.112754+0000","last_active":"2024-05-10T11:12:36.133000+0000","last_peered":"2024-05-10T11:12:36.133000+0000","last_clean":"2024-05-10T11:12:36.133000+0000","last_became_active":"2024-05-10T11:12:31.112193+0000","last_became_peered":"2024-05-10T11:12:31.112193+0000","last_unstale":"2024-05-10T11:12:36.133000+0000","last_undegraded":"2024-05-10T11:12:36.133000+0000","last_fullsized":"2024-05-10T11:12:36.133000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:06.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186601+0000","last_change":"2024-05-10T11:12:30.104162+0000","last_active":"2024-05-10T11:12:37.186601+0000","last_peered":"2024-05-10T11:12:37.186601+0000","last_clean":"2024-05-10T11:12:37.186601+0000","last_became_active":"2024-05-10T11:12:30.103843+0000","last_became_peered":"2024-05-10T11:12:30.103843+0000","last_unstale":"2024-05-10T11:12:37.186601+0000","last_undegraded":"2024-05-10T11:12:37.186601+0000","last_fullsized":"2024-05-10T11:12:37.186601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133886+0000","last_change":"2024-05-10T11:12:35.135088+0000","last_active":"2024-05-10T11:12:36.133886+0000","last_peered":"2024-05-10T11:12:36.133886+0000","last_clean":"2024-05-10T11:12:36.133886+0000","last_became_active":"2024-05-10T11:12:35.134532+0000","last_became_peered":"2024-05-10T11:12:35.134532+0000","last_unstale":"2024-05-10T11:12:36.133886+0000","last_undegraded":"2024-05-10T11:12:36.133886+0000","last_fullsized":"2024-05-10T11:12:36.133886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:42.541074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186828+0000","last_change":"2024-05-10T11:12:31.118512+0000","last_active":"2024-05-10T11:12:37.186828+0000","last_peered":"2024-05-10T11:12:37.186828+0000","last_clean":"2024-05-10T11:12:37.186828+0000","last_became_active":"2024-05-10T11:12:31.117887+0000","last_became_peered":"2024-05-10T11:12:31.117887+0000","last_unstale":"2024-05-10T11:12:37.186828+0000","last_undegraded":"2024-05-10T11:12:37.186828+0000","last_fullsized":"2024-05-10T11:12:37.186828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132913+0000","last_change":"2024-05-10T11:12:30.108984+0000","last_active":"2024-05-10T11:12:36.132913+0000","last_peered":"2024-05-10T11:12:36.132913+0000","last_clean":"2024-05-10T11:12:36.132913+0000","last_became_active":"2024-05-10T11:12:30.108652+0000","last_became_peered":"2024-05-10T11:12:30.108652+0000","last_unstale":"2024-05-10T11:12:36.132913+0000","last_undegraded":"2024-05-10T11:12:36.132913+0000","last_fullsized":"2024-05-10T11:12:36.132913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187375+0000","last_change":"2024-05-10T11:12:35.135736+0000","last_active":"2024-05-10T11:12:37.187375+0000","last_peered":"2024-05-10T11:12:37.187375+0000","last_clean":"2024-05-10T11:12:37.187375+0000","last_became_active":"2024-05-10T11:12:35.133392+0000","last_became_peered":"2024-05-10T11:12:35.133392+0000","last_unstale":"2024-05-10T11:12:37.187375+0000","last_undegraded":"2024-05-10T11:12:37.187375+0000","last_fullsized":"2024-05-10T11:12:37.187375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132810+0000","last_change":"2024-05-10T11:12:31.111452+0000","last_active":"2024-05-10T11:12:36.132810+0000","last_peered":"2024-05-10T11:12:36.132810+0000","last_clean":"2024-05-10T11:12:36.132810+0000","last_became_active":"2024-05-10T11:12:31.111168+0000","last_became_peered":"2024-05-10T11:12:31.111168+0000","last_unstale":"2024-05-10T11:12:36.132810+0000","last_undegraded":"2024-05-10T11:12:36.132810+0000","last_fullsized":"2024-05-10T11:12:36.132810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285516+0000","last_change":"2024-05-10T11:12:30.112912+0000","last_active":"2024-05-10T11:12:36.285516+0000","last_peered":"2024-05-10T11:12:36.285516+0000","last_clean":"2024-05-10T11:12:36.285516+0000","last_became_active":"2024-05-10T11:12:30.111893+0000","last_became_peered":"2024-05-10T11:12:30.111893+0000","last_unstale":"2024-05-10T11:12:36.285516+0000","last_undegraded":"2024-05-10T11:12:36.285516+0000","last_fullsized":"2024-05-10T11:12:36.285516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188183+0000","last_change":"2024-05-10T11:12:35.420832+0000","last_active":"2024-05-10T11:12:37.188183+0000","last_peered":"2024-05-10T11:12:37.188183+0000","last_clean":"2024-05-10T11:12:37.188183+0000","last_became_active":"2024-05-10T11:12:35.420468+0000","last_became_peered":"2024-05-10T11:12:35.420468+0000","last_unstale":"2024-05-10T11:12:37.188183+0000","last_undegraded":"2024-05-10T11:12:37.188183+0000","last_fullsized":"2024-05-10T11:12:37.188183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:03:37.556378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187133+0000","last_change":"2024-05-10T11:12:35.420919+0000","last_active":"2024-05-10T11:12:37.187133+0000","last_peered":"2024-05-10T11:12:37.187133+0000","last_clean":"2024-05-10T11:12:37.187133+0000","last_became_active":"2024-05-10T11:12:35.420486+0000","last_became_peered":"2024-05-10T11:12:35.420486+0000","last_unstale":"2024-05-10T11:12:37.187133+0000","last_undegraded":"2024-05-10T11:12:37.187133+0000","last_fullsized":"2024-05-10T11:12:37.187133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186198+0000","last_change":"2024-05-10T11:12:31.113465+0000","last_active":"2024-05-10T11:12:37.186198+0000","last_peered":"2024-05-10T11:12:37.186198+0000","last_clean":"2024-05-10T11:12:37.186198+0000","last_became_active":"2024-05-10T11:12:31.112391+0000","last_became_peered":"2024-05-10T11:12:31.112391+0000","last_unstale":"2024-05-10T11:12:37.186198+0000","last_undegraded":"2024-05-10T11:12:37.186198+0000","last_fullsized":"2024-05-10T11:12:37.186198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132384+0000","last_change":"2024-05-10T11:12:30.111231+0000","last_active":"2024-05-10T11:12:36.132384+0000","last_peered":"2024-05-10T11:12:36.132384+0000","last_clean":"2024-05-10T11:12:36.132384+0000","last_became_active":"2024-05-10T11:12:30.110915+0000","last_became_peered":"2024-05-10T11:12:30.110915+0000","last_unstale":"2024-05-10T11:12:36.132384+0000","last_undegraded":"2024-05-10T11:12:36.132384+0000","last_fullsized":"2024-05-10T11:12:36.132384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285493+0000","last_change":"2024-05-10T11:12:35.133270+0000","last_active":"2024-05-10T11:12:36.285493+0000","last_peered":"2024-05-10T11:12:36.285493+0000","last_clean":"2024-05-10T11:12:36.285493+0000","last_became_active":"2024-05-10T11:12:35.132883+0000","last_became_peered":"2024-05-10T11:12:35.132883+0000","last_unstale":"2024-05-10T11:12:36.285493+0000","last_undegraded":"2024-05-10T11:12:36.285493+0000","last_fullsized":"2024-05-10T11:12:36.285493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187365+0000","last_change":"2024-05-10T11:12:31.111880+0000","last_active":"2024-05-10T11:12:37.187365+0000","last_peered":"2024-05-10T11:12:37.187365+0000","last_clean":"2024-05-10T11:12:37.187365+0000","last_became_active":"2024-05-10T11:12:31.111561+0000","last_became_peered":"2024-05-10T11:12:31.111561+0000","last_unstale":"2024-05-10T11:12:37.187365+0000","last_undegraded":"2024-05-10T11:12:37.187365+0000","last_fullsized":"2024-05-10T11:12:37.187365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188080+0000","last_change":"2024-05-10T11:12:30.109020+0000","last_active":"2024-05-10T11:12:37.188080+0000","last_peered":"2024-05-10T11:12:37.188080+0000","last_clean":"2024-05-10T11:12:37.188080+0000","last_became_active":"2024-05-10T11:12:30.108553+0000","last_became_peered":"2024-05-10T11:12:30.108553+0000","last_unstale":"2024-05-10T11:12:37.188080+0000","last_undegraded":"2024-05-10T11:12:37.188080+0000","last_fullsized":"2024-05-10T11:12:37.188080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:39.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285277+0000","last_change":"2024-05-10T11:12:30.109083+0000","last_active":"2024-05-10T11:12:36.285277+0000","last_peered":"2024-05-10T11:12:36.285277+0000","last_clean":"2024-05-10T11:12:36.285277+0000","last_became_active":"2024-05-10T11:12:30.108670+0000","last_became_peered":"2024-05-10T11:12:30.108670+0000","last_unstale":"2024-05-10T11:12:36.285277+0000","last_undegraded":"2024-05-10T11:12:36.285277+0000","last_fullsized":"2024-05-10T11:12:36.285277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:58.672933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187664+0000","last_change":"2024-05-10T11:12:31.108203+0000","last_active":"2024-05-10T11:12:37.187664+0000","last_peered":"2024-05-10T11:12:37.187664+0000","last_clean":"2024-05-10T11:12:37.187664+0000","last_became_active":"2024-05-10T11:12:31.105737+0000","last_became_peered":"2024-05-10T11:12:31.105737+0000","last_unstale":"2024-05-10T11:12:37.187664+0000","last_undegraded":"2024-05-10T11:12:37.187664+0000","last_fullsized":"2024-05-10T11:12:37.187664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186596+0000","last_change":"2024-05-10T11:12:35.138676+0000","last_active":"2024-05-10T11:12:37.186596+0000","last_peered":"2024-05-10T11:12:37.186596+0000","last_clean":"2024-05-10T11:12:37.186596+0000","last_became_active":"2024-05-10T11:12:35.138246+0000","last_became_peered":"2024-05-10T11:12:35.138246+0000","last_unstale":"2024-05-10T11:12:37.186596+0000","last_undegraded":"2024-05-10T11:12:37.186596+0000","last_fullsized":"2024-05-10T11:12:37.186596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:10:22.656575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188197+0000","last_change":"2024-05-10T11:12:30.104759+0000","last_active":"2024-05-10T11:12:37.188197+0000","last_peered":"2024-05-10T11:12:37.188197+0000","last_clean":"2024-05-10T11:12:37.188197+0000","last_became_active":"2024-05-10T11:12:30.104499+0000","last_became_peered":"2024-05-10T11:12:30.104499+0000","last_unstale":"2024-05-10T11:12:37.188197+0000","last_undegraded":"2024-05-10T11:12:37.188197+0000","last_fullsized":"2024-05-10T11:12:37.188197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132631+0000","last_change":"2024-05-10T11:12:31.105067+0000","last_active":"2024-05-10T11:12:36.132631+0000","last_peered":"2024-05-10T11:12:36.132631+0000","last_clean":"2024-05-10T11:12:36.132631+0000","last_became_active":"2024-05-10T11:12:31.104796+0000","last_became_peered":"2024-05-10T11:12:31.104796+0000","last_unstale":"2024-05-10T11:12:36.132631+0000","last_undegraded":"2024-05-10T11:12:36.132631+0000","last_fullsized":"2024-05-10T11:12:36.132631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:14.797134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187802+0000","last_change":"2024-05-10T11:12:35.137496+0000","last_active":"2024-05-10T11:12:37.187802+0000","last_peered":"2024-05-10T11:12:37.187802+0000","last_clean":"2024-05-10T11:12:37.187802+0000","last_became_active":"2024-05-10T11:12:35.137075+0000","last_became_peered":"2024-05-10T11:12:35.137075+0000","last_unstale":"2024-05-10T11:12:37.187802+0000","last_undegraded":"2024-05-10T11:12:37.187802+0000","last_fullsized":"2024-05-10T11:12:37.187802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:05.500894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284987+0000","last_change":"2024-05-10T11:12:31.109999+0000","last_active":"2024-05-10T11:12:36.284987+0000","last_peered":"2024-05-10T11:12:36.284987+0000","last_clean":"2024-05-10T11:12:36.284987+0000","last_became_active":"2024-05-10T11:12:31.109735+0000","last_became_peered":"2024-05-10T11:12:31.109735+0000","last_unstale":"2024-05-10T11:12:36.284987+0000","last_undegraded":"2024-05-10T11:12:36.284987+0000","last_fullsized":"2024-05-10T11:12:36.284987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:16.421221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186110+0000","last_change":"2024-05-10T11:12:31.099225+0000","last_active":"2024-05-10T11:12:37.186110+0000","last_peered":"2024-05-10T11:12:37.186110+0000","last_clean":"2024-05-10T11:12:37.186110+0000","last_became_active":"2024-05-10T11:12:31.098939+0000","last_became_peered":"2024-05-10T11:12:31.098939+0000","last_unstale":"2024-05-10T11:12:37.186110+0000","last_undegraded":"2024-05-10T11:12:37.186110+0000","last_fullsized":"2024-05-10T11:12:37.186110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:37.589756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133535+0000","last_change":"2024-05-10T11:12:31.113217+0000","last_active":"2024-05-10T11:12:36.133535+0000","last_peered":"2024-05-10T11:12:36.133535+0000","last_clean":"2024-05-10T11:12:36.133535+0000","last_became_active":"2024-05-10T11:12:31.112918+0000","last_became_peered":"2024-05-10T11:12:31.112918+0000","last_unstale":"2024-05-10T11:12:36.133535+0000","last_undegraded":"2024-05-10T11:12:36.133535+0000","last_fullsized":"2024-05-10T11:12:36.133535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187573+0000","last_change":"2024-05-10T11:12:31.118834+0000","last_active":"2024-05-10T11:12:37.187573+0000","last_peered":"2024-05-10T11:12:37.187573+0000","last_clean":"2024-05-10T11:12:37.187573+0000","last_became_active":"2024-05-10T11:12:31.118516+0000","last_became_peered":"2024-05-10T11:12:31.118516+0000","last_unstale":"2024-05-10T11:12:37.187573+0000","last_undegraded":"2024-05-10T11:12:37.187573+0000","last_fullsized":"2024-05-10T11:12:37.187573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188567+0000","last_change":"2024-05-10T11:12:31.117568+0000","last_active":"2024-05-10T11:12:37.188567+0000","last_peered":"2024-05-10T11:12:37.188567+0000","last_clean":"2024-05-10T11:12:37.188567+0000","last_became_active":"2024-05-10T11:12:31.117238+0000","last_became_peered":"2024-05-10T11:12:31.117238+0000","last_unstale":"2024-05-10T11:12:37.188567+0000","last_undegraded":"2024-05-10T11:12:37.188567+0000","last_fullsized":"2024-05-10T11:12:37.188567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:31.113071+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:31.112773+0000","last_became_peered":"2024-05-10T11:12:31.112773+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285634+0000","last_change":"2024-05-10T11:12:31.111220+0000","last_active":"2024-05-10T11:12:36.285634+0000","last_peered":"2024-05-10T11:12:36.285634+0000","last_clean":"2024-05-10T11:12:36.285634+0000","last_became_active":"2024-05-10T11:12:31.110958+0000","last_became_peered":"2024-05-10T11:12:31.110958+0000","last_unstale":"2024-05-10T11:12:36.285634+0000","last_undegraded":"2024-05-10T11:12:36.285634+0000","last_fullsized":"2024-05-10T11:12:36.285634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:51.025764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188266+0000","last_change":"2024-05-10T11:12:31.116575+0000","last_active":"2024-05-10T11:12:37.188266+0000","last_peered":"2024-05-10T11:12:37.188266+0000","last_clean":"2024-05-10T11:12:37.188266+0000","last_became_active":"2024-05-10T11:12:31.116288+0000","last_became_peered":"2024-05-10T11:12:31.116288+0000","last_unstale":"2024-05-10T11:12:37.188266+0000","last_undegraded":"2024-05-10T11:12:37.188266+0000","last_fullsized":"2024-05-10T11:12:37.188266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132498+0000","last_change":"2024-05-10T11:12:31.117085+0000","last_active":"2024-05-10T11:12:36.132498+0000","last_peered":"2024-05-10T11:12:36.132498+0000","last_clean":"2024-05-10T11:12:36.132498+0000","last_became_active":"2024-05-10T11:12:31.116791+0000","last_became_peered":"2024-05-10T11:12:31.116791+0000","last_unstale":"2024-05-10T11:12:36.132498+0000","last_undegraded":"2024-05-10T11:12:36.132498+0000","last_fullsized":"2024-05-10T11:12:36.132498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187990+0000","last_change":"2024-05-10T11:12:31.117793+0000","last_active":"2024-05-10T11:12:37.187990+0000","last_peered":"2024-05-10T11:12:37.187990+0000","last_clean":"2024-05-10T11:12:37.187990+0000","last_became_active":"2024-05-10T11:12:31.117201+0000","last_became_peered":"2024-05-10T11:12:31.117201+0000","last_unstale":"2024-05-10T11:12:37.187990+0000","last_undegraded":"2024-05-10T11:12:37.187990+0000","last_fullsized":"2024-05-10T11:12:37.187990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133423+0000","last_change":"2024-05-10T11:12:31.111395+0000","last_active":"2024-05-10T11:12:36.133423+0000","last_peered":"2024-05-10T11:12:36.133423+0000","last_clean":"2024-05-10T11:12:36.133423+0000","last_became_active":"2024-05-10T11:12:31.111135+0000","last_became_peered":"2024-05-10T11:12:31.111135+0000","last_unstale":"2024-05-10T11:12:36.133423+0000","last_undegraded":"2024-05-10T11:12:36.133423+0000","last_fullsized":"2024-05-10T11:12:36.133423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187468+0000","last_change":"2024-05-10T11:12:31.111936+0000","last_active":"2024-05-10T11:12:37.187468+0000","last_peered":"2024-05-10T11:12:37.187468+0000","last_clean":"2024-05-10T11:12:37.187468+0000","last_became_active":"2024-05-10T11:12:31.111680+0000","last_became_peered":"2024-05-10T11:12:31.111680+0000","last_unstale":"2024-05-10T11:12:37.187468+0000","last_undegraded":"2024-05-10T11:12:37.187468+0000","last_fullsized":"2024-05-10T11:12:37.187468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285454+0000","last_change":"2024-05-10T11:12:31.106171+0000","last_active":"2024-05-10T11:12:36.285454+0000","last_peered":"2024-05-10T11:12:36.285454+0000","last_clean":"2024-05-10T11:12:36.285454+0000","last_became_active":"2024-05-10T11:12:31.105915+0000","last_became_peered":"2024-05-10T11:12:31.105915+0000","last_unstale":"2024-05-10T11:12:36.285454+0000","last_undegraded":"2024-05-10T11:12:36.285454+0000","last_fullsized":"2024-05-10T11:12:36.285454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:17.016710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186719+0000","last_change":"2024-05-10T11:12:31.116162+0000","last_active":"2024-05-10T11:12:37.186719+0000","last_peered":"2024-05-10T11:12:37.186719+0000","last_clean":"2024-05-10T11:12:37.186719+0000","last_became_active":"2024-05-10T11:12:31.115881+0000","last_became_peered":"2024-05-10T11:12:31.115881+0000","last_unstale":"2024-05-10T11:12:37.186719+0000","last_undegraded":"2024-05-10T11:12:37.186719+0000","last_fullsized":"2024-05-10T11:12:37.186719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:38.516343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186489+0000","last_change":"2024-05-10T11:12:31.104416+0000","last_active":"2024-05-10T11:12:37.186489+0000","last_peered":"2024-05-10T11:12:37.186489+0000","last_clean":"2024-05-10T11:12:37.186489+0000","last_became_active":"2024-05-10T11:12:31.104119+0000","last_became_peered":"2024-05-10T11:12:31.104119+0000","last_unstale":"2024-05-10T11:12:37.186489+0000","last_undegraded":"2024-05-10T11:12:37.186489+0000","last_fullsized":"2024-05-10T11:12:37.186489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:07.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133674+0000","last_change":"2024-05-10T11:12:31.111652+0000","last_active":"2024-05-10T11:12:36.133674+0000","last_peered":"2024-05-10T11:12:36.133674+0000","last_clean":"2024-05-10T11:12:36.133674+0000","last_became_active":"2024-05-10T11:12:31.111385+0000","last_became_peered":"2024-05-10T11:12:31.111385+0000","last_unstale":"2024-05-10T11:12:36.133674+0000","last_undegraded":"2024-05-10T11:12:36.133674+0000","last_fullsized":"2024-05-10T11:12:36.133674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:43.352019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132211+0000","last_change":"2024-05-10T11:12:31.110383+0000","last_active":"2024-05-10T11:12:36.132211+0000","last_peered":"2024-05-10T11:12:36.132211+0000","last_clean":"2024-05-10T11:12:36.132211+0000","last_became_active":"2024-05-10T11:12:31.108601+0000","last_became_peered":"2024-05-10T11:12:31.108601+0000","last_unstale":"2024-05-10T11:12:36.132211+0000","last_undegraded":"2024-05-10T11:12:36.132211+0000","last_fullsized":"2024-05-10T11:12:36.132211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186293+0000","last_change":"2024-05-10T11:12:31.108178+0000","last_active":"2024-05-10T11:12:37.186293+0000","last_peered":"2024-05-10T11:12:37.186293+0000","last_clean":"2024-05-10T11:12:37.186293+0000","last_became_active":"2024-05-10T11:12:31.107907+0000","last_became_peered":"2024-05-10T11:12:31.107907+0000","last_unstale":"2024-05-10T11:12:37.186293+0000","last_undegraded":"2024-05-10T11:12:37.186293+0000","last_fullsized":"2024-05-10T11:12:37.186293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187803+0000","last_change":"2024-05-10T11:12:31.110566+0000","last_active":"2024-05-10T11:12:37.187803+0000","last_peered":"2024-05-10T11:12:37.187803+0000","last_clean":"2024-05-10T11:12:37.187803+0000","last_became_active":"2024-05-10T11:12:31.109454+0000","last_became_peered":"2024-05-10T11:12:31.109454+0000","last_unstale":"2024-05-10T11:12:37.187803+0000","last_undegraded":"2024-05-10T11:12:37.187803+0000","last_fullsized":"2024-05-10T11:12:37.187803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188026+0000","last_change":"2024-05-10T11:12:31.115792+0000","last_active":"2024-05-10T11:12:37.188026+0000","last_peered":"2024-05-10T11:12:37.188026+0000","last_clean":"2024-05-10T11:12:37.188026+0000","last_became_active":"2024-05-10T11:12:31.115100+0000","last_became_peered":"2024-05-10T11:12:31.115100+0000","last_unstale":"2024-05-10T11:12:37.188026+0000","last_undegraded":"2024-05-10T11:12:37.188026+0000","last_fullsized":"2024-05-10T11:12:37.188026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132918+0000","last_change":"2024-05-10T11:12:31.103226+0000","last_active":"2024-05-10T11:12:36.132918+0000","last_peered":"2024-05-10T11:12:36.132918+0000","last_clean":"2024-05-10T11:12:36.132918+0000","last_became_active":"2024-05-10T11:12:31.102693+0000","last_became_peered":"2024-05-10T11:12:31.102693+0000","last_unstale":"2024-05-10T11:12:36.132918+0000","last_undegraded":"2024-05-10T11:12:36.132918+0000","last_fullsized":"2024-05-10T11:12:36.132918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:58.305425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285258+0000","last_change":"2024-05-10T11:12:31.117347+0000","last_active":"2024-05-10T11:12:36.285258+0000","last_peered":"2024-05-10T11:12:36.285258+0000","last_clean":"2024-05-10T11:12:36.285258+0000","last_became_active":"2024-05-10T11:12:31.117080+0000","last_became_peered":"2024-05-10T11:12:31.117080+0000","last_unstale":"2024-05-10T11:12:36.285258+0000","last_undegraded":"2024-05-10T11:12:36.285258+0000","last_fullsized":"2024-05-10T11:12:36.285258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:20:41.148766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285571+0000","last_change":"2024-05-10T11:12:31.113909+0000","last_active":"2024-05-10T11:12:36.285571+0000","last_peered":"2024-05-10T11:12:36.285571+0000","last_clean":"2024-05-10T11:12:36.285571+0000","last_became_active":"2024-05-10T11:12:31.113651+0000","last_became_peered":"2024-05-10T11:12:31.113651+0000","last_unstale":"2024-05-10T11:12:36.285571+0000","last_undegraded":"2024-05-10T11:12:36.285571+0000","last_fullsized":"2024-05-10T11:12:36.285571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:43.952189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186834+0000","last_change":"2024-05-10T11:12:31.117272+0000","last_active":"2024-05-10T11:12:37.186834+0000","last_peered":"2024-05-10T11:12:37.186834+0000","last_clean":"2024-05-10T11:12:37.186834+0000","last_became_active":"2024-05-10T11:12:31.117013+0000","last_became_peered":"2024-05-10T11:12:31.117013+0000","last_unstale":"2024-05-10T11:12:37.186834+0000","last_undegraded":"2024-05-10T11:12:37.186834+0000","last_fullsized":"2024-05-10T11:12:37.186834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:25.498498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187253+0000","last_change":"2024-05-10T11:12:31.118763+0000","last_active":"2024-05-10T11:12:37.187253+0000","last_peered":"2024-05-10T11:12:37.187253+0000","last_clean":"2024-05-10T11:12:37.187253+0000","last_became_active":"2024-05-10T11:12:31.118500+0000","last_became_peered":"2024-05-10T11:12:31.118500+0000","last_unstale":"2024-05-10T11:12:37.187253+0000","last_undegraded":"2024-05-10T11:12:37.187253+0000","last_fullsized":"2024-05-10T11:12:37.187253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186156+0000","last_change":"2024-05-10T11:12:31.121865+0000","last_active":"2024-05-10T11:12:37.186156+0000","last_peered":"2024-05-10T11:12:37.186156+0000","last_clean":"2024-05-10T11:12:37.186156+0000","last_became_active":"2024-05-10T11:12:31.121590+0000","last_became_peered":"2024-05-10T11:12:31.121590+0000","last_unstale":"2024-05-10T11:12:37.186156+0000","last_undegraded":"2024-05-10T11:12:37.186156+0000","last_fullsized":"2024-05-10T11:12:37.186156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:39.407373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133353+0000","last_change":"2024-05-10T11:12:31.118987+0000","last_active":"2024-05-10T11:12:36.133353+0000","last_peered":"2024-05-10T11:12:36.133353+0000","last_clean":"2024-05-10T11:12:36.133353+0000","last_became_active":"2024-05-10T11:12:31.118719+0000","last_became_peered":"2024-05-10T11:12:31.118719+0000","last_unstale":"2024-05-10T11:12:36.133353+0000","last_undegraded":"2024-05-10T11:12:36.133353+0000","last_fullsized":"2024-05-10T11:12:36.133353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:55:31.635937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186264+0000","last_change":"2024-05-10T11:12:31.114654+0000","last_active":"2024-05-10T11:12:37.186264+0000","last_peered":"2024-05-10T11:12:37.186264+0000","last_clean":"2024-05-10T11:12:37.186264+0000","last_became_active":"2024-05-10T11:12:31.114360+0000","last_became_peered":"2024-05-10T11:12:31.114360+0000","last_unstale":"2024-05-10T11:12:37.186264+0000","last_undegraded":"2024-05-10T11:12:37.186264+0000","last_fullsized":"2024-05-10T11:12:37.186264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:43.145552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132883+0000","last_change":"2024-05-10T11:12:31.116369+0000","last_active":"2024-05-10T11:12:36.132883+0000","last_peered":"2024-05-10T11:12:36.132883+0000","last_clean":"2024-05-10T11:12:36.132883+0000","last_became_active":"2024-05-10T11:12:31.114859+0000","last_became_peered":"2024-05-10T11:12:31.114859+0000","last_unstale":"2024-05-10T11:12:36.132883+0000","last_undegraded":"2024-05-10T11:12:36.132883+0000","last_fullsized":"2024-05-10T11:12:36.132883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186153+0000","last_change":"2024-05-10T11:12:31.116456+0000","last_active":"2024-05-10T11:12:37.186153+0000","last_peered":"2024-05-10T11:12:37.186153+0000","last_clean":"2024-05-10T11:12:37.186153+0000","last_became_active":"2024-05-10T11:12:31.115520+0000","last_became_peered":"2024-05-10T11:12:31.115520+0000","last_unstale":"2024-05-10T11:12:37.186153+0000","last_undegraded":"2024-05-10T11:12:37.186153+0000","last_fullsized":"2024-05-10T11:12:37.186153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186576+0000","last_change":"2024-05-10T11:12:31.107221+0000","last_active":"2024-05-10T11:12:37.186576+0000","last_peered":"2024-05-10T11:12:37.186576+0000","last_clean":"2024-05-10T11:12:37.186576+0000","last_became_active":"2024-05-10T11:12:31.106948+0000","last_became_peered":"2024-05-10T11:12:31.106948+0000","last_unstale":"2024-05-10T11:12:37.186576+0000","last_undegraded":"2024-05-10T11:12:37.186576+0000","last_fullsized":"2024-05-10T11:12:37.186576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186697+0000","last_change":"2024-05-10T11:12:31.113410+0000","last_active":"2024-05-10T11:12:37.186697+0000","last_peered":"2024-05-10T11:12:37.186697+0000","last_clean":"2024-05-10T11:12:37.186697+0000","last_became_active":"2024-05-10T11:12:31.112221+0000","last_became_peered":"2024-05-10T11:12:31.112221+0000","last_unstale":"2024-05-10T11:12:37.186697+0000","last_undegraded":"2024-05-10T11:12:37.186697+0000","last_fullsized":"2024-05-10T11:12:37.186697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:47.185372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":693801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":102977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":693857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:12:45.570 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:12:45.570 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T11:12:45.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T11:12:45.570 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T11:12:45.571 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T11:12:45.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.708+0000 7f24fa9f0640 1 Processor -- start 2024-05-10T11:12:45.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.709+0000 7f24fa9f0640 1 -- start start 2024-05-10T11:12:45.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.709+0000 7f24fa9f0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f415f3b0 0x7f24f40d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.709+0000 7f24fa9f0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24f40d5d30 0x7f24f40d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.709+0000 7f24fa9f0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f40d30b0 con 0x7f24f415f790 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.709+0000 7f24fa9f0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f24f40d3390 con 0x7f24f40d5d30 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.709+0000 7f24fa9f0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24f40c8c80 con 0x7f24f415f3b0 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f37fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f24f415f790 0x7f24f40c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40936/0 (socket says 172.21.15.66:40936) 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f37fe640 1 -- 172.21.15.66:0/1886689100 learned_addr learned my addr 172.21.15.66:0/1886689100 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f8f8d640 1 --2- 172.21.15.66:0/1886689100 >> v2:172.21.15.190:3300/0 conn(0x7f24f40d5d30 0x7f24f40d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f3fff640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f415f3b0 0x7f24f40d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312990431 0 0) 0x7f24f40d30b0 con 0x7f24f415f790 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24dc003520 con 0x7f24f415f790 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4222464117 0 0) 0x7f24dc003520 con 0x7f24f415f790 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f415f3b0 msgr2=0x7f24f40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f415f3b0 0x7f24f40d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 >> v2:172.21.15.190:3300/0 conn(0x7f24f40d5d30 msgr2=0x7f24f40d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 --2- 172.21.15.66:0/1886689100 >> v2:172.21.15.190:3300/0 conn(0x7f24f40d5d30 0x7f24f40d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f40c8f60 con 0x7f24f415f790 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f24e8001670 con 0x7f24f415f790 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 >> v1:172.21.15.66:6789/0 conn(0x7f24f415f790 legacy=0x7f24f40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40d3390 con 0x7f24dc0039b0 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40c8c80 con 0x7f24dc004800 2024-05-10T11:12:45.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc00bf00 con 0x7f24dc0051c0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f3fff640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f415f3b0 0x7f24f40d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f8f8d640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f3fff640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.710+0000 7f24f37fe640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f8f8d640 1 -- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24dc004800 msgr2=0x7f24dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f8f8d640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f8f8d640 1 -- 172.21.15.66:0/1886689100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0039b0 msgr2=0x7f24dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f8f8d640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f8f8d640 1 -- 172.21.15.66:0/1886689100 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc003520 con 0x7f24dc0051c0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f3fff640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.711+0000 7f24f8f8d640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009f90 tx=0x7f24dc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51bac45832b2a25 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec009c10 con 0x7f24dc0051c0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec036070 con 0x7f24dc0051c0 2024-05-10T11:12:45.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24f2ffd640 1 -- 172.21.15.66:0/1886689100 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec031880 con 0x7f24dc0051c0 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24fa9f0640 1 -- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24dc0051c0 msgr2=0x7f24dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/1886689100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009f90 tx=0x7f24dc005830 comp rx=0 tx=0).stop 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24f8f8d640 1 -- 172.21.15.66:0/1886689100 reap_dead start 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24fa9f0640 1 -- 172.21.15.66:0/1886689100 shutdown_connections 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24fa9f0640 1 -- 172.21.15.66:0/1886689100 >> 172.21.15.66:0/1886689100 conn(0x7f24f40d5130 msgr2=0x7f24f40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24fa9f0640 1 -- 172.21.15.66:0/1886689100 shutdown_connections 2024-05-10T11:12:45.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.712+0000 7f24fa9f0640 1 -- 172.21.15.66:0/1886689100 wait complete. 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.713+0000 7f24fa9f0640 1 Processor -- start 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 -- start start 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 0x7f24f40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f40ccba0 0x7f24f4154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f40ba810 0x7f24f40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40d3870 con 0x7f24dc0051c0 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40d36f0 con 0x7f24f40ccba0 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24fa9f0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24f40d39f0 con 0x7f24f40ba810 2024-05-10T11:12:45.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.714+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 0x7f24f40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 0x7f24f40b8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39708/0 (socket says 172.21.15.66:39708) 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 -- 172.21.15.66:0/3717947130 learned_addr learned my addr 172.21.15.66:0/3717947130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f8f8d640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f40ba810 0x7f24f40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f37fe640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f40ccba0 0x7f24f4154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 -- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f40ba810 msgr2=0x7f24f40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f40ba810 0x7f24f40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 -- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f40ccba0 msgr2=0x7f24f4154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f40ccba0 0x7f24f4154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 -- 172.21.15.66:0/3717947130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f40cd030 con 0x7f24dc0051c0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f3fff640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 0x7f24f40b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e4011c30 tx=0x7f24e400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4011ea0 con 0x7f24dc0051c0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e4014440 con 0x7f24dc0051c0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f4157c50 con 0x7f24dc0051c0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4014830 con 0x7f24dc0051c0 2024-05-10T11:12:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.715+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f40cd310 con 0x7f24dc0051c0 2024-05-10T11:12:45.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.716+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f406a220 con 0x7f24dc0051c0 2024-05-10T11:12:45.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.717+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f24e4012040 con 0x7f24dc0051c0 2024-05-10T11:12:45.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.717+0000 7f24f0ff9640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24e00762d0 0x7f24e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:45.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.717+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f24e4098240 con 0x7f24dc0051c0 2024-05-10T11:12:45.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.718+0000 7f24f37fe640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24e00762d0 0x7f24e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:45.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.718+0000 7f24f37fe640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24e00762d0 0x7f24e0078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24f40ce350 tx=0x7f24e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:45.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.722+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f24e4019030 con 0x7f24dc0051c0 2024-05-10T11:12:45.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.962+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f24f40d1650 con 0x7f24dc0051c0 2024-05-10T11:12:45.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.965+0000 7f24f0ff9640 1 -- 172.21.15.66:0/3717947130 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189525 (secure 0 0 0) 0x7f24e4061870 con 0x7f24dc0051c0 2024-05-10T11:12:45.968 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:45.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24e00762d0 msgr2=0x7f24e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24e00762d0 0x7f24e0078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24f40ce350 tx=0x7f24e8009040 comp rx=0 tx=0).stop 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 msgr2=0x7f24f40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 0x7f24f40b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e4011c30 tx=0x7f24e400f610 comp rx=0 tx=0).stop 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 shutdown_connections 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24e00762d0 0x7f24e0078790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24f40ba810 0x7f24f40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f40ccba0 0x7f24f4154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 --2- 172.21.15.66:0/3717947130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24dc0051c0 0x7f24f40b8af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 >> 172.21.15.66:0/3717947130 conn(0x7f24f40d5130 msgr2=0x7f24f40d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 shutdown_connections 2024-05-10T11:12:45.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:45.968+0000 7f24fa9f0640 1 -- 172.21.15.66:0/3717947130 wait complete. 2024-05-10T11:12:45.979 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":311085521},{"type":"v1","addr":"172.21.15.190:6833","nonce":311085521}]},"active_addr":"172.21.15.190:6833/311085521","active_change":"2024-05-10T11:12:11.671977+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1464255567}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3817729978}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1198444894}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3564184258}]}]} 2024-05-10T11:12:45.983 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T11:12:45.983 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T11:12:45.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:46.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.086+0000 7fe293afc640 1 Processor -- start 2024-05-10T11:12:46.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.086+0000 7fe293afc640 1 -- start start 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe293afc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe28c15f3b0 0x7fe28c0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe293afc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28c0d30b0 con 0x7fe28c15f790 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe293afc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28c0d3390 con 0x7fe28c0d5d30 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe293afc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe28c0c8c80 con 0x7fe28c15f3b0 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe291898640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe28c15f3b0 0x7fe28c0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe291097640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe28c15f790 0x7fe28c0c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40948/0 (socket says 172.21.15.66:40948) 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe291097640 1 -- 172.21.15.66:0/1117616905 learned_addr learned my addr 172.21.15.66:0/1117616905 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe291898640 1 -- 172.21.15.66:0/1117616905 >> v1:172.21.15.190:6789/0 conn(0x7fe28c0d5d30 legacy=0x7fe28c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe291898640 1 -- 172.21.15.66:0/1117616905 >> v1:172.21.15.66:6789/0 conn(0x7fe28c15f790 legacy=0x7fe28c0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe291898640 1 -- 172.21.15.66:0/1117616905 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c0c8f60 con 0x7fe28c15f3b0 2024-05-10T11:12:46.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.087+0000 7fe290896640 1 -- 172.21.15.66:0/1117616905 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192053930 0 0) 0x7fe28c0d30b0 con 0x7fe28c15f790 2024-05-10T11:12:46.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.088+0000 7fe291898640 1 --2- 172.21.15.66:0/1117616905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c15f3b0 0x7fe28c0d36f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2880097a0 tx=0x7fe28802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73051a9edc1acd30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.088+0000 7fe290896640 1 -- 172.21.15.66:0/1117616905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288037070 con 0x7fe28c15f3b0 2024-05-10T11:12:46.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.088+0000 7fe290896640 1 -- 172.21.15.66:0/1117616905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe288032440 con 0x7fe28c15f3b0 2024-05-10T11:12:46.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.088+0000 7fe290896640 1 -- 172.21.15.66:0/1117616905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288032810 con 0x7fe28c15f3b0 2024-05-10T11:12:46.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 -- 172.21.15.66:0/1117616905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c15f3b0 msgr2=0x7fe28c0d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 --2- 172.21.15.66:0/1117616905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c15f3b0 0x7fe28c0d36f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2880097a0 tx=0x7fe28802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 -- 172.21.15.66:0/1117616905 shutdown_connections 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 --2- 172.21.15.66:0/1117616905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c15f3b0 0x7fe28c0d36f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 -- 172.21.15.66:0/1117616905 >> 172.21.15.66:0/1117616905 conn(0x7fe28c0d5130 msgr2=0x7fe28c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 -- 172.21.15.66:0/1117616905 shutdown_connections 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.089+0000 7fe293afc640 1 -- 172.21.15.66:0/1117616905 wait complete. 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.090+0000 7fe293afc640 1 Processor -- start 2024-05-10T11:12:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.090+0000 7fe293afc640 1 -- start start 2024-05-10T11:12:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe28c0d5d30 0x7fe28c1623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe28c15f3b0 0x7fe28c14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 0x7fe28c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0d3db0 con 0x7fe28c1543a0 2024-05-10T11:12:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0d3c30 con 0x7fe28c0d5d30 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c0d3f30 con 0x7fe28c15f3b0 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 0x7fe28c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 0x7fe28c0cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39734/0 (socket says 172.21.15.66:39734) 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 -- 172.21.15.66:0/3849778784 learned_addr learned my addr 172.21.15.66:0/3849778784 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe291097640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe28c15f3b0 0x7fe28c14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe291898640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe28c0d5d30 0x7fe28c1623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 -- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe28c15f3b0 msgr2=0x7fe28c14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe28c15f3b0 0x7fe28c14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 -- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe28c0d5d30 msgr2=0x7fe28c1623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe28c0d5d30 0x7fe28c1623e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 -- 172.21.15.66:0/3849778784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c1629c0 con 0x7fe28c1543a0 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe292099640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 0x7fe28c0cda50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c780 tx=0x7fe28400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284004b60 con 0x7fe28c1543a0 2024-05-10T11:12:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe284004d00 con 0x7fe28c1543a0 2024-05-10T11:12:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.091+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c0ce7b0 con 0x7fe28c1543a0 2024-05-10T11:12:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.092+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28400aa30 con 0x7fe28c1543a0 2024-05-10T11:12:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.092+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c0ced30 con 0x7fe28c1543a0 2024-05-10T11:12:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.093+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c06a220 con 0x7fe28c1543a0 2024-05-10T11:12:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.093+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe28400abd0 con 0x7fe28c1543a0 2024-05-10T11:12:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.094+0000 7fe2827fc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2700762d0 0x7fe270078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.094+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe284097e20 con 0x7fe28c1543a0 2024-05-10T11:12:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.094+0000 7fe291898640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2700762d0 0x7fe270078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.094+0000 7fe291898640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2700762d0 0x7fe270078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe288034000 tx=0x7fe28802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.098+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe284061440 con 0x7fe28c1543a0 2024-05-10T11:12:46.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.291+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe28c0d1fa0 con 0x7fe28c1543a0 2024-05-10T11:12:46.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.292+0000 7fe2827fc640 1 -- 172.21.15.66:0/3849778784 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7fe284094870 con 0x7fe28c1543a0 2024-05-10T11:12:46.293 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:46.293 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2700762d0 msgr2=0x7fe270078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2700762d0 0x7fe270078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe288034000 tx=0x7fe28802e000 comp rx=0 tx=0).stop 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 msgr2=0x7fe28c0cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 0x7fe28c0cda50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c780 tx=0x7fe28400cc40 comp rx=0 tx=0).stop 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 shutdown_connections 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2700762d0 0x7fe270078790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe28c1543a0 0x7fe28c0cda50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe28c15f3b0 0x7fe28c14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 --2- 172.21.15.66:0/3849778784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe28c0d5d30 0x7fe28c1623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 >> 172.21.15.66:0/3849778784 conn(0x7fe28c0d5130 msgr2=0x7fe28c0cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 shutdown_connections 2024-05-10T11:12:46.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.294+0000 7fe293afc640 1 -- 172.21.15.66:0/3849778784 wait complete. 2024-05-10T11:12:46.306 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T11:12:46.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:46.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 Processor -- start 2024-05-10T11:12:46.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 -- start start 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe93015f3b0 0x7fe9300d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 0x7fe9300d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9300d30b0 con 0x7fe9300d5d30 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe9300d3390 con 0x7fe93015f3b0 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.409+0000 7fe937119640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe9300c8c80 con 0x7fe93015f790 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 0x7fe9300d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe934eb5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe93015f3b0 0x7fe9300d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 0x7fe9300d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53176/0 (socket says 172.21.15.66:53176) 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 -- 172.21.15.66:0/1283846004 learned_addr learned my addr 172.21.15.66:0/1283846004 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe9356b6640 1 --1- 172.21.15.66:0/1283846004 >> v1:172.21.15.190:6789/0 conn(0x7fe9300d5d30 0x7fe9300c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43190/0 (socket says 172.21.15.66:43190) 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92f7fe640 1 -- 172.21.15.66:0/1283846004 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890734577 0 0) 0x7fe9300d30b0 con 0x7fe9300d5d30 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92f7fe640 1 -- 172.21.15.66:0/1283846004 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe91c003520 con 0x7fe9300d5d30 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 -- 172.21.15.66:0/1283846004 >> v2:172.21.15.190:3300/0 conn(0x7fe93015f3b0 msgr2=0x7fe9300d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 --2- 172.21.15.66:0/1283846004 >> v2:172.21.15.190:3300/0 conn(0x7fe93015f3b0 0x7fe9300d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 -- 172.21.15.66:0/1283846004 >> v1:172.21.15.190:6789/0 conn(0x7fe9300d5d30 legacy=0x7fe9300c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe92ffff640 1 -- 172.21.15.66:0/1283846004 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9300c8f60 con 0x7fe93015f790 2024-05-10T11:12:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.410+0000 7fe934eb5640 1 --2- 172.21.15.66:0/1283846004 >> v2:172.21.15.190:3300/0 conn(0x7fe93015f3b0 0x7fe9300d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.411+0000 7fe92ffff640 1 --2- 172.21.15.66:0/1283846004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 0x7fe9300d3c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe920009870 tx=0x7fe92002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a712bc3ee1e4c35 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.411+0000 7fe92f7fe640 1 -- 172.21.15.66:0/1283846004 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920037070 con 0x7fe93015f790 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.411+0000 7fe92f7fe640 1 -- 172.21.15.66:0/1283846004 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe920032440 con 0x7fe93015f790 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.411+0000 7fe92f7fe640 1 -- 172.21.15.66:0/1283846004 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200327f0 con 0x7fe93015f790 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 -- 172.21.15.66:0/1283846004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 msgr2=0x7fe9300d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 --2- 172.21.15.66:0/1283846004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 0x7fe9300d3c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe920009870 tx=0x7fe92002a270 comp rx=0 tx=0).stop 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 -- 172.21.15.66:0/1283846004 shutdown_connections 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 --2- 172.21.15.66:0/1283846004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe93015f790 0x7fe9300d3c30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 --2- 172.21.15.66:0/1283846004 >> v2:172.21.15.190:3300/0 conn(0x7fe93015f3b0 0x7fe9300d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 -- 172.21.15.66:0/1283846004 >> 172.21.15.66:0/1283846004 conn(0x7fe9300d5130 msgr2=0x7fe9300d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 -- 172.21.15.66:0/1283846004 shutdown_connections 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.412+0000 7fe937119640 1 -- 172.21.15.66:0/1283846004 wait complete. 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.413+0000 7fe937119640 1 Processor -- start 2024-05-10T11:12:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.413+0000 7fe937119640 1 -- start start 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe937119640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9300d5d30 0x7fe930154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe937119640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 0x7fe9300cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe937119640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9301f4c30 0x7fe9300cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe937119640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe9300d0e60 con 0x7fe93015f3b0 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe937119640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe9300d0ce0 con 0x7fe9300d5d30 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe937119640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe9300d0fe0 con 0x7fe9301f4c30 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 0x7fe9300cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 0x7fe9300cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39746/0 (socket says 172.21.15.66:39746) 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 -- 172.21.15.66:0/4129077218 learned_addr learned my addr 172.21.15.66:0/4129077218 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe934eb5640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9300d5d30 0x7fe930154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe9356b6640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9301f4c30 0x7fe9300cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 -- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9301f4c30 msgr2=0x7fe9300cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9301f4c30 0x7fe9300cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 -- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9300d5d30 msgr2=0x7fe930154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9300d5d30 0x7fe930154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe92ffff640 1 -- 172.21.15.66:0/4129077218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9300cc740 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.414+0000 7fe9356b6640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9301f4c30 0x7fe9300cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.415+0000 7fe92ffff640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 0x7fe9300cc200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe920009870 tx=0x7fe9200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.415+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920037040 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.415+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe920004230 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.415+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9301f5180 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.415+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920003610 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.415+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9301f5740 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.416+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93006a220 con 0x7fe93015f3b0 2024-05-10T11:12:46.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.416+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe9200037b0 con 0x7fe93015f3b0 2024-05-10T11:12:46.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.417+0000 7fe92d7fa640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe9100762d0 0x7fe910078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.417+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe9200b84a0 con 0x7fe93015f3b0 2024-05-10T11:12:46.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.417+0000 7fe934eb5640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe9100762d0 0x7fe910078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.418+0000 7fe934eb5640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe9100762d0 0x7fe910078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe930161950 tx=0x7fe918009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.421+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe920081ac0 con 0x7fe93015f3b0 2024-05-10T11:12:46.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.614+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe930075ea0 con 0x7fe93015f3b0 2024-05-10T11:12:46.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.615+0000 7fe92d7fa640 1 -- 172.21.15.66:0/4129077218 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7fe9200813c0 con 0x7fe93015f3b0 2024-05-10T11:12:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:46.616 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:46.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.617+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe9100762d0 msgr2=0x7fe910078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.617+0000 7fe937119640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe9100762d0 0x7fe910078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe930161950 tx=0x7fe918009190 comp rx=0 tx=0).stop 2024-05-10T11:12:46.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.617+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 msgr2=0x7fe9300cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.617+0000 7fe937119640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 0x7fe9300cc200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe920009870 tx=0x7fe9200046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 shutdown_connections 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe9100762d0 0x7fe910078790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9301f4c30 0x7fe9300cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe93015f3b0 0x7fe9300cc200 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 --2- 172.21.15.66:0/4129077218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9300d5d30 0x7fe930154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 >> 172.21.15.66:0/4129077218 conn(0x7fe9300d5130 msgr2=0x7fe93015e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 shutdown_connections 2024-05-10T11:12:46.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.618+0000 7fe937119640 1 -- 172.21.15.66:0/4129077218 wait complete. 2024-05-10T11:12:46.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T11:12:46.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T11:12:46.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T11:12:46.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T11:12:46.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T11:12:46.632 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T11:12:46.632 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T11:12:46.632 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T11:12:46.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.810+0000 7fdf06893640 1 Processor -- start 2024-05-10T11:12:46.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.810+0000 7fdf06893640 1 -- start start 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf06893640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdf00162980 0x7fdf000cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf06893640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdf0006e000 0x7fdf000b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf06893640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf00162d60 con 0x7fdf000b4030 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf06893640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fdf000d35d0 con 0x7fdf0006e000 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf06893640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0006e550 con 0x7fdf00162980 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf04e30640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fdf000b4030 0x7fdf000b1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40952/0 (socket says 172.21.15.66:40952) 2024-05-10T11:12:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.811+0000 7fdf04e30640 1 -- 172.21.15.66:0/3227865210 learned_addr learned my addr 172.21.15.66:0/3227865210 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7faeb89c8640 1 Processor -- start 2024-05-10T11:12:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7fdeff7fe640 1 --2- 172.21.15.66:0/3227865210 >> v2:172.21.15.66:3300/0 conn(0x7fdf0006e000 0x7fdf000b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7fdefffff640 1 --2- 172.21.15.66:0/3227865210 >> v2:172.21.15.190:3300/0 conn(0x7fdf00162980 0x7fdf000cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7faeb89c8640 1 -- start start 2024-05-10T11:12:46.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7fdefeffd640 1 -- 172.21.15.66:0/3227865210 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651548798 0 0) 0x7fdf00162d60 con 0x7fdf000b4030 2024-05-10T11:12:46.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7fdefeffd640 1 -- 172.21.15.66:0/3227865210 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee8003520 con 0x7fdf000b4030 2024-05-10T11:12:46.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.813+0000 7fdeff7fe640 1 -- 172.21.15.66:0/3227865210 >> v2:172.21.15.190:3300/0 conn(0x7fdf00162980 msgr2=0x7fdf000cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.813+0000 7fdeff7fe640 1 --2- 172.21.15.66:0/3227865210 >> v2:172.21.15.190:3300/0 conn(0x7fdf00162980 0x7fdf000cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.813+0000 7fdeff7fe640 1 -- 172.21.15.66:0/3227865210 >> v1:172.21.15.66:6789/0 conn(0x7fdf000b4030 legacy=0x7fdf000b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.813+0000 7fc4ba0ec640 1 Processor -- start 2024-05-10T11:12:46.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.812+0000 7f6544b9d640 1 Processor -- start 2024-05-10T11:12:46.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.813+0000 7f6544b9d640 1 -- start start 2024-05-10T11:12:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.813+0000 7fdeff7fe640 1 -- 172.21.15.66:0/3227865210 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf000d3820 con 0x7fdf0006e000 2024-05-10T11:12:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7fc4ba0ec640 1 -- start start 2024-05-10T11:12:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb89c8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faeb4162a20 0x7faeb40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb89c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb40cbd90 0x7faeb40cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7f6e0a666640 1 Processor -- start 2024-05-10T11:12:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7f24c7c33640 1 Processor -- start 2024-05-10T11:12:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb89c8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb40cf0c0 con 0x7faeb40af790 2024-05-10T11:12:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb89c8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7faeb40cf360 con 0x7faeb4162a20 2024-05-10T11:12:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faeb4162a20 0x7faeb40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7f24c7c33640 1 -- start start 2024-05-10T11:12:46.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7f6e0a666640 1 -- start start 2024-05-10T11:12:46.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7f6544b9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65400c5150 0x7f6540164c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb89c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faeb40cf640 con 0x7faeb40cbd90 2024-05-10T11:12:46.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb1d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7faeb40af790 0x7faeb40cb680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40954/0 (socket says 172.21.15.66:40954) 2024-05-10T11:12:46.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7fdeff7fe640 1 --2- 172.21.15.66:0/3227865210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf000b3af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf0006f400 tx=0x7fdef802a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e22de278def6d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7f6544b9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f654006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb1d9b640 1 -- 172.21.15.66:0/2676683244 learned_addr learned my addr 172.21.15.66:0/2676683244 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faeb4162a20 0x7faeb40720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43660/0 (socket says 172.21.15.66:43660) 2024-05-10T11:12:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.814+0000 7faeb2d9d640 1 --2- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb40cbd90 0x7faeb40cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f6544b9d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65400cce30 con 0x7f65400c5530 2024-05-10T11:12:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7faeb259c640 1 -- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb40cbd90 msgr2=0x7faeb40cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7faeb259c640 1 --2- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb40cbd90 0x7faeb40cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7faeb259c640 1 -- 172.21.15.66:0/2676683244 >> v1:172.21.15.66:6789/0 conn(0x7faeb40af790 legacy=0x7faeb40cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7faeb259c640 1 -- 172.21.15.66:0/2676683244 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb40cf920 con 0x7faeb4162a20 2024-05-10T11:12:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7fdefeffd640 1 -- 172.21.15.66:0/3227865210 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8035020 con 0x7fdf0006e000 2024-05-10T11:12:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f6544b9d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f65400cfed0 con 0x7f65400c5150 2024-05-10T11:12:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f6544b9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f65400cd110 con 0x7f6540165320 2024-05-10T11:12:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f653ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f654006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7fdefeffd640 1 -- 172.21.15.66:0/3227865210 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef8007540 con 0x7fdf0006e000 2024-05-10T11:12:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7fdefeffd640 1 -- 172.21.15.66:0/3227865210 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0001670 con 0x7fdf0006e000 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f653ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f654006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53186/0 (socket says 172.21.15.66:53186) 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f653ed9d640 1 -- 172.21.15.66:0/412824054 learned_addr learned my addr 172.21.15.66:0/412824054 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.815+0000 7f653e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65400c5150 0x7f6540164c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f653ed9d640 1 -- 172.21.15.66:0/412824054 >> v2:172.21.15.190:3300/0 conn(0x7f65400c5150 msgr2=0x7f6540164c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f653ed9d640 1 --2- 172.21.15.66:0/412824054 >> v2:172.21.15.190:3300/0 conn(0x7f65400c5150 0x7f6540164c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f653ed9d640 1 -- 172.21.15.66:0/412824054 >> v1:172.21.15.190:6789/0 conn(0x7f65400c5530 legacy=0x7f65400cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f653ed9d640 1 -- 172.21.15.66:0/412824054 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65400cfb60 con 0x7f6540165320 2024-05-10T11:12:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7faeb259c640 1 --2- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb4162a20 0x7faeb40720f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faea80097d0 tx=0x7faea802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7bdbe2c152d3c90 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 -- 172.21.15.66:0/3227865210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 msgr2=0x7fdf000b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 --2- 172.21.15.66:0/3227865210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf000b3af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf0006f400 tx=0x7fdef802a4d0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f24c7c33640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f24c01558d0 0x7f24c013eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7faeb159a640 1 -- 172.21.15.66:0/2676683244 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8037070 con 0x7faeb4162a20 2024-05-10T11:12:46.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7faeb159a640 1 -- 172.21.15.66:0/2676683244 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea8032440 con 0x7faeb4162a20 2024-05-10T11:12:46.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7faeb159a640 1 -- 172.21.15.66:0/2676683244 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8032810 con 0x7faeb4162a20 2024-05-10T11:12:46.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f6e0a666640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0df420 0x7f6dfc053260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f24c7c33640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24c00cb2e0 0x7f24c00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 -- 172.21.15.66:0/3227865210 shutdown_connections 2024-05-10T11:12:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 --2- 172.21.15.66:0/3227865210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf000b3af0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 --2- 172.21.15.66:0/3227865210 >> v2:172.21.15.190:3300/0 conn(0x7fdf00162980 0x7fdf000cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 -- 172.21.15.66:0/3227865210 >> 172.21.15.66:0/3227865210 conn(0x7fdf000d4ff0 msgr2=0x7fdf000d5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f24c59cf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f24c01558d0 0x7f24c013eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 -- 172.21.15.66:0/3227865210 shutdown_connections 2024-05-10T11:12:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f6e09664640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6dfc04fa90 0x7f6dfc04fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40970/0 (socket says 172.21.15.66:40970) 2024-05-10T11:12:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f6e09664640 1 -- 172.21.15.66:0/2095853318 learned_addr learned my addr 172.21.15.66:0/2095853318 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f24c51ce640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24c00cb2e0 0x7f24c00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f24c51ce640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24c00cb2e0 0x7f24c00cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43680/0 (socket says 172.21.15.66:43680) 2024-05-10T11:12:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f24c59cf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f24c01558d0 0x7f24c013eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39762/0 (socket says 172.21.15.66:39762) 2024-05-10T11:12:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f6e0a666640 1 --2- 172.21.15.66:0/2095853318 >> v2:172.21.15.66:3300/0 conn(0x7f6dfc0392d0 0x7f6dfc0537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7f44dec75640 1 Processor -- start 2024-05-10T11:12:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.816+0000 7fdf06893640 1 -- 172.21.15.66:0/3227865210 wait complete. 2024-05-10T11:12:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f44dec75640 1 -- start start 2024-05-10T11:12:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6e09e65640 1 --2- 172.21.15.66:0/2095853318 >> v2:172.21.15.66:3300/0 conn(0x7f6dfc0392d0 0x7f6dfc0537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6e08e63640 1 --2- 172.21.15.66:0/2095853318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0df420 0x7f6dfc053260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c61d0640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f24c0140bd0 0x7f24c0140fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40978/0 (socket says 172.21.15.66:40978) 2024-05-10T11:12:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c7c33640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24c0141940 con 0x7f24c0140bd0 2024-05-10T11:12:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c7c33640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f24c00cbc90 con 0x7f24c01558d0 2024-05-10T11:12:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c7c33640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f24c01416f0 con 0x7f24c00cb2e0 2024-05-10T11:12:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc006af0 con 0x7f6dfc04fa90 2024-05-10T11:12:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f6dfc0068a0 con 0x7f6dfc0392d0 2024-05-10T11:12:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc006dd0 con 0x7f6dfc0df420 2024-05-10T11:12:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c51ce640 1 -- 172.21.15.66:0/1593140161 learned_addr learned my addr 172.21.15.66:0/1593140161 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7faeb89c8640 1 -- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb4162a20 msgr2=0x7faeb40720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f653ed9d640 1 --2- 172.21.15.66:0/412824054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f654006c2c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6538009e50 tx=0x7f653802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a0942f1844389 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7faeb89c8640 1 --2- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb4162a20 0x7faeb40720f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faea80097d0 tx=0x7faea802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7fc4ba0ec640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc4b40c8f80 0x7fc4b40cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6dfbfff640 1 -- 172.21.15.66:0/2095853318 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469417081 0 0) 0x7f6dfc006af0 con 0x7f6dfc04fa90 2024-05-10T11:12:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f6dfbfff640 1 -- 172.21.15.66:0/2095853318 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df0003520 con 0x7f6dfc04fa90 2024-05-10T11:12:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f653d59a640 1 -- 172.21.15.66:0/412824054 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538036070 con 0x7f6540165320 2024-05-10T11:12:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f653d59a640 1 -- 172.21.15.66:0/412824054 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538031600 con 0x7f6540165320 2024-05-10T11:12:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7fc4ba0ec640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40ce9e0 0x7fc4b40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f653d59a640 1 -- 172.21.15.66:0/412824054 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65380319d0 con 0x7f6540165320 2024-05-10T11:12:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4b90ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc4b40c8f80 0x7fc4b40cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fbce5e23640 1 Processor -- start 2024-05-10T11:12:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f6e08e63640 1 -- 172.21.15.66:0/2095853318 >> v2:172.21.15.66:3300/0 conn(0x7f6dfc0392d0 msgr2=0x7f6dfc0537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f6e08e63640 1 --2- 172.21.15.66:0/2095853318 >> v2:172.21.15.66:3300/0 conn(0x7f6dfc0392d0 0x7f6dfc0537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f6e08e63640 1 -- 172.21.15.66:0/2095853318 >> v1:172.21.15.66:6789/0 conn(0x7f6dfc04fa90 legacy=0x7f6dfc04fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f6dfbfff640 1 -- 172.21.15.66:0/2095853318 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1013287728 0 0) 0x7f6df0003520 con 0x7f6dfc04fa90 2024-05-10T11:12:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4b90ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc4b40c8f80 0x7fc4b40cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43696/0 (socket says 172.21.15.66:43696) 2024-05-10T11:12:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f6e08e63640 1 -- 172.21.15.66:0/2095853318 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc0070b0 con 0x7f6dfc0df420 2024-05-10T11:12:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4b90ea640 1 -- 172.21.15.66:0/1758647782 learned_addr learned my addr 172.21.15.66:0/1758647782 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b40b39e0 con 0x7fc4b40c9360 2024-05-10T11:12:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b40d3950 con 0x7fc4b40c8f80 2024-05-10T11:12:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b40ce4c0 con 0x7fc4b40ce9e0 2024-05-10T11:12:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fbce5e23640 1 -- start start 2024-05-10T11:12:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f44dec75640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d8163690 0x7f44d80b9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f44dec75640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f44d80b9a00 0x7f44d809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f44dec75640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44d80b6ac0 0x7f44d80b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fdf06893640 1 Processor -- start 2024-05-10T11:12:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fdf06893640 1 -- start start 2024-05-10T11:12:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c51ce640 1 -- 172.21.15.66:0/1593140161 >> v2:172.21.15.66:3300/0 conn(0x7f24c01558d0 msgr2=0x7f24c013eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c51ce640 1 --2- 172.21.15.66:0/1593140161 >> v2:172.21.15.66:3300/0 conn(0x7f24c01558d0 0x7f24c013eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c51ce640 1 -- 172.21.15.66:0/1593140161 >> v1:172.21.15.66:6789/0 conn(0x7f24c0140bd0 legacy=0x7f24c0140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.817+0000 7f24c51ce640 1 -- 172.21.15.66:0/1593140161 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c00ceb90 con 0x7f24c00cb2e0 2024-05-10T11:12:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7fc4b88e9640 1 --2- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40ce9e0 0x7fc4b40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7faeb89c8640 1 -- 172.21.15.66:0/2676683244 shutdown_connections 2024-05-10T11:12:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7faeb89c8640 1 --2- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb40cbd90 0x7faeb40cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7faeb89c8640 1 --2- 172.21.15.66:0/2676683244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb4162a20 0x7faeb40720f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7faeb89c8640 1 -- 172.21.15.66:0/2676683244 >> 172.21.15.66:0/2676683244 conn(0x7faeb40d0c90 msgr2=0x7faeb40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.818+0000 7f44d7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f44d80b9a00 0x7f44d809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f44d80b9a00 0x7f44d809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39778/0 (socket says 172.21.15.66:39778) 2024-05-10T11:12:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fc4b90ea640 1 -- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40ce9e0 msgr2=0x7fc4b40cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fc4b90ea640 1 --2- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40ce9e0 0x7fc4b40cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fc4b90ea640 1 -- 172.21.15.66:0/1758647782 >> v1:172.21.15.190:6789/0 conn(0x7fc4b40c9360 legacy=0x7fc4b40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fc4b90ea640 1 -- 172.21.15.66:0/1758647782 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b40d0450 con 0x7fc4b40c8f80 2024-05-10T11:12:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44dec75640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f44d809e900 con 0x7f44d80b9a00 2024-05-10T11:12:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44dec75640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f44d80b8bf0 con 0x7f44d80b6ac0 2024-05-10T11:12:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44dec75640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f44d80b8020 con 0x7f44d8163690 2024-05-10T11:12:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 -- 172.21.15.66:0/1987159769 learned_addr learned my addr 172.21.15.66:0/1987159769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44dca11640 1 --2- 172.21.15.66:0/1987159769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d8163690 0x7f44d80b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7faeb89c8640 1 -- 172.21.15.66:0/2676683244 shutdown_connections 2024-05-10T11:12:46.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f6e08e63640 1 --2- 172.21.15.66:0/2095853318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0df420 0x7f6dfc053260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6df40097a0 tx=0x7f6df402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=100ed598bb9719b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f24c51ce640 1 --2- 172.21.15.66:0/1593140161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c00cb2e0 0x7f24c00cb750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24c0071ea0 tx=0x7f24bc02a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bcfeab48f35ec82 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 -- 172.21.15.66:0/1987159769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d8163690 msgr2=0x7f44d80b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 --2- 172.21.15.66:0/1987159769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d8163690 0x7f44d80b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44dd212640 1 --2- 172.21.15.66:0/1987159769 >> v2:172.21.15.190:3300/0 conn(0x7f44d80b6ac0 0x7f44d80b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 -- 172.21.15.66:0/1987159769 >> v2:172.21.15.190:3300/0 conn(0x7f44d80b6ac0 msgr2=0x7f44d80b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 --2- 172.21.15.66:0/1987159769 >> v2:172.21.15.190:3300/0 conn(0x7f44d80b6ac0 0x7f44d80b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5e23640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd80e7750 0x7fbcd80381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5e23640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbcd804fe00 0x7fbcd8054800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5e23640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd80386e0 con 0x7fbcd804f9a0 2024-05-10T11:12:46.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5e23640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd8050290 con 0x7fbcd804fe00 2024-05-10T11:12:46.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5e23640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd8051bb0 con 0x7fbcd80e7750 2024-05-10T11:12:46.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f6544b9d640 1 -- 172.21.15.66:0/412824054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 msgr2=0x7f654006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f24c49cd640 1 -- 172.21.15.66:0/1593140161 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc037070 con 0x7f24c00cb2e0 2024-05-10T11:12:46.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f24c49cd640 1 -- 172.21.15.66:0/1593140161 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc032440 con 0x7f24c00cb2e0 2024-05-10T11:12:46.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f6544b9d640 1 --2- 172.21.15.66:0/412824054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f654006c2c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6538009e50 tx=0x7f653802a710 comp rx=0 tx=0).stop 2024-05-10T11:12:46.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5622640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbcd804fe00 0x7fbcd8054800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5622640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbcd804fe00 0x7fbcd8054800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43718/0 (socket says 172.21.15.66:43718) 2024-05-10T11:12:46.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7fbce5622640 1 -- 172.21.15.66:0/434583671 learned_addr learned my addr 172.21.15.66:0/434583671 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f24c49cd640 1 -- 172.21.15.66:0/1593140161 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc032810 con 0x7f24c00cb2e0 2024-05-10T11:12:46.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fbce4e21640 1 --2- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd80e7750 0x7fbcd80381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7faeb89c8640 1 -- 172.21.15.66:0/2676683244 wait complete. 2024-05-10T11:12:46.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7f6544b9d640 1 -- 172.21.15.66:0/412824054 shutdown_connections 2024-05-10T11:12:46.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7f6544b9d640 1 --2- 172.21.15.66:0/412824054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f654006c2c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7f6544b9d640 1 --2- 172.21.15.66:0/412824054 >> v2:172.21.15.190:3300/0 conn(0x7f65400c5150 0x7f6540164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7f6544b9d640 1 -- 172.21.15.66:0/412824054 >> 172.21.15.66:0/412824054 conn(0x7f65400d1df0 msgr2=0x7f65400d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf06893640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf0015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fbce5622640 1 -- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd80e7750 msgr2=0x7fbcd80381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fbce5622640 1 --2- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd80e7750 0x7fbcd80381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fbce5622640 1 -- 172.21.15.66:0/434583671 >> v1:172.21.15.190:6789/0 conn(0x7fbcd804f9a0 legacy=0x7fbcd80540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:46.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf06893640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b4030 0x7fdf000cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fbce5622640 1 -- 172.21.15.66:0/434583671 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd8053050 con 0x7fbcd804fe00 2024-05-10T11:12:46.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf06893640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00162980 0x7fdf000b9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7f6544b9d640 1 -- 172.21.15.66:0/412824054 shutdown_connections 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7f6544b9d640 1 -- 172.21.15.66:0/412824054 wait complete. 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf06893640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0006dce0 con 0x7fdf0006e000 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf06893640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000d3de0 con 0x7fdf000b4030 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf06893640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0006de60 con 0x7fdf00162980 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdefffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf0015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdeff7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b4030 0x7fdf000cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdefffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf0015b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39792/0 (socket says 172.21.15.66:39792) 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdefffff640 1 -- 172.21.15.66:0/3109847026 learned_addr learned my addr 172.21.15.66:0/3109847026 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fdf04e30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00162980 0x7fdf000b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.819+0000 7f44d7fff640 1 -- 172.21.15.66:0/1987159769 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d80b95c0 con 0x7f44d80b9a00 2024-05-10T11:12:46.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 -- 172.21.15.66:0/1593140161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c00cb2e0 msgr2=0x7f24c00cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 --2- 172.21.15.66:0/1593140161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c00cb2e0 0x7f24c00cb750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24c0071ea0 tx=0x7f24bc02a280 comp rx=0 tx=0).stop 2024-05-10T11:12:46.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdeff7fe640 1 -- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00162980 msgr2=0x7fdf000b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdeff7fe640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00162980 0x7fdf000b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdeff7fe640 1 -- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 msgr2=0x7fdf0015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdeff7fe640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf0015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdeff7fe640 1 -- 172.21.15.66:0/3109847026 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf001f89e0 con 0x7fdf000b4030 2024-05-10T11:12:46.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fbce5622640 1 --2- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804fe00 0x7fbcd8054800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbce006ab70 tx=0x7fbce006a170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf9a0c9456fb05dd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f6dfbfff640 1 -- 172.21.15.66:0/2095853318 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4037070 con 0x7f6dfc0df420 2024-05-10T11:12:46.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f6dfbfff640 1 -- 172.21.15.66:0/2095853318 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df402aba0 con 0x7f6dfc0df420 2024-05-10T11:12:46.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f6dfbfff640 1 -- 172.21.15.66:0/2095853318 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4037070 con 0x7f6dfc0df420 2024-05-10T11:12:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 -- 172.21.15.66:0/1593140161 shutdown_connections 2024-05-10T11:12:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 --2- 172.21.15.66:0/1593140161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c00cb2e0 0x7f24c00cb750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 --2- 172.21.15.66:0/1593140161 >> v2:172.21.15.66:3300/0 conn(0x7f24c01558d0 0x7f24c013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 -- 172.21.15.66:0/1593140161 >> 172.21.15.66:0/1593140161 conn(0x7f24c00d0c90 msgr2=0x7f24c00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdefffff640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf0006e000 0x7fdf0015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdeff7fe640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b4030 0x7fdf000cee80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdef8031000 tx=0x7fdef8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f44d7fff640 1 --2- 172.21.15.66:0/1987159769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d80b9a00 0x7f44d809e000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f44d80b77a0 tx=0x7f44c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b43f13e861911f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fbcdf7fe640 1 -- 172.21.15.66:0/434583671 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b2070 con 0x7fbcd804fe00 2024-05-10T11:12:46.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fbcdf7fe640 1 -- 172.21.15.66:0/434583671 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce00ab7d0 con 0x7fbcd804fe00 2024-05-10T11:12:46.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fbcdf7fe640 1 -- 172.21.15.66:0/434583671 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00abc40 con 0x7fbcd804fe00 2024-05-10T11:12:46.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 -- 172.21.15.66:0/1593140161 shutdown_connections 2024-05-10T11:12:46.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f24c7c33640 1 -- 172.21.15.66:0/1593140161 wait complete. 2024-05-10T11:12:46.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f44d77fe640 1 -- 172.21.15.66:0/1987159769 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4037070 con 0x7f44d80b9a00 2024-05-10T11:12:46.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f44d77fe640 1 -- 172.21.15.66:0/1987159769 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4032440 con 0x7f44d80b9a00 2024-05-10T11:12:46.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7f44d77fe640 1 -- 172.21.15.66:0/1987159769 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4032810 con 0x7f44d80b9a00 2024-05-10T11:12:46.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7faeb89c8640 1 Processor -- start 2024-05-10T11:12:46.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef803f070 con 0x7fdf000b4030 2024-05-10T11:12:46.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.820+0000 7fc4b90ea640 1 --2- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b40cf350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009870 tx=0x7fc4b002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72df56ca7dfa741c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef8003b90 con 0x7fdf000b4030 2024-05-10T11:12:46.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fc4abfff640 1 -- 172.21.15.66:0/1758647782 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0037070 con 0x7fc4b40c8f80 2024-05-10T11:12:46.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fc4abfff640 1 -- 172.21.15.66:0/1758647782 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0032440 con 0x7fc4b40c8f80 2024-05-10T11:12:46.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.821+0000 7fc4abfff640 1 -- 172.21.15.66:0/1758647782 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0032850 con 0x7fc4b40c8f80 2024-05-10T11:12:46.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 msgr2=0x7fc4b40cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 --2- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b40cf350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009870 tx=0x7fc4b002a230 comp rx=0 tx=0).stop 2024-05-10T11:12:46.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 shutdown_connections 2024-05-10T11:12:46.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 --2- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40ce9e0 0x7fc4b40cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0df420 msgr2=0x7f6dfc053260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 --2- 172.21.15.66:0/2095853318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0df420 0x7f6dfc053260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6df40097a0 tx=0x7f6df402a110 comp rx=0 tx=0).stop 2024-05-10T11:12:46.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 --2- 172.21.15.66:0/1758647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b40cf350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 >> 172.21.15.66:0/1758647782 conn(0x7fc4b40d2c20 msgr2=0x7fc4b40d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 shutdown_connections 2024-05-10T11:12:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 --2- 172.21.15.66:0/2095853318 >> v2:172.21.15.66:3300/0 conn(0x7f6dfc0392d0 0x7f6dfc0537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 --2- 172.21.15.66:0/2095853318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0df420 0x7f6dfc053260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 >> 172.21.15.66:0/2095853318 conn(0x7f6dfc009fb0 msgr2=0x7f6dfc00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 shutdown_connections 2024-05-10T11:12:46.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fbce5e23640 1 -- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804fe00 msgr2=0x7fbcd8054800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fbce5e23640 1 --2- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804fe00 0x7fbcd8054800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbce006ab70 tx=0x7fbce006a170 comp rx=0 tx=0).stop 2024-05-10T11:12:46.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 shutdown_connections 2024-05-10T11:12:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f44dec75640 1 -- 172.21.15.66:0/1987159769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d80b9a00 msgr2=0x7f44d809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f44dec75640 1 --2- 172.21.15.66:0/1987159769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d80b9a00 0x7f44d809e000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f44d80b77a0 tx=0x7f44c402a1e0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7f6e0a666640 1 -- 172.21.15.66:0/2095853318 wait complete. 2024-05-10T11:12:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fbce5e23640 1 -- 172.21.15.66:0/434583671 shutdown_connections 2024-05-10T11:12:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fbce5e23640 1 --2- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804fe00 0x7fbcd8054800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fbce5e23640 1 --2- 172.21.15.66:0/434583671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd80e7750 0x7fbcd80381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fbce5e23640 1 -- 172.21.15.66:0/434583671 >> 172.21.15.66:0/434583671 conn(0x7fbcd8055350 msgr2=0x7fbcd8055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8035070 con 0x7fdf000b4030 2024-05-10T11:12:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf001f8c80 con 0x7fdf000b4030 2024-05-10T11:12:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.822+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/1758647782 wait complete. 2024-05-10T11:12:46.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f6544b9d640 1 Processor -- start 2024-05-10T11:12:46.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7faeb89c8640 1 -- start start 2024-05-10T11:12:46.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf001f9240 con 0x7fdf000b4030 2024-05-10T11:12:46.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f6544b9d640 1 -- start start 2024-05-10T11:12:46.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f44dec75640 1 -- 172.21.15.66:0/1987159769 shutdown_connections 2024-05-10T11:12:46.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f44dec75640 1 --2- 172.21.15.66:0/1987159769 >> v2:172.21.15.190:3300/0 conn(0x7f44d80b6ac0 0x7f44d80b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f44dec75640 1 --2- 172.21.15.66:0/1987159769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d80b9a00 0x7f44d809e000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f44dec75640 1 --2- 172.21.15.66:0/1987159769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d8163690 0x7f44d80b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7f44dec75640 1 -- 172.21.15.66:0/1987159769 >> 172.21.15.66:0/1987159769 conn(0x7f44d80d1ac0 msgr2=0x7f44d80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7fbce5e23640 1 -- 172.21.15.66:0/434583671 shutdown_connections 2024-05-10T11:12:46.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7f24c7c33640 1 Processor -- start 2024-05-10T11:12:46.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7f24c7c33640 1 -- start start 2024-05-10T11:12:46.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.823+0000 7fbce5e23640 1 -- 172.21.15.66:0/434583671 wait complete. 2024-05-10T11:12:46.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf0006a220 con 0x7fdf000b4030 2024-05-10T11:12:46.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7fc4ba0ec640 1 Processor -- start 2024-05-10T11:12:46.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7faeb89c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb40af790 0x7faeb40b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7f6e0a666640 1 Processor -- start 2024-05-10T11:12:46.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7faeb89c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb40cbd90 0x7faeb40c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7f6e0a666640 1 -- start start 2024-05-10T11:12:46.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7faeb89c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb4162a20 0x7faeb40c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.824+0000 7f6544b9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65400c5150 0x7f65400b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f6544b9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f65400b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb1d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb40cbd90 0x7faeb40c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f653e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65400c5150 0x7f65400b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f653e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65400c5150 0x7f65400b6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43748/0 (socket says 172.21.15.66:43748) 2024-05-10T11:12:46.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb1d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb40cbd90 0x7faeb40c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43736/0 (socket says 172.21.15.66:43736) 2024-05-10T11:12:46.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb1d9b640 1 -- 172.21.15.66:0/734041516 learned_addr learned my addr 172.21.15.66:0/734041516 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb2d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb4162a20 0x7faeb40c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb259c640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb40af790 0x7faeb40b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40727b0 con 0x7faeb40af790 2024-05-10T11:12:46.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f653dd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f65400b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f653dd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f65400b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53266/0 (socket says 172.21.15.66:53266) 2024-05-10T11:12:46.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7fbce5e23640 1 Processor -- start 2024-05-10T11:12:46.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4072630 con 0x7faeb40cbd90 2024-05-10T11:12:46.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faeb40ae9c0 con 0x7faeb4162a20 2024-05-10T11:12:46.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f24c7c33640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24c00cb2e0 0x7f24c00732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7fbce5e23640 1 -- start start 2024-05-10T11:12:46.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f653dd9b640 1 -- 172.21.15.66:0/3290120831 learned_addr learned my addr 172.21.15.66:0/3290120831 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f6544b9d640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65400c86e0 0x7f6540157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f24c59cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24c00cb2e0 0x7f24c00732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f24c59cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24c00cb2e0 0x7f24c00732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39812/0 (socket says 172.21.15.66:39812) 2024-05-10T11:12:46.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f24c59cf640 1 -- 172.21.15.66:0/2979496441 learned_addr learned my addr 172.21.15.66:0/2979496441 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c7c33640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c0140bd0 0x7f24c00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdef8042070 con 0x7fdf000b4030 2024-05-10T11:12:46.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e0a666640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0392d0 0x7f6dfc0453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c7c33640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24c01558d0 0x7f24c015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7fc4ba0ec640 1 -- start start 2024-05-10T11:12:46.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e0a666640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dfc04fa90 0x7f6dfc0d4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e0a666640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dfc0df420 0x7f6dfc0d4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c7c33640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24c00cf430 con 0x7f24c00cb2e0 2024-05-10T11:12:46.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c51ce640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c0140bd0 0x7f24c00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c7c33640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24c00cf150 con 0x7f24c0140bd0 2024-05-10T11:12:46.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c7c33640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24c013efe0 con 0x7f24c01558d0 2024-05-10T11:12:46.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e0a666640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc052cc0 con 0x7f6dfc0df420 2024-05-10T11:12:46.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e0a666640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc052b40 con 0x7f6dfc04fa90 2024-05-10T11:12:46.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e0a666640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc00aaa0 con 0x7f6dfc0392d0 2024-05-10T11:12:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f44dec75640 1 -- 172.21.15.66:0/1987159769 shutdown_connections 2024-05-10T11:12:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.825+0000 7f44dec75640 1 -- 172.21.15.66:0/1987159769 wait complete. 2024-05-10T11:12:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7faeb259c640 1 -- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb4162a20 msgr2=0x7faeb40c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7faeb259c640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeb4162a20 0x7faeb40c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7faeb259c640 1 -- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb40cbd90 msgr2=0x7faeb40c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7faeb259c640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeb40cbd90 0x7faeb40c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7faeb259c640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb40b6760 con 0x7faeb40af790 2024-05-10T11:12:46.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e09664640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0392d0 0x7f6dfc0453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7fdefcff9640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdeec0763d0 0x7fdeec078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e09e65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dfc0df420 0x7f6dfc0d4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7fc4ba0ec640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e09e65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dfc0df420 0x7f6dfc0d4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39828/0 (socket says 172.21.15.66:39828) 2024-05-10T11:12:46.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e09e65640 1 -- 172.21.15.66:0/559376621 learned_addr learned my addr 172.21.15.66:0/559376621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7fc4ba0ec640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40c9360 0x7fc4b40b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4ba0ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b40ce9e0 0x7fc4b4070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f6e08e63640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dfc04fa90 0x7f6dfc0d4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fdefffff640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdeec0763d0 0x7fdeec078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7faeb259c640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb40af790 0x7faeb40b6220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faea8031000 tx=0x7faea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdef80b8c50 con 0x7fdf000b4030 2024-05-10T11:12:46.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.826+0000 7f24c61d0640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24c01558d0 0x7f24c015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5e23640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804f9a0 0x7fbcd804a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f44dec75640 1 Processor -- start 2024-05-10T11:12:46.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6e08e63640 1 -- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0392d0 msgr2=0x7f6dfc0453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6e08e63640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dfc0392d0 0x7f6dfc0453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6e08e63640 1 -- 172.21.15.66:0/559376621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dfc0df420 msgr2=0x7f6dfc0d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6e08e63640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dfc0df420 0x7f6dfc0d4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f653ed9d640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65400c86e0 0x7f6540157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5e23640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd804fe00 0x7fbcd80d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6e08e63640 1 -- 172.21.15.66:0/559376621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc04c7b0 con 0x7f6dfc04fa90 2024-05-10T11:12:46.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5e23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd80e7750 0x7fbcd8035350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4b90ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4b90ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b415d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43784/0 (socket says 172.21.15.66:43784) 2024-05-10T11:12:46.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4b98eb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b40ce9e0 0x7fc4b4070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4b98eb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b40ce9e0 0x7fc4b4070bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39838/0 (socket says 172.21.15.66:39838) 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4b90ea640 1 -- 172.21.15.66:0/3018653901 learned_addr learned my addr 172.21.15.66:0/3018653901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b40d1a10 con 0x7fc4b40ce9e0 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b40b3fe0 con 0x7fc4b40c8f80 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b40d1b90 con 0x7fc4b40c9360 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5e23640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd80538f0 con 0x7fbcd80e7750 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5e23640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8053610 con 0x7fbcd804f9a0 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5e23640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd8053bd0 con 0x7fbcd804fe00 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce4e21640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804f9a0 0x7fbcd804a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbcdffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd804fe00 0x7fbcd80d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbcdffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd804fe00 0x7fbcd80d87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53306/0 (socket says 172.21.15.66:53306) 2024-05-10T11:12:46.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbcdffff640 1 -- 172.21.15.66:0/2770987926 learned_addr learned my addr 172.21.15.66:0/2770987926 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fdefcff9640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7fdeec07fb40 0x7fdeec081f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f44dec75640 1 -- start start 2024-05-10T11:12:46.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fc4b88e9640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40c9360 0x7fc4b40b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdef803de50 con 0x7fdeec07fb40 2024-05-10T11:12:46.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f654006c980 con 0x7f65400c86e0 2024-05-10T11:12:46.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fdefffff640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdeec0763d0 0x7fdeec078890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009f50 tx=0x7fdef4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f654006c800 con 0x7f65400c5150 2024-05-10T11:12:46.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdef80b9040 con 0x7fdf000b4030 2024-05-10T11:12:46.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7f6e08e63640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dfc04fa90 0x7f6dfc0d4900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6df4031000 tx=0x7f6df40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f654006cb00 con 0x7f6540165320 2024-05-10T11:12:46.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbce5622640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd80e7750 0x7fbcd8035350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbcdffff640 1 -- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804f9a0 msgr2=0x7fbcd804a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.827+0000 7fbcdffff640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd804f9a0 0x7fbcd804a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fbcdffff640 1 -- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd80e7750 msgr2=0x7fbcd8035350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fbcdffff640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd80e7750 0x7fbcd8035350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fbcdffff640 1 -- 172.21.15.66:0/2770987926 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd804ae40 con 0x7fbcd804fe00 2024-05-10T11:12:46.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fc4b90ea640 1 -- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40c9360 msgr2=0x7fc4b40b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fc4b90ea640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4b40c9360 0x7fc4b40b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fc4b90ea640 1 -- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b40ce9e0 msgr2=0x7fc4b4070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8037040 con 0x7faeb40af790 2024-05-10T11:12:46.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fdf04e30640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7fdeec07fb40 0x7fdeec081f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fc4b90ea640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b40ce9e0 0x7fc4b4070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fc4b90ea640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b40b6380 con 0x7fc4b40c8f80 2024-05-10T11:12:46.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fc4b98eb640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b40ce9e0 0x7fc4b4070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:46.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fbcdffff640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd804fe00 0x7fbcd80d87b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00b3f0 tx=0x7fbccc00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea8030770 con 0x7faeb40af790 2024-05-10T11:12:46.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4041020 con 0x7f6dfc04fa90 2024-05-10T11:12:46.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df403d620 con 0x7f6dfc04fa90 2024-05-10T11:12:46.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6e0a666640 1 -- 172.21.15.66:0/559376621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc04ca90 con 0x7f6dfc04fa90 2024-05-10T11:12:46.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4037040 con 0x7f6dfc04fa90 2024-05-10T11:12:46.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb40ca8d0 con 0x7faeb40af790 2024-05-10T11:12:46.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb40b3d00 con 0x7faeb40af790 2024-05-10T11:12:46.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc015020 con 0x7fbcd804fe00 2024-05-10T11:12:46.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc011830 con 0x7fbcd804fe00 2024-05-10T11:12:46.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7fdf04e30640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7fdeec07fb40 0x7fdeec081f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f44dec75640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44d80b6ac0 0x7f44d80c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f6e0a666640 1 -- 172.21.15.66:0/559376621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc04d050 con 0x7f6dfc04fa90 2024-05-10T11:12:46.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f24c59cf640 1 -- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24c01558d0 msgr2=0x7f24c015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f24c59cf640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24c01558d0 0x7f24c015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7f24c59cf640 1 -- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c0140bd0 msgr2=0x7f24c00c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f24c59cf640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c0140bd0 0x7f24c00c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dec75640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d80b9a00 0x7f44d8154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f653ed9d640 1 -- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 msgr2=0x7f65400b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f24c59cf640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c00c6280 con 0x7f24c00cb2e0 2024-05-10T11:12:46.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f653ed9d640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6540165320 0x7f65400b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f653ed9d640 1 -- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65400c5150 msgr2=0x7f65400b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dec75640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d8163690 0x7f44d80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f653ed9d640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65400c5150 0x7f65400b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f24c51ce640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24c0140bd0 0x7f24c00c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:46.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f653ed9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65400b5270 con 0x7f65400c86e0 2024-05-10T11:12:46.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dec75640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44d80b8880 con 0x7f44d8163690 2024-05-10T11:12:46.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dec75640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f44d80b85a0 con 0x7f44d80b6ac0 2024-05-10T11:12:46.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dec75640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f44d809e540 con 0x7f44d80b9a00 2024-05-10T11:12:46.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dca11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44d80b6ac0 0x7f44d80c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f653ed9d640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65400c86e0 0x7f6540157250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6538030000 tx=0x7f6538004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7fbce5e23640 1 -- 172.21.15.66:0/2770987926 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd804b120 con 0x7fbcd804fe00 2024-05-10T11:12:46.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44d7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d80b9a00 0x7f44d8154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44d7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d80b9a00 0x7f44d8154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53312/0 (socket says 172.21.15.66:53312) 2024-05-10T11:12:46.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44d7fff640 1 -- 172.21.15.66:0/374033615 learned_addr learned my addr 172.21.15.66:0/374033615 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:46.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dd212640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d8163690 0x7f44d80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f44dca11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44d80b6ac0 0x7f44d80c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43804/0 (socket says 172.21.15.66:43804) 2024-05-10T11:12:46.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdef803de50 con 0x7fdeec07fb40 2024-05-10T11:12:46.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7fbce5e23640 1 -- 172.21.15.66:0/2770987926 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd804b6e0 con 0x7fbcd804fe00 2024-05-10T11:12:46.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc011c20 con 0x7fbcd804fe00 2024-05-10T11:12:46.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7f24c59cf640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24c00cb2e0 0x7f24c00732d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24b000d840 tx=0x7f24b000dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.829+0000 7fc4b90ea640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b415d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009870 tx=0x7fc4b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0041020 con 0x7fc4b40c8f80 2024-05-10T11:12:46.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f44d7fff640 1 -- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44d80b6ac0 msgr2=0x7f44d80c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f44d7fff640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44d80b6ac0 0x7f44d80c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000b6c0 con 0x7f24c00cb2e0 2024-05-10T11:12:46.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0030910 con 0x7fc4b40c8f80 2024-05-10T11:12:46.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0037040 con 0x7fc4b40c8f80 2024-05-10T11:12:46.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538041020 con 0x7f65400c86e0 2024-05-10T11:12:46.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538008730 con 0x7f65400c86e0 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65400b5550 con 0x7f65400c86e0 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538036040 con 0x7f65400c86e0 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7fbce5e23640 1 -- 172.21.15.66:0/2770987926 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcd804bac0 con 0x7fbcd804fe00 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f44d7fff640 1 -- 172.21.15.66:0/374033615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d8163690 msgr2=0x7f44d80b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f44d7fff640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d8163690 0x7f44d80b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f44d7fff640 1 -- 172.21.15.66:0/374033615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d80c8dc0 con 0x7f44d80b9a00 2024-05-10T11:12:46.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f44dd212640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d8163690 0x7f44d80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:46.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.828+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8006e10 con 0x7faeb40af790 2024-05-10T11:12:46.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f6e0a666640 1 -- 172.21.15.66:0/559376621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dfc005390 con 0x7f6dfc04fa90 2024-05-10T11:12:46.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b0019070 con 0x7f24c00cb2e0 2024-05-10T11:12:46.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000b6c0 con 0x7f24c00cb2e0 2024-05-10T11:12:46.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f24c7c33640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c00c6520 con 0x7f24c00cb2e0 2024-05-10T11:12:46.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.830+0000 7f24c7c33640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c00c6ae0 con 0x7f24c00cb2e0 2024-05-10T11:12:46.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.832+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65400b5b10 con 0x7f65400c86e0 2024-05-10T11:12:46.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65400693f0 con 0x7f65400c86e0 2024-05-10T11:12:46.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f44d7fff640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d80b9a00 0x7f44d8154e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009960 tx=0x7f44c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6df4044020 con 0x7f6dfc04fa90 2024-05-10T11:12:46.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.832+0000 7f6df9ffb640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6de80763a0 0x7f6de8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6df40b7b70 con 0x7f6dfc04fa90 2024-05-10T11:12:46.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f6df9ffb640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7f6de807fa90 0x7f6de8081ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6df402aba0 con 0x7f6de807fa90 2024-05-10T11:12:46.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.831+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b40b6660 con 0x7fc4b40c8f80 2024-05-10T11:12:46.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6df407d170 con 0x7f6dfc04fa90 2024-05-10T11:12:46.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.832+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b40b6c20 con 0x7fc4b40c8f80 2024-05-10T11:12:46.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4b40709b0 con 0x7fc4b40c8f80 2024-05-10T11:12:46.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.832+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbccc018020 con 0x7fbcd804fe00 2024-05-10T11:12:46.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbcdd7fa640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbcc40763a0 0x7fbcc4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbccc0974c0 con 0x7fbcd804fe00 2024-05-10T11:12:46.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4041020 con 0x7f44d80b9a00 2024-05-10T11:12:46.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae98001030 con 0x7faeb40af790 2024-05-10T11:12:46.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4030780 con 0x7f44d80b9a00 2024-05-10T11:12:46.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbce4e21640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbcc40763a0 0x7fbcc4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbcdd7fa640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fbcc407fb20 0x7fbcc4081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbccc00de50 con 0x7fbcc407fb20 2024-05-10T11:12:46.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbccc09e050 con 0x7fbcd804fe00 2024-05-10T11:12:46.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7fbce5622640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fbcc407fb20 0x7fbcc4081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7f6e09664640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6de80763a0 0x7f6de8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7fbce4e21640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbcc40763a0 0x7fbcc4078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006fd0 tx=0x7fbcd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4037040 con 0x7f44d80b9a00 2024-05-10T11:12:46.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.833+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24c006a220 con 0x7f24c00cb2e0 2024-05-10T11:12:46.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7fbce5622640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fbcc407fb20 0x7fbcc4081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc4b0044020 con 0x7fc4b40c8f80 2024-05-10T11:12:46.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7f44dec75640 1 -- 172.21.15.66:0/374033615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d80c90a0 con 0x7f44d80b9a00 2024-05-10T11:12:46.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.835+0000 7f44dec75640 1 -- 172.21.15.66:0/374033615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d80c9660 con 0x7f44d80b9a00 2024-05-10T11:12:46.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.835+0000 7f6e09664640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6de80763a0 0x7f6de8078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e000011e0 tx=0x7f6e00016040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.835+0000 7fc4a9ffb640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4980763a0 0x7fc498078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.834+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faea8044020 con 0x7faeb40af790 2024-05-10T11:12:46.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.835+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f24b000b860 con 0x7f24c00cb2e0 2024-05-10T11:12:46.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.835+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbccc00de50 con 0x7fbcc407fb20 2024-05-10T11:12:46.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f6e09e65640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7f6de807fa90 0x7f6de8081ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7faea2ffd640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae940763a0 0x7fae94078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f24b67fc640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24a40766d0 0x7f24a4078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faea80b7b70 con 0x7faeb40af790 2024-05-10T11:12:46.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7faeb1d9b640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae940763a0 0x7fae94078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f24c51ce640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24a40766d0 0x7f24a4078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7faea2ffd640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fae9407faa0 0x7fae94081ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faea8042ec0 con 0x7fae9407faa0 2024-05-10T11:12:46.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f24b000f040 con 0x7f24c00cb2e0 2024-05-10T11:12:46.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc4b00b88c0 con 0x7fc4b40c8f80 2024-05-10T11:12:46.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7faeb2d9d640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fae9407faa0 0x7fae94081ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7fc4b88e9640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4980763a0 0x7fc498078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7fc4a9ffb640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7fc49807fb20 0x7fc498081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4b0032440 con 0x7fc49807fb20 2024-05-10T11:12:46.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc4b00b8cb0 con 0x7fc4b40c8f80 2024-05-10T11:12:46.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f24c51ce640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24a40766d0 0x7f24a4078b90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f24bc034000 tx=0x7f24bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44d80c8b70 con 0x7f44d80b9a00 2024-05-10T11:12:46.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.835+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6538044020 con 0x7f65400c86e0 2024-05-10T11:12:46.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f652effd640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6520076320 0x7f65200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65380b8a10 con 0x7f65400c86e0 2024-05-10T11:12:46.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f652effd640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7f652007fa90 0x7f6520081ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.836+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6538041e80 con 0x7f652007fa90 2024-05-10T11:12:46.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65380b8ef0 con 0x7f65400c86e0 2024-05-10T11:12:46.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f653e59c640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6520076320 0x7f65200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7fc4b98eb640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7fc49807fb20 0x7fc498081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7faeb1d9b640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae940763a0 0x7fae94078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faeb415cf00 tx=0x7faeac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f653dd9b640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7f652007fa90 0x7f6520081ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f24b67fc640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f24a407fcc0 0x7f24a4082100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7faeb2d9d640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fae9407faa0 0x7fae94081ee0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faea807d200 con 0x7faeb40af790 2024-05-10T11:12:46.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24b0020e70 con 0x7f24a407fcc0 2024-05-10T11:12:46.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7fc4b98eb640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7fc49807fb20 0x7fc498081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.837+0000 7f653e59c640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6520076320 0x7f65200787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f65401fc970 tx=0x7f6530009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7f24c61d0640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f24a407fcc0 0x7f24a4082100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7fc4b88e9640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4980763a0 0x7fc498078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40bd1a0 tx=0x7fc4a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7f653dd9b640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7f652007fa90 0x7f6520081ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24b005cc00 con 0x7f24c00cb2e0 2024-05-10T11:12:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f44c4044020 con 0x7f44d80b9a00 2024-05-10T11:12:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7f6e09e65640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7f6de807fa90 0x7f6de8081ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faea8042ec0 con 0x7fae9407faa0 2024-05-10T11:12:46.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7f24c61d0640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f24a407fcc0 0x7f24a4082100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.838+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4b0032440 con 0x7fc49807fb20 2024-05-10T11:12:46.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44d57fa640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f44bc0762d0 0x7f44bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6538041e80 con 0x7f652007fa90 2024-05-10T11:12:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f44c40b7f90 con 0x7f44d80b9a00 2024-05-10T11:12:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6df402aba0 con 0x7f6de807fa90 2024-05-10T11:12:46.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44dca11640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f44bc0762d0 0x7f44bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44d57fa640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f44bc07f9d0 0x7f44bc081e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:46.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44c4037e50 con 0x7f44bc07f9d0 2024-05-10T11:12:46.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44c40ba5b0 con 0x7f44d80b9a00 2024-05-10T11:12:46.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24b0020e70 con 0x7f24a407fcc0 2024-05-10T11:12:46.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.839+0000 7f44dd212640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f44bc07f9d0 0x7f44bc081e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:46.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.840+0000 7f44dca11640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f44bc0762d0 0x7f44bc078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44cc006fd0 tx=0x7f44cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.845+0000 7f44dd212640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f44bc07f9d0 0x7f44bc081e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:46.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.846+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44c4037e50 con 0x7f44bc07f9d0 2024-05-10T11:12:46.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.861+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf000b33e0 con 0x7fdeec07fb40 2024-05-10T11:12:46.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.861+0000 7fdefcff9640 1 -- 172.21.15.66:0/3109847026 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf000b33e0 con 0x7fdeec07fb40 2024-05-10T11:12:46.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fbce5e23640 1 -- 172.21.15.66:0/2770987926 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbcd8005c20 con 0x7fbcc407fb20 2024-05-10T11:12:46.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7fdeec07fb40 msgr2=0x7fdeec081f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7fdeec07fb40 0x7fdeec081f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdeec0763d0 msgr2=0x7fdeec078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdeec0763d0 0x7fdeec078890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009f50 tx=0x7fdef4009190 comp rx=0 tx=0).stop 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b4030 msgr2=0x7fdf000cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 --2- 172.21.15.66:0/3109847026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b4030 0x7fdf000cee80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdef8031000 tx=0x7fdef8004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf04e30640 1 -- 172.21.15.66:0/3109847026 reap_dead start 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 shutdown_connections 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.862+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 >> 172.21.15.66:0/3109847026 conn(0x7fdf000d4ff0 msgr2=0x7fdf000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.863+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 shutdown_connections 2024-05-10T11:12:46.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.863+0000 7fbcdd7fa640 1 -- 172.21.15.66:0/2770987926 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbcd8005c20 con 0x7fbcc407fb20 2024-05-10T11:12:46.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.863+0000 7fdf06893640 1 -- 172.21.15.66:0/3109847026 wait complete. 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.863+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fbcc407fb20 msgr2=0x7fbcc4081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.863+0000 7fbccaffd640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fbcc407fb20 0x7fbcc4081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbcc40763a0 msgr2=0x7fbcc4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbccaffd640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbcc40763a0 0x7fbcc4078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006fd0 tx=0x7fbcd4008040 comp rx=0 tx=0).stop 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd804fe00 msgr2=0x7fbcd80d87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbccaffd640 1 --2- 172.21.15.66:0/2770987926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcd804fe00 0x7fbcd80d87b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00b3f0 tx=0x7fbccc00b8b0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbce5622640 1 -- 172.21.15.66:0/2770987926 reap_dead start 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 shutdown_connections 2024-05-10T11:12:46.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.864+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 >> 172.21.15.66:0/2770987926 conn(0x7fbcd8055350 msgr2=0x7fbcd8038b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.865+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 shutdown_connections 2024-05-10T11:12:46.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.865+0000 7fbccaffd640 1 -- 172.21.15.66:0/2770987926 wait complete. 2024-05-10T11:12:46.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.871+0000 7f6544b9d640 1 -- 172.21.15.66:0/3290120831 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65400693f0 con 0x7f652007fa90 2024-05-10T11:12:46.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.871+0000 7f652effd640 1 -- 172.21.15.66:0/3290120831 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f65400693f0 con 0x7f652007fa90 2024-05-10T11:12:46.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.871+0000 7faeb89c8640 1 -- 172.21.15.66:0/734041516 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae98002dd0 con 0x7fae9407faa0 2024-05-10T11:12:46.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.872+0000 7faea2ffd640 1 -- 172.21.15.66:0/734041516 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae98002dd0 con 0x7fae9407faa0 2024-05-10T11:12:46.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7f652007fa90 msgr2=0x7f6520081ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4b40cedc0 con 0x7fc49807fb20 2024-05-10T11:12:46.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7f652007fa90 0x7f6520081ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6520076320 msgr2=0x7f65200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6520076320 0x7f65200787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f65401fc970 tx=0x7f6530009190 comp rx=0 tx=0).stop 2024-05-10T11:12:46.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65400c86e0 msgr2=0x7f6540157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 --2- 172.21.15.66:0/3290120831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65400c86e0 0x7f6540157250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6538030000 tx=0x7f6538004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:46.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fae9407faa0 msgr2=0x7fae94081ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fae9407faa0 0x7fae94081ee0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae940763a0 msgr2=0x7fae94078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae940763a0 0x7fae94078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faeb415cf00 tx=0x7faeac009040 comp rx=0 tx=0).stop 2024-05-10T11:12:46.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb40af790 msgr2=0x7faeb40b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 --2- 172.21.15.66:0/734041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb40af790 0x7faeb40b6220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faea8031000 tx=0x7faea80046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faeb2d9d640 1 -- 172.21.15.66:0/734041516 reap_dead start 2024-05-10T11:12:46.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f653ed9d640 1 -- 172.21.15.66:0/3290120831 reap_dead start 2024-05-10T11:12:46.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 shutdown_connections 2024-05-10T11:12:46.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 >> 172.21.15.66:0/3290120831 conn(0x7f65400d1df0 msgr2=0x7f65400b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f24c013ea20 con 0x7f24a407fcc0 2024-05-10T11:12:46.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 shutdown_connections 2024-05-10T11:12:46.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 >> 172.21.15.66:0/734041516 conn(0x7faeb40d0c90 msgr2=0x7faeb40b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 shutdown_connections 2024-05-10T11:12:46.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7f6e0a666640 1 -- 172.21.15.66:0/559376621 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6dfc045910 con 0x7f6de807fa90 2024-05-10T11:12:46.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.873+0000 7fc4a9ffb640 1 -- 172.21.15.66:0/3018653901 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc4b40cedc0 con 0x7fc49807fb20 2024-05-10T11:12:46.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 shutdown_connections 2024-05-10T11:12:46.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7faea0ff9640 1 -- 172.21.15.66:0/734041516 wait complete. 2024-05-10T11:12:46.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7f652cff9640 1 -- 172.21.15.66:0/3290120831 wait complete. 2024-05-10T11:12:46.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7f24b67fc640 1 -- 172.21.15.66:0/2979496441 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f24c013ea20 con 0x7f24a407fcc0 2024-05-10T11:12:46.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7f6df9ffb640 1 -- 172.21.15.66:0/559376621 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6dfc045910 con 0x7f6de807fa90 2024-05-10T11:12:46.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7fc49807fb20 msgr2=0x7fc498081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7fc4ba0ec640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7fc49807fb20 0x7fc498081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f24a407fcc0 msgr2=0x7f24a4082100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7f24a3fff640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f24a407fcc0 0x7f24a4082100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4980763a0 msgr2=0x7fc498078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7fc4ba0ec640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4980763a0 0x7fc498078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40bd1a0 tx=0x7fc4a4008040 comp rx=0 tx=0).stop 2024-05-10T11:12:46.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 msgr2=0x7fc4b415d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.874+0000 7fc4ba0ec640 1 --2- 172.21.15.66:0/3018653901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4b40c8f80 0x7fc4b415d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009870 tx=0x7fc4b00046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7f6de807fa90 msgr2=0x7f6de8081ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7f6de807fa90 0x7f6de8081ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24a40766d0 msgr2=0x7f24a4078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24a3fff640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24a40766d0 0x7f24a4078b90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f24bc034000 tx=0x7f24bc02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:46.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24c00cb2e0 msgr2=0x7f24c00732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24a3fff640 1 --2- 172.21.15.66:0/2979496441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24c00cb2e0 0x7f24c00732d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24b000d840 tx=0x7f24b000dd00 comp rx=0 tx=0).stop 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7fc4b98eb640 1 -- 172.21.15.66:0/3018653901 reap_dead start 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 shutdown_connections 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 >> 172.21.15.66:0/3018653901 conn(0x7fc4b40d2c20 msgr2=0x7fc4b406eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 shutdown_connections 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24c61d0640 1 -- 172.21.15.66:0/2979496441 reap_dead start 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 shutdown_connections 2024-05-10T11:12:46.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 >> 172.21.15.66:0/2979496441 conn(0x7f24c00d0c90 msgr2=0x7f24c0073bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7fc4ba0ec640 1 -- 172.21.15.66:0/3018653901 wait complete. 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6de80763a0 msgr2=0x7f6de8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6de80763a0 0x7f6de8078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e000011e0 tx=0x7f6e00016040 comp rx=0 tx=0).stop 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dfc04fa90 msgr2=0x7f6dfc0d4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 --2- 172.21.15.66:0/559376621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dfc04fa90 0x7f6dfc0d4900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6df4031000 tx=0x7f6df40046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6e09e65640 1 -- 172.21.15.66:0/559376621 reap_dead start 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 shutdown_connections 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.875+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 >> 172.21.15.66:0/559376621 conn(0x7f6dfc009fb0 msgr2=0x7f6dfc0541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.876+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 shutdown_connections 2024-05-10T11:12:46.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.876+0000 7f6def7fe640 1 -- 172.21.15.66:0/559376621 wait complete. 2024-05-10T11:12:46.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.876+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 shutdown_connections 2024-05-10T11:12:46.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.876+0000 7f24a3fff640 1 -- 172.21.15.66:0/2979496441 wait complete. 2024-05-10T11:12:46.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.877+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44d80b6270 con 0x7f44bc07f9d0 2024-05-10T11:12:46.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.877+0000 7f44d57fa640 1 -- 172.21.15.66:0/374033615 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f44d80b6270 con 0x7f44bc07f9d0 2024-05-10T11:12:46.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.879+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f44bc07f9d0 msgr2=0x7f44bc081e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.880+0000 7f44c2ffd640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f44bc07f9d0 0x7f44bc081e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.880+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f44bc0762d0 msgr2=0x7f44bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.880+0000 7f44c2ffd640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f44bc0762d0 0x7f44bc078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44cc006fd0 tx=0x7f44cc008040 comp rx=0 tx=0).stop 2024-05-10T11:12:46.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.881+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d80b9a00 msgr2=0x7f44d8154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:46.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.881+0000 7f44c2ffd640 1 --2- 172.21.15.66:0/374033615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44d80b9a00 0x7f44d8154e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009960 tx=0x7f44c40046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:46.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.881+0000 7f44dd212640 1 -- 172.21.15.66:0/374033615 reap_dead start 2024-05-10T11:12:46.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.881+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 shutdown_connections 2024-05-10T11:12:46.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.881+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 >> 172.21.15.66:0/374033615 conn(0x7f44d80d1ac0 msgr2=0x7f44d80d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:46.964 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:46.964 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T11:12:46.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.881+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 shutdown_connections 2024-05-10T11:12:46.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:46.882+0000 7f44c2ffd640 1 -- 172.21.15.66:0/374033615 wait complete. 2024-05-10T11:12:46.965 INFO:teuthology.orchestra.run.smithi066.stdout:60129542154 2024-05-10T11:12:46.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T11:12:46.966 INFO:teuthology.orchestra.run.smithi066.stdout:55834574858 2024-05-10T11:12:46.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T11:12:46.968 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:46.968 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T11:12:46.969 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:46.969 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T11:12:46.970 INFO:teuthology.orchestra.run.smithi066.stdout:64424509450 2024-05-10T11:12:46.971 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T11:12:46.971 INFO:teuthology.orchestra.run.smithi066.stdout:64424509450 2024-05-10T11:12:46.972 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T11:12:46.973 INFO:teuthology.orchestra.run.smithi066.stdout:64424509450 2024-05-10T11:12:46.973 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T11:12:47.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.186+0000 7f3297e93640 1 Processor -- start 2024-05-10T11:12:47.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.185+0000 7fe72b7c1640 1 Processor -- start 2024-05-10T11:12:47.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.185+0000 7fe72b7c1640 1 -- start start 2024-05-10T11:12:47.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe72b7c1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe724071360 0x7fe7240b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.186+0000 7f3297e93640 1 -- start start 2024-05-10T11:12:47.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe72b7c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe724070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7f3297e93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32901463c0 0x7f32900d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7f3297e93640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3290164490 0x7f3290148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7f3297e93640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3290149170 0x7f32900cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7f3297e93640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3290164a30 con 0x7f3290149170 2024-05-10T11:12:47.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7f3297e93640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f32900d0870 con 0x7f3290164490 2024-05-10T11:12:47.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7f3297e93640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f32900ce810 con 0x7f32901463c0 2024-05-10T11:12:47.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe2f5134640 1 Processor -- start 2024-05-10T11:12:47.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7f3296430640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3290149170 0x7f32900cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7f3296430640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3290149170 0x7f32900cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39878/0 (socket says 172.21.15.66:39878) 2024-05-10T11:12:47.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7f3296430640 1 -- 172.21.15.66:0/1167972005 learned_addr learned my addr 172.21.15.66:0/1167972005 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe72b7c1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7240b5cc0 con 0x7fe724070dc0 2024-05-10T11:12:47.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe72b7c1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe72406fb70 con 0x7fe724071360 2024-05-10T11:12:47.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe72b7c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe72415c2d0 con 0x7fe72415be70 2024-05-10T11:12:47.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7f3295c2f640 1 --2- 172.21.15.66:0/1167972005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32901463c0 0x7f32900d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe728d5c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe724070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe728d5c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe724070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53328/0 (socket says 172.21.15.66:53328) 2024-05-10T11:12:47.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.187+0000 7fe728d5c640 1 -- 172.21.15.66:0/740128637 learned_addr learned my addr 172.21.15.66:0/740128637 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7f3296430640 1 -- 172.21.15.66:0/1167972005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32901463c0 msgr2=0x7f32900d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe72955d640 1 --2- 172.21.15.66:0/740128637 >> v2:172.21.15.190:3300/0 conn(0x7fe724071360 0x7fe7240b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe72955d640 1 -- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 msgr2=0x7fe724070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe72955d640 1 --2- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe724070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe72955d640 1 -- 172.21.15.66:0/740128637 >> v1:172.21.15.66:6789/0 conn(0x7fe724070dc0 legacy=0x7fe7240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe72955d640 1 -- 172.21.15.66:0/740128637 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe724162d60 con 0x7fe724071360 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7fe728d5c640 1 --2- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe724070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7fe72955d640 1 --2- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe7240b69f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7200097a0 tx=0x7fe72002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc4e519b22a0adf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7f3296430640 1 --2- 172.21.15.66:0/1167972005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32901463c0 0x7f32900d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.188+0000 7fe2f5134640 1 -- start start 2024-05-10T11:12:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7fe2f5134640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2e804fa80 0x7fe2e804fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.189+0000 7fe2f5134640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e8054260 0x7fe2e80389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2f5134640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e80503a0 con 0x7fe2e80df410 2024-05-10T11:12:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2f5134640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e8006890 con 0x7fe2e804fa80 2024-05-10T11:12:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2f5134640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e8006ae0 con 0x7fe2e8054260 2024-05-10T11:12:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe71bfff640 1 -- 172.21.15.66:0/740128637 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720037070 con 0x7fe724071360 2024-05-10T11:12:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2f4933640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e8054260 0x7fe2e80389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2effff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2e804fa80 0x7fe2e804fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2effff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2e804fa80 0x7fe2e804fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43832/0 (socket says 172.21.15.66:43832) 2024-05-10T11:12:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2effff640 1 -- 172.21.15.66:0/35021831 learned_addr learned my addr 172.21.15.66:0/35021831 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe71bfff640 1 -- 172.21.15.66:0/740128637 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72002ade0 con 0x7fe724071360 2024-05-10T11:12:47.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe71bfff640 1 -- 172.21.15.66:0/740128637 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720032660 con 0x7fe724071360 2024-05-10T11:12:47.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7f3296430640 1 -- 172.21.15.66:0/1167972005 >> v2:172.21.15.190:3300/0 conn(0x7f3290164490 msgr2=0x7f3290148c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T11:12:47.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704643456 0 0) 0x7fe2e80503a0 con 0x7fe2e80df410 2024-05-10T11:12:47.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2e0005730 con 0x7fe2e80df410 2024-05-10T11:12:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7f3296430640 1 --2- 172.21.15.66:0/1167972005 >> v2:172.21.15.190:3300/0 conn(0x7f3290164490 0x7f3290148c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7f3296430640 1 -- 172.21.15.66:0/1167972005 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329006de20 con 0x7f3290149170 2024-05-10T11:12:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.190+0000 7f3af1d78640 1 Processor -- start 2024-05-10T11:12:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7f3af1d78640 1 -- start start 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 -- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 msgr2=0x7fe7240b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe7240b69f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7200097a0 tx=0x7fe72002a0d0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3035936201 0 0) 0x7fe2e0005730 con 0x7fe2e80df410 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e8054260 msgr2=0x7fe2e80389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e8054260 0x7fe2e80389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 >> v2:172.21.15.190:3300/0 conn(0x7fe2e804fa80 msgr2=0x7fe2e804fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 --2- 172.21.15.66:0/35021831 >> v2:172.21.15.190:3300/0 conn(0x7fe2e804fa80 0x7fe2e804fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7f3296430640 1 --2- 172.21.15.66:0/1167972005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290149170 0x7f32900cc100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f32900708d0 tx=0x7f328402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9e41213f136aae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e8006dc0 con 0x7fe2e80df410 2024-05-10T11:12:47.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 -- 172.21.15.66:0/740128637 shutdown_connections 2024-05-10T11:12:47.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe724070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/740128637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe7240b69f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 -- 172.21.15.66:0/740128637 >> 172.21.15.66:0/740128637 conn(0x7fe7240d1d70 msgr2=0x7fe7240d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe2e4001670 con 0x7fe2e80df410 2024-05-10T11:12:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 >> v1:172.21.15.66:6789/0 conn(0x7fe2e80df410 legacy=0x7fe2e80382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e0005bc0 0x7fe2e0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e0006a10 0x7fe2e0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 -- 172.21.15.66:0/740128637 shutdown_connections 2024-05-10T11:12:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3294c2d640 1 -- 172.21.15.66:0/1167972005 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284037070 con 0x7f3290149170 2024-05-10T11:12:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3294c2d640 1 -- 172.21.15.66:0/1167972005 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3284032440 con 0x7f3290149170 2024-05-10T11:12:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3294c2d640 1 -- 172.21.15.66:0/1167972005 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284032810 con 0x7f3290149170 2024-05-10T11:12:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 -- 172.21.15.66:0/1167972005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290149170 msgr2=0x7f32900cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3af1d78640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3aec0cfa40 0x7f3aec15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3af1d78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec15ff70 0x7f3aec0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3af1d78640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aec0cff70 con 0x7f3aec159a20 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3af1d78640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3aec0d0250 con 0x7f3aec0cfa40 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3af1d78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec0d0530 con 0x7f3aec15ff70 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3aeaffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3aec0cfa40 0x7f3aec15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3aeb7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3aec159a20 0x7f3aec06f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40988/0 (socket says 172.21.15.66:40988) 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7f3aeb7fe640 1 -- 172.21.15.66:0/3567444791 learned_addr learned my addr 172.21.15.66:0/3567444791 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e00073d0 0x7fe2e000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e8006890 con 0x7fe2e0005bc0 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e8006ae0 con 0x7fe2e00073d0 2024-05-10T11:12:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e000e320 con 0x7fe2e0006a10 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2ef7fe640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e0006a10 0x7fe2e0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe2effff640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e0005bc0 0x7fe2e0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fe2f4933640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e00073d0 0x7fe2e000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fe2ef7fe640 1 -- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e00073d0 msgr2=0x7fe2e000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fe2ef7fe640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e00073d0 0x7fe2e000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fe2ef7fe640 1 -- 172.21.15.66:0/35021831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e0005bc0 msgr2=0x7fe2e0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fe2ef7fe640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e0005bc0 0x7fe2e0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fe2ef7fe640 1 -- 172.21.15.66:0/35021831 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e0005730 con 0x7fe2e0006a10 2024-05-10T11:12:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fd057c3e640 1 Processor -- start 2024-05-10T11:12:47.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 --2- 172.21.15.66:0/1167972005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290149170 0x7f32900cc100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f32900708d0 tx=0x7f328402a230 comp rx=0 tx=0).stop 2024-05-10T11:12:47.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 -- 172.21.15.66:0/1167972005 shutdown_connections 2024-05-10T11:12:47.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 --2- 172.21.15.66:0/1167972005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290149170 0x7f32900cc100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 --2- 172.21.15.66:0/1167972005 >> v2:172.21.15.190:3300/0 conn(0x7f3290164490 0x7f3290148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 --2- 172.21.15.66:0/1167972005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32901463c0 0x7f32900d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3297e93640 1 -- 172.21.15.66:0/1167972005 >> 172.21.15.66:0/1167972005 conn(0x7f32900d0aa0 msgr2=0x7f32900d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.192+0000 7fd057c3e640 1 -- start start 2024-05-10T11:12:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7fd057c3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0500d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7fd057c3e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0500d3b30 con 0x7fd0500c69c0 2024-05-10T11:12:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7fd057c3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0500ce8d0 con 0x7fd05015d540 2024-05-10T11:12:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7fd057c3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500d3e10 con 0x7fd0500b4050 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3aeaffd640 1 -- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec15ff70 msgr2=0x7f3aec0cc600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3aeaffd640 1 --2- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec15ff70 0x7f3aec0cc600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3aeaffd640 1 -- 172.21.15.66:0/3567444791 >> v1:172.21.15.66:6789/0 conn(0x7f3aec159a20 legacy=0x7f3aec06f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7f3aeaffd640 1 -- 172.21.15.66:0/3567444791 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec0d0810 con 0x7f3aec0cfa40 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.191+0000 7fe72b7c1640 1 -- 172.21.15.66:0/740128637 wait complete. 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7fe72b7c1640 1 Processor -- start 2024-05-10T11:12:47.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.193+0000 7fe72b7c1640 1 -- start start 2024-05-10T11:12:47.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0561db640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd0500c69c0 0x7fd0500c6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40992/0 (socket says 172.21.15.66:40992) 2024-05-10T11:12:47.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0561db640 1 -- 172.21.15.66:0/2086332678 learned_addr learned my addr 172.21.15.66:0/2086332678 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:47.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7f3297e93640 1 -- 172.21.15.66:0/1167972005 shutdown_connections 2024-05-10T11:12:47.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7f3297e93640 1 -- 172.21.15.66:0/1167972005 wait complete. 2024-05-10T11:12:47.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0551d9640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0500d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fe2ef7fe640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e0006a10 0x7fe2e0006e90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007b70 tx=0x7fe2e0007a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6467fca53c5925ee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4007bb0 con 0x7fe2e0006a10 2024-05-10T11:12:47.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e4030640 con 0x7fe2e0006a10 2024-05-10T11:12:47.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177965288 0 0) 0x7fd0500ce8d0 con 0x7fd05015d540 2024-05-10T11:12:47.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7f3aeaffd640 1 --2- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec0cfa40 0x7f3aec15fa30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00097a0 tx=0x7f3ae002c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7336947fbbc62b6d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd040003520 con 0x7fd05015d540 2024-05-10T11:12:47.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7f3aea7fc640 1 -- 172.21.15.66:0/3567444791 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0039070 con 0x7f3aec0cfa40 2024-05-10T11:12:47.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7f3aea7fc640 1 -- 172.21.15.66:0/3567444791 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae0034440 con 0x7f3aec0cfa40 2024-05-10T11:12:47.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7f3aea7fc640 1 -- 172.21.15.66:0/3567444791 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0034810 con 0x7f3aec0cfa40 2024-05-10T11:12:47.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fe2eeffd640 1 -- 172.21.15.66:0/35021831 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4030a70 con 0x7fe2e0006a10 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3619331585 0 0) 0x7fd040003520 con 0x7fd05015d540 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 msgr2=0x7fd0500d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0500d1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 >> v1:172.21.15.66:6789/0 conn(0x7fd0500c69c0 legacy=0x7fd0500c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0500cebb0 con 0x7fd05015d540 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fd044001920 con 0x7fd05015d540 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0551d9640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0500d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 >> v1:172.21.15.190:6789/0 conn(0x7fd05015d540 legacy=0x7fd0500d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fb3c93af640 1 Processor -- start 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.194+0000 7fb3c93af640 1 -- start start 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72b7c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 0x7fe7240b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72b7c1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe72414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72b7c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe7240cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72b7c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe72406fda0 con 0x7fe724070dc0 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72b7c1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe7240703f0 con 0x7fe724071360 2024-05-10T11:12:47.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72b7c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe724070080 con 0x7fe72415be70 2024-05-10T11:12:47.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7f0aeed38640 1 Processor -- start 2024-05-10T11:12:47.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7f0aeed38640 1 -- start start 2024-05-10T11:12:47.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72955d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 0x7fe7240b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72955d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 0x7fe7240b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39892/0 (socket says 172.21.15.66:39892) 2024-05-10T11:12:47.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe72955d640 1 -- 172.21.15.66:0/1487183661 learned_addr learned my addr 172.21.15.66:0/1487183661 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe2f5134640 1 -- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e0006a10 msgr2=0x7fe2e0006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe2f5134640 1 --2- 172.21.15.66:0/35021831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e0006a10 0x7fe2e0006e90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007b70 tx=0x7fe2e0007a40 comp rx=0 tx=0).stop 2024-05-10T11:12:47.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd040003f40 0x7fd040004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe2f4933640 1 -- 172.21.15.66:0/35021831 reap_dead start 2024-05-10T11:12:47.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fd0549d8640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7f3af1d78640 1 -- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec0cfa40 msgr2=0x7f3aec15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7f3af1d78640 1 --2- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec0cfa40 0x7f3aec15fa30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00097a0 tx=0x7f3ae002c2b0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd04000bb50 con 0x7fd040004d40 2024-05-10T11:12:47.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe728d5c640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe72414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe2f5134640 1 -- 172.21.15.66:0/35021831 shutdown_connections 2024-05-10T11:12:47.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fe2f5134640 1 -- 172.21.15.66:0/35021831 >> 172.21.15.66:0/35021831 conn(0x7fe2e8009fa0 msgr2=0x7fe2e800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe72955d640 1 -- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 msgr2=0x7fe7240cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe72955d640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe7240cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe72955d640 1 -- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 msgr2=0x7fe72414a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3af1d78640 1 -- 172.21.15.66:0/3567444791 shutdown_connections 2024-05-10T11:12:47.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3af1d78640 1 --2- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec15ff70 0x7f3aec0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3af1d78640 1 --2- 172.21.15.66:0/3567444791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec0cfa40 0x7f3aec15fa30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3af1d78640 1 -- 172.21.15.66:0/3567444791 >> 172.21.15.66:0/3567444791 conn(0x7f3aec0d14f0 msgr2=0x7f3aec0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd04000bcd0 con 0x7fd040003f40 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fd0561db640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd04000bea0 con 0x7fd0500b4050 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.195+0000 7fb3c93af640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb3c41636f0 0x7fb3c40add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c93af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4167870 0x7fb3c406eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c93af640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c40cefe0 con 0x7fb3c40d0480 2024-05-10T11:12:47.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c93af640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c40b06d0 con 0x7fb3c41636f0 2024-05-10T11:12:47.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c93af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c40b0110 con 0x7fb3c4167870 2024-05-10T11:12:47.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe72955d640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe72414a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe72955d640 1 -- 172.21.15.66:0/1487183661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe724173960 con 0x7fe724070dc0 2024-05-10T11:12:47.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe2f5134640 1 -- 172.21.15.66:0/35021831 shutdown_connections 2024-05-10T11:12:47.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3af1d78640 1 -- 172.21.15.66:0/3567444791 shutdown_connections 2024-05-10T11:12:47.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fd0551d9640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd040003f40 0x7fd040004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fd0559da640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe2f5134640 1 -- 172.21.15.66:0/35021831 wait complete. 2024-05-10T11:12:47.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4167870 0x7fb3c406eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4167870 0x7fb3c406eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53412/0 (socket says 172.21.15.66:53412) 2024-05-10T11:12:47.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c37fe640 1 -- 172.21.15.66:0/3396779108 learned_addr learned my addr 172.21.15.66:0/3396779108 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3297e93640 1 Processor -- start 2024-05-10T11:12:47.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3297e93640 1 -- start start 2024-05-10T11:12:47.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe72955d640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 0x7fe7240b08f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7200098c0 tx=0x7fe720004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720041020 con 0x7fe724070dc0 2024-05-10T11:12:47.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7f3af1d78640 1 -- 172.21.15.66:0/3567444791 wait complete. 2024-05-10T11:12:47.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0aeed38640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0ae80c6730 0x7f0ae806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0aecad4640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0ae81625f0 0x7f0ae80d0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43252/0 (socket says 172.21.15.66:43252) 2024-05-10T11:12:47.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72003d420 con 0x7fe724070dc0 2024-05-10T11:12:47.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720037040 con 0x7fe724070dc0 2024-05-10T11:12:47.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7240ce1e0 con 0x7fe724070dc0 2024-05-10T11:12:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0aecad4640 1 -- 172.21.15.66:0/3756355919 learned_addr learned my addr 172.21.15.66:0/3756355919 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0ae7fff640 1 --2- 172.21.15.66:0/3756355919 >> v2:172.21.15.190:3300/0 conn(0x7f0ae80c6730 0x7f0ae806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0aeed38640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae80c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae80cead0 con 0x7f0ae81625f0 2024-05-10T11:12:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7f0aed2d5640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae80c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3297e93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32901463c0 0x7f329015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3297e93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 0x7f32900cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae80c6500 con 0x7f0ae80c6730 2024-05-10T11:12:47.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae80ce880 con 0x7f0ae80c5b70 2024-05-10T11:12:47.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3af1d78640 1 Processor -- start 2024-05-10T11:12:47.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3297e93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290164490 0x7f32900ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267104989 0 0) 0x7f0ae80cead0 con 0x7f0ae81625f0 2024-05-10T11:12:47.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad0003520 con 0x7f0ae81625f0 2024-05-10T11:12:47.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7240ce7a0 con 0x7fe724070dc0 2024-05-10T11:12:47.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f329542e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 0x7f32900cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f329542e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 0x7f32900cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53420/0 (socket says 172.21.15.66:53420) 2024-05-10T11:12:47.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f329542e640 1 -- 172.21.15.66:0/2856013183 learned_addr learned my addr 172.21.15.66:0/2856013183 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f32901467a0 con 0x7f3290164490 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3290149a20 con 0x7f32901463c0 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fd0561db640 1 -- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 msgr2=0x7fd0400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fd0561db640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b4050 0x7fd0400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fd0561db640 1 -- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd040003f40 msgr2=0x7fd040004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fd0561db640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd040003f40 0x7fd040004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fd0561db640 1 -- 172.21.15.66:0/2086332678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd040003520 con 0x7fd040004d40 2024-05-10T11:12:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3290146920 con 0x7f3290149170 2024-05-10T11:12:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3295c2f640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32901463c0 0x7f329015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 900168064 0 0) 0x7f0ad0003520 con 0x7f0ae81625f0 2024-05-10T11:12:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 msgr2=0x7f0ae80c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7fe2f5134640 1 Processor -- start 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae80c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 >> v2:172.21.15.190:3300/0 conn(0x7f0ae80c6730 msgr2=0x7f0ae806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 --2- 172.21.15.66:0/3756355919 >> v2:172.21.15.190:3300/0 conn(0x7f0ae80c6730 0x7f0ae806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80cedb0 con 0x7f0ae81625f0 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f0ae00019f0 con 0x7f0ae81625f0 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 >> v1:172.21.15.190:6789/0 conn(0x7f0ae81625f0 legacy=0x7f0ae80d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7fe2f5134640 1 -- start start 2024-05-10T11:12:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ad00039b0 0x7f0ad0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7f3af1d78640 1 -- start start 2024-05-10T11:12:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.196+0000 7fb3c2ffd640 1 --2- 172.21.15.66:0/3396779108 >> v2:172.21.15.66:3300/0 conn(0x7fb3c41636f0 0x7fb3c40add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7240693f0 con 0x7fe724070dc0 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f329542e640 1 -- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32901463c0 msgr2=0x7f329015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f329542e640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32901463c0 0x7f329015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f329542e640 1 -- 172.21.15.66:0/2856013183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290164490 msgr2=0x7f32900ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f329542e640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290164490 0x7f32900ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f329542e640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3290146eb0 con 0x7f3290149170 2024-05-10T11:12:47.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ad0004800 0x7f0ad0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fb3c2ffd640 1 -- 172.21.15.66:0/3396779108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4167870 msgr2=0x7fb3c406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fb3c2ffd640 1 --2- 172.21.15.66:0/3396779108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4167870 0x7fb3c406eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fb3c2ffd640 1 -- 172.21.15.66:0/3396779108 >> v1:172.21.15.190:6789/0 conn(0x7fb3c40d0480 legacy=0x7fb3c4167160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T11:12:47.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.197+0000 7fb3c2ffd640 1 -- 172.21.15.66:0/3396779108 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c40b03f0 con 0x7fb3c41636f0 2024-05-10T11:12:47.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.198+0000 7fb3c2ffd640 1 --2- 172.21.15.66:0/3396779108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c41636f0 0x7fb3c40add50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009a00 tx=0x7fb3ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daa77c86e92eb99 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80c6500 con 0x7f0ad00039b0 2024-05-10T11:12:47.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80ce880 con 0x7f0ad0004800 2024-05-10T11:12:47.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad000bb20 con 0x7f0ae80c5b70 2024-05-10T11:12:47.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0ae7fff640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ad0004800 0x7f0ad0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0aed2d5640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f3af1d78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 0x7f3aec156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f3af1d78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3aec159a20 0x7f3aec1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f3af1d78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec15ff70 0x7f3aec1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f0aecad4640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ad00039b0 0x7f0ad0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f3af1d78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec06fc70 con 0x7f3aec159a20 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f3af1d78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec159e00 con 0x7f3aec15ff70 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.199+0000 7f3af1d78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec06fdf0 con 0x7f3aec0cfa40 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 0x7f3aec156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f0aed2d5640 1 -- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ad0004800 msgr2=0x7f0ad0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f0aed2d5640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ad0004800 0x7f0ad0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f0aed2d5640 1 -- 172.21.15.66:0/3756355919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ad00039b0 msgr2=0x7f0ad0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f0aed2d5640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ad00039b0 0x7f0ad0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f0aed2d5640 1 -- 172.21.15.66:0/3756355919 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80cedb0 con 0x7f0ae80c5b70 2024-05-10T11:12:47.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 0x7f3aec156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53438/0 (socket says 172.21.15.66:53438) 2024-05-10T11:12:47.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 -- 172.21.15.66:0/869493439 learned_addr learned my addr 172.21.15.66:0/869493439 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f6d03e83640 1 Processor -- start 2024-05-10T11:12:47.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f0ae7fff640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ad0004800 0x7f0ad0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aebfff640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec15ff70 0x7f3aec1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f5134640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e80dab80 0x7fe2e80daf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f5134640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8178460 0x7fe2e816b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f5134640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 0x7fe2e80e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f5134640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e80546f0 con 0x7fe2e8178460 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f5134640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e8007380 con 0x7fe2e80dab80 2024-05-10T11:12:47.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f5134640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e8054870 con 0x7fe2e80e0200 2024-05-10T11:12:47.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fb3c27fc640 1 -- 172.21.15.66:0/3396779108 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac037070 con 0x7fb3c41636f0 2024-05-10T11:12:47.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 -- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec15ff70 msgr2=0x7f3aec1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f6d03e83640 1 -- start start 2024-05-10T11:12:47.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec15ff70 0x7f3aec1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 -- 172.21.15.66:0/869493439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3aec159a20 msgr2=0x7f3aec1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3aec159a20 0x7f3aec1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f4933640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 0x7fe2e80e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f3aeb7fe640 1 -- 172.21.15.66:0/869493439 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec158310 con 0x7f3aec0cfa40 2024-05-10T11:12:47.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f4933640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 0x7fe2e80e19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53454/0 (socket says 172.21.15.66:53454) 2024-05-10T11:12:47.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fe2f4933640 1 -- 172.21.15.66:0/158367939 learned_addr learned my addr 172.21.15.66:0/158367939 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7f329542e640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 0x7f32900cc5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f328000ba80 tx=0x7f328000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.200+0000 7fd0561db640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0400051c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd048001920 tx=0x7fd040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed31faad23cffe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3aeb7fe640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 0x7f3aec156b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00c780 tx=0x7f3adc00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7fe2effff640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e80dab80 0x7fe2e80daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc018070 con 0x7f3aec0cfa40 2024-05-10T11:12:47.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec157550 con 0x7f3aec0cfa40 2024-05-10T11:12:47.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aec157b10 con 0x7f3aec0cfa40 2024-05-10T11:12:47.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3adc0072d0 con 0x7f3aec0cfa40 2024-05-10T11:12:47.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f0aed2d5640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ad00051c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800ba00 tx=0x7f0ad0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f479476a3a9df131 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7fe2f4933640 1 -- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e80dab80 msgr2=0x7fe2e80daf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7fe2f4933640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e80dab80 0x7fe2e80daf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7fe2f4933640 1 -- 172.21.15.66:0/158367939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8178460 msgr2=0x7fe2e816b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7fe2f4933640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8178460 0x7fe2e816b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7fe2f4933640 1 -- 172.21.15.66:0/158367939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e80e0680 con 0x7fe2e80e0200 2024-05-10T11:12:47.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc018070 con 0x7f3aec0cfa40 2024-05-10T11:12:47.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f6d03e83640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6cfc06f4c0 0x7f6cfc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f6d03e83640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc15f6e0 con 0x7f6cfc15b640 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f6d03e83640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc15f9c0 con 0x7f6cfc0cd6c0 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f6d03e83640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc15fca0 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d0141e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6cfc06f4c0 0x7f6cfc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d0141e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6cfc06f4c0 0x7f6cfc15ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43924/0 (socket says 172.21.15.66:43924) 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d0141e640 1 -- 172.21.15.66:0/3535438740 learned_addr learned my addr 172.21.15.66:0/3535438740 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8030070 con 0x7f0ae80c5b70 2024-05-10T11:12:47.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad802ade0 con 0x7f0ae80c5b70 2024-05-10T11:12:47.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f0ae77fe640 1 -- 172.21.15.66:0/3756355919 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800b600 con 0x7f0ae80c5b70 2024-05-10T11:12:47.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d00c1d640 1 -- 172.21.15.66:0/3535438740 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 875294760 0 0) 0x7f6cfc15f9c0 con 0x7f6cfc0cd6c0 2024-05-10T11:12:47.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d00c1d640 1 -- 172.21.15.66:0/3535438740 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce8003520 con 0x7f6cfc0cd6c0 2024-05-10T11:12:47.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d0141e640 1 -- 172.21.15.66:0/3535438740 >> v1:172.21.15.190:6789/0 conn(0x7f6cfc0cd6c0 legacy=0x7f6cfc0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d0141e640 1 -- 172.21.15.66:0/3535438740 >> v1:172.21.15.66:6789/0 conn(0x7f6cfc15b640 legacy=0x7f6cfc15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f6d0141e640 1 -- 172.21.15.66:0/3535438740 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc15bbf0 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280019070 con 0x7f3290149170 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328000cc90 con 0x7f3290149170 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280014680 con 0x7f3290149170 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32900ca7a0 con 0x7f3290149170 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.201+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32900c9970 con 0x7f3290149170 2024-05-10T11:12:47.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32900765a0 con 0x7f3290149170 2024-05-10T11:12:47.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 msgr2=0x7f0ad00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3acc005290 con 0x7f3aec0cfa40 2024-05-10T11:12:47.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f0aeed38640 1 --2- 172.21.15.66:0/3756355919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ad00051c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800ba00 tx=0x7f0ad0005830 comp rx=0 tx=0).stop 2024-05-10T11:12:47.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f0aed2d5640 1 -- 172.21.15.66:0/3756355919 reap_dead start 2024-05-10T11:12:47.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.202+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe720044020 con 0x7fe724070dc0 2024-05-10T11:12:47.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7fe719ffb640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7080763d0 0x7fe708078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 shutdown_connections 2024-05-10T11:12:47.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 >> 172.21.15.66:0/3756355919 conn(0x7f0ae80b2900 msgr2=0x7f0ae80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7fb3c27fc640 1 -- 172.21.15.66:0/3396779108 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac02ae00 con 0x7fb3c41636f0 2024-05-10T11:12:47.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7fb3c27fc640 1 -- 172.21.15.66:0/3396779108 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac032660 con 0x7fb3c41636f0 2024-05-10T11:12:47.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7fe728d5c640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7080763d0 0x7fe708078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7200b8260 con 0x7fe724070dc0 2024-05-10T11:12:47.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f6d0141e640 1 --2- 172.21.15.66:0/3535438740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc06f4c0 0x7f6cfc15ee90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cec008870 tx=0x7f6cec02c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3211300e44900659 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7fe2f4933640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 0x7fe2e80e19f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc006fd0 tx=0x7fe2dc00f5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.203+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 shutdown_connections 2024-05-10T11:12:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d00c1d640 1 -- 172.21.15.66:0/3535438740 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec03a070 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d00c1d640 1 -- 172.21.15.66:0/3535438740 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec032480 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f0aeed38640 1 -- 172.21.15.66:0/3756355919 wait complete. 2024-05-10T11:12:47.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7fe728d5c640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7080763d0 0x7fe708078890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009c90 tx=0x7fe71c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d03e83640 1 -- 172.21.15.66:0/3535438740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc06f4c0 msgr2=0x7f6cfc15ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d03e83640 1 --2- 172.21.15.66:0/3535438740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc06f4c0 0x7f6cfc15ee90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cec008870 tx=0x7f6cec02c7a0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d03e83640 1 -- 172.21.15.66:0/3535438740 shutdown_connections 2024-05-10T11:12:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7fb3c93af640 1 -- 172.21.15.66:0/3396779108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c41636f0 msgr2=0x7fb3c40add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7fb3c93af640 1 --2- 172.21.15.66:0/3396779108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c41636f0 0x7fb3c40add50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009a00 tx=0x7fb3ac02a300 comp rx=0 tx=0).stop 2024-05-10T11:12:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3280003a10 con 0x7f3290149170 2024-05-10T11:12:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d03e83640 1 --2- 172.21.15.66:0/3535438740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc06f4c0 0x7f6cfc15ee90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d03e83640 1 -- 172.21.15.66:0/3535438740 >> 172.21.15.66:0/3535438740 conn(0x7f6cfc06cd60 msgr2=0x7f6cfc0b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3adc007480 con 0x7f3aec0cfa40 2024-05-10T11:12:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.204+0000 7f6d03e83640 1 -- 172.21.15.66:0/3535438740 shutdown_connections 2024-05-10T11:12:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f6d03e83640 1 -- 172.21.15.66:0/3535438740 wait complete. 2024-05-10T11:12:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7fb3c93af640 1 -- 172.21.15.66:0/3396779108 shutdown_connections 2024-05-10T11:12:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7fb3c93af640 1 --2- 172.21.15.66:0/3396779108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4167870 0x7fb3c406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7fb3c93af640 1 --2- 172.21.15.66:0/3396779108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c41636f0 0x7fb3c40add50 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009a00 tx=0x7fb3ac02a300 comp rx=0 tx=0).stop 2024-05-10T11:12:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7fb3c93af640 1 -- 172.21.15.66:0/3396779108 >> 172.21.15.66:0/3396779108 conn(0x7fb3c406cd60 msgr2=0x7fb3c40b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7fb3c93af640 1 -- 172.21.15.66:0/3396779108 shutdown_connections 2024-05-10T11:12:47.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f328e7fc640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f327c076300 0x7f327c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f3ad3fff640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ad80766d0 0x7f3ad8078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3adc0070d0 con 0x7f3aec0cfa40 2024-05-10T11:12:47.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3280097750 con 0x7f3290149170 2024-05-10T11:12:47.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f3295c2f640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f327c076300 0x7f327c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.205+0000 7f3aeaffd640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ad80766d0 0x7f3ad8078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7fb3c93af640 1 -- 172.21.15.66:0/3396779108 wait complete. 2024-05-10T11:12:47.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7f3295c2f640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f327c076300 0x7f327c0787c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32901fc830 tx=0x7f3288008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7f3aeaffd640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ad80766d0 0x7f3ad8078b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0036000 tx=0x7f3ae002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7f0aeed38640 1 Processor -- start 2024-05-10T11:12:47.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7f6d03e83640 1 Processor -- start 2024-05-10T11:12:47.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7f0aeed38640 1 -- start start 2024-05-10T11:12:47.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.206+0000 7f6d03e83640 1 -- start start 2024-05-10T11:12:47.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d03e83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 0x7f6cfc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7fb3c93af640 1 Processor -- start 2024-05-10T11:12:47.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d03e83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cfc0cd6c0 0x7f6cfc15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7fb3c93af640 1 -- start start 2024-05-10T11:12:47.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d03e83640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc15b640 0x7f6cfc15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d03e83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0b3010 con 0x7f6cfc0cd6c0 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 0x7f6cfc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d03e83640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc15f3d0 con 0x7f6cfc15b640 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d03e83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc0b3190 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 0x7f6cfc155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53462/0 (socket says 172.21.15.66:53462) 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 -- 172.21.15.66:0/2086680540 learned_addr learned my addr 172.21.15.66:0/2086680540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d0141e640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cfc0cd6c0 0x7f6cfc15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d02420640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc15b640 0x7f6cfc15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 -- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc15b640 msgr2=0x7f6cfc15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc15b640 0x7f6cfc15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 -- 172.21.15.66:0/2086680540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cfc0cd6c0 msgr2=0x7f6cfc15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cfc0cd6c0 0x7f6cfc15ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.207+0000 7f6d01c1f640 1 -- 172.21.15.66:0/2086680540 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc15d960 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f6d01c1f640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 0x7f6cfc155b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c430 tx=0x7f6cf800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aeed38640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aeed38640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae80b3fa0 0x7f0ae80b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aeed38640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 0x7f0ae80b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aeed38640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae81629d0 con 0x7f0ae80b1b30 2024-05-10T11:12:47.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c93af640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c40d0480 0x7fb3c40b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c93af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 0x7fb3c4164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aed2d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 0x7f0ae80b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c93af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4153000 0x7fb3c4165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 0x7fb3c4164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0ae7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae80b3fa0 0x7f0ae80b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c93af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c40d08e0 con 0x7fb3c4167870 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c40d0480 0x7fb3c40b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 0x7fb3c4164ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39974/0 (socket says 172.21.15.66:39974) 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3bbfff640 1 -- 172.21.15.66:0/554982161 learned_addr learned my addr 172.21.15.66:0/554982161 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c40ced00 con 0x7fb3c40d0480 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c40d0a60 con 0x7fb3c4153000 2024-05-10T11:12:47.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aed2d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 0x7f0ae80b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39966/0 (socket says 172.21.15.66:39966) 2024-05-10T11:12:47.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fb3c37fe640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4153000 0x7fb3c4165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc014660 con 0x7fe2e80e0200 2024-05-10T11:12:47.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8017070 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e80e0950 con 0x7fe2e80e0200 2024-05-10T11:12:47.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e80e0f10 con 0x7fe2e80e0200 2024-05-10T11:12:47.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f6d03e83640 1 -- 172.21.15.66:0/2086680540 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc15f140 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aecad4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3280060d50 con 0x7f3290149170 2024-05-10T11:12:47.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f6d03e83640 1 -- 172.21.15.66:0/2086680540 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc15dc00 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.208+0000 7f0aed2d5640 1 -- 172.21.15.66:0/356434792 learned_addr learned my addr 172.21.15.66:0/356434792 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80aec50 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae806e2d0 con 0x7f0ae80c5b70 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3bbfff640 1 -- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4153000 msgr2=0x7fb3c4165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3bbfff640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4153000 0x7fb3c4165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3bbfff640 1 -- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c40d0480 msgr2=0x7fb3c40b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3bbfff640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c40d0480 0x7fb3c40b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3bbfff640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c40b5290 con 0x7fb3c4167870 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3c2ffd640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c40d0480 0x7fb3c40b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:47.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fb3bbfff640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 0x7fb3c4164ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400b450 tx=0x7fb3b400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0ae7fff640 1 -- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 msgr2=0x7f0ae815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0ae7fff640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0ae7fff640 1 -- 172.21.15.66:0/356434792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 msgr2=0x7f0ae80b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0ae7fff640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 0x7f0ae80b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0ae7fff640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80b4a40 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7f0aed2d5640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 0x7f0ae80b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:47.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.209+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e80089c0 con 0x7fe2e80e0200 2024-05-10T11:12:47.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f0ae7fff640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae80b3fa0 0x7f0ae80b4400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00f4e0 tx=0x7f0adc00f9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f6d03e83640 1 -- 172.21.15.66:0/2086680540 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc06a220 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc004030 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc01c070 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae80b4d20 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc004410 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.210+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae80b52e0 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048001520 con 0x7fd040004d40 2024-05-10T11:12:47.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd048005ad0 con 0x7fd040004d40 2024-05-10T11:12:47.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fd0549d8640 1 -- 172.21.15.66:0/2086332678 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048007070 con 0x7fd040004d40 2024-05-10T11:12:47.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4015020 con 0x7fb3c4167870 2024-05-10T11:12:47.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae806a220 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe72004b030 con 0x7fe724070dc0 2024-05-10T11:12:47.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b4011890 con 0x7fb3c4167870 2024-05-10T11:12:47.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011c80 con 0x7fb3c4167870 2024-05-10T11:12:47.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c40b5570 con 0x7fb3c4167870 2024-05-10T11:12:47.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.211+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c41611d0 con 0x7fb3c4167870 2024-05-10T11:12:47.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7fd057c3e640 1 -- 172.21.15.66:0/2086332678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 msgr2=0x7fd0400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7fd057c3e640 1 --2- 172.21.15.66:0/2086332678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0400051c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd048001920 tx=0x7fd040005830 comp rx=0 tx=0).stop 2024-05-10T11:12:47.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7fd0561db640 1 -- 172.21.15.66:0/2086332678 reap_dead start 2024-05-10T11:12:47.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0adc003610 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7fd057c3e640 1 -- 172.21.15.66:0/2086332678 shutdown_connections 2024-05-10T11:12:47.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7fd057c3e640 1 -- 172.21.15.66:0/2086332678 >> 172.21.15.66:0/2086332678 conn(0x7fd0500d2e70 msgr2=0x7fd0500d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.212+0000 7fd057c3e640 1 -- 172.21.15.66:0/2086332678 shutdown_connections 2024-05-10T11:12:47.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf80052d0 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8021060 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7fd057c3e640 1 -- 172.21.15.66:0/2086332678 wait complete. 2024-05-10T11:12:47.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7f0ae57fa640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ad40762d0 0x7f0ad4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0adc09fbd0 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3aec158310 con 0x7f3aec0cfa40 2024-05-10T11:12:47.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7f0aecad4640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ad40762d0 0x7f0ad4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc01a070 con 0x7fe2e80e0200 2024-05-10T11:12:47.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc005b90 con 0x7fe2e80e0200 2024-05-10T11:12:47.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.213+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb3b4018020 con 0x7fb3c4167870 2024-05-10T11:12:47.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7fd057c3e640 1 Processor -- start 2024-05-10T11:12:47.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7fd057c3e640 1 -- start start 2024-05-10T11:12:47.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7fb3bb7fe640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb3a40763a0 0x7fb3a4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.214+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c406a220 con 0x7fb3c4167870 2024-05-10T11:12:47.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.215+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb3b40979f0 con 0x7fb3c4167870 2024-05-10T11:12:47.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6cf801a070 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7f6cf27fc640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ce00762d0 0x7f6ce0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6cf8097430 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7f6d0141e640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ce00762d0 0x7f6ce0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.215+0000 7f0aecad4640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ad40762d0 0x7f0ad4078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000f80 tx=0x7f0ae0001860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2dc012070 con 0x7fe2e80e0200 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fe2ecff9640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2d4076300 0x7fe2d40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fe2effff640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2d4076300 0x7fe2d40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe2dc098060 con 0x7fe2e80e0200 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd057c3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0500ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd057c3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0500d0d70 0x7fd0500d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd0559da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0500ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd0559da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0500ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39984/0 (socket says 172.21.15.66:39984) 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd0559da640 1 -- 172.21.15.66:0/2264645996 learned_addr learned my addr 172.21.15.66:0/2264645996 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd057c3e640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b2ab0 0x7fd0500b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd057c3e640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015daa0 con 0x7fd040004d40 2024-05-10T11:12:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd057c3e640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015d920 con 0x7fd0500d0d70 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fd057c3e640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500cf3b0 con 0x7fd0500b2ab0 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0551d9640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0500d0d70 0x7fd0500d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0561db640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b2ab0 0x7fd0500b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0559da640 1 -- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b2ab0 msgr2=0x7fd0500b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0559da640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b2ab0 0x7fd0500b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0559da640 1 -- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0500d0d70 msgr2=0x7fd0500d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0559da640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0500d0d70 0x7fd0500d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0559da640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05015a120 con 0x7fd040004d40 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fd0559da640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0500ca950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd04400eb20 tx=0x7fd044002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.216+0000 7fb3c2ffd640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb3a40763a0 0x7fb3a4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.217+0000 7fb3c2ffd640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb3a40763a0 0x7fb3a4078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac034000 tx=0x7fb3ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.218+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0adc068b90 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.218+0000 7f6d0141e640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ce00762d0 0x7f6ce0078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6cec037000 tx=0x7f6cec030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.218+0000 7fe2effff640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2d4076300 0x7fe2d40787c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0051c90 tx=0x7fe2f008f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.219+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe2dc0615d0 con 0x7fe2e80e0200 2024-05-10T11:12:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.224+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6cf8060470 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.225+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044003b80 con 0x7fd040004d40 2024-05-10T11:12:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.225+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044018070 con 0x7fd040004d40 2024-05-10T11:12:47.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.225+0000 7fd057c3e640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05015a400 con 0x7fd040004d40 2024-05-10T11:12:47.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.225+0000 7fd057c3e640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05015a9c0 con 0x7fd040004d40 2024-05-10T11:12:47.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.225+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400c7e0 con 0x7fd040004d40 2024-05-10T11:12:47.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.225+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb3b401f020 con 0x7fb3c4167870 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.232+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd04400c980 con 0x7fd040004d40 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.233+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0500693f0 con 0x7fd040004d40 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.243+0000 7fd04e7fc640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0340763d0 0x7fd034078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.243+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd044097620 con 0x7fd040004d40 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.244+0000 7fd0551d9640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0340763d0 0x7fd034078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.244+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd044099b30 con 0x7fd040004d40 2024-05-10T11:12:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.257+0000 7fd0551d9640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0340763d0 0x7fd034078890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd05006ed50 tx=0x7fd03c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:47.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.656+0000 7f3297e93640 1 -- 172.21.15.66:0/2856013183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3290161100 con 0x7f3290149170 2024-05-10T11:12:47.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.656+0000 7f328e7fc640 1 -- 172.21.15.66:0/2856013183 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3280060650 con 0x7f3290149170 2024-05-10T11:12:47.657 INFO:teuthology.orchestra.run.smithi066.stdout:60129542152 2024-05-10T11:12:47.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.658+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe7240b62c0 con 0x7fe724070dc0 2024-05-10T11:12:47.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.658+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3acc005580 con 0x7f3aec0cfa40 2024-05-10T11:12:47.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.659+0000 7f3ad3fff640 1 -- 172.21.15.66:0/869493439 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3aec158310 con 0x7f3aec0cfa40 2024-05-10T11:12:47.659 INFO:teuthology.orchestra.run.smithi066.stdout:55834574856 2024-05-10T11:12:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.659+0000 7fe719ffb640 1 -- 172.21.15.66:0/1487183661 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe720081a10 con 0x7fe724070dc0 2024-05-10T11:12:47.660 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:47.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.660+0000 7f3277fff640 1 -- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f327c076300 msgr2=0x7f327c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f327c076300 0x7f327c0787c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32901fc830 tx=0x7f3288008040 comp rx=0 tx=0).stop 2024-05-10T11:12:47.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 -- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 msgr2=0x7f32900cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 0x7f32900cc5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f328000ba80 tx=0x7f328000bf40 comp rx=0 tx=0).stop 2024-05-10T11:12:47.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 -- 172.21.15.66:0/2856013183 shutdown_connections 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f327c076300 0x7f327c0787c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3290164490 0x7f32900ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290149170 0x7f32900cc5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 --2- 172.21.15.66:0/2856013183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32901463c0 0x7f329015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 -- 172.21.15.66:0/2856013183 >> 172.21.15.66:0/2856013183 conn(0x7f32900d0aa0 msgr2=0x7f329006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 -- 172.21.15.66:0/2856013183 shutdown_connections 2024-05-10T11:12:47.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.661+0000 7f3277fff640 1 -- 172.21.15.66:0/2856013183 wait complete. 2024-05-10T11:12:47.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.662+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0ae80b24f0 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ad80766d0 msgr2=0x7f3ad8078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ad80766d0 0x7f3ad8078b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0036000 tx=0x7f3ae002e000 comp rx=0 tx=0).stop 2024-05-10T11:12:47.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 msgr2=0x7f3aec156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 0x7f3aec156b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00c780 tx=0x7f3adc00cc40 comp rx=0 tx=0).stop 2024-05-10T11:12:47.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 shutdown_connections 2024-05-10T11:12:47.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7080763d0 msgr2=0x7fe708078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7080763d0 0x7fe708078890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009c90 tx=0x7fe71c00b040 comp rx=0 tx=0).stop 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 msgr2=0x7fe7240b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 0x7fe7240b08f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7200098c0 tx=0x7fe720004730 comp rx=0 tx=0).stop 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ad80766d0 0x7f3ad8078b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 shutdown_connections 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7080763d0 0x7fe708078890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe72415be70 0x7fe7240cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe724071360 0x7fe72414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 --2- 172.21.15.66:0/1487183661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724070dc0 0x7fe7240b08f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 >> 172.21.15.66:0/1487183661 conn(0x7fe7240d1d70 msgr2=0x7fe72406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aec15ff70 0x7f3aec1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3aec159a20 0x7f3aec1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 --2- 172.21.15.66:0/869493439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aec0cfa40 0x7f3aec156b20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 >> 172.21.15.66:0/869493439 conn(0x7f3aec0d14f0 msgr2=0x7f3aec0d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.666 INFO:teuthology.orchestra.run.smithi066.stdout:60129542152 2024-05-10T11:12:47.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.663+0000 7f0ae57fa640 1 -- 172.21.15.66:0/356434792 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0adc06ce90 con 0x7f0ae80b3fa0 2024-05-10T11:12:47.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.664+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 shutdown_connections 2024-05-10T11:12:47.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.664+0000 7f3af1d78640 1 -- 172.21.15.66:0/869493439 wait complete. 2024-05-10T11:12:47.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.664+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 shutdown_connections 2024-05-10T11:12:47.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.664+0000 7fe72b7c1640 1 -- 172.21.15.66:0/1487183661 wait complete. 2024-05-10T11:12:47.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.665+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe2e804b8f0 con 0x7fe2e80e0200 2024-05-10T11:12:47.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.665+0000 7fe2ecff9640 1 -- 172.21.15.66:0/158367939 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2dc060ed0 con 0x7fe2e80e0200 2024-05-10T11:12:47.669 INFO:teuthology.orchestra.run.smithi066.stdout:64424509449 2024-05-10T11:12:47.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.667+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ad40762d0 msgr2=0x7f0ad4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.667+0000 7f0aeed38640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ad40762d0 0x7f0ad4078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000f80 tx=0x7f0ae0001860 comp rx=0 tx=0).stop 2024-05-10T11:12:47.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.667+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae80b3fa0 msgr2=0x7f0ae80b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.667+0000 7f0aeed38640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae80b3fa0 0x7f0ae80b4400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00f4e0 tx=0x7f0adc00f9a0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 shutdown_connections 2024-05-10T11:12:47.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ad40762d0 0x7f0ad4078790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ae80b1b30 0x7f0ae80b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae80b3fa0 0x7f0ae80b4400 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 --2- 172.21.15.66:0/356434792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae80c5b70 0x7f0ae815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 >> 172.21.15.66:0/356434792 conn(0x7f0ae80b2900 msgr2=0x7f0ae8161180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 shutdown_connections 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.668+0000 7f0aeed38640 1 -- 172.21.15.66:0/356434792 wait complete. 2024-05-10T11:12:47.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.669+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb3c40cdde0 con 0x7fb3c4167870 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.669+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2d4076300 msgr2=0x7fe2d40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.669+0000 7fe2f5134640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2d4076300 0x7fe2d40787c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0051c90 tx=0x7fe2f008f040 comp rx=0 tx=0).stop 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.669+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 msgr2=0x7fe2e80e19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.669+0000 7fe2f5134640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 0x7fe2e80e19f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc006fd0 tx=0x7fe2dc00f5d0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 shutdown_connections 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe2d4076300 0x7fe2d40787c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2e80e0200 0x7fe2e80e19f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8178460 0x7fe2e816b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 --2- 172.21.15.66:0/158367939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2e80dab80 0x7fe2e80daf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 >> 172.21.15.66:0/158367939 conn(0x7fe2e8009fa0 msgr2=0x7fe2e803a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 shutdown_connections 2024-05-10T11:12:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fe2f5134640 1 -- 172.21.15.66:0/158367939 wait complete. 2024-05-10T11:12:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.670+0000 7fb3bb7fe640 1 -- 172.21.15.66:0/554982161 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3b400d040 con 0x7fb3c4167870 2024-05-10T11:12:47.674 INFO:teuthology.orchestra.run.smithi066.stdout:64424509449 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.674+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb3a40763a0 msgr2=0x7fb3a4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.674+0000 7fb3c93af640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb3a40763a0 0x7fb3a4078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac034000 tx=0x7fb3ac02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.674+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 msgr2=0x7fb3c4164ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.674+0000 7fb3c93af640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 0x7fb3c4164ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400b450 tx=0x7fb3b400b910 comp rx=0 tx=0).stop 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 shutdown_connections 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb3a40763a0 0x7fb3a4078860 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac034000 tx=0x7fb3ac02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3c4153000 0x7fb3c4165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c4167870 0x7fb3c4164ff0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 --2- 172.21.15.66:0/554982161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c40d0480 0x7fb3c40b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 >> 172.21.15.66:0/554982161 conn(0x7fb3c406cd60 msgr2=0x7fb3c415db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 shutdown_connections 2024-05-10T11:12:47.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.675+0000 7fb3c93af640 1 -- 172.21.15.66:0/554982161 wait complete. 2024-05-10T11:12:47.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.676+0000 7f6d03e83640 1 -- 172.21.15.66:0/2086680540 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6cfc0c7760 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.676+0000 7f6cf27fc640 1 -- 172.21.15.66:0/2086680540 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6cf8064770 con 0x7f6cfc06f4c0 2024-05-10T11:12:47.677 INFO:teuthology.orchestra.run.smithi066.stdout:60129542152 2024-05-10T11:12:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.680+0000 7f6cdffff640 1 -- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ce00762d0 msgr2=0x7f6ce0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ce00762d0 0x7f6ce0078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6cec037000 tx=0x7f6cec030000 comp rx=0 tx=0).stop 2024-05-10T11:12:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 -- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 msgr2=0x7f6cfc155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 0x7f6cfc155b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c430 tx=0x7f6cf800c8f0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 -- 172.21.15.66:0/2086680540 shutdown_connections 2024-05-10T11:12:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ce00762d0 0x7f6ce0078790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cfc15b640 0x7f6cfc15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cfc0cd6c0 0x7f6cfc15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 --2- 172.21.15.66:0/2086680540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cfc06f4c0 0x7f6cfc155b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.681+0000 7f6cdffff640 1 -- 172.21.15.66:0/2086680540 >> 172.21.15.66:0/2086680540 conn(0x7f6cfc06cd60 msgr2=0x7f6cfc0ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.682+0000 7f6cdffff640 1 -- 172.21.15.66:0/2086680540 shutdown_connections 2024-05-10T11:12:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.682+0000 7f6cdffff640 1 -- 172.21.15.66:0/2086680540 wait complete. 2024-05-10T11:12:47.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.3 2024-05-10T11:12:47.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2024-05-10T11:12:47.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.689+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd0500c6460 con 0x7fd040004d40 2024-05-10T11:12:47.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.689+0000 7fd04e7fc640 1 -- 172.21.15.66:0/2264645996 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd044060c20 con 0x7fd040004d40 2024-05-10T11:12:47.690 INFO:teuthology.orchestra.run.smithi066.stdout:64424509449 2024-05-10T11:12:47.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2024-05-10T11:12:47.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0340763d0 msgr2=0x7fd034078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0340763d0 0x7fd034078890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd05006ed50 tx=0x7fd03c008040 comp rx=0 tx=0).stop 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 msgr2=0x7fd0500ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0500ca950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd04400eb20 tx=0x7fd044002190 comp rx=0 tx=0).stop 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 shutdown_connections 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0340763d0 0x7fd034078890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0500b2ab0 0x7fd0500b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0500d0d70 0x7fd0500d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 --2- 172.21.15.66:0/2264645996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd040004d40 0x7fd0500ca950 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 >> 172.21.15.66:0/2264645996 conn(0x7fd0500d2e70 msgr2=0x7fd0501e6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 shutdown_connections 2024-05-10T11:12:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:47.692+0000 7fd033fff640 1 -- 172.21.15.66:0/2264645996 wait complete. 2024-05-10T11:12:47.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2024-05-10T11:12:47.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-05-10T11:12:47.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-05-10T11:12:47.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.1 2024-05-10T11:12:47.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-05-10T11:12:48.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T11:12:48.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T11:12:48.691 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T11:12:48.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T11:12:48.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T11:12:48.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T11:12:48.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T11:12:48.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T11:12:48.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.860+0000 7ff64eefd640 1 Processor -- start 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.861+0000 7ff64eefd640 1 -- start start 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.862+0000 7ff64eefd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff640050500 0x7ff640007bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.862+0000 7ff64eefd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6400512f0 con 0x7ff6400e0120 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.862+0000 7ff64eefd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6400549d0 con 0x7ff6400dfd40 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.862+0000 7ff64eefd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff640054cb0 con 0x7ff640050500 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.863+0000 7ff64d6fa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff640050500 0x7ff640007bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.863+0000 7ff64d6fa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff640050500 0x7ff640007bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:43984/0 (socket says 172.21.15.66:43984) 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.863+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2793078845 learned_addr learned my addr 172.21.15.66:0/2793078845 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.864+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2793078845 >> v1:172.21.15.190:6789/0 conn(0x7ff6400dfd40 legacy=0x7ff640050be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.864+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2793078845 >> v1:172.21.15.66:6789/0 conn(0x7ff6400e0120 legacy=0x7ff640008110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T11:12:48.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.864+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2793078845 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff640054f90 con 0x7ff640050500 2024-05-10T11:12:48.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.865+0000 7ff64d6fa640 1 --2- 172.21.15.66:0/2793078845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff640050500 0x7ff640007bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff64802e0e0 tx=0x7ff6480a6580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8952ebe920ebf46 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.866+0000 7ff64cef9640 1 -- 172.21.15.66:0/2793078845 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480b2070 con 0x7ff640050500 2024-05-10T11:12:48.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.866+0000 7ff64cef9640 1 -- 172.21.15.66:0/2793078845 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6480ab7d0 con 0x7ff640050500 2024-05-10T11:12:48.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.867+0000 7ff64eefd640 1 -- 172.21.15.66:0/2793078845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff640050500 msgr2=0x7ff640007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.867+0000 7ff64eefd640 1 --2- 172.21.15.66:0/2793078845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff640050500 0x7ff640007bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff64802e0e0 tx=0x7ff6480a6580 comp rx=0 tx=0).stop 2024-05-10T11:12:48.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.867+0000 7ff64eefd640 1 -- 172.21.15.66:0/2793078845 shutdown_connections 2024-05-10T11:12:48.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.867+0000 7ff64eefd640 1 --2- 172.21.15.66:0/2793078845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff640050500 0x7ff640007bd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.867+0000 7ff64eefd640 1 -- 172.21.15.66:0/2793078845 >> 172.21.15.66:0/2793078845 conn(0x7ff640055bc0 msgr2=0x7ff640055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.868+0000 7ff64eefd640 1 -- 172.21.15.66:0/2793078845 shutdown_connections 2024-05-10T11:12:48.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.868+0000 7ff64eefd640 1 -- 172.21.15.66:0/2793078845 wait complete. 2024-05-10T11:12:48.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.870+0000 7ff64eefd640 1 Processor -- start 2024-05-10T11:12:48.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.870+0000 7ff64eefd640 1 -- start start 2024-05-10T11:12:48.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.871+0000 7ff64eefd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6400dfd40 0x7ff6400e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.872+0000 7ff64eefd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 0x7ff6400da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.872+0000 7ff64d6fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 0x7ff6400da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.872+0000 7ff64defb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6400dfd40 0x7ff6400e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.872+0000 7ff64defb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6400dfd40 0x7ff6400e0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53506/0 (socket says 172.21.15.66:53506) 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.872+0000 7ff64d6fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 0x7ff6400da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39988/0 (socket says 172.21.15.66:39988) 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.872+0000 7ff64defb640 1 -- 172.21.15.66:0/2702128077 learned_addr learned my addr 172.21.15.66:0/2702128077 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.873+0000 7ff64eefd640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6400e3110 0x7ff6400dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.873+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff640039e00 con 0x7ff6400e0120 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.873+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff640055550 con 0x7ff6400e3110 2024-05-10T11:12:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.873+0000 7ff64e6fc640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6400e3110 0x7ff6400dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.873+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff640039f80 con 0x7ff6400dfd40 2024-05-10T11:12:48.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.874+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6400dfd40 msgr2=0x7ff6400e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.874+0000 7ff64d6fa640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6400dfd40 0x7ff6400e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.874+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6400e3110 msgr2=0x7ff6400dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.874+0000 7ff64d6fa640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6400e3110 0x7ff6400dace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.874+0000 7ff64d6fa640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6400e18b0 con 0x7ff6400e0120 2024-05-10T11:12:48.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.875+0000 7ff64d6fa640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 0x7ff6400da7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6480520f0 tx=0x7ff64806a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.875+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480b2040 con 0x7ff6400e0120 2024-05-10T11:12:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.876+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6400e1b90 con 0x7ff6400e0120 2024-05-10T11:12:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.876+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64004a2a0 con 0x7ff6400e0120 2024-05-10T11:12:48.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.879+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6480addb0 con 0x7ff6400e0120 2024-05-10T11:12:48.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.879+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480b8670 con 0x7ff6400e0120 2024-05-10T11:12:48.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.881+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6480c1020 con 0x7ff6400e0120 2024-05-10T11:12:48.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.882+0000 7ff63e7fc640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff634076520 0x7ff6340789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.883+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff6481342a0 con 0x7ff6400e0120 2024-05-10T11:12:48.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.883+0000 7ff64defb640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff634076520 0x7ff6340789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.884+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff630005290 con 0x7ff6400e0120 2024-05-10T11:12:48.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.893+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff6400512f0 con 0x7ff6400e0120 2024-05-10T11:12:48.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.900+0000 7ff64defb640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff634076520 0x7ff6340789e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff644001770 tx=0x7ff644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.917+0000 7f517359e640 1 Processor -- start 2024-05-10T11:12:48.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.917+0000 7f517359e640 1 -- start start 2024-05-10T11:12:48.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.918+0000 7f24e81c9640 1 Processor -- start 2024-05-10T11:12:48.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.918+0000 7f24e81c9640 1 -- start start 2024-05-10T11:12:48.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f517359e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f516c0e7870 0x7f516c050430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f517359e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f516c0071d0 0x7f516c050970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f517359e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516c0510b0 con 0x7f516c0e7490 2024-05-10T11:12:48.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f517359e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f516c0539c0 con 0x7f516c0e7870 2024-05-10T11:12:48.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f517359e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f516c051390 con 0x7f516c0071d0 2024-05-10T11:12:48.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f7719ab7640 1 Processor -- start 2024-05-10T11:12:48.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.920+0000 7f517259c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f516c0e7490 0x7f516c006ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41022/0 (socket says 172.21.15.66:41022) 2024-05-10T11:12:48.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.920+0000 7f5171d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f516c0e7870 0x7f516c050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.920+0000 7f517259c640 1 -- 172.21.15.66:0/2441568383 learned_addr learned my addr 172.21.15.66:0/2441568383 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:48.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.920+0000 7f631359e640 1 Processor -- start 2024-05-10T11:12:48.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.920+0000 7f631359e640 1 -- start start 2024-05-10T11:12:48.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.919+0000 7f7719ab7640 1 -- start start 2024-05-10T11:12:48.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f627ccbd640 1 Processor -- start 2024-05-10T11:12:48.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f24e5764640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f24e0074590 0x7f24e0167b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41024/0 (socket says 172.21.15.66:41024) 2024-05-10T11:12:48.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f24e5f65640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f24e0166c90 0x7f24e0167480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43282/0 (socket says 172.21.15.66:43282) 2024-05-10T11:12:48.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f5171d9b640 1 -- 172.21.15.66:0/2441568383 >> v2:172.21.15.190:3300/0 conn(0x7f516c0071d0 msgr2=0x7f516c050970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f5171d9b640 1 --2- 172.21.15.66:0/2441568383 >> v2:172.21.15.190:3300/0 conn(0x7f516c0071d0 0x7f516c050970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f5171d9b640 1 -- 172.21.15.66:0/2441568383 >> v1:172.21.15.66:6789/0 conn(0x7f516c0e7490 legacy=0x7f516c006ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f5171d9b640 1 -- 172.21.15.66:0/2441568383 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c051670 con 0x7f516c0e7870 2024-05-10T11:12:48.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f627ccbd640 1 -- start start 2024-05-10T11:12:48.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f24e5764640 1 -- 172.21.15.66:0/1203391568 learned_addr learned my addr 172.21.15.66:0/1203391568 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:48.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f24e81c9640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e016c7a0 0x7f24e016eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f7719ab7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f770c0e30c0 0x7f770c057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f7719ab7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 0x7f770c053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f7719ab7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f770c054130 0x7f770c0e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f631359e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6314163580 0x7f631409cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f631359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f631406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f7719ab7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f770c0582d0 con 0x7f770c054130 2024-05-10T11:12:48.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f7719ab7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f770c058570 con 0x7f770c0e30c0 2024-05-10T11:12:48.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f7719ab7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f770c058850 con 0x7f770c03e840 2024-05-10T11:12:48.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f631359e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63140b8120 con 0x7f63140b69b0 2024-05-10T11:12:48.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f631359e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f631406da40 con 0x7f6314163580 2024-05-10T11:12:48.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f631359e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6314167610 con 0x7f63141671d0 2024-05-10T11:12:48.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 0x7f770c053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 0x7f770c053bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53524/0 (socket says 172.21.15.66:53524) 2024-05-10T11:12:48.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 -- 172.21.15.66:0/2505581646 learned_addr learned my addr 172.21.15.66:0/2505581646 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f631259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6314163580 0x7f631409cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f6312d9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f63140b69b0 0x7f63140b88e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43290/0 (socket says 172.21.15.66:43290) 2024-05-10T11:12:48.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f6312d9d640 1 -- 172.21.15.66:0/2232035205 learned_addr learned my addr 172.21.15.66:0/2232035205 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:48.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f631259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6314163580 0x7f631409cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:44038/0 (socket says 172.21.15.66:44038) 2024-05-10T11:12:48.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 -- 172.21.15.66:0/2505581646 >> v2:172.21.15.190:3300/0 conn(0x7f770c0e30c0 msgr2=0x7f770c057d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T11:12:48.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 --2- 172.21.15.66:0/2505581646 >> v2:172.21.15.190:3300/0 conn(0x7f770c0e30c0 0x7f770c057d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 -- 172.21.15.66:0/2505581646 >> v2:172.21.15.66:3300/0 conn(0x7f770c054130 msgr2=0x7f770c0e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f77192b6640 1 --2- 172.21.15.66:0/2505581646 >> v2:172.21.15.66:3300/0 conn(0x7f770c054130 0x7f770c0e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f5171d9b640 1 --2- 172.21.15.66:0/2441568383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c050430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5174000b60 tx=0x7f51740a6560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236cc3eb65b28a90 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.921+0000 7f24e6766640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e016c7a0 0x7f24e016eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e00b8060 con 0x7f24e0074590 2024-05-10T11:12:48.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e009cfe0 con 0x7f24e0166c90 2024-05-10T11:12:48.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24e01682a0 con 0x7f24e016c7a0 2024-05-10T11:12:48.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f517159a640 1 -- 172.21.15.66:0/2441568383 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51740b2070 con 0x7f516c0e7870 2024-05-10T11:12:48.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340706248 0 0) 0x7f24d0001040 con 0x7f24e0166c90 2024-05-10T11:12:48.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24cc003520 con 0x7f24e0166c90 2024-05-10T11:12:48.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f627ccbd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6270007910 0x7f62700eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f627ccbd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62700585a0 con 0x7f627003e870 2024-05-10T11:12:48.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f627ccbd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6270058880 con 0x7f62700e30f0 2024-05-10T11:12:48.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f627ccbd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f6270058b60 con 0x7f6270007910 2024-05-10T11:12:48.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f517159a640 1 -- 172.21.15.66:0/2441568383 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740ab7d0 con 0x7f516c0e7870 2024-05-10T11:12:48.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7fc992308640 1 Processor -- start 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f6276d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6270007910 0x7f62700eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f6276d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6270007910 0x7f62700eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40008/0 (socket says 172.21.15.66:40008) 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f6276d9d640 1 -- 172.21.15.66:0/551224654 learned_addr learned my addr 172.21.15.66:0/551224654 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398322136 0 0) 0x7f24cc003520 con 0x7f24e0166c90 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e016c7a0 msgr2=0x7f24e016eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e016c7a0 0x7f24e016eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 >> v1:172.21.15.66:6789/0 conn(0x7f24e0074590 legacy=0x7f24e0167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e00d4860 con 0x7f24e0166c90 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f24d0001770 con 0x7f24e0166c90 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 >> v1:172.21.15.190:6789/0 conn(0x7f24e0166c90 legacy=0x7f24e0167480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24cc0039b0 0x7f24cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24cc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24cc0050d0 0x7f24cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24e01682a0 con 0x7f24cc0050d0 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc00bfe0 con 0x7f24cc0039b0 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24cc00c1e0 con 0x7f24cc0043b0 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f631259c640 1 -- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 msgr2=0x7f631406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f6311d9b640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f631406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f631259c640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f631406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f631259c640 1 -- 172.21.15.66:0/2232035205 >> v1:172.21.15.190:6789/0 conn(0x7f63140b69b0 legacy=0x7f63140b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 --2- 172.21.15.66:0/2505581646 >> v2:172.21.15.66:3300/0 conn(0x7f770c054130 0x7f770c0e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f7713fff640 1 -- 172.21.15.66:0/2505581646 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c058b30 con 0x7f770c03e840 2024-05-10T11:12:48.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.922+0000 7f77192b6640 1 --2- 172.21.15.66:0/2505581646 >> v2:172.21.15.66:3300/0 conn(0x7f770c054130 0x7f770c0e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:48.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7fc992308640 1 -- start start 2024-05-10T11:12:48.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7fe71ac37640 1 Processor -- start 2024-05-10T11:12:48.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7fe71ac37640 1 -- start start 2024-05-10T11:12:48.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825402759 0 0) 0x7f6270058880 con 0x7f62700e30f0 2024-05-10T11:12:48.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.923+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6260003520 con 0x7f62700e30f0 2024-05-10T11:12:48.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f24e5f65640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24cc0039b0 0x7f24cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679121839 0 0) 0x7f62700585a0 con 0x7f627003e870 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6270058880 con 0x7f627003e870 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 723980619 0 0) 0x7f6260003520 con 0x7f62700e30f0 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 >> v2:172.21.15.66:3300/0 conn(0x7f6270007910 msgr2=0x7f62700eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 --2- 172.21.15.66:0/551224654 >> v2:172.21.15.66:3300/0 conn(0x7f6270007910 0x7f62700eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 >> v1:172.21.15.66:6789/0 conn(0x7f627003e870 legacy=0x7f6270053c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62700063e0 con 0x7f62700e30f0 2024-05-10T11:12:48.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f626c001670 con 0x7f62700e30f0 2024-05-10T11:12:48.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 >> v1:172.21.15.190:6789/0 conn(0x7f62700e30f0 legacy=0x7f6270057dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260003be0 0x7f6260003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6260004800 0x7f6260004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 -- 172.21.15.66:0/2441568383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 msgr2=0x7f516c050430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 --2- 172.21.15.66:0/2441568383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c050430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5174000b60 tx=0x7f51740a6560 comp rx=0 tx=0).stop 2024-05-10T11:12:48.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe71ac37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 0x7fe71416e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f631159a640 1 -- 172.21.15.66:0/2232035205 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41133791 0 0) 0x7f63140b8120 con 0x7f63140b69b0 2024-05-10T11:12:48.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f631259c640 1 -- 172.21.15.66:0/2232035205 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63141678d0 con 0x7f6314163580 2024-05-10T11:12:48.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f7713fff640 1 --2- 172.21.15.66:0/2505581646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 0x7f770c053bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f770c056960 tx=0x7f770002a280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403a68b07478af3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260005310 0x7f626000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6270058b60 con 0x7f6260003be0 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f626000c110 con 0x7f6260004800 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f626000c310 con 0x7f6260005310 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 -- 172.21.15.66:0/2441568383 shutdown_connections 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 --2- 172.21.15.66:0/2441568383 >> v2:172.21.15.190:3300/0 conn(0x7f516c0071d0 0x7f516c050970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 --2- 172.21.15.66:0/2441568383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c050430 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 -- 172.21.15.66:0/2441568383 >> 172.21.15.66:0/2441568383 conn(0x7f516c055bc0 msgr2=0x7f516c055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 -- 172.21.15.66:0/2441568383 shutdown_connections 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f6276d9d640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260005310 0x7f626000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe71ac37640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7140b58c0 con 0x7fe71415dd10 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe71ac37640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7140b7090 con 0x7fe7140aed60 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe71ac37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe7140af7e0 con 0x7fe71406c9d0 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe7191d4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 0x7fe71416e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe7191d4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 0x7fe71416e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53554/0 (socket says 172.21.15.66:53554) 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe7191d4640 1 -- 172.21.15.66:0/3445723133 learned_addr learned my addr 172.21.15.66:0/3445723133 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7fe70bfff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe7140aed60 0x7fe71406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43314/0 (socket says 172.21.15.66:43314) 2024-05-10T11:12:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f24e5764640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24cc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f517359e640 1 -- 172.21.15.66:0/2441568383 wait complete. 2024-05-10T11:12:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.924+0000 7f6275d9b640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6260004800 0x7f6260004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f77137fe640 1 -- 172.21.15.66:0/2505581646 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700037070 con 0x7f770c03e840 2024-05-10T11:12:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f77137fe640 1 -- 172.21.15.66:0/2505581646 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7700032440 con 0x7f770c03e840 2024-05-10T11:12:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f627659c640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260003be0 0x7f6260003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f77137fe640 1 -- 172.21.15.66:0/2505581646 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700032810 con 0x7f770c03e840 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fe70b7fe640 1 -- 172.21.15.66:0/3445723133 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635732687 0 0) 0x7fe7140b7090 con 0x7fe7140aed60 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fe70b7fe640 1 -- 172.21.15.66:0/3445723133 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6fc003520 con 0x7fe7140aed60 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fe7191d4640 1 -- 172.21.15.66:0/3445723133 >> v1:172.21.15.190:6789/0 conn(0x7fe7140aed60 legacy=0x7fe71406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fe7191d4640 1 -- 172.21.15.66:0/3445723133 >> v1:172.21.15.66:6789/0 conn(0x7fe71415dd10 legacy=0x7fe714164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fe7191d4640 1 -- 172.21.15.66:0/3445723133 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7140afac0 con 0x7fe71406c9d0 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f24e5764640 1 -- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24cc0039b0 msgr2=0x7f24cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f24e5764640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24cc0039b0 0x7f24cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f24e5764640 1 -- 172.21.15.66:0/1203391568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24cc0050d0 msgr2=0x7f24cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f24e5764640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24cc0050d0 0x7f24cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f24e5764640 1 -- 172.21.15.66:0/1203391568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e00d4860 con 0x7f24cc0043b0 2024-05-10T11:12:48.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc992308640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc992308640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c0b4e30 con 0x7fc98c06e070 2024-05-10T11:12:48.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc992308640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c072bf0 con 0x7fc98c144a90 2024-05-10T11:12:48.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc992308640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c072ed0 con 0x7fc98c0b4390 2024-05-10T11:12:48.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f6311d9b640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f631406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:48.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f7719ab7640 1 -- 172.21.15.66:0/2505581646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 msgr2=0x7f770c053bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f7719ab7640 1 --2- 172.21.15.66:0/2505581646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 0x7f770c053bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f770c056960 tx=0x7f770002a280 comp rx=0 tx=0).stop 2024-05-10T11:12:48.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f24e5764640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24cc004880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f24d800c260 tx=0x7f24cc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba638506cdeccf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f6275d9b640 1 -- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260005310 msgr2=0x7f626000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f6275d9b640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260005310 0x7f626000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f6275d9b640 1 -- 172.21.15.66:0/551224654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260003be0 msgr2=0x7f6260003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:48.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f6275d9b640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260003be0 0x7f6260003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7f6275d9b640 1 -- 172.21.15.66:0/551224654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6260003520 con 0x7f6260004800 2024-05-10T11:12:48.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f631259c640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6314163580 0x7f631409cdb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6304009d90 tx=0x7f630402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f243670485dd0c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f6276d9d640 1 -- 172.21.15.66:0/551224654 reap_dead start 2024-05-10T11:12:48.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc991b07640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc98c06e070 0x7fc98c15c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41052/0 (socket says 172.21.15.66:41052) 2024-05-10T11:12:48.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc991b07640 1 -- 172.21.15.66:0/1413657518 learned_addr learned my addr 172.21.15.66:0/1413657518 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:48.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.925+0000 7fc990b05640 1 --2- 172.21.15.66:0/1413657518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7fc990b05640 1 -- 172.21.15.66:0/1413657518 >> v1:172.21.15.190:6789/0 conn(0x7fc98c144a90 legacy=0x7fc98c0736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7fc990b05640 1 -- 172.21.15.66:0/1413657518 >> v1:172.21.15.66:6789/0 conn(0x7fc98c06e070 legacy=0x7fc98c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7fc990b05640 1 -- 172.21.15.66:0/1413657518 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c0731b0 con 0x7fc98c0b4390 2024-05-10T11:12:48.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8001fa0 con 0x7f24cc0043b0 2024-05-10T11:12:48.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d8032650 con 0x7f24cc0043b0 2024-05-10T11:12:48.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f24e4f63640 1 -- 172.21.15.66:0/1203391568 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8032a40 con 0x7f24cc0043b0 2024-05-10T11:12:48.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f6275d9b640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6260004800 0x7f6260004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6268001800 tx=0x7f6260005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeae3e39a8393015 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.926+0000 7f631159a640 1 -- 172.21.15.66:0/2232035205 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304007740 con 0x7f6314163580 2024-05-10T11:12:48.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f631159a640 1 -- 172.21.15.66:0/2232035205 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63040078e0 con 0x7f6314163580 2024-05-10T11:12:48.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f631159a640 1 -- 172.21.15.66:0/2232035205 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304007cf0 con 0x7f6314163580 2024-05-10T11:12:48.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7fe7191d4640 1 --2- 172.21.15.66:0/3445723133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 0x7fe71416e110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009e80 tx=0x7fe70c02a740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0dd7c5476a7aef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f517359e640 1 Processor -- start 2024-05-10T11:12:48.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 -- 172.21.15.66:0/2505581646 shutdown_connections 2024-05-10T11:12:48.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 --2- 172.21.15.66:0/2505581646 >> v2:172.21.15.66:3300/0 conn(0x7f770c054130 0x7f770c0e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 --2- 172.21.15.66:0/2505581646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c03e840 0x7f770c053bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 --2- 172.21.15.66:0/2505581646 >> v2:172.21.15.190:3300/0 conn(0x7f770c0e30c0 0x7f770c057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 -- 172.21.15.66:0/2505581646 >> 172.21.15.66:0/2505581646 conn(0x7f770c0559e0 msgr2=0x7f770c055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268001420 con 0x7f6260004800 2024-05-10T11:12:48.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 -- 172.21.15.66:0/2505581646 shutdown_connections 2024-05-10T11:12:48.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7fe70b7fe640 1 -- 172.21.15.66:0/3445723133 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c036070 con 0x7fe71406c9d0 2024-05-10T11:12:48.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62680052d0 con 0x7f6260004800 2024-05-10T11:12:48.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f627559a640 1 -- 172.21.15.66:0/551224654 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626802abe0 con 0x7f6260004800 2024-05-10T11:12:48.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7fe70b7fe640 1 -- 172.21.15.66:0/3445723133 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c031600 con 0x7fe71406c9d0 2024-05-10T11:12:48.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7fe70b7fe640 1 -- 172.21.15.66:0/3445723133 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0319d0 con 0x7fe71406c9d0 2024-05-10T11:12:48.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f517359e640 1 -- start start 2024-05-10T11:12:48.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f7719ab7640 1 -- 172.21.15.66:0/2505581646 wait complete. 2024-05-10T11:12:48.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 msgr2=0x7f24cc004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f24e81c9640 1 --2- 172.21.15.66:0/1203391568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24cc004880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f24d800c260 tx=0x7f24cc005830 comp rx=0 tx=0).stop 2024-05-10T11:12:48.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.927+0000 7f24e6766640 1 -- 172.21.15.66:0/1203391568 reap_dead start 2024-05-10T11:12:48.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 shutdown_connections 2024-05-10T11:12:48.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f627ccbd640 1 -- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6260004800 msgr2=0x7f6260004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f627ccbd640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6260004800 0x7f6260004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6268001800 tx=0x7f6260005830 comp rx=0 tx=0).stop 2024-05-10T11:12:48.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 >> 172.21.15.66:0/1203391568 conn(0x7f24e00d5350 msgr2=0x7f24e00d5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f631359e640 1 -- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6314163580 msgr2=0x7f631409cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f631359e640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6314163580 0x7f631409cdb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6304009d90 tx=0x7f630402a710 comp rx=0 tx=0).stop 2024-05-10T11:12:48.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f627ccbd640 1 -- 172.21.15.66:0/551224654 shutdown_connections 2024-05-10T11:12:48.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f627ccbd640 1 --2- 172.21.15.66:0/551224654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6260004800 0x7f6260004c80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f627ccbd640 1 -- 172.21.15.66:0/551224654 >> 172.21.15.66:0/551224654 conn(0x7f6270055a10 msgr2=0x7f6270055e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7fc990b05640 1 --2- 172.21.15.66:0/1413657518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c0b4820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc97c010bd0 tx=0x7fc97c032aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17392a58f7322233 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7fc983fff640 1 -- 172.21.15.66:0/1413657518 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c03d020 con 0x7fc98c0b4390 2024-05-10T11:12:48.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 shutdown_connections 2024-05-10T11:12:48.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f24e81c9640 1 -- 172.21.15.66:0/1203391568 wait complete. 2024-05-10T11:12:48.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7fc983fff640 1 -- 172.21.15.66:0/1413657518 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97c039850 con 0x7fc98c0b4390 2024-05-10T11:12:48.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f517359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516c0071d0 0x7f516c0e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f517359e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 0x7f516c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.928+0000 7f517359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c0de2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 -- 172.21.15.66:0/3445723133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 msgr2=0x7fe71416e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 --2- 172.21.15.66:0/3445723133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 0x7fe71416e110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009e80 tx=0x7fe70c02a740 comp rx=0 tx=0).stop 2024-05-10T11:12:48.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f5171d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 0x7f516c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f5171d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 0x7f516c0ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:44072/0 (socket says 172.21.15.66:44072) 2024-05-10T11:12:48.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f5171d9b640 1 -- 172.21.15.66:0/2548441705 learned_addr learned my addr 172.21.15.66:0/2548441705 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f627ccbd640 1 -- 172.21.15.66:0/551224654 shutdown_connections 2024-05-10T11:12:48.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 -- 172.21.15.66:0/3445723133 shutdown_connections 2024-05-10T11:12:48.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 --2- 172.21.15.66:0/3445723133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe71406c9d0 0x7fe71416e110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 -- 172.21.15.66:0/3445723133 >> 172.21.15.66:0/3445723133 conn(0x7fe7140d1d70 msgr2=0x7fe7140d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fc983fff640 1 -- 172.21.15.66:0/1413657518 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c039c20 con 0x7fc98c0b4390 2024-05-10T11:12:48.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f5172d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c0de2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f516c054220 con 0x7f516c0e7870 2024-05-10T11:12:48.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0540a0 con 0x7f516c0e7490 2024-05-10T11:12:48.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f516c0543a0 con 0x7f516c0071d0 2024-05-10T11:12:48.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f627ccbd640 1 -- 172.21.15.66:0/551224654 wait complete. 2024-05-10T11:12:48.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f7719ab7640 1 Processor -- start 2024-05-10T11:12:48.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7f7719ab7640 1 -- start start 2024-05-10T11:12:48.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 -- 172.21.15.66:0/3445723133 shutdown_connections 2024-05-10T11:12:48.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fe71ac37640 1 -- 172.21.15.66:0/3445723133 wait complete. 2024-05-10T11:12:48.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fc992308640 1 -- 172.21.15.66:0/1413657518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 msgr2=0x7fc98c0b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fc992308640 1 --2- 172.21.15.66:0/1413657518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c0b4820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc97c010bd0 tx=0x7fc97c032aa0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fc992308640 1 -- 172.21.15.66:0/1413657518 shutdown_connections 2024-05-10T11:12:48.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fc992308640 1 --2- 172.21.15.66:0/1413657518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c0b4820 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.929+0000 7fc992308640 1 -- 172.21.15.66:0/1413657518 >> 172.21.15.66:0/1413657518 conn(0x7fc98c0b2cf0 msgr2=0x7fc98c0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7fc992308640 1 -- 172.21.15.66:0/1413657518 shutdown_connections 2024-05-10T11:12:48.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f24e81c9640 1 Processor -- start 2024-05-10T11:12:48.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7fc992308640 1 -- 172.21.15.66:0/1413657518 wait complete. 2024-05-10T11:12:48.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f24e81c9640 1 -- start start 2024-05-10T11:12:48.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f5171d9b640 1 -- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516c0071d0 msgr2=0x7f516c0e32e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f5171d9b640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516c0071d0 0x7f516c0e32e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f5171d9b640 1 -- 172.21.15.66:0/2548441705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 msgr2=0x7f516c0de2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f5171d9b640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c0de2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f5171d9b640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c0e5950 con 0x7f516c0e7490 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f5172d9d640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c0de2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7719ab7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f770c03e840 0x7f770c0529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7719ab7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 0x7f770c0e4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f5171d9b640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 0x7f516c0ceec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f517402e0e0 tx=0x7f5174076270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f627ccbd640 1 Processor -- start 2024-05-10T11:12:48.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f24e81c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24e0159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7718ab5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f770c03e840 0x7f770c0529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f24e81c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0159f00 0x7f24e009df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7719ab7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f770c0e30c0 0x7f770c0d8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f627ccbd640 1 -- start start 2024-05-10T11:12:48.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f24e81c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e0165ac0 0x7f24e009e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7719ab7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f770c0e34a0 con 0x7f770c03e840 2024-05-10T11:12:48.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f24e81c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00b9800 con 0x7f24e0159f00 2024-05-10T11:12:48.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f24e81c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00d4e20 con 0x7f24e0165ac0 2024-05-10T11:12:48.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f24e81c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24e00b9980 con 0x7f24cc0043b0 2024-05-10T11:12:48.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7fe71ac37640 1 Processor -- start 2024-05-10T11:12:48.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7713fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 0x7f770c0e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f631359e640 1 -- 172.21.15.66:0/2232035205 shutdown_connections 2024-05-10T11:12:48.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f631359e640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f631406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f631359e640 1 --2- 172.21.15.66:0/2232035205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6314163580 0x7f631409cdb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.930+0000 7f631359e640 1 -- 172.21.15.66:0/2232035205 >> 172.21.15.66:0/2232035205 conn(0x7f63140ba410 msgr2=0x7f63140ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:48.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f631359e640 1 -- 172.21.15.66:0/2232035205 shutdown_connections 2024-05-10T11:12:48.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f631359e640 1 -- 172.21.15.66:0/2232035205 wait complete. 2024-05-10T11:12:48.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7fe71ac37640 1 -- start start 2024-05-10T11:12:48.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7fc992308640 1 Processor -- start 2024-05-10T11:12:48.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7fc992308640 1 -- start start 2024-05-10T11:12:48.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7713fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 0x7f770c0e4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53604/0 (socket says 172.21.15.66:53604) 2024-05-10T11:12:48.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f7713fff640 1 -- 172.21.15.66:0/3484409109 learned_addr learned my addr 172.21.15.66:0/3484409109 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.931+0000 7f77192b6640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f770c0e30c0 0x7f770c0d8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51740b2050 con 0x7f516c0e7490 2024-05-10T11:12:48.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f24e6766640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e0165ac0 0x7f24e009e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f24e5f65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24e0159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f24e6766640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e0165ac0 0x7f24e009e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:44092/0 (socket says 172.21.15.66:44092) 2024-05-10T11:12:48.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f24e6766640 1 -- 172.21.15.66:0/330213608 learned_addr learned my addr 172.21.15.66:0/330213608 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f24e5764640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0159f00 0x7f24e009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f770c03bfc0 con 0x7f770c0e30c0 2024-05-10T11:12:48.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f627ccbd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260004800 0x7f6270180550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f627ccbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700e3650 0x7f62700e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f627659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260004800 0x7f6270180550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f627659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260004800 0x7f6270180550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53622/0 (socket says 172.21.15.66:53622) 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f627659c640 1 -- 172.21.15.66:0/3193453810 learned_addr learned my addr 172.21.15.66:0/3193453810 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fe71ac37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe71406c9d0 0x7fe714166000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f24e5f65640 1 -- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e0165ac0 msgr2=0x7f24e009e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f24e5f65640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e0165ac0 0x7f24e009e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f24e5f65640 1 -- 172.21.15.66:0/330213608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0159f00 msgr2=0x7f24e009df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f24e5f65640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0159f00 0x7f24e009df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f24e5f65640 1 -- 172.21.15.66:0/330213608 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e015ffe0 con 0x7f24cc0043b0 2024-05-10T11:12:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f24e5f65640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24e0159770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f24d0007790 tx=0x7f24d00077c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f631359e640 1 Processor -- start 2024-05-10T11:12:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f631359e640 1 -- start start 2024-05-10T11:12:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc992308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98c06e070 0x7fc98c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc992308640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc992308640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc98c144a90 0x7fc98c201880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f6275d9b640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700e3650 0x7f62700e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fe71ac37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7140aed60 0x7fe71409f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc992308640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c06a220 con 0x7fc98c06e070 2024-05-10T11:12:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc992308640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c15c6f0 con 0x7fc98c144a90 2024-05-10T11:12:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc992308640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c06a3a0 con 0x7fc98c0b4390 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f627004dab0 0x7f627004df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6270057dc0 con 0x7f627004dab0 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f62700e34d0 con 0x7f62700e3650 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f6276d9d640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f627004dab0 0x7f627004df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6270057f40 con 0x7f6260004800 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fe7189d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe71406c9d0 0x7fe714166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fe7189d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe71406c9d0 0x7fe714166000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:44102/0 (socket says 172.21.15.66:44102) 2024-05-10T11:12:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc990b05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc990b05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53630/0 (socket says 172.21.15.66:53630) 2024-05-10T11:12:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc990b05640 1 -- 172.21.15.66:0/3877856754 learned_addr learned my addr 172.21.15.66:0/3877856754 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7fc991b07640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc98c144a90 0x7fc98c201880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7fc990b05640 1 -- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc98c144a90 msgr2=0x7fc98c201880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d000f730 con 0x7f24cc0043b0 2024-05-10T11:12:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7fc990b05640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc98c144a90 0x7fc98c201880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7fc990b05640 1 -- 172.21.15.66:0/3877856754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98c06e070 msgr2=0x7fc98c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7fc990b05640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98c06e070 0x7fc98c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e0159cb0 con 0x7f24cc0043b0 2024-05-10T11:12:48.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7fc990b05640 1 -- 172.21.15.66:0/3877856754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c157820 con 0x7fc98c0b4390 2024-05-10T11:12:48.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7fc990b05640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c156ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc97c010bd0 tx=0x7fc97c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e015dee0 con 0x7f24cc0043b0 2024-05-10T11:12:48.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f6276d9d640 1 -- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260004800 msgr2=0x7f6270180550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f6276d9d640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260004800 0x7f6270180550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f6276d9d640 1 -- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700e3650 msgr2=0x7f62700e3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f6276d9d640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700e3650 0x7f62700e3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f6276d9d640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6270180a90 con 0x7f627004dab0 2024-05-10T11:12:48.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0018070 con 0x7f24cc0043b0 2024-05-10T11:12:48.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f631359e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 0x7f63141f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6314163580 0x7f6314166010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f6276d9d640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f627004dab0 0x7f627004df10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6278051c90 tx=0x7f6278069ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f6314166550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780759b0 con 0x7f627004dab0 2024-05-10T11:12:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6278075b70 con 0x7f627004dab0 2024-05-10T11:12:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278075f60 con 0x7f627004dab0 2024-05-10T11:12:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fe70bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7140aed60 0x7fe71409f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fe70bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7140aed60 0x7fe71409f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:53642/0 (socket says 172.21.15.66:53642) 2024-05-10T11:12:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fe70bfff640 1 -- 172.21.15.66:0/1278128439 learned_addr learned my addr 172.21.15.66:0/1278128439 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe71415dd10 0x7fe71409c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fe7191d4640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe71415dd10 0x7fe71409c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe714164ca0 con 0x7fe71415dd10 2024-05-10T11:12:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe7140b5b60 con 0x7fe71406c9d0 2024-05-10T11:12:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe71416e650 con 0x7fe7140aed60 2024-05-10T11:12:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d000fad0 con 0x7f24cc0043b0 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631359e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63140b83c0 con 0x7f6314163580 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631359e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6314167e90 con 0x7f63140b69b0 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631359e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6314163960 con 0x7f63141671d0 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 0x7f63141f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 0x7f63141f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:44114/0 (socket says 172.21.15.66:44114) 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f631259c640 1 -- 172.21.15.66:0/4108186683 learned_addr learned my addr 172.21.15.66:0/4108186683 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f6312d9d640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f6314166550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c03d040 con 0x7fc98c0b4390 2024-05-10T11:12:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97c019560 con 0x7fc98c0b4390 2024-05-10T11:12:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c037ca0 con 0x7fc98c0b4390 2024-05-10T11:12:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c157b00 con 0x7fc98c0b4390 2024-05-10T11:12:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c1580c0 con 0x7fc98c0b4390 2024-05-10T11:12:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.932+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f770c0e7170 con 0x7f770c054130 2024-05-10T11:12:48.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f6311d9b640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6314163580 0x7f6314166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f631259c640 1 -- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 msgr2=0x7f6314166550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f631259c640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f6314166550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f631259c640 1 -- 172.21.15.66:0/4108186683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6314163580 msgr2=0x7f6314166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f631259c640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6314163580 0x7f6314166010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f631259c640 1 -- 172.21.15.66:0/4108186683 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63141f95d0 con 0x7f63140b69b0 2024-05-10T11:12:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7713fff640 1 -- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f770c0e30c0 msgr2=0x7f770c0d8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7713fff640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f770c0e30c0 0x7f770c0d8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7713fff640 1 -- 172.21.15.66:0/3484409109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f770c03e840 msgr2=0x7f770c0529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7713fff640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f770c03e840 0x7f770c0529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7713fff640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c0e4680 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7713fff640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 0x7f770c0e4140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7700000c00 tx=0x7f77000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700041020 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7700030820 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770c0e4900 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.933+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f770c0e4ec0 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.934+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700037040 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.935+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770c0560a0 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7700044020 con 0x7f770c054130 2024-05-10T11:12:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c0e5c30 con 0x7f516c0e7490 2024-05-10T11:12:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c0e61f0 con 0x7f516c0e7490 2024-05-10T11:12:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c8005290 con 0x7f24cc0043b0 2024-05-10T11:12:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7f631259c640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 0x7f63141f9090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6304000f80 tx=0x7f6304004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740b3040 con 0x7f516c0e7490 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe7191d4640 1 -- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7140aed60 msgr2=0x7fe71409f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe7191d4640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7140aed60 0x7fe71409f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe7191d4640 1 -- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe71406c9d0 msgr2=0x7fe714166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe7191d4640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe71406c9d0 0x7fe714166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.936+0000 7fe7191d4640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71415e240 con 0x7fe71415dd10 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7fe7191d4640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe71415dd10 0x7fe71409c470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe70c030000 tx=0x7fe70c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7f77117fa640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76f8076320 0x7f76f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77000b8170 con 0x7f770c054130 2024-05-10T11:12:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c041020 con 0x7fe71415dd10 2024-05-10T11:12:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c037040 con 0x7fe71415dd10 2024-05-10T11:12:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c036070 con 0x7fe71415dd10 2024-05-10T11:12:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71415e520 con 0x7fe71415dd10 2024-05-10T11:12:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304040070 con 0x7f63140b69b0 2024-05-10T11:12:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.937+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6304031c90 con 0x7f63140b69b0 2024-05-10T11:12:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51740b9650 con 0x7f516c0e7490 2024-05-10T11:12:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f7718ab5640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76f8076320 0x7f76f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5158005290 con 0x7f516c0e7490 2024-05-10T11:12:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627004e840 con 0x7f627004dab0 2024-05-10T11:12:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627004ee00 con 0x7f627004dab0 2024-05-10T11:12:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71409bf50 con 0x7fe71415dd10 2024-05-10T11:12:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f24d000fc70 con 0x7f24cc0043b0 2024-05-10T11:12:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040456a0 con 0x7f63140b69b0 2024-05-10T11:12:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63141f9880 con 0x7f63140b69b0 2024-05-10T11:12:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63141f9e20 con 0x7f63140b69b0 2024-05-10T11:12:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.938+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c1582c0 con 0x7fc98c0b4390 2024-05-10T11:12:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.939+0000 7f7718ab5640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76f8076320 0x7f76f80787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f771406b2b0 tx=0x7f77140756d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.939+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7140b0fc0 con 0x7fe71415dd10 2024-05-10T11:12:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.940+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f51740c0030 con 0x7f516c0e7490 2024-05-10T11:12:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.940+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6270005810 con 0x7f627004dab0 2024-05-10T11:12:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.940+0000 7f24d67fc640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24c40763a0 0x7f24c4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.940+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63140d22c0 con 0x7f63140b69b0 2024-05-10T11:12:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.940+0000 7f24e5764640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24c40763a0 0x7f24c4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.940+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f24d00976a0 con 0x7f24cc0043b0 2024-05-10T11:12:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6304039040 con 0x7f63140b69b0 2024-05-10T11:12:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f5162ffd640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5154076300 0x7f51540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe70c044020 con 0x7fe71415dd10 2024-05-10T11:12:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f517259c640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5154076300 0x7f51540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f630affd640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62f40763a0 0x7f62f4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f24e5764640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24c40763a0 0x7f24c4078860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24d8033000 tx=0x7f24d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5174134090 con 0x7f516c0e7490 2024-05-10T11:12:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7fe7097fa640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7000763d0 0x7fe700078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe70c0b8010 con 0x7fe71415dd10 2024-05-10T11:12:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.941+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f63040b91e0 con 0x7f63140b69b0 2024-05-10T11:12:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f770004b030 con 0x7f770c054130 2024-05-10T11:12:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7f517259c640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5154076300 0x7f51540787c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5168001580 tx=0x7f5168007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7f6311d9b640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62f40763a0 0x7f62f4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7fe7189d3640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7000763d0 0x7fe700078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6278074150 con 0x7f627004dab0 2024-05-10T11:12:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7f6311d9b640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62f40763a0 0x7f62f4078860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f63140bade0 tx=0x7f62fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.942+0000 7fe7189d3640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7000763d0 0x7fe700078890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe710006fd0 tx=0x7fe710008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.943+0000 7f6266ffd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6258076320 0x7f62580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.943+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc97c049060 con 0x7fc98c0b4390 2024-05-10T11:12:49.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.943+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6278113c10 con 0x7f627004dab0 2024-05-10T11:12:49.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.943+0000 7f627659c640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6258076320 0x7f62580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.944+0000 7fc981ffb640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc970076350 0x7fc970078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.944+0000 7f627659c640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6258076320 0x7f62580787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f627003de10 tx=0x7f626c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.944+0000 7fc991306640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc970076350 0x7fc970078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.944+0000 7fc991306640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc970076350 0x7fc970078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc988000f60 tx=0x7fc9880079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.945+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f51740c7020 con 0x7f516c0e7490 2024-05-10T11:12:49.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.947+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc97c0397f0 con 0x7fc98c0b4390 2024-05-10T11:12:49.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.947+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f24e009cfe0 con 0x7f24cc0043b0 2024-05-10T11:12:49.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.949+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6304082870 con 0x7f63140b69b0 2024-05-10T11:12:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.951+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe7140b0fc0 con 0x7fe71415dd10 2024-05-10T11:12:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.951+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc97c081b60 con 0x7fc98c0b4390 2024-05-10T11:12:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:48.960+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f62780dd320 con 0x7f627004dab0 2024-05-10T11:12:49.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.326+0000 7ff64eefd640 1 -- 172.21.15.66:0/2702128077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff630005580 con 0x7ff6400e0120 2024-05-10T11:12:49.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.327+0000 7ff63e7fc640 1 -- 172.21.15.66:0/2702128077 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6480fd990 con 0x7ff6400e0120 2024-05-10T11:12:49.328 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:49.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.331+0000 7ff62bfff640 1 -- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff634076520 msgr2=0x7ff6340789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.331+0000 7ff62bfff640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff634076520 0x7ff6340789e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff644001770 tx=0x7ff644009040 comp rx=0 tx=0).stop 2024-05-10T11:12:49.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.331+0000 7ff62bfff640 1 -- 172.21.15.66:0/2702128077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 msgr2=0x7ff6400da7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.331+0000 7ff62bfff640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 0x7ff6400da7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6480520f0 tx=0x7ff64806a170 comp rx=0 tx=0).stop 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 -- 172.21.15.66:0/2702128077 shutdown_connections 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff634076520 0x7ff6340789e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6400e3110 0x7ff6400dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6400e0120 0x7ff6400da7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 --2- 172.21.15.66:0/2702128077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6400dfd40 0x7ff6400e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 -- 172.21.15.66:0/2702128077 >> 172.21.15.66:0/2702128077 conn(0x7ff640055bc0 msgr2=0x7ff640055fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 -- 172.21.15.66:0/2702128077 shutdown_connections 2024-05-10T11:12:49.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.332+0000 7ff62bfff640 1 -- 172.21.15.66:0/2702128077 wait complete. 2024-05-10T11:12:49.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.3 2024-05-10T11:12:49.350 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.376+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f62700563d0 con 0x7f627004dab0 2024-05-10T11:12:49.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.376+0000 7f6266ffd640 1 -- 172.21.15.66:0/3193453810 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f62780e5310 con 0x7f627004dab0 2024-05-10T11:12:49.377 INFO:teuthology.orchestra.run.smithi066.stdout:55834574858 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.378+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6258076320 msgr2=0x7f62580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.378+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6258076320 0x7f62580787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f627003de10 tx=0x7f626c009040 comp rx=0 tx=0).stop 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.378+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f627004dab0 msgr2=0x7f627004df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.378+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f627004dab0 0x7f627004df10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6278051c90 tx=0x7f6278069ed0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 shutdown_connections 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6258076320 0x7f62580787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f627004dab0 0x7f627004df10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700e3650 0x7f62700e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 --2- 172.21.15.66:0/3193453810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6260004800 0x7f6270180550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 >> 172.21.15.66:0/3193453810 conn(0x7f6270055a10 msgr2=0x7f62700573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 shutdown_connections 2024-05-10T11:12:49.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.379+0000 7f627ccbd640 1 -- 172.21.15.66:0/3193453810 wait complete. 2024-05-10T11:12:49.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.382+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f770c009000 con 0x7f770c054130 2024-05-10T11:12:49.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.383+0000 7f77117fa640 1 -- 172.21.15.66:0/3484409109 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f770c0e4680 con 0x7f770c054130 2024-05-10T11:12:49.383 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.386+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76f8076320 msgr2=0x7f76f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.386+0000 7f7719ab7640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76f8076320 0x7f76f80787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f771406b2b0 tx=0x7f77140756d0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.386+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 msgr2=0x7f770c0e4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.386+0000 7f7719ab7640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 0x7f770c0e4140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7700000c00 tx=0x7f77000046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 shutdown_connections 2024-05-10T11:12:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76f8076320 0x7f76f80787e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f770c0e30c0 0x7f770c0d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f770c054130 0x7f770c0e4140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 --2- 172.21.15.66:0/3484409109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f770c03e840 0x7f770c0529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 >> 172.21.15.66:0/3484409109 conn(0x7f770c0559e0 msgr2=0x7f770c054b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 shutdown_connections 2024-05-10T11:12:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.387+0000 7f7719ab7640 1 -- 172.21.15.66:0/3484409109 wait complete. 2024-05-10T11:12:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.390+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe7140693f0 con 0x7fe71415dd10 2024-05-10T11:12:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.391+0000 7fe7097fa640 1 -- 172.21.15.66:0/1278128439 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe70c04b070 con 0x7fe71415dd10 2024-05-10T11:12:49.391 INFO:teuthology.orchestra.run.smithi066.stdout:64424509450 2024-05-10T11:12:49.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-05-10T11:12:49.395 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7000763d0 msgr2=0x7fe700078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7000763d0 0x7fe700078890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe710006fd0 tx=0x7fe710008040 comp rx=0 tx=0).stop 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe71415dd10 msgr2=0x7fe71409c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe71415dd10 0x7fe71409c470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe70c030000 tx=0x7fe70c004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 shutdown_connections 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe7000763d0 0x7fe700078890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe71415dd10 0x7fe71409c470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7140aed60 0x7fe71409f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 --2- 172.21.15.66:0/1278128439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe71406c9d0 0x7fe714166000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.394+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 >> 172.21.15.66:0/1278128439 conn(0x7fe7140d1d70 msgr2=0x7fe7140b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.395+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 shutdown_connections 2024-05-10T11:12:49.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.395+0000 7fe71ac37640 1 -- 172.21.15.66:0/1278128439 wait complete. 2024-05-10T11:12:49.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.398+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f24c8005580 con 0x7f24cc0043b0 2024-05-10T11:12:49.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.399+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5158005580 con 0x7f516c0e7490 2024-05-10T11:12:49.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.399+0000 7f24d67fc640 1 -- 172.21.15.66:0/330213608 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24d00606e0 con 0x7f24cc0043b0 2024-05-10T11:12:49.400 INFO:teuthology.orchestra.run.smithi066.stdout:64424509450 2024-05-10T11:12:49.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.399+0000 7f5162ffd640 1 -- 172.21.15.66:0/2548441705 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51740fd610 con 0x7f516c0e7490 2024-05-10T11:12:49.400 INFO:teuthology.orchestra.run.smithi066.stdout:60129542154 2024-05-10T11:12:49.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.400+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f63140d1dd0 con 0x7f63140b69b0 2024-05-10T11:12:49.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.400+0000 7f630affd640 1 -- 172.21.15.66:0/4108186683 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6304044e80 con 0x7f63140b69b0 2024-05-10T11:12:49.401 INFO:teuthology.orchestra.run.smithi066.stdout:60129542153 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24c40763a0 msgr2=0x7f24c4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24c40763a0 0x7f24c4078860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24d8033000 tx=0x7f24d802e000 comp rx=0 tx=0).stop 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 msgr2=0x7f24e0159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24e0159770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f24d0007790 tx=0x7f24d00077c0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 shutdown_connections 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24c40763a0 0x7f24c4078860 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e0165ac0 0x7f24e009e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0159f00 0x7f24e009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 --2- 172.21.15.66:0/330213608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24cc0043b0 0x7f24e0159770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 >> 172.21.15.66:0/330213608 conn(0x7f24e00d5350 msgr2=0x7f24e00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 shutdown_connections 2024-05-10T11:12:49.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f24e81c9640 1 -- 172.21.15.66:0/330213608 wait complete. 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5154076300 msgr2=0x7f51540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5154076300 0x7f51540787c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5168001580 tx=0x7f5168007a40 comp rx=0 tx=0).stop 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 msgr2=0x7f516c0ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 0x7f516c0ceec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f517402e0e0 tx=0x7f5174076270 comp rx=0 tx=0).stop 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 shutdown_connections 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5154076300 0x7f51540787c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f516c0e7870 0x7f516c0de2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516c0e7490 0x7f516c0ceec0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 --2- 172.21.15.66:0/2548441705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516c0071d0 0x7f516c0e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.402+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 >> 172.21.15.66:0/2548441705 conn(0x7f516c055bc0 msgr2=0x7f516c0ea350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.403+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 shutdown_connections 2024-05-10T11:12:49.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.403+0000 7f517359e640 1 -- 172.21.15.66:0/2548441705 wait complete. 2024-05-10T11:12:49.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.403+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc98c0693f0 con 0x7fc98c0b4390 2024-05-10T11:12:49.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.403+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62f40763a0 msgr2=0x7f62f4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.403+0000 7f631359e640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62f40763a0 0x7f62f4078860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f63140bade0 tx=0x7f62fc008040 comp rx=0 tx=0).stop 2024-05-10T11:12:49.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 msgr2=0x7f63141f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 0x7f63141f9090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6304000f80 tx=0x7f6304004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:49.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 shutdown_connections 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62f40763a0 0x7f62f4078860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63141671d0 0x7f6314166550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6314163580 0x7f6314166010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 --2- 172.21.15.66:0/4108186683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63140b69b0 0x7f63141f9090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 >> 172.21.15.66:0/4108186683 conn(0x7f63140ba410 msgr2=0x7f63140b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 shutdown_connections 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7f631359e640 1 -- 172.21.15.66:0/4108186683 wait complete. 2024-05-10T11:12:49.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.404+0000 7fc981ffb640 1 -- 172.21.15.66:0/3877856754 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc97c081460 con 0x7fc98c0b4390 2024-05-10T11:12:49.409 INFO:teuthology.orchestra.run.smithi066.stdout:64424509450 2024-05-10T11:12:49.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2024-05-10T11:12:49.410 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc970076350 msgr2=0x7fc970078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc970076350 0x7fc970078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc988000f60 tx=0x7fc9880079b0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 msgr2=0x7fc98c156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c156ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc97c010bd0 tx=0x7fc97c004730 comp rx=0 tx=0).stop 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 shutdown_connections 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc970076350 0x7fc970078810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc98c144a90 0x7fc98c201880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc98c0b4390 0x7fc98c156ff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 --2- 172.21.15.66:0/3877856754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98c06e070 0x7fc98c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 >> 172.21.15.66:0/3877856754 conn(0x7fc98c0b2cf0 msgr2=0x7fc98c142a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 shutdown_connections 2024-05-10T11:12:49.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.407+0000 7fc992308640 1 -- 172.21.15.66:0/3877856754 wait complete. 2024-05-10T11:12:49.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-05-10T11:12:49.413 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-05-10T11:12:49.419 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2024-05-10T11:12:49.420 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-05-10T11:12:49.422 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-05-10T11:12:49.425 DEBUG:teuthology.parallel:result is None 2024-05-10T11:12:49.425 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:12:49.425 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:12:49.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.569+0000 7f1f1d4bd640 1 Processor -- start 2024-05-10T11:12:49.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.569+0000 7f1f1d4bd640 1 -- start start 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f1d4bd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f1815d0d0 0x7f1f180d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f1d4bd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1f180d1b20 0x7f1f180c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f1d4bd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f180cde40 con 0x7f1f180cec00 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f1d4bd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1f180d1170 con 0x7f1f180d1b20 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f1d4bd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1f180d0250 con 0x7f1f1815d0d0 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f177fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1f180d1b20 0x7f1f180c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f177fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1f180d1b20 0x7f1f180c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40124/0 (socket says 172.21.15.66:40124) 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f167fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1f180cec00 0x7f1f180d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41054/0 (socket says 172.21.15.66:41054) 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.570+0000 7f1f177fe640 1 -- 172.21.15.66:0/2387094438 learned_addr learned my addr 172.21.15.66:0/2387094438 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f16ffd640 1 --2- 172.21.15.66:0/2387094438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f1815d0d0 0x7f1f180d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f177fe640 1 -- 172.21.15.66:0/2387094438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f1815d0d0 msgr2=0x7f1f180d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f177fe640 1 --2- 172.21.15.66:0/2387094438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f1815d0d0 0x7f1f180d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f177fe640 1 -- 172.21.15.66:0/2387094438 >> v1:172.21.15.66:6789/0 conn(0x7f1f180cec00 legacy=0x7f1f180d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f15ffb640 1 -- 172.21.15.66:0/2387094438 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327290765 0 0) 0x7f1f180cde40 con 0x7f1f180cec00 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f177fe640 1 -- 172.21.15.66:0/2387094438 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f180ce120 con 0x7f1f180d1b20 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.571+0000 7f1f177fe640 1 --2- 172.21.15.66:0/2387094438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f180c8b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009870 tx=0x7f1f0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2783183983dd61 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f15ffb640 1 -- 172.21.15.66:0/2387094438 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08037070 con 0x7f1f180d1b20 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f15ffb640 1 -- 172.21.15.66:0/2387094438 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f08032440 con 0x7f1f180d1b20 2024-05-10T11:12:49.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f15ffb640 1 -- 172.21.15.66:0/2387094438 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08032810 con 0x7f1f180d1b20 2024-05-10T11:12:49.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/2387094438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 msgr2=0x7f1f180c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/2387094438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f180c8b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009870 tx=0x7f1f0802a270 comp rx=0 tx=0).stop 2024-05-10T11:12:49.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/2387094438 shutdown_connections 2024-05-10T11:12:49.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/2387094438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f180c8b60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/2387094438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f1815d0d0 0x7f1f180d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/2387094438 >> 172.21.15.66:0/2387094438 conn(0x7f1f180d2e50 msgr2=0x7f1f180d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/2387094438 shutdown_connections 2024-05-10T11:12:49.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.572+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/2387094438 wait complete. 2024-05-10T11:12:49.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 Processor -- start 2024-05-10T11:12:49.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 -- start start 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f180cec00 0x7f1f181f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f18157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f1815d0d0 0x7f1f181f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f180cda60 con 0x7f1f180d1b20 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f180ce6e0 con 0x7f1f1815d0d0 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f1d4bd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1f180cdbe0 con 0x7f1f180cec00 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.574+0000 7f1f167fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f18157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f18157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40128/0 (socket says 172.21.15.66:40128) 2024-05-10T11:12:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 -- 172.21.15.66:0/4249035283 learned_addr learned my addr 172.21.15.66:0/4249035283 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 -- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f180cec00 msgr2=0x7f1f181f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f16ffd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f180cec00 0x7f1f181f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f177fe640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f1815d0d0 0x7f1f181f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f180cec00 0x7f1f181f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 -- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f1815d0d0 msgr2=0x7f1f181f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f1815d0d0 0x7f1f181f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 -- 172.21.15.66:0/4249035283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f18155160 con 0x7f1f180d1b20 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f167fc640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f18157900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000c4e0 tx=0x7f1f0000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00018070 con 0x7f1f180d1b20 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f00007500 con 0x7f1f180d1b20 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00004a20 con 0x7f1f180d1b20 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f18155400 con 0x7f1f180d1b20 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.575+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f181559c0 con 0x7f1f180d1b20 2024-05-10T11:12:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.576+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f180693f0 con 0x7f1f180d1b20 2024-05-10T11:12:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.577+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1f0001b070 con 0x7f1f180d1b20 2024-05-10T11:12:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.577+0000 7f1f0f7fe640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ef80762d0 0x7f1ef8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.577+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1f00096c40 con 0x7f1f180d1b20 2024-05-10T11:12:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.577+0000 7f1f16ffd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ef80762d0 0x7f1ef8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.578+0000 7f1f16ffd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ef80762d0 0x7f1ef8078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f10007380 tx=0x7f1f1000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.581+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1f00060320 con 0x7f1f180d1b20 2024-05-10T11:12:49.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.768+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f18068af0 con 0x7f1ef80762d0 2024-05-10T11:12:49.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.776+0000 7f1f0f7fe640 1 -- 172.21.15.66:0/4249035283 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f1f18068af0 con 0x7f1ef80762d0 2024-05-10T11:12:49.780 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:49.782 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ef80762d0 msgr2=0x7f1ef8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ef80762d0 0x7f1ef8078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f10007380 tx=0x7f1f1000b040 comp rx=0 tx=0).stop 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 msgr2=0x7f1f18157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f18157900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000c4e0 tx=0x7f1f0000c9a0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 shutdown_connections 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ef80762d0 0x7f1ef8078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f1815d0d0 0x7f1f181f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f180d1b20 0x7f1f18157900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 --2- 172.21.15.66:0/4249035283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f180cec00 0x7f1f181f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 >> 172.21.15.66:0/4249035283 conn(0x7f1f180d2e50 msgr2=0x7f1f1815f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 shutdown_connections 2024-05-10T11:12:49.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.780+0000 7f1f1d4bd640 1 -- 172.21.15.66:0/4249035283 wait complete. 2024-05-10T11:12:49.793 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-05-10T11:12:49.687778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219404,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755316,"statfs":{"total":773094113280,"available":772869443584,"internally_reserved":0,"allocated":3317760,"data_stored":2012824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003623"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186919+0000","last_change":"2024-05-10T11:12:30.107293+0000","last_active":"2024-05-10T11:12:37.186919+0000","last_peered":"2024-05-10T11:12:37.186919+0000","last_clean":"2024-05-10T11:12:37.186919+0000","last_became_active":"2024-05-10T11:12:30.106969+0000","last_became_peered":"2024-05-10T11:12:30.106969+0000","last_unstale":"2024-05-10T11:12:37.186919+0000","last_undegraded":"2024-05-10T11:12:37.186919+0000","last_fullsized":"2024-05-10T11:12:37.186919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186702+0000","last_change":"2024-05-10T11:12:31.115437+0000","last_active":"2024-05-10T11:12:37.186702+0000","last_peered":"2024-05-10T11:12:37.186702+0000","last_clean":"2024-05-10T11:12:37.186702+0000","last_became_active":"2024-05-10T11:12:31.115119+0000","last_became_peered":"2024-05-10T11:12:31.115119+0000","last_unstale":"2024-05-10T11:12:37.186702+0000","last_undegraded":"2024-05-10T11:12:37.186702+0000","last_fullsized":"2024-05-10T11:12:37.186702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187674+0000","last_change":"2024-05-10T11:12:35.422690+0000","last_active":"2024-05-10T11:12:37.187674+0000","last_peered":"2024-05-10T11:12:37.187674+0000","last_clean":"2024-05-10T11:12:37.187674+0000","last_became_active":"2024-05-10T11:12:35.422285+0000","last_became_peered":"2024-05-10T11:12:35.422285+0000","last_unstale":"2024-05-10T11:12:37.187674+0000","last_undegraded":"2024-05-10T11:12:37.187674+0000","last_fullsized":"2024-05-10T11:12:37.187674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186871+0000","last_change":"2024-05-10T11:12:30.100472+0000","last_active":"2024-05-10T11:12:37.186871+0000","last_peered":"2024-05-10T11:12:37.186871+0000","last_clean":"2024-05-10T11:12:37.186871+0000","last_became_active":"2024-05-10T11:12:30.100185+0000","last_became_peered":"2024-05-10T11:12:30.100185+0000","last_unstale":"2024-05-10T11:12:37.186871+0000","last_undegraded":"2024-05-10T11:12:37.186871+0000","last_fullsized":"2024-05-10T11:12:37.186871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186663+0000","last_change":"2024-05-10T11:12:31.118746+0000","last_active":"2024-05-10T11:12:37.186663+0000","last_peered":"2024-05-10T11:12:37.186663+0000","last_clean":"2024-05-10T11:12:37.186663+0000","last_became_active":"2024-05-10T11:12:31.118237+0000","last_became_peered":"2024-05-10T11:12:31.118237+0000","last_unstale":"2024-05-10T11:12:37.186663+0000","last_undegraded":"2024-05-10T11:12:37.186663+0000","last_fullsized":"2024-05-10T11:12:37.186663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132046+0000","last_change":"2024-05-10T11:12:35.138165+0000","last_active":"2024-05-10T11:12:36.132046+0000","last_peered":"2024-05-10T11:12:36.132046+0000","last_clean":"2024-05-10T11:12:36.132046+0000","last_became_active":"2024-05-10T11:12:35.137676+0000","last_became_peered":"2024-05-10T11:12:35.137676+0000","last_unstale":"2024-05-10T11:12:36.132046+0000","last_undegraded":"2024-05-10T11:12:36.132046+0000","last_fullsized":"2024-05-10T11:12:36.132046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:55:00.560547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186717+0000","last_change":"2024-05-10T11:12:30.110920+0000","last_active":"2024-05-10T11:12:37.186717+0000","last_peered":"2024-05-10T11:12:37.186717+0000","last_clean":"2024-05-10T11:12:37.186717+0000","last_became_active":"2024-05-10T11:12:30.110167+0000","last_became_peered":"2024-05-10T11:12:30.110167+0000","last_unstale":"2024-05-10T11:12:37.186717+0000","last_undegraded":"2024-05-10T11:12:37.186717+0000","last_fullsized":"2024-05-10T11:12:37.186717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132994+0000","last_change":"2024-05-10T11:12:31.101959+0000","last_active":"2024-05-10T11:12:36.132994+0000","last_peered":"2024-05-10T11:12:36.132994+0000","last_clean":"2024-05-10T11:12:36.132994+0000","last_became_active":"2024-05-10T11:12:31.101677+0000","last_became_peered":"2024-05-10T11:12:31.101677+0000","last_unstale":"2024-05-10T11:12:36.132994+0000","last_undegraded":"2024-05-10T11:12:36.132994+0000","last_fullsized":"2024-05-10T11:12:36.132994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133684+0000","last_change":"2024-05-10T11:12:35.138098+0000","last_active":"2024-05-10T11:12:36.133684+0000","last_peered":"2024-05-10T11:12:36.133684+0000","last_clean":"2024-05-10T11:12:36.133684+0000","last_became_active":"2024-05-10T11:12:35.137760+0000","last_became_peered":"2024-05-10T11:12:35.137760+0000","last_unstale":"2024-05-10T11:12:36.133684+0000","last_undegraded":"2024-05-10T11:12:36.133684+0000","last_fullsized":"2024-05-10T11:12:36.133684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186379+0000","last_change":"2024-05-10T11:12:30.112117+0000","last_active":"2024-05-10T11:12:37.186379+0000","last_peered":"2024-05-10T11:12:37.186379+0000","last_clean":"2024-05-10T11:12:37.186379+0000","last_became_active":"2024-05-10T11:12:30.111649+0000","last_became_peered":"2024-05-10T11:12:30.111649+0000","last_unstale":"2024-05-10T11:12:37.186379+0000","last_undegraded":"2024-05-10T11:12:37.186379+0000","last_fullsized":"2024-05-10T11:12:37.186379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133328+0000","last_change":"2024-05-10T11:12:31.113857+0000","last_active":"2024-05-10T11:12:36.133328+0000","last_peered":"2024-05-10T11:12:36.133328+0000","last_clean":"2024-05-10T11:12:36.133328+0000","last_became_active":"2024-05-10T11:12:31.113561+0000","last_became_peered":"2024-05-10T11:12:31.113561+0000","last_unstale":"2024-05-10T11:12:36.133328+0000","last_undegraded":"2024-05-10T11:12:36.133328+0000","last_fullsized":"2024-05-10T11:12:36.133328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:57.654437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132469+0000","last_change":"2024-05-10T11:12:35.138373+0000","last_active":"2024-05-10T11:12:36.132469+0000","last_peered":"2024-05-10T11:12:36.132469+0000","last_clean":"2024-05-10T11:12:36.132469+0000","last_became_active":"2024-05-10T11:12:35.137918+0000","last_became_peered":"2024-05-10T11:12:35.137918+0000","last_unstale":"2024-05-10T11:12:36.132469+0000","last_undegraded":"2024-05-10T11:12:36.132469+0000","last_fullsized":"2024-05-10T11:12:36.132469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:47.170283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284980+0000","last_change":"2024-05-10T11:12:31.101194+0000","last_active":"2024-05-10T11:12:36.284980+0000","last_peered":"2024-05-10T11:12:36.284980+0000","last_clean":"2024-05-10T11:12:36.284980+0000","last_became_active":"2024-05-10T11:12:31.100888+0000","last_became_peered":"2024-05-10T11:12:31.100888+0000","last_unstale":"2024-05-10T11:12:36.284980+0000","last_undegraded":"2024-05-10T11:12:36.284980+0000","last_fullsized":"2024-05-10T11:12:36.284980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:00.574123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186570+0000","last_change":"2024-05-10T11:12:30.109646+0000","last_active":"2024-05-10T11:12:37.186570+0000","last_peered":"2024-05-10T11:12:37.186570+0000","last_clean":"2024-05-10T11:12:37.186570+0000","last_became_active":"2024-05-10T11:12:30.109393+0000","last_became_peered":"2024-05-10T11:12:30.109393+0000","last_unstale":"2024-05-10T11:12:37.186570+0000","last_undegraded":"2024-05-10T11:12:37.186570+0000","last_fullsized":"2024-05-10T11:12:37.186570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132986+0000","last_change":"2024-05-10T11:12:35.134377+0000","last_active":"2024-05-10T11:12:36.132986+0000","last_peered":"2024-05-10T11:12:36.132986+0000","last_clean":"2024-05-10T11:12:36.132986+0000","last_became_active":"2024-05-10T11:12:35.133107+0000","last_became_peered":"2024-05-10T11:12:35.133107+0000","last_unstale":"2024-05-10T11:12:36.132986+0000","last_undegraded":"2024-05-10T11:12:36.132986+0000","last_fullsized":"2024-05-10T11:12:36.132986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188108+0000","last_change":"2024-05-10T11:12:31.113901+0000","last_active":"2024-05-10T11:12:37.188108+0000","last_peered":"2024-05-10T11:12:37.188108+0000","last_clean":"2024-05-10T11:12:37.188108+0000","last_became_active":"2024-05-10T11:12:31.113316+0000","last_became_peered":"2024-05-10T11:12:31.113316+0000","last_unstale":"2024-05-10T11:12:37.188108+0000","last_undegraded":"2024-05-10T11:12:37.188108+0000","last_fullsized":"2024-05-10T11:12:37.188108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188842+0000","last_change":"2024-05-10T11:12:30.104152+0000","last_active":"2024-05-10T11:12:37.188842+0000","last_peered":"2024-05-10T11:12:37.188842+0000","last_clean":"2024-05-10T11:12:37.188842+0000","last_became_active":"2024-05-10T11:12:30.103869+0000","last_became_peered":"2024-05-10T11:12:30.103869+0000","last_unstale":"2024-05-10T11:12:37.188842+0000","last_undegraded":"2024-05-10T11:12:37.188842+0000","last_fullsized":"2024-05-10T11:12:37.188842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132702+0000","last_change":"2024-05-10T11:12:35.140690+0000","last_active":"2024-05-10T11:12:36.132702+0000","last_peered":"2024-05-10T11:12:36.132702+0000","last_clean":"2024-05-10T11:12:36.132702+0000","last_became_active":"2024-05-10T11:12:35.140367+0000","last_became_peered":"2024-05-10T11:12:35.140367+0000","last_unstale":"2024-05-10T11:12:36.132702+0000","last_undegraded":"2024-05-10T11:12:36.132702+0000","last_fullsized":"2024-05-10T11:12:36.132702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187425+0000","last_change":"2024-05-10T11:12:31.112506+0000","last_active":"2024-05-10T11:12:37.187425+0000","last_peered":"2024-05-10T11:12:37.187425+0000","last_clean":"2024-05-10T11:12:37.187425+0000","last_became_active":"2024-05-10T11:12:31.112211+0000","last_became_peered":"2024-05-10T11:12:31.112211+0000","last_unstale":"2024-05-10T11:12:37.187425+0000","last_undegraded":"2024-05-10T11:12:37.187425+0000","last_fullsized":"2024-05-10T11:12:37.187425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:30.107759+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:30.107468+0000","last_became_peered":"2024-05-10T11:12:30.107468+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186715+0000","last_change":"2024-05-10T11:12:35.422670+0000","last_active":"2024-05-10T11:12:37.186715+0000","last_peered":"2024-05-10T11:12:37.186715+0000","last_clean":"2024-05-10T11:12:37.186715+0000","last_became_active":"2024-05-10T11:12:35.422307+0000","last_became_peered":"2024-05-10T11:12:35.422307+0000","last_unstale":"2024-05-10T11:12:37.186715+0000","last_undegraded":"2024-05-10T11:12:37.186715+0000","last_fullsized":"2024-05-10T11:12:37.186715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:01.679168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132243+0000","last_change":"2024-05-10T11:12:31.105780+0000","last_active":"2024-05-10T11:12:36.132243+0000","last_peered":"2024-05-10T11:12:36.132243+0000","last_clean":"2024-05-10T11:12:36.132243+0000","last_became_active":"2024-05-10T11:12:31.105471+0000","last_became_peered":"2024-05-10T11:12:31.105471+0000","last_unstale":"2024-05-10T11:12:36.132243+0000","last_undegraded":"2024-05-10T11:12:36.132243+0000","last_fullsized":"2024-05-10T11:12:36.132243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:55.127350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186041+0000","last_change":"2024-05-10T11:12:30.110798+0000","last_active":"2024-05-10T11:12:37.186041+0000","last_peered":"2024-05-10T11:12:37.186041+0000","last_clean":"2024-05-10T11:12:37.186041+0000","last_became_active":"2024-05-10T11:12:30.110468+0000","last_became_peered":"2024-05-10T11:12:30.110468+0000","last_unstale":"2024-05-10T11:12:37.186041+0000","last_undegraded":"2024-05-10T11:12:37.186041+0000","last_fullsized":"2024-05-10T11:12:37.186041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132575+0000","last_change":"2024-05-10T11:12:35.138104+0000","last_active":"2024-05-10T11:12:36.132575+0000","last_peered":"2024-05-10T11:12:36.132575+0000","last_clean":"2024-05-10T11:12:36.132575+0000","last_became_active":"2024-05-10T11:12:35.137693+0000","last_became_peered":"2024-05-10T11:12:35.137693+0000","last_unstale":"2024-05-10T11:12:36.132575+0000","last_undegraded":"2024-05-10T11:12:36.132575+0000","last_fullsized":"2024-05-10T11:12:36.132575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:40.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187558+0000","last_change":"2024-05-10T11:12:31.107722+0000","last_active":"2024-05-10T11:12:37.187558+0000","last_peered":"2024-05-10T11:12:37.187558+0000","last_clean":"2024-05-10T11:12:37.187558+0000","last_became_active":"2024-05-10T11:12:31.107404+0000","last_became_peered":"2024-05-10T11:12:31.107404+0000","last_unstale":"2024-05-10T11:12:37.187558+0000","last_undegraded":"2024-05-10T11:12:37.187558+0000","last_fullsized":"2024-05-10T11:12:37.187558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285637+0000","last_change":"2024-05-10T11:12:30.113757+0000","last_active":"2024-05-10T11:12:36.285637+0000","last_peered":"2024-05-10T11:12:36.285637+0000","last_clean":"2024-05-10T11:12:36.285637+0000","last_became_active":"2024-05-10T11:12:30.113457+0000","last_became_peered":"2024-05-10T11:12:30.113457+0000","last_unstale":"2024-05-10T11:12:36.285637+0000","last_undegraded":"2024-05-10T11:12:36.285637+0000","last_fullsized":"2024-05-10T11:12:36.285637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132184+0000","last_change":"2024-05-10T11:12:35.421589+0000","last_active":"2024-05-10T11:12:36.132184+0000","last_peered":"2024-05-10T11:12:36.132184+0000","last_clean":"2024-05-10T11:12:36.132184+0000","last_became_active":"2024-05-10T11:12:35.421209+0000","last_became_peered":"2024-05-10T11:12:35.421209+0000","last_unstale":"2024-05-10T11:12:36.132184+0000","last_undegraded":"2024-05-10T11:12:36.132184+0000","last_fullsized":"2024-05-10T11:12:36.132184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:43.432104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188363+0000","last_change":"2024-05-10T11:12:31.113183+0000","last_active":"2024-05-10T11:12:37.188363+0000","last_peered":"2024-05-10T11:12:37.188363+0000","last_clean":"2024-05-10T11:12:37.188363+0000","last_became_active":"2024-05-10T11:12:31.112885+0000","last_became_peered":"2024-05-10T11:12:31.112885+0000","last_unstale":"2024-05-10T11:12:37.188363+0000","last_undegraded":"2024-05-10T11:12:37.188363+0000","last_fullsized":"2024-05-10T11:12:37.188363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186681+0000","last_change":"2024-05-10T11:12:30.106330+0000","last_active":"2024-05-10T11:12:37.186681+0000","last_peered":"2024-05-10T11:12:37.186681+0000","last_clean":"2024-05-10T11:12:37.186681+0000","last_became_active":"2024-05-10T11:12:30.106029+0000","last_became_peered":"2024-05-10T11:12:30.106029+0000","last_unstale":"2024-05-10T11:12:37.186681+0000","last_undegraded":"2024-05-10T11:12:37.186681+0000","last_fullsized":"2024-05-10T11:12:37.186681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187168+0000","last_change":"2024-05-10T11:12:35.421780+0000","last_active":"2024-05-10T11:12:37.187168+0000","last_peered":"2024-05-10T11:12:37.187168+0000","last_clean":"2024-05-10T11:12:37.187168+0000","last_became_active":"2024-05-10T11:12:35.421406+0000","last_became_peered":"2024-05-10T11:12:35.421406+0000","last_unstale":"2024-05-10T11:12:37.187168+0000","last_undegraded":"2024-05-10T11:12:37.187168+0000","last_fullsized":"2024-05-10T11:12:37.187168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187694+0000","last_change":"2024-05-10T11:12:31.104014+0000","last_active":"2024-05-10T11:12:37.187694+0000","last_peered":"2024-05-10T11:12:37.187694+0000","last_clean":"2024-05-10T11:12:37.187694+0000","last_became_active":"2024-05-10T11:12:31.103724+0000","last_became_peered":"2024-05-10T11:12:31.103724+0000","last_unstale":"2024-05-10T11:12:37.187694+0000","last_undegraded":"2024-05-10T11:12:37.187694+0000","last_fullsized":"2024-05-10T11:12:37.187694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186832+0000","last_change":"2024-05-10T11:12:30.110419+0000","last_active":"2024-05-10T11:12:37.186832+0000","last_peered":"2024-05-10T11:12:37.186832+0000","last_clean":"2024-05-10T11:12:37.186832+0000","last_became_active":"2024-05-10T11:12:30.109820+0000","last_became_peered":"2024-05-10T11:12:30.109820+0000","last_unstale":"2024-05-10T11:12:37.186832+0000","last_undegraded":"2024-05-10T11:12:37.186832+0000","last_fullsized":"2024-05-10T11:12:37.186832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:57.299078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187509+0000","last_change":"2024-05-10T11:12:35.420791+0000","last_active":"2024-05-10T11:12:37.187509+0000","last_peered":"2024-05-10T11:12:37.187509+0000","last_clean":"2024-05-10T11:12:37.187509+0000","last_became_active":"2024-05-10T11:12:35.420414+0000","last_became_peered":"2024-05-10T11:12:35.420414+0000","last_unstale":"2024-05-10T11:12:37.187509+0000","last_undegraded":"2024-05-10T11:12:37.187509+0000","last_fullsized":"2024-05-10T11:12:37.187509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133388+0000","last_change":"2024-05-10T11:12:31.109103+0000","last_active":"2024-05-10T11:12:36.133388+0000","last_peered":"2024-05-10T11:12:36.133388+0000","last_clean":"2024-05-10T11:12:36.133388+0000","last_became_active":"2024-05-10T11:12:31.108146+0000","last_became_peered":"2024-05-10T11:12:31.108146+0000","last_unstale":"2024-05-10T11:12:36.133388+0000","last_undegraded":"2024-05-10T11:12:36.133388+0000","last_fullsized":"2024-05-10T11:12:36.133388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:12.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187781+0000","last_change":"2024-05-10T11:12:30.101891+0000","last_active":"2024-05-10T11:12:37.187781+0000","last_peered":"2024-05-10T11:12:37.187781+0000","last_clean":"2024-05-10T11:12:37.187781+0000","last_became_active":"2024-05-10T11:12:30.101598+0000","last_became_peered":"2024-05-10T11:12:30.101598+0000","last_unstale":"2024-05-10T11:12:37.187781+0000","last_undegraded":"2024-05-10T11:12:37.187781+0000","last_fullsized":"2024-05-10T11:12:37.187781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188770+0000","last_change":"2024-05-10T11:12:35.135817+0000","last_active":"2024-05-10T11:12:37.188770+0000","last_peered":"2024-05-10T11:12:37.188770+0000","last_clean":"2024-05-10T11:12:37.188770+0000","last_became_active":"2024-05-10T11:12:35.135403+0000","last_became_peered":"2024-05-10T11:12:35.135403+0000","last_unstale":"2024-05-10T11:12:37.188770+0000","last_undegraded":"2024-05-10T11:12:37.188770+0000","last_fullsized":"2024-05-10T11:12:37.188770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133910+0000","last_change":"2024-05-10T11:12:31.103973+0000","last_active":"2024-05-10T11:12:36.133910+0000","last_peered":"2024-05-10T11:12:36.133910+0000","last_clean":"2024-05-10T11:12:36.133910+0000","last_became_active":"2024-05-10T11:12:31.103697+0000","last_became_peered":"2024-05-10T11:12:31.103697+0000","last_unstale":"2024-05-10T11:12:36.133910+0000","last_undegraded":"2024-05-10T11:12:36.133910+0000","last_fullsized":"2024-05-10T11:12:36.133910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:20.650809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133763+0000","last_change":"2024-05-10T11:12:30.112118+0000","last_active":"2024-05-10T11:12:36.133763+0000","last_peered":"2024-05-10T11:12:36.133763+0000","last_clean":"2024-05-10T11:12:36.133763+0000","last_became_active":"2024-05-10T11:12:30.111287+0000","last_became_peered":"2024-05-10T11:12:30.111287+0000","last_unstale":"2024-05-10T11:12:36.133763+0000","last_undegraded":"2024-05-10T11:12:36.133763+0000","last_fullsized":"2024-05-10T11:12:36.133763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187647+0000","last_change":"2024-05-10T11:12:35.140853+0000","last_active":"2024-05-10T11:12:37.187647+0000","last_peered":"2024-05-10T11:12:37.187647+0000","last_clean":"2024-05-10T11:12:37.187647+0000","last_became_active":"2024-05-10T11:12:35.140434+0000","last_became_peered":"2024-05-10T11:12:35.140434+0000","last_unstale":"2024-05-10T11:12:37.187647+0000","last_undegraded":"2024-05-10T11:12:37.187647+0000","last_fullsized":"2024-05-10T11:12:37.187647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187195+0000","last_change":"2024-05-10T11:12:31.110391+0000","last_active":"2024-05-10T11:12:37.187195+0000","last_peered":"2024-05-10T11:12:37.187195+0000","last_clean":"2024-05-10T11:12:37.187195+0000","last_became_active":"2024-05-10T11:12:31.109461+0000","last_became_peered":"2024-05-10T11:12:31.109461+0000","last_unstale":"2024-05-10T11:12:37.187195+0000","last_undegraded":"2024-05-10T11:12:37.187195+0000","last_fullsized":"2024-05-10T11:12:37.187195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186210+0000","last_change":"2024-05-10T11:12:30.109322+0000","last_active":"2024-05-10T11:12:37.186210+0000","last_peered":"2024-05-10T11:12:37.186210+0000","last_clean":"2024-05-10T11:12:37.186210+0000","last_became_active":"2024-05-10T11:12:30.109010+0000","last_became_peered":"2024-05-10T11:12:30.109010+0000","last_unstale":"2024-05-10T11:12:37.186210+0000","last_undegraded":"2024-05-10T11:12:37.186210+0000","last_fullsized":"2024-05-10T11:12:37.186210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186867+0000","last_change":"2024-05-10T11:12:35.138343+0000","last_active":"2024-05-10T11:12:37.186867+0000","last_peered":"2024-05-10T11:12:37.186867+0000","last_clean":"2024-05-10T11:12:37.186867+0000","last_became_active":"2024-05-10T11:12:35.137977+0000","last_became_peered":"2024-05-10T11:12:35.137977+0000","last_unstale":"2024-05-10T11:12:37.186867+0000","last_undegraded":"2024-05-10T11:12:37.186867+0000","last_fullsized":"2024-05-10T11:12:37.186867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:16.923493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186404+0000","last_change":"2024-05-10T11:12:31.107001+0000","last_active":"2024-05-10T11:12:37.186404+0000","last_peered":"2024-05-10T11:12:37.186404+0000","last_clean":"2024-05-10T11:12:37.186404+0000","last_became_active":"2024-05-10T11:12:31.105856+0000","last_became_peered":"2024-05-10T11:12:31.105856+0000","last_unstale":"2024-05-10T11:12:37.186404+0000","last_undegraded":"2024-05-10T11:12:37.186404+0000","last_fullsized":"2024-05-10T11:12:37.186404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186079+0000","last_change":"2024-05-10T11:12:30.106324+0000","last_active":"2024-05-10T11:12:37.186079+0000","last_peered":"2024-05-10T11:12:37.186079+0000","last_clean":"2024-05-10T11:12:37.186079+0000","last_became_active":"2024-05-10T11:12:30.106071+0000","last_became_peered":"2024-05-10T11:12:30.106071+0000","last_unstale":"2024-05-10T11:12:37.186079+0000","last_undegraded":"2024-05-10T11:12:37.186079+0000","last_fullsized":"2024-05-10T11:12:37.186079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:54.121002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187453+0000","last_change":"2024-05-10T11:12:35.420622+0000","last_active":"2024-05-10T11:12:37.187453+0000","last_peered":"2024-05-10T11:12:37.187453+0000","last_clean":"2024-05-10T11:12:37.187453+0000","last_became_active":"2024-05-10T11:12:35.420207+0000","last_became_peered":"2024-05-10T11:12:35.420207+0000","last_unstale":"2024-05-10T11:12:37.187453+0000","last_undegraded":"2024-05-10T11:12:37.187453+0000","last_fullsized":"2024-05-10T11:12:37.187453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186367+0000","last_change":"2024-05-10T11:12:31.119911+0000","last_active":"2024-05-10T11:12:37.186367+0000","last_peered":"2024-05-10T11:12:37.186367+0000","last_clean":"2024-05-10T11:12:37.186367+0000","last_became_active":"2024-05-10T11:12:31.119563+0000","last_became_peered":"2024-05-10T11:12:31.119563+0000","last_unstale":"2024-05-10T11:12:37.186367+0000","last_undegraded":"2024-05-10T11:12:37.186367+0000","last_fullsized":"2024-05-10T11:12:37.186367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132850+0000","last_change":"2024-05-10T11:12:30.111460+0000","last_active":"2024-05-10T11:12:36.132850+0000","last_peered":"2024-05-10T11:12:36.132850+0000","last_clean":"2024-05-10T11:12:36.132850+0000","last_became_active":"2024-05-10T11:12:30.111150+0000","last_became_peered":"2024-05-10T11:12:30.111150+0000","last_unstale":"2024-05-10T11:12:36.132850+0000","last_undegraded":"2024-05-10T11:12:36.132850+0000","last_fullsized":"2024-05-10T11:12:36.132850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186200+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:12:37.186200+0000","last_peered":"2024-05-10T11:12:37.186200+0000","last_clean":"2024-05-10T11:12:37.186200+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:12:37.186200+0000","last_undegraded":"2024-05-10T11:12:37.186200+0000","last_fullsized":"2024-05-10T11:12:37.186200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285379+0000","last_change":"2024-05-10T11:12:35.421543+0000","last_active":"2024-05-10T11:12:36.285379+0000","last_peered":"2024-05-10T11:12:36.285379+0000","last_clean":"2024-05-10T11:12:36.285379+0000","last_became_active":"2024-05-10T11:12:35.421171+0000","last_became_peered":"2024-05-10T11:12:35.421171+0000","last_unstale":"2024-05-10T11:12:36.285379+0000","last_undegraded":"2024-05-10T11:12:36.285379+0000","last_fullsized":"2024-05-10T11:12:36.285379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186499+0000","last_change":"2024-05-10T11:12:31.119926+0000","last_active":"2024-05-10T11:12:37.186499+0000","last_peered":"2024-05-10T11:12:37.186499+0000","last_clean":"2024-05-10T11:12:37.186499+0000","last_became_active":"2024-05-10T11:12:31.119632+0000","last_became_peered":"2024-05-10T11:12:31.119632+0000","last_unstale":"2024-05-10T11:12:37.186499+0000","last_undegraded":"2024-05-10T11:12:37.186499+0000","last_fullsized":"2024-05-10T11:12:37.186499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:17.896621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186772+0000","last_change":"2024-05-10T11:12:30.112153+0000","last_active":"2024-05-10T11:12:37.186772+0000","last_peered":"2024-05-10T11:12:37.186772+0000","last_clean":"2024-05-10T11:12:37.186772+0000","last_became_active":"2024-05-10T11:12:30.111901+0000","last_became_peered":"2024-05-10T11:12:30.111901+0000","last_unstale":"2024-05-10T11:12:37.186772+0000","last_undegraded":"2024-05-10T11:12:37.186772+0000","last_fullsized":"2024-05-10T11:12:37.186772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285207+0000","last_change":"2024-05-10T11:12:35.420749+0000","last_active":"2024-05-10T11:12:36.285207+0000","last_peered":"2024-05-10T11:12:36.285207+0000","last_clean":"2024-05-10T11:12:36.285207+0000","last_became_active":"2024-05-10T11:12:35.420325+0000","last_became_peered":"2024-05-10T11:12:35.420325+0000","last_unstale":"2024-05-10T11:12:36.285207+0000","last_undegraded":"2024-05-10T11:12:36.285207+0000","last_fullsized":"2024-05-10T11:12:36.285207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133116+0000","last_change":"2024-05-10T11:12:31.115139+0000","last_active":"2024-05-10T11:12:36.133116+0000","last_peered":"2024-05-10T11:12:36.133116+0000","last_clean":"2024-05-10T11:12:36.133116+0000","last_became_active":"2024-05-10T11:12:31.114482+0000","last_became_peered":"2024-05-10T11:12:31.114482+0000","last_unstale":"2024-05-10T11:12:36.133116+0000","last_undegraded":"2024-05-10T11:12:36.133116+0000","last_fullsized":"2024-05-10T11:12:36.133116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:02.344229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186711+0000","last_change":"2024-05-10T11:12:30.102023+0000","last_active":"2024-05-10T11:12:37.186711+0000","last_peered":"2024-05-10T11:12:37.186711+0000","last_clean":"2024-05-10T11:12:37.186711+0000","last_became_active":"2024-05-10T11:12:30.101642+0000","last_became_peered":"2024-05-10T11:12:30.101642+0000","last_unstale":"2024-05-10T11:12:37.186711+0000","last_undegraded":"2024-05-10T11:12:37.186711+0000","last_fullsized":"2024-05-10T11:12:37.186711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187660+0000","last_change":"2024-05-10T11:12:35.133498+0000","last_active":"2024-05-10T11:12:37.187660+0000","last_peered":"2024-05-10T11:12:37.187660+0000","last_clean":"2024-05-10T11:12:37.187660+0000","last_became_active":"2024-05-10T11:12:35.133009+0000","last_became_peered":"2024-05-10T11:12:35.133009+0000","last_unstale":"2024-05-10T11:12:37.187660+0000","last_undegraded":"2024-05-10T11:12:37.187660+0000","last_fullsized":"2024-05-10T11:12:37.187660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186836+0000","last_change":"2024-05-10T11:12:31.119096+0000","last_active":"2024-05-10T11:12:37.186836+0000","last_peered":"2024-05-10T11:12:37.186836+0000","last_clean":"2024-05-10T11:12:37.186836+0000","last_became_active":"2024-05-10T11:12:31.118841+0000","last_became_peered":"2024-05-10T11:12:31.118841+0000","last_unstale":"2024-05-10T11:12:37.186836+0000","last_undegraded":"2024-05-10T11:12:37.186836+0000","last_fullsized":"2024-05-10T11:12:37.186836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:51.850619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186580+0000","last_change":"2024-05-10T11:12:30.107841+0000","last_active":"2024-05-10T11:12:37.186580+0000","last_peered":"2024-05-10T11:12:37.186580+0000","last_clean":"2024-05-10T11:12:37.186580+0000","last_became_active":"2024-05-10T11:12:30.107551+0000","last_became_peered":"2024-05-10T11:12:30.107551+0000","last_unstale":"2024-05-10T11:12:37.186580+0000","last_undegraded":"2024-05-10T11:12:37.186580+0000","last_fullsized":"2024-05-10T11:12:37.186580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132082+0000","last_change":"2024-05-10T11:12:35.420691+0000","last_active":"2024-05-10T11:12:36.132082+0000","last_peered":"2024-05-10T11:12:36.132082+0000","last_clean":"2024-05-10T11:12:36.132082+0000","last_became_active":"2024-05-10T11:12:35.420284+0000","last_became_peered":"2024-05-10T11:12:35.420284+0000","last_unstale":"2024-05-10T11:12:36.132082+0000","last_undegraded":"2024-05-10T11:12:36.132082+0000","last_fullsized":"2024-05-10T11:12:36.132082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186722+0000","last_change":"2024-05-10T11:12:31.119535+0000","last_active":"2024-05-10T11:12:37.186722+0000","last_peered":"2024-05-10T11:12:37.186722+0000","last_clean":"2024-05-10T11:12:37.186722+0000","last_became_active":"2024-05-10T11:12:31.119282+0000","last_became_peered":"2024-05-10T11:12:31.119282+0000","last_unstale":"2024-05-10T11:12:37.186722+0000","last_undegraded":"2024-05-10T11:12:37.186722+0000","last_fullsized":"2024-05-10T11:12:37.186722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:58.094353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132416+0000","last_change":"2024-05-10T11:12:30.109801+0000","last_active":"2024-05-10T11:12:36.132416+0000","last_peered":"2024-05-10T11:12:36.132416+0000","last_clean":"2024-05-10T11:12:36.132416+0000","last_became_active":"2024-05-10T11:12:30.109068+0000","last_became_peered":"2024-05-10T11:12:30.109068+0000","last_unstale":"2024-05-10T11:12:36.132416+0000","last_undegraded":"2024-05-10T11:12:36.132416+0000","last_fullsized":"2024-05-10T11:12:36.132416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:58.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.131960+0000","last_change":"2024-05-10T11:12:35.132271+0000","last_active":"2024-05-10T11:12:36.131960+0000","last_peered":"2024-05-10T11:12:36.131960+0000","last_clean":"2024-05-10T11:12:36.131960+0000","last_became_active":"2024-05-10T11:12:35.131925+0000","last_became_peered":"2024-05-10T11:12:35.131925+0000","last_unstale":"2024-05-10T11:12:36.131960+0000","last_undegraded":"2024-05-10T11:12:36.131960+0000","last_fullsized":"2024-05-10T11:12:36.131960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:55.050495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186329+0000","last_change":"2024-05-10T11:12:31.120591+0000","last_active":"2024-05-10T11:12:37.186329+0000","last_peered":"2024-05-10T11:12:37.186329+0000","last_clean":"2024-05-10T11:12:37.186329+0000","last_became_active":"2024-05-10T11:12:31.120238+0000","last_became_peered":"2024-05-10T11:12:31.120238+0000","last_unstale":"2024-05-10T11:12:37.186329+0000","last_undegraded":"2024-05-10T11:12:37.186329+0000","last_fullsized":"2024-05-10T11:12:37.186329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:54:56.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187113+0000","last_change":"2024-05-10T11:12:30.106471+0000","last_active":"2024-05-10T11:12:37.187113+0000","last_peered":"2024-05-10T11:12:37.187113+0000","last_clean":"2024-05-10T11:12:37.187113+0000","last_became_active":"2024-05-10T11:12:30.106152+0000","last_became_peered":"2024-05-10T11:12:30.106152+0000","last_unstale":"2024-05-10T11:12:37.187113+0000","last_undegraded":"2024-05-10T11:12:37.187113+0000","last_fullsized":"2024-05-10T11:12:37.187113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187285+0000","last_change":"2024-05-10T11:12:35.126286+0000","last_active":"2024-05-10T11:12:37.187285+0000","last_peered":"2024-05-10T11:12:37.187285+0000","last_clean":"2024-05-10T11:12:37.187285+0000","last_became_active":"2024-05-10T11:12:35.125717+0000","last_became_peered":"2024-05-10T11:12:35.125717+0000","last_unstale":"2024-05-10T11:12:37.187285+0000","last_undegraded":"2024-05-10T11:12:37.187285+0000","last_fullsized":"2024-05-10T11:12:37.187285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285141+0000","last_change":"2024-05-10T11:12:31.109293+0000","last_active":"2024-05-10T11:12:36.285141+0000","last_peered":"2024-05-10T11:12:36.285141+0000","last_clean":"2024-05-10T11:12:36.285141+0000","last_became_active":"2024-05-10T11:12:31.109011+0000","last_became_peered":"2024-05-10T11:12:31.109011+0000","last_unstale":"2024-05-10T11:12:36.285141+0000","last_undegraded":"2024-05-10T11:12:36.285141+0000","last_fullsized":"2024-05-10T11:12:36.285141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:23.860440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285079+0000","last_change":"2024-05-10T11:12:30.112853+0000","last_active":"2024-05-10T11:12:36.285079+0000","last_peered":"2024-05-10T11:12:36.285079+0000","last_clean":"2024-05-10T11:12:36.285079+0000","last_became_active":"2024-05-10T11:12:30.112518+0000","last_became_peered":"2024-05-10T11:12:30.112518+0000","last_unstale":"2024-05-10T11:12:36.285079+0000","last_undegraded":"2024-05-10T11:12:36.285079+0000","last_fullsized":"2024-05-10T11:12:36.285079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188215+0000","last_change":"2024-05-10T11:12:35.421295+0000","last_active":"2024-05-10T11:12:37.188215+0000","last_peered":"2024-05-10T11:12:37.188215+0000","last_clean":"2024-05-10T11:12:37.188215+0000","last_became_active":"2024-05-10T11:12:35.420917+0000","last_became_peered":"2024-05-10T11:12:35.420917+0000","last_unstale":"2024-05-10T11:12:37.188215+0000","last_undegraded":"2024-05-10T11:12:37.188215+0000","last_fullsized":"2024-05-10T11:12:37.188215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:08:10.900267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186431+0000","last_change":"2024-05-10T11:12:31.118875+0000","last_active":"2024-05-10T11:12:37.186431+0000","last_peered":"2024-05-10T11:12:37.186431+0000","last_clean":"2024-05-10T11:12:37.186431+0000","last_became_active":"2024-05-10T11:12:31.118593+0000","last_became_peered":"2024-05-10T11:12:31.118593+0000","last_unstale":"2024-05-10T11:12:37.186431+0000","last_undegraded":"2024-05-10T11:12:37.186431+0000","last_fullsized":"2024-05-10T11:12:37.186431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:36.209217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133641+0000","last_change":"2024-05-10T11:12:30.112650+0000","last_active":"2024-05-10T11:12:36.133641+0000","last_peered":"2024-05-10T11:12:36.133641+0000","last_clean":"2024-05-10T11:12:36.133641+0000","last_became_active":"2024-05-10T11:12:30.112297+0000","last_became_peered":"2024-05-10T11:12:30.112297+0000","last_unstale":"2024-05-10T11:12:36.133641+0000","last_undegraded":"2024-05-10T11:12:36.133641+0000","last_fullsized":"2024-05-10T11:12:36.133641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188493+0000","last_change":"2024-05-10T11:12:35.420619+0000","last_active":"2024-05-10T11:12:37.188493+0000","last_peered":"2024-05-10T11:12:37.188493+0000","last_clean":"2024-05-10T11:12:37.188493+0000","last_became_active":"2024-05-10T11:12:35.420215+0000","last_became_peered":"2024-05-10T11:12:35.420215+0000","last_unstale":"2024-05-10T11:12:37.188493+0000","last_undegraded":"2024-05-10T11:12:37.188493+0000","last_fullsized":"2024-05-10T11:12:37.188493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:13.010526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187343+0000","last_change":"2024-05-10T11:12:31.109731+0000","last_active":"2024-05-10T11:12:37.187343+0000","last_peered":"2024-05-10T11:12:37.187343+0000","last_clean":"2024-05-10T11:12:37.187343+0000","last_became_active":"2024-05-10T11:12:31.109139+0000","last_became_peered":"2024-05-10T11:12:31.109139+0000","last_unstale":"2024-05-10T11:12:37.187343+0000","last_undegraded":"2024-05-10T11:12:37.187343+0000","last_fullsized":"2024-05-10T11:12:37.187343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187717+0000","last_change":"2024-05-10T11:12:30.100711+0000","last_active":"2024-05-10T11:12:37.187717+0000","last_peered":"2024-05-10T11:12:37.187717+0000","last_clean":"2024-05-10T11:12:37.187717+0000","last_became_active":"2024-05-10T11:12:30.100119+0000","last_became_peered":"2024-05-10T11:12:30.100119+0000","last_unstale":"2024-05-10T11:12:37.187717+0000","last_undegraded":"2024-05-10T11:12:37.187717+0000","last_fullsized":"2024-05-10T11:12:37.187717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133273+0000","last_change":"2024-05-10T11:12:35.421572+0000","last_active":"2024-05-10T11:12:36.133273+0000","last_peered":"2024-05-10T11:12:36.133273+0000","last_clean":"2024-05-10T11:12:36.133273+0000","last_became_active":"2024-05-10T11:12:35.421218+0000","last_became_peered":"2024-05-10T11:12:35.421218+0000","last_unstale":"2024-05-10T11:12:36.133273+0000","last_undegraded":"2024-05-10T11:12:36.133273+0000","last_fullsized":"2024-05-10T11:12:36.133273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186338+0000","last_change":"2024-05-10T11:12:31.119385+0000","last_active":"2024-05-10T11:12:37.186338+0000","last_peered":"2024-05-10T11:12:37.186338+0000","last_clean":"2024-05-10T11:12:37.186338+0000","last_became_active":"2024-05-10T11:12:31.118251+0000","last_became_peered":"2024-05-10T11:12:31.118251+0000","last_unstale":"2024-05-10T11:12:37.186338+0000","last_undegraded":"2024-05-10T11:12:37.186338+0000","last_fullsized":"2024-05-10T11:12:37.186338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:27.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:40.660245+0000","last_change":"2024-05-10T11:12:30.115042+0000","last_active":"2024-05-10T11:12:40.660245+0000","last_peered":"2024-05-10T11:12:40.660245+0000","last_clean":"2024-05-10T11:12:40.660245+0000","last_became_active":"2024-05-10T11:12:30.114856+0000","last_became_peered":"2024-05-10T11:12:30.114856+0000","last_unstale":"2024-05-10T11:12:40.660245+0000","last_undegraded":"2024-05-10T11:12:40.660245+0000","last_fullsized":"2024-05-10T11:12:40.660245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188815+0000","last_change":"2024-05-10T11:12:35.134285+0000","last_active":"2024-05-10T11:12:37.188815+0000","last_peered":"2024-05-10T11:12:37.188815+0000","last_clean":"2024-05-10T11:12:37.188815+0000","last_became_active":"2024-05-10T11:12:35.133864+0000","last_became_peered":"2024-05-10T11:12:35.133864+0000","last_unstale":"2024-05-10T11:12:37.188815+0000","last_undegraded":"2024-05-10T11:12:37.188815+0000","last_fullsized":"2024-05-10T11:12:37.188815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133000+0000","last_change":"2024-05-10T11:12:31.112754+0000","last_active":"2024-05-10T11:12:36.133000+0000","last_peered":"2024-05-10T11:12:36.133000+0000","last_clean":"2024-05-10T11:12:36.133000+0000","last_became_active":"2024-05-10T11:12:31.112193+0000","last_became_peered":"2024-05-10T11:12:31.112193+0000","last_unstale":"2024-05-10T11:12:36.133000+0000","last_undegraded":"2024-05-10T11:12:36.133000+0000","last_fullsized":"2024-05-10T11:12:36.133000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:06.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186601+0000","last_change":"2024-05-10T11:12:30.104162+0000","last_active":"2024-05-10T11:12:37.186601+0000","last_peered":"2024-05-10T11:12:37.186601+0000","last_clean":"2024-05-10T11:12:37.186601+0000","last_became_active":"2024-05-10T11:12:30.103843+0000","last_became_peered":"2024-05-10T11:12:30.103843+0000","last_unstale":"2024-05-10T11:12:37.186601+0000","last_undegraded":"2024-05-10T11:12:37.186601+0000","last_fullsized":"2024-05-10T11:12:37.186601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133886+0000","last_change":"2024-05-10T11:12:35.135088+0000","last_active":"2024-05-10T11:12:36.133886+0000","last_peered":"2024-05-10T11:12:36.133886+0000","last_clean":"2024-05-10T11:12:36.133886+0000","last_became_active":"2024-05-10T11:12:35.134532+0000","last_became_peered":"2024-05-10T11:12:35.134532+0000","last_unstale":"2024-05-10T11:12:36.133886+0000","last_undegraded":"2024-05-10T11:12:36.133886+0000","last_fullsized":"2024-05-10T11:12:36.133886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:42.541074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186828+0000","last_change":"2024-05-10T11:12:31.118512+0000","last_active":"2024-05-10T11:12:37.186828+0000","last_peered":"2024-05-10T11:12:37.186828+0000","last_clean":"2024-05-10T11:12:37.186828+0000","last_became_active":"2024-05-10T11:12:31.117887+0000","last_became_peered":"2024-05-10T11:12:31.117887+0000","last_unstale":"2024-05-10T11:12:37.186828+0000","last_undegraded":"2024-05-10T11:12:37.186828+0000","last_fullsized":"2024-05-10T11:12:37.186828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132913+0000","last_change":"2024-05-10T11:12:30.108984+0000","last_active":"2024-05-10T11:12:36.132913+0000","last_peered":"2024-05-10T11:12:36.132913+0000","last_clean":"2024-05-10T11:12:36.132913+0000","last_became_active":"2024-05-10T11:12:30.108652+0000","last_became_peered":"2024-05-10T11:12:30.108652+0000","last_unstale":"2024-05-10T11:12:36.132913+0000","last_undegraded":"2024-05-10T11:12:36.132913+0000","last_fullsized":"2024-05-10T11:12:36.132913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187375+0000","last_change":"2024-05-10T11:12:35.135736+0000","last_active":"2024-05-10T11:12:37.187375+0000","last_peered":"2024-05-10T11:12:37.187375+0000","last_clean":"2024-05-10T11:12:37.187375+0000","last_became_active":"2024-05-10T11:12:35.133392+0000","last_became_peered":"2024-05-10T11:12:35.133392+0000","last_unstale":"2024-05-10T11:12:37.187375+0000","last_undegraded":"2024-05-10T11:12:37.187375+0000","last_fullsized":"2024-05-10T11:12:37.187375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132810+0000","last_change":"2024-05-10T11:12:31.111452+0000","last_active":"2024-05-10T11:12:36.132810+0000","last_peered":"2024-05-10T11:12:36.132810+0000","last_clean":"2024-05-10T11:12:36.132810+0000","last_became_active":"2024-05-10T11:12:31.111168+0000","last_became_peered":"2024-05-10T11:12:31.111168+0000","last_unstale":"2024-05-10T11:12:36.132810+0000","last_undegraded":"2024-05-10T11:12:36.132810+0000","last_fullsized":"2024-05-10T11:12:36.132810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285516+0000","last_change":"2024-05-10T11:12:30.112912+0000","last_active":"2024-05-10T11:12:36.285516+0000","last_peered":"2024-05-10T11:12:36.285516+0000","last_clean":"2024-05-10T11:12:36.285516+0000","last_became_active":"2024-05-10T11:12:30.111893+0000","last_became_peered":"2024-05-10T11:12:30.111893+0000","last_unstale":"2024-05-10T11:12:36.285516+0000","last_undegraded":"2024-05-10T11:12:36.285516+0000","last_fullsized":"2024-05-10T11:12:36.285516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188183+0000","last_change":"2024-05-10T11:12:35.420832+0000","last_active":"2024-05-10T11:12:37.188183+0000","last_peered":"2024-05-10T11:12:37.188183+0000","last_clean":"2024-05-10T11:12:37.188183+0000","last_became_active":"2024-05-10T11:12:35.420468+0000","last_became_peered":"2024-05-10T11:12:35.420468+0000","last_unstale":"2024-05-10T11:12:37.188183+0000","last_undegraded":"2024-05-10T11:12:37.188183+0000","last_fullsized":"2024-05-10T11:12:37.188183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:03:37.556378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187133+0000","last_change":"2024-05-10T11:12:35.420919+0000","last_active":"2024-05-10T11:12:37.187133+0000","last_peered":"2024-05-10T11:12:37.187133+0000","last_clean":"2024-05-10T11:12:37.187133+0000","last_became_active":"2024-05-10T11:12:35.420486+0000","last_became_peered":"2024-05-10T11:12:35.420486+0000","last_unstale":"2024-05-10T11:12:37.187133+0000","last_undegraded":"2024-05-10T11:12:37.187133+0000","last_fullsized":"2024-05-10T11:12:37.187133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186198+0000","last_change":"2024-05-10T11:12:31.113465+0000","last_active":"2024-05-10T11:12:37.186198+0000","last_peered":"2024-05-10T11:12:37.186198+0000","last_clean":"2024-05-10T11:12:37.186198+0000","last_became_active":"2024-05-10T11:12:31.112391+0000","last_became_peered":"2024-05-10T11:12:31.112391+0000","last_unstale":"2024-05-10T11:12:37.186198+0000","last_undegraded":"2024-05-10T11:12:37.186198+0000","last_fullsized":"2024-05-10T11:12:37.186198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132384+0000","last_change":"2024-05-10T11:12:30.111231+0000","last_active":"2024-05-10T11:12:36.132384+0000","last_peered":"2024-05-10T11:12:36.132384+0000","last_clean":"2024-05-10T11:12:36.132384+0000","last_became_active":"2024-05-10T11:12:30.110915+0000","last_became_peered":"2024-05-10T11:12:30.110915+0000","last_unstale":"2024-05-10T11:12:36.132384+0000","last_undegraded":"2024-05-10T11:12:36.132384+0000","last_fullsized":"2024-05-10T11:12:36.132384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285493+0000","last_change":"2024-05-10T11:12:35.133270+0000","last_active":"2024-05-10T11:12:36.285493+0000","last_peered":"2024-05-10T11:12:36.285493+0000","last_clean":"2024-05-10T11:12:36.285493+0000","last_became_active":"2024-05-10T11:12:35.132883+0000","last_became_peered":"2024-05-10T11:12:35.132883+0000","last_unstale":"2024-05-10T11:12:36.285493+0000","last_undegraded":"2024-05-10T11:12:36.285493+0000","last_fullsized":"2024-05-10T11:12:36.285493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187365+0000","last_change":"2024-05-10T11:12:31.111880+0000","last_active":"2024-05-10T11:12:37.187365+0000","last_peered":"2024-05-10T11:12:37.187365+0000","last_clean":"2024-05-10T11:12:37.187365+0000","last_became_active":"2024-05-10T11:12:31.111561+0000","last_became_peered":"2024-05-10T11:12:31.111561+0000","last_unstale":"2024-05-10T11:12:37.187365+0000","last_undegraded":"2024-05-10T11:12:37.187365+0000","last_fullsized":"2024-05-10T11:12:37.187365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188080+0000","last_change":"2024-05-10T11:12:30.109020+0000","last_active":"2024-05-10T11:12:37.188080+0000","last_peered":"2024-05-10T11:12:37.188080+0000","last_clean":"2024-05-10T11:12:37.188080+0000","last_became_active":"2024-05-10T11:12:30.108553+0000","last_became_peered":"2024-05-10T11:12:30.108553+0000","last_unstale":"2024-05-10T11:12:37.188080+0000","last_undegraded":"2024-05-10T11:12:37.188080+0000","last_fullsized":"2024-05-10T11:12:37.188080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:39.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285277+0000","last_change":"2024-05-10T11:12:30.109083+0000","last_active":"2024-05-10T11:12:36.285277+0000","last_peered":"2024-05-10T11:12:36.285277+0000","last_clean":"2024-05-10T11:12:36.285277+0000","last_became_active":"2024-05-10T11:12:30.108670+0000","last_became_peered":"2024-05-10T11:12:30.108670+0000","last_unstale":"2024-05-10T11:12:36.285277+0000","last_undegraded":"2024-05-10T11:12:36.285277+0000","last_fullsized":"2024-05-10T11:12:36.285277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:58.672933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187664+0000","last_change":"2024-05-10T11:12:31.108203+0000","last_active":"2024-05-10T11:12:37.187664+0000","last_peered":"2024-05-10T11:12:37.187664+0000","last_clean":"2024-05-10T11:12:37.187664+0000","last_became_active":"2024-05-10T11:12:31.105737+0000","last_became_peered":"2024-05-10T11:12:31.105737+0000","last_unstale":"2024-05-10T11:12:37.187664+0000","last_undegraded":"2024-05-10T11:12:37.187664+0000","last_fullsized":"2024-05-10T11:12:37.187664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186596+0000","last_change":"2024-05-10T11:12:35.138676+0000","last_active":"2024-05-10T11:12:37.186596+0000","last_peered":"2024-05-10T11:12:37.186596+0000","last_clean":"2024-05-10T11:12:37.186596+0000","last_became_active":"2024-05-10T11:12:35.138246+0000","last_became_peered":"2024-05-10T11:12:35.138246+0000","last_unstale":"2024-05-10T11:12:37.186596+0000","last_undegraded":"2024-05-10T11:12:37.186596+0000","last_fullsized":"2024-05-10T11:12:37.186596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:10:22.656575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188197+0000","last_change":"2024-05-10T11:12:30.104759+0000","last_active":"2024-05-10T11:12:37.188197+0000","last_peered":"2024-05-10T11:12:37.188197+0000","last_clean":"2024-05-10T11:12:37.188197+0000","last_became_active":"2024-05-10T11:12:30.104499+0000","last_became_peered":"2024-05-10T11:12:30.104499+0000","last_unstale":"2024-05-10T11:12:37.188197+0000","last_undegraded":"2024-05-10T11:12:37.188197+0000","last_fullsized":"2024-05-10T11:12:37.188197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132631+0000","last_change":"2024-05-10T11:12:31.105067+0000","last_active":"2024-05-10T11:12:36.132631+0000","last_peered":"2024-05-10T11:12:36.132631+0000","last_clean":"2024-05-10T11:12:36.132631+0000","last_became_active":"2024-05-10T11:12:31.104796+0000","last_became_peered":"2024-05-10T11:12:31.104796+0000","last_unstale":"2024-05-10T11:12:36.132631+0000","last_undegraded":"2024-05-10T11:12:36.132631+0000","last_fullsized":"2024-05-10T11:12:36.132631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:14.797134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187802+0000","last_change":"2024-05-10T11:12:35.137496+0000","last_active":"2024-05-10T11:12:37.187802+0000","last_peered":"2024-05-10T11:12:37.187802+0000","last_clean":"2024-05-10T11:12:37.187802+0000","last_became_active":"2024-05-10T11:12:35.137075+0000","last_became_peered":"2024-05-10T11:12:35.137075+0000","last_unstale":"2024-05-10T11:12:37.187802+0000","last_undegraded":"2024-05-10T11:12:37.187802+0000","last_fullsized":"2024-05-10T11:12:37.187802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:05.500894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284987+0000","last_change":"2024-05-10T11:12:31.109999+0000","last_active":"2024-05-10T11:12:36.284987+0000","last_peered":"2024-05-10T11:12:36.284987+0000","last_clean":"2024-05-10T11:12:36.284987+0000","last_became_active":"2024-05-10T11:12:31.109735+0000","last_became_peered":"2024-05-10T11:12:31.109735+0000","last_unstale":"2024-05-10T11:12:36.284987+0000","last_undegraded":"2024-05-10T11:12:36.284987+0000","last_fullsized":"2024-05-10T11:12:36.284987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:16.421221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186110+0000","last_change":"2024-05-10T11:12:31.099225+0000","last_active":"2024-05-10T11:12:37.186110+0000","last_peered":"2024-05-10T11:12:37.186110+0000","last_clean":"2024-05-10T11:12:37.186110+0000","last_became_active":"2024-05-10T11:12:31.098939+0000","last_became_peered":"2024-05-10T11:12:31.098939+0000","last_unstale":"2024-05-10T11:12:37.186110+0000","last_undegraded":"2024-05-10T11:12:37.186110+0000","last_fullsized":"2024-05-10T11:12:37.186110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:37.589756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133535+0000","last_change":"2024-05-10T11:12:31.113217+0000","last_active":"2024-05-10T11:12:36.133535+0000","last_peered":"2024-05-10T11:12:36.133535+0000","last_clean":"2024-05-10T11:12:36.133535+0000","last_became_active":"2024-05-10T11:12:31.112918+0000","last_became_peered":"2024-05-10T11:12:31.112918+0000","last_unstale":"2024-05-10T11:12:36.133535+0000","last_undegraded":"2024-05-10T11:12:36.133535+0000","last_fullsized":"2024-05-10T11:12:36.133535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187573+0000","last_change":"2024-05-10T11:12:31.118834+0000","last_active":"2024-05-10T11:12:37.187573+0000","last_peered":"2024-05-10T11:12:37.187573+0000","last_clean":"2024-05-10T11:12:37.187573+0000","last_became_active":"2024-05-10T11:12:31.118516+0000","last_became_peered":"2024-05-10T11:12:31.118516+0000","last_unstale":"2024-05-10T11:12:37.187573+0000","last_undegraded":"2024-05-10T11:12:37.187573+0000","last_fullsized":"2024-05-10T11:12:37.187573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188567+0000","last_change":"2024-05-10T11:12:31.117568+0000","last_active":"2024-05-10T11:12:37.188567+0000","last_peered":"2024-05-10T11:12:37.188567+0000","last_clean":"2024-05-10T11:12:37.188567+0000","last_became_active":"2024-05-10T11:12:31.117238+0000","last_became_peered":"2024-05-10T11:12:31.117238+0000","last_unstale":"2024-05-10T11:12:37.188567+0000","last_undegraded":"2024-05-10T11:12:37.188567+0000","last_fullsized":"2024-05-10T11:12:37.188567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:31.113071+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:31.112773+0000","last_became_peered":"2024-05-10T11:12:31.112773+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285634+0000","last_change":"2024-05-10T11:12:31.111220+0000","last_active":"2024-05-10T11:12:36.285634+0000","last_peered":"2024-05-10T11:12:36.285634+0000","last_clean":"2024-05-10T11:12:36.285634+0000","last_became_active":"2024-05-10T11:12:31.110958+0000","last_became_peered":"2024-05-10T11:12:31.110958+0000","last_unstale":"2024-05-10T11:12:36.285634+0000","last_undegraded":"2024-05-10T11:12:36.285634+0000","last_fullsized":"2024-05-10T11:12:36.285634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:51.025764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188266+0000","last_change":"2024-05-10T11:12:31.116575+0000","last_active":"2024-05-10T11:12:37.188266+0000","last_peered":"2024-05-10T11:12:37.188266+0000","last_clean":"2024-05-10T11:12:37.188266+0000","last_became_active":"2024-05-10T11:12:31.116288+0000","last_became_peered":"2024-05-10T11:12:31.116288+0000","last_unstale":"2024-05-10T11:12:37.188266+0000","last_undegraded":"2024-05-10T11:12:37.188266+0000","last_fullsized":"2024-05-10T11:12:37.188266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132498+0000","last_change":"2024-05-10T11:12:31.117085+0000","last_active":"2024-05-10T11:12:36.132498+0000","last_peered":"2024-05-10T11:12:36.132498+0000","last_clean":"2024-05-10T11:12:36.132498+0000","last_became_active":"2024-05-10T11:12:31.116791+0000","last_became_peered":"2024-05-10T11:12:31.116791+0000","last_unstale":"2024-05-10T11:12:36.132498+0000","last_undegraded":"2024-05-10T11:12:36.132498+0000","last_fullsized":"2024-05-10T11:12:36.132498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187990+0000","last_change":"2024-05-10T11:12:31.117793+0000","last_active":"2024-05-10T11:12:37.187990+0000","last_peered":"2024-05-10T11:12:37.187990+0000","last_clean":"2024-05-10T11:12:37.187990+0000","last_became_active":"2024-05-10T11:12:31.117201+0000","last_became_peered":"2024-05-10T11:12:31.117201+0000","last_unstale":"2024-05-10T11:12:37.187990+0000","last_undegraded":"2024-05-10T11:12:37.187990+0000","last_fullsized":"2024-05-10T11:12:37.187990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133423+0000","last_change":"2024-05-10T11:12:31.111395+0000","last_active":"2024-05-10T11:12:36.133423+0000","last_peered":"2024-05-10T11:12:36.133423+0000","last_clean":"2024-05-10T11:12:36.133423+0000","last_became_active":"2024-05-10T11:12:31.111135+0000","last_became_peered":"2024-05-10T11:12:31.111135+0000","last_unstale":"2024-05-10T11:12:36.133423+0000","last_undegraded":"2024-05-10T11:12:36.133423+0000","last_fullsized":"2024-05-10T11:12:36.133423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187468+0000","last_change":"2024-05-10T11:12:31.111936+0000","last_active":"2024-05-10T11:12:37.187468+0000","last_peered":"2024-05-10T11:12:37.187468+0000","last_clean":"2024-05-10T11:12:37.187468+0000","last_became_active":"2024-05-10T11:12:31.111680+0000","last_became_peered":"2024-05-10T11:12:31.111680+0000","last_unstale":"2024-05-10T11:12:37.187468+0000","last_undegraded":"2024-05-10T11:12:37.187468+0000","last_fullsized":"2024-05-10T11:12:37.187468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285454+0000","last_change":"2024-05-10T11:12:31.106171+0000","last_active":"2024-05-10T11:12:36.285454+0000","last_peered":"2024-05-10T11:12:36.285454+0000","last_clean":"2024-05-10T11:12:36.285454+0000","last_became_active":"2024-05-10T11:12:31.105915+0000","last_became_peered":"2024-05-10T11:12:31.105915+0000","last_unstale":"2024-05-10T11:12:36.285454+0000","last_undegraded":"2024-05-10T11:12:36.285454+0000","last_fullsized":"2024-05-10T11:12:36.285454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:17.016710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186719+0000","last_change":"2024-05-10T11:12:31.116162+0000","last_active":"2024-05-10T11:12:37.186719+0000","last_peered":"2024-05-10T11:12:37.186719+0000","last_clean":"2024-05-10T11:12:37.186719+0000","last_became_active":"2024-05-10T11:12:31.115881+0000","last_became_peered":"2024-05-10T11:12:31.115881+0000","last_unstale":"2024-05-10T11:12:37.186719+0000","last_undegraded":"2024-05-10T11:12:37.186719+0000","last_fullsized":"2024-05-10T11:12:37.186719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:38.516343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186489+0000","last_change":"2024-05-10T11:12:31.104416+0000","last_active":"2024-05-10T11:12:37.186489+0000","last_peered":"2024-05-10T11:12:37.186489+0000","last_clean":"2024-05-10T11:12:37.186489+0000","last_became_active":"2024-05-10T11:12:31.104119+0000","last_became_peered":"2024-05-10T11:12:31.104119+0000","last_unstale":"2024-05-10T11:12:37.186489+0000","last_undegraded":"2024-05-10T11:12:37.186489+0000","last_fullsized":"2024-05-10T11:12:37.186489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:07.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133674+0000","last_change":"2024-05-10T11:12:31.111652+0000","last_active":"2024-05-10T11:12:36.133674+0000","last_peered":"2024-05-10T11:12:36.133674+0000","last_clean":"2024-05-10T11:12:36.133674+0000","last_became_active":"2024-05-10T11:12:31.111385+0000","last_became_peered":"2024-05-10T11:12:31.111385+0000","last_unstale":"2024-05-10T11:12:36.133674+0000","last_undegraded":"2024-05-10T11:12:36.133674+0000","last_fullsized":"2024-05-10T11:12:36.133674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:43.352019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132211+0000","last_change":"2024-05-10T11:12:31.110383+0000","last_active":"2024-05-10T11:12:36.132211+0000","last_peered":"2024-05-10T11:12:36.132211+0000","last_clean":"2024-05-10T11:12:36.132211+0000","last_became_active":"2024-05-10T11:12:31.108601+0000","last_became_peered":"2024-05-10T11:12:31.108601+0000","last_unstale":"2024-05-10T11:12:36.132211+0000","last_undegraded":"2024-05-10T11:12:36.132211+0000","last_fullsized":"2024-05-10T11:12:36.132211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186293+0000","last_change":"2024-05-10T11:12:31.108178+0000","last_active":"2024-05-10T11:12:37.186293+0000","last_peered":"2024-05-10T11:12:37.186293+0000","last_clean":"2024-05-10T11:12:37.186293+0000","last_became_active":"2024-05-10T11:12:31.107907+0000","last_became_peered":"2024-05-10T11:12:31.107907+0000","last_unstale":"2024-05-10T11:12:37.186293+0000","last_undegraded":"2024-05-10T11:12:37.186293+0000","last_fullsized":"2024-05-10T11:12:37.186293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187803+0000","last_change":"2024-05-10T11:12:31.110566+0000","last_active":"2024-05-10T11:12:37.187803+0000","last_peered":"2024-05-10T11:12:37.187803+0000","last_clean":"2024-05-10T11:12:37.187803+0000","last_became_active":"2024-05-10T11:12:31.109454+0000","last_became_peered":"2024-05-10T11:12:31.109454+0000","last_unstale":"2024-05-10T11:12:37.187803+0000","last_undegraded":"2024-05-10T11:12:37.187803+0000","last_fullsized":"2024-05-10T11:12:37.187803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188026+0000","last_change":"2024-05-10T11:12:31.115792+0000","last_active":"2024-05-10T11:12:37.188026+0000","last_peered":"2024-05-10T11:12:37.188026+0000","last_clean":"2024-05-10T11:12:37.188026+0000","last_became_active":"2024-05-10T11:12:31.115100+0000","last_became_peered":"2024-05-10T11:12:31.115100+0000","last_unstale":"2024-05-10T11:12:37.188026+0000","last_undegraded":"2024-05-10T11:12:37.188026+0000","last_fullsized":"2024-05-10T11:12:37.188026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132918+0000","last_change":"2024-05-10T11:12:31.103226+0000","last_active":"2024-05-10T11:12:36.132918+0000","last_peered":"2024-05-10T11:12:36.132918+0000","last_clean":"2024-05-10T11:12:36.132918+0000","last_became_active":"2024-05-10T11:12:31.102693+0000","last_became_peered":"2024-05-10T11:12:31.102693+0000","last_unstale":"2024-05-10T11:12:36.132918+0000","last_undegraded":"2024-05-10T11:12:36.132918+0000","last_fullsized":"2024-05-10T11:12:36.132918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:58.305425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285258+0000","last_change":"2024-05-10T11:12:31.117347+0000","last_active":"2024-05-10T11:12:36.285258+0000","last_peered":"2024-05-10T11:12:36.285258+0000","last_clean":"2024-05-10T11:12:36.285258+0000","last_became_active":"2024-05-10T11:12:31.117080+0000","last_became_peered":"2024-05-10T11:12:31.117080+0000","last_unstale":"2024-05-10T11:12:36.285258+0000","last_undegraded":"2024-05-10T11:12:36.285258+0000","last_fullsized":"2024-05-10T11:12:36.285258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:20:41.148766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285571+0000","last_change":"2024-05-10T11:12:31.113909+0000","last_active":"2024-05-10T11:12:36.285571+0000","last_peered":"2024-05-10T11:12:36.285571+0000","last_clean":"2024-05-10T11:12:36.285571+0000","last_became_active":"2024-05-10T11:12:31.113651+0000","last_became_peered":"2024-05-10T11:12:31.113651+0000","last_unstale":"2024-05-10T11:12:36.285571+0000","last_undegraded":"2024-05-10T11:12:36.285571+0000","last_fullsized":"2024-05-10T11:12:36.285571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:43.952189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186834+0000","last_change":"2024-05-10T11:12:31.117272+0000","last_active":"2024-05-10T11:12:37.186834+0000","last_peered":"2024-05-10T11:12:37.186834+0000","last_clean":"2024-05-10T11:12:37.186834+0000","last_became_active":"2024-05-10T11:12:31.117013+0000","last_became_peered":"2024-05-10T11:12:31.117013+0000","last_unstale":"2024-05-10T11:12:37.186834+0000","last_undegraded":"2024-05-10T11:12:37.186834+0000","last_fullsized":"2024-05-10T11:12:37.186834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:25.498498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187253+0000","last_change":"2024-05-10T11:12:31.118763+0000","last_active":"2024-05-10T11:12:37.187253+0000","last_peered":"2024-05-10T11:12:37.187253+0000","last_clean":"2024-05-10T11:12:37.187253+0000","last_became_active":"2024-05-10T11:12:31.118500+0000","last_became_peered":"2024-05-10T11:12:31.118500+0000","last_unstale":"2024-05-10T11:12:37.187253+0000","last_undegraded":"2024-05-10T11:12:37.187253+0000","last_fullsized":"2024-05-10T11:12:37.187253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186156+0000","last_change":"2024-05-10T11:12:31.121865+0000","last_active":"2024-05-10T11:12:37.186156+0000","last_peered":"2024-05-10T11:12:37.186156+0000","last_clean":"2024-05-10T11:12:37.186156+0000","last_became_active":"2024-05-10T11:12:31.121590+0000","last_became_peered":"2024-05-10T11:12:31.121590+0000","last_unstale":"2024-05-10T11:12:37.186156+0000","last_undegraded":"2024-05-10T11:12:37.186156+0000","last_fullsized":"2024-05-10T11:12:37.186156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:39.407373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133353+0000","last_change":"2024-05-10T11:12:31.118987+0000","last_active":"2024-05-10T11:12:36.133353+0000","last_peered":"2024-05-10T11:12:36.133353+0000","last_clean":"2024-05-10T11:12:36.133353+0000","last_became_active":"2024-05-10T11:12:31.118719+0000","last_became_peered":"2024-05-10T11:12:31.118719+0000","last_unstale":"2024-05-10T11:12:36.133353+0000","last_undegraded":"2024-05-10T11:12:36.133353+0000","last_fullsized":"2024-05-10T11:12:36.133353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:55:31.635937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186264+0000","last_change":"2024-05-10T11:12:31.114654+0000","last_active":"2024-05-10T11:12:37.186264+0000","last_peered":"2024-05-10T11:12:37.186264+0000","last_clean":"2024-05-10T11:12:37.186264+0000","last_became_active":"2024-05-10T11:12:31.114360+0000","last_became_peered":"2024-05-10T11:12:31.114360+0000","last_unstale":"2024-05-10T11:12:37.186264+0000","last_undegraded":"2024-05-10T11:12:37.186264+0000","last_fullsized":"2024-05-10T11:12:37.186264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:43.145552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132883+0000","last_change":"2024-05-10T11:12:31.116369+0000","last_active":"2024-05-10T11:12:36.132883+0000","last_peered":"2024-05-10T11:12:36.132883+0000","last_clean":"2024-05-10T11:12:36.132883+0000","last_became_active":"2024-05-10T11:12:31.114859+0000","last_became_peered":"2024-05-10T11:12:31.114859+0000","last_unstale":"2024-05-10T11:12:36.132883+0000","last_undegraded":"2024-05-10T11:12:36.132883+0000","last_fullsized":"2024-05-10T11:12:36.132883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186153+0000","last_change":"2024-05-10T11:12:31.116456+0000","last_active":"2024-05-10T11:12:37.186153+0000","last_peered":"2024-05-10T11:12:37.186153+0000","last_clean":"2024-05-10T11:12:37.186153+0000","last_became_active":"2024-05-10T11:12:31.115520+0000","last_became_peered":"2024-05-10T11:12:31.115520+0000","last_unstale":"2024-05-10T11:12:37.186153+0000","last_undegraded":"2024-05-10T11:12:37.186153+0000","last_fullsized":"2024-05-10T11:12:37.186153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186576+0000","last_change":"2024-05-10T11:12:31.107221+0000","last_active":"2024-05-10T11:12:37.186576+0000","last_peered":"2024-05-10T11:12:37.186576+0000","last_clean":"2024-05-10T11:12:37.186576+0000","last_became_active":"2024-05-10T11:12:31.106948+0000","last_became_peered":"2024-05-10T11:12:31.106948+0000","last_unstale":"2024-05-10T11:12:37.186576+0000","last_undegraded":"2024-05-10T11:12:37.186576+0000","last_fullsized":"2024-05-10T11:12:37.186576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186697+0000","last_change":"2024-05-10T11:12:31.113410+0000","last_active":"2024-05-10T11:12:37.186697+0000","last_peered":"2024-05-10T11:12:37.186697+0000","last_clean":"2024-05-10T11:12:37.186697+0000","last_became_active":"2024-05-10T11:12:31.112221+0000","last_became_peered":"2024-05-10T11:12:31.112221+0000","last_unstale":"2024-05-10T11:12:37.186697+0000","last_undegraded":"2024-05-10T11:12:37.186697+0000","last_fullsized":"2024-05-10T11:12:37.186697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:47.185372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":693801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":102977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":693857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:12:49.798 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:12:49.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.936+0000 7fbfdab2b640 1 Processor -- start 2024-05-10T11:12:49.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.937+0000 7fbfdab2b640 1 -- start start 2024-05-10T11:12:49.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.937+0000 7fbfdab2b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbfd415d290 0x7fbfd4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.937+0000 7fbfdab2b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd40d3510 0x7fbfd40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.937+0000 7fbfdab2b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd4072330 con 0x7fbfd4071880 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.937+0000 7fbfdab2b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd4071d70 con 0x7fbfd415d290 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.937+0000 7fbfdab2b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd4072050 con 0x7fbfd40d3510 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd88c7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbfd415d290 0x7fbfd4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd3fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbfd4071880 0x7fbfd40d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41070/0 (socket says 172.21.15.66:41070) 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd88c7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbfd415d290 0x7fbfd4071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40138/0 (socket says 172.21.15.66:40138) 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd3fff640 1 -- 172.21.15.66:0/2903643584 learned_addr learned my addr 172.21.15.66:0/2903643584 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd90c8640 1 --2- 172.21.15.66:0/2903643584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd40d3510 0x7fbfd40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd88c7640 1 -- 172.21.15.66:0/2903643584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd40d3510 msgr2=0x7fbfd40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd88c7640 1 --2- 172.21.15.66:0/2903643584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd40d3510 0x7fbfd40ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd88c7640 1 -- 172.21.15.66:0/2903643584 >> v1:172.21.15.66:6789/0 conn(0x7fbfd4071880 legacy=0x7fbfd40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.938+0000 7fbfd88c7640 1 -- 172.21.15.66:0/2903643584 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40cda70 con 0x7fbfd415d290 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfd88c7640 1 --2- 172.21.15.66:0/2903643584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd415d290 0x7fbfd4071340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0097a0 tx=0x7fbfcc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695e699545537865 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfd37fe640 1 -- 172.21.15.66:0/2903643584 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc037070 con 0x7fbfd415d290 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfd37fe640 1 -- 172.21.15.66:0/2903643584 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc032440 con 0x7fbfd415d290 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfd37fe640 1 -- 172.21.15.66:0/2903643584 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc032810 con 0x7fbfd415d290 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 -- 172.21.15.66:0/2903643584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd415d290 msgr2=0x7fbfd4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/2903643584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd415d290 0x7fbfd4071340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0097a0 tx=0x7fbfcc02a180 comp rx=0 tx=0).stop 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 -- 172.21.15.66:0/2903643584 shutdown_connections 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/2903643584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd40d3510 0x7fbfd40ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/2903643584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd415d290 0x7fbfd4071340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 -- 172.21.15.66:0/2903643584 >> 172.21.15.66:0/2903643584 conn(0x7fbfd409ba20 msgr2=0x7fbfd409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 -- 172.21.15.66:0/2903643584 shutdown_connections 2024-05-10T11:12:49.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.939+0000 7fbfdab2b640 1 -- 172.21.15.66:0/2903643584 wait complete. 2024-05-10T11:12:49.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 Processor -- start 2024-05-10T11:12:49.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 -- start start 2024-05-10T11:12:49.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd4071880 0x7fbfd414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 0x7fbfd40cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfd415d290 0x7fbfd40c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd40d1c20 con 0x7fbfd40d3510 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd40d1aa0 con 0x7fbfd415d290 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.941+0000 7fbfdab2b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd40cc9a0 con 0x7fbfd4071880 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 0x7fbfd40cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 0x7fbfd40cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40142/0 (socket says 172.21.15.66:40142) 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 -- 172.21.15.66:0/535553470 learned_addr learned my addr 172.21.15.66:0/535553470 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd88c7640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd4071880 0x7fbfd414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd90c8640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfd415d290 0x7fbfd40c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 -- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd4071880 msgr2=0x7fbfd414b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd4071880 0x7fbfd414b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 -- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfd415d290 msgr2=0x7fbfd40c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:49.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfd415d290 0x7fbfd40c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 -- 172.21.15.66:0/535553470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40cc3e0 con 0x7fbfd40d3510 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd3fff640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 0x7fbfd40cba20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400cae0 tx=0x7fbfc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4017070 con 0x7fbfd40d3510 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc400ac40 con 0x7fbfd40d3510 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd40cc6c0 con 0x7fbfd40d3510 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4012620 con 0x7fbfd40d3510 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.942+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd40b6660 con 0x7fbfd40d3510 2024-05-10T11:12:49.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.943+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd40b6860 con 0x7fbfd40d3510 2024-05-10T11:12:49.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.944+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbfc401a070 con 0x7fbfd40d3510 2024-05-10T11:12:49.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.944+0000 7fbfd17fa640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfb40762d0 0x7fbfb4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:49.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.945+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbfc4097620 con 0x7fbfd40d3510 2024-05-10T11:12:49.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.945+0000 7fbfd88c7640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfb40762d0 0x7fbfb4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:49.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.945+0000 7fbfd88c7640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfb40762d0 0x7fbfb4078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc034000 tx=0x7fbfcc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:49.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:49.949+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbfd40b6860 con 0x7fbfd40d3510 2024-05-10T11:12:50.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.135+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfd40693f0 con 0x7fbfb40762d0 2024-05-10T11:12:50.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.143+0000 7fbfd17fa640 1 -- 172.21.15.66:0/535553470 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fbfd40693f0 con 0x7fbfb40762d0 2024-05-10T11:12:50.147 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:50.149 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:12:50.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfb40762d0 msgr2=0x7fbfb4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfb40762d0 0x7fbfb4078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc034000 tx=0x7fbfcc02e000 comp rx=0 tx=0).stop 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 msgr2=0x7fbfd40cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 0x7fbfd40cba20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400cae0 tx=0x7fbfc400a060 comp rx=0 tx=0).stop 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 shutdown_connections 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfb40762d0 0x7fbfb4078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfd415d290 0x7fbfd40c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfd40d3510 0x7fbfd40cba20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 --2- 172.21.15.66:0/535553470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfd4071880 0x7fbfd414b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 >> 172.21.15.66:0/535553470 conn(0x7fbfd409ba20 msgr2=0x7fbfd40b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 shutdown_connections 2024-05-10T11:12:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.146+0000 7fbfdab2b640 1 -- 172.21.15.66:0/535553470 wait complete. 2024-05-10T11:12:50.158 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-05-10T11:12:49.687778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219404,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755316,"statfs":{"total":773094113280,"available":772869443584,"internally_reserved":0,"allocated":3317760,"data_stored":2012824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003623"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186919+0000","last_change":"2024-05-10T11:12:30.107293+0000","last_active":"2024-05-10T11:12:37.186919+0000","last_peered":"2024-05-10T11:12:37.186919+0000","last_clean":"2024-05-10T11:12:37.186919+0000","last_became_active":"2024-05-10T11:12:30.106969+0000","last_became_peered":"2024-05-10T11:12:30.106969+0000","last_unstale":"2024-05-10T11:12:37.186919+0000","last_undegraded":"2024-05-10T11:12:37.186919+0000","last_fullsized":"2024-05-10T11:12:37.186919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186702+0000","last_change":"2024-05-10T11:12:31.115437+0000","last_active":"2024-05-10T11:12:37.186702+0000","last_peered":"2024-05-10T11:12:37.186702+0000","last_clean":"2024-05-10T11:12:37.186702+0000","last_became_active":"2024-05-10T11:12:31.115119+0000","last_became_peered":"2024-05-10T11:12:31.115119+0000","last_unstale":"2024-05-10T11:12:37.186702+0000","last_undegraded":"2024-05-10T11:12:37.186702+0000","last_fullsized":"2024-05-10T11:12:37.186702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187674+0000","last_change":"2024-05-10T11:12:35.422690+0000","last_active":"2024-05-10T11:12:37.187674+0000","last_peered":"2024-05-10T11:12:37.187674+0000","last_clean":"2024-05-10T11:12:37.187674+0000","last_became_active":"2024-05-10T11:12:35.422285+0000","last_became_peered":"2024-05-10T11:12:35.422285+0000","last_unstale":"2024-05-10T11:12:37.187674+0000","last_undegraded":"2024-05-10T11:12:37.187674+0000","last_fullsized":"2024-05-10T11:12:37.187674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186871+0000","last_change":"2024-05-10T11:12:30.100472+0000","last_active":"2024-05-10T11:12:37.186871+0000","last_peered":"2024-05-10T11:12:37.186871+0000","last_clean":"2024-05-10T11:12:37.186871+0000","last_became_active":"2024-05-10T11:12:30.100185+0000","last_became_peered":"2024-05-10T11:12:30.100185+0000","last_unstale":"2024-05-10T11:12:37.186871+0000","last_undegraded":"2024-05-10T11:12:37.186871+0000","last_fullsized":"2024-05-10T11:12:37.186871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186663+0000","last_change":"2024-05-10T11:12:31.118746+0000","last_active":"2024-05-10T11:12:37.186663+0000","last_peered":"2024-05-10T11:12:37.186663+0000","last_clean":"2024-05-10T11:12:37.186663+0000","last_became_active":"2024-05-10T11:12:31.118237+0000","last_became_peered":"2024-05-10T11:12:31.118237+0000","last_unstale":"2024-05-10T11:12:37.186663+0000","last_undegraded":"2024-05-10T11:12:37.186663+0000","last_fullsized":"2024-05-10T11:12:37.186663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132046+0000","last_change":"2024-05-10T11:12:35.138165+0000","last_active":"2024-05-10T11:12:36.132046+0000","last_peered":"2024-05-10T11:12:36.132046+0000","last_clean":"2024-05-10T11:12:36.132046+0000","last_became_active":"2024-05-10T11:12:35.137676+0000","last_became_peered":"2024-05-10T11:12:35.137676+0000","last_unstale":"2024-05-10T11:12:36.132046+0000","last_undegraded":"2024-05-10T11:12:36.132046+0000","last_fullsized":"2024-05-10T11:12:36.132046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:55:00.560547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186717+0000","last_change":"2024-05-10T11:12:30.110920+0000","last_active":"2024-05-10T11:12:37.186717+0000","last_peered":"2024-05-10T11:12:37.186717+0000","last_clean":"2024-05-10T11:12:37.186717+0000","last_became_active":"2024-05-10T11:12:30.110167+0000","last_became_peered":"2024-05-10T11:12:30.110167+0000","last_unstale":"2024-05-10T11:12:37.186717+0000","last_undegraded":"2024-05-10T11:12:37.186717+0000","last_fullsized":"2024-05-10T11:12:37.186717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132994+0000","last_change":"2024-05-10T11:12:31.101959+0000","last_active":"2024-05-10T11:12:36.132994+0000","last_peered":"2024-05-10T11:12:36.132994+0000","last_clean":"2024-05-10T11:12:36.132994+0000","last_became_active":"2024-05-10T11:12:31.101677+0000","last_became_peered":"2024-05-10T11:12:31.101677+0000","last_unstale":"2024-05-10T11:12:36.132994+0000","last_undegraded":"2024-05-10T11:12:36.132994+0000","last_fullsized":"2024-05-10T11:12:36.132994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:09:23.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133684+0000","last_change":"2024-05-10T11:12:35.138098+0000","last_active":"2024-05-10T11:12:36.133684+0000","last_peered":"2024-05-10T11:12:36.133684+0000","last_clean":"2024-05-10T11:12:36.133684+0000","last_became_active":"2024-05-10T11:12:35.137760+0000","last_became_peered":"2024-05-10T11:12:35.137760+0000","last_unstale":"2024-05-10T11:12:36.133684+0000","last_undegraded":"2024-05-10T11:12:36.133684+0000","last_fullsized":"2024-05-10T11:12:36.133684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186379+0000","last_change":"2024-05-10T11:12:30.112117+0000","last_active":"2024-05-10T11:12:37.186379+0000","last_peered":"2024-05-10T11:12:37.186379+0000","last_clean":"2024-05-10T11:12:37.186379+0000","last_became_active":"2024-05-10T11:12:30.111649+0000","last_became_peered":"2024-05-10T11:12:30.111649+0000","last_unstale":"2024-05-10T11:12:37.186379+0000","last_undegraded":"2024-05-10T11:12:37.186379+0000","last_fullsized":"2024-05-10T11:12:37.186379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133328+0000","last_change":"2024-05-10T11:12:31.113857+0000","last_active":"2024-05-10T11:12:36.133328+0000","last_peered":"2024-05-10T11:12:36.133328+0000","last_clean":"2024-05-10T11:12:36.133328+0000","last_became_active":"2024-05-10T11:12:31.113561+0000","last_became_peered":"2024-05-10T11:12:31.113561+0000","last_unstale":"2024-05-10T11:12:36.133328+0000","last_undegraded":"2024-05-10T11:12:36.133328+0000","last_fullsized":"2024-05-10T11:12:36.133328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:57.654437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132469+0000","last_change":"2024-05-10T11:12:35.138373+0000","last_active":"2024-05-10T11:12:36.132469+0000","last_peered":"2024-05-10T11:12:36.132469+0000","last_clean":"2024-05-10T11:12:36.132469+0000","last_became_active":"2024-05-10T11:12:35.137918+0000","last_became_peered":"2024-05-10T11:12:35.137918+0000","last_unstale":"2024-05-10T11:12:36.132469+0000","last_undegraded":"2024-05-10T11:12:36.132469+0000","last_fullsized":"2024-05-10T11:12:36.132469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:47.170283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284980+0000","last_change":"2024-05-10T11:12:31.101194+0000","last_active":"2024-05-10T11:12:36.284980+0000","last_peered":"2024-05-10T11:12:36.284980+0000","last_clean":"2024-05-10T11:12:36.284980+0000","last_became_active":"2024-05-10T11:12:31.100888+0000","last_became_peered":"2024-05-10T11:12:31.100888+0000","last_unstale":"2024-05-10T11:12:36.284980+0000","last_undegraded":"2024-05-10T11:12:36.284980+0000","last_fullsized":"2024-05-10T11:12:36.284980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:00.574123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186570+0000","last_change":"2024-05-10T11:12:30.109646+0000","last_active":"2024-05-10T11:12:37.186570+0000","last_peered":"2024-05-10T11:12:37.186570+0000","last_clean":"2024-05-10T11:12:37.186570+0000","last_became_active":"2024-05-10T11:12:30.109393+0000","last_became_peered":"2024-05-10T11:12:30.109393+0000","last_unstale":"2024-05-10T11:12:37.186570+0000","last_undegraded":"2024-05-10T11:12:37.186570+0000","last_fullsized":"2024-05-10T11:12:37.186570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132986+0000","last_change":"2024-05-10T11:12:35.134377+0000","last_active":"2024-05-10T11:12:36.132986+0000","last_peered":"2024-05-10T11:12:36.132986+0000","last_clean":"2024-05-10T11:12:36.132986+0000","last_became_active":"2024-05-10T11:12:35.133107+0000","last_became_peered":"2024-05-10T11:12:35.133107+0000","last_unstale":"2024-05-10T11:12:36.132986+0000","last_undegraded":"2024-05-10T11:12:36.132986+0000","last_fullsized":"2024-05-10T11:12:36.132986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188108+0000","last_change":"2024-05-10T11:12:31.113901+0000","last_active":"2024-05-10T11:12:37.188108+0000","last_peered":"2024-05-10T11:12:37.188108+0000","last_clean":"2024-05-10T11:12:37.188108+0000","last_became_active":"2024-05-10T11:12:31.113316+0000","last_became_peered":"2024-05-10T11:12:31.113316+0000","last_unstale":"2024-05-10T11:12:37.188108+0000","last_undegraded":"2024-05-10T11:12:37.188108+0000","last_fullsized":"2024-05-10T11:12:37.188108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188842+0000","last_change":"2024-05-10T11:12:30.104152+0000","last_active":"2024-05-10T11:12:37.188842+0000","last_peered":"2024-05-10T11:12:37.188842+0000","last_clean":"2024-05-10T11:12:37.188842+0000","last_became_active":"2024-05-10T11:12:30.103869+0000","last_became_peered":"2024-05-10T11:12:30.103869+0000","last_unstale":"2024-05-10T11:12:37.188842+0000","last_undegraded":"2024-05-10T11:12:37.188842+0000","last_fullsized":"2024-05-10T11:12:37.188842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132702+0000","last_change":"2024-05-10T11:12:35.140690+0000","last_active":"2024-05-10T11:12:36.132702+0000","last_peered":"2024-05-10T11:12:36.132702+0000","last_clean":"2024-05-10T11:12:36.132702+0000","last_became_active":"2024-05-10T11:12:35.140367+0000","last_became_peered":"2024-05-10T11:12:35.140367+0000","last_unstale":"2024-05-10T11:12:36.132702+0000","last_undegraded":"2024-05-10T11:12:36.132702+0000","last_fullsized":"2024-05-10T11:12:36.132702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187425+0000","last_change":"2024-05-10T11:12:31.112506+0000","last_active":"2024-05-10T11:12:37.187425+0000","last_peered":"2024-05-10T11:12:37.187425+0000","last_clean":"2024-05-10T11:12:37.187425+0000","last_became_active":"2024-05-10T11:12:31.112211+0000","last_became_peered":"2024-05-10T11:12:31.112211+0000","last_unstale":"2024-05-10T11:12:37.187425+0000","last_undegraded":"2024-05-10T11:12:37.187425+0000","last_fullsized":"2024-05-10T11:12:37.187425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:30.107759+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:30.107468+0000","last_became_peered":"2024-05-10T11:12:30.107468+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186715+0000","last_change":"2024-05-10T11:12:35.422670+0000","last_active":"2024-05-10T11:12:37.186715+0000","last_peered":"2024-05-10T11:12:37.186715+0000","last_clean":"2024-05-10T11:12:37.186715+0000","last_became_active":"2024-05-10T11:12:35.422307+0000","last_became_peered":"2024-05-10T11:12:35.422307+0000","last_unstale":"2024-05-10T11:12:37.186715+0000","last_undegraded":"2024-05-10T11:12:37.186715+0000","last_fullsized":"2024-05-10T11:12:37.186715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:01.679168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132243+0000","last_change":"2024-05-10T11:12:31.105780+0000","last_active":"2024-05-10T11:12:36.132243+0000","last_peered":"2024-05-10T11:12:36.132243+0000","last_clean":"2024-05-10T11:12:36.132243+0000","last_became_active":"2024-05-10T11:12:31.105471+0000","last_became_peered":"2024-05-10T11:12:31.105471+0000","last_unstale":"2024-05-10T11:12:36.132243+0000","last_undegraded":"2024-05-10T11:12:36.132243+0000","last_fullsized":"2024-05-10T11:12:36.132243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:55.127350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186041+0000","last_change":"2024-05-10T11:12:30.110798+0000","last_active":"2024-05-10T11:12:37.186041+0000","last_peered":"2024-05-10T11:12:37.186041+0000","last_clean":"2024-05-10T11:12:37.186041+0000","last_became_active":"2024-05-10T11:12:30.110468+0000","last_became_peered":"2024-05-10T11:12:30.110468+0000","last_unstale":"2024-05-10T11:12:37.186041+0000","last_undegraded":"2024-05-10T11:12:37.186041+0000","last_fullsized":"2024-05-10T11:12:37.186041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132575+0000","last_change":"2024-05-10T11:12:35.138104+0000","last_active":"2024-05-10T11:12:36.132575+0000","last_peered":"2024-05-10T11:12:36.132575+0000","last_clean":"2024-05-10T11:12:36.132575+0000","last_became_active":"2024-05-10T11:12:35.137693+0000","last_became_peered":"2024-05-10T11:12:35.137693+0000","last_unstale":"2024-05-10T11:12:36.132575+0000","last_undegraded":"2024-05-10T11:12:36.132575+0000","last_fullsized":"2024-05-10T11:12:36.132575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:40.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187558+0000","last_change":"2024-05-10T11:12:31.107722+0000","last_active":"2024-05-10T11:12:37.187558+0000","last_peered":"2024-05-10T11:12:37.187558+0000","last_clean":"2024-05-10T11:12:37.187558+0000","last_became_active":"2024-05-10T11:12:31.107404+0000","last_became_peered":"2024-05-10T11:12:31.107404+0000","last_unstale":"2024-05-10T11:12:37.187558+0000","last_undegraded":"2024-05-10T11:12:37.187558+0000","last_fullsized":"2024-05-10T11:12:37.187558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285637+0000","last_change":"2024-05-10T11:12:30.113757+0000","last_active":"2024-05-10T11:12:36.285637+0000","last_peered":"2024-05-10T11:12:36.285637+0000","last_clean":"2024-05-10T11:12:36.285637+0000","last_became_active":"2024-05-10T11:12:30.113457+0000","last_became_peered":"2024-05-10T11:12:30.113457+0000","last_unstale":"2024-05-10T11:12:36.285637+0000","last_undegraded":"2024-05-10T11:12:36.285637+0000","last_fullsized":"2024-05-10T11:12:36.285637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:13.790787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132184+0000","last_change":"2024-05-10T11:12:35.421589+0000","last_active":"2024-05-10T11:12:36.132184+0000","last_peered":"2024-05-10T11:12:36.132184+0000","last_clean":"2024-05-10T11:12:36.132184+0000","last_became_active":"2024-05-10T11:12:35.421209+0000","last_became_peered":"2024-05-10T11:12:35.421209+0000","last_unstale":"2024-05-10T11:12:36.132184+0000","last_undegraded":"2024-05-10T11:12:36.132184+0000","last_fullsized":"2024-05-10T11:12:36.132184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:43.432104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188363+0000","last_change":"2024-05-10T11:12:31.113183+0000","last_active":"2024-05-10T11:12:37.188363+0000","last_peered":"2024-05-10T11:12:37.188363+0000","last_clean":"2024-05-10T11:12:37.188363+0000","last_became_active":"2024-05-10T11:12:31.112885+0000","last_became_peered":"2024-05-10T11:12:31.112885+0000","last_unstale":"2024-05-10T11:12:37.188363+0000","last_undegraded":"2024-05-10T11:12:37.188363+0000","last_fullsized":"2024-05-10T11:12:37.188363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186681+0000","last_change":"2024-05-10T11:12:30.106330+0000","last_active":"2024-05-10T11:12:37.186681+0000","last_peered":"2024-05-10T11:12:37.186681+0000","last_clean":"2024-05-10T11:12:37.186681+0000","last_became_active":"2024-05-10T11:12:30.106029+0000","last_became_peered":"2024-05-10T11:12:30.106029+0000","last_unstale":"2024-05-10T11:12:37.186681+0000","last_undegraded":"2024-05-10T11:12:37.186681+0000","last_fullsized":"2024-05-10T11:12:37.186681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187168+0000","last_change":"2024-05-10T11:12:35.421780+0000","last_active":"2024-05-10T11:12:37.187168+0000","last_peered":"2024-05-10T11:12:37.187168+0000","last_clean":"2024-05-10T11:12:37.187168+0000","last_became_active":"2024-05-10T11:12:35.421406+0000","last_became_peered":"2024-05-10T11:12:35.421406+0000","last_unstale":"2024-05-10T11:12:37.187168+0000","last_undegraded":"2024-05-10T11:12:37.187168+0000","last_fullsized":"2024-05-10T11:12:37.187168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187694+0000","last_change":"2024-05-10T11:12:31.104014+0000","last_active":"2024-05-10T11:12:37.187694+0000","last_peered":"2024-05-10T11:12:37.187694+0000","last_clean":"2024-05-10T11:12:37.187694+0000","last_became_active":"2024-05-10T11:12:31.103724+0000","last_became_peered":"2024-05-10T11:12:31.103724+0000","last_unstale":"2024-05-10T11:12:37.187694+0000","last_undegraded":"2024-05-10T11:12:37.187694+0000","last_fullsized":"2024-05-10T11:12:37.187694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186832+0000","last_change":"2024-05-10T11:12:30.110419+0000","last_active":"2024-05-10T11:12:37.186832+0000","last_peered":"2024-05-10T11:12:37.186832+0000","last_clean":"2024-05-10T11:12:37.186832+0000","last_became_active":"2024-05-10T11:12:30.109820+0000","last_became_peered":"2024-05-10T11:12:30.109820+0000","last_unstale":"2024-05-10T11:12:37.186832+0000","last_undegraded":"2024-05-10T11:12:37.186832+0000","last_fullsized":"2024-05-10T11:12:37.186832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:57.299078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187509+0000","last_change":"2024-05-10T11:12:35.420791+0000","last_active":"2024-05-10T11:12:37.187509+0000","last_peered":"2024-05-10T11:12:37.187509+0000","last_clean":"2024-05-10T11:12:37.187509+0000","last_became_active":"2024-05-10T11:12:35.420414+0000","last_became_peered":"2024-05-10T11:12:35.420414+0000","last_unstale":"2024-05-10T11:12:37.187509+0000","last_undegraded":"2024-05-10T11:12:37.187509+0000","last_fullsized":"2024-05-10T11:12:37.187509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:51.141249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133388+0000","last_change":"2024-05-10T11:12:31.109103+0000","last_active":"2024-05-10T11:12:36.133388+0000","last_peered":"2024-05-10T11:12:36.133388+0000","last_clean":"2024-05-10T11:12:36.133388+0000","last_became_active":"2024-05-10T11:12:31.108146+0000","last_became_peered":"2024-05-10T11:12:31.108146+0000","last_unstale":"2024-05-10T11:12:36.133388+0000","last_undegraded":"2024-05-10T11:12:36.133388+0000","last_fullsized":"2024-05-10T11:12:36.133388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:12.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187781+0000","last_change":"2024-05-10T11:12:30.101891+0000","last_active":"2024-05-10T11:12:37.187781+0000","last_peered":"2024-05-10T11:12:37.187781+0000","last_clean":"2024-05-10T11:12:37.187781+0000","last_became_active":"2024-05-10T11:12:30.101598+0000","last_became_peered":"2024-05-10T11:12:30.101598+0000","last_unstale":"2024-05-10T11:12:37.187781+0000","last_undegraded":"2024-05-10T11:12:37.187781+0000","last_fullsized":"2024-05-10T11:12:37.187781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188770+0000","last_change":"2024-05-10T11:12:35.135817+0000","last_active":"2024-05-10T11:12:37.188770+0000","last_peered":"2024-05-10T11:12:37.188770+0000","last_clean":"2024-05-10T11:12:37.188770+0000","last_became_active":"2024-05-10T11:12:35.135403+0000","last_became_peered":"2024-05-10T11:12:35.135403+0000","last_unstale":"2024-05-10T11:12:37.188770+0000","last_undegraded":"2024-05-10T11:12:37.188770+0000","last_fullsized":"2024-05-10T11:12:37.188770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133910+0000","last_change":"2024-05-10T11:12:31.103973+0000","last_active":"2024-05-10T11:12:36.133910+0000","last_peered":"2024-05-10T11:12:36.133910+0000","last_clean":"2024-05-10T11:12:36.133910+0000","last_became_active":"2024-05-10T11:12:31.103697+0000","last_became_peered":"2024-05-10T11:12:31.103697+0000","last_unstale":"2024-05-10T11:12:36.133910+0000","last_undegraded":"2024-05-10T11:12:36.133910+0000","last_fullsized":"2024-05-10T11:12:36.133910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:20.650809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133763+0000","last_change":"2024-05-10T11:12:30.112118+0000","last_active":"2024-05-10T11:12:36.133763+0000","last_peered":"2024-05-10T11:12:36.133763+0000","last_clean":"2024-05-10T11:12:36.133763+0000","last_became_active":"2024-05-10T11:12:30.111287+0000","last_became_peered":"2024-05-10T11:12:30.111287+0000","last_unstale":"2024-05-10T11:12:36.133763+0000","last_undegraded":"2024-05-10T11:12:36.133763+0000","last_fullsized":"2024-05-10T11:12:36.133763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187647+0000","last_change":"2024-05-10T11:12:35.140853+0000","last_active":"2024-05-10T11:12:37.187647+0000","last_peered":"2024-05-10T11:12:37.187647+0000","last_clean":"2024-05-10T11:12:37.187647+0000","last_became_active":"2024-05-10T11:12:35.140434+0000","last_became_peered":"2024-05-10T11:12:35.140434+0000","last_unstale":"2024-05-10T11:12:37.187647+0000","last_undegraded":"2024-05-10T11:12:37.187647+0000","last_fullsized":"2024-05-10T11:12:37.187647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187195+0000","last_change":"2024-05-10T11:12:31.110391+0000","last_active":"2024-05-10T11:12:37.187195+0000","last_peered":"2024-05-10T11:12:37.187195+0000","last_clean":"2024-05-10T11:12:37.187195+0000","last_became_active":"2024-05-10T11:12:31.109461+0000","last_became_peered":"2024-05-10T11:12:31.109461+0000","last_unstale":"2024-05-10T11:12:37.187195+0000","last_undegraded":"2024-05-10T11:12:37.187195+0000","last_fullsized":"2024-05-10T11:12:37.187195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186210+0000","last_change":"2024-05-10T11:12:30.109322+0000","last_active":"2024-05-10T11:12:37.186210+0000","last_peered":"2024-05-10T11:12:37.186210+0000","last_clean":"2024-05-10T11:12:37.186210+0000","last_became_active":"2024-05-10T11:12:30.109010+0000","last_became_peered":"2024-05-10T11:12:30.109010+0000","last_unstale":"2024-05-10T11:12:37.186210+0000","last_undegraded":"2024-05-10T11:12:37.186210+0000","last_fullsized":"2024-05-10T11:12:37.186210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186867+0000","last_change":"2024-05-10T11:12:35.138343+0000","last_active":"2024-05-10T11:12:37.186867+0000","last_peered":"2024-05-10T11:12:37.186867+0000","last_clean":"2024-05-10T11:12:37.186867+0000","last_became_active":"2024-05-10T11:12:35.137977+0000","last_became_peered":"2024-05-10T11:12:35.137977+0000","last_unstale":"2024-05-10T11:12:37.186867+0000","last_undegraded":"2024-05-10T11:12:37.186867+0000","last_fullsized":"2024-05-10T11:12:37.186867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:06:16.923493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186404+0000","last_change":"2024-05-10T11:12:31.107001+0000","last_active":"2024-05-10T11:12:37.186404+0000","last_peered":"2024-05-10T11:12:37.186404+0000","last_clean":"2024-05-10T11:12:37.186404+0000","last_became_active":"2024-05-10T11:12:31.105856+0000","last_became_peered":"2024-05-10T11:12:31.105856+0000","last_unstale":"2024-05-10T11:12:37.186404+0000","last_undegraded":"2024-05-10T11:12:37.186404+0000","last_fullsized":"2024-05-10T11:12:37.186404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186079+0000","last_change":"2024-05-10T11:12:30.106324+0000","last_active":"2024-05-10T11:12:37.186079+0000","last_peered":"2024-05-10T11:12:37.186079+0000","last_clean":"2024-05-10T11:12:37.186079+0000","last_became_active":"2024-05-10T11:12:30.106071+0000","last_became_peered":"2024-05-10T11:12:30.106071+0000","last_unstale":"2024-05-10T11:12:37.186079+0000","last_undegraded":"2024-05-10T11:12:37.186079+0000","last_fullsized":"2024-05-10T11:12:37.186079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:54.121002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187453+0000","last_change":"2024-05-10T11:12:35.420622+0000","last_active":"2024-05-10T11:12:37.187453+0000","last_peered":"2024-05-10T11:12:37.187453+0000","last_clean":"2024-05-10T11:12:37.187453+0000","last_became_active":"2024-05-10T11:12:35.420207+0000","last_became_peered":"2024-05-10T11:12:35.420207+0000","last_unstale":"2024-05-10T11:12:37.187453+0000","last_undegraded":"2024-05-10T11:12:37.187453+0000","last_fullsized":"2024-05-10T11:12:37.187453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186367+0000","last_change":"2024-05-10T11:12:31.119911+0000","last_active":"2024-05-10T11:12:37.186367+0000","last_peered":"2024-05-10T11:12:37.186367+0000","last_clean":"2024-05-10T11:12:37.186367+0000","last_became_active":"2024-05-10T11:12:31.119563+0000","last_became_peered":"2024-05-10T11:12:31.119563+0000","last_unstale":"2024-05-10T11:12:37.186367+0000","last_undegraded":"2024-05-10T11:12:37.186367+0000","last_fullsized":"2024-05-10T11:12:37.186367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132850+0000","last_change":"2024-05-10T11:12:30.111460+0000","last_active":"2024-05-10T11:12:36.132850+0000","last_peered":"2024-05-10T11:12:36.132850+0000","last_clean":"2024-05-10T11:12:36.132850+0000","last_became_active":"2024-05-10T11:12:30.111150+0000","last_became_peered":"2024-05-10T11:12:30.111150+0000","last_unstale":"2024-05-10T11:12:36.132850+0000","last_undegraded":"2024-05-10T11:12:36.132850+0000","last_fullsized":"2024-05-10T11:12:36.132850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186200+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:12:37.186200+0000","last_peered":"2024-05-10T11:12:37.186200+0000","last_clean":"2024-05-10T11:12:37.186200+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:12:37.186200+0000","last_undegraded":"2024-05-10T11:12:37.186200+0000","last_fullsized":"2024-05-10T11:12:37.186200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285379+0000","last_change":"2024-05-10T11:12:35.421543+0000","last_active":"2024-05-10T11:12:36.285379+0000","last_peered":"2024-05-10T11:12:36.285379+0000","last_clean":"2024-05-10T11:12:36.285379+0000","last_became_active":"2024-05-10T11:12:35.421171+0000","last_became_peered":"2024-05-10T11:12:35.421171+0000","last_unstale":"2024-05-10T11:12:36.285379+0000","last_undegraded":"2024-05-10T11:12:36.285379+0000","last_fullsized":"2024-05-10T11:12:36.285379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186499+0000","last_change":"2024-05-10T11:12:31.119926+0000","last_active":"2024-05-10T11:12:37.186499+0000","last_peered":"2024-05-10T11:12:37.186499+0000","last_clean":"2024-05-10T11:12:37.186499+0000","last_became_active":"2024-05-10T11:12:31.119632+0000","last_became_peered":"2024-05-10T11:12:31.119632+0000","last_unstale":"2024-05-10T11:12:37.186499+0000","last_undegraded":"2024-05-10T11:12:37.186499+0000","last_fullsized":"2024-05-10T11:12:37.186499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:17.896621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186772+0000","last_change":"2024-05-10T11:12:30.112153+0000","last_active":"2024-05-10T11:12:37.186772+0000","last_peered":"2024-05-10T11:12:37.186772+0000","last_clean":"2024-05-10T11:12:37.186772+0000","last_became_active":"2024-05-10T11:12:30.111901+0000","last_became_peered":"2024-05-10T11:12:30.111901+0000","last_unstale":"2024-05-10T11:12:37.186772+0000","last_undegraded":"2024-05-10T11:12:37.186772+0000","last_fullsized":"2024-05-10T11:12:37.186772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285207+0000","last_change":"2024-05-10T11:12:35.420749+0000","last_active":"2024-05-10T11:12:36.285207+0000","last_peered":"2024-05-10T11:12:36.285207+0000","last_clean":"2024-05-10T11:12:36.285207+0000","last_became_active":"2024-05-10T11:12:35.420325+0000","last_became_peered":"2024-05-10T11:12:35.420325+0000","last_unstale":"2024-05-10T11:12:36.285207+0000","last_undegraded":"2024-05-10T11:12:36.285207+0000","last_fullsized":"2024-05-10T11:12:36.285207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.089151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133116+0000","last_change":"2024-05-10T11:12:31.115139+0000","last_active":"2024-05-10T11:12:36.133116+0000","last_peered":"2024-05-10T11:12:36.133116+0000","last_clean":"2024-05-10T11:12:36.133116+0000","last_became_active":"2024-05-10T11:12:31.114482+0000","last_became_peered":"2024-05-10T11:12:31.114482+0000","last_unstale":"2024-05-10T11:12:36.133116+0000","last_undegraded":"2024-05-10T11:12:36.133116+0000","last_fullsized":"2024-05-10T11:12:36.133116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:02.344229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186711+0000","last_change":"2024-05-10T11:12:30.102023+0000","last_active":"2024-05-10T11:12:37.186711+0000","last_peered":"2024-05-10T11:12:37.186711+0000","last_clean":"2024-05-10T11:12:37.186711+0000","last_became_active":"2024-05-10T11:12:30.101642+0000","last_became_peered":"2024-05-10T11:12:30.101642+0000","last_unstale":"2024-05-10T11:12:37.186711+0000","last_undegraded":"2024-05-10T11:12:37.186711+0000","last_fullsized":"2024-05-10T11:12:37.186711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:36.583408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187660+0000","last_change":"2024-05-10T11:12:35.133498+0000","last_active":"2024-05-10T11:12:37.187660+0000","last_peered":"2024-05-10T11:12:37.187660+0000","last_clean":"2024-05-10T11:12:37.187660+0000","last_became_active":"2024-05-10T11:12:35.133009+0000","last_became_peered":"2024-05-10T11:12:35.133009+0000","last_unstale":"2024-05-10T11:12:37.187660+0000","last_undegraded":"2024-05-10T11:12:37.187660+0000","last_fullsized":"2024-05-10T11:12:37.187660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186836+0000","last_change":"2024-05-10T11:12:31.119096+0000","last_active":"2024-05-10T11:12:37.186836+0000","last_peered":"2024-05-10T11:12:37.186836+0000","last_clean":"2024-05-10T11:12:37.186836+0000","last_became_active":"2024-05-10T11:12:31.118841+0000","last_became_peered":"2024-05-10T11:12:31.118841+0000","last_unstale":"2024-05-10T11:12:37.186836+0000","last_undegraded":"2024-05-10T11:12:37.186836+0000","last_fullsized":"2024-05-10T11:12:37.186836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:51.850619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186580+0000","last_change":"2024-05-10T11:12:30.107841+0000","last_active":"2024-05-10T11:12:37.186580+0000","last_peered":"2024-05-10T11:12:37.186580+0000","last_clean":"2024-05-10T11:12:37.186580+0000","last_became_active":"2024-05-10T11:12:30.107551+0000","last_became_peered":"2024-05-10T11:12:30.107551+0000","last_unstale":"2024-05-10T11:12:37.186580+0000","last_undegraded":"2024-05-10T11:12:37.186580+0000","last_fullsized":"2024-05-10T11:12:37.186580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:21.687602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132082+0000","last_change":"2024-05-10T11:12:35.420691+0000","last_active":"2024-05-10T11:12:36.132082+0000","last_peered":"2024-05-10T11:12:36.132082+0000","last_clean":"2024-05-10T11:12:36.132082+0000","last_became_active":"2024-05-10T11:12:35.420284+0000","last_became_peered":"2024-05-10T11:12:35.420284+0000","last_unstale":"2024-05-10T11:12:36.132082+0000","last_undegraded":"2024-05-10T11:12:36.132082+0000","last_fullsized":"2024-05-10T11:12:36.132082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186722+0000","last_change":"2024-05-10T11:12:31.119535+0000","last_active":"2024-05-10T11:12:37.186722+0000","last_peered":"2024-05-10T11:12:37.186722+0000","last_clean":"2024-05-10T11:12:37.186722+0000","last_became_active":"2024-05-10T11:12:31.119282+0000","last_became_peered":"2024-05-10T11:12:31.119282+0000","last_unstale":"2024-05-10T11:12:37.186722+0000","last_undegraded":"2024-05-10T11:12:37.186722+0000","last_fullsized":"2024-05-10T11:12:37.186722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:58.094353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132416+0000","last_change":"2024-05-10T11:12:30.109801+0000","last_active":"2024-05-10T11:12:36.132416+0000","last_peered":"2024-05-10T11:12:36.132416+0000","last_clean":"2024-05-10T11:12:36.132416+0000","last_became_active":"2024-05-10T11:12:30.109068+0000","last_became_peered":"2024-05-10T11:12:30.109068+0000","last_unstale":"2024-05-10T11:12:36.132416+0000","last_undegraded":"2024-05-10T11:12:36.132416+0000","last_fullsized":"2024-05-10T11:12:36.132416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:58.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.131960+0000","last_change":"2024-05-10T11:12:35.132271+0000","last_active":"2024-05-10T11:12:36.131960+0000","last_peered":"2024-05-10T11:12:36.131960+0000","last_clean":"2024-05-10T11:12:36.131960+0000","last_became_active":"2024-05-10T11:12:35.131925+0000","last_became_peered":"2024-05-10T11:12:35.131925+0000","last_unstale":"2024-05-10T11:12:36.131960+0000","last_undegraded":"2024-05-10T11:12:36.131960+0000","last_fullsized":"2024-05-10T11:12:36.131960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:55.050495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186329+0000","last_change":"2024-05-10T11:12:31.120591+0000","last_active":"2024-05-10T11:12:37.186329+0000","last_peered":"2024-05-10T11:12:37.186329+0000","last_clean":"2024-05-10T11:12:37.186329+0000","last_became_active":"2024-05-10T11:12:31.120238+0000","last_became_peered":"2024-05-10T11:12:31.120238+0000","last_unstale":"2024-05-10T11:12:37.186329+0000","last_undegraded":"2024-05-10T11:12:37.186329+0000","last_fullsized":"2024-05-10T11:12:37.186329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:54:56.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187113+0000","last_change":"2024-05-10T11:12:30.106471+0000","last_active":"2024-05-10T11:12:37.187113+0000","last_peered":"2024-05-10T11:12:37.187113+0000","last_clean":"2024-05-10T11:12:37.187113+0000","last_became_active":"2024-05-10T11:12:30.106152+0000","last_became_peered":"2024-05-10T11:12:30.106152+0000","last_unstale":"2024-05-10T11:12:37.187113+0000","last_undegraded":"2024-05-10T11:12:37.187113+0000","last_fullsized":"2024-05-10T11:12:37.187113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187285+0000","last_change":"2024-05-10T11:12:35.126286+0000","last_active":"2024-05-10T11:12:37.187285+0000","last_peered":"2024-05-10T11:12:37.187285+0000","last_clean":"2024-05-10T11:12:37.187285+0000","last_became_active":"2024-05-10T11:12:35.125717+0000","last_became_peered":"2024-05-10T11:12:35.125717+0000","last_unstale":"2024-05-10T11:12:37.187285+0000","last_undegraded":"2024-05-10T11:12:37.187285+0000","last_fullsized":"2024-05-10T11:12:37.187285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:12.380250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285141+0000","last_change":"2024-05-10T11:12:31.109293+0000","last_active":"2024-05-10T11:12:36.285141+0000","last_peered":"2024-05-10T11:12:36.285141+0000","last_clean":"2024-05-10T11:12:36.285141+0000","last_became_active":"2024-05-10T11:12:31.109011+0000","last_became_peered":"2024-05-10T11:12:31.109011+0000","last_unstale":"2024-05-10T11:12:36.285141+0000","last_undegraded":"2024-05-10T11:12:36.285141+0000","last_fullsized":"2024-05-10T11:12:36.285141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:23.860440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285079+0000","last_change":"2024-05-10T11:12:30.112853+0000","last_active":"2024-05-10T11:12:36.285079+0000","last_peered":"2024-05-10T11:12:36.285079+0000","last_clean":"2024-05-10T11:12:36.285079+0000","last_became_active":"2024-05-10T11:12:30.112518+0000","last_became_peered":"2024-05-10T11:12:30.112518+0000","last_unstale":"2024-05-10T11:12:36.285079+0000","last_undegraded":"2024-05-10T11:12:36.285079+0000","last_fullsized":"2024-05-10T11:12:36.285079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:21.544811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188215+0000","last_change":"2024-05-10T11:12:35.421295+0000","last_active":"2024-05-10T11:12:37.188215+0000","last_peered":"2024-05-10T11:12:37.188215+0000","last_clean":"2024-05-10T11:12:37.188215+0000","last_became_active":"2024-05-10T11:12:35.420917+0000","last_became_peered":"2024-05-10T11:12:35.420917+0000","last_unstale":"2024-05-10T11:12:37.188215+0000","last_undegraded":"2024-05-10T11:12:37.188215+0000","last_fullsized":"2024-05-10T11:12:37.188215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:08:10.900267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186431+0000","last_change":"2024-05-10T11:12:31.118875+0000","last_active":"2024-05-10T11:12:37.186431+0000","last_peered":"2024-05-10T11:12:37.186431+0000","last_clean":"2024-05-10T11:12:37.186431+0000","last_became_active":"2024-05-10T11:12:31.118593+0000","last_became_peered":"2024-05-10T11:12:31.118593+0000","last_unstale":"2024-05-10T11:12:37.186431+0000","last_undegraded":"2024-05-10T11:12:37.186431+0000","last_fullsized":"2024-05-10T11:12:37.186431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:36.209217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133641+0000","last_change":"2024-05-10T11:12:30.112650+0000","last_active":"2024-05-10T11:12:36.133641+0000","last_peered":"2024-05-10T11:12:36.133641+0000","last_clean":"2024-05-10T11:12:36.133641+0000","last_became_active":"2024-05-10T11:12:30.112297+0000","last_became_peered":"2024-05-10T11:12:30.112297+0000","last_unstale":"2024-05-10T11:12:36.133641+0000","last_undegraded":"2024-05-10T11:12:36.133641+0000","last_fullsized":"2024-05-10T11:12:36.133641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:43.433421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188493+0000","last_change":"2024-05-10T11:12:35.420619+0000","last_active":"2024-05-10T11:12:37.188493+0000","last_peered":"2024-05-10T11:12:37.188493+0000","last_clean":"2024-05-10T11:12:37.188493+0000","last_became_active":"2024-05-10T11:12:35.420215+0000","last_became_peered":"2024-05-10T11:12:35.420215+0000","last_unstale":"2024-05-10T11:12:37.188493+0000","last_undegraded":"2024-05-10T11:12:37.188493+0000","last_fullsized":"2024-05-10T11:12:37.188493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:13.010526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187343+0000","last_change":"2024-05-10T11:12:31.109731+0000","last_active":"2024-05-10T11:12:37.187343+0000","last_peered":"2024-05-10T11:12:37.187343+0000","last_clean":"2024-05-10T11:12:37.187343+0000","last_became_active":"2024-05-10T11:12:31.109139+0000","last_became_peered":"2024-05-10T11:12:31.109139+0000","last_unstale":"2024-05-10T11:12:37.187343+0000","last_undegraded":"2024-05-10T11:12:37.187343+0000","last_fullsized":"2024-05-10T11:12:37.187343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187717+0000","last_change":"2024-05-10T11:12:30.100711+0000","last_active":"2024-05-10T11:12:37.187717+0000","last_peered":"2024-05-10T11:12:37.187717+0000","last_clean":"2024-05-10T11:12:37.187717+0000","last_became_active":"2024-05-10T11:12:30.100119+0000","last_became_peered":"2024-05-10T11:12:30.100119+0000","last_unstale":"2024-05-10T11:12:37.187717+0000","last_undegraded":"2024-05-10T11:12:37.187717+0000","last_fullsized":"2024-05-10T11:12:37.187717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133273+0000","last_change":"2024-05-10T11:12:35.421572+0000","last_active":"2024-05-10T11:12:36.133273+0000","last_peered":"2024-05-10T11:12:36.133273+0000","last_clean":"2024-05-10T11:12:36.133273+0000","last_became_active":"2024-05-10T11:12:35.421218+0000","last_became_peered":"2024-05-10T11:12:35.421218+0000","last_unstale":"2024-05-10T11:12:36.133273+0000","last_undegraded":"2024-05-10T11:12:36.133273+0000","last_fullsized":"2024-05-10T11:12:36.133273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:32.997147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186338+0000","last_change":"2024-05-10T11:12:31.119385+0000","last_active":"2024-05-10T11:12:37.186338+0000","last_peered":"2024-05-10T11:12:37.186338+0000","last_clean":"2024-05-10T11:12:37.186338+0000","last_became_active":"2024-05-10T11:12:31.118251+0000","last_became_peered":"2024-05-10T11:12:31.118251+0000","last_unstale":"2024-05-10T11:12:37.186338+0000","last_undegraded":"2024-05-10T11:12:37.186338+0000","last_fullsized":"2024-05-10T11:12:37.186338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:27.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:40.660245+0000","last_change":"2024-05-10T11:12:30.115042+0000","last_active":"2024-05-10T11:12:40.660245+0000","last_peered":"2024-05-10T11:12:40.660245+0000","last_clean":"2024-05-10T11:12:40.660245+0000","last_became_active":"2024-05-10T11:12:30.114856+0000","last_became_peered":"2024-05-10T11:12:30.114856+0000","last_unstale":"2024-05-10T11:12:40.660245+0000","last_undegraded":"2024-05-10T11:12:40.660245+0000","last_fullsized":"2024-05-10T11:12:40.660245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:13.236354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188815+0000","last_change":"2024-05-10T11:12:35.134285+0000","last_active":"2024-05-10T11:12:37.188815+0000","last_peered":"2024-05-10T11:12:37.188815+0000","last_clean":"2024-05-10T11:12:37.188815+0000","last_became_active":"2024-05-10T11:12:35.133864+0000","last_became_peered":"2024-05-10T11:12:35.133864+0000","last_unstale":"2024-05-10T11:12:37.188815+0000","last_undegraded":"2024-05-10T11:12:37.188815+0000","last_fullsized":"2024-05-10T11:12:37.188815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:40.383320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133000+0000","last_change":"2024-05-10T11:12:31.112754+0000","last_active":"2024-05-10T11:12:36.133000+0000","last_peered":"2024-05-10T11:12:36.133000+0000","last_clean":"2024-05-10T11:12:36.133000+0000","last_became_active":"2024-05-10T11:12:31.112193+0000","last_became_peered":"2024-05-10T11:12:31.112193+0000","last_unstale":"2024-05-10T11:12:36.133000+0000","last_undegraded":"2024-05-10T11:12:36.133000+0000","last_fullsized":"2024-05-10T11:12:36.133000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:06.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186601+0000","last_change":"2024-05-10T11:12:30.104162+0000","last_active":"2024-05-10T11:12:37.186601+0000","last_peered":"2024-05-10T11:12:37.186601+0000","last_clean":"2024-05-10T11:12:37.186601+0000","last_became_active":"2024-05-10T11:12:30.103843+0000","last_became_peered":"2024-05-10T11:12:30.103843+0000","last_unstale":"2024-05-10T11:12:37.186601+0000","last_undegraded":"2024-05-10T11:12:37.186601+0000","last_fullsized":"2024-05-10T11:12:37.186601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:06.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133886+0000","last_change":"2024-05-10T11:12:35.135088+0000","last_active":"2024-05-10T11:12:36.133886+0000","last_peered":"2024-05-10T11:12:36.133886+0000","last_clean":"2024-05-10T11:12:36.133886+0000","last_became_active":"2024-05-10T11:12:35.134532+0000","last_became_peered":"2024-05-10T11:12:35.134532+0000","last_unstale":"2024-05-10T11:12:36.133886+0000","last_undegraded":"2024-05-10T11:12:36.133886+0000","last_fullsized":"2024-05-10T11:12:36.133886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:42.541074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186828+0000","last_change":"2024-05-10T11:12:31.118512+0000","last_active":"2024-05-10T11:12:37.186828+0000","last_peered":"2024-05-10T11:12:37.186828+0000","last_clean":"2024-05-10T11:12:37.186828+0000","last_became_active":"2024-05-10T11:12:31.117887+0000","last_became_peered":"2024-05-10T11:12:31.117887+0000","last_unstale":"2024-05-10T11:12:37.186828+0000","last_undegraded":"2024-05-10T11:12:37.186828+0000","last_fullsized":"2024-05-10T11:12:37.186828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132913+0000","last_change":"2024-05-10T11:12:30.108984+0000","last_active":"2024-05-10T11:12:36.132913+0000","last_peered":"2024-05-10T11:12:36.132913+0000","last_clean":"2024-05-10T11:12:36.132913+0000","last_became_active":"2024-05-10T11:12:30.108652+0000","last_became_peered":"2024-05-10T11:12:30.108652+0000","last_unstale":"2024-05-10T11:12:36.132913+0000","last_undegraded":"2024-05-10T11:12:36.132913+0000","last_fullsized":"2024-05-10T11:12:36.132913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:32.838275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187375+0000","last_change":"2024-05-10T11:12:35.135736+0000","last_active":"2024-05-10T11:12:37.187375+0000","last_peered":"2024-05-10T11:12:37.187375+0000","last_clean":"2024-05-10T11:12:37.187375+0000","last_became_active":"2024-05-10T11:12:35.133392+0000","last_became_peered":"2024-05-10T11:12:35.133392+0000","last_unstale":"2024-05-10T11:12:37.187375+0000","last_undegraded":"2024-05-10T11:12:37.187375+0000","last_fullsized":"2024-05-10T11:12:37.187375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:44.435402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132810+0000","last_change":"2024-05-10T11:12:31.111452+0000","last_active":"2024-05-10T11:12:36.132810+0000","last_peered":"2024-05-10T11:12:36.132810+0000","last_clean":"2024-05-10T11:12:36.132810+0000","last_became_active":"2024-05-10T11:12:31.111168+0000","last_became_peered":"2024-05-10T11:12:31.111168+0000","last_unstale":"2024-05-10T11:12:36.132810+0000","last_undegraded":"2024-05-10T11:12:36.132810+0000","last_fullsized":"2024-05-10T11:12:36.132810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285516+0000","last_change":"2024-05-10T11:12:30.112912+0000","last_active":"2024-05-10T11:12:36.285516+0000","last_peered":"2024-05-10T11:12:36.285516+0000","last_clean":"2024-05-10T11:12:36.285516+0000","last_became_active":"2024-05-10T11:12:30.111893+0000","last_became_peered":"2024-05-10T11:12:30.111893+0000","last_unstale":"2024-05-10T11:12:36.285516+0000","last_undegraded":"2024-05-10T11:12:36.285516+0000","last_fullsized":"2024-05-10T11:12:36.285516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:05.409023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188183+0000","last_change":"2024-05-10T11:12:35.420832+0000","last_active":"2024-05-10T11:12:37.188183+0000","last_peered":"2024-05-10T11:12:37.188183+0000","last_clean":"2024-05-10T11:12:37.188183+0000","last_became_active":"2024-05-10T11:12:35.420468+0000","last_became_peered":"2024-05-10T11:12:35.420468+0000","last_unstale":"2024-05-10T11:12:37.188183+0000","last_undegraded":"2024-05-10T11:12:37.188183+0000","last_fullsized":"2024-05-10T11:12:37.188183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:03:37.556378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187133+0000","last_change":"2024-05-10T11:12:35.420919+0000","last_active":"2024-05-10T11:12:37.187133+0000","last_peered":"2024-05-10T11:12:37.187133+0000","last_clean":"2024-05-10T11:12:37.187133+0000","last_became_active":"2024-05-10T11:12:35.420486+0000","last_became_peered":"2024-05-10T11:12:35.420486+0000","last_unstale":"2024-05-10T11:12:37.187133+0000","last_undegraded":"2024-05-10T11:12:37.187133+0000","last_fullsized":"2024-05-10T11:12:37.187133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:47.376750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186198+0000","last_change":"2024-05-10T11:12:31.113465+0000","last_active":"2024-05-10T11:12:37.186198+0000","last_peered":"2024-05-10T11:12:37.186198+0000","last_clean":"2024-05-10T11:12:37.186198+0000","last_became_active":"2024-05-10T11:12:31.112391+0000","last_became_peered":"2024-05-10T11:12:31.112391+0000","last_unstale":"2024-05-10T11:12:37.186198+0000","last_undegraded":"2024-05-10T11:12:37.186198+0000","last_fullsized":"2024-05-10T11:12:37.186198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132384+0000","last_change":"2024-05-10T11:12:30.111231+0000","last_active":"2024-05-10T11:12:36.132384+0000","last_peered":"2024-05-10T11:12:36.132384+0000","last_clean":"2024-05-10T11:12:36.132384+0000","last_became_active":"2024-05-10T11:12:30.110915+0000","last_became_peered":"2024-05-10T11:12:30.110915+0000","last_unstale":"2024-05-10T11:12:36.132384+0000","last_undegraded":"2024-05-10T11:12:36.132384+0000","last_fullsized":"2024-05-10T11:12:36.132384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:01.128948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285493+0000","last_change":"2024-05-10T11:12:35.133270+0000","last_active":"2024-05-10T11:12:36.285493+0000","last_peered":"2024-05-10T11:12:36.285493+0000","last_clean":"2024-05-10T11:12:36.285493+0000","last_became_active":"2024-05-10T11:12:35.132883+0000","last_became_peered":"2024-05-10T11:12:35.132883+0000","last_unstale":"2024-05-10T11:12:36.285493+0000","last_undegraded":"2024-05-10T11:12:36.285493+0000","last_fullsized":"2024-05-10T11:12:36.285493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:02.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187365+0000","last_change":"2024-05-10T11:12:31.111880+0000","last_active":"2024-05-10T11:12:37.187365+0000","last_peered":"2024-05-10T11:12:37.187365+0000","last_clean":"2024-05-10T11:12:37.187365+0000","last_became_active":"2024-05-10T11:12:31.111561+0000","last_became_peered":"2024-05-10T11:12:31.111561+0000","last_unstale":"2024-05-10T11:12:37.187365+0000","last_undegraded":"2024-05-10T11:12:37.187365+0000","last_fullsized":"2024-05-10T11:12:37.187365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188080+0000","last_change":"2024-05-10T11:12:30.109020+0000","last_active":"2024-05-10T11:12:37.188080+0000","last_peered":"2024-05-10T11:12:37.188080+0000","last_clean":"2024-05-10T11:12:37.188080+0000","last_became_active":"2024-05-10T11:12:30.108553+0000","last_became_peered":"2024-05-10T11:12:30.108553+0000","last_unstale":"2024-05-10T11:12:37.188080+0000","last_undegraded":"2024-05-10T11:12:37.188080+0000","last_fullsized":"2024-05-10T11:12:37.188080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:39.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285277+0000","last_change":"2024-05-10T11:12:30.109083+0000","last_active":"2024-05-10T11:12:36.285277+0000","last_peered":"2024-05-10T11:12:36.285277+0000","last_clean":"2024-05-10T11:12:36.285277+0000","last_became_active":"2024-05-10T11:12:30.108670+0000","last_became_peered":"2024-05-10T11:12:30.108670+0000","last_unstale":"2024-05-10T11:12:36.285277+0000","last_undegraded":"2024-05-10T11:12:36.285277+0000","last_fullsized":"2024-05-10T11:12:36.285277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:58.672933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187664+0000","last_change":"2024-05-10T11:12:31.108203+0000","last_active":"2024-05-10T11:12:37.187664+0000","last_peered":"2024-05-10T11:12:37.187664+0000","last_clean":"2024-05-10T11:12:37.187664+0000","last_became_active":"2024-05-10T11:12:31.105737+0000","last_became_peered":"2024-05-10T11:12:31.105737+0000","last_unstale":"2024-05-10T11:12:37.187664+0000","last_undegraded":"2024-05-10T11:12:37.187664+0000","last_fullsized":"2024-05-10T11:12:37.187664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186596+0000","last_change":"2024-05-10T11:12:35.138676+0000","last_active":"2024-05-10T11:12:37.186596+0000","last_peered":"2024-05-10T11:12:37.186596+0000","last_clean":"2024-05-10T11:12:37.186596+0000","last_became_active":"2024-05-10T11:12:35.138246+0000","last_became_peered":"2024-05-10T11:12:35.138246+0000","last_unstale":"2024-05-10T11:12:37.186596+0000","last_undegraded":"2024-05-10T11:12:37.186596+0000","last_fullsized":"2024-05-10T11:12:37.186596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:10:22.656575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188197+0000","last_change":"2024-05-10T11:12:30.104759+0000","last_active":"2024-05-10T11:12:37.188197+0000","last_peered":"2024-05-10T11:12:37.188197+0000","last_clean":"2024-05-10T11:12:37.188197+0000","last_became_active":"2024-05-10T11:12:30.104499+0000","last_became_peered":"2024-05-10T11:12:30.104499+0000","last_unstale":"2024-05-10T11:12:37.188197+0000","last_undegraded":"2024-05-10T11:12:37.188197+0000","last_fullsized":"2024-05-10T11:12:37.188197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:29.073776+0000","last_clean_scrub_stamp":"2024-05-10T11:12:29.073776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:52.533603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132631+0000","last_change":"2024-05-10T11:12:31.105067+0000","last_active":"2024-05-10T11:12:36.132631+0000","last_peered":"2024-05-10T11:12:36.132631+0000","last_clean":"2024-05-10T11:12:36.132631+0000","last_became_active":"2024-05-10T11:12:31.104796+0000","last_became_peered":"2024-05-10T11:12:31.104796+0000","last_unstale":"2024-05-10T11:12:36.132631+0000","last_undegraded":"2024-05-10T11:12:36.132631+0000","last_fullsized":"2024-05-10T11:12:36.132631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:14.797134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187802+0000","last_change":"2024-05-10T11:12:35.137496+0000","last_active":"2024-05-10T11:12:37.187802+0000","last_peered":"2024-05-10T11:12:37.187802+0000","last_clean":"2024-05-10T11:12:37.187802+0000","last_became_active":"2024-05-10T11:12:35.137075+0000","last_became_peered":"2024-05-10T11:12:35.137075+0000","last_unstale":"2024-05-10T11:12:37.187802+0000","last_undegraded":"2024-05-10T11:12:37.187802+0000","last_fullsized":"2024-05-10T11:12:37.187802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:34.104855+0000","last_clean_scrub_stamp":"2024-05-10T11:12:34.104855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:05.500894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.284987+0000","last_change":"2024-05-10T11:12:31.109999+0000","last_active":"2024-05-10T11:12:36.284987+0000","last_peered":"2024-05-10T11:12:36.284987+0000","last_clean":"2024-05-10T11:12:36.284987+0000","last_became_active":"2024-05-10T11:12:31.109735+0000","last_became_peered":"2024-05-10T11:12:31.109735+0000","last_unstale":"2024-05-10T11:12:36.284987+0000","last_undegraded":"2024-05-10T11:12:36.284987+0000","last_fullsized":"2024-05-10T11:12:36.284987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:16.421221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186110+0000","last_change":"2024-05-10T11:12:31.099225+0000","last_active":"2024-05-10T11:12:37.186110+0000","last_peered":"2024-05-10T11:12:37.186110+0000","last_clean":"2024-05-10T11:12:37.186110+0000","last_became_active":"2024-05-10T11:12:31.098939+0000","last_became_peered":"2024-05-10T11:12:31.098939+0000","last_unstale":"2024-05-10T11:12:37.186110+0000","last_undegraded":"2024-05-10T11:12:37.186110+0000","last_fullsized":"2024-05-10T11:12:37.186110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:37.589756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133535+0000","last_change":"2024-05-10T11:12:31.113217+0000","last_active":"2024-05-10T11:12:36.133535+0000","last_peered":"2024-05-10T11:12:36.133535+0000","last_clean":"2024-05-10T11:12:36.133535+0000","last_became_active":"2024-05-10T11:12:31.112918+0000","last_became_peered":"2024-05-10T11:12:31.112918+0000","last_unstale":"2024-05-10T11:12:36.133535+0000","last_undegraded":"2024-05-10T11:12:36.133535+0000","last_fullsized":"2024-05-10T11:12:36.133535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:17.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187573+0000","last_change":"2024-05-10T11:12:31.118834+0000","last_active":"2024-05-10T11:12:37.187573+0000","last_peered":"2024-05-10T11:12:37.187573+0000","last_clean":"2024-05-10T11:12:37.187573+0000","last_became_active":"2024-05-10T11:12:31.118516+0000","last_became_peered":"2024-05-10T11:12:31.118516+0000","last_unstale":"2024-05-10T11:12:37.187573+0000","last_undegraded":"2024-05-10T11:12:37.187573+0000","last_fullsized":"2024-05-10T11:12:37.187573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:08.732145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188567+0000","last_change":"2024-05-10T11:12:31.117568+0000","last_active":"2024-05-10T11:12:37.188567+0000","last_peered":"2024-05-10T11:12:37.188567+0000","last_clean":"2024-05-10T11:12:37.188567+0000","last_became_active":"2024-05-10T11:12:31.117238+0000","last_became_peered":"2024-05-10T11:12:31.117238+0000","last_unstale":"2024-05-10T11:12:37.188567+0000","last_undegraded":"2024-05-10T11:12:37.188567+0000","last_fullsized":"2024-05-10T11:12:37.188567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186397+0000","last_change":"2024-05-10T11:12:31.113071+0000","last_active":"2024-05-10T11:12:37.186397+0000","last_peered":"2024-05-10T11:12:37.186397+0000","last_clean":"2024-05-10T11:12:37.186397+0000","last_became_active":"2024-05-10T11:12:31.112773+0000","last_became_peered":"2024-05-10T11:12:31.112773+0000","last_unstale":"2024-05-10T11:12:37.186397+0000","last_undegraded":"2024-05-10T11:12:37.186397+0000","last_fullsized":"2024-05-10T11:12:37.186397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285634+0000","last_change":"2024-05-10T11:12:31.111220+0000","last_active":"2024-05-10T11:12:36.285634+0000","last_peered":"2024-05-10T11:12:36.285634+0000","last_clean":"2024-05-10T11:12:36.285634+0000","last_became_active":"2024-05-10T11:12:31.110958+0000","last_became_peered":"2024-05-10T11:12:31.110958+0000","last_unstale":"2024-05-10T11:12:36.285634+0000","last_undegraded":"2024-05-10T11:12:36.285634+0000","last_fullsized":"2024-05-10T11:12:36.285634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:51.025764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188266+0000","last_change":"2024-05-10T11:12:31.116575+0000","last_active":"2024-05-10T11:12:37.188266+0000","last_peered":"2024-05-10T11:12:37.188266+0000","last_clean":"2024-05-10T11:12:37.188266+0000","last_became_active":"2024-05-10T11:12:31.116288+0000","last_became_peered":"2024-05-10T11:12:31.116288+0000","last_unstale":"2024-05-10T11:12:37.188266+0000","last_undegraded":"2024-05-10T11:12:37.188266+0000","last_fullsized":"2024-05-10T11:12:37.188266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132498+0000","last_change":"2024-05-10T11:12:31.117085+0000","last_active":"2024-05-10T11:12:36.132498+0000","last_peered":"2024-05-10T11:12:36.132498+0000","last_clean":"2024-05-10T11:12:36.132498+0000","last_became_active":"2024-05-10T11:12:31.116791+0000","last_became_peered":"2024-05-10T11:12:31.116791+0000","last_unstale":"2024-05-10T11:12:36.132498+0000","last_undegraded":"2024-05-10T11:12:36.132498+0000","last_fullsized":"2024-05-10T11:12:36.132498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:46.496246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187990+0000","last_change":"2024-05-10T11:12:31.117793+0000","last_active":"2024-05-10T11:12:37.187990+0000","last_peered":"2024-05-10T11:12:37.187990+0000","last_clean":"2024-05-10T11:12:37.187990+0000","last_became_active":"2024-05-10T11:12:31.117201+0000","last_became_peered":"2024-05-10T11:12:31.117201+0000","last_unstale":"2024-05-10T11:12:37.187990+0000","last_undegraded":"2024-05-10T11:12:37.187990+0000","last_fullsized":"2024-05-10T11:12:37.187990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:37.389979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133423+0000","last_change":"2024-05-10T11:12:31.111395+0000","last_active":"2024-05-10T11:12:36.133423+0000","last_peered":"2024-05-10T11:12:36.133423+0000","last_clean":"2024-05-10T11:12:36.133423+0000","last_became_active":"2024-05-10T11:12:31.111135+0000","last_became_peered":"2024-05-10T11:12:31.111135+0000","last_unstale":"2024-05-10T11:12:36.133423+0000","last_undegraded":"2024-05-10T11:12:36.133423+0000","last_fullsized":"2024-05-10T11:12:36.133423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187468+0000","last_change":"2024-05-10T11:12:31.111936+0000","last_active":"2024-05-10T11:12:37.187468+0000","last_peered":"2024-05-10T11:12:37.187468+0000","last_clean":"2024-05-10T11:12:37.187468+0000","last_became_active":"2024-05-10T11:12:31.111680+0000","last_became_peered":"2024-05-10T11:12:31.111680+0000","last_unstale":"2024-05-10T11:12:37.187468+0000","last_undegraded":"2024-05-10T11:12:37.187468+0000","last_fullsized":"2024-05-10T11:12:37.187468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:18.117560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285454+0000","last_change":"2024-05-10T11:12:31.106171+0000","last_active":"2024-05-10T11:12:36.285454+0000","last_peered":"2024-05-10T11:12:36.285454+0000","last_clean":"2024-05-10T11:12:36.285454+0000","last_became_active":"2024-05-10T11:12:31.105915+0000","last_became_peered":"2024-05-10T11:12:31.105915+0000","last_unstale":"2024-05-10T11:12:36.285454+0000","last_undegraded":"2024-05-10T11:12:36.285454+0000","last_fullsized":"2024-05-10T11:12:36.285454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:17.016710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186719+0000","last_change":"2024-05-10T11:12:31.116162+0000","last_active":"2024-05-10T11:12:37.186719+0000","last_peered":"2024-05-10T11:12:37.186719+0000","last_clean":"2024-05-10T11:12:37.186719+0000","last_became_active":"2024-05-10T11:12:31.115881+0000","last_became_peered":"2024-05-10T11:12:31.115881+0000","last_unstale":"2024-05-10T11:12:37.186719+0000","last_undegraded":"2024-05-10T11:12:37.186719+0000","last_fullsized":"2024-05-10T11:12:37.186719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:38.516343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186489+0000","last_change":"2024-05-10T11:12:31.104416+0000","last_active":"2024-05-10T11:12:37.186489+0000","last_peered":"2024-05-10T11:12:37.186489+0000","last_clean":"2024-05-10T11:12:37.186489+0000","last_became_active":"2024-05-10T11:12:31.104119+0000","last_became_peered":"2024-05-10T11:12:31.104119+0000","last_unstale":"2024-05-10T11:12:37.186489+0000","last_undegraded":"2024-05-10T11:12:37.186489+0000","last_fullsized":"2024-05-10T11:12:37.186489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:07.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133674+0000","last_change":"2024-05-10T11:12:31.111652+0000","last_active":"2024-05-10T11:12:36.133674+0000","last_peered":"2024-05-10T11:12:36.133674+0000","last_clean":"2024-05-10T11:12:36.133674+0000","last_became_active":"2024-05-10T11:12:31.111385+0000","last_became_peered":"2024-05-10T11:12:31.111385+0000","last_unstale":"2024-05-10T11:12:36.133674+0000","last_undegraded":"2024-05-10T11:12:36.133674+0000","last_fullsized":"2024-05-10T11:12:36.133674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:43.352019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132211+0000","last_change":"2024-05-10T11:12:31.110383+0000","last_active":"2024-05-10T11:12:36.132211+0000","last_peered":"2024-05-10T11:12:36.132211+0000","last_clean":"2024-05-10T11:12:36.132211+0000","last_became_active":"2024-05-10T11:12:31.108601+0000","last_became_peered":"2024-05-10T11:12:31.108601+0000","last_unstale":"2024-05-10T11:12:36.132211+0000","last_undegraded":"2024-05-10T11:12:36.132211+0000","last_fullsized":"2024-05-10T11:12:36.132211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186293+0000","last_change":"2024-05-10T11:12:31.108178+0000","last_active":"2024-05-10T11:12:37.186293+0000","last_peered":"2024-05-10T11:12:37.186293+0000","last_clean":"2024-05-10T11:12:37.186293+0000","last_became_active":"2024-05-10T11:12:31.107907+0000","last_became_peered":"2024-05-10T11:12:31.107907+0000","last_unstale":"2024-05-10T11:12:37.186293+0000","last_undegraded":"2024-05-10T11:12:37.186293+0000","last_fullsized":"2024-05-10T11:12:37.186293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187803+0000","last_change":"2024-05-10T11:12:31.110566+0000","last_active":"2024-05-10T11:12:37.187803+0000","last_peered":"2024-05-10T11:12:37.187803+0000","last_clean":"2024-05-10T11:12:37.187803+0000","last_became_active":"2024-05-10T11:12:31.109454+0000","last_became_peered":"2024-05-10T11:12:31.109454+0000","last_unstale":"2024-05-10T11:12:37.187803+0000","last_undegraded":"2024-05-10T11:12:37.187803+0000","last_fullsized":"2024-05-10T11:12:37.187803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:27.900557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.188026+0000","last_change":"2024-05-10T11:12:31.115792+0000","last_active":"2024-05-10T11:12:37.188026+0000","last_peered":"2024-05-10T11:12:37.188026+0000","last_clean":"2024-05-10T11:12:37.188026+0000","last_became_active":"2024-05-10T11:12:31.115100+0000","last_became_peered":"2024-05-10T11:12:31.115100+0000","last_unstale":"2024-05-10T11:12:37.188026+0000","last_undegraded":"2024-05-10T11:12:37.188026+0000","last_fullsized":"2024-05-10T11:12:37.188026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132918+0000","last_change":"2024-05-10T11:12:31.103226+0000","last_active":"2024-05-10T11:12:36.132918+0000","last_peered":"2024-05-10T11:12:36.132918+0000","last_clean":"2024-05-10T11:12:36.132918+0000","last_became_active":"2024-05-10T11:12:31.102693+0000","last_became_peered":"2024-05-10T11:12:31.102693+0000","last_unstale":"2024-05-10T11:12:36.132918+0000","last_undegraded":"2024-05-10T11:12:36.132918+0000","last_fullsized":"2024-05-10T11:12:36.132918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:58.305425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285258+0000","last_change":"2024-05-10T11:12:31.117347+0000","last_active":"2024-05-10T11:12:36.285258+0000","last_peered":"2024-05-10T11:12:36.285258+0000","last_clean":"2024-05-10T11:12:36.285258+0000","last_became_active":"2024-05-10T11:12:31.117080+0000","last_became_peered":"2024-05-10T11:12:31.117080+0000","last_unstale":"2024-05-10T11:12:36.285258+0000","last_undegraded":"2024-05-10T11:12:36.285258+0000","last_fullsized":"2024-05-10T11:12:36.285258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:20:41.148766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.285571+0000","last_change":"2024-05-10T11:12:31.113909+0000","last_active":"2024-05-10T11:12:36.285571+0000","last_peered":"2024-05-10T11:12:36.285571+0000","last_clean":"2024-05-10T11:12:36.285571+0000","last_became_active":"2024-05-10T11:12:31.113651+0000","last_became_peered":"2024-05-10T11:12:31.113651+0000","last_unstale":"2024-05-10T11:12:36.285571+0000","last_undegraded":"2024-05-10T11:12:36.285571+0000","last_fullsized":"2024-05-10T11:12:36.285571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:43.952189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186834+0000","last_change":"2024-05-10T11:12:31.117272+0000","last_active":"2024-05-10T11:12:37.186834+0000","last_peered":"2024-05-10T11:12:37.186834+0000","last_clean":"2024-05-10T11:12:37.186834+0000","last_became_active":"2024-05-10T11:12:31.117013+0000","last_became_peered":"2024-05-10T11:12:31.117013+0000","last_unstale":"2024-05-10T11:12:37.186834+0000","last_undegraded":"2024-05-10T11:12:37.186834+0000","last_fullsized":"2024-05-10T11:12:37.186834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:25.498498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.187253+0000","last_change":"2024-05-10T11:12:31.118763+0000","last_active":"2024-05-10T11:12:37.187253+0000","last_peered":"2024-05-10T11:12:37.187253+0000","last_clean":"2024-05-10T11:12:37.187253+0000","last_became_active":"2024-05-10T11:12:31.118500+0000","last_became_peered":"2024-05-10T11:12:31.118500+0000","last_unstale":"2024-05-10T11:12:37.187253+0000","last_undegraded":"2024-05-10T11:12:37.187253+0000","last_fullsized":"2024-05-10T11:12:37.187253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:45.881268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186156+0000","last_change":"2024-05-10T11:12:31.121865+0000","last_active":"2024-05-10T11:12:37.186156+0000","last_peered":"2024-05-10T11:12:37.186156+0000","last_clean":"2024-05-10T11:12:37.186156+0000","last_became_active":"2024-05-10T11:12:31.121590+0000","last_became_peered":"2024-05-10T11:12:31.121590+0000","last_unstale":"2024-05-10T11:12:37.186156+0000","last_undegraded":"2024-05-10T11:12:37.186156+0000","last_fullsized":"2024-05-10T11:12:37.186156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:39.407373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.133353+0000","last_change":"2024-05-10T11:12:31.118987+0000","last_active":"2024-05-10T11:12:36.133353+0000","last_peered":"2024-05-10T11:12:36.133353+0000","last_clean":"2024-05-10T11:12:36.133353+0000","last_became_active":"2024-05-10T11:12:31.118719+0000","last_became_peered":"2024-05-10T11:12:31.118719+0000","last_unstale":"2024-05-10T11:12:36.133353+0000","last_undegraded":"2024-05-10T11:12:36.133353+0000","last_fullsized":"2024-05-10T11:12:36.133353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:55:31.635937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186264+0000","last_change":"2024-05-10T11:12:31.114654+0000","last_active":"2024-05-10T11:12:37.186264+0000","last_peered":"2024-05-10T11:12:37.186264+0000","last_clean":"2024-05-10T11:12:37.186264+0000","last_became_active":"2024-05-10T11:12:31.114360+0000","last_became_peered":"2024-05-10T11:12:31.114360+0000","last_unstale":"2024-05-10T11:12:37.186264+0000","last_undegraded":"2024-05-10T11:12:37.186264+0000","last_fullsized":"2024-05-10T11:12:37.186264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:43.145552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:36.132883+0000","last_change":"2024-05-10T11:12:31.116369+0000","last_active":"2024-05-10T11:12:36.132883+0000","last_peered":"2024-05-10T11:12:36.132883+0000","last_clean":"2024-05-10T11:12:36.132883+0000","last_became_active":"2024-05-10T11:12:31.114859+0000","last_became_peered":"2024-05-10T11:12:31.114859+0000","last_unstale":"2024-05-10T11:12:36.132883+0000","last_undegraded":"2024-05-10T11:12:36.132883+0000","last_fullsized":"2024-05-10T11:12:36.132883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:36.431235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186153+0000","last_change":"2024-05-10T11:12:31.116456+0000","last_active":"2024-05-10T11:12:37.186153+0000","last_peered":"2024-05-10T11:12:37.186153+0000","last_clean":"2024-05-10T11:12:37.186153+0000","last_became_active":"2024-05-10T11:12:31.115520+0000","last_became_peered":"2024-05-10T11:12:31.115520+0000","last_unstale":"2024-05-10T11:12:37.186153+0000","last_undegraded":"2024-05-10T11:12:37.186153+0000","last_fullsized":"2024-05-10T11:12:37.186153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:52:30.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186576+0000","last_change":"2024-05-10T11:12:31.107221+0000","last_active":"2024-05-10T11:12:37.186576+0000","last_peered":"2024-05-10T11:12:37.186576+0000","last_clean":"2024-05-10T11:12:37.186576+0000","last_became_active":"2024-05-10T11:12:31.106948+0000","last_became_peered":"2024-05-10T11:12:31.106948+0000","last_unstale":"2024-05-10T11:12:37.186576+0000","last_undegraded":"2024-05-10T11:12:37.186576+0000","last_fullsized":"2024-05-10T11:12:37.186576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:05.258772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T11:12:37.186697+0000","last_change":"2024-05-10T11:12:31.113410+0000","last_active":"2024-05-10T11:12:37.186697+0000","last_peered":"2024-05-10T11:12:37.186697+0000","last_clean":"2024-05-10T11:12:37.186697+0000","last_became_active":"2024-05-10T11:12:31.112221+0000","last_became_peered":"2024-05-10T11:12:31.112221+0000","last_unstale":"2024-05-10T11:12:37.186697+0000","last_undegraded":"2024-05-10T11:12:37.186697+0000","last_fullsized":"2024-05-10T11:12:37.186697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:30.080124+0000","last_clean_scrub_stamp":"2024-05-10T11:12:30.080124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:47.185372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":693801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":102977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":693857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:12:50.163 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:12:50.163 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T11:12:50.163 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T11:12:50.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:12:50.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.301+0000 7fb91bd5f640 1 Processor -- start 2024-05-10T11:12:50.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.301+0000 7fb91bd5f640 1 -- start start 2024-05-10T11:12:50.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91bd5f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb914162750 0x7fb9140d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91bd5f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb9140d5cb0 0x7fb9140d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91bd5f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9140b45f0 con 0x7fb914162b30 2024-05-10T11:12:50.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91bd5f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140b4f20 con 0x7fb914162750 2024-05-10T11:12:50.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91bd5f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140d0fe0 con 0x7fb9140d5cb0 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb919afb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb914162750 0x7fb9140d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91a2fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb914162b30 0x7fb9140d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41084/0 (socket says 172.21.15.66:41084) 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb91a2fc640 1 -- 172.21.15.66:0/413932725 learned_addr learned my addr 172.21.15.66:0/413932725 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb919afb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb914162750 0x7fb9140d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40152/0 (socket says 172.21.15.66:40152) 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.302+0000 7fb9192fa640 1 --2- 172.21.15.66:0/413932725 >> v2:172.21.15.190:3300/0 conn(0x7fb9140d5cb0 0x7fb9140d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb919afb640 1 -- 172.21.15.66:0/413932725 >> v2:172.21.15.190:3300/0 conn(0x7fb9140d5cb0 msgr2=0x7fb9140d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb919afb640 1 --2- 172.21.15.66:0/413932725 >> v2:172.21.15.190:3300/0 conn(0x7fb9140d5cb0 0x7fb9140d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb919afb640 1 -- 172.21.15.66:0/413932725 >> v1:172.21.15.66:6789/0 conn(0x7fb914162b30 legacy=0x7fb9140d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb918af9640 1 -- 172.21.15.66:0/413932725 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692133801 0 0) 0x7fb9140b45f0 con 0x7fb914162b30 2024-05-10T11:12:50.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb919afb640 1 -- 172.21.15.66:0/413932725 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140b48d0 con 0x7fb914162750 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb919afb640 1 --2- 172.21.15.66:0/413932725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162750 0x7fb9140d0670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9140b4e90 tx=0x7fb91002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779499a81b972577 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb918af9640 1 -- 172.21.15.66:0/413932725 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910037070 con 0x7fb914162750 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.303+0000 7fb918af9640 1 -- 172.21.15.66:0/413932725 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910032440 con 0x7fb914162750 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb918af9640 1 -- 172.21.15.66:0/413932725 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91002ae60 con 0x7fb914162750 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 -- 172.21.15.66:0/413932725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162750 msgr2=0x7fb9140d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/413932725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162750 0x7fb9140d0670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9140b4e90 tx=0x7fb91002a110 comp rx=0 tx=0).stop 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 -- 172.21.15.66:0/413932725 shutdown_connections 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/413932725 >> v2:172.21.15.190:3300/0 conn(0x7fb9140d5cb0 0x7fb9140d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/413932725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162750 0x7fb9140d0670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 -- 172.21.15.66:0/413932725 >> 172.21.15.66:0/413932725 conn(0x7fb91409e3b0 msgr2=0x7fb9140d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:50.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 -- 172.21.15.66:0/413932725 shutdown_connections 2024-05-10T11:12:50.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.304+0000 7fb91bd5f640 1 -- 172.21.15.66:0/413932725 wait complete. 2024-05-10T11:12:50.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.305+0000 7fb91bd5f640 1 Processor -- start 2024-05-10T11:12:50.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.305+0000 7fb91bd5f640 1 -- start start 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91bd5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb914162750 0x7fb914158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91bd5f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 0x7fb91414e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91bd5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9140ceb70 0x7fb9140b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91bd5f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140d0d30 con 0x7fb914162b30 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91bd5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140d0bb0 con 0x7fb914162750 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91bd5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb9140b63c0 con 0x7fb9140ceb70 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 0x7fb91414e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 0x7fb91414e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40160/0 (socket says 172.21.15.66:40160) 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 -- 172.21.15.66:0/992606832 learned_addr learned my addr 172.21.15.66:0/992606832 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb919afb640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb914162750 0x7fb914158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91a2fc640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9140ceb70 0x7fb9140b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 -- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9140ceb70 msgr2=0x7fb9140b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9140ceb70 0x7fb9140b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 -- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb914162750 msgr2=0x7fb914158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb914162750 0x7fb914158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb9192fa640 1 -- 172.21.15.66:0/992606832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91414e9a0 con 0x7fb914162b30 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.306+0000 7fb91a2fc640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9140ceb70 0x7fb9140b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.307+0000 7fb9192fa640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 0x7fb91414e460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb90400d800 tx=0x7fb90400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.307+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90400b6c0 con 0x7fb914162b30 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.307+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904019070 con 0x7fb914162b30 2024-05-10T11:12:50.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.307+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9140b9180 con 0x7fb914162b30 2024-05-10T11:12:50.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.307+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90400baa0 con 0x7fb914162b30 2024-05-10T11:12:50.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.307+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9140cc250 con 0x7fb914162b30 2024-05-10T11:12:50.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.308+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91406a220 con 0x7fb914162b30 2024-05-10T11:12:50.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.309+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb90400bc40 con 0x7fb914162b30 2024-05-10T11:12:50.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.309+0000 7fb90a7fc640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8f80762d0 0x7fb8f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.309+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb904097cd0 con 0x7fb914162b30 2024-05-10T11:12:50.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.309+0000 7fb919afb640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8f80762d0 0x7fb8f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.310+0000 7fb919afb640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8f80762d0 0x7fb8f8078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb910034000 tx=0x7fb91002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:50.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.314+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb904061380 con 0x7fb914162b30 2024-05-10T11:12:50.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.564+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9140d1300 con 0x7fb914162b30 2024-05-10T11:12:50.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.565+0000 7fb90a7fc640 1 -- 172.21.15.66:0/992606832 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb904060c80 con 0x7fb914162b30 2024-05-10T11:12:50.566 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:50.566 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T11:12:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8f80762d0 msgr2=0x7fb8f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8f80762d0 0x7fb8f8078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb910034000 tx=0x7fb91002e000 comp rx=0 tx=0).stop 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 msgr2=0x7fb91414e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 0x7fb91414e460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb90400d800 tx=0x7fb90400dcc0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 shutdown_connections 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8f80762d0 0x7fb8f8078790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9140ceb70 0x7fb9140b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb914162b30 0x7fb91414e460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 --2- 172.21.15.66:0/992606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb914162750 0x7fb914158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 >> 172.21.15.66:0/992606832 conn(0x7fb91409e3b0 msgr2=0x7fb9140d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 shutdown_connections 2024-05-10T11:12:50.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.567+0000 7fb91bd5f640 1 -- 172.21.15.66:0/992606832 wait complete. 2024-05-10T11:12:50.579 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T11:12:50.579 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:50.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.682+0000 7f3b0ad22640 1 Processor -- start 2024-05-10T11:12:50.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.682+0000 7f3b0ad22640 1 -- start start 2024-05-10T11:12:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.683+0000 7f3b0ad22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b04071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.683+0000 7f3b0ad22640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b04072330 con 0x7f3b04071880 2024-05-10T11:12:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.683+0000 7f3b0ad22640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b04071d70 con 0x7f3b040d3510 2024-05-10T11:12:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.683+0000 7f3b0ad22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3b04072050 con 0x7f3b0415d290 2024-05-10T11:12:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.683+0000 7f3b03fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3b04071880 0x7f3b040d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41100/0 (socket says 172.21.15.66:41100) 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.683+0000 7f3b03fff640 1 -- 172.21.15.66:0/4266706350 learned_addr learned my addr 172.21.15.66:0/4266706350 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b08abe640 1 --2- 172.21.15.66:0/4266706350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b04071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364572256 0 0) 0x7f3b04072330 con 0x7f3b04071880 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3af0003520 con 0x7f3b04071880 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912368251 0 0) 0x7f3b04071d70 con 0x7f3b040d3510 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b04072330 con 0x7f3b040d3510 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b08abe640 1 -- 172.21.15.66:0/4266706350 >> v1:172.21.15.190:6789/0 conn(0x7f3b040d3510 legacy=0x7f3b040ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b08abe640 1 -- 172.21.15.66:0/4266706350 >> v1:172.21.15.66:6789/0 conn(0x7f3b04071880 legacy=0x7f3b040d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.684+0000 7f3b08abe640 1 -- 172.21.15.66:0/4266706350 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b040cda70 con 0x7f3b0415d290 2024-05-10T11:12:50.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b08abe640 1 --2- 172.21.15.66:0/4266706350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b04071340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097d0 tx=0x7f3afc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a0c194dd872e8fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc037070 con 0x7f3b0415d290 2024-05-10T11:12:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc032440 con 0x7f3b0415d290 2024-05-10T11:12:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b037fe640 1 -- 172.21.15.66:0/4266706350 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0327f0 con 0x7f3b0415d290 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b0ad22640 1 -- 172.21.15.66:0/4266706350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 msgr2=0x7f3b04071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/4266706350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b04071340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097d0 tx=0x7f3afc02a210 comp rx=0 tx=0).stop 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b0ad22640 1 -- 172.21.15.66:0/4266706350 shutdown_connections 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/4266706350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b04071340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.685+0000 7f3b0ad22640 1 -- 172.21.15.66:0/4266706350 >> 172.21.15.66:0/4266706350 conn(0x7f3b0409ba20 msgr2=0x7f3b0409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.686+0000 7f3b0ad22640 1 -- 172.21.15.66:0/4266706350 shutdown_connections 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.686+0000 7f3b0ad22640 1 -- 172.21.15.66:0/4266706350 wait complete. 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.687+0000 7f3b0ad22640 1 Processor -- start 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.687+0000 7f3b0ad22640 1 -- start start 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 0x7f3b040b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b040d3510 0x7f3b0415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b0415df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040d1c20 con 0x7f3b04071880 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040d1aa0 con 0x7f3b040d3510 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3b04148f70 con 0x7f3b0415d290 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 0x7f3b040b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 0x7f3b040b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40170/0 (socket says 172.21.15.66:40170) 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 -- 172.21.15.66:0/2606312977 learned_addr learned my addr 172.21.15.66:0/2606312977 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b03fff640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b040d3510 0x7f3b0415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b092bf640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b0415df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 -- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 msgr2=0x7f3b0415df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b0415df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 -- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b040d3510 msgr2=0x7f3b0415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b040d3510 0x7f3b0415d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 -- 172.21.15.66:0/2606312977 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b04149250 con 0x7f3b04071880 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b08abe640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 0x7f3b040b3c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3afc000c00 tx=0x7f3afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc041020 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc03d620 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b04149530 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.688+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc037040 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.689+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b04149af0 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.690+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b040693f0 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.690+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3afc044020 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.691+0000 7f3b017fa640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ae4076300 0x7f3ae40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.691+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3afc0b7ea0 con 0x7f3b04071880 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.691+0000 7f3b03fff640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ae4076300 0x7f3ae40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.691+0000 7f3b03fff640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ae4076300 0x7f3ae40787c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b0414d5f0 tx=0x7f3af4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.695+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3afc04b070 con 0x7f3b04071880 2024-05-10T11:12:50.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.924+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b0415c500 con 0x7f3b04071880 2024-05-10T11:12:50.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.924+0000 7f3b017fa640 1 -- 172.21.15.66:0/2606312977 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f3afc0814d0 con 0x7f3b04071880 2024-05-10T11:12:50.925 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:50.925 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:12:50.925 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ae4076300 msgr2=0x7f3ae40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ae4076300 0x7f3ae40787c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b0414d5f0 tx=0x7f3af4009040 comp rx=0 tx=0).stop 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 msgr2=0x7f3b040b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 0x7f3b040b3c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3afc000c00 tx=0x7f3afc0046c0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 shutdown_connections 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3ae4076300 0x7f3ae40787c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0415d290 0x7f3b0415df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b040d3510 0x7f3b0415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 --2- 172.21.15.66:0/2606312977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b04071880 0x7f3b040b3c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:50.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 >> 172.21.15.66:0/2606312977 conn(0x7f3b0409ba20 msgr2=0x7f3b04070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:50.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 shutdown_connections 2024-05-10T11:12:50.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:50.926+0000 7f3b0ad22640 1 -- 172.21.15.66:0/2606312977 wait complete. 2024-05-10T11:12:50.938 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:51.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.041+0000 7f1b36885640 1 Processor -- start 2024-05-10T11:12:51.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.041+0000 7f1b36885640 1 -- start start 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b36885640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b30162dd0 0x7f1b300cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b36885640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b300b5e80 con 0x7f1b300d2270 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b36885640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b300d5c50 con 0x7f1b300d3980 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b36885640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300b5c30 con 0x7f1b30162dd0 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b34e22640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1b300d2270 0x7f1b300d03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41116/0 (socket says 172.21.15.66:41116) 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b34e22640 1 -- 172.21.15.66:0/2607182224 learned_addr learned my addr 172.21.15.66:0/2607182224 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:51.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b2f7fe640 1 --2- 172.21.15.66:0/2607182224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b30162dd0 0x7f1b300cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845980924 0 0) 0x7f1b300b5e80 con 0x7f1b300d2270 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b18003520 con 0x7f1b300d2270 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.042+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924177708 0 0) 0x7f1b300d5c50 con 0x7f1b300d3980 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.043+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b300b5e80 con 0x7f1b300d3980 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.043+0000 7f1b2f7fe640 1 -- 172.21.15.66:0/2607182224 >> v1:172.21.15.190:6789/0 conn(0x7f1b300d3980 legacy=0x7f1b301626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.043+0000 7f1b2f7fe640 1 -- 172.21.15.66:0/2607182224 >> v1:172.21.15.66:6789/0 conn(0x7f1b300d2270 legacy=0x7f1b300d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.043+0000 7f1b2f7fe640 1 -- 172.21.15.66:0/2607182224 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300d5f30 con 0x7f1b30162dd0 2024-05-10T11:12:51.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.043+0000 7f1b2f7fe640 1 --2- 172.21.15.66:0/2607182224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b30162dd0 0x7f1b300cfeb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b240097d0 tx=0x7f1b2402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=576473662a182f5f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24037070 con 0x7f1b30162dd0 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b24032440 con 0x7f1b30162dd0 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b2effd640 1 -- 172.21.15.66:0/2607182224 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24032810 con 0x7f1b30162dd0 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 -- 172.21.15.66:0/2607182224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b30162dd0 msgr2=0x7f1b300cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 --2- 172.21.15.66:0/2607182224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b30162dd0 0x7f1b300cfeb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b240097d0 tx=0x7f1b2402a210 comp rx=0 tx=0).stop 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 -- 172.21.15.66:0/2607182224 shutdown_connections 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 --2- 172.21.15.66:0/2607182224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b30162dd0 0x7f1b300cfeb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 -- 172.21.15.66:0/2607182224 >> 172.21.15.66:0/2607182224 conn(0x7f1b300d5130 msgr2=0x7f1b300d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 -- 172.21.15.66:0/2607182224 shutdown_connections 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.044+0000 7f1b36885640 1 -- 172.21.15.66:0/2607182224 wait complete. 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.045+0000 7f1b36885640 1 Processor -- start 2024-05-10T11:12:51.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.045+0000 7f1b36885640 1 -- start start 2024-05-10T11:12:51.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b36885640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b300d2270 0x7f1b300b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b36885640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b300d3980 0x7f1b301554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b36885640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 0x7f1b300b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b36885640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300b6890 con 0x7f1b30162dd0 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b36885640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300d31f0 con 0x7f1b300d3980 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b36885640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300b6160 con 0x7f1b300d2270 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b34e22640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 0x7f1b300b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b34e22640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 0x7f1b300b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40174/0 (socket says 172.21.15.66:40174) 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b34e22640 1 -- 172.21.15.66:0/3883098802 learned_addr learned my addr 172.21.15.66:0/3883098802 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b2ffff640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b300d2270 0x7f1b300b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.046+0000 7f1b2f7fe640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b300d3980 0x7f1b301554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b34e22640 1 -- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b300d2270 msgr2=0x7f1b300b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b34e22640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b300d2270 0x7f1b300b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b34e22640 1 -- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b300d3980 msgr2=0x7f1b301554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b34e22640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b300d3980 0x7f1b301554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b34e22640 1 -- 172.21.15.66:0/3883098802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300b87a0 con 0x7f1b30162dd0 2024-05-10T11:12:51.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b34e22640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 0x7f1b300b7d20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800cba0 tx=0x7f1b2800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28017070 con 0x7f1b30162dd0 2024-05-10T11:12:51.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2800ace0 con 0x7f1b30162dd0 2024-05-10T11:12:51.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b300b8a80 con 0x7f1b30162dd0 2024-05-10T11:12:51.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28012620 con 0x7f1b30162dd0 2024-05-10T11:12:51.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.047+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b300b9040 con 0x7f1b30162dd0 2024-05-10T11:12:51.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.048+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3006a220 con 0x7f1b30162dd0 2024-05-10T11:12:51.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.049+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b2801a070 con 0x7f1b30162dd0 2024-05-10T11:12:51.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.049+0000 7f1b2cff9640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b1c0762d0 0x7f1b1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.049+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b280975f0 con 0x7f1b30162dd0 2024-05-10T11:12:51.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.049+0000 7f1b2ffff640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b1c0762d0 0x7f1b1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.050+0000 7f1b2ffff640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b1c0762d0 0x7f1b1c078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b20007fd0 tx=0x7f1b20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.053+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1b28060650 con 0x7f1b30162dd0 2024-05-10T11:12:51.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.289+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b300d1d50 con 0x7f1b30162dd0 2024-05-10T11:12:51.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.290+0000 7f1b2cff9640 1 -- 172.21.15.66:0/3883098802 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f1b28064950 con 0x7f1b30162dd0 2024-05-10T11:12:51.290 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:51.290 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:12:51.291 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:12:51.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b1c0762d0 msgr2=0x7f1b1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b1c0762d0 0x7f1b1c078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b20007fd0 tx=0x7f1b20009040 comp rx=0 tx=0).stop 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 msgr2=0x7f1b300b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 0x7f1b300b7d20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800cba0 tx=0x7f1b2800a430 comp rx=0 tx=0).stop 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 shutdown_connections 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b1c0762d0 0x7f1b1c078790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30162dd0 0x7f1b300b7d20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b300d3980 0x7f1b301554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 --2- 172.21.15.66:0/3883098802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b300d2270 0x7f1b300b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 >> 172.21.15.66:0/3883098802 conn(0x7f1b300d5130 msgr2=0x7f1b30160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 shutdown_connections 2024-05-10T11:12:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.292+0000 7f1b36885640 1 -- 172.21.15.66:0/3883098802 wait complete. 2024-05-10T11:12:51.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:12:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.406+0000 7f8182c74640 1 Processor -- start 2024-05-10T11:12:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.406+0000 7f8182c74640 1 -- start start 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f8182c74640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f817c162600 0x7f817c06ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f8182c74640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f817c0caf50 0x7f817c0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f8182c74640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817c1635d0 con 0x7f817c162de0 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f8182c74640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f817c1638b0 con 0x7f817c162600 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f8182c74640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f817c163b90 con 0x7f817c0caf50 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f8180a10640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f817c162600 0x7f817c06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f817bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f817c162de0 0x7f817c0ca840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41124/0 (socket says 172.21.15.66:41124) 2024-05-10T11:12:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.407+0000 7f817bfff640 1 -- 172.21.15.66:0/2457301767 learned_addr learned my addr 172.21.15.66:0/2457301767 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8181211640 1 --2- 172.21.15.66:0/2457301767 >> v2:172.21.15.190:3300/0 conn(0x7f817c0caf50 0x7f817c0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8180a10640 1 -- 172.21.15.66:0/2457301767 >> v2:172.21.15.190:3300/0 conn(0x7f817c0caf50 msgr2=0x7f817c0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8180a10640 1 --2- 172.21.15.66:0/2457301767 >> v2:172.21.15.190:3300/0 conn(0x7f817c0caf50 0x7f817c0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8180a10640 1 -- 172.21.15.66:0/2457301767 >> v1:172.21.15.66:6789/0 conn(0x7f817c162de0 legacy=0x7f817c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f817b7fe640 1 -- 172.21.15.66:0/2457301767 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980156285 0 0) 0x7f817c1635d0 con 0x7f817c162de0 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8180a10640 1 -- 172.21.15.66:0/2457301767 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c0cf980 con 0x7f817c162600 2024-05-10T11:12:51.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8181211640 1 --2- 172.21.15.66:0/2457301767 >> v2:172.21.15.190:3300/0 conn(0x7f817c0caf50 0x7f817c0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f8180a10640 1 --2- 172.21.15.66:0/2457301767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c06ea00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f817c0b0950 tx=0x7f817402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592eba1130ba1fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.408+0000 7f817b7fe640 1 -- 172.21.15.66:0/2457301767 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174037070 con 0x7f817c162600 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f817b7fe640 1 -- 172.21.15.66:0/2457301767 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8174032440 con 0x7f817c162600 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f817b7fe640 1 -- 172.21.15.66:0/2457301767 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817402ae60 con 0x7f817c162600 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 -- 172.21.15.66:0/2457301767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 msgr2=0x7f817c06ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 --2- 172.21.15.66:0/2457301767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c06ea00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f817c0b0950 tx=0x7f817402a110 comp rx=0 tx=0).stop 2024-05-10T11:12:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 -- 172.21.15.66:0/2457301767 shutdown_connections 2024-05-10T11:12:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 --2- 172.21.15.66:0/2457301767 >> v2:172.21.15.190:3300/0 conn(0x7f817c0caf50 0x7f817c0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 --2- 172.21.15.66:0/2457301767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c06ea00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 -- 172.21.15.66:0/2457301767 >> 172.21.15.66:0/2457301767 conn(0x7f817c0d1510 msgr2=0x7f817c0d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 -- 172.21.15.66:0/2457301767 shutdown_connections 2024-05-10T11:12:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.409+0000 7f8182c74640 1 -- 172.21.15.66:0/2457301767 wait complete. 2024-05-10T11:12:51.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.410+0000 7f8182c74640 1 Processor -- start 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.410+0000 7f8182c74640 1 -- start start 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f8182c74640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f817c0caf50 0x7f817c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f8182c74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f8182c74640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f817c162de0 0x7f817c1f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f8182c74640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f817c162b60 con 0x7f817c162600 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f8182c74640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1629e0 con 0x7f817c162de0 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f8182c74640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f817c06c2c0 con 0x7f817c0caf50 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f817bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f817bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c14e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40194/0 (socket says 172.21.15.66:40194) 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.411+0000 7f817bfff640 1 -- 172.21.15.66:0/2351971799 learned_addr learned my addr 172.21.15.66:0/2351971799 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f8180a10640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f817c0caf50 0x7f817c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f8181211640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f817c162de0 0x7f817c1f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f817bfff640 1 -- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f817c0caf50 msgr2=0x7f817c151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f817bfff640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f817c0caf50 0x7f817c151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f817bfff640 1 -- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f817c162de0 msgr2=0x7f817c1f8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f817bfff640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f817c162de0 0x7f817c1f8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f817bfff640 1 -- 172.21.15.66:0/2351971799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c1f93a0 con 0x7f817c162600 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f8180a10640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f817c0caf50 0x7f817c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f817bfff640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c14e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f816400c3f0 tx=0x7f816400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81640074e0 con 0x7f817c162600 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81640047e0 con 0x7f817c162600 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c1f90c0 con 0x7f817c162600 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164004c10 con 0x7f817c162600 2024-05-10T11:12:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.412+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c151470 con 0x7f817c162600 2024-05-10T11:12:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.413+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817c06a220 con 0x7f817c162600 2024-05-10T11:12:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.414+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8164011070 con 0x7f817c162600 2024-05-10T11:12:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.414+0000 7f81797fa640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f815c0762d0 0x7f815c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.414+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8164097520 con 0x7f817c162600 2024-05-10T11:12:51.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.415+0000 7f8180a10640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f815c0762d0 0x7f815c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.415+0000 7f8180a10640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f815c0762d0 0x7f815c078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8174034000 tx=0x7f817402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.419+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8164060b40 con 0x7f817c162600 2024-05-10T11:12:51.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.611+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f817c0cf030 con 0x7f817c162600 2024-05-10T11:12:51.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.612+0000 7f81797fa640 1 -- 172.21.15.66:0/2351971799 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f8164060440 con 0x7f817c162600 2024-05-10T11:12:51.612 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:51.613 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:12:51.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f815c0762d0 msgr2=0x7f815c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f815c0762d0 0x7f815c078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8174034000 tx=0x7f817402e000 comp rx=0 tx=0).stop 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 msgr2=0x7f817c14e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c14e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f816400c3f0 tx=0x7f816400c8b0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 shutdown_connections 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f815c0762d0 0x7f815c078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f817c162de0 0x7f817c1f8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f817c162600 0x7f817c14e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 --2- 172.21.15.66:0/2351971799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f817c0caf50 0x7f817c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 >> 172.21.15.66:0/2351971799 conn(0x7f817c0d1510 msgr2=0x7f817c0b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 shutdown_connections 2024-05-10T11:12:51.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.614+0000 7f8182c74640 1 -- 172.21.15.66:0/2351971799 wait complete. 2024-05-10T11:12:51.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:12:51.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.729+0000 7f1b5b9dd640 1 Processor -- start 2024-05-10T11:12:51.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.730+0000 7f1b5b9dd640 1 -- start start 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.730+0000 7f1b5b9dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 0x7f1b54071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.730+0000 7f1b5b9dd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b54072330 con 0x7f1b54071880 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.730+0000 7f1b5b9dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b54071d70 con 0x7f1b540d3510 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.730+0000 7f1b5b9dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b54072050 con 0x7f1b5415d290 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b58f78640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1b54071880 0x7f1b540d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41128/0 (socket says 172.21.15.66:41128) 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b58f78640 1 -- 172.21.15.66:0/148607305 learned_addr learned my addr 172.21.15.66:0/148607305 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b59779640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 0x7f1b54071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759576250 0 0) 0x7f1b54072330 con 0x7f1b54071880 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b40003520 con 0x7f1b54071880 2024-05-10T11:12:51.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591468812 0 0) 0x7f1b54071d70 con 0x7f1b540d3510 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b54072330 con 0x7f1b540d3510 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 249392374 0 0) 0x7f1b40003520 con 0x7f1b54071880 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 msgr2=0x7f1b54071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 0x7f1b54071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 >> v1:172.21.15.190:6789/0 conn(0x7f1b540d3510 legacy=0x7f1b540ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b540cda70 con 0x7f1b54071880 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f1b48001670 con 0x7f1b54071880 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 >> v1:172.21.15.66:6789/0 conn(0x7f1b54071880 legacy=0x7f1b540d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b40003b70 0x7f1b40003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 0x7f1b40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b54072050 con 0x7f1b40004d40 2024-05-10T11:12:51.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4000ba70 con 0x7f1b40003b70 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4000bc20 con 0x7f1b5415d290 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b59f7a640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b59779640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b40003b70 0x7f1b40003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.731+0000 7f1b58f78640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 0x7f1b40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b59f7a640 1 -- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 msgr2=0x7f1b40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b59f7a640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b5415d290 0x7f1b40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b59f7a640 1 -- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b40003b70 msgr2=0x7f1b40003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b59f7a640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b40003b70 0x7f1b40003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b59f7a640 1 -- 172.21.15.66:0/148607305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40003520 con 0x7f1b40004d40 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b59f7a640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001fa0 tx=0x7f1b40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8236d267b1b9e69 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c001bf0 con 0x7f1b40004d40 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c003b70 con 0x7f1b40004d40 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.732+0000 7f1b47fff640 1 -- 172.21.15.66:0/148607305 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0050d0 con 0x7f1b40004d40 2024-05-10T11:12:51.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/148607305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b40004d40 msgr2=0x7f1b400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/148607305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001fa0 tx=0x7f1b40005830 comp rx=0 tx=0).stop 2024-05-10T11:12:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b59f7a640 1 -- 172.21.15.66:0/148607305 reap_dead start 2024-05-10T11:12:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/148607305 shutdown_connections 2024-05-10T11:12:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/148607305 >> 172.21.15.66:0/148607305 conn(0x7f1b5409ba20 msgr2=0x7f1b5409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/148607305 shutdown_connections 2024-05-10T11:12:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.733+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/148607305 wait complete. 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.734+0000 7f1b5b9dd640 1 Processor -- start 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.734+0000 7f1b5b9dd640 1 -- start start 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b5b9dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b40004d40 0x7f1b541f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b5b9dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 0x7f1b540cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b5b9dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b540cd2d0 0x7f1b540cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b5b9dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b540d1c20 con 0x7f1b540cce50 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b5b9dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1b540d1aa0 con 0x7f1b540cd2d0 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b5b9dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b541f5dd0 con 0x7f1b40004d40 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 0x7f1b540cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 0x7f1b540cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40220/0 (socket says 172.21.15.66:40220) 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 -- 172.21.15.66:0/3299189563 learned_addr learned my addr 172.21.15.66:0/3299189563 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:51.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b59779640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b40004d40 0x7f1b541f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b59f7a640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b540cd2d0 0x7f1b540cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 -- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b40004d40 msgr2=0x7f1b541f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b40004d40 0x7f1b541f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 -- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b540cd2d0 msgr2=0x7f1b540cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b540cd2d0 0x7f1b540cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.735+0000 7f1b58f78640 1 -- 172.21.15.66:0/3299189563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b540c6b10 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.736+0000 7f1b58f78640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 0x7f1b540cf600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007370 tx=0x7f1b48007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.736+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800f9c0 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.736+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b48018070 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.736+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800fde0 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.736+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b540c6df0 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.736+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b540c73b0 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.737+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b540693f0 con 0x7f1b540cce50 2024-05-10T11:12:51.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.737+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b4801d460 con 0x7f1b540cce50 2024-05-10T11:12:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.738+0000 7f1b45ffb640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b38076300 0x7f1b380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.738+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b480979f0 con 0x7f1b540cce50 2024-05-10T11:12:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.738+0000 7f1b59779640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b38076300 0x7f1b380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.739+0000 7f1b59779640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b38076300 0x7f1b380787c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009b00 tx=0x7f1b50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.742+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1b48061010 con 0x7f1b540cce50 2024-05-10T11:12:51.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.977+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b540b5890 con 0x7f1b540cce50 2024-05-10T11:12:51.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.978+0000 7f1b45ffb640 1 -- 172.21.15.66:0/3299189563 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f1b48060910 con 0x7f1b540cce50 2024-05-10T11:12:51.978 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:12:51.978 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:12:51.979 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:12:51.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b38076300 msgr2=0x7f1b380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b38076300 0x7f1b380787c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009b00 tx=0x7f1b50008040 comp rx=0 tx=0).stop 2024-05-10T11:12:51.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 msgr2=0x7f1b540cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:51.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 0x7f1b540cf600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007370 tx=0x7f1b48007830 comp rx=0 tx=0).stop 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 shutdown_connections 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b38076300 0x7f1b380787c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b540cd2d0 0x7f1b540cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b540cce50 0x7f1b540cf600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 --2- 172.21.15.66:0/3299189563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b40004d40 0x7f1b541f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 >> 172.21.15.66:0/3299189563 conn(0x7f1b5409ba20 msgr2=0x7f1b540b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 shutdown_connections 2024-05-10T11:12:51.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:51.980+0000 7f1b5b9dd640 1 -- 172.21.15.66:0/3299189563 wait complete. 2024-05-10T11:12:52.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:12:30.471760+0000', 'modified': '2024-05-10T11:12:43.531893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.190:6836/3761141260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 3761141260}, {'type': 'v1', 'addr': '172.21.15.190:6836', 'nonce': 3761141260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4293, 'qdb_cluster': [4293]} 2024-05-10T11:12:52.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:12:52.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T11:12:52.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.502+0000 7f4e52cbd640 1 Processor -- start 2024-05-10T11:12:52.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.502+0000 7f4e52cbd640 1 -- start start 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e52cbd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4e4c15f8c0 0x7f4e4c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e52cbd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c06e620 0x7f4e4c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e52cbd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c0b0a90 con 0x7f4e4c15f4e0 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e52cbd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c0b23f0 con 0x7f4e4c15f8c0 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e52cbd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c0b4150 con 0x7f4e4c06e620 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e50a59640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4e4c15f4e0 0x7f4e4c06d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41136/0 (socket says 172.21.15.66:41136) 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4e4c15f8c0 0x7f4e4c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e50a59640 1 -- 172.21.15.66:0/2346865144 learned_addr learned my addr 172.21.15.66:0/2346865144 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e5125a640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c06e620 0x7f4e4c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4b7fe640 1 -- 172.21.15.66:0/2346865144 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274626412 0 0) 0x7f4e4c0b0a90 con 0x7f4e4c15f4e0 2024-05-10T11:12:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4b7fe640 1 -- 172.21.15.66:0/2346865144 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e34003520 con 0x7f4e4c15f4e0 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2346865144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c06e620 msgr2=0x7f4e4c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c06e620 0x7f4e4c0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2346865144 >> v1:172.21.15.66:6789/0 conn(0x7f4e4c15f4e0 legacy=0x7f4e4c06d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2346865144 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0b3540 con 0x7f4e4c15f8c0 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.503+0000 7f4e5125a640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c06e620 0x7f4e4c0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.504+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c06e0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e4002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d359775de2ced8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.504+0000 7f4e4b7fe640 1 -- 172.21.15.66:0/2346865144 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40037070 con 0x7f4e4c15f8c0 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.504+0000 7f4e4b7fe640 1 -- 172.21.15.66:0/2346865144 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e4002ae50 con 0x7f4e4c15f8c0 2024-05-10T11:12:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.504+0000 7f4e4b7fe640 1 -- 172.21.15.66:0/2346865144 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40032660 con 0x7f4e4c15f8c0 2024-05-10T11:12:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 -- 172.21.15.66:0/2346865144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c15f8c0 msgr2=0x7f4e4c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c06e0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e4002a100 comp rx=0 tx=0).stop 2024-05-10T11:12:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 -- 172.21.15.66:0/2346865144 shutdown_connections 2024-05-10T11:12:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c06e620 0x7f4e4c0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/2346865144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c06e0e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 -- 172.21.15.66:0/2346865144 >> 172.21.15.66:0/2346865144 conn(0x7f4e4c0d2df0 msgr2=0x7f4e4c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 -- 172.21.15.66:0/2346865144 shutdown_connections 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.505+0000 7f4e52cbd640 1 -- 172.21.15.66:0/2346865144 wait complete. 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.506+0000 7f4e52cbd640 1 Processor -- start 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.506+0000 7f4e52cbd640 1 -- start start 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e52cbd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 0x7f4e4c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e52cbd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15f4e0 0x7f4e4c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e52cbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c0d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e52cbd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0b3de0 con 0x7f4e4c06e620 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e52cbd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0b3b00 con 0x7f4e4c15f8c0 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e52cbd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c0b45e0 con 0x7f4e4c15f4e0 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 0x7f4e4c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 0x7f4e4c0c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40240/0 (socket says 172.21.15.66:40240) 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 -- 172.21.15.66:0/4276017467 learned_addr learned my addr 172.21.15.66:0/4276017467 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15f4e0 0x7f4e4c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e5125a640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c0d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 -- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15f4e0 msgr2=0x7f4e4c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15f4e0 0x7f4e4c15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 -- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15f8c0 msgr2=0x7f4e4c0d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c0d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.507+0000 7f4e50a59640 1 -- 172.21.15.66:0/4276017467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c15c2a0 con 0x7f4e4c06e620 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.508+0000 7f4e50a59640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 0x7f4e4c0c7fd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c460 tx=0x7f4e3c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.508+0000 7f4e497fa640 1 -- 172.21.15.66:0/4276017467 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c017070 con 0x7f4e4c06e620 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.508+0000 7f4e497fa640 1 -- 172.21.15.66:0/4276017467 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c005ce0 con 0x7f4e4c06e620 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.508+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c15c580 con 0x7f4e4c06e620 2024-05-10T11:12:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.508+0000 7f4e497fa640 1 -- 172.21.15.66:0/4276017467 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0072f0 con 0x7f4e4c06e620 2024-05-10T11:12:52.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.508+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c15cb40 con 0x7f4e4c06e620 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.509+0000 7f4e497fa640 1 -- 172.21.15.66:0/4276017467 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e3c01a070 con 0x7f4e4c06e620 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.510+0000 7f4e497fa640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e380762d0 0x7f4e38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.510+0000 7f4e497fa640 1 -- 172.21.15.66:0/4276017467 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e3c096d20 con 0x7f4e4c06e620 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.510+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e380762d0 0x7f4e38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.511+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e380762d0 0x7f4e38078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e40034000 tx=0x7f4e4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.511+0000 7f4e559d5740 1 Processor -- start 2024-05-10T11:12:52.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.511+0000 7f4e559d5740 1 -- start start 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.511+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e604f50 0x55770e607760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.511+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e607ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e5d7bb0 0x55770e5db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e559d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55770e5418d0 con 0x55770e605330 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55770e4fac10 con 0x55770e5d7bb0 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55770e53d890 con 0x55770e604f50 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e607ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e607ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40244/0 (socket says 172.21.15.66:40244) 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2673364977 learned_addr learned my addr 172.21.15.66:0/2673364977 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e50a59640 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e604f50 0x55770e607760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e5125a640 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e5d7bb0 0x55770e5db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e604f50 msgr2=0x55770e607760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e604f50 0x55770e607760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e5d7bb0 msgr2=0x55770e5db3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e5d7bb0 0x55770e5db3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 -- 172.21.15.66:0/2673364977 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55770e5025d0 con 0x55770e605330 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e5125a640 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e5d7bb0 0x55770e5db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e607ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e4002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae64294baa1ebba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e327fc640 1 -- 172.21.15.66:0/2673364977 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4004d070 con 0x55770e605330 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e327fc640 1 -- 172.21.15.66:0/2673364977 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e40032cf0 con 0x55770e605330 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.512+0000 7f4e327fc640 1 -- 172.21.15.66:0/2673364977 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40037040 con 0x55770e605330 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 -- 172.21.15.66:0/2673364977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 msgr2=0x55770e607ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e607ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e4002c000 comp rx=0 tx=0).stop 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 -- 172.21.15.66:0/2673364977 shutdown_connections 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e5d7bb0 0x55770e5db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e607ca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 --2- 172.21.15.66:0/2673364977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e604f50 0x55770e607760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 -- 172.21.15.66:0/2673364977 >> 172.21.15.66:0/2673364977 conn(0x55770e5d9e20 msgr2=0x55770e622760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:52.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 -- 172.21.15.66:0/2673364977 shutdown_connections 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 -- 172.21.15.66:0/2673364977 wait complete. 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.513+0000 7f4e559d5740 1 -- start start 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 Processor -- start 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e60ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e623890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e623dd0 0x55770e608c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55770e5dcfd0 con 0x55770e605330 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55770e4fe760 con 0x55770e604f50 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.514+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55770e5dd2b0 con 0x55770e623dd0 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e559d5740 10 client.0 _ll_register_callbacks cb 0x55770e537cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e623890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e50a59640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e60ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e623890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40260/0 (socket says 172.21.15.66:40260) 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e50a59640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e60ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:44258/0 (socket says 172.21.15.66:44258) 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e5125a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e623dd0 0x55770e608c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 -- 172.21.15.66:0/1077532871 learned_addr learned my addr 172.21.15.66:0/1077532871 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 -- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e623dd0 msgr2=0x55770e608c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e623dd0 0x55770e608c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 -- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 msgr2=0x55770e60ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e60ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 -- 172.21.15.66:0/1077532871 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55770e2532d0 con 0x55770e605330 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e623890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7cfe74c85a8c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1077532871 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40058060 con 0x55770e605330 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1077532871 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e40048c70 con 0x55770e605330 2024-05-10T11:12:52.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e40032cf0 con 0x55770e605330 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1077532871 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4e4005e050 con 0x55770e605330 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e559d5740 10 client.4710 fetch_fsmap learned FSMap version 8 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55770e31d6b0 con 0x55770e605330 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.515+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1077532871 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e40032cf0 con 0x55770e605330 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1077532871 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f4e40061020 con 0x55770e605330 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e559d5740 10 client.4710 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e559d5740 10 client.4710 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e559d5740 20 client.4710 populate_metadata read hostname 'smithi066' 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e624ed0 0x55770e6023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e559d5740 4 client.4710 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 --> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55770e4c5760 con 0x55770e624ed0 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e624ed0 0x55770e6023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e624ed0 0x55770e6023a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9869bd54aa75a174 server_cookie=efe8e4dd867348c0 in_seq=0 out_seq=0 2024-05-10T11:12:52.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.516+0000 7f4e2b7fe640 10 client.4710 ms_handle_connect on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1077532871 <== mds.0 v2:172.21.15.190:6834/3761141260 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55770e4c5760 con 0x55770e624ed0 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e2b7fe640 10 client.4710 handle_command_reply: tid=0 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 client.4710 shutdown 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 msgr2=0x55770e623890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e623890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e40004730 comp rx=0 tx=0).stop 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 shutdown_connections 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e624ed0 0x55770e6023a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e623dd0 0x55770e608c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e623890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1077532871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e60ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 >> 172.21.15.66:0/1077532871 conn(0x55770e5d7bb0 msgr2=0x55770e607720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.517+0000 7f4e2b7fe640 0 client.4710 ms_handle_reset on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.518+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 shutdown_connections 2024-05-10T11:12:52.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.518+0000 7f4e559d5740 1 -- 172.21.15.66:0/1077532871 wait complete. 2024-05-10T11:12:52.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.518+0000 7f4e559d5740 20 client.4710 trim_cache size 0 max 16384 2024-05-10T11:12:52.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.536+0000 7f4e559d5740 1 Processor -- start 2024-05-10T11:12:52.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.536+0000 7f4e559d5740 1 -- start start 2024-05-10T11:12:52.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 0x55770e627700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e605330 0x55770e5dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e60b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e559d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c201ad0 con 0x55770e604f50 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c153a80 con 0x55770e605330 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c201480 con 0x55770e5dde70 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 0x55770e627700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 0x55770e627700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40266/0 (socket says 172.21.15.66:40266) 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 -- 172.21.15.66:0/1265339604 learned_addr learned my addr 172.21.15.66:0/1265339604 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e605330 0x55770e5dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e5125a640 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e60b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 -- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 msgr2=0x55770e60b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e60b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 -- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e605330 msgr2=0x55770e5dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.537+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e605330 0x55770e5dd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e50a59640 1 -- 172.21.15.66:0/1265339604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55770e623c00 con 0x55770e604f50 2024-05-10T11:12:52.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e605330 0x55770e5dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 0x55770e627700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c094fa0 tx=0x7f4e3c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4b9503a51b8574 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e31ffb640 1 -- 172.21.15.66:0/1265339604 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c078040 con 0x55770e604f50 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e31ffb640 1 -- 172.21.15.66:0/1265339604 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c064080 con 0x55770e604f50 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e31ffb640 1 -- 172.21.15.66:0/1265339604 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c068aa0 con 0x55770e604f50 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 -- 172.21.15.66:0/1265339604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 msgr2=0x55770e627700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 0x55770e627700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c094fa0 tx=0x7f4e3c005f90 comp rx=0 tx=0).stop 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 -- 172.21.15.66:0/1265339604 shutdown_connections 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e60b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e605330 0x55770e5dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1265339604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e604f50 0x55770e627700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 -- 172.21.15.66:0/1265339604 >> 172.21.15.66:0/1265339604 conn(0x55770e5d7bb0 msgr2=0x55770e609520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 -- 172.21.15.66:0/1265339604 shutdown_connections 2024-05-10T11:12:52.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.538+0000 7f4e559d5740 1 -- 172.21.15.66:0/1265339604 wait complete. 2024-05-10T11:12:52.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.539+0000 7f4e559d5740 1 -- start start 2024-05-10T11:12:52.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.539+0000 7f4e559d5740 1 Processor -- start 2024-05-10T11:12:52.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e6a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e5fd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e5d72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55770e5feb20 con 0x55770e605330 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55770e60a8d0 con 0x55770e604f50 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55770e636890 con 0x55770e5dde70 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e559d5740 10 client.0 _ll_register_callbacks cb 0x7f4e4004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e5d72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e5d72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40276/0 (socket says 172.21.15.66:40276) 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 -- 172.21.15.66:0/1311044212 learned_addr learned my addr 172.21.15.66:0/1311044212 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e6a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e4bfff640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e5fd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 -- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 msgr2=0x55770e6a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e6a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 -- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 msgr2=0x55770e5fd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e5fd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 -- 172.21.15.66:0/1311044212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55770e6a0a30 con 0x55770e605330 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e5125a640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e5d72e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009800 tx=0x7f4e44009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587e727a49232848 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.540+0000 7f4e2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1311044212 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4401c070 con 0x55770e605330 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1311044212 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e44016a50 con 0x55770e605330 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e3c064080 con 0x55770e605330 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1311044212 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4e44029050 con 0x55770e605330 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 10 client.4716 fetch_fsmap learned FSMap version 8 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55770e5fddc0 con 0x55770e605330 2024-05-10T11:12:52.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1311044212 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c064080 con 0x55770e605330 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1311044212 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f4e4402c020 con 0x55770e605330 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 10 client.4716 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 10 client.4716 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 20 client.4716 populate_metadata read hostname 'smithi066' 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e622e00 0x55770e63cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 4 client.4716 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 --> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] -- command(tid 0: {"prefix": "status"}) -- 0x55770e54f4e0 con 0x55770e622e00 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.541+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e622e00 0x55770e63cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e2b7fe640 10 client.4716 ms_handle_connect on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e50a59640 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e622e00 0x55770e63cb70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c636902137b0e2f server_cookie=9be770547f64217 in_seq=0 out_seq=0 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e2b7fe640 1 -- 172.21.15.66:0/1311044212 <== mds.0 v2:172.21.15.190:6834/3761141260 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55770e54f4e0 con 0x55770e622e00 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e2b7fe640 10 client.4716 handle_command_reply: tid=0 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 client.4716 shutdown 2024-05-10T11:12:52.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 msgr2=0x55770e5d72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e5d72e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009800 tx=0x7f4e44009cc0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 shutdown_connections 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:6834/3761141260,v1:172.21.15.190:6836/3761141260] conn(0x55770e622e00 0x55770e63cb70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55770e605330 0x55770e5d72e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55770e604f50 0x55770e5fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e2b7fe640 0 client.4716 ms_handle_reset on v2:172.21.15.190:6834/3761141260 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 --2- 172.21.15.66:0/1311044212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55770e5dde70 0x55770e6a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 >> 172.21.15.66:0/1311044212 conn(0x55770e5d7bb0 msgr2=0x55770e60ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 shutdown_connections 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 1 -- 172.21.15.66:0/1311044212 wait complete. 2024-05-10T11:12:52.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.542+0000 7f4e559d5740 20 client.4716 trim_cache size 0 max 16384 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4293, 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 21.455935784000001, 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 8, 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 25, 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 25, 2024-05-10T11:12:52.550 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 27.469709592000001 2024-05-10T11:12:52.551 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:12:52.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e380762d0 msgr2=0x7f4e38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e380762d0 0x7f4e38078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e40034000 tx=0x7f4e4002e000 comp rx=0 tx=0).stop 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 msgr2=0x7f4e4c0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 0x7f4e4c0c7fd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c460 tx=0x7f4e3c00c920 comp rx=0 tx=0).stop 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 shutdown_connections 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e380762d0 0x7f4e38078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15f8c0 0x7f4e4c0d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15f4e0 0x7f4e4c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 --2- 172.21.15.66:0/4276017467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e4c06e620 0x7f4e4c0c7fd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 >> 172.21.15.66:0/4276017467 conn(0x7f4e4c0d2df0 msgr2=0x7f4e4c06ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 shutdown_connections 2024-05-10T11:12:52.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:52.543+0000 7f4e52cbd640 1 -- 172.21.15.66:0/4276017467 wait complete. 2024-05-10T11:12:52.554 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T11:12:52.564 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T11:12:52.564 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T11:12:52.564 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T11:12:52.564 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T11:12:52.583 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T11:12:52.583 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-10T11:12:52.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.583 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:12:52.600 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-10T11:12:52.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T11:12:52.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.666 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-05-10T11:12:52.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.763 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:12:52.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-05-10T11:12:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2024-05-10T11:12:52.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:12:52.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.851 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-05-10T11:12:52.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.870 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2024-05-10T11:12:52.941 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2024-05-10T11:12:52.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:12:52.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:52.943 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-05-10T11:12:53.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:53.001 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2024-05-10T11:12:53.069 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2024-05-10T11:12:53.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:12:53.071 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-10T11:12:53.071 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T11:12:53.071 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:12:53.071 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:12:53.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.175+0000 7f757e0f8640 1 Processor -- start 2024-05-10T11:12:53.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.175+0000 7f757e0f8640 1 -- start start 2024-05-10T11:12:53.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f757e0f8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f75781598c0 0x7f757806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:53.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f757e0f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75780c7390 0x7f75780cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:53.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f757e0f8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757806f1c0 con 0x7f757806ec40 2024-05-10T11:12:53.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f757e0f8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f757806f4a0 con 0x7f75781598c0 2024-05-10T11:12:53.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f757e0f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f757806f780 con 0x7f75780c7390 2024-05-10T11:12:53.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f75777fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f75781598c0 0x7f757806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f7576ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f757806ec40 0x7f75780c6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:41152/0 (socket says 172.21.15.66:41152) 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f7576ffd640 1 -- 172.21.15.66:0/3076856937 learned_addr learned my addr 172.21.15.66:0/3076856937 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.176+0000 7f7577fff640 1 --2- 172.21.15.66:0/3076856937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75780c7390 0x7f75780cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75777fe640 1 -- 172.21.15.66:0/3076856937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75780c7390 msgr2=0x7f75780cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75777fe640 1 --2- 172.21.15.66:0/3076856937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75780c7390 0x7f75780cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75777fe640 1 -- 172.21.15.66:0/3076856937 >> v1:172.21.15.66:6789/0 conn(0x7f757806ec40 legacy=0x7f75780c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75777fe640 1 -- 172.21.15.66:0/3076856937 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757806fa60 con 0x7f75781598c0 2024-05-10T11:12:53.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75767fc640 1 -- 172.21.15.66:0/3076856937 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426055042 0 0) 0x7f757806f1c0 con 0x7f757806ec40 2024-05-10T11:12:53.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75777fe640 1 --2- 172.21.15.66:0/3076856937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75781598c0 0x7f757806e700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75680097a0 tx=0x7f756802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4390719cf1e57a49 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75767fc640 1 -- 172.21.15.66:0/3076856937 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568037070 con 0x7f75781598c0 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75767fc640 1 -- 172.21.15.66:0/3076856937 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7568032440 con 0x7f75781598c0 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.177+0000 7f75767fc640 1 -- 172.21.15.66:0/3076856937 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568032810 con 0x7f75781598c0 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 -- 172.21.15.66:0/3076856937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75781598c0 msgr2=0x7f757806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 --2- 172.21.15.66:0/3076856937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75781598c0 0x7f757806e700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75680097a0 tx=0x7f756802a180 comp rx=0 tx=0).stop 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 -- 172.21.15.66:0/3076856937 shutdown_connections 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 --2- 172.21.15.66:0/3076856937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75780c7390 0x7f75780cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 --2- 172.21.15.66:0/3076856937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75781598c0 0x7f757806e700 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 -- 172.21.15.66:0/3076856937 >> 172.21.15.66:0/3076856937 conn(0x7f75780b2900 msgr2=0x7f75780b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 -- 172.21.15.66:0/3076856937 shutdown_connections 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.178+0000 7f757e0f8640 1 -- 172.21.15.66:0/3076856937 wait complete. 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.179+0000 7f757e0f8640 1 Processor -- start 2024-05-10T11:12:53.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.179+0000 7f757e0f8640 1 -- start start 2024-05-10T11:12:53.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f757e0f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f757806ec40 0x7f7578156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:53.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f757e0f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 0x7f75780c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:53.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f757e0f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75781598c0 0x7f7578072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f757e0f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7578159ca0 con 0x7f75780c7390 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f757e0f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f757815c6e0 con 0x7f75781598c0 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f757e0f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7578159e20 con 0x7f757806ec40 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f7576ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 0x7f75780c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f7576ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 0x7f75780c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40282/0 (socket says 172.21.15.66:40282) 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f7576ffd640 1 -- 172.21.15.66:0/445574433 learned_addr learned my addr 172.21.15.66:0/445574433 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f75777fe640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f757806ec40 0x7f7578156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.180+0000 7f7577fff640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75781598c0 0x7f7578072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7576ffd640 1 -- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f757806ec40 msgr2=0x7f7578156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7576ffd640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f757806ec40 0x7f7578156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7576ffd640 1 -- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75781598c0 msgr2=0x7f7578072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7576ffd640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75781598c0 0x7f7578072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7576ffd640 1 -- 172.21.15.66:0/445574433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7578156dd0 con 0x7f75780c7390 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7577fff640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75781598c0 0x7f7578072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f7576ffd640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 0x7f75780c8240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c4d0 tx=0x7f756c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c0072e0 con 0x7f75780c7390 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756c016020 con 0x7f75780c7390 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75780ae5c0 con 0x7f75780c7390 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c0047e0 con 0x7f75780c7390 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.181+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75780aeb80 con 0x7f75780c7390 2024-05-10T11:12:53.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.182+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757806a220 con 0x7f75780c7390 2024-05-10T11:12:53.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.183+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f756c004980 con 0x7f75780c7390 2024-05-10T11:12:53.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.183+0000 7f755ffff640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75640762d0 0x7f7564078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:53.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.183+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f756c0997d0 con 0x7f75780c7390 2024-05-10T11:12:53.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.183+0000 7f75777fe640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75640762d0 0x7f7564078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:53.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.184+0000 7f75777fe640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75640762d0 0x7f7564078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7568034000 tx=0x7f756802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:53.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.188+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f756c020020 con 0x7f75780c7390 2024-05-10T11:12:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.422+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f757806e4e0 con 0x7f75780c7390 2024-05-10T11:12:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.423+0000 7f755ffff640 1 -- 172.21.15.66:0/445574433 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f7578156dd0 con 0x7f75780c7390 2024-05-10T11:12:53.423 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75640762d0 msgr2=0x7f7564078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75640762d0 0x7f7564078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7568034000 tx=0x7f756802e000 comp rx=0 tx=0).stop 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 msgr2=0x7f75780c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 0x7f75780c8240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c4d0 tx=0x7f756c00c990 comp rx=0 tx=0).stop 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 shutdown_connections 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75640762d0 0x7f7564078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75781598c0 0x7f7578072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75780c7390 0x7f75780c8240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 --2- 172.21.15.66:0/445574433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f757806ec40 0x7f7578156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 >> 172.21.15.66:0/445574433 conn(0x7f75780b2900 msgr2=0x7f75780b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 shutdown_connections 2024-05-10T11:12:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53.425+0000 7f757e0f8640 1 -- 172.21.15.66:0/445574433 wait complete. 2024-05-10T11:12:53.436 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T11:12:53.436 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:12:53.437 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:12:53.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:53.437 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:12:53.453 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:53.454 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42720sec preferred_lft 42720sec 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:12:53.455 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:53.455 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T11:12:53.455 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2024-05-10T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2024-05-10T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2024-05-10T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:53.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:53.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:53.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:53.596 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:12:53.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:53.623 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:12:53.680 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:12:53.681 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:12:53.681 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:12:53.681 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:12:53.681 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:12:53.681 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:53.681 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:53.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:12:53.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:12:53.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:12:53.682 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:53.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:53.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:53.812 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:12:53.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:53.828 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-05-10T11:12:53.884 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:53.884 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:53.884 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:12:53.884 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T11:12:53.884 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:53.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.003 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T11:12:54.003 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:54.003 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:54.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T11:12:54.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T11:12:54.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T11:12:54.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T11:12:54.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T11:12:54.004 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:54.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:54.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.122 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:54.122 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:54.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:12:54.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T11:12:54.122 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:54.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:54.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:12:54.219 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:12:54.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:54.219 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:12:54.275 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:12:54.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:54.275 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:12:54.360 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:12:54.360 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:12:54.360 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:12:54.472 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:12:54.472 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:12:54.472 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:12:54.472 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:54.472 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:54.480 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:12:54.480 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:12:54.480 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:12:54.480 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:54.480 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:54.480 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:12:54.481 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:12:54.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:12:54.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:54.483 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:12:54.509 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:54.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:54.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.607 INFO:teuthology.orchestra.run.smithi066.stdout:client4728 2024-05-10T11:12:54.608 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:54.608 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:12:54.624 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:54.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:54.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.723 INFO:teuthology.orchestra.run.smithi066.stdout:client4728 2024-05-10T11:12:54.723 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:54.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:54.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.781 INFO:teuthology.orchestra.run.smithi066.stdout:client4728 2024-05-10T11:12:54.781 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/62c58463-bf48-494c-be0a-3a4b427ce317.client4728/status') 2024-05-10T11:12:54.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:54.841 INFO:teuthology.orchestra.run.smithi066.stdout:instance: client.4728 (3)192.168.0.1:0/326601178 2024-05-10T11:12:54.841 INFO:teuthology.orchestra.run.smithi066.stdout:blocklisted: false 2024-05-10T11:12:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2024-05-10T11:12:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2024-05-10T11:12:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:68 bytes copied, 2.7231e-05 s, 2.5 MB/s 2024-05-10T11:12:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:54.849 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-10T11:12:54.849 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T11:12:54.849 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T11:12:54.849 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:12:54.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.952+0000 7f6c91959640 1 Processor -- start 2024-05-10T11:12:54.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.952+0000 7f6c91959640 1 -- start start 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c91959640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 0x7f6c8c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c91959640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0d2d20 con 0x7f6c8c0d3d80 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c91959640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0d3000 con 0x7f6c8c162940 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c91959640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c162d20 con 0x7f6c8c0d59d0 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c8a7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6c8c0d3d80 0x7f6c8c0d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35946/0 (socket says 172.21.15.66:35946) 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c8a7fc640 1 -- 172.21.15.66:0/1636045471 learned_addr learned my addr 172.21.15.66:0/1636045471 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.953+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 0x7f6c8c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641635626 0 0) 0x7f6c8c0d2d20 con 0x7f6c8c0d3d80 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c74003520 con 0x7f6c8c0d3d80 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2374746784 0 0) 0x7f6c74003520 con 0x7f6c8c0d3d80 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 msgr2=0x7f6c8c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 0x7f6c8c0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 >> v1:172.21.15.190:6789/0 conn(0x7f6c8c162940 legacy=0x7f6c8c0d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0d32e0 con 0x7f6c8c0d3d80 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f6c80001670 con 0x7f6c8c0d3d80 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 >> v1:172.21.15.66:6789/0 conn(0x7f6c8c0d3d80 legacy=0x7f6c8c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c740039e0 0x7f6c74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 0x7f6c74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74004d40 0x7f6c740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7400baf0 con 0x7f6c74004d40 2024-05-10T11:12:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7400bca0 con 0x7f6c740039e0 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7400bea0 con 0x7f6c8c0d59d0 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74004d40 0x7f6c740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8affd640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c740039e0 0x7f6c74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8a7fc640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 0x7f6c74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 msgr2=0x7f6c74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c8c0d59d0 0x7f6c74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c740039e0 msgr2=0x7f6c74003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c740039e0 0x7f6c74003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.954+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1636045471 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c74003520 con 0x7f6c74004d40 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.955+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74004d40 0x7f6c740051c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009ac0 tx=0x7f6c74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851aa79a9d7ad63c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.955+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84036070 con 0x7f6c74004d40 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.955+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c84031400 con 0x7f6c74004d40 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.955+0000 7f6c89ffb640 1 -- 172.21.15.66:0/1636045471 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84009690 con 0x7f6c74004d40 2024-05-10T11:12:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c91959640 1 -- 172.21.15.66:0/1636045471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74004d40 msgr2=0x7f6c740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c91959640 1 --2- 172.21.15.66:0/1636045471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74004d40 0x7f6c740051c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009ac0 tx=0x7f6c74005830 comp rx=0 tx=0).stop 2024-05-10T11:12:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1636045471 reap_dead start 2024-05-10T11:12:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c91959640 1 -- 172.21.15.66:0/1636045471 shutdown_connections 2024-05-10T11:12:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c91959640 1 -- 172.21.15.66:0/1636045471 >> 172.21.15.66:0/1636045471 conn(0x7f6c8c09e380 msgr2=0x7f6c8c0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c91959640 1 -- 172.21.15.66:0/1636045471 shutdown_connections 2024-05-10T11:12:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.956+0000 7f6c91959640 1 -- 172.21.15.66:0/1636045471 wait complete. 2024-05-10T11:12:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.957+0000 7f6c91959640 1 Processor -- start 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.957+0000 7f6c91959640 1 -- start start 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c91959640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c74004d40 0x7f6c8c1535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c91959640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c8c0cea50 0x7f6c8c0b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c91959640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 0x7f6c8c0ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c91959640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d2390 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c91959640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0cfc50 con 0x7f6c8c0cea50 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c91959640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d2510 con 0x7f6c74004d40 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 0x7f6c8c0ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 0x7f6c8c0ba2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46274/0 (socket says 172.21.15.66:46274) 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1436146418 learned_addr learned my addr 172.21.15.66:0/1436146418 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8a7fc640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c8c0cea50 0x7f6c8c0b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8affd640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c74004d40 0x7f6c8c1535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c74004d40 msgr2=0x7f6c8c1535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c74004d40 0x7f6c8c1535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c8c0cea50 msgr2=0x7f6c8c0b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c8c0cea50 0x7f6c8c0b9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.958+0000 7f6c8b7fe640 1 -- 172.21.15.66:0/1436146418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c153ae0 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.959+0000 7f6c8b7fe640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 0x7f6c8c0ba2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009be0 tx=0x7f6c84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.959+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84036040 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.959+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c84041070 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.959+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c0cf2a0 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.959+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84009690 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.959+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c0b8050 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.960+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c06a220 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.960+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c84039070 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.961+0000 7f6c73fff640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c780762d0 0x7f6c78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:54.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.961+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c840b7470 con 0x7f6c8c0b9e70 2024-05-10T11:12:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.961+0000 7f6c8affd640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c780762d0 0x7f6c78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.962+0000 7f6c8affd640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c780762d0 0x7f6c78078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c001ee0 tx=0x7f6c7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:54.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:54.965+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6c8404b020 con 0x7f6c8c0b9e70 2024-05-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.201+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6c8c0cbf40 con 0x7f6c8c0b9e70 2024-05-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.201+0000 7f6c73fff640 1 -- 172.21.15.66:0/1436146418 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f6c8c153ae0 con 0x7f6c8c0b9e70 2024-05-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c780762d0 msgr2=0x7f6c78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c780762d0 0x7f6c78078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c001ee0 tx=0x7f6c7c009040 comp rx=0 tx=0).stop 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 msgr2=0x7f6c8c0ba2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 0x7f6c8c0ba2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009be0 tx=0x7f6c84004730 comp rx=0 tx=0).stop 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 shutdown_connections 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c780762d0 0x7f6c78078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c8c0b9e70 0x7f6c8c0ba2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c8c0cea50 0x7f6c8c0b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 --2- 172.21.15.66:0/1436146418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c74004d40 0x7f6c8c1535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 >> 172.21.15.66:0/1436146418 conn(0x7f6c8c09e380 msgr2=0x7f6c8c162d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 shutdown_connections 2024-05-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55.203+0000 7f6c91959640 1 -- 172.21.15.66:0/1436146418 wait complete. 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:12:55.215 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-10T11:12:55.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.216 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42718sec preferred_lft 42718sec 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:55.233 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link tentative 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link tentative 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.234 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:12:55.296 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:12:55.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.298 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:12:55.355 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:12:55.355 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:12:55.355 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:12:55.355 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:12:55.355 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:12:55.355 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:55.355 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:55.355 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:12:55.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:12:55.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:12:55.356 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:55.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.486 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:12:55.501 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:12:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.502 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-05-10T11:12:55.558 INFO:teuthology.orchestra.run.smithi066.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-10T11:12:55.558 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:55.558 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:55.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:12:55.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-10T11:12:55.558 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:55.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:55.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:55.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.678 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T11:12:55.704 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:55.704 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:55.704 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:55.704 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.704 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:55.704 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.705 INFO:teuthology.orchestra.run.smithi066.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:12:55.705 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 9e:da:fa:2a:1f:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T11:12:55.705 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T11:12:55.705 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.705 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::9cda:faff:fe2a:1f14/64 scope link 2024-05-10T11:12:55.705 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:55.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T11:12:55.771 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 9e:da:fa:2a:1f:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::9cda:faff:fe2a:1f14/64 scope link 2024-05-10T11:12:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:55.773 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-10T11:12:55.774 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:55.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:55.930 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:55.931 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:12:55.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.1 up 2024-05-10T11:12:55.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T11:12:55.931 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:12:55.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:56.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:56.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:56.010 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-10T11:12:56.026 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-10T11:12:56.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:56.026 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-10T11:12:56.082 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:12:56.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:56.082 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T11:12:56.167 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T11:12:56.167 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T11:12:56.167 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:12:56.176 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T11:12:56.176 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T11:12:56.176 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:12:56.176 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:56.176 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:12:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:12:56.184 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-10T11:12:56.184 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:12:56.185 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:12:56.185 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:12:56.185 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:12:56.185 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:12:56.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:56.185 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-10T11:12:56.216 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:56.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:56.315 INFO:teuthology.orchestra.run.smithi066.stdout:client4532 2024-05-10T11:12:56.315 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:12:56.315 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:12:56.332 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:56.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:56.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:56.430 INFO:teuthology.orchestra.run.smithi066.stdout:client4532 2024-05-10T11:12:56.430 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:56.488 INFO:teuthology.orchestra.run.smithi066.stdout:client4532 2024-05-10T11:12:56.488 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/62c58463-bf48-494c-be0a-3a4b427ce317.client4532/status') 2024-05-10T11:12:56.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:56.548 INFO:teuthology.orchestra.run.smithi066.stdout:instance: client.4532 (3)172.21.15.66:0/3422766549 2024-05-10T11:12:56.548 INFO:teuthology.orchestra.run.smithi066.stdout:blocklisted: false 2024-05-10T11:12:56.549 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2024-05-10T11:12:56.549 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2024-05-10T11:12:56.549 INFO:teuthology.orchestra.run.smithi066.stderr:70 bytes copied, 2.8856e-05 s, 2.4 MB/s 2024-05-10T11:12:56.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:56.556 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-10T11:12:56.556 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T11:12:56.556 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T11:12:56.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:12:56.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.659+0000 7effae1f7640 1 Processor -- start 2024-05-10T11:12:56.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.659+0000 7effae1f7640 1 -- start start 2024-05-10T11:12:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effae1f7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7effa8162940 0x7effa80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effae1f7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7effa80d3d80 0x7effa80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effae1f7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa80d2d20 con 0x7effa80d59d0 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effae1f7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7effa8162d20 con 0x7effa80d3d80 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effae1f7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7effa80d3000 con 0x7effa8162940 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7effa80d3d80 0x7effa80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7eff9ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7effa80d59d0 0x7effa80d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35952/0 (socket says 172.21.15.66:35952) 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7effa80d3d80 0x7effa80d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46284/0 (socket says 172.21.15.66:46284) 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7eff9ffff640 1 -- 172.21.15.66:0/2554567182 learned_addr learned my addr 172.21.15.66:0/2554567182 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa77fe640 1 --2- 172.21.15.66:0/2554567182 >> v2:172.21.15.190:3300/0 conn(0x7effa8162940 0x7effa80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa7fff640 1 -- 172.21.15.66:0/2554567182 >> v2:172.21.15.190:3300/0 conn(0x7effa8162940 msgr2=0x7effa80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa7fff640 1 --2- 172.21.15.66:0/2554567182 >> v2:172.21.15.190:3300/0 conn(0x7effa8162940 0x7effa80b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa7fff640 1 -- 172.21.15.66:0/2554567182 >> v1:172.21.15.66:6789/0 conn(0x7effa80d59d0 legacy=0x7effa80d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa7fff640 1 -- 172.21.15.66:0/2554567182 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa80d32e0 con 0x7effa80d3d80 2024-05-10T11:12:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.660+0000 7effa6ffd640 1 -- 172.21.15.66:0/2554567182 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208614710 0 0) 0x7effa80d2d20 con 0x7effa80d59d0 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.661+0000 7effa7fff640 1 --2- 172.21.15.66:0/2554567182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa80d3d80 0x7effa80d01e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7effa808d970 tx=0x7effa002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363fe7c8e215960c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.661+0000 7effa6ffd640 1 -- 172.21.15.66:0/2554567182 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0007740 con 0x7effa80d3d80 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.661+0000 7effa6ffd640 1 -- 172.21.15.66:0/2554567182 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00078e0 con 0x7effa80d3d80 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.661+0000 7effa6ffd640 1 -- 172.21.15.66:0/2554567182 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0007cb0 con 0x7effa80d3d80 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 -- 172.21.15.66:0/2554567182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa80d3d80 msgr2=0x7effa80d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 --2- 172.21.15.66:0/2554567182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa80d3d80 0x7effa80d01e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7effa808d970 tx=0x7effa002a5f0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 -- 172.21.15.66:0/2554567182 shutdown_connections 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 --2- 172.21.15.66:0/2554567182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa80d3d80 0x7effa80d01e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 --2- 172.21.15.66:0/2554567182 >> v2:172.21.15.190:3300/0 conn(0x7effa8162940 0x7effa80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 -- 172.21.15.66:0/2554567182 >> 172.21.15.66:0/2554567182 conn(0x7effa809e380 msgr2=0x7effa80d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 -- 172.21.15.66:0/2554567182 shutdown_connections 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.662+0000 7effae1f7640 1 -- 172.21.15.66:0/2554567182 wait complete. 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.663+0000 7effae1f7640 1 Processor -- start 2024-05-10T11:12:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.663+0000 7effae1f7640 1 -- start start 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effae1f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d3d80 0x7effa8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effae1f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d59d0 0x7effa80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effae1f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 0x7effa80b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effae1f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7effa80d2390 con 0x7effa8162940 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effae1f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7effa80cfc50 con 0x7effa80d59d0 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effae1f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7effa80d2510 con 0x7effa80d3d80 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 0x7effa80b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 0x7effa80b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46288/0 (socket says 172.21.15.66:46288) 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 -- 172.21.15.66:0/718828989 learned_addr learned my addr 172.21.15.66:0/718828989 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7eff9ffff640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d59d0 0x7effa80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa77fe640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d3d80 0x7effa8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 -- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d3d80 msgr2=0x7effa8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d3d80 0x7effa8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 -- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d59d0 msgr2=0x7effa80ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d59d0 0x7effa80ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 -- 172.21.15.66:0/718828989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa80b9d50 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa77fe640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d3d80 0x7effa8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.664+0000 7effa7fff640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 0x7effa80b5a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7effa0009e50 tx=0x7effa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.665+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa003f070 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.665+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa0031bf0 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.665+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0044460 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.665+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa80b9ff0 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.665+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa80ba5b0 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.666+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa806a220 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.666+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7effa003b410 con 0x7effa8162940 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.667+0000 7effa4ff9640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7eff88076300 0x7eff880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.667+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7effa00b9170 con 0x7effa8162940 2024-05-10T11:12:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.667+0000 7effa77fe640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7eff88076300 0x7eff880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.667+0000 7effa77fe640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7eff88076300 0x7eff880787c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff98006fd0 tx=0x7eff98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.671+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7effa0082700 con 0x7effa8162940 2024-05-10T11:12:56.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.901+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7effa80d2730 con 0x7effa8162940 2024-05-10T11:12:56.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.902+0000 7effa4ff9640 1 -- 172.21.15.66:0/718828989 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7effa0082000 con 0x7effa8162940 2024-05-10T11:12:56.902 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T11:12:56.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7eff88076300 msgr2=0x7eff880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7eff88076300 0x7eff880787c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff98006fd0 tx=0x7eff98008040 comp rx=0 tx=0).stop 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 msgr2=0x7effa80b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 0x7effa80b5a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7effa0009e50 tx=0x7effa0004a40 comp rx=0 tx=0).stop 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 shutdown_connections 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7eff88076300 0x7eff880787c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effa8162940 0x7effa80b5a80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d59d0 0x7effa80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 --2- 172.21.15.66:0/718828989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d3d80 0x7effa8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 >> 172.21.15.66:0/718828989 conn(0x7effa809e380 msgr2=0x7effa815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 shutdown_connections 2024-05-10T11:12:56.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:56.904+0000 7effae1f7640 1 -- 172.21.15.66:0/718828989 wait complete. 2024-05-10T11:12:56.915 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T11:12:56.915 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:12:56.916 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-10T11:12:56.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:56.916 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:56.936 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-05-10T11:12:56.937 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2024-05-10T11:12:56.938 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:56.938 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add name ceph-brx type bridge 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr flush dev ceph-brx 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set ceph-brx up 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T11:12:56.938 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:57.034 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:57.170 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:57.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:57.177 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:12:57.202 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-05-10T11:12:57.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:57.204 DEBUG:teuthology.orchestra.run.smithi190:> route 2024-05-10T11:12:57.314 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2024-05-10T11:12:57.315 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:12:57.315 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:12:57.315 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:12:57.315 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:12:57.315 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:57.315 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:57.315 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:12:57.315 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:12:57.315 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:12:57.315 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:57.365 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:57.553 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:57.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:57.559 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-05-10T11:12:57.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:57.575 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2024-05-10T11:12:57.631 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:57.631 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:57.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T11:12:57.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-10T11:12:57.631 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:57.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:57.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:57.753 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-10T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:57.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:57.878 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:57.887 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:57.887 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:57.887 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.0 up 2024-05-10T11:12:57.887 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T11:12:57.887 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:57.936 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:57.958 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:57.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:57.965 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-10T11:12:57.981 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-10T11:12:57.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:57.981 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-10T11:12:58.037 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:12:58.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:58.037 DEBUG:teuthology.orchestra.run.smithi190:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T11:12:58.133 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T11:12:58.133 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T11:12:58.133 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2024-05-10T11:12:58.254 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T11:12:58.254 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T11:12:58.254 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2024-05-10T11:12:58.254 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:58.254 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:12:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:12:58.260 INFO:teuthology.orchestra.run.smithi190.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-10T11:12:58.260 INFO:teuthology.orchestra.run.smithi190.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:12:58.260 INFO:teuthology.orchestra.run.smithi190.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:12:58.260 INFO:teuthology.orchestra.run.smithi190.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:12:58.260 INFO:teuthology.orchestra.run.smithi190.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:12:58.262 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:12:58.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:58.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-10T11:12:58.293 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:58.382 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:58.389 INFO:teuthology.orchestra.run.smithi190.stdout:client4538 2024-05-10T11:12:58.389 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:12:58.389 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:12:58.405 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:58.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:58.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:58.501 INFO:teuthology.orchestra.run.smithi190.stdout:client4538 2024-05-10T11:12:58.501 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:12:58.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:12:58.559 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:58.566 INFO:teuthology.orchestra.run.smithi190.stdout:client4538 2024-05-10T11:12:58.567 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/62c58463-bf48-494c-be0a-3a4b427ce317.client4538/status') 2024-05-10T11:12:58.615 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:58.626 INFO:teuthology.orchestra.run.smithi190.stdout:instance: client.4538 (3)192.168.0.1:0/2395592252 2024-05-10T11:12:58.626 INFO:teuthology.orchestra.run.smithi190.stdout:blocklisted: false 2024-05-10T11:12:58.626 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records in 2024-05-10T11:12:58.626 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records out 2024-05-10T11:12:58.626 INFO:teuthology.orchestra.run.smithi190.stderr:69 bytes copied, 2.27e-05 s, 3.0 MB/s 2024-05-10T11:12:58.627 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:58.633 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-10T11:12:58.633 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T11:12:58.633 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T11:12:58.633 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:12:58.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.750+0000 7fb89d7c8640 1 Processor -- start 2024-05-10T11:12:58.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.750+0000 7fb89d7c8640 1 -- start start 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb89d7c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb89815ce60 0x7fb8980cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb89d7c8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8980c6a30 con 0x7fb8980c65f0 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb89d7c8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8980cd090 con 0x7fb8981611e0 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb89d7c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8980cd370 con 0x7fb89815ce60 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb88e7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb8980c65f0 0x7fb898160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35966/0 (socket says 172.21.15.66:35966) 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb88e7fc640 1 -- 172.21.15.66:0/1264317906 learned_addr learned my addr 172.21.15.66:0/1264317906 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb896ffd640 1 --2- 172.21.15.66:0/1264317906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb89815ce60 0x7fb8980cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360406621 0 0) 0x7fb8980c6a30 con 0x7fb8980c65f0 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb884003520 con 0x7fb8980c65f0 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946877961 0 0) 0x7fb8980cd090 con 0x7fb8981611e0 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8980c6a30 con 0x7fb8981611e0 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb896ffd640 1 -- 172.21.15.66:0/1264317906 >> v1:172.21.15.190:6789/0 conn(0x7fb8981611e0 legacy=0x7fb89815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb896ffd640 1 -- 172.21.15.66:0/1264317906 >> v1:172.21.15.66:6789/0 conn(0x7fb8980c65f0 legacy=0x7fb898160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2283515115 0 0) 0x7fb884003520 con 0x7fb8980c65f0 2024-05-10T11:12:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.751+0000 7fb896ffd640 1 -- 172.21.15.66:0/1264317906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8980cd650 con 0x7fb89815ce60 2024-05-10T11:12:58.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.752+0000 7fb896ffd640 1 --2- 172.21.15.66:0/1264317906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb89815ce60 0x7fb8980cb300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8880097d0 tx=0x7fb88802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95af03ded394a08b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:58.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.752+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888037070 con 0x7fb89815ce60 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.752+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88802ab90 con 0x7fb89815ce60 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.752+0000 7fb8967fc640 1 -- 172.21.15.66:0/1264317906 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880001670 con 0x7fb89815ce60 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 -- 172.21.15.66:0/1264317906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb89815ce60 msgr2=0x7fb8980cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/1264317906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb89815ce60 0x7fb8980cb300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8880097d0 tx=0x7fb88802a100 comp rx=0 tx=0).stop 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 -- 172.21.15.66:0/1264317906 shutdown_connections 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/1264317906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb89815ce60 0x7fb8980cb300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 -- 172.21.15.66:0/1264317906 >> 172.21.15.66:0/1264317906 conn(0x7fb8980b2900 msgr2=0x7fb8980b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 -- 172.21.15.66:0/1264317906 shutdown_connections 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.753+0000 7fb89d7c8640 1 -- 172.21.15.66:0/1264317906 wait complete. 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.754+0000 7fb89d7c8640 1 Processor -- start 2024-05-10T11:12:58.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 -- start start 2024-05-10T11:12:58.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8980c65f0 0x7fb898151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:58.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89815ce60 0x7fb898073460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:58.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 0x7fb8980739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:58.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8980cde50 con 0x7fb8981611e0 2024-05-10T11:12:58.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8980ccd60 con 0x7fb89815ce60 2024-05-10T11:12:58.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb89d7c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8980cdfd0 con 0x7fb8980c65f0 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb8977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 0x7fb8980739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb8977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 0x7fb8980739a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46304/0 (socket says 172.21.15.66:46304) 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.755+0000 7fb8977fe640 1 -- 172.21.15.66:0/2145014233 learned_addr learned my addr 172.21.15.66:0/2145014233 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb896ffd640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8980c65f0 0x7fb898151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb88e7fc640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89815ce60 0x7fb898073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb8977fe640 1 -- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8980c65f0 msgr2=0x7fb898151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb8977fe640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8980c65f0 0x7fb898151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb8977fe640 1 -- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89815ce60 msgr2=0x7fb898073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb8977fe640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89815ce60 0x7fb898073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb8977fe640 1 -- 172.21.15.66:0/2145014233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8980ca380 con 0x7fb8981611e0 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb88e7fc640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89815ce60 0x7fb898073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb896ffd640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8980c65f0 0x7fb898151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:12:58.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb8977fe640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 0x7fb8980739a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c710 tx=0x7fb89000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:58.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890003b70 con 0x7fb8981611e0 2024-05-10T11:12:58.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb890003d10 con 0x7fb8981611e0 2024-05-10T11:12:58.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8980ca660 con 0x7fb8981611e0 2024-05-10T11:12:58.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89000aa50 con 0x7fb8981611e0 2024-05-10T11:12:58.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.756+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8980af750 con 0x7fb8981611e0 2024-05-10T11:12:58.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.757+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8980af950 con 0x7fb8981611e0 2024-05-10T11:12:58.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.758+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb89000abf0 con 0x7fb8981611e0 2024-05-10T11:12:58.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.758+0000 7fb88ffff640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8780762d0 0x7fb878078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:12:58.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.759+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb8900977a0 con 0x7fb8981611e0 2024-05-10T11:12:58.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.759+0000 7fb896ffd640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8780762d0 0x7fb878078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:12:58.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.759+0000 7fb896ffd640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8780762d0 0x7fb878078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb888034000 tx=0x7fb88802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:12:58.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.763+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb8980af950 con 0x7fb8981611e0 2024-05-10T11:12:58.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.998+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb89806a220 con 0x7fb8981611e0 2024-05-10T11:12:58.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:58.999+0000 7fb88ffff640 1 -- 172.21.15.66:0/2145014233 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fb89000ce20 con 0x7fb8981611e0 2024-05-10T11:12:58.999 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T11:12:59.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.000+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8780762d0 msgr2=0x7fb878078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:59.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.000+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8780762d0 0x7fb878078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb888034000 tx=0x7fb88802e000 comp rx=0 tx=0).stop 2024-05-10T11:12:59.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.000+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 msgr2=0x7fb8980739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 0x7fb8980739a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c710 tx=0x7fb89000cbd0 comp rx=0 tx=0).stop 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 shutdown_connections 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8780762d0 0x7fb878078790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8981611e0 0x7fb8980739a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89815ce60 0x7fb898073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 --2- 172.21.15.66:0/2145014233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8980c65f0 0x7fb898151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 >> 172.21.15.66:0/2145014233 conn(0x7fb8980b2900 msgr2=0x7fb89815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 shutdown_connections 2024-05-10T11:12:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:12:59.001+0000 7fb89d7c8640 1 -- 172.21.15.66:0/2145014233 wait complete. 2024-05-10T11:12:59.012 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T11:12:59.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:12:59.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2024-05-10T11:12:59.012 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-10T11:12:59.013 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T11:12:59.013 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T11:12:59.013 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T11:12:59.013 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:12:59.013 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-10T11:12:59.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.013 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2024-05-10T11:12:59.029 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:59.029 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:59.029 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:59.030 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42737sec preferred_lft 42737sec 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether b2:40:ac:3a:63:a0 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::c40b:32ff:fef8:b3f8/64 scope link tentative 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether b2:40:ac:3a:63:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::b040:acff:fe3a:63a0/64 scope link tentative 2024-05-10T11:12:59.031 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.032 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:12:59.093 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-05-10T11:12:59.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.095 DEBUG:teuthology.orchestra.run.smithi190:> route 2024-05-10T11:12:59.151 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2024-05-10T11:12:59.151 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:12:59.151 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:12:59.151 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:12:59.151 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:12:59.151 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:59.151 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:59.151 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:12:59.151 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:12:59.152 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:12:59.153 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:59.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:59.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:59.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.277 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-05-10T11:12:59.292 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T11:12:59.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.293 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2024-05-10T11:12:59.348 INFO:teuthology.orchestra.run.smithi190.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-10T11:12:59.348 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:59.348 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:59.348 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T11:12:59.348 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-10T11:12:59.348 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:59.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:59.460 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:59.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.466 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T11:12:59.490 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:59.490 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether be:05:1c:05:b4:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::bc05:1cff:fe05:b49f/64 scope link 2024-05-10T11:12:59.491 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.492 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T11:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-05-10T11:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.558 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:12:59.558 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether be:05:1c:05:b4:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T11:12:59.558 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T11:12:59.558 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.558 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::bc05:1cff:fe05:b49f/64 scope link 2024-05-10T11:12:59.558 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:12:59.562 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-10T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:59.650 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:59.709 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:59.716 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:12:59.716 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-05-10T11:12:59.716 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.1 up 2024-05-10T11:12:59.716 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T11:12:59.716 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-05-10T11:12:59.765 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:12:59.786 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:12:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:12:59.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:59.792 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-10T11:12:59.807 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-10T11:12:59.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:12:59.807 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-10T11:12:59.861 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:12:59.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.862 DEBUG:teuthology.orchestra.run.smithi190:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T11:12:59.945 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T11:12:59.945 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T11:12:59.945 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2024-05-10T11:12:59.953 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T11:12:59.953 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T11:12:59.953 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2024-05-10T11:12:59.953 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:59.954 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:59.959 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T11:12:59.959 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T11:12:59.959 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2024-05-10T11:12:59.959 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:12:59.959 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:12:59.959 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:12:59.960 INFO:teuthology.orchestra.run.smithi190.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:12:59.962 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:12:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:12:59.962 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-10T11:13:00.028 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:13:00.116 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:13:00.118 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:00.123 INFO:teuthology.orchestra.run.smithi190.stdout:client4752 2024-05-10T11:13:00.124 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:00.124 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:00.140 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:13:00.229 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:13:00.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:00.236 INFO:teuthology.orchestra.run.smithi190.stdout:client4752 2024-05-10T11:13:00.236 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:13:00.285 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:13:00.286 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:00.292 INFO:teuthology.orchestra.run.smithi190.stdout:client4752 2024-05-10T11:13:00.292 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/62c58463-bf48-494c-be0a-3a4b427ce317.client4752/status') 2024-05-10T11:13:00.340 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:13:00.350 INFO:teuthology.orchestra.run.smithi190.stdout:instance: client.4752 (3)172.21.15.190:0/447146584 2024-05-10T11:13:00.350 INFO:teuthology.orchestra.run.smithi190.stdout:blocklisted: false 2024-05-10T11:13:00.350 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records in 2024-05-10T11:13:00.350 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records out 2024-05-10T11:13:00.351 INFO:teuthology.orchestra.run.smithi190.stderr:70 bytes copied, 2.4104e-05 s, 2.9 MB/s 2024-05-10T11:13:00.351 INFO:teuthology.orchestra.run.smithi190.stderr:2024-05-10T11:13:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:00.357 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-10T11:13:00.383 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:13:00.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:00.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.500+0000 7f5f3427e640 1 Processor -- start 2024-05-10T11:13:00.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.500+0000 7f5f3427e640 1 -- start start 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3427e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5f2c162750 0x7f5f2c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3427e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2c0b45f0 con 0x7f5f2c162b30 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3427e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2c0b48d0 con 0x7f5f2c0d5cb0 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3427e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5f2c0b4f20 con 0x7f5f2c162750 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3281b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5f2c162b30 0x7f5f2c0b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35970/0 (socket says 172.21.15.66:35970) 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3281b640 1 -- 172.21.15.66:0/1775349890 learned_addr learned my addr 172.21.15.66:0/1775349890 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3201a640 1 --2- 172.21.15.66:0/1775349890 >> v2:172.21.15.190:3300/0 conn(0x7f5f2c162750 0x7f5f2c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436174055 0 0) 0x7f5f2c0b45f0 con 0x7f5f2c162b30 2024-05-10T11:13:00.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f18003520 con 0x7f5f2c162b30 2024-05-10T11:13:00.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181462396 0 0) 0x7f5f2c0b48d0 con 0x7f5f2c0d5cb0 2024-05-10T11:13:00.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f2c0b45f0 con 0x7f5f2c0d5cb0 2024-05-10T11:13:00.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3201a640 1 -- 172.21.15.66:0/1775349890 >> v1:172.21.15.190:6789/0 conn(0x7f5f2c0d5cb0 legacy=0x7f5f2c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3201a640 1 -- 172.21.15.66:0/1775349890 >> v1:172.21.15.66:6789/0 conn(0x7f5f2c162b30 legacy=0x7f5f2c0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.501+0000 7f5f3201a640 1 -- 172.21.15.66:0/1775349890 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c0b4bb0 con 0x7f5f2c162750 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.502+0000 7f5f3201a640 1 --2- 172.21.15.66:0/1775349890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162750 0x7f5f2c0d0670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f280097a0 tx=0x7f5f2802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4076010204a1994c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.502+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28037070 con 0x7f5f2c162750 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.502+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f28032440 con 0x7f5f2c162750 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.502+0000 7f5f31018640 1 -- 172.21.15.66:0/1775349890 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f280327f0 con 0x7f5f2c162750 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 -- 172.21.15.66:0/1775349890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162750 msgr2=0x7f5f2c0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 --2- 172.21.15.66:0/1775349890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162750 0x7f5f2c0d0670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f280097a0 tx=0x7f5f2802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 -- 172.21.15.66:0/1775349890 shutdown_connections 2024-05-10T11:13:00.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 --2- 172.21.15.66:0/1775349890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162750 0x7f5f2c0d0670 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 -- 172.21.15.66:0/1775349890 >> 172.21.15.66:0/1775349890 conn(0x7f5f2c09e3b0 msgr2=0x7f5f2c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:00.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 -- 172.21.15.66:0/1775349890 shutdown_connections 2024-05-10T11:13:00.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.503+0000 7f5f3427e640 1 -- 172.21.15.66:0/1775349890 wait complete. 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.504+0000 7f5f3427e640 1 Processor -- start 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.504+0000 7f5f3427e640 1 -- start start 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3427e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 0x7f5f2c1577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3427e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162b30 0x7f5f2c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3427e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f2c0cd930 0x7f5f2c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3427e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c0d3d40 con 0x7f5f2c162750 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3427e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c0d0fe0 con 0x7f5f2c162b30 2024-05-10T11:13:00.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3427e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2c0d3ec0 con 0x7f5f2c0cd930 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 0x7f5f2c1577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 0x7f5f2c1577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46314/0 (socket says 172.21.15.66:46314) 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 -- 172.21.15.66:0/4051789423 learned_addr learned my addr 172.21.15.66:0/4051789423 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f31819640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162b30 0x7f5f2c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3281b640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f2c0cd930 0x7f5f2c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 -- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f2c0cd930 msgr2=0x7f5f2c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f2c0cd930 0x7f5f2c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 -- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162b30 msgr2=0x7f5f2c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.505+0000 7f5f3201a640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162b30 0x7f5f2c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f3201a640 1 -- 172.21.15.66:0/4051789423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c0cc890 con 0x7f5f2c162750 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f3281b640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f2c0cd930 0x7f5f2c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f3201a640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 0x7f5f2c1577d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f2802a1e0 tx=0x7f5f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28041020 con 0x7f5f2c162750 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2803d620 con 0x7f5f2c162750 2024-05-10T11:13:00.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c0ccb70 con 0x7f5f2c162750 2024-05-10T11:13:00.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28037040 con 0x7f5f2c162750 2024-05-10T11:13:00.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.506+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c0cd130 con 0x7f5f2c162750 2024-05-10T11:13:00.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.507+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2c06a220 con 0x7f5f2c162750 2024-05-10T11:13:00.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.508+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f28044020 con 0x7f5f2c162750 2024-05-10T11:13:00.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.508+0000 7f5f22ffd640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5f100762d0 0x7f5f10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.508+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5f280b8180 con 0x7f5f2c162750 2024-05-10T11:13:00.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.509+0000 7f5f31819640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5f100762d0 0x7f5f10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.509+0000 7f5f31819640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5f100762d0 0x7f5f10078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ce6c0 tx=0x7f5f1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:00.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.513+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5f2804b030 con 0x7f5f2c162750 2024-05-10T11:13:00.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.704+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f2c0cf360 con 0x7f5f2c162750 2024-05-10T11:13:00.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.705+0000 7f5f22ffd640 1 -- 172.21.15.66:0/4051789423 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f5f28081720 con 0x7f5f2c162750 2024-05-10T11:13:00.706 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:00.706 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5f100762d0 msgr2=0x7f5f10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5f100762d0 0x7f5f10078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ce6c0 tx=0x7f5f1c009040 comp rx=0 tx=0).stop 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 msgr2=0x7f5f2c1577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 0x7f5f2c1577d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f2802a1e0 tx=0x7f5f280046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 shutdown_connections 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5f100762d0 0x7f5f10078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f2c0cd930 0x7f5f2c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f2c162b30 0x7f5f2c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 --2- 172.21.15.66:0/4051789423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f2c162750 0x7f5f2c1577d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 >> 172.21.15.66:0/4051789423 conn(0x7f5f2c09e3b0 msgr2=0x7f5f2c0d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:00.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.707+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 shutdown_connections 2024-05-10T11:13:00.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.708+0000 7f5f3427e640 1 -- 172.21.15.66:0/4051789423 wait complete. 2024-05-10T11:13:00.719 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T11:12:28.361614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T11:12:29.425925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T11:12:33.110522+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T11:13:00.720 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:13:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.827+0000 7f15a9714640 1 Processor -- start 2024-05-10T11:13:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.827+0000 7f15a9714640 1 -- start start 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.827+0000 7f15a9714640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f15a40d3df0 0x7f15a40d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.827+0000 7f15a9714640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40b4aa0 0x7f15a40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a9714640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15a40d1a10 0x7f15a40d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a9714640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f15a40cfd50 con 0x7f15a40d1a10 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a9714640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f15a40b5d90 con 0x7f15a40d3df0 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a9714640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f15a40d41d0 con 0x7f15a40b4aa0 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15a40d1a10 0x7f15a40d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15a40d1a10 0x7f15a40d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46326/0 (socket says 172.21.15.66:46326) 2024-05-10T11:13:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 -- 172.21.15.66:0/216782765 learned_addr learned my addr 172.21.15.66:0/216782765 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a2ffd640 1 --2- 172.21.15.66:0/216782765 >> v2:172.21.15.190:3300/0 conn(0x7f15a40d3df0 0x7f15a40d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f159bfff640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40b4aa0 0x7f15a40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 -- 172.21.15.66:0/216782765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40b4aa0 msgr2=0x7f15a40b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40b4aa0 0x7f15a40b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 -- 172.21.15.66:0/216782765 >> v2:172.21.15.190:3300/0 conn(0x7f15a40d3df0 msgr2=0x7f15a40d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 --2- 172.21.15.66:0/216782765 >> v2:172.21.15.190:3300/0 conn(0x7f15a40d3df0 0x7f15a40d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f15a37fe640 1 -- 172.21.15.66:0/216782765 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a40b54f0 con 0x7f15a40d1a10 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.828+0000 7f159bfff640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40b4aa0 0x7f15a40b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:00.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.829+0000 7f15a37fe640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d1a10 0x7f15a40d1ea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f15a406cbe0 tx=0x7f159c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cf5a408b2280df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.829+0000 7f15a27fc640 1 -- 172.21.15.66:0/216782765 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c036070 con 0x7f15a40d1a10 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.829+0000 7f15a27fc640 1 -- 172.21.15.66:0/216782765 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159c031600 con 0x7f15a40d1a10 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.829+0000 7f15a27fc640 1 -- 172.21.15.66:0/216782765 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0319d0 con 0x7f15a40d1a10 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 -- 172.21.15.66:0/216782765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d1a10 msgr2=0x7f15a40d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d1a10 0x7f15a40d1ea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f15a406cbe0 tx=0x7f159c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 -- 172.21.15.66:0/216782765 shutdown_connections 2024-05-10T11:13:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d1a10 0x7f15a40d1ea0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 --2- 172.21.15.66:0/216782765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40b4aa0 0x7f15a40b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 --2- 172.21.15.66:0/216782765 >> v2:172.21.15.190:3300/0 conn(0x7f15a40d3df0 0x7f15a40d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 -- 172.21.15.66:0/216782765 >> 172.21.15.66:0/216782765 conn(0x7f15a409e450 msgr2=0x7f15a40d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 -- 172.21.15.66:0/216782765 shutdown_connections 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.830+0000 7f15a9714640 1 -- 172.21.15.66:0/216782765 wait complete. 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.831+0000 7f15a9714640 1 Processor -- start 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.831+0000 7f15a9714640 1 -- start start 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15a40b4aa0 0x7f15a40b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40d1a10 0x7f15a415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 0x7f15a41f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15a40cff80 con 0x7f15a40d3df0 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15a40b5ab0 con 0x7f15a40b4aa0 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f15a40b6120 con 0x7f15a40d1a10 2024-05-10T11:13:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 0x7f15a41f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 0x7f15a41f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46338/0 (socket says 172.21.15.66:46338) 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 -- 172.21.15.66:0/892667428 learned_addr learned my addr 172.21.15.66:0/892667428 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f159bfff640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40d1a10 0x7f15a415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a2ffd640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15a40b4aa0 0x7f15a40b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 -- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40d1a10 msgr2=0x7f15a415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40d1a10 0x7f15a415b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 -- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15a40b4aa0 msgr2=0x7f15a40b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15a40b4aa0 0x7f15a40b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 -- 172.21.15.66:0/892667428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a40b8e50 con 0x7f15a40d3df0 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f159bfff640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40d1a10 0x7f15a415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a2ffd640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15a40b4aa0 0x7f15a40b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a37fe640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 0x7f15a41f89c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f159c02ac90 tx=0x7f159c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c041020 con 0x7f15a40d3df0 2024-05-10T11:13:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159c007780 con 0x7f15a40d3df0 2024-05-10T11:13:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c036040 con 0x7f15a40d3df0 2024-05-10T11:13:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.832+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a40b9130 con 0x7f15a40d3df0 2024-05-10T11:13:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.833+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a41585c0 con 0x7f15a40d3df0 2024-05-10T11:13:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.833+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a40b9650 con 0x7f15a40d3df0 2024-05-10T11:13:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.834+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f159c044020 con 0x7f15a40d3df0 2024-05-10T11:13:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.835+0000 7f159b7fe640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15840762d0 0x7f1584078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.835+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f159c0b8860 con 0x7f15a40d3df0 2024-05-10T11:13:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.835+0000 7f15a2ffd640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15840762d0 0x7f1584078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.835+0000 7f15a2ffd640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15840762d0 0x7f1584078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1594006fd0 tx=0x7f1594008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:00.839+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f15a40b9650 con 0x7f15a40d3df0 2024-05-10T11:13:01.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.029+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15a406a220 con 0x7f15a40d3df0 2024-05-10T11:13:01.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.029+0000 7f159b7fe640 1 -- 172.21.15.66:0/892667428 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f159c04b020 con 0x7f15a40d3df0 2024-05-10T11:13:01.030 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:13:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.031+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15840762d0 msgr2=0x7f1584078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.031+0000 7f15a9714640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15840762d0 0x7f1584078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1594006fd0 tx=0x7f1594008040 comp rx=0 tx=0).stop 2024-05-10T11:13:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 msgr2=0x7f15a41f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 0x7f15a41f89c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f159c02ac90 tx=0x7f159c004a40 comp rx=0 tx=0).stop 2024-05-10T11:13:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 shutdown_connections 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15840762d0 0x7f1584078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15a40d3df0 0x7f15a41f89c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15a40d1a10 0x7f15a415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 --2- 172.21.15.66:0/892667428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15a40b4aa0 0x7f15a40b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 >> 172.21.15.66:0/892667428 conn(0x7f15a409e450 msgr2=0x7f15a40d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 shutdown_connections 2024-05-10T11:13:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.032+0000 7f15a9714640 1 -- 172.21.15.66:0/892667428 wait complete. 2024-05-10T11:13:01.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T11:13:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.149+0000 7f70c0a74640 1 Processor -- start 2024-05-10T11:13:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.149+0000 7f70c0a74640 1 -- start start 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70c0a74640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc162900 0x7f70bc0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70c0a74640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70bc162ce0 0x7f70bc0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70c0a74640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70bc0d4190 con 0x7f70bc0d3950 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70c0a74640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f70bc0cfc40 con 0x7f70bc162ce0 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70c0a74640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc0d3eb0 con 0x7f70bc162900 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70bc162ce0 0x7f70bc0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70bc162ce0 0x7f70bc0b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46350/0 (socket says 172.21.15.66:46350) 2024-05-10T11:13:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 -- 172.21.15.66:0/1094759071 learned_addr learned my addr 172.21.15.66:0/1094759071 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:01.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70ba59c640 1 --2- 172.21.15.66:0/1094759071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc162900 0x7f70bc0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 -- 172.21.15.66:0/1094759071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc162900 msgr2=0x7f70bc0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:01.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 --2- 172.21.15.66:0/1094759071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc162900 0x7f70bc0d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 -- 172.21.15.66:0/1094759071 >> v1:172.21.15.190:6789/0 conn(0x7f70bc0d3950 legacy=0x7f70bc0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.150+0000 7f70b1d9b640 1 -- 172.21.15.66:0/1094759071 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc0cfee0 con 0x7f70bc162ce0 2024-05-10T11:13:01.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.151+0000 7f70b1d9b640 1 --2- 172.21.15.66:0/1094759071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b48e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009870 tx=0x7f70a402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d577ec76135aff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.151+0000 7f70b9d9b640 1 -- 172.21.15.66:0/1094759071 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4037070 con 0x7f70bc162ce0 2024-05-10T11:13:01.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.151+0000 7f70b9d9b640 1 -- 172.21.15.66:0/1094759071 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a4032440 con 0x7f70bc162ce0 2024-05-10T11:13:01.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.151+0000 7f70b9d9b640 1 -- 172.21.15.66:0/1094759071 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4032810 con 0x7f70bc162ce0 2024-05-10T11:13:01.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 -- 172.21.15.66:0/1094759071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 msgr2=0x7f70bc0b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 --2- 172.21.15.66:0/1094759071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b48e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009870 tx=0x7f70a402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 -- 172.21.15.66:0/1094759071 shutdown_connections 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 --2- 172.21.15.66:0/1094759071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b48e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 --2- 172.21.15.66:0/1094759071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc162900 0x7f70bc0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 -- 172.21.15.66:0/1094759071 >> 172.21.15.66:0/1094759071 conn(0x7f70bc09e430 msgr2=0x7f70bc0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 -- 172.21.15.66:0/1094759071 shutdown_connections 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.152+0000 7f70c0a74640 1 -- 172.21.15.66:0/1094759071 wait complete. 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.153+0000 7f70c0a74640 1 Processor -- start 2024-05-10T11:13:01.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.153+0000 7f70c0a74640 1 -- start start 2024-05-10T11:13:01.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70c0a74640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc0d3950 0x7f70bc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70c0a74640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70bc162900 0x7f70bc06e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70c0a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70c0a74640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc0b4300 con 0x7f70bc162ce0 2024-05-10T11:13:01.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70c0a74640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc0b4180 con 0x7f70bc162900 2024-05-10T11:13:01.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70c0a74640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc0d10d0 con 0x7f70bc0d3950 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46360/0 (socket says 172.21.15.66:46360) 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 -- 172.21.15.66:0/27567327 learned_addr learned my addr 172.21.15.66:0/27567327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70b1d9b640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70bc162900 0x7f70bc06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70ba59c640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc0d3950 0x7f70bc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 -- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc0d3950 msgr2=0x7f70bc06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc0d3950 0x7f70bc06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 -- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70bc162900 msgr2=0x7f70bc06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70bc162900 0x7f70bc06e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70bad9d640 1 -- 172.21.15.66:0/27567327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc0ce0a0 con 0x7f70bc162ce0 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.154+0000 7f70b1d9b640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70bc162900 0x7f70bc06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:01.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.155+0000 7f70bad9d640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b8cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c680 tx=0x7f70b400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.155+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4003b70 con 0x7f70bc162ce0 2024-05-10T11:13:01.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.155+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4003d10 con 0x7f70bc162ce0 2024-05-10T11:13:01.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.155+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc0ce380 con 0x7f70bc162ce0 2024-05-10T11:13:01.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.155+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4005310 con 0x7f70bc162ce0 2024-05-10T11:13:01.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.155+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc0ce940 con 0x7f70bc162ce0 2024-05-10T11:13:01.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.156+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc06a220 con 0x7f70bc162ce0 2024-05-10T11:13:01.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.156+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f70b40054b0 con 0x7f70bc162ce0 2024-05-10T11:13:01.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.157+0000 7f70b37fe640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f709c0762d0 0x7f709c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.157+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f70b40976c0 con 0x7f70bc162ce0 2024-05-10T11:13:01.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.157+0000 7f70ba59c640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f709c0762d0 0x7f709c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.158+0000 7f70ba59c640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f709c0762d0 0x7f709c078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009ad0 tx=0x7f70ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.161+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f70bc0d4190 con 0x7f70bc162ce0 2024-05-10T11:13:01.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:13:01.186 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:13:01.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.353+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f70bc0d29a0 con 0x7f70bc162ce0 2024-05-10T11:13:01.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.353+0000 7f70b37fe640 1 -- 172.21.15.66:0/27567327 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f70b4060d70 con 0x7f70bc162ce0 2024-05-10T11:13:01.354 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 32 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f709c0762d0 msgr2=0x7f709c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f709c0762d0 0x7f709c078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009ad0 tx=0x7f70ac008040 comp rx=0 tx=0).stop 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 msgr2=0x7f70bc0b8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b8cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c680 tx=0x7f70b400cb40 comp rx=0 tx=0).stop 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 shutdown_connections 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f709c0762d0 0x7f709c078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc162ce0 0x7f70bc0b8cb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70bc162900 0x7f70bc06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 --2- 172.21.15.66:0/27567327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70bc0d3950 0x7f70bc06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 >> 172.21.15.66:0/27567327 conn(0x7f70bc09e430 msgr2=0x7f70bc0d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:01.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 shutdown_connections 2024-05-10T11:13:01.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.355+0000 7f70c0a74640 1 -- 172.21.15.66:0/27567327 wait complete. 2024-05-10T11:13:01.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T11:13:01.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.473+0000 7fe53ab11640 1 Processor -- start 2024-05-10T11:13:01.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.473+0000 7fe53ab11640 1 -- start start 2024-05-10T11:13:01.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe53ab11640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe53415f1b0 0x7fe534070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe53ab11640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe5340c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe53ab11640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5340d02a0 con 0x7fe53415f590 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe53ab11640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe5340ccdf0 con 0x7fe53415f1b0 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe53ab11640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5340cfce0 con 0x7fe5340c7c60 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe5340c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe5388ad640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe53415f1b0 0x7fe534070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe5340c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:52546/0 (socket says 172.21.15.66:52546) 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 -- 172.21.15.66:0/3938734093 learned_addr learned my addr 172.21.15.66:0/3938734093 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 -- 172.21.15.66:0/3938734093 >> v2:172.21.15.190:3300/0 conn(0x7fe53415f1b0 msgr2=0x7fe534070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 --2- 172.21.15.66:0/3938734093 >> v2:172.21.15.190:3300/0 conn(0x7fe53415f1b0 0x7fe534070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 -- 172.21.15.66:0/3938734093 >> v1:172.21.15.190:6789/0 conn(0x7fe53415f590 legacy=0x7fe53406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe52bfff640 1 -- 172.21.15.66:0/3938734093 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340cffc0 con 0x7fe5340c7c60 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.474+0000 7fe5388ad640 1 --2- 172.21.15.66:0/3938734093 >> v2:172.21.15.190:3300/0 conn(0x7fe53415f1b0 0x7fe534070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.475+0000 7fe52bfff640 1 --2- 172.21.15.66:0/3938734093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe5340c67b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe524009870 tx=0x7fe52402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2ba6826ed44001 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.475+0000 7fe52b7fe640 1 -- 172.21.15.66:0/3938734093 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524037070 con 0x7fe5340c7c60 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.475+0000 7fe52b7fe640 1 -- 172.21.15.66:0/3938734093 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe524032440 con 0x7fe5340c7c60 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.475+0000 7fe52b7fe640 1 -- 172.21.15.66:0/3938734093 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524032810 con 0x7fe5340c7c60 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 -- 172.21.15.66:0/3938734093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 msgr2=0x7fe5340c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 --2- 172.21.15.66:0/3938734093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe5340c67b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe524009870 tx=0x7fe52402a270 comp rx=0 tx=0).stop 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 -- 172.21.15.66:0/3938734093 shutdown_connections 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 --2- 172.21.15.66:0/3938734093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe5340c67b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 --2- 172.21.15.66:0/3938734093 >> v2:172.21.15.190:3300/0 conn(0x7fe53415f1b0 0x7fe534070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 -- 172.21.15.66:0/3938734093 >> 172.21.15.66:0/3938734093 conn(0x7fe5340ce0a0 msgr2=0x7fe5340ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 -- 172.21.15.66:0/3938734093 shutdown_connections 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.476+0000 7fe53ab11640 1 -- 172.21.15.66:0/3938734093 wait complete. 2024-05-10T11:13:01.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.477+0000 7fe53ab11640 1 Processor -- start 2024-05-10T11:13:01.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.477+0000 7fe53ab11640 1 -- start start 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe53ab11640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe534154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe53ab11640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 0x7fe534153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe53ab11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe53415f590 0x7fe534162010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe53ab11640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5340c80a0 con 0x7fe53415f1b0 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe53ab11640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5340c7740 con 0x7fe53415f590 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe53ab11640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5340c8220 con 0x7fe5340c7c60 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 0x7fe534153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 0x7fe534153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46368/0 (socket says 172.21.15.66:46368) 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe52bfff640 1 -- 172.21.15.66:0/246984245 learned_addr learned my addr 172.21.15.66:0/246984245 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe5388ad640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe534154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.478+0000 7fe5390ae640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe53415f590 0x7fe534162010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe52bfff640 1 -- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 msgr2=0x7fe534154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe52bfff640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe534154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe52bfff640 1 -- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe53415f590 msgr2=0x7fe534162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe52bfff640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe53415f590 0x7fe534162010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe52bfff640 1 -- 172.21.15.66:0/246984245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340b7460 con 0x7fe53415f1b0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe5388ad640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe534154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe52bfff640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 0x7fe534153f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe52402a2b0 tx=0x7fe5240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524037040 con 0x7fe53415f1b0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe524042070 con 0x7fe53415f1b0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5340af980 con 0x7fe53415f1b0 2024-05-10T11:13:01.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524030880 con 0x7fe53415f1b0 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.479+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5340aff40 con 0x7fe53415f1b0 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.480+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe53406a220 con 0x7fe53415f1b0 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.481+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe524030a20 con 0x7fe53415f1b0 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.481+0000 7fe5297fa640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5200762d0 0x7fe520078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.482+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe5240b80c0 con 0x7fe53415f1b0 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.482+0000 7fe5388ad640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5200762d0 0x7fe520078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.482+0000 7fe5388ad640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5200762d0 0x7fe520078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe530009fd0 tx=0x7fe53000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.486+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe524081010 con 0x7fe53415f1b0 2024-05-10T11:13:01.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.681+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe5340b2e00 con 0x7fe53415f1b0 2024-05-10T11:13:01.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.681+0000 7fe5297fa640 1 -- 172.21.15.66:0/246984245 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fe524085310 con 0x7fe53415f1b0 2024-05-10T11:13:01.681 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 64 2024-05-10T11:13:01.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5200762d0 msgr2=0x7fe520078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5200762d0 0x7fe520078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe530009fd0 tx=0x7fe53000b040 comp rx=0 tx=0).stop 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 msgr2=0x7fe534153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 0x7fe534153f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe52402a2b0 tx=0x7fe5240046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 shutdown_connections 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5200762d0 0x7fe520078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe53415f590 0x7fe534162010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe53415f1b0 0x7fe534153f40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 --2- 172.21.15.66:0/246984245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5340c7c60 0x7fe534154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 >> 172.21.15.66:0/246984245 conn(0x7fe5340ce0a0 msgr2=0x7fe53406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:01.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 shutdown_connections 2024-05-10T11:13:01.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.683+0000 7fe53ab11640 1 -- 172.21.15.66:0/246984245 wait complete. 2024-05-10T11:13:01.695 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T11:13:01.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.802+0000 7fcda0e93640 1 Processor -- start 2024-05-10T11:13:01.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.802+0000 7fcda0e93640 1 -- start start 2024-05-10T11:13:01.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcda0e93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 0x7fcd9c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcda0e93640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd9c0d1f70 0x7fcd9c0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcda0e93640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9c0d60a0 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcda0e93640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcd9c163190 con 0x7fcd9c0d1f70 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcda0e93640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9c0c8c90 con 0x7fcd9c0d1b90 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcd9a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 0x7fcd9c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcd9ad9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd9c0d1f70 0x7fcd9c0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcd9a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 0x7fcd9c0b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:52564/0 (socket says 172.21.15.66:52564) 2024-05-10T11:13:01.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.803+0000 7fcd9a59c640 1 -- 172.21.15.66:0/3229119558 learned_addr learned my addr 172.21.15.66:0/3229119558 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:01.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.804+0000 7fcd9ad9d640 1 -- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 msgr2=0x7fcd9c0b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:01.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.804+0000 7fcd9ad9d640 1 --2- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 0x7fcd9c0b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.804+0000 7fcd9ad9d640 1 -- 172.21.15.66:0/3229119558 >> v1:172.21.15.190:6789/0 conn(0x7fcd9c0b62b0 legacy=0x7fcd9c163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.804+0000 7fcd9ad9d640 1 -- 172.21.15.66:0/3229119558 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c0b6a00 con 0x7fcd9c0d1f70 2024-05-10T11:13:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.804+0000 7fcd9a59c640 1 --2- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 0x7fcd9c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.804+0000 7fcd9ad9d640 1 --2- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1f70 0x7fcd9c0b5670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0b6bd0 tx=0x7fcd9402a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ca2479f31b5d6e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcd9959a640 1 -- 172.21.15.66:0/3229119558 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94007740 con 0x7fcd9c0d1f70 2024-05-10T11:13:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcd9959a640 1 -- 172.21.15.66:0/3229119558 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd940078e0 con 0x7fcd9c0d1f70 2024-05-10T11:13:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcd9959a640 1 -- 172.21.15.66:0/3229119558 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94007cb0 con 0x7fcd9c0d1f70 2024-05-10T11:13:01.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 -- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1f70 msgr2=0x7fcd9c0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1f70 0x7fcd9c0b5670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0b6bd0 tx=0x7fcd9402a530 comp rx=0 tx=0).stop 2024-05-10T11:13:01.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 -- 172.21.15.66:0/3229119558 shutdown_connections 2024-05-10T11:13:01.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1f70 0x7fcd9c0b5670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3229119558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1b90 0x7fcd9c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 -- 172.21.15.66:0/3229119558 >> 172.21.15.66:0/3229119558 conn(0x7fcd9c0d5140 msgr2=0x7fcd9c0d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 -- 172.21.15.66:0/3229119558 shutdown_connections 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.805+0000 7fcda0e93640 1 -- 172.21.15.66:0/3229119558 wait complete. 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 Processor -- start 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 -- start start 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 0x7fcd9c150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1b90 0x7fcd9c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1f70 0x7fcd9c0ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c0d5e00 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c0d3d20 con 0x7fcd9c0d1b90 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcda0e93640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9c0d4000 con 0x7fcd9c0d1f70 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.807+0000 7fcd9a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 0x7fcd9c150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 0x7fcd9c150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46382/0 (socket says 172.21.15.66:46382) 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 -- 172.21.15.66:0/3114707659 learned_addr learned my addr 172.21.15.66:0/3114707659 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9ad9d640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1f70 0x7fcd9c0ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd99d9b640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1b90 0x7fcd9c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 -- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1f70 msgr2=0x7fcd9c0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1f70 0x7fcd9c0ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 -- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1b90 msgr2=0x7fcd9c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1b90 0x7fcd9c0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 -- 172.21.15.66:0/3114707659 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c0ce990 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd99d9b640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1b90 0x7fcd9c0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd9a59c640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 0x7fcd9c150f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00e9d0 tx=0x7fcd8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c017070 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8c00ca60 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9c0cec70 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00ce10 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.808+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9c09f160 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.809+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9c0b5b50 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.810+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcd8c01a070 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.810+0000 7fcd8affd640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcd7c0762d0 0x7fcd7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:01.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.810+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcd8c097bf0 con 0x7fcd9c0b62b0 2024-05-10T11:13:01.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.810+0000 7fcd99d9b640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcd7c0762d0 0x7fcd7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:01.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.811+0000 7fcd99d9b640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcd7c0762d0 0x7fcd7c078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c161700 tx=0x7fcd90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:01.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:01.815+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcd8c060bc0 con 0x7fcd9c0b62b0 2024-05-10T11:13:02.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.004+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcd9c08cfb0 con 0x7fcd9c0b62b0 2024-05-10T11:13:02.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.004+0000 7fcd8affd640 1 -- 172.21.15.66:0/3114707659 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fcd8c069030 con 0x7fcd9c0b62b0 2024-05-10T11:13:02.005 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 32 2024-05-10T11:13:02.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcd7c0762d0 msgr2=0x7fcd7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcd7c0762d0 0x7fcd7c078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c161700 tx=0x7fcd90009040 comp rx=0 tx=0).stop 2024-05-10T11:13:02.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 msgr2=0x7fcd9c150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 0x7fcd9c150f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00e9d0 tx=0x7fcd8c00ee90 comp rx=0 tx=0).stop 2024-05-10T11:13:02.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 shutdown_connections 2024-05-10T11:13:02.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcd7c0762d0 0x7fcd7c078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd9c0d1f70 0x7fcd9c0ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd9c0d1b90 0x7fcd9c0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 --2- 172.21.15.66:0/3114707659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd9c0b62b0 0x7fcd9c150f20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 >> 172.21.15.66:0/3114707659 conn(0x7fcd9c0d5140 msgr2=0x7fcd9c0ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:02.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 shutdown_connections 2024-05-10T11:13:02.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.006+0000 7fcda0e93640 1 -- 172.21.15.66:0/3114707659 wait complete. 2024-05-10T11:13:02.018 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-05-10T11:13:02.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.123+0000 7fba1cec4640 1 Processor -- start 2024-05-10T11:13:02.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.123+0000 7fba1cec4640 1 -- start start 2024-05-10T11:13:02.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1cec4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 0x7fba18169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1cec4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba180b45f0 con 0x7fba18162750 2024-05-10T11:13:02.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1cec4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba180b48d0 con 0x7fba180d5cb0 2024-05-10T11:13:02.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1cec4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fba180b4f20 con 0x7fba18162b30 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1659c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fba18162750 0x7fba180d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35978/0 (socket says 172.21.15.66:35978) 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1659c640 1 -- 172.21.15.66:0/3385221628 learned_addr learned my addr 172.21.15.66:0/3385221628 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba16d9d640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 0x7fba18169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753725276 0 0) 0x7fba180b45f0 con 0x7fba18162750 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba04003520 con 0x7fba18162750 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3283922369 0 0) 0x7fba04003520 con 0x7fba18162750 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 msgr2=0x7fba18169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 0x7fba18169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 >> v1:172.21.15.190:6789/0 conn(0x7fba180d5cb0 legacy=0x7fba180d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba180b4bb0 con 0x7fba18162750 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fba08001670 con 0x7fba18162750 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 >> v1:172.21.15.66:6789/0 conn(0x7fba18162750 legacy=0x7fba180d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba040039e0 0x7fba04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 0x7fba04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba04004d40 0x7fba040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fba180b4f20 con 0x7fba040039e0 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba0400baa0 con 0x7fba04004d40 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fba0400bca0 con 0x7fba18162b30 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.124+0000 7fba1659c640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba040039e0 0x7fba04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba0dd9b640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 0x7fba04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba16d9d640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba04004d40 0x7fba040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba1659c640 1 -- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 msgr2=0x7fba04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba1659c640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba18162b30 0x7fba04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba1659c640 1 -- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba04004d40 msgr2=0x7fba040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba1659c640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba04004d40 0x7fba040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.125+0000 7fba1659c640 1 -- 172.21.15.66:0/3385221628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba04003520 con 0x7fba040039e0 2024-05-10T11:13:02.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1659c640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba040039e0 0x7fba04003dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c290 tx=0x7fba04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72982bbe7e60de5b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:02.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08007d50 con 0x7fba040039e0 2024-05-10T11:13:02.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08005af0 con 0x7fba040039e0 2024-05-10T11:13:02.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba15d9b640 1 -- 172.21.15.66:0/3385221628 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08007070 con 0x7fba040039e0 2024-05-10T11:13:02.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1cec4640 1 -- 172.21.15.66:0/3385221628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba040039e0 msgr2=0x7fba04003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1cec4640 1 --2- 172.21.15.66:0/3385221628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba040039e0 0x7fba04003dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c290 tx=0x7fba04005830 comp rx=0 tx=0).stop 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba16d9d640 1 -- 172.21.15.66:0/3385221628 reap_dead start 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1cec4640 1 -- 172.21.15.66:0/3385221628 shutdown_connections 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1cec4640 1 -- 172.21.15.66:0/3385221628 >> 172.21.15.66:0/3385221628 conn(0x7fba1809e3b0 msgr2=0x7fba180d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1cec4640 1 -- 172.21.15.66:0/3385221628 shutdown_connections 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.126+0000 7fba1cec4640 1 -- 172.21.15.66:0/3385221628 wait complete. 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.128+0000 7fba1cec4640 1 Processor -- start 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.128+0000 7fba1cec4640 1 -- start start 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.128+0000 7fba1cec4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba040039e0 0x7fba181f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.128+0000 7fba1cec4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 0x7fba181f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.128+0000 7fba1cec4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba181f8790 0x7fba1815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1cec4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fba180d0fe0 con 0x7fba18147f80 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1cec4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba180d3f50 con 0x7fba181f8790 2024-05-10T11:13:02.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1cec4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fba180d0d80 con 0x7fba040039e0 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 0x7fba181f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 0x7fba181f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46406/0 (socket says 172.21.15.66:46406) 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 -- 172.21.15.66:0/1416735666 learned_addr learned my addr 172.21.15.66:0/1416735666 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba16d9d640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba181f8790 0x7fba1815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1659c640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba040039e0 0x7fba181f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 -- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba040039e0 msgr2=0x7fba181f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba040039e0 0x7fba181f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 -- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba181f8790 msgr2=0x7fba1815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba181f8790 0x7fba1815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 -- 172.21.15.66:0/1416735666 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba181f4b10 con 0x7fba18147f80 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1659c640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba040039e0 0x7fba181f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0dd9b640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 0x7fba181f8250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba0000f740 tx=0x7fba0000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0000fe50 con 0x7fba18147f80 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba00018070 con 0x7fba18147f80 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1815df00 con 0x7fba18147f80 2024-05-10T11:13:02.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0000d6d0 con 0x7fba18147f80 2024-05-10T11:13:02.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.129+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba180cdb90 con 0x7fba18147f80 2024-05-10T11:13:02.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.131+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1806a220 con 0x7fba18147f80 2024-05-10T11:13:02.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.131+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba0000d870 con 0x7fba18147f80 2024-05-10T11:13:02.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.132+0000 7fba0f7fe640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb9f8076300 0x7fb9f80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:02.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.132+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fba00097770 con 0x7fba18147f80 2024-05-10T11:13:02.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.132+0000 7fba1659c640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb9f8076300 0x7fb9f80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:02.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.133+0000 7fba1659c640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb9f8076300 0x7fb9f80787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba08033000 tx=0x7fba0802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:02.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.136+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fba00060d90 con 0x7fba18147f80 2024-05-10T11:13:02.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:02.404+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7fba181f8b70 con 0x7fba18147f80 2024-05-10T11:13:03.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.227+0000 7fba0f7fe640 1 -- 172.21.15.66:0/1416735666 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v51) ==== 145+0+0 (secure 0 0 0) 0x7fba00060690 con 0x7fba18147f80 2024-05-10T11:13:03.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb9f8076300 msgr2=0x7fb9f80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb9f8076300 0x7fb9f80787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba08033000 tx=0x7fba0802e000 comp rx=0 tx=0).stop 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 msgr2=0x7fba181f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 0x7fba181f8250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba0000f740 tx=0x7fba0000fc00 comp rx=0 tx=0).stop 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 shutdown_connections 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb9f8076300 0x7fb9f80787c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba181f8790 0x7fba1815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba18147f80 0x7fba181f8250 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 --2- 172.21.15.66:0/1416735666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba040039e0 0x7fba181f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 >> 172.21.15.66:0/1416735666 conn(0x7fba1809e3b0 msgr2=0x7fba180d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 shutdown_connections 2024-05-10T11:13:03.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.230+0000 7fba1cec4640 1 -- 172.21.15.66:0/1416735666 wait complete. 2024-05-10T11:13:03.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:13:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.357+0000 7fac16093640 1 Processor -- start 2024-05-10T11:13:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.357+0000 7fac16093640 1 -- start start 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac16093640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fac1015f330 0x7fac100b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac16093640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac100b44e0 con 0x7fac100b4050 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac16093640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac100b47c0 con 0x7fac100b2c80 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac16093640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fac100b50f0 con 0x7fac1015f330 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac0effd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fac100b4050 0x7fac100d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35982/0 (socket says 172.21.15.66:35982) 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac0effd640 1 -- 172.21.15.66:0/2279272763 learned_addr learned my addr 172.21.15.66:0/2279272763 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac0f7fe640 1 --2- 172.21.15.66:0/2279272763 >> v2:172.21.15.190:3300/0 conn(0x7fac1015f330 0x7fac100b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac0e7fc640 1 -- 172.21.15.66:0/2279272763 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747601117 0 0) 0x7fac100b44e0 con 0x7fac100b4050 2024-05-10T11:13:03.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.358+0000 7fac0e7fc640 1 -- 172.21.15.66:0/2279272763 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf8003520 con 0x7fac100b4050 2024-05-10T11:13:03.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.359+0000 7fac0e7fc640 1 -- 172.21.15.66:0/2279272763 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2284495494 0 0) 0x7fabf8003520 con 0x7fac100b4050 2024-05-10T11:13:03.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.359+0000 7fac0f7fe640 1 -- 172.21.15.66:0/2279272763 >> v1:172.21.15.190:6789/0 conn(0x7fac100b2c80 legacy=0x7fac100cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.359+0000 7fac0f7fe640 1 -- 172.21.15.66:0/2279272763 >> v1:172.21.15.66:6789/0 conn(0x7fac100b4050 legacy=0x7fac100d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.359+0000 7fac0f7fe640 1 -- 172.21.15.66:0/2279272763 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac100b4aa0 con 0x7fac1015f330 2024-05-10T11:13:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.359+0000 7fac0f7fe640 1 --2- 172.21.15.66:0/2279272763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac100b5580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac000097a0 tx=0x7fac0002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a48ed278a6ff3651 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac0e7fc640 1 -- 172.21.15.66:0/2279272763 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00037070 con 0x7fac1015f330 2024-05-10T11:13:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac0e7fc640 1 -- 172.21.15.66:0/2279272763 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0002ac50 con 0x7fac1015f330 2024-05-10T11:13:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac0e7fc640 1 -- 172.21.15.66:0/2279272763 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04001670 con 0x7fac1015f330 2024-05-10T11:13:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 -- 172.21.15.66:0/2279272763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 msgr2=0x7fac100b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 --2- 172.21.15.66:0/2279272763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac100b5580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac000097a0 tx=0x7fac0002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 -- 172.21.15.66:0/2279272763 shutdown_connections 2024-05-10T11:13:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 --2- 172.21.15.66:0/2279272763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac100b5580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 -- 172.21.15.66:0/2279272763 >> 172.21.15.66:0/2279272763 conn(0x7fac100cdc80 msgr2=0x7fac100ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 -- 172.21.15.66:0/2279272763 shutdown_connections 2024-05-10T11:13:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.360+0000 7fac16093640 1 -- 172.21.15.66:0/2279272763 wait complete. 2024-05-10T11:13:03.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.361+0000 7fac16093640 1 Processor -- start 2024-05-10T11:13:03.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 -- start start 2024-05-10T11:13:03.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 0x7fac1015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac10072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac100732d0 0x7fac101f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac100b30b0 con 0x7fac100b2c80 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fac1015f710 con 0x7fac1015f330 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac16093640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fac100b3230 con 0x7fac100732d0 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac0f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 0x7fac1015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac0f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 0x7fac1015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46410/0 (socket says 172.21.15.66:46410) 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.362+0000 7fac0f7fe640 1 -- 172.21.15.66:0/1404476212 learned_addr learned my addr 172.21.15.66:0/1404476212 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0ffff640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac100732d0 0x7fac101f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0effd640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac10072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0f7fe640 1 -- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac100732d0 msgr2=0x7fac101f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0f7fe640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac100732d0 0x7fac101f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0f7fe640 1 -- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 msgr2=0x7fac10072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0f7fe640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac10072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0f7fe640 1 -- 172.21.15.66:0/1404476212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac101f5860 con 0x7fac100b2c80 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0ffff640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac100732d0 0x7fac101f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0effd640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac10072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac0f7fe640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 0x7fac1015d570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac00035040 tx=0x7fac000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00041070 con 0x7fac100b2c80 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0003c460 con 0x7fac100b2c80 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac101f5b40 con 0x7fac100b2c80 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00037040 con 0x7fac100b2c80 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.363+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac10073eb0 con 0x7fac100b2c80 2024-05-10T11:13:03.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.364+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac10072380 con 0x7fac100b2c80 2024-05-10T11:13:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.365+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac00044070 con 0x7fac100b2c80 2024-05-10T11:13:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.365+0000 7fabf7fff640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fabfc0762d0 0x7fabfc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.365+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac000b7f60 con 0x7fac100b2c80 2024-05-10T11:13:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.365+0000 7fac0effd640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fabfc0762d0 0x7fabfc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.366+0000 7fac0effd640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fabfc0762d0 0x7fabfc078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac100b0360 tx=0x7fac04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.370+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fac00081580 con 0x7fac100b2c80 2024-05-10T11:13:03.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.562+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fac1006a220 con 0x7fac100b2c80 2024-05-10T11:13:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.566+0000 7fabf7fff640 1 -- 172.21.15.66:0/1404476212 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fac00080e80 con 0x7fac100b2c80 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fabfc0762d0 msgr2=0x7fabfc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fabfc0762d0 0x7fabfc078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac100b0360 tx=0x7fac04009040 comp rx=0 tx=0).stop 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 msgr2=0x7fac1015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 0x7fac1015d570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac00035040 tx=0x7fac000046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 shutdown_connections 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fabfc0762d0 0x7fabfc078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac100732d0 0x7fac101f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac1015f330 0x7fac10072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 --2- 172.21.15.66:0/1404476212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac100b2c80 0x7fac1015d570 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 >> 172.21.15.66:0/1404476212 conn(0x7fac100cdc80 msgr2=0x7fac100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 shutdown_connections 2024-05-10T11:13:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.568+0000 7fac16093640 1 -- 172.21.15.66:0/1404476212 wait complete. 2024-05-10T11:13:03.580 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:13:03.580 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:13:03.624 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:13:03.672 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:13:03.673 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:03.673 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:03.689 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:03.689 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:03.745 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:03.746 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:03.803 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:13:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.947+0000 7ff20781d640 1 Processor -- start 2024-05-10T11:13:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.947+0000 7ff20781d640 1 -- start start 2024-05-10T11:13:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff20781d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2000d3d80 0x7ff2000b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff20781d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000d2d20 con 0x7ff200162940 2024-05-10T11:13:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff20781d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000d3000 con 0x7ff2000d59d0 2024-05-10T11:13:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff20781d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff200162d20 con 0x7ff2000d3d80 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff204db8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2000d3d80 0x7ff2000b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff2055b9640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff200162940 0x7ff2000d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:35988/0 (socket says 172.21.15.66:35988) 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.948+0000 7ff2055b9640 1 -- 172.21.15.66:0/392694705 learned_addr learned my addr 172.21.15.66:0/392694705 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.949+0000 7ff204db8640 1 -- 172.21.15.66:0/392694705 >> v1:172.21.15.190:6789/0 conn(0x7ff2000d59d0 legacy=0x7ff2000d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.949+0000 7ff204db8640 1 -- 172.21.15.66:0/392694705 >> v1:172.21.15.66:6789/0 conn(0x7ff200162940 legacy=0x7ff2000d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.949+0000 7ff1fffff640 1 -- 172.21.15.66:0/392694705 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116938345 0 0) 0x7ff2000d2d20 con 0x7ff200162940 2024-05-10T11:13:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.949+0000 7ff204db8640 1 -- 172.21.15.66:0/392694705 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2000d32e0 con 0x7ff2000d3d80 2024-05-10T11:13:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.949+0000 7ff204db8640 1 --2- 172.21.15.66:0/392694705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2000d3d80 0x7ff2000b5e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097a0 tx=0x7ff1f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9498dbbb2cdfe30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff1fffff640 1 -- 172.21.15.66:0/392694705 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4037070 con 0x7ff2000d3d80 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff1fffff640 1 -- 172.21.15.66:0/392694705 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f402ae50 con 0x7ff2000d3d80 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff1fffff640 1 -- 172.21.15.66:0/392694705 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4032660 con 0x7ff2000d3d80 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 -- 172.21.15.66:0/392694705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2000d3d80 msgr2=0x7ff2000b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 --2- 172.21.15.66:0/392694705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2000d3d80 0x7ff2000b5e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097a0 tx=0x7ff1f402a140 comp rx=0 tx=0).stop 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 -- 172.21.15.66:0/392694705 shutdown_connections 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 --2- 172.21.15.66:0/392694705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2000d3d80 0x7ff2000b5e20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 -- 172.21.15.66:0/392694705 >> 172.21.15.66:0/392694705 conn(0x7ff20009e380 msgr2=0x7ff2000d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 -- 172.21.15.66:0/392694705 shutdown_connections 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.950+0000 7ff20781d640 1 -- 172.21.15.66:0/392694705 wait complete. 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.951+0000 7ff20781d640 1 Processor -- start 2024-05-10T11:13:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.951+0000 7ff20781d640 1 -- start start 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff20781d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2000d3d80 0x7ff20015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff20781d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2000d59d0 0x7ff2000cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff20781d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 0x7ff20015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff20781d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000d2390 con 0x7ff200162940 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff20781d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000cfc50 con 0x7ff2000d3d80 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff20781d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2000d2510 con 0x7ff2000d59d0 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff205dba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 0x7ff20015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff205dba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 0x7ff20015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46424/0 (socket says 172.21.15.66:46424) 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.952+0000 7ff205dba640 1 -- 172.21.15.66:0/2829915127 learned_addr learned my addr 172.21.15.66:0/2829915127 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff204db8640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2000d59d0 0x7ff2000cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff2055b9640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2000d3d80 0x7ff20015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff205dba640 1 -- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2000d59d0 msgr2=0x7ff2000cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff205dba640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2000d59d0 0x7ff2000cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff205dba640 1 -- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2000d3d80 msgr2=0x7ff20015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff205dba640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2000d3d80 0x7ff20015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff205dba640 1 -- 172.21.15.66:0/2829915127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff200160b40 con 0x7ff200162940 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff204db8640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2000d59d0 0x7ff2000cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff2055b9640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2000d3d80 0x7ff20015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff205dba640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 0x7ff20015d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c780 tx=0x7ff1f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8004b60 con 0x7ff200162940 2024-05-10T11:13:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f8004d00 con 0x7ff200162940 2024-05-10T11:13:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff200160e20 con 0x7ff200162940 2024-05-10T11:13:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800aa90 con 0x7ff200162940 2024-05-10T11:13:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.953+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2000b8070 con 0x7ff200162940 2024-05-10T11:13:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.954+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20006a220 con 0x7ff200162940 2024-05-10T11:13:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.955+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff1f800ac30 con 0x7ff200162940 2024-05-10T11:13:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.955+0000 7ff1fdffb640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1ec0762d0 0x7ff1ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.955+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff1f8097dc0 con 0x7ff200162940 2024-05-10T11:13:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.956+0000 7ff2055b9640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1ec0762d0 0x7ff1ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.956+0000 7ff2055b9640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1ec0762d0 0x7ff1ec078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0000f60 tx=0x7ff1f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:03.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:03.960+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff1f8061470 con 0x7ff200162940 2024-05-10T11:13:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.162+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff2000d2730 con 0x7ff200162940 2024-05-10T11:13:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.162+0000 7ff1fdffb640 1 -- 172.21.15.66:0/2829915127 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff1f8060d70 con 0x7ff200162940 2024-05-10T11:13:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:13:04.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1ec0762d0 msgr2=0x7ff1ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1ec0762d0 0x7ff1ec078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0000f60 tx=0x7ff1f0009040 comp rx=0 tx=0).stop 2024-05-10T11:13:04.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 msgr2=0x7ff20015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 0x7ff20015d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c780 tx=0x7ff1f800cc40 comp rx=0 tx=0).stop 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 shutdown_connections 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1ec0762d0 0x7ff1ec078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff200162940 0x7ff20015d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2000d59d0 0x7ff2000cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 --2- 172.21.15.66:0/2829915127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2000d3d80 0x7ff20015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.164+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 >> 172.21.15.66:0/2829915127 conn(0x7ff20009e380 msgr2=0x7ff2000b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.165+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 shutdown_connections 2024-05-10T11:13:04.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.165+0000 7ff20781d640 1 -- 172.21.15.66:0/2829915127 wait complete. 2024-05-10T11:13:04.176 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:13:04.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:04.177 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-10T11:13:04.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:13:04.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:04.203 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:13:04.259 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:04.260 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:04.280 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:04.280 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:04.339 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:04.340 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:04.398 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:13:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 Processor -- start 2024-05-10T11:13:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 -- start start 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 0x7f47000d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f47000d5d30 0x7f47000d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47000d30b0 con 0x7f470015f790 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f47000d3390 con 0x7f47000d5d30 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.503+0000 7f4705c07640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f47000c8c80 con 0x7f470015f3b0 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46feffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f470015f790 0x7f47000c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36002/0 (socket says 172.21.15.66:36002) 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46feffd640 1 -- 172.21.15.66:0/1365587291 learned_addr learned my addr 172.21.15.66:0/1365587291 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fffff640 1 --2- 172.21.15.66:0/1365587291 >> v2:172.21.15.190:3300/0 conn(0x7f47000d5d30 0x7f47000d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 0x7f47000d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122300232 0 0) 0x7f47000d30b0 con 0x7f470015f790 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e8003520 con 0x7f470015f790 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1713542182 0 0) 0x7f46e8003520 con 0x7f470015f790 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 msgr2=0x7f47000d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 0x7f47000d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 >> v2:172.21.15.190:3300/0 conn(0x7f47000d5d30 msgr2=0x7f47000d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 --2- 172.21.15.66:0/1365587291 >> v2:172.21.15.190:3300/0 conn(0x7f47000d5d30 0x7f47000d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47000c8f60 con 0x7f470015f790 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f46f4001670 con 0x7f470015f790 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 >> v1:172.21.15.66:6789/0 conn(0x7f470015f790 legacy=0x7f47000c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f46e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 0x7f46e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46e8004d40 0x7f46e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47000d3390 con 0x7f46e80039b0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f47000c8c80 con 0x7f46e8004d40 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f46e800b9c0 con 0x7f470015f3b0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f46e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46feffd640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 0x7f46e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.504+0000 7f46fffff640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46e8004d40 0x7f46e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.505+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 msgr2=0x7f46e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.505+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f470015f3b0 0x7f46e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.505+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46e8004d40 msgr2=0x7f46e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.505+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46e8004d40 0x7f46e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.505+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1365587291 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e8003520 con 0x7f46e80039b0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.505+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f46e8003dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009ac0 tx=0x7f46e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5396d16456c050e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0036070 con 0x7f46e80039b0 2024-05-10T11:13:04.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f0031400 con 0x7f46e80039b0 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f46fe7fc640 1 -- 172.21.15.66:0/1365587291 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0009690 con 0x7f46e80039b0 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f4705c07640 1 -- 172.21.15.66:0/1365587291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 msgr2=0x7f46e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f4705c07640 1 --2- 172.21.15.66:0/1365587291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f46e8003dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009ac0 tx=0x7f46e8005830 comp rx=0 tx=0).stop 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f46fffff640 1 -- 172.21.15.66:0/1365587291 reap_dead start 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f4705c07640 1 -- 172.21.15.66:0/1365587291 shutdown_connections 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f4705c07640 1 -- 172.21.15.66:0/1365587291 >> 172.21.15.66:0/1365587291 conn(0x7f47000d5130 msgr2=0x7f47000d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f4705c07640 1 -- 172.21.15.66:0/1365587291 shutdown_connections 2024-05-10T11:13:04.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.506+0000 7f4705c07640 1 -- 172.21.15.66:0/1365587291 wait complete. 2024-05-10T11:13:04.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.507+0000 7f4705c07640 1 Processor -- start 2024-05-10T11:13:04.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 -- start start 2024-05-10T11:13:04.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f47000cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47000bab00 0x7f47001613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47001520e0 0x7f4700152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47000d3870 con 0x7f46e80039b0 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f47000d36f0 con 0x7f47000bab00 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f4705c07640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f47000d39f0 con 0x7f47001520e0 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f47000cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f47000cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46440/0 (socket says 172.21.15.66:46440) 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.508+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1052883221 learned_addr learned my addr 172.21.15.66:0/1052883221 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46fffff640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47001520e0 0x7f4700152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46feffd640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47000bab00 0x7f47001613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47001520e0 msgr2=0x7f4700152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47001520e0 0x7f4700152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47000bab00 msgr2=0x7f47001613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47000bab00 0x7f47001613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46ff7fe640 1 -- 172.21.15.66:0/1052883221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4700152ab0 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46feffd640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47000bab00 0x7f47001613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46ff7fe640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f47000cc200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46f0034040 tx=0x7f46f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0040020 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f0003940 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47000ccb00 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0036040 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.509+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47000cd0c0 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.510+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470006a220 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.511+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46f0043020 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.511+0000 7f46e7fff640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46ec0762d0 0x7f46ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.511+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46f00b7a00 con 0x7f46e80039b0 2024-05-10T11:13:04.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.511+0000 7f46feffd640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46ec0762d0 0x7f46ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:04.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.512+0000 7f46feffd640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46ec0762d0 0x7f46ec078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47000baf00 tx=0x7f46f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:04.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.516+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f46f004a070 con 0x7f46e80039b0 2024-05-10T11:13:04.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.720+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47000c9800 con 0x7f46e80039b0 2024-05-10T11:13:04.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.721+0000 7f46e7fff640 1 -- 172.21.15.66:0/1052883221 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f46f0080a60 con 0x7f46e80039b0 2024-05-10T11:13:04.721 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46ec0762d0 msgr2=0x7f46ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46ec0762d0 0x7f46ec078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47000baf00 tx=0x7f46f4009040 comp rx=0 tx=0).stop 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 msgr2=0x7f47000cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f47000cc200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46f0034040 tx=0x7f46f0004730 comp rx=0 tx=0).stop 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 shutdown_connections 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46ec0762d0 0x7f46ec078790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47001520e0 0x7f4700152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47000bab00 0x7f47001613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 --2- 172.21.15.66:0/1052883221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46e80039b0 0x7f47000cc200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 >> 172.21.15.66:0/1052883221 conn(0x7f47000d5130 msgr2=0x7f47000d20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 shutdown_connections 2024-05-10T11:13:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:04.723+0000 7f4705c07640 1 -- 172.21.15.66:0/1052883221 wait complete. 2024-05-10T11:13:04.735 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-10T11:13:04.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:04.735 DEBUG:teuthology.orchestra.run.smithi190:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-10T11:13:04.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:13:04.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:04.768 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-10T11:13:05.025 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:05.025 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:05.042 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:05.043 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:05.100 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:05.100 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:05.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:13:05.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.304+0000 7fd49d19e640 1 Processor -- start 2024-05-10T11:13:05.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.304+0000 7fd49d19e640 1 -- start start 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49d19e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd498072980 0x7fd49815e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49d19e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd498072480 0x7fd4980cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49d19e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49815d590 con 0x7fd49815a970 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49d19e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd49815dba0 con 0x7fd498072480 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49d19e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd498073d10 con 0x7fd498072980 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49c99d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd498072480 0x7fd4980cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd497fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd49815a970 0x7fd498071d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39240/0 (socket says 172.21.15.66:39240) 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd497fff640 1 -- 172.21.15.66:0/195826201 learned_addr learned my addr 172.21.15.66:0/195826201 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd4977fe640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd498072980 0x7fd49815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49c99d640 1 -- 172.21.15.66:0/195826201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd498072980 msgr2=0x7fd49815e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49c99d640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd498072980 0x7fd49815e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49c99d640 1 -- 172.21.15.66:0/195826201 >> v1:172.21.15.66:6789/0 conn(0x7fd49815a970 legacy=0x7fd498071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd496ffd640 1 -- 172.21.15.66:0/195826201 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224877592 0 0) 0x7fd49815d590 con 0x7fd49815a970 2024-05-10T11:13:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd49c99d640 1 -- 172.21.15.66:0/195826201 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49815d830 con 0x7fd498072480 2024-05-10T11:13:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.305+0000 7fd4977fe640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd498072980 0x7fd49815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.306+0000 7fd49c99d640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd4980cb100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd490009d90 tx=0x7fd49002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d5abb39aa1ccab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd496ffd640 1 -- 172.21.15.66:0/195826201 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490031600 con 0x7fd498072480 2024-05-10T11:13:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd496ffd640 1 -- 172.21.15.66:0/195826201 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4900317a0 con 0x7fd498072480 2024-05-10T11:13:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd496ffd640 1 -- 172.21.15.66:0/195826201 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490031b70 con 0x7fd498072480 2024-05-10T11:13:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 -- 172.21.15.66:0/195826201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 msgr2=0x7fd4980cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd4980cb100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd490009d90 tx=0x7fd49002a5d0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 -- 172.21.15.66:0/195826201 shutdown_connections 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd4980cb100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 --2- 172.21.15.66:0/195826201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd498072980 0x7fd49815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 -- 172.21.15.66:0/195826201 >> 172.21.15.66:0/195826201 conn(0x7fd4980d0ab0 msgr2=0x7fd4980d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 -- 172.21.15.66:0/195826201 shutdown_connections 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.307+0000 7fd49d19e640 1 -- 172.21.15.66:0/195826201 wait complete. 2024-05-10T11:13:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.309+0000 7fd49d19e640 1 Processor -- start 2024-05-10T11:13:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.310+0000 7fd49d19e640 1 -- start start 2024-05-10T11:13:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49d19e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd49814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49d19e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd498072980 0x7fd49815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49d19e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd49815a970 0x7fd49815c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49d19e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815aed0 con 0x7fd498072480 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49d19e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815ad50 con 0x7fd498072980 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49d19e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd4980738a0 con 0x7fd49815a970 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd49814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd49814ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53570/0 (socket says 172.21.15.66:53570) 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 -- 172.21.15.66:0/2410249386 learned_addr learned my addr 172.21.15.66:0/2410249386 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd49c99d640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd49815a970 0x7fd49815c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd4977fe640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd498072980 0x7fd49815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 -- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd49815a970 msgr2=0x7fd49815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd49815a970 0x7fd49815c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 -- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd498072980 msgr2=0x7fd49815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd498072980 0x7fd49815c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.311+0000 7fd497fff640 1 -- 172.21.15.66:0/2410249386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4981f2c90 con 0x7fd498072480 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.312+0000 7fd497fff640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd49814ed70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd48800c4a0 tx=0x7fd48800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.312+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488017070 con 0x7fd498072480 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.312+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd488005ce0 con 0x7fd498072480 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.312+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4981f2f70 con 0x7fd498072480 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.312+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4880072b0 con 0x7fd498072480 2024-05-10T11:13:05.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.312+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49814f900 con 0x7fd498072480 2024-05-10T11:13:05.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.313+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49806a220 con 0x7fd498072480 2024-05-10T11:13:05.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.313+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd48801a070 con 0x7fd498072480 2024-05-10T11:13:05.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.314+0000 7fd494ff9640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4840762d0 0x7fd484078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.314+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd488096c60 con 0x7fd498072480 2024-05-10T11:13:05.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.314+0000 7fd4977fe640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4840762d0 0x7fd484078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.315+0000 7fd4977fe640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4840762d0 0x7fd484078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd49815ce70 tx=0x7fd48c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.319+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd488060310 con 0x7fd498072480 2024-05-10T11:13:05.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.524+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4980d19a0 con 0x7fd498072480 2024-05-10T11:13:05.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.524+0000 7fd494ff9640 1 -- 172.21.15.66:0/2410249386 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fd48805fc10 con 0x7fd498072480 2024-05-10T11:13:05.525 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:13:05.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.526+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4840762d0 msgr2=0x7fd484078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.526+0000 7fd49d19e640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4840762d0 0x7fd484078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd49815ce70 tx=0x7fd48c008040 comp rx=0 tx=0).stop 2024-05-10T11:13:05.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.526+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 msgr2=0x7fd49814ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.526+0000 7fd49d19e640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd49814ed70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd48800c4a0 tx=0x7fd48800c960 comp rx=0 tx=0).stop 2024-05-10T11:13:05.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 shutdown_connections 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4840762d0 0x7fd484078790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd49815a970 0x7fd49815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd498072980 0x7fd49815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 --2- 172.21.15.66:0/2410249386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd498072480 0x7fd49814ed70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 >> 172.21.15.66:0/2410249386 conn(0x7fd4980d0ab0 msgr2=0x7fd498158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 shutdown_connections 2024-05-10T11:13:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.527+0000 7fd49d19e640 1 -- 172.21.15.66:0/2410249386 wait complete. 2024-05-10T11:13:05.538 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-10T11:13:05.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:05.538 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-10T11:13:05.566 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:13:05.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:05.566 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-10T11:13:05.622 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:05.622 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:05.641 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:05.642 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:05.701 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:05.701 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:05.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:13:05.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.864+0000 7fb6f0c2a640 1 Processor -- start 2024-05-10T11:13:05.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.864+0000 7fb6f0c2a640 1 -- start start 2024-05-10T11:13:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6f0c2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec15ce60 0x7fb6ec0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6f0c2a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb6ec1611e0 0x7fb6ec15d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6f0c2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ec0c6a30 con 0x7fb6ec0c65f0 2024-05-10T11:13:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6f0c2a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb6ec0cd090 con 0x7fb6ec1611e0 2024-05-10T11:13:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6f0c2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ec0cd370 con 0x7fb6ec15ce60 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb6ec1611e0 0x7fb6ec15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb6ec1611e0 0x7fb6ec15d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53584/0 (socket says 172.21.15.66:53584) 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 -- 172.21.15.66:0/611157116 learned_addr learned my addr 172.21.15.66:0/611157116 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ea59c640 1 --2- 172.21.15.66:0/611157116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec15ce60 0x7fb6ec0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 -- 172.21.15.66:0/611157116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec15ce60 msgr2=0x7fb6ec0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 --2- 172.21.15.66:0/611157116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec15ce60 0x7fb6ec0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 -- 172.21.15.66:0/611157116 >> v1:172.21.15.190:6789/0 conn(0x7fb6ec0c65f0 legacy=0x7fb6ec160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:05.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.865+0000 7fb6ead9d640 1 -- 172.21.15.66:0/611157116 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ec0cd650 con 0x7fb6ec1611e0 2024-05-10T11:13:05.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.866+0000 7fb6ead9d640 1 --2- 172.21.15.66:0/611157116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec15d240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009e50 tx=0x7fb6e402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15bf85f14b1cfb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.866+0000 7fb6e959a640 1 -- 172.21.15.66:0/611157116 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4036070 con 0x7fb6ec1611e0 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.866+0000 7fb6e959a640 1 -- 172.21.15.66:0/611157116 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e4031600 con 0x7fb6ec1611e0 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.866+0000 7fb6e959a640 1 -- 172.21.15.66:0/611157116 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40319d0 con 0x7fb6ec1611e0 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/611157116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 msgr2=0x7fb6ec15d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/611157116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec15d240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009e50 tx=0x7fb6e402a630 comp rx=0 tx=0).stop 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/611157116 shutdown_connections 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/611157116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec15d240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/611157116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec15ce60 0x7fb6ec0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/611157116 >> 172.21.15.66:0/611157116 conn(0x7fb6ec0b2900 msgr2=0x7fb6ec0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:05.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/611157116 shutdown_connections 2024-05-10T11:13:05.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.867+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/611157116 wait complete. 2024-05-10T11:13:05.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.869+0000 7fb6f0c2a640 1 Processor -- start 2024-05-10T11:13:05.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.869+0000 7fb6f0c2a640 1 -- start start 2024-05-10T11:13:05.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.870+0000 7fb6f0c2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec0c65f0 0x7fb6ec1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.870+0000 7fb6f0c2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6ec15ce60 0x7fb6ec072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6f0c2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6f0c2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec0cde50 con 0x7fb6ec1611e0 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6f0c2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec0ccd60 con 0x7fb6ec15ce60 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6f0c2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ec0cdfd0 con 0x7fb6ec0c65f0 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec073380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53590/0 (socket says 172.21.15.66:53590) 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 -- 172.21.15.66:0/1699436905 learned_addr learned my addr 172.21.15.66:0/1699436905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6e9d9b640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6ec15ce60 0x7fb6ec072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ea59c640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec0c65f0 0x7fb6ec1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 -- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec0c65f0 msgr2=0x7fb6ec1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec0c65f0 0x7fb6ec1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 -- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6ec15ce60 msgr2=0x7fb6ec072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6ec15ce60 0x7fb6ec072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:05.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 -- 172.21.15.66:0/1699436905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ec09bb70 con 0x7fb6ec1611e0 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ea59c640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec0c65f0 0x7fb6ec1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6ead9d640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec073380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009f70 tx=0x7fb6e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4041020 con 0x7fb6ec1611e0 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e4007800 con 0x7fb6ec1611e0 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4036040 con 0x7fb6ec1611e0 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ec152f20 con 0x7fb6ec1611e0 2024-05-10T11:13:05.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.871+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ec09c0c0 con 0x7fb6ec1611e0 2024-05-10T11:13:05.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.872+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ec06a220 con 0x7fb6ec1611e0 2024-05-10T11:13:05.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.873+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6e4044020 con 0x7fb6ec1611e0 2024-05-10T11:13:05.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.873+0000 7fb6daffd640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb6cc076300 0x7fb6cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:05.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.874+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb6e40b85d0 con 0x7fb6ec1611e0 2024-05-10T11:13:05.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.874+0000 7fb6ea59c640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb6cc076300 0x7fb6cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:05.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.874+0000 7fb6ea59c640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb6cc076300 0x7fb6cc0787c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc006fd0 tx=0x7fb6dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:05.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:05.878+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb6e404b030 con 0x7fb6ec1611e0 2024-05-10T11:13:06.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.083+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6ec0af0b0 con 0x7fb6ec1611e0 2024-05-10T11:13:06.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.084+0000 7fb6daffd640 1 -- 172.21.15.66:0/1699436905 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb6ec152f20 con 0x7fb6ec1611e0 2024-05-10T11:13:06.084 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:13:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb6cc076300 msgr2=0x7fb6cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb6cc076300 0x7fb6cc0787c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc006fd0 tx=0x7fb6dc008040 comp rx=0 tx=0).stop 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 msgr2=0x7fb6ec073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec073380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009f70 tx=0x7fb6e4004a40 comp rx=0 tx=0).stop 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 shutdown_connections 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb6cc076300 0x7fb6cc0787c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6ec1611e0 0x7fb6ec073380 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6ec15ce60 0x7fb6ec072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 --2- 172.21.15.66:0/1699436905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6ec0c65f0 0x7fb6ec1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 >> 172.21.15.66:0/1699436905 conn(0x7fb6ec0b2900 msgr2=0x7fb6ec158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 shutdown_connections 2024-05-10T11:13:06.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.086+0000 7fb6f0c2a640 1 -- 172.21.15.66:0/1699436905 wait complete. 2024-05-10T11:13:06.098 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-10T11:13:06.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:06.098 DEBUG:teuthology.orchestra.run.smithi190:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-10T11:13:06.130 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:13:06.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:06.130 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-10T11:13:06.189 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:13:06.189 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:06.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.294+0000 7fe2409d4640 1 Processor -- start 2024-05-10T11:13:06.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.294+0000 7fe2409d4640 1 -- start start 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe2409d4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c0af680 0x7fe23c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe2409d4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23c0b1560 con 0x7fe23c06c800 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe2409d4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23c162ce0 con 0x7fe23c15f070 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe2409d4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c0afb10 con 0x7fe23c0af680 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe23ad9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe23c06c800 0x7fe23c0b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39252/0 (socket says 172.21.15.66:39252) 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe23ad9d640 1 -- 172.21.15.66:0/794528848 learned_addr learned my addr 172.21.15.66:0/794528848 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe239d9b640 1 --2- 172.21.15.66:0/794528848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c0af680 0x7fe23c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760718384 0 0) 0x7fe23c0b1560 con 0x7fe23c06c800 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe224003520 con 0x7fe23c06c800 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369316366 0 0) 0x7fe23c162ce0 con 0x7fe23c15f070 2024-05-10T11:13:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe23c0b1560 con 0x7fe23c15f070 2024-05-10T11:13:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe239d9b640 1 -- 172.21.15.66:0/794528848 >> v1:172.21.15.190:6789/0 conn(0x7fe23c15f070 legacy=0x7fe23c0aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe239d9b640 1 -- 172.21.15.66:0/794528848 >> v1:172.21.15.66:6789/0 conn(0x7fe23c06c800 legacy=0x7fe23c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.295+0000 7fe239d9b640 1 -- 172.21.15.66:0/794528848 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c162fa0 con 0x7fe23c0af680 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.296+0000 7fe239d9b640 1 --2- 172.21.15.66:0/794528848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c0af680 0x7fe23c06c2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2300097d0 tx=0x7fe23002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d53a82479397aa60 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.296+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230037070 con 0x7fe23c0af680 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.296+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe230032440 con 0x7fe23c0af680 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.296+0000 7fe23959a640 1 -- 172.21.15.66:0/794528848 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230032810 con 0x7fe23c0af680 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 -- 172.21.15.66:0/794528848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c0af680 msgr2=0x7fe23c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 --2- 172.21.15.66:0/794528848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c0af680 0x7fe23c06c2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2300097d0 tx=0x7fe23002a210 comp rx=0 tx=0).stop 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 -- 172.21.15.66:0/794528848 shutdown_connections 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 --2- 172.21.15.66:0/794528848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c0af680 0x7fe23c06c2c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 -- 172.21.15.66:0/794528848 >> 172.21.15.66:0/794528848 conn(0x7fe23c0d1d70 msgr2=0x7fe23c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:06.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 -- 172.21.15.66:0/794528848 shutdown_connections 2024-05-10T11:13:06.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.297+0000 7fe2409d4640 1 -- 172.21.15.66:0/794528848 wait complete. 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.298+0000 7fe2409d4640 1 Processor -- start 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 -- start start 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe23c06c800 0x7fe23c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c15f070 0x7fe23c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 0x7fe23c1e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c15f450 con 0x7fe23c1538f0 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c163560 con 0x7fe23c06c800 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe2409d4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c15f760 con 0x7fe23c15f070 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe23ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 0x7fe23c1e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe23ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 0x7fe23c1e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53602/0 (socket says 172.21.15.66:53602) 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.299+0000 7fe23ad9d640 1 -- 172.21.15.66:0/3549053137 learned_addr learned my addr 172.21.15.66:0/3549053137 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe239d9b640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c15f070 0x7fe23c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23a59c640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe23c06c800 0x7fe23c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23ad9d640 1 -- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c15f070 msgr2=0x7fe23c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23ad9d640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c15f070 0x7fe23c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23ad9d640 1 -- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe23c06c800 msgr2=0x7fe23c151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23ad9d640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe23c06c800 0x7fe23c151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23ad9d640 1 -- 172.21.15.66:0/3549053137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c153d90 con 0x7fe23c1538f0 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe23ad9d640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 0x7fe23c1e9450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe23400cba0 tx=0x7fe23400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234017070 con 0x7fe23c1538f0 2024-05-10T11:13:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23400ace0 con 0x7fe23c1538f0 2024-05-10T11:13:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c15f9b0 con 0x7fe23c1538f0 2024-05-10T11:13:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234012620 con 0x7fe23c1538f0 2024-05-10T11:13:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.300+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c15ff70 con 0x7fe23c1538f0 2024-05-10T11:13:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.301+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23c0693f0 con 0x7fe23c1538f0 2024-05-10T11:13:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.302+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe23401a070 con 0x7fe23c1538f0 2024-05-10T11:13:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.302+0000 7fe22affd640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe21c076300 0x7fe21c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.303+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe234097760 con 0x7fe23c1538f0 2024-05-10T11:13:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.303+0000 7fe23a59c640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe21c076300 0x7fe21c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.303+0000 7fe23a59c640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe21c076300 0x7fe21c0787c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe22c007fd0 tx=0x7fe22c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.310+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe234060690 con 0x7fe23c1538f0 2024-05-10T11:13:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.539+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe23c0b4ef0 con 0x7fe23c1538f0 2024-05-10T11:13:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.540+0000 7fe22affd640 1 -- 172.21.15.66:0/3549053137 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fe234064990 con 0x7fe23c1538f0 2024-05-10T11:13:06.541 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:06.541 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:13:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe21c076300 msgr2=0x7fe21c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe21c076300 0x7fe21c0787c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe22c007fd0 tx=0x7fe22c009040 comp rx=0 tx=0).stop 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 msgr2=0x7fe23c1e9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 0x7fe23c1e9450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe23400cba0 tx=0x7fe23400a430 comp rx=0 tx=0).stop 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 shutdown_connections 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe21c076300 0x7fe21c0787c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe23c1538f0 0x7fe23c1e9450 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe23c15f070 0x7fe23c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 --2- 172.21.15.66:0/3549053137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe23c06c800 0x7fe23c151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 >> 172.21.15.66:0/3549053137 conn(0x7fe23c0d1d70 msgr2=0x7fe23c0b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 shutdown_connections 2024-05-10T11:13:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.542+0000 7fe2409d4640 1 -- 172.21.15.66:0/3549053137 wait complete. 2024-05-10T11:13:06.553 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.656+0000 7f5570447640 1 Processor -- start 2024-05-10T11:13:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.656+0000 7f5570447640 1 -- start start 2024-05-10T11:13:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.657+0000 7f5570447640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.657+0000 7f5570447640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f556815f790 0x7f55680d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.657+0000 7f5570447640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f55680d5d30 0x7f55680c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.657+0000 7f5570447640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f55680d30b0 con 0x7f556815f790 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.657+0000 7f5570447640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f55680d3390 con 0x7f55680d5d30 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.657+0000 7f5570447640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55680c8c80 con 0x7f556815f3b0 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f556815f790 0x7f55680d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f556815f790 0x7f55680d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53616/0 (socket says 172.21.15.66:53616) 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 -- 172.21.15.66:0/1154849311 learned_addr learned my addr 172.21.15.66:0/1154849311 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556e1e3640 1 --2- 172.21.15.66:0/1154849311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 -- 172.21.15.66:0/1154849311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 msgr2=0x7f55680d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556e9e4640 1 --2- 172.21.15.66:0/1154849311 >> v2:172.21.15.190:3300/0 conn(0x7f55680d5d30 0x7f55680c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 --2- 172.21.15.66:0/1154849311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 -- 172.21.15.66:0/1154849311 >> v2:172.21.15.190:3300/0 conn(0x7f55680d5d30 msgr2=0x7f55680c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:06.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 --2- 172.21.15.66:0/1154849311 >> v2:172.21.15.190:3300/0 conn(0x7f55680d5d30 0x7f55680c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.658+0000 7f556d9e2640 1 -- 172.21.15.66:0/1154849311 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55680c8f60 con 0x7f556815f790 2024-05-10T11:13:06.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f556d9e2640 1 --2- 172.21.15.66:0/1154849311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f556815f790 0x7f55680d3c30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55680d36a0 tx=0x7f555c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885ab7fb5660f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:06.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f556d1e1640 1 -- 172.21.15.66:0/1154849311 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c036070 con 0x7f556815f790 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f556d1e1640 1 -- 172.21.15.66:0/1154849311 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c031600 con 0x7f556815f790 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f556d1e1640 1 -- 172.21.15.66:0/1154849311 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0319d0 con 0x7f556815f790 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 -- 172.21.15.66:0/1154849311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f556815f790 msgr2=0x7f55680d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 --2- 172.21.15.66:0/1154849311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f556815f790 0x7f55680d3c30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55680d36a0 tx=0x7f555c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 -- 172.21.15.66:0/1154849311 shutdown_connections 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 --2- 172.21.15.66:0/1154849311 >> v2:172.21.15.190:3300/0 conn(0x7f55680d5d30 0x7f55680c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 --2- 172.21.15.66:0/1154849311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f556815f790 0x7f55680d3c30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 --2- 172.21.15.66:0/1154849311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 -- 172.21.15.66:0/1154849311 >> 172.21.15.66:0/1154849311 conn(0x7f55680d5130 msgr2=0x7f55680d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 -- 172.21.15.66:0/1154849311 shutdown_connections 2024-05-10T11:13:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.659+0000 7f5570447640 1 -- 172.21.15.66:0/1154849311 wait complete. 2024-05-10T11:13:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 Processor -- start 2024-05-10T11:13:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 -- start start 2024-05-10T11:13:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55680d5d30 0x7f556815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 0x7f556809fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55680c9e20 con 0x7f55680b9230 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55680c9ca0 con 0x7f55680d5d30 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.661+0000 7f5570447640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55680c9fa0 con 0x7f556815f3b0 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 0x7f556809fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 0x7f556809fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53618/0 (socket says 172.21.15.66:53618) 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 -- 172.21.15.66:0/4259066904 learned_addr learned my addr 172.21.15.66:0/4259066904 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e1e3640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55680d5d30 0x7f556815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556d9e2640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 -- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 msgr2=0x7f55680b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 -- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55680d5d30 msgr2=0x7f556815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55680d5d30 0x7f556815cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 -- 172.21.15.66:0/4259066904 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55680b9b50 con 0x7f55680b9230 2024-05-10T11:13:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e1e3640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55680d5d30 0x7f556815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556d9e2640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f556e9e4640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 0x7f556809fcb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f556000c540 tx=0x7f556000ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560015070 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560004220 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560003610 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556815d140 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.662+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55680ce150 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.663+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556806a220 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.664+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55600037b0 con 0x7f55680b9230 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.664+0000 7f5566ffd640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5554076300 0x7f55540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.665+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5560097570 con 0x7f55680b9230 2024-05-10T11:13:06.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.665+0000 7f556e1e3640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5554076300 0x7f55540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:06.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.665+0000 7f556e1e3640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5554076300 0x7f55540787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5558008890 tx=0x7f5558008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.669+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f55680b9b50 con 0x7f55680b9230 2024-05-10T11:13:06.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.899+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55680d2660 con 0x7f55680b9230 2024-05-10T11:13:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.900+0000 7f5566ffd640 1 -- 172.21.15.66:0/4259066904 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f5560060c20 con 0x7f55680b9230 2024-05-10T11:13:06.900 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:06.900 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:13:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:13:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5554076300 msgr2=0x7f55540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5554076300 0x7f55540787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5558008890 tx=0x7f5558008040 comp rx=0 tx=0).stop 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 msgr2=0x7f556809fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 0x7f556809fcb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f556000c540 tx=0x7f556000ca00 comp rx=0 tx=0).stop 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 shutdown_connections 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5554076300 0x7f55540787c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55680b9230 0x7f556809fcb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556815f3b0 0x7f55680b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 --2- 172.21.15.66:0/4259066904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55680d5d30 0x7f556815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:06.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 >> 172.21.15.66:0/4259066904 conn(0x7f55680d5130 msgr2=0x7f5568075930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:06.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 shutdown_connections 2024-05-10T11:13:06.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:06.902+0000 7f5570447640 1 -- 172.21.15.66:0/4259066904 wait complete. 2024-05-10T11:13:06.913 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:07.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.016+0000 7f8e80f22640 1 Processor -- start 2024-05-10T11:13:07.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.016+0000 7f8e80f22640 1 -- start start 2024-05-10T11:13:07.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e80f22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15f3b0 0x7f8e7c0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e80f22640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8e7c0d5d30 0x7f8e7c0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e80f22640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e7c0d30b0 con 0x7f8e7c15f790 2024-05-10T11:13:07.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e80f22640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8e7c0d3390 con 0x7f8e7c0d5d30 2024-05-10T11:13:07.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e80f22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c0c8c80 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e79d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8e7c15f790 0x7f8e7c0c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39262/0 (socket says 172.21.15.66:39262) 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e79d9b640 1 -- 172.21.15.66:0/1166985848 learned_addr learned my addr 172.21.15.66:0/1166985848 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.017+0000 7f8e7ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8e7c0d5d30 0x7f8e7c0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7a59c640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15f3b0 0x7f8e7c0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7959a640 1 -- 172.21.15.66:0/1166985848 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247960679 0 0) 0x7f8e7c0d30b0 con 0x7f8e7c15f790 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7959a640 1 -- 172.21.15.66:0/1166985848 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e68003520 con 0x7f8e7c15f790 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7ad9d640 1 -- 172.21.15.66:0/1166985848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15f3b0 msgr2=0x7f8e7c0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:07.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7ad9d640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15f3b0 0x7f8e7c0d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7ad9d640 1 -- 172.21.15.66:0/1166985848 >> v1:172.21.15.66:6789/0 conn(0x7f8e7c15f790 legacy=0x7f8e7c0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7ad9d640 1 -- 172.21.15.66:0/1166985848 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c0c8f60 con 0x7f8e7c0d5d30 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7a59c640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15f3b0 0x7f8e7c0d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.018+0000 7f8e7ad9d640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c0d3c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0097a0 tx=0x7f8e6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b219a4209a7c127 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e7959a640 1 -- 172.21.15.66:0/1166985848 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c037070 con 0x7f8e7c0d5d30 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e7959a640 1 -- 172.21.15.66:0/1166985848 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6c032440 con 0x7f8e7c0d5d30 2024-05-10T11:13:07.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e7959a640 1 -- 172.21.15.66:0/1166985848 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0327f0 con 0x7f8e7c0d5d30 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 -- 172.21.15.66:0/1166985848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c0d5d30 msgr2=0x7f8e7c0d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c0d3c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0097a0 tx=0x7f8e6c02a180 comp rx=0 tx=0).stop 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 -- 172.21.15.66:0/1166985848 shutdown_connections 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c0d3c30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 --2- 172.21.15.66:0/1166985848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15f3b0 0x7f8e7c0d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 -- 172.21.15.66:0/1166985848 >> 172.21.15.66:0/1166985848 conn(0x7f8e7c0d5130 msgr2=0x7f8e7c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 -- 172.21.15.66:0/1166985848 shutdown_connections 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.019+0000 7f8e80f22640 1 -- 172.21.15.66:0/1166985848 wait complete. 2024-05-10T11:13:07.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 Processor -- start 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 -- start start 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 0x7f8e7c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15b070 0x7f8e7c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c0d0e60 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c0d0ce0 con 0x7f8e7c0d5d30 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.021+0000 7f8e80f22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c0d0fe0 con 0x7f8e7c15b070 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 0x7f8e7c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 0x7f8e7c15ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53630/0 (socket says 172.21.15.66:53630) 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 -- 172.21.15.66:0/2499399160 learned_addr learned my addr 172.21.15.66:0/2499399160 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e7ad9d640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15b070 0x7f8e7c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e7a59c640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 -- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15b070 msgr2=0x7f8e7c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15b070 0x7f8e7c0ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 -- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e7c0d5d30 msgr2=0x7f8e7c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 -- 172.21.15.66:0/2499399160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c0cc450 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e79d9b640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 0x7f8e7c15ab30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e64001eb0 tx=0x7f8e6400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64017070 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e64005d00 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c0cc730 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64007310 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.022+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c0cccf0 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.023+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c06a220 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.024+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e6401a070 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.024+0000 7f8e72ffd640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e5c0762d0 0x7f8e5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.025+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e64096cd0 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.025+0000 7f8e7a59c640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e5c0762d0 0x7f8e5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.025+0000 7f8e7a59c640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e5c0762d0 0x7f8e5c078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009f70 tx=0x7f8e7400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.029+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8e640602f0 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.221+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e7c06dca0 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.223+0000 7f8e72ffd640 1 -- 172.21.15.66:0/2499399160 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f8e6405fbf0 con 0x7f8e7c15f3b0 2024-05-10T11:13:07.223 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:07.224 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e5c0762d0 msgr2=0x7f8e5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e5c0762d0 0x7f8e5c078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009f70 tx=0x7f8e7400b040 comp rx=0 tx=0).stop 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 msgr2=0x7f8e7c15ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 0x7f8e7c15ab30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e64001eb0 tx=0x7f8e6400c820 comp rx=0 tx=0).stop 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 shutdown_connections 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e5c0762d0 0x7f8e5c078790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e7c15b070 0x7f8e7c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15f3b0 0x7f8e7c15ab30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 --2- 172.21.15.66:0/2499399160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e7c0d5d30 0x7f8e7c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 >> 172.21.15.66:0/2499399160 conn(0x7f8e7c0d5130 msgr2=0x7f8e7c0cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:07.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 shutdown_connections 2024-05-10T11:13:07.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.225+0000 7f8e80f22640 1 -- 172.21.15.66:0/2499399160 wait complete. 2024-05-10T11:13:07.237 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:13:07.237 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.340+0000 7f5033a72640 1 Processor -- start 2024-05-10T11:13:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.340+0000 7f5033a72640 1 -- start start 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f5033a72640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f502c1598c0 0x7f502c06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f5033a72640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f502c06ec40 0x7f502c0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f5033a72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c06f1c0 con 0x7f502c0c71c0 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f5033a72640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f502c0c7610 con 0x7f502c1598c0 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f5033a72640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f502c06f4a0 con 0x7f502c06ec40 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f502c1598c0 0x7f502c06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f502c1598c0 0x7f502c06e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53640/0 (socket says 172.21.15.66:53640) 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 -- 172.21.15.66:0/1188211067 learned_addr learned my addr 172.21.15.66:0/1188211067 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503100d640 1 --2- 172.21.15.66:0/1188211067 >> v2:172.21.15.190:3300/0 conn(0x7f502c06ec40 0x7f502c0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 -- 172.21.15.66:0/1188211067 >> v2:172.21.15.190:3300/0 conn(0x7f502c06ec40 msgr2=0x7f502c0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 --2- 172.21.15.66:0/1188211067 >> v2:172.21.15.190:3300/0 conn(0x7f502c06ec40 0x7f502c0c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 -- 172.21.15.66:0/1188211067 >> v1:172.21.15.190:6789/0 conn(0x7f502c0c71c0 legacy=0x7f502c15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:07.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.341+0000 7f503180e640 1 -- 172.21.15.66:0/1188211067 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c06f780 con 0x7f502c1598c0 2024-05-10T11:13:07.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.342+0000 7f503180e640 1 --2- 172.21.15.66:0/1188211067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c1598c0 0x7f502c06e700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f502c070400 tx=0x7f502802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c769b8d23e263fbd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.342+0000 7f503080c640 1 -- 172.21.15.66:0/1188211067 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028037070 con 0x7f502c1598c0 2024-05-10T11:13:07.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.342+0000 7f503080c640 1 -- 172.21.15.66:0/1188211067 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5028032440 con 0x7f502c1598c0 2024-05-10T11:13:07.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.342+0000 7f503080c640 1 -- 172.21.15.66:0/1188211067 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028032810 con 0x7f502c1598c0 2024-05-10T11:13:07.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 -- 172.21.15.66:0/1188211067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c1598c0 msgr2=0x7f502c06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 --2- 172.21.15.66:0/1188211067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c1598c0 0x7f502c06e700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f502c070400 tx=0x7f502802a230 comp rx=0 tx=0).stop 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 -- 172.21.15.66:0/1188211067 shutdown_connections 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 --2- 172.21.15.66:0/1188211067 >> v2:172.21.15.190:3300/0 conn(0x7f502c06ec40 0x7f502c0c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 --2- 172.21.15.66:0/1188211067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c1598c0 0x7f502c06e700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 -- 172.21.15.66:0/1188211067 >> 172.21.15.66:0/1188211067 conn(0x7f502c0b2900 msgr2=0x7f502c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 -- 172.21.15.66:0/1188211067 shutdown_connections 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.343+0000 7f5033a72640 1 -- 172.21.15.66:0/1188211067 wait complete. 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.344+0000 7f5033a72640 1 Processor -- start 2024-05-10T11:13:07.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.344+0000 7f5033a72640 1 -- start start 2024-05-10T11:13:07.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f5033a72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 0x7f502c1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f5033a72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f502c0c71c0 0x7f502c0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f5033a72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f502c1598c0 0x7f502c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f5033a72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f502c15c6e0 con 0x7f502c06ec40 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f5033a72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0ce920 con 0x7f502c1598c0 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f5033a72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f502c159ca0 con 0x7f502c0c71c0 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 0x7f502c1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 0x7f502c1488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53654/0 (socket says 172.21.15.66:53654) 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 -- 172.21.15.66:0/3446772612 learned_addr learned my addr 172.21.15.66:0/3446772612 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 -- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f502c0c71c0 msgr2=0x7f502c0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503200f640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f502c1598c0 0x7f502c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503100d640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f502c0c71c0 0x7f502c0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f502c0c71c0 0x7f502c0cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 -- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f502c1598c0 msgr2=0x7f502c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f502c1598c0 0x7f502c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 -- 172.21.15.66:0/3446772612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c0aff30 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503200f640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f502c1598c0 0x7f502c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503100d640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f502c0c71c0 0x7f502c0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.345+0000 7f503180e640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 0x7f502c1488d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f502802a270 tx=0x7f50280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.346+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028041020 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.346+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50280306c0 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.346+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028037040 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.346+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c15e240 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.346+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c15ed20 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.347+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c06a220 con 0x7f502c06ec40 2024-05-10T11:13:07.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.347+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5028044020 con 0x7f502c06ec40 2024-05-10T11:13:07.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.348+0000 7f50227fc640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50100762d0 0x7f5010078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.348+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f50280b80c0 con 0x7f502c06ec40 2024-05-10T11:13:07.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.348+0000 7f503100d640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50100762d0 0x7f5010078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.349+0000 7f503100d640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50100762d0 0x7f5010078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f502c1f6740 tx=0x7f501c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.353+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f502804b030 con 0x7f502c06ec40 2024-05-10T11:13:07.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.582+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f502c06e4e0 con 0x7f502c06ec40 2024-05-10T11:13:07.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.582+0000 7f50227fc640 1 -- 172.21.15.66:0/3446772612 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f5028081770 con 0x7f502c06ec40 2024-05-10T11:13:07.583 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:07.583 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:13:07.584 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:13:07.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50100762d0 msgr2=0x7f5010078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50100762d0 0x7f5010078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f502c1f6740 tx=0x7f501c008040 comp rx=0 tx=0).stop 2024-05-10T11:13:07.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 msgr2=0x7f502c1488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 0x7f502c1488d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f502802a270 tx=0x7f50280046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 shutdown_connections 2024-05-10T11:13:07.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50100762d0 0x7f5010078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f502c1598c0 0x7f502c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f502c0c71c0 0x7f502c0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 --2- 172.21.15.66:0/3446772612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f502c06ec40 0x7f502c1488d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.584+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 >> 172.21.15.66:0/3446772612 conn(0x7f502c0b2900 msgr2=0x7f502c15f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.585+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 shutdown_connections 2024-05-10T11:13:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.585+0000 7f5033a72640 1 -- 172.21.15.66:0/3446772612 wait complete. 2024-05-10T11:13:07.596 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.700+0000 7f55b8ea7640 1 Processor -- start 2024-05-10T11:13:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.700+0000 7f55b8ea7640 1 -- start start 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.701+0000 7f55b8ea7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 0x7f55b40b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.701+0000 7f55b8ea7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b40d41f0 con 0x7f55b40b5900 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.701+0000 7f55b8ea7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b40d5eb0 con 0x7f55b40b5520 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.701+0000 7f55b8ea7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55b40d5c60 con 0x7f55b40d1fb0 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.701+0000 7f55b2d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f55b40b5900 0x7f55b40b86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39278/0 (socket says 172.21.15.66:39278) 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.701+0000 7f55b2d9d640 1 -- 172.21.15.66:0/22216624 learned_addr learned my addr 172.21.15.66:0/22216624 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b1d9b640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 0x7f55b40b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759050082 0 0) 0x7f55b40d41f0 con 0x7f55b40b5900 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55a0003520 con 0x7f55b40b5900 2024-05-10T11:13:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085118622 0 0) 0x7f55a0003520 con 0x7f55b40b5900 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 msgr2=0x7f55b40b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 0x7f55b40b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 >> v1:172.21.15.190:6789/0 conn(0x7f55b40b5520 legacy=0x7f55b40d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b40d0a30 con 0x7f55b40b5900 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f55a4001670 con 0x7f55b40b5900 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 >> v1:172.21.15.66:6789/0 conn(0x7f55b40b5900 legacy=0x7f55b40b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a00039e0 0x7f55a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a0004800 0x7f55a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 0x7f55a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40d5c60 con 0x7f55a00039e0 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55a000baa0 con 0x7f55a0004800 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55a000bca0 con 0x7f55b40d1fb0 2024-05-10T11:13:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b259c640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a00039e0 0x7f55a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b1d9b640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a0004800 0x7f55a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.702+0000 7f55b2d9d640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 0x7f55a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b259c640 1 -- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 msgr2=0x7f55a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b259c640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40d1fb0 0x7f55a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b259c640 1 -- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a0004800 msgr2=0x7f55a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b259c640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a0004800 0x7f55a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b259c640 1 -- 172.21.15.66:0/22216624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a0003520 con 0x7f55a00039e0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b259c640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a00039e0 0x7f55a0003e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55ac001e50 tx=0x7f55a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741dfafa681a7b43 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac001a70 con 0x7f55a00039e0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac003970 con 0x7f55a00039e0 2024-05-10T11:13:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.703+0000 7f55b159a640 1 -- 172.21.15.66:0/22216624 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac003d60 con 0x7f55a00039e0 2024-05-10T11:13:07.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b8ea7640 1 -- 172.21.15.66:0/22216624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a00039e0 msgr2=0x7f55a0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/22216624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a00039e0 0x7f55a0003e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55ac001e50 tx=0x7f55a0005830 comp rx=0 tx=0).stop 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b2d9d640 1 -- 172.21.15.66:0/22216624 reap_dead start 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b8ea7640 1 -- 172.21.15.66:0/22216624 shutdown_connections 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b8ea7640 1 -- 172.21.15.66:0/22216624 >> 172.21.15.66:0/22216624 conn(0x7f55b40d5170 msgr2=0x7f55b40d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b8ea7640 1 -- 172.21.15.66:0/22216624 shutdown_connections 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.704+0000 7f55b8ea7640 1 -- 172.21.15.66:0/22216624 wait complete. 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.705+0000 7f55b8ea7640 1 Processor -- start 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 -- start start 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a00039e0 0x7f55b406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 0x7f55b40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40cee10 0x7f55b414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40b6460 con 0x7f55b41617b0 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40b62e0 con 0x7f55b40cee10 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b8ea7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55b40b65e0 con 0x7f55a00039e0 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 0x7f55b40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 0x7f55b40ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53666/0 (socket says 172.21.15.66:53666) 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.706+0000 7f55b1d9b640 1 -- 172.21.15.66:0/1674076654 learned_addr learned my addr 172.21.15.66:0/1674076654 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b259c640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a00039e0 0x7f55b406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b2d9d640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40cee10 0x7f55b414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b1d9b640 1 -- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a00039e0 msgr2=0x7f55b406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b1d9b640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a00039e0 0x7f55b406e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b1d9b640 1 -- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40cee10 msgr2=0x7f55b414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b1d9b640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40cee10 0x7f55b414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b1d9b640 1 -- 172.21.15.66:0/1674076654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b40cf450 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b1d9b640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 0x7f55b40ce8d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f559c011990 tx=0x7f559c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c00fa70 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c00fc30 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b41520d0 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c014440 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.707+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b4160cd0 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.708+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b40693f0 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.709+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f559c012040 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.709+0000 7f55aaffd640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55940762d0 0x7f5594078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.709+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f559c097ce0 con 0x7f55b41617b0 2024-05-10T11:13:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.709+0000 7f55b259c640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55940762d0 0x7f5594078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.710+0000 7f55b259c640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55940762d0 0x7f5594078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55ac032000 tx=0x7f55ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:07.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.714+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f559c019030 con 0x7f55b41617b0 2024-05-10T11:13:07.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.949+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55b40d3d90 con 0x7f55b41617b0 2024-05-10T11:13:07.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.949+0000 7f55aaffd640 1 -- 172.21.15.66:0/1674076654 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f559c060d40 con 0x7f55b41617b0 2024-05-10T11:13:07.950 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:07.950 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633531639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2633531639},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633531639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1403592978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":1403592978},{"type":"v1","addr":"172.21.15.66:6835","nonce":1403592978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/2890975932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2890975932},{"type":"v1","addr":"172.21.15.66:6834","nonce":2890975932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:12:30.471760+0000","modified":"2024-05-10T11:12:43.531893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3761141260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3761141260},{"type":"v1","addr":"172.21.15.190:6836","nonce":3761141260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-10T11:13:07.950 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55940762d0 msgr2=0x7f5594078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55940762d0 0x7f5594078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55ac032000 tx=0x7f55ac02e000 comp rx=0 tx=0).stop 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 msgr2=0x7f55b40ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 0x7f55b40ce8d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f559c011990 tx=0x7f559c011e50 comp rx=0 tx=0).stop 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 shutdown_connections 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55940762d0 0x7f5594078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40cee10 0x7f55b414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b41617b0 0x7f55b40ce8d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 --2- 172.21.15.66:0/1674076654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a00039e0 0x7f55b406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:07.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.951+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 >> 172.21.15.66:0/1674076654 conn(0x7f55b40d5170 msgr2=0x7f55b40d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:07.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.952+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 shutdown_connections 2024-05-10T11:13:07.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:07.952+0000 7f55b8ea7640 1 -- 172.21.15.66:0/1674076654 wait complete. 2024-05-10T11:13:07.963 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.066+0000 7f50a6e6b640 1 Processor -- start 2024-05-10T11:13:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.066+0000 7f50a6e6b640 1 -- start start 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a6e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a00d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a6e6b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f50a0072ab0 0x7f50a00cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a6e6b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a00cf210 con 0x7f50a00d0850 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a6e6b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f50a0073300 con 0x7f50a0072ab0 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a6e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50a00cf4f0 con 0x7f50a015f330 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a5408640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f50a0072ab0 0x7f50a00cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f509ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f50a00d0850 0x7f50a00723a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39286/0 (socket says 172.21.15.66:39286) 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f509ffff640 1 -- 172.21.15.66:0/2994179907 learned_addr learned my addr 172.21.15.66:0/2994179907 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a4c07640 1 --2- 172.21.15.66:0/2994179907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a00d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.067+0000 7f50a5408640 1 -- 172.21.15.66:0/2994179907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 msgr2=0x7f50a00d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f50a5408640 1 --2- 172.21.15.66:0/2994179907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a00d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f50a5408640 1 -- 172.21.15.66:0/2994179907 >> v1:172.21.15.66:6789/0 conn(0x7f50a00d0850 legacy=0x7f50a00723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f509f7fe640 1 -- 172.21.15.66:0/2994179907 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406163427 0 0) 0x7f50a00cf210 con 0x7f50a00d0850 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f50a5408640 1 -- 172.21.15.66:0/2994179907 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a00cf7d0 con 0x7f50a0072ab0 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f50a5408640 1 --2- 172.21.15.66:0/2994179907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a0072ab0 0x7f50a00cb730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5098009d90 tx=0x7f509802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54349d3bc3ac8451 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f509f7fe640 1 -- 172.21.15.66:0/2994179907 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098007740 con 0x7f50a0072ab0 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f509f7fe640 1 -- 172.21.15.66:0/2994179907 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50980078e0 con 0x7f50a0072ab0 2024-05-10T11:13:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.068+0000 7f509f7fe640 1 -- 172.21.15.66:0/2994179907 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098007cb0 con 0x7f50a0072ab0 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 -- 172.21.15.66:0/2994179907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a0072ab0 msgr2=0x7f50a00cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/2994179907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a0072ab0 0x7f50a00cb730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5098009d90 tx=0x7f509802a660 comp rx=0 tx=0).stop 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 -- 172.21.15.66:0/2994179907 shutdown_connections 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/2994179907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a0072ab0 0x7f50a00cb730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/2994179907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a00d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 -- 172.21.15.66:0/2994179907 >> 172.21.15.66:0/2994179907 conn(0x7f50a00d10e0 msgr2=0x7f50a00d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 -- 172.21.15.66:0/2994179907 shutdown_connections 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.069+0000 7f50a6e6b640 1 -- 172.21.15.66:0/2994179907 wait complete. 2024-05-10T11:13:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.070+0000 7f50a6e6b640 1 Processor -- start 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.070+0000 7f50a6e6b640 1 -- start start 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a6e6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a0072ab0 0x7f50a015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a6e6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 0x7f50a015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a6e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a6e6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00cbc70 con 0x7f50a00d0850 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a6e6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00ceec0 con 0x7f50a0072ab0 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a6e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50a00cbdf0 con 0x7f50a015f330 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f509ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 0x7f50a015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f509ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 0x7f50a015dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53670/0 (socket says 172.21.15.66:53670) 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f509ffff640 1 -- 172.21.15.66:0/3828053675 learned_addr learned my addr 172.21.15.66:0/3828053675 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a5408640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.071+0000 7f50a4c07640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a0072ab0 0x7f50a015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509ffff640 1 -- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 msgr2=0x7f50a0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509ffff640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a0154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509ffff640 1 -- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a0072ab0 msgr2=0x7f50a015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509ffff640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a0072ab0 0x7f50a015f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509ffff640 1 -- 172.21.15.66:0/3828053675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a015fcf0 con 0x7f50a00d0850 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509ffff640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 0x7f50a015dcc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f509400c500 tx=0x7f509400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094018070 con 0x7f50a00d0850 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094007580 con 0x7f50a00d0850 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a015ffd0 con 0x7f50a00d0850 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094004a20 con 0x7f50a00d0850 2024-05-10T11:13:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.072+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a0160590 con 0x7f50a00d0850 2024-05-10T11:13:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.073+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a006a220 con 0x7f50a00d0850 2024-05-10T11:13:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.074+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f509401b070 con 0x7f50a00d0850 2024-05-10T11:13:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.074+0000 7f509d7fa640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f508c0762d0 0x7f508c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.074+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5094096b70 con 0x7f50a00d0850 2024-05-10T11:13:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.074+0000 7f50a4c07640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f508c0762d0 0x7f508c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.075+0000 7f50a4c07640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f508c0762d0 0x7f508c078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50900079a0 tx=0x7f5090008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.079+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f509405fbd0 con 0x7f50a00d0850 2024-05-10T11:13:08.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.270+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50a00b7060 con 0x7f50a00d0850 2024-05-10T11:13:08.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.271+0000 7f509d7fa640 1 -- 172.21.15.66:0/3828053675 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18514 (secure 0 0 0) 0x7f5094068210 con 0x7f50a00d0850 2024-05-10T11:13:08.272 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:08.272 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:12:35.506491+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:12:28.361614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T11:12:29.425925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T11:12:33.110522+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f508c0762d0 msgr2=0x7f508c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f508c0762d0 0x7f508c078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50900079a0 tx=0x7f5090008040 comp rx=0 tx=0).stop 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 msgr2=0x7f50a015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 0x7f50a015dcc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f509400c500 tx=0x7f509400c9c0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 shutdown_connections 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f508c0762d0 0x7f508c078790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a015f330 0x7f50a0154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50a00d0850 0x7f50a015dcc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 --2- 172.21.15.66:0/3828053675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a0072ab0 0x7f50a015f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 >> 172.21.15.66:0/3828053675 conn(0x7f50a00d10e0 msgr2=0x7f50a00aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 shutdown_connections 2024-05-10T11:13:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.273+0000 7f50a6e6b640 1 -- 172.21.15.66:0/3828053675 wait complete. 2024-05-10T11:13:08.285 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:13:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.389+0000 7fd476a47640 1 Processor -- start 2024-05-10T11:13:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.389+0000 7fd476a47640 1 -- start start 2024-05-10T11:13:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd476a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 0x7fd4700cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd476a47640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700ce590 con 0x7fd47015d650 2024-05-10T11:13:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd476a47640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700d0500 con 0x7fd4700b43a0 2024-05-10T11:13:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd476a47640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd47015da30 con 0x7fd4700d3980 2024-05-10T11:13:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd46ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd47015d650 0x7fd4700cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39302/0 (socket says 172.21.15.66:39302) 2024-05-10T11:13:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd46ffff640 1 -- 172.21.15.66:0/3749840313 learned_addr learned my addr 172.21.15.66:0/3749840313 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd46f7fe640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 0x7fd4700cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863665155 0 0) 0x7fd460001110 con 0x7fd47015d650 2024-05-10T11:13:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.390+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd458003520 con 0x7fd47015d650 2024-05-10T11:13:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288008890 0 0) 0x7fd4700d0500 con 0x7fd4700b43a0 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd460001110 con 0x7fd4700b43a0 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4009314038 0 0) 0x7fd458003520 con 0x7fd47015d650 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 msgr2=0x7fd4700cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 0x7fd4700cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 >> v1:172.21.15.190:6789/0 conn(0x7fd4700b43a0 legacy=0x7fd4700b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4700ce810 con 0x7fd47015d650 2024-05-10T11:13:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fd460001840 con 0x7fd47015d650 2024-05-10T11:13:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 >> v1:172.21.15.66:6789/0 conn(0x7fd47015d650 legacy=0x7fd4700cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd458003b70 0x7fd458003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458004800 0x7fd458004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 0x7fd4580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd45800ba70 con 0x7fd458003b70 2024-05-10T11:13:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd45800bbf0 con 0x7fd458004800 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd45800bdf0 con 0x7fd4700d3980 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46ffff640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd458003b70 0x7fd458003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd474fe4640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 0x7fd4580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46f7fe640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458004800 0x7fd458004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46ffff640 1 -- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 msgr2=0x7fd4580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46ffff640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700d3980 0x7fd4580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46ffff640 1 -- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458004800 msgr2=0x7fd458004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46ffff640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458004800 0x7fd458004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.391+0000 7fd46ffff640 1 -- 172.21.15.66:0/3749840313 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd458003520 con 0x7fd458003b70 2024-05-10T11:13:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.392+0000 7fd46ffff640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd458003b70 0x7fd458003f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c270 tx=0x7fd458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852f59913a876b12 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.392+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460036070 con 0x7fd458003b70 2024-05-10T11:13:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.392+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd460005ad0 con 0x7fd458003b70 2024-05-10T11:13:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.392+0000 7fd46effd640 1 -- 172.21.15.66:0/3749840313 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460007db0 con 0x7fd458003b70 2024-05-10T11:13:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd476a47640 1 -- 172.21.15.66:0/3749840313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd458003b70 msgr2=0x7fd458003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd476a47640 1 --2- 172.21.15.66:0/3749840313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd458003b70 0x7fd458003f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c270 tx=0x7fd458005830 comp rx=0 tx=0).stop 2024-05-10T11:13:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd474fe4640 1 -- 172.21.15.66:0/3749840313 reap_dead start 2024-05-10T11:13:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd476a47640 1 -- 172.21.15.66:0/3749840313 shutdown_connections 2024-05-10T11:13:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd476a47640 1 -- 172.21.15.66:0/3749840313 >> 172.21.15.66:0/3749840313 conn(0x7fd4700d2df0 msgr2=0x7fd4700d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd476a47640 1 -- 172.21.15.66:0/3749840313 shutdown_connections 2024-05-10T11:13:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.393+0000 7fd476a47640 1 -- 172.21.15.66:0/3749840313 wait complete. 2024-05-10T11:13:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.394+0000 7fd476a47640 1 Processor -- start 2024-05-10T11:13:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.394+0000 7fd476a47640 1 -- start start 2024-05-10T11:13:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd476a47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458003b70 0x7fd4701f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd476a47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 0x7fd47006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd476a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700c6c40 0x7fd47006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd476a47640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4700cfc50 con 0x7fd4700c67c0 2024-05-10T11:13:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd476a47640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4700cedd0 con 0x7fd458003b70 2024-05-10T11:13:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd476a47640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd4700cfdd0 con 0x7fd4700c6c40 2024-05-10T11:13:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 0x7fd47006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 0x7fd47006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53684/0 (socket says 172.21.15.66:53684) 2024-05-10T11:13:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 -- 172.21.15.66:0/535925348 learned_addr learned my addr 172.21.15.66:0/535925348 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46ffff640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458003b70 0x7fd4701f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd474fe4640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700c6c40 0x7fd47006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 -- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700c6c40 msgr2=0x7fd47006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700c6c40 0x7fd47006e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 -- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458003b70 msgr2=0x7fd4701f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458003b70 0x7fd4701f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 -- 172.21.15.66:0/535925348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4700c9ff0 con 0x7fd4700c67c0 2024-05-10T11:13:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.395+0000 7fd46f7fe640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 0x7fd47006dde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd464011910 tx=0x7fd464011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.396+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46400fa90 con 0x7fd4700c67c0 2024-05-10T11:13:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.396+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46400fc30 con 0x7fd4700c67c0 2024-05-10T11:13:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.396+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4700ca2d0 con 0x7fd4700c67c0 2024-05-10T11:13:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.396+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464014440 con 0x7fd4700c67c0 2024-05-10T11:13:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.396+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4700ca890 con 0x7fd4700c67c0 2024-05-10T11:13:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.397+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd47006a220 con 0x7fd4700c67c0 2024-05-10T11:13:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.397+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd464012040 con 0x7fd4700c67c0 2024-05-10T11:13:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.398+0000 7fd46cff9640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd45c076300 0x7fd45c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.398+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd464097e50 con 0x7fd4700c67c0 2024-05-10T11:13:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.398+0000 7fd46ffff640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd45c076300 0x7fd45c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.399+0000 7fd46ffff640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd45c076300 0x7fd45c0787c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd460033000 tx=0x7fd46002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.403+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd464019030 con 0x7fd4700c67c0 2024-05-10T11:13:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.641+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd4700ce090 con 0x7fd4700c67c0 2024-05-10T11:13:08.641 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:13:08.641+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:13:08.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.643+0000 7fd46cff9640 1 -- 172.21.15.66:0/535925348 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fd464061500 con 0x7fd4700c67c0 2024-05-10T11:13:08.643 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd45c076300 msgr2=0x7fd45c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd45c076300 0x7fd45c0787c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd460033000 tx=0x7fd46002e000 comp rx=0 tx=0).stop 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 msgr2=0x7fd47006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 0x7fd47006dde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd464011910 tx=0x7fd464011dd0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 shutdown_connections 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd45c076300 0x7fd45c0787c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700c6c40 0x7fd47006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4700c67c0 0x7fd47006dde0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 --2- 172.21.15.66:0/535925348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd458003b70 0x7fd4701f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 >> 172.21.15.66:0/535925348 conn(0x7fd4700d2df0 msgr2=0x7fd4700cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 shutdown_connections 2024-05-10T11:13:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.646+0000 7fd476a47640 1 -- 172.21.15.66:0/535925348 wait complete. 2024-05-10T11:13:08.649 INFO:tasks.ceph.mds.b.smithi190.stderr: -4065> 2024-05-10T11:12:36.073+0000 7f3328496640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:13:08.658 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:13:08.682 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:13:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.764+0000 7f06991e4640 1 Processor -- start 2024-05-10T11:13:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.764+0000 7f06991e4640 1 -- start start 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f06991e4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0694162ce0 0x7f06940b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f06991e4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06940b4e20 0x7f06940d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f06991e4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06940d4190 con 0x7f0694162900 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f06991e4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f06940cfc40 con 0x7f06940b4e20 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f06991e4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f06940d3eb0 con 0x7f0694162ce0 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06940b4e20 0x7f06940d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06940b4e20 0x7f06940d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53696/0 (socket says 172.21.15.66:53696) 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 -- 172.21.15.66:0/2685133722 learned_addr learned my addr 172.21.15.66:0/2685133722 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f068a59c640 1 --2- 172.21.15.66:0/2685133722 >> v2:172.21.15.190:3300/0 conn(0x7f0694162ce0 0x7f06940b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 -- 172.21.15.66:0/2685133722 >> v2:172.21.15.190:3300/0 conn(0x7f0694162ce0 msgr2=0x7f06940b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:08.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 --2- 172.21.15.66:0/2685133722 >> v2:172.21.15.190:3300/0 conn(0x7f0694162ce0 0x7f06940b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 -- 172.21.15.66:0/2685133722 >> v1:172.21.15.190:6789/0 conn(0x7f0694162900 legacy=0x7f06940d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.765+0000 7f069359e640 1 -- 172.21.15.66:0/2685133722 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06940cfee0 con 0x7f06940b4e20 2024-05-10T11:13:08.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.766+0000 7f069359e640 1 --2- 172.21.15.66:0/2685133722 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940d09c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f06940c8bc0 tx=0x7f068c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8273b0e6e904b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.766+0000 7f069259c640 1 -- 172.21.15.66:0/2685133722 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c036070 con 0x7f06940b4e20 2024-05-10T11:13:08.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.766+0000 7f069259c640 1 -- 172.21.15.66:0/2685133722 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068c031600 con 0x7f06940b4e20 2024-05-10T11:13:08.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.766+0000 7f069259c640 1 -- 172.21.15.66:0/2685133722 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c0319d0 con 0x7f06940b4e20 2024-05-10T11:13:08.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 -- 172.21.15.66:0/2685133722 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 msgr2=0x7f06940d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 --2- 172.21.15.66:0/2685133722 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940d09c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f06940c8bc0 tx=0x7f068c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 -- 172.21.15.66:0/2685133722 shutdown_connections 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 --2- 172.21.15.66:0/2685133722 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940d09c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 --2- 172.21.15.66:0/2685133722 >> v2:172.21.15.190:3300/0 conn(0x7f0694162ce0 0x7f06940b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 -- 172.21.15.66:0/2685133722 >> 172.21.15.66:0/2685133722 conn(0x7f069409e430 msgr2=0x7f06940d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 -- 172.21.15.66:0/2685133722 shutdown_connections 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.767+0000 7f06991e4640 1 -- 172.21.15.66:0/2685133722 wait complete. 2024-05-10T11:13:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.768+0000 7f06991e4640 1 Processor -- start 2024-05-10T11:13:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.768+0000 7f06991e4640 1 -- start start 2024-05-10T11:13:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f06991e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f06991e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0694162900 0x7f069415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f06991e4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0694162ce0 0x7f06940ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f06991e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f06940b4180 con 0x7f06940b4e20 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f06991e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06940d3b20 con 0x7f0694162900 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f06991e4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f06940b4300 con 0x7f0694162ce0 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53712/0 (socket says 172.21.15.66:53712) 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 -- 172.21.15.66:0/3371730295 learned_addr learned my addr 172.21.15.66:0/3371730295 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f068a59c640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0694162900 0x7f069415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f069359e640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0694162ce0 0x7f06940ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 -- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0694162ce0 msgr2=0x7f06940ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0694162ce0 0x7f06940ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 -- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0694162900 msgr2=0x7f069415edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.769+0000 7f0692d9d640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0694162900 0x7f069415edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f0692d9d640 1 -- 172.21.15.66:0/3371730295 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06940cf0b0 con 0x7f06940b4e20 2024-05-10T11:13:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f0692d9d640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940b7c60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f068400c400 tx=0x7f068400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840052d0 con 0x7f06940b4e20 2024-05-10T11:13:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684005490 con 0x7f06940b4e20 2024-05-10T11:13:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06940b82f0 con 0x7f06940b4e20 2024-05-10T11:13:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684007260 con 0x7f06940b4e20 2024-05-10T11:13:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.770+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06940b88b0 con 0x7f06940b4e20 2024-05-10T11:13:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.771+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0694068550 con 0x7f06940b4e20 2024-05-10T11:13:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.772+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0684007400 con 0x7f06940b4e20 2024-05-10T11:13:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.772+0000 7f068bfff640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f06740762d0 0x7f0674078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.772+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6618+0+0 (secure 0 0 0) 0x7f0684096dd0 con 0x7f06940b4e20 2024-05-10T11:13:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.772+0000 7f068a59c640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f06740762d0 0x7f0674078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.773+0000 7f068a59c640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f06740762d0 0x7f0674078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06940a22e0 tx=0x7f067c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:08.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:08.777+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0694068550 con 0x7f06940b4e20 2024-05-10T11:13:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.005+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f069406a220 con 0x7f06940b4e20 2024-05-10T11:13:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.645+0000 7f068bfff640 1 -- 172.21.15.66:0/3371730295 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f06940d4190 con 0x7f06940b4e20 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f06740762d0 msgr2=0x7f0674078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f06740762d0 0x7f0674078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06940a22e0 tx=0x7f067c009190 comp rx=0 tx=0).stop 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 msgr2=0x7f06940b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940b7c60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f068400c400 tx=0x7f068400c8c0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 shutdown_connections 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f06740762d0 0x7f0674078790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0694162ce0 0x7f06940ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0694162900 0x7f069415edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 --2- 172.21.15.66:0/3371730295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06940b4e20 0x7f06940b7c60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 >> 172.21.15.66:0/3371730295 conn(0x7f069409e430 msgr2=0x7f06940b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 shutdown_connections 2024-05-10T11:13:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.648+0000 7f06991e4640 1 -- 172.21.15.66:0/3371730295 wait complete. 2024-05-10T11:13:09.661 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:13:09.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.777+0000 7f20062c8640 1 Processor -- start 2024-05-10T11:13:09.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.777+0000 7f20062c8640 1 -- start start 2024-05-10T11:13:09.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f20062c8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f200015f490 0x7f20000d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:09.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f20062c8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f20000d5ca0 0x7f20000d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:09.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f20062c8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20000d1080 con 0x7f20000d3b80 2024-05-10T11:13:09.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f20062c8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f20000d3ff0 con 0x7f200015f490 2024-05-10T11:13:09.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f20062c8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f20000b4e70 con 0x7f20000d5ca0 2024-05-10T11:13:09.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f1ffffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f200015f490 0x7f20000d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f2004865640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f20000d3b80 0x7f20000cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39308/0 (socket says 172.21.15.66:39308) 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.778+0000 7f2004865640 1 -- 172.21.15.66:0/3296654187 learned_addr learned my addr 172.21.15.66:0/3296654187 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1ffffff640 1 -- 172.21.15.66:0/3296654187 >> v2:172.21.15.190:3300/0 conn(0x7f20000d5ca0 msgr2=0x7f20000d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1fff7fe640 1 --2- 172.21.15.66:0/3296654187 >> v2:172.21.15.190:3300/0 conn(0x7f20000d5ca0 0x7f20000d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1ffeffd640 1 -- 172.21.15.66:0/3296654187 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564772452 0 0) 0x7f20000d1080 con 0x7f20000d3b80 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1ffffff640 1 --2- 172.21.15.66:0/3296654187 >> v2:172.21.15.190:3300/0 conn(0x7f20000d5ca0 0x7f20000d3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1ffffff640 1 -- 172.21.15.66:0/3296654187 >> v1:172.21.15.66:6789/0 conn(0x7f20000d3b80 legacy=0x7f20000cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1ffffff640 1 -- 172.21.15.66:0/3296654187 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20000b4820 con 0x7f200015f490 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.779+0000 7f1fff7fe640 1 --2- 172.21.15.66:0/3296654187 >> v2:172.21.15.190:3300/0 conn(0x7f20000d5ca0 0x7f20000d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f1ffffff640 1 --2- 172.21.15.66:0/3296654187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f200015f490 0x7f20000d2f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f20000a2fa0 tx=0x7f1ff002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f75f1c1f2cf9098 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f1ffeffd640 1 -- 172.21.15.66:0/3296654187 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0037070 con 0x7f200015f490 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f1ffeffd640 1 -- 172.21.15.66:0/3296654187 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff0032440 con 0x7f200015f490 2024-05-10T11:13:09.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f1ffeffd640 1 -- 172.21.15.66:0/3296654187 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff002ae60 con 0x7f200015f490 2024-05-10T11:13:09.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 -- 172.21.15.66:0/3296654187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f200015f490 msgr2=0x7f20000d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:09.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 --2- 172.21.15.66:0/3296654187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f200015f490 0x7f20000d2f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f20000a2fa0 tx=0x7f1ff002a110 comp rx=0 tx=0).stop 2024-05-10T11:13:09.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 -- 172.21.15.66:0/3296654187 shutdown_connections 2024-05-10T11:13:09.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 --2- 172.21.15.66:0/3296654187 >> v2:172.21.15.190:3300/0 conn(0x7f20000d5ca0 0x7f20000d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 --2- 172.21.15.66:0/3296654187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f200015f490 0x7f20000d2f60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 -- 172.21.15.66:0/3296654187 >> 172.21.15.66:0/3296654187 conn(0x7f20000d50f0 msgr2=0x7f20000d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 -- 172.21.15.66:0/3296654187 shutdown_connections 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.780+0000 7f20062c8640 1 -- 172.21.15.66:0/3296654187 wait complete. 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.782+0000 7f20062c8640 1 Processor -- start 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.782+0000 7f20062c8640 1 -- start start 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 0x7f20000cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20000d5ca0 0x7f2000155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200015f490 0x7f20000ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f200015f9f0 con 0x7f20000d3b80 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f200015f870 con 0x7f200015f490 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f20000b6310 con 0x7f20000d5ca0 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 0x7f20000cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:09.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 0x7f20000cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53728/0 (socket says 172.21.15.66:53728) 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 -- 172.21.15.66:0/1288722947 learned_addr learned my addr 172.21.15.66:0/1288722947 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 -- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20000d5ca0 msgr2=0x7f2000155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20000d5ca0 0x7f2000155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 -- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200015f490 msgr2=0x7f20000ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200015f490 0x7f20000ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 -- 172.21.15.66:0/1288722947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20001e8e90 con 0x7f20000d3b80 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffffff640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 0x7f20000cc1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0000c00 tx=0x7f1ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0037040 con 0x7f20000d3b80 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff0042070 con 0x7f20000d3b80 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20001e9150 con 0x7f20000d3b80 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0030bd0 con 0x7f20000d3b80 2024-05-10T11:13:09.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.783+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20001e9710 con 0x7f20000d3b80 2024-05-10T11:13:09.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.784+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200008d1a0 con 0x7f20000d3b80 2024-05-10T11:13:09.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.785+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ff0047460 con 0x7f20000d3b80 2024-05-10T11:13:09.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.786+0000 7f1ffcff9640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1fec0762d0 0x7f1fec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.786+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6618+0+0 (secure 0 0 0) 0x7f1ff00b86f0 con 0x7f20000d3b80 2024-05-10T11:13:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.786+0000 7f1fff7fe640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1fec0762d0 0x7f1fec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.787+0000 7f1fff7fe640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1fec0762d0 0x7f1fec078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4006fd0 tx=0x7f1ff4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:09.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.790+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f200008d1a0 con 0x7f20000d3b80 2024-05-10T11:13:09.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:09.983+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20000d4170 con 0x7f20000d3b80 2024-05-10T11:13:10.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.651+0000 7f1ffcff9640 1 -- 172.21.15.66:0/1288722947 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f1ff0032e20 con 0x7f20000d3b80 2024-05-10T11:13:10.650 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1fec0762d0 msgr2=0x7f1fec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1fec0762d0 0x7f1fec078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4006fd0 tx=0x7f1ff4008040 comp rx=0 tx=0).stop 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 msgr2=0x7f20000cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 0x7f20000cc1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0000c00 tx=0x7f1ff00046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 shutdown_connections 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1fec0762d0 0x7f1fec078790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200015f490 0x7f20000ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20000d5ca0 0x7f2000155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 --2- 172.21.15.66:0/1288722947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20000d3b80 0x7f20000cc1c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.655+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 >> 172.21.15.66:0/1288722947 conn(0x7f20000d50f0 msgr2=0x7f20000d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:10.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.656+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 shutdown_connections 2024-05-10T11:13:10.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.656+0000 7f20062c8640 1 -- 172.21.15.66:0/1288722947 wait complete. 2024-05-10T11:13:10.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:13:10.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.784+0000 7f2423493640 1 Processor -- start 2024-05-10T11:13:10.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.784+0000 7f2423493640 1 -- start start 2024-05-10T11:13:10.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2423493640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 0x7f241c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:10.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2423493640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c0d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:10.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2423493640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f241c0d0830 con 0x7f241c162990 2024-05-10T11:13:10.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2423493640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f241c0d10d0 con 0x7f241c0b48a0 2024-05-10T11:13:10.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2423493640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f241c0d0b10 con 0x7f241c0d1aa0 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2420a2e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 0x7f241c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2421a30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c0d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2420a2e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 0x7f241c0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:51992/0 (socket says 172.21.15.66:51992) 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2420a2e640 1 -- 172.21.15.66:0/1938037186 learned_addr learned my addr 172.21.15.66:0/1938037186 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.785+0000 7f2421a30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c0d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:38448/0 (socket says 172.21.15.66:38448) 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2421a30640 1 -- 172.21.15.66:0/1938037186 >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 msgr2=0x7f241c0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2421a30640 1 --2- 172.21.15.66:0/1938037186 >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 0x7f241c0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2421a30640 1 -- 172.21.15.66:0/1938037186 >> v1:172.21.15.190:6789/0 conn(0x7f241c162990 legacy=0x7f241c0d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2413fff640 1 -- 172.21.15.66:0/1938037186 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395096137 0 0) 0x7f241c0d0830 con 0x7f241c162990 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2421a30640 1 -- 172.21.15.66:0/1938037186 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241c0d0df0 con 0x7f241c0d1aa0 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2420a2e640 1 --2- 172.21.15.66:0/1938037186 >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 0x7f241c0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.786+0000 7f2421a30640 1 --2- 172.21.15.66:0/1938037186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c0d1f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2414009d90 tx=0x7f241402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=599caf999527b163 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2413fff640 1 -- 172.21.15.66:0/1938037186 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414007740 con 0x7f241c0d1aa0 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2413fff640 1 -- 172.21.15.66:0/1938037186 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24140078e0 con 0x7f241c0d1aa0 2024-05-10T11:13:10.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2413fff640 1 -- 172.21.15.66:0/1938037186 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414007cb0 con 0x7f241c0d1aa0 2024-05-10T11:13:10.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 -- 172.21.15.66:0/1938037186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 msgr2=0x7f241c0d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:10.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 --2- 172.21.15.66:0/1938037186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c0d1f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2414009d90 tx=0x7f241402a660 comp rx=0 tx=0).stop 2024-05-10T11:13:10.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 -- 172.21.15.66:0/1938037186 shutdown_connections 2024-05-10T11:13:10.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 --2- 172.21.15.66:0/1938037186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c0d1f30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 --2- 172.21.15.66:0/1938037186 >> v2:172.21.15.190:3300/0 conn(0x7f241c0b48a0 0x7f241c0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 -- 172.21.15.66:0/1938037186 >> 172.21.15.66:0/1938037186 conn(0x7f241c09e3f0 msgr2=0x7f241c0d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:10.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 -- 172.21.15.66:0/1938037186 shutdown_connections 2024-05-10T11:13:10.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.787+0000 7f2423493640 1 -- 172.21.15.66:0/1938037186 wait complete. 2024-05-10T11:13:10.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.788+0000 7f2423493640 1 Processor -- start 2024-05-10T11:13:10.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.788+0000 7f2423493640 1 -- start start 2024-05-10T11:13:10.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2423493640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 0x7f241c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:10.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2423493640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:10.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2423493640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f241c162990 0x7f241c1f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2423493640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f241c0d3320 con 0x7f241c0b48a0 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2423493640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f241c162d70 con 0x7f241c162990 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2423493640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f241c0d34a0 con 0x7f241c0d1aa0 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f242122f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 0x7f241c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f242122f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 0x7f241c0cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53736/0 (socket says 172.21.15.66:53736) 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f242122f640 1 -- 172.21.15.66:0/2986443100 learned_addr learned my addr 172.21.15.66:0/2986443100 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2420a2e640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.789+0000 7f2421a30640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f241c162990 0x7f241c1f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f242122f640 1 -- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 msgr2=0x7f241c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f242122f640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f242122f640 1 -- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f241c162990 msgr2=0x7f241c1f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f242122f640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f241c162990 0x7f241c1f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:10.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f242122f640 1 -- 172.21.15.66:0/2986443100 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241c0ce870 con 0x7f241c0b48a0 2024-05-10T11:13:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f242122f640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 0x7f241c0cc160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f241800c410 tx=0x7f241800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418017070 con 0x7f241c0b48a0 2024-05-10T11:13:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24180035f0 con 0x7f241c0b48a0 2024-05-10T11:13:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24180039e0 con 0x7f241c0b48a0 2024-05-10T11:13:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241c0cc740 con 0x7f241c0b48a0 2024-05-10T11:13:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.790+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241c0cee10 con 0x7f241c0b48a0 2024-05-10T11:13:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.791+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241c06a220 con 0x7f241c0b48a0 2024-05-10T11:13:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.792+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f241801a070 con 0x7f241c0b48a0 2024-05-10T11:13:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.792+0000 7f2411ffb640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24000762d0 0x7f2400078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.792+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6180+0+0 (secure 0 0 0) 0x7f2418096ad0 con 0x7f241c0b48a0 2024-05-10T11:13:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.793+0000 7f2420a2e640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24000762d0 0x7f2400078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.793+0000 7f2420a2e640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24000762d0 0x7f2400078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f240c009630 tx=0x7f240c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:10.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.797+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f241805fc90 con 0x7f241c0b48a0 2024-05-10T11:13:10.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:10.997+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f241c0d2710 con 0x7f241c0b48a0 2024-05-10T11:13:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.654+0000 7f2411ffb640 1 -- 172.21.15.66:0/2986443100 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f2418063f90 con 0x7f241c0b48a0 2024-05-10T11:13:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24000762d0 msgr2=0x7f2400078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24000762d0 0x7f2400078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f240c009630 tx=0x7f240c009240 comp rx=0 tx=0).stop 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 msgr2=0x7f241c0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 0x7f241c0cc160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f241800c410 tx=0x7f241800c8d0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 shutdown_connections 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f24000762d0 0x7f2400078790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f241c162990 0x7f241c1f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f241c0d1aa0 0x7f241c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 --2- 172.21.15.66:0/2986443100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f241c0b48a0 0x7f241c0cc160 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 >> 172.21.15.66:0/2986443100 conn(0x7f241c09e3f0 msgr2=0x7f241c06ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 shutdown_connections 2024-05-10T11:13:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.657+0000 7f2423493640 1 -- 172.21.15.66:0/2986443100 wait complete. 2024-05-10T11:13:11.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-10T11:13:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.788+0000 7fc91cc45640 1 Processor -- start 2024-05-10T11:13:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.788+0000 7fc91cc45640 1 -- start start 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.789+0000 7fc91cc45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc9180d3d50 0x7fc9180d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.789+0000 7fc91cc45640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9180d1080 con 0x7fc91815f490 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.789+0000 7fc91cc45640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9180b4820 con 0x7fc9180d5ca0 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.789+0000 7fc91cc45640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc9180b4e70 con 0x7fc9180d3d50 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91659c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc91815f490 0x7fc9180d3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39324/0 (socket says 172.21.15.66:39324) 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91659c640 1 -- 172.21.15.66:0/2894663364 learned_addr learned my addr 172.21.15.66:0/2894663364 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485335033 0 0) 0x7fc9180d1080 con 0x7fc91815f490 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc915d9b640 1 --2- 172.21.15.66:0/2894663364 >> v2:172.21.15.190:3300/0 conn(0x7fc9180d3d50 0x7fc9180d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc904003520 con 0x7fc91815f490 2024-05-10T11:13:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2585213815 0 0) 0x7fc904003520 con 0x7fc91815f490 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 >> v2:172.21.15.190:3300/0 conn(0x7fc9180d3d50 msgr2=0x7fc9180d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 --2- 172.21.15.66:0/2894663364 >> v2:172.21.15.190:3300/0 conn(0x7fc9180d3d50 0x7fc9180d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 >> v1:172.21.15.190:6789/0 conn(0x7fc9180d5ca0 legacy=0x7fc9180b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9180b4b00 con 0x7fc91815f490 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fc910001670 con 0x7fc91815f490 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 >> v1:172.21.15.66:6789/0 conn(0x7fc91815f490 legacy=0x7fc9180d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9040039b0 0x7fc904003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc904004800 0x7fc904004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9040051c0 0x7fc90400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9180b4e70 con 0x7fc9040051c0 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc90400c160 con 0x7fc9040039b0 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc90400c360 con 0x7fc904004800 2024-05-10T11:13:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc916d9d640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9040051c0 0x7fc90400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc91659c640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9040039b0 0x7fc904003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.790+0000 7fc915d9b640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc904004800 0x7fc904004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 -- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc904004800 msgr2=0x7fc904004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc904004800 0x7fc904004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 -- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9040039b0 msgr2=0x7fc904003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9040039b0 0x7fc904003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 -- 172.21.15.66:0/2894663364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc904003520 con 0x7fc9040051c0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 -- 172.21.15.66:0/2894663364 reap_dead start 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.791+0000 7fc916d9d640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9040051c0 0x7fc90400b9c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc908001e50 tx=0x7fc904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b6639a93b38d3a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908001a70 con 0x7fc9040051c0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908003970 con 0x7fc9040051c0 2024-05-10T11:13:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91559a640 1 -- 172.21.15.66:0/2894663364 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908003d60 con 0x7fc9040051c0 2024-05-10T11:13:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 -- 172.21.15.66:0/2894663364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9040051c0 msgr2=0x7fc90400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9040051c0 0x7fc90400b9c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc908001e50 tx=0x7fc904005830 comp rx=0 tx=0).stop 2024-05-10T11:13:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 -- 172.21.15.66:0/2894663364 shutdown_connections 2024-05-10T11:13:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 --2- 172.21.15.66:0/2894663364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9040051c0 0x7fc90400b9c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 -- 172.21.15.66:0/2894663364 >> 172.21.15.66:0/2894663364 conn(0x7fc9180d50f0 msgr2=0x7fc9180d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 -- 172.21.15.66:0/2894663364 shutdown_connections 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.792+0000 7fc91cc45640 1 -- 172.21.15.66:0/2894663364 wait complete. 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 Processor -- start 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 -- start start 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9040051c0 0x7fc918152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 0x7fc9181f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc91815c560 0x7fc91815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9180d2f60 con 0x7fc9181f5560 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc91815fa80 con 0x7fc91815c560 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.794+0000 7fc91cc45640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc9180d30e0 con 0x7fc9040051c0 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 0x7fc9181f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 0x7fc9181f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53754/0 (socket says 172.21.15.66:53754) 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 -- 172.21.15.66:0/1051666130 learned_addr learned my addr 172.21.15.66:0/1051666130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc91659c640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9040051c0 0x7fc918152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc916d9d640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc91815c560 0x7fc91815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 -- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9040051c0 msgr2=0x7fc918152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9040051c0 0x7fc918152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 -- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc91815c560 msgr2=0x7fc91815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc91815c560 0x7fc91815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 -- 172.21.15.66:0/1051666130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc918160330 con 0x7fc9181f5560 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc916d9d640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc91815c560 0x7fc91815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc915d9b640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 0x7fc9181f59e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc900011960 tx=0x7fc900011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90000f9d0 con 0x7fc9181f5560 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90000fb70 con 0x7fc9181f5560 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9180ce790 con 0x7fc9181f5560 2024-05-10T11:13:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900014440 con 0x7fc9181f5560 2024-05-10T11:13:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.795+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc918151560 con 0x7fc9181f5560 2024-05-10T11:13:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.796+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91815cf20 con 0x7fc9181f5560 2024-05-10T11:13:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.797+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc900012040 con 0x7fc9181f5560 2024-05-10T11:13:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.798+0000 7fc90effd640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc8f8076300 0x7fc8f80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.798+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5766+0+0 (secure 0 0 0) 0x7fc900097b40 con 0x7fc9181f5560 2024-05-10T11:13:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.798+0000 7fc91659c640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc8f8076300 0x7fc8f80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.798+0000 7fc91659c640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc8f8076300 0x7fc8f80787c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc910000f60 tx=0x7fc910000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:11.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.802+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc900019030 con 0x7fc9181f5560 2024-05-10T11:13:11.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:11.992+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc91806a220 con 0x7fc9181f5560 2024-05-10T11:13:12.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.661+0000 7fc90effd640 1 -- 172.21.15.66:0/1051666130 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v29) ==== 178+0+0 (secure 0 0 0) 0x7fc9000614f0 con 0x7fc9181f5560 2024-05-10T11:13:12.660 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data_ec' removed 2024-05-10T11:13:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc8f8076300 msgr2=0x7fc8f80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc8f8076300 0x7fc8f80787c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc910000f60 tx=0x7fc910000ed0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 msgr2=0x7fc9181f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 0x7fc9181f59e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc900011960 tx=0x7fc900011d60 comp rx=0 tx=0).stop 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 shutdown_connections 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc8f8076300 0x7fc8f80787c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc91815c560 0x7fc91815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9181f5560 0x7fc9181f59e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 --2- 172.21.15.66:0/1051666130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9040051c0 0x7fc918152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.668+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 >> 172.21.15.66:0/1051666130 conn(0x7fc9180d50f0 msgr2=0x7fc9180d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.669+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 shutdown_connections 2024-05-10T11:13:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.669+0000 7fc91cc45640 1 -- 172.21.15.66:0/1051666130 wait complete. 2024-05-10T11:13:12.683 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:13:12.683 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:13:12.683 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:13:12.683 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:12.684 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:13:12.684 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:13:12.684 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:13:12.684 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:12.684 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:13:12.684 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:13:12.684 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:13:12.685 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:12.685 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:13:12.685 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:13:12.685 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:13:12.685 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:12.694 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:13:12.695 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:13:12.695 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:13:12.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:13:12.696 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:13:12.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:13:12.697 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:13:12.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:13:12.739 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:13:12.739 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:12.740 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:13:12.740 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:12.741 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:13:12.741 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:13:12.741 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:12.741 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:12.741 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:13:12.823 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:13:12.824 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:13:12.826 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:13:12.827 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:13:12.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.857+0000 7f7bef0e1640 1 Processor -- start 2024-05-10T11:13:12.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.857+0000 7f7bef0e1640 1 -- start start 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bef0e1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7be815f3b0 0x7f7be80d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bef0e1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7be80d5d30 0x7f7be80d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bef0e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be80d30b0 con 0x7f7be815f790 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bef0e1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7be80d3390 con 0x7f7be80d5d30 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7be80d5d30 0x7f7be80d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bef0e1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7be80c8c80 con 0x7f7be815f3b0 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7be80d5d30 0x7f7be80d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53796/0 (socket says 172.21.15.66:53796) 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bece7d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7be815f3b0 0x7f7be80d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 -- 172.21.15.66:0/3819185034 learned_addr learned my addr 172.21.15.66:0/3819185034 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 -- 172.21.15.66:0/3819185034 >> v2:172.21.15.190:3300/0 conn(0x7f7be815f3b0 msgr2=0x7f7be80d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 --2- 172.21.15.66:0/3819185034 >> v2:172.21.15.190:3300/0 conn(0x7f7be815f3b0 0x7f7be80d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 -- 172.21.15.66:0/3819185034 >> v1:172.21.15.190:6789/0 conn(0x7f7be815f790 legacy=0x7f7be80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.858+0000 7f7bed67e640 1 -- 172.21.15.66:0/3819185034 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80c8f60 con 0x7f7be80d5d30 2024-05-10T11:13:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.859+0000 7f7bed67e640 1 --2- 172.21.15.66:0/3819185034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80d5d30 0x7f7be80d3c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7be808e820 tx=0x7f7be002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba89ac91df1d64bc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.859+0000 7f7be77fe640 1 -- 172.21.15.66:0/3819185034 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0036070 con 0x7f7be80d5d30 2024-05-10T11:13:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.859+0000 7f7be77fe640 1 -- 172.21.15.66:0/3819185034 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be0031600 con 0x7f7be80d5d30 2024-05-10T11:13:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.859+0000 7f7be77fe640 1 -- 172.21.15.66:0/3819185034 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be00319d0 con 0x7f7be80d5d30 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 -- 172.21.15.66:0/3819185034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80d5d30 msgr2=0x7f7be80d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/3819185034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80d5d30 0x7f7be80d3c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7be808e820 tx=0x7f7be002a730 comp rx=0 tx=0).stop 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 -- 172.21.15.66:0/3819185034 shutdown_connections 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/3819185034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80d5d30 0x7f7be80d3c30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/3819185034 >> v2:172.21.15.190:3300/0 conn(0x7f7be815f3b0 0x7f7be80d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 -- 172.21.15.66:0/3819185034 >> 172.21.15.66:0/3819185034 conn(0x7f7be80d5130 msgr2=0x7f7be80d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 -- 172.21.15.66:0/3819185034 shutdown_connections 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.860+0000 7f7bef0e1640 1 -- 172.21.15.66:0/3819185034 wait complete. 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.861+0000 7f7bef0e1640 1 Processor -- start 2024-05-10T11:13:12.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.861+0000 7f7bef0e1640 1 -- start start 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bef0e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7be80d5d30 0x7f7be80b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bef0e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7be815f3b0 0x7f7be80a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bef0e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 0x7f7be80a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bef0e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80d0e60 con 0x7f7be80b3070 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bef0e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80d0ce0 con 0x7f7be815f3b0 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bef0e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7be80d0fe0 con 0x7f7be80d5d30 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 0x7f7be80a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 0x7f7be80a2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53806/0 (socket says 172.21.15.66:53806) 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 -- 172.21.15.66:0/2395727702 learned_addr learned my addr 172.21.15.66:0/2395727702 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bece7d640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7be80d5d30 0x7f7be80b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7be7fff640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7be815f3b0 0x7f7be80a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:12.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 -- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7be80d5d30 msgr2=0x7f7be80b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7be80d5d30 0x7f7be80b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 -- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7be815f3b0 msgr2=0x7f7be80a2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7be815f3b0 0x7f7be80a2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.862+0000 7f7bed67e640 1 -- 172.21.15.66:0/2395727702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80a1470 con 0x7f7be80b3070 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.863+0000 7f7bed67e640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 0x7f7be80a2a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009f40 tx=0x7f7be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.863+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0036050 con 0x7f7be80b3070 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.863+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be0042070 con 0x7f7be80b3070 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.863+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be80a1750 con 0x7f7be80b3070 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.863+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0009510 con 0x7f7be80b3070 2024-05-10T11:13:12.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.863+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80a1d10 con 0x7f7be80b3070 2024-05-10T11:13:12.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.864+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be806a220 con 0x7f7be80b3070 2024-05-10T11:13:12.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.864+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7be0007bf0 con 0x7f7be80b3070 2024-05-10T11:13:12.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.865+0000 7f7be57fa640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7bcc076300 0x7f7bcc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:12.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.865+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5335+0+0 (secure 0 0 0) 0x7f7be00b8080 con 0x7f7be80b3070 2024-05-10T11:13:12.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.865+0000 7f7bece7d640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7bcc076300 0x7f7bcc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:12.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.866+0000 7f7bece7d640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7bcc076300 0x7f7bcc0787c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009b40 tx=0x7f7bdc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:12.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:12.869+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7be0081500 con 0x7f7be80b3070 2024-05-10T11:13:13.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.071+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7be8075a00 con 0x7f7be80b3070 2024-05-10T11:13:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.669+0000 7f7be57fa640 1 -- 172.21.15.66:0/2395727702 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) ==== 97+0+0 (secure 0 0 0) 0x7f7be0085800 con 0x7f7be80b3070 2024-05-10T11:13:13.669 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:13:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.672+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7bcc076300 msgr2=0x7f7bcc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.672+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7bcc076300 0x7f7bcc0787c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009b40 tx=0x7f7bdc009190 comp rx=0 tx=0).stop 2024-05-10T11:13:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.672+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 msgr2=0x7f7be80a2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.672+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 0x7f7be80a2a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009f40 tx=0x7f7be0004a40 comp rx=0 tx=0).stop 2024-05-10T11:13:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 shutdown_connections 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7bcc076300 0x7f7bcc0787c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be80b3070 0x7f7be80a2a50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7be815f3b0 0x7f7be80a2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 --2- 172.21.15.66:0/2395727702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7be80d5d30 0x7f7be80b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 >> 172.21.15.66:0/2395727702 conn(0x7f7be80d5130 msgr2=0x7f7be806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 shutdown_connections 2024-05-10T11:13:13.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.673+0000 7f7bef0e1640 1 -- 172.21.15.66:0/2395727702 wait complete. 2024-05-10T11:13:13.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:13:13.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.794+0000 7f6a74332640 1 Processor -- start 2024-05-10T11:13:13.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.794+0000 7f6a74332640 1 -- start start 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a74332640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c16a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a74332640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c15fc90 con 0x7f6a6c0d0230 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a74332640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c0b8c40 con 0x7f6a6c0b8860 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a74332640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c06ec30 con 0x7f6a6c0cfd80 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a718cd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6a6c0d0230 0x7f6a6c0cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:39330/0 (socket says 172.21.15.66:39330) 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a718cd640 1 -- 172.21.15.66:0/3446340484 learned_addr learned my addr 172.21.15.66:0/3446340484 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a728cf640 1 --2- 172.21.15.66:0/3446340484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c16a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:13.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508139780 0 0) 0x7f6a6c15fc90 con 0x7f6a6c0d0230 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.795+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a58003520 con 0x7f6a6c0d0230 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477612314 0 0) 0x7f6a6c0b8c40 con 0x7f6a6c0b8860 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a6c15fc90 con 0x7f6a6c0b8860 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a728cf640 1 -- 172.21.15.66:0/3446340484 >> v1:172.21.15.190:6789/0 conn(0x7f6a6c0b8860 legacy=0x7f6a6c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a728cf640 1 -- 172.21.15.66:0/3446340484 >> v1:172.21.15.66:6789/0 conn(0x7f6a6c0d0230 legacy=0x7f6a6c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3267383104 0 0) 0x7f6a58003520 con 0x7f6a6c0d0230 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a728cf640 1 -- 172.21.15.66:0/3446340484 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0cd570 con 0x7f6a6c0cfd80 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.796+0000 7f6a728cf640 1 --2- 172.21.15.66:0/3446340484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c16a3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009dc0 tx=0x7f6a6402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6093a269783ada server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c001670 con 0x7f6a6c0cfd80 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64007540 con 0x7f6a6c0cfd80 2024-05-10T11:13:13.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a710cc640 1 -- 172.21.15.66:0/3446340484 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a640078f0 con 0x7f6a6c0cfd80 2024-05-10T11:13:13.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 -- 172.21.15.66:0/3446340484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 msgr2=0x7f6a6c16a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 --2- 172.21.15.66:0/3446340484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c16a3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009dc0 tx=0x7f6a6402a5d0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 -- 172.21.15.66:0/3446340484 shutdown_connections 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 --2- 172.21.15.66:0/3446340484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c16a3a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 -- 172.21.15.66:0/3446340484 >> 172.21.15.66:0/3446340484 conn(0x7f6a6c0d2df0 msgr2=0x7f6a6c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 -- 172.21.15.66:0/3446340484 shutdown_connections 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.797+0000 7f6a74332640 1 -- 172.21.15.66:0/3446340484 wait complete. 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.798+0000 7f6a74332640 1 Processor -- start 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.798+0000 7f6a74332640 1 -- start start 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a74332640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a6c0b8860 0x7f6a6c1f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a74332640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a74332640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 0x7f6a6c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:13.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a74332640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cdb30 con 0x7f6a6c0d0230 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a74332640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c06ee50 con 0x7f6a6c0b8860 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a74332640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cde10 con 0x7f6a6c0cfd80 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a728cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 0x7f6a6c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a728cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 0x7f6a6c155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53810/0 (socket says 172.21.15.66:53810) 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a728cf640 1 -- 172.21.15.66:0/3306675547 learned_addr learned my addr 172.21.15.66:0/3306675547 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a718cd640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.799+0000 7f6a720ce640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a6c0b8860 0x7f6a6c1f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a728cf640 1 -- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 msgr2=0x7f6a6c1559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a728cf640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c1559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a728cf640 1 -- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a6c0b8860 msgr2=0x7f6a6c1f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:13.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a728cf640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a6c0b8860 0x7f6a6c1f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a728cf640 1 -- 172.21.15.66:0/3306675547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c1622b0 con 0x7f6a6c0d0230 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a728cf640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 0x7f6a6c155f10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ee0 tx=0x7f6a64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64040070 con 0x7f6a6c0d0230 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64031c40 con 0x7f6a6c0d0230 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c1f9380 con 0x7f6a6c0d0230 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64009450 con 0x7f6a6c0d0230 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.800+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c1f5290 con 0x7f6a6c0d0230 2024-05-10T11:13:13.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.801+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c068c40 con 0x7f6a6c0d0230 2024-05-10T11:13:13.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.802+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a64039040 con 0x7f6a6c0d0230 2024-05-10T11:13:13.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.802+0000 7f6a62ffd640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:13.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.802+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f6a640b85d0 con 0x7f6a6c0d0230 2024-05-10T11:13:13.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.802+0000 7f6a720ce640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:13.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.803+0000 7f6a720ce640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a680011e0 tx=0x7f6a68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:13.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:13.807+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6a6c068c40 con 0x7f6a6c0d0230 2024-05-10T11:13:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.068+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6a6c0d0650 con 0x7f6a6c0d0230 2024-05-10T11:13:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.069+0000 7f6a62ffd640 1 -- 172.21.15.66:0/3306675547 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f6a6c1622b0 con 0x7f6a6c0d0230 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.069 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:13:14.070 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:14.071 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:13:14.072 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.073 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:13:14.074 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.075 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:13:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:14.077 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:13:14.078 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:14.079 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.080 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.bootstrap-mds", 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQAHAT5m/+E4EBAAgG3iNNmocyCnFof1BXzZ4Q==", 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile bootstrap-mds" 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.bootstrap-mgr", 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQAHAT5miuo4EBAAZXTTrfyph9OwmuXIoElT+g==", 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.081 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.bootstrap-osd", 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQAHAT5mU/M4EBAA1+2GYBfRUQQ7QwYLK7rhww==", 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile bootstrap-osd" 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.bootstrap-rbd", 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQAHAT5mq/o4EBAACrrCzh8OPgunBpOYmaatRw==", 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.082 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQAHAT5mEAI5EBAAEsvU3dDsHl2h9btOqudYDQ==", 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.bootstrap-rgw", 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQAHAT5mowk5EBAA+dk3ZKFTH8WIahm8K3XMug==", 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.083 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:13:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:13:14.085 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:14.085 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.085 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:14.085 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:13:14.085 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:13:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 msgr2=0x7f6a50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a680011e0 tx=0x7f6a68009040 comp rx=0 tx=0).stop 2024-05-10T11:13:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 msgr2=0x7f6a6c155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 0x7f6a6c155f10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ee0 tx=0x7f6a64004a40 comp rx=0 tx=0).stop 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 shutdown_connections 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c0d0230 0x7f6a6c155f10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a6c0cfd80 0x7f6a6c1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 --2- 172.21.15.66:0/3306675547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a6c0b8860 0x7f6a6c1f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 >> 172.21.15.66:0/3306675547 conn(0x7f6a6c0d2df0 msgr2=0x7f6a6c0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 shutdown_connections 2024-05-10T11:13:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.071+0000 7f6a74332640 1 -- 172.21.15.66:0/3306675547 wait complete. 2024-05-10T11:13:14.088 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-10T11:13:14.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.193+0000 7f1d90c09640 1 Processor -- start 2024-05-10T11:13:14.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.193+0000 7f1d90c09640 1 -- start start 2024-05-10T11:13:14.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d90c09640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1d8c15f6f0 0x7f1d8c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d90c09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d90c09640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d8c0b40f0 0x7f1d8c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d90c09640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1d8c0d27b0 con 0x7f1d8c0b40f0 2024-05-10T11:13:14.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d90c09640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1d8c15fad0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d90c09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8c06e1a0 con 0x7f1d8c0b3ba0 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d8c0b40f0 0x7f1d8c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d8c0b40f0 0x7f1d8c0d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53818/0 (socket says 172.21.15.66:53818) 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d83fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8a59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1d8c15f6f0 0x7f1d8c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3540603973 learned_addr learned my addr 172.21.15.66:0/3540603973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3540603973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 msgr2=0x7f1d8c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 --2- 172.21.15.66:0/3540603973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3540603973 >> v2:172.21.15.190:3300/0 conn(0x7f1d8c15f6f0 msgr2=0x7f1d8c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 --2- 172.21.15.66:0/3540603973 >> v2:172.21.15.190:3300/0 conn(0x7f1d8c15f6f0 0x7f1d8c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.194+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3540603973 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c06e480 con 0x7f1d8c0b40f0 2024-05-10T11:13:14.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.195+0000 7f1d8ad9d640 1 --2- 172.21.15.66:0/3540603973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0d1040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c073110 tx=0x7f1d8402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5f7f1fefa987ad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.195+0000 7f1d89d9b640 1 -- 172.21.15.66:0/3540603973 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84036070 con 0x7f1d8c0b40f0 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.195+0000 7f1d89d9b640 1 -- 172.21.15.66:0/3540603973 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d84031600 con 0x7f1d8c0b40f0 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.195+0000 7f1d89d9b640 1 -- 172.21.15.66:0/3540603973 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d840319d0 con 0x7f1d8c0b40f0 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 -- 172.21.15.66:0/3540603973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c0b40f0 msgr2=0x7f1d8c0d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3540603973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0d1040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c073110 tx=0x7f1d8402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 -- 172.21.15.66:0/3540603973 shutdown_connections 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3540603973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0d1040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3540603973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3540603973 >> v2:172.21.15.190:3300/0 conn(0x7f1d8c15f6f0 0x7f1d8c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 -- 172.21.15.66:0/3540603973 >> 172.21.15.66:0/3540603973 conn(0x7f1d8c0d2d70 msgr2=0x7f1d8c0d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 -- 172.21.15.66:0/3540603973 shutdown_connections 2024-05-10T11:13:14.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.196+0000 7f1d90c09640 1 -- 172.21.15.66:0/3540603973 wait complete. 2024-05-10T11:13:14.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.197+0000 7f1d90c09640 1 Processor -- start 2024-05-10T11:13:14.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.197+0000 7f1d90c09640 1 -- start start 2024-05-10T11:13:14.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d90c09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d90c09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d90c09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 0x7f1d8c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d90c09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c0cd4f0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d90c09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c0d24d0 con 0x7f1d8c0b40f0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d90c09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8c0d1580 con 0x7f1d8c0b3ba0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 0x7f1d8c0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 0x7f1d8c0cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53826/0 (socket says 172.21.15.66:53826) 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3257440123 learned_addr learned my addr 172.21.15.66:0/3257440123 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d83fff640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8a59c640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 msgr2=0x7f1d8c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d8c0b40f0 msgr2=0x7f1d8c0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 -- 172.21.15.66:0/3257440123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c0c7ef0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.198+0000 7f1d8ad9d640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 0x7f1d8c0cdec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009e20 tx=0x7f1d84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.199+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84036050 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.199+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d84042070 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.199+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8c0b56d0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.199+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84009510 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.199+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8c0b76a0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.200+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8c06a220 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.200+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d84007bf0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.201+0000 7f1d82ffd640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d6c0762d0 0x7f1d6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.201+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f1d840b80a0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.201+0000 7f1d8a59c640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d6c0762d0 0x7f1d6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.202+0000 7f1d8a59c640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d6c0762d0 0x7f1d6c078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009a30 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.205+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1d84081c50 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.470+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f1d8c0d05d0 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.471+0000 7f1d82ffd640 1 -- 172.21.15.66:0/3257440123 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f1d84081550 con 0x7f1d8c15f6f0 2024-05-10T11:13:14.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.473+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d6c0762d0 msgr2=0x7f1d6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.473+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d6c0762d0 0x7f1d6c078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009a30 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2024-05-10T11:13:14.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.473+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 msgr2=0x7f1d8c0cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.473+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 0x7f1d8c0cdec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009e20 tx=0x7f1d84004a40 comp rx=0 tx=0).stop 2024-05-10T11:13:14.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.473+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 shutdown_connections 2024-05-10T11:13:14.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.473+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d6c0762d0 0x7f1d6c078790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.474+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d8c15f6f0 0x7f1d8c0cdec0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.474+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d8c0b40f0 0x7f1d8c0c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.474+0000 7f1d90c09640 1 --2- 172.21.15.66:0/3257440123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d8c0b3ba0 0x7f1d8c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.474+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 >> 172.21.15.66:0/3257440123 conn(0x7f1d8c0d2d70 msgr2=0x7f1d8c06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:14.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.474+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 shutdown_connections 2024-05-10T11:13:14.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.474+0000 7f1d90c09640 1 -- 172.21.15.66:0/3257440123 wait complete. 2024-05-10T11:13:14.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-10T11:13:14.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.589+0000 7f87b6a20640 1 Processor -- start 2024-05-10T11:13:14.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 -- start start 2024-05-10T11:13:14.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f87b015d2c0 0x7f87b00d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f87b00b1d70 0x7f87b00d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b00d1910 0x7f87b00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f87b00d0f00 con 0x7f87b00b1d70 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f87b00afaa0 con 0x7f87b015d2c0 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.590+0000 7f87b6a20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00afd80 con 0x7f87b00d1910 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f87b00b1d70 0x7f87b00d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f87b00b1d70 0x7f87b00d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53830/0 (socket says 172.21.15.66:53830) 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 -- 172.21.15.66:0/3959469959 learned_addr learned my addr 172.21.15.66:0/3959469959 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87b4fbd640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b00d1910 0x7f87b00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87affff640 1 --2- 172.21.15.66:0/3959469959 >> v2:172.21.15.190:3300/0 conn(0x7f87b015d2c0 0x7f87b00d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 -- 172.21.15.66:0/3959469959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b00d1910 msgr2=0x7f87b00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b00d1910 0x7f87b00cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 -- 172.21.15.66:0/3959469959 >> v2:172.21.15.190:3300/0 conn(0x7f87b015d2c0 msgr2=0x7f87b00d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 --2- 172.21.15.66:0/3959469959 >> v2:172.21.15.190:3300/0 conn(0x7f87b015d2c0 0x7f87b00d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87a7fff640 1 -- 172.21.15.66:0/3959469959 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00ce5b0 con 0x7f87b00b1d70 2024-05-10T11:13:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87b4fbd640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b00d1910 0x7f87b00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.591+0000 7f87affff640 1 --2- 172.21.15.66:0/3959469959 >> v2:172.21.15.190:3300/0 conn(0x7f87b015d2c0 0x7f87b00d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87a7fff640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b00d13d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87b0073440 tx=0x7f879802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3850c6739d1f5e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87af7fe640 1 -- 172.21.15.66:0/3959469959 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798037070 con 0x7f87b00b1d70 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87af7fe640 1 -- 172.21.15.66:0/3959469959 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879802ae00 con 0x7f87b00b1d70 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87af7fe640 1 -- 172.21.15.66:0/3959469959 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798032660 con 0x7f87b00b1d70 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 -- 172.21.15.66:0/3959469959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 msgr2=0x7f87b00d13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b00d13d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87b0073440 tx=0x7f879802a0b0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 -- 172.21.15.66:0/3959469959 shutdown_connections 2024-05-10T11:13:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b00d1910 0x7f87b00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 --2- 172.21.15.66:0/3959469959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b00d13d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 --2- 172.21.15.66:0/3959469959 >> v2:172.21.15.190:3300/0 conn(0x7f87b015d2c0 0x7f87b00d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 -- 172.21.15.66:0/3959469959 >> 172.21.15.66:0/3959469959 conn(0x7f87b00d2df0 msgr2=0x7f87b00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 -- 172.21.15.66:0/3959469959 shutdown_connections 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.592+0000 7f87b6a20640 1 -- 172.21.15.66:0/3959469959 wait complete. 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 Processor -- start 2024-05-10T11:13:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 -- start start 2024-05-10T11:13:14.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b01f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b00d1910 0x7f87b015ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b015d2c0 0x7f87b00c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00ceb30 con 0x7f87b00b1d70 2024-05-10T11:13:14.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00ce850 con 0x7f87b00d1910 2024-05-10T11:13:14.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87b6a20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00cf960 con 0x7f87b015d2c0 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.594+0000 7f87affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b01f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b01f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53844/0 (socket says 172.21.15.66:53844) 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 -- 172.21.15.66:0/2248216585 learned_addr learned my addr 172.21.15.66:0/2248216585 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87b4fbd640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b015d2c0 0x7f87b00c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87a7fff640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b00d1910 0x7f87b015ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 -- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b015d2c0 msgr2=0x7f87b00c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b015d2c0 0x7f87b00c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 -- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b00d1910 msgr2=0x7f87b015ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b00d1910 0x7f87b015ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 -- 172.21.15.66:0/2248216585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00ca960 con 0x7f87b00b1d70 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87affff640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b01f64c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f87a000d7d0 tx=0x7f87a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0004030 con 0x7f87b00b1d70 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a00041d0 con 0x7f87b00b1d70 2024-05-10T11:13:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b01f59e0 con 0x7f87b00b1d70 2024-05-10T11:13:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a000b6c0 con 0x7f87b00b1d70 2024-05-10T11:13:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.595+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b01f5fa0 con 0x7f87b00b1d70 2024-05-10T11:13:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.596+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b00693f0 con 0x7f87b00b1d70 2024-05-10T11:13:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.597+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f87a000b860 con 0x7f87b00b1d70 2024-05-10T11:13:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.597+0000 7f87ad7fa640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8790076300 0x7f87900787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.597+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f87a0097670 con 0x7f87b00b1d70 2024-05-10T11:13:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.598+0000 7f87a7fff640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8790076300 0x7f87900787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.598+0000 7f87a7fff640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8790076300 0x7f87900787c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8798034000 tx=0x7f879802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.602+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f87a0061110 con 0x7f87b00b1d70 2024-05-10T11:13:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.869+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f87b00c9750 con 0x7f87b00b1d70 2024-05-10T11:13:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.871+0000 7f87ad7fa640 1 -- 172.21.15.66:0/2248216585 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f87a0060a10 con 0x7f87b00b1d70 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8790076300 msgr2=0x7f87900787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8790076300 0x7f87900787c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8798034000 tx=0x7f879802e000 comp rx=0 tx=0).stop 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 msgr2=0x7f87b01f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b01f64c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f87a000d7d0 tx=0x7f87a000dc90 comp rx=0 tx=0).stop 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 shutdown_connections 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8790076300 0x7f87900787c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b015d2c0 0x7f87b00c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b00d1910 0x7f87b015ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 --2- 172.21.15.66:0/2248216585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87b00b1d70 0x7f87b01f64c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 >> 172.21.15.66:0/2248216585 conn(0x7f87b00d2df0 msgr2=0x7f87b0070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 shutdown_connections 2024-05-10T11:13:14.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.873+0000 7f87b6a20640 1 -- 172.21.15.66:0/2248216585 wait complete. 2024-05-10T11:13:14.884 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-10T11:13:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.988+0000 7f7c7f551640 1 Processor -- start 2024-05-10T11:13:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.988+0000 7f7c7f551640 1 -- start start 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.989+0000 7f7c7f551640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 0x7f7c780d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.989+0000 7f7c7f551640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c780b1d70 0x7f7c780b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.989+0000 7f7c7f551640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c780ce5b0 con 0x7f7c7815d2c0 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.989+0000 7f7c7f551640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7c780d0f00 con 0x7f7c780b1d70 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.989+0000 7f7c7f551640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c780afaa0 con 0x7f7c780d1ae0 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 0x7f7c780d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 0x7f7c780d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:34202/0 (socket says 172.21.15.66:34202) 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 -- 172.21.15.66:0/3721533460 learned_addr learned my addr 172.21.15.66:0/3721533460 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7daee640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c780b1d70 0x7f7c780b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 -- 172.21.15.66:0/3721533460 >> v2:172.21.15.190:3300/0 conn(0x7f7c780b1d70 msgr2=0x7f7c780b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 --2- 172.21.15.66:0/3721533460 >> v2:172.21.15.190:3300/0 conn(0x7f7c780b1d70 0x7f7c780b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 -- 172.21.15.66:0/3721533460 >> v1:172.21.15.190:6789/0 conn(0x7f7c7815d2c0 legacy=0x7f7c780d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.990+0000 7f7c7caec640 1 -- 172.21.15.66:0/3721533460 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7815d6a0 con 0x7f7c780d1ae0 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.991+0000 7f7c7caec640 1 --2- 172.21.15.66:0/3721533460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 0x7f7c780d3910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009870 tx=0x7f7c6c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d9dcbfc0effeefe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.991+0000 7f7c77fff640 1 -- 172.21.15.66:0/3721533460 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c037070 con 0x7f7c780d1ae0 2024-05-10T11:13:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.991+0000 7f7c77fff640 1 -- 172.21.15.66:0/3721533460 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c032440 con 0x7f7c780d1ae0 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.991+0000 7f7c77fff640 1 -- 172.21.15.66:0/3721533460 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c032810 con 0x7f7c780d1ae0 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.991+0000 7f7c7f551640 1 -- 172.21.15.66:0/3721533460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 msgr2=0x7f7c780d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 --2- 172.21.15.66:0/3721533460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 0x7f7c780d3910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009870 tx=0x7f7c6c02a130 comp rx=0 tx=0).stop 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 -- 172.21.15.66:0/3721533460 shutdown_connections 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 --2- 172.21.15.66:0/3721533460 >> v2:172.21.15.190:3300/0 conn(0x7f7c780b1d70 0x7f7c780b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 --2- 172.21.15.66:0/3721533460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c780d1ae0 0x7f7c780d3910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 -- 172.21.15.66:0/3721533460 >> 172.21.15.66:0/3721533460 conn(0x7f7c780d2df0 msgr2=0x7f7c780d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 -- 172.21.15.66:0/3721533460 shutdown_connections 2024-05-10T11:13:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.992+0000 7f7c7f551640 1 -- 172.21.15.66:0/3721533460 wait complete. 2024-05-10T11:13:14.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.993+0000 7f7c7f551640 1 Processor -- start 2024-05-10T11:13:14.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.993+0000 7f7c7f551640 1 -- start start 2024-05-10T11:13:14.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7f551640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c780b1d70 0x7f7c7814a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7f551640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 0x7f7c78160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7f551640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c7815d2c0 0x7f7c780cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7f551640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780ceb30 con 0x7f7c780d1ae0 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7f551640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780afd80 con 0x7f7c780b1d70 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7f551640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c780b0750 con 0x7f7c7815d2c0 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 0x7f7c78160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 0x7f7c78160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35702/0 (socket says 172.21.15.66:35702) 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 -- 172.21.15.66:0/695224947 learned_addr learned my addr 172.21.15.66:0/695224947 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7daee640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c7815d2c0 0x7f7c780cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7d2ed640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c780b1d70 0x7f7c7814a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 -- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c7815d2c0 msgr2=0x7f7c780cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c7815d2c0 0x7f7c780cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 -- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c780b1d70 msgr2=0x7f7c7814a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c780b1d70 0x7f7c7814a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 -- 172.21.15.66:0/695224947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7814a960 con 0x7f7c780d1ae0 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c7caec640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 0x7f7c78160380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c000c00 tx=0x7f7c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.994+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c041020 con 0x7f7c780d1ae0 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.995+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c030660 con 0x7f7c780d1ae0 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.995+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c037040 con 0x7f7c780d1ae0 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.995+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7815f2e0 con 0x7f7c780d1ae0 2024-05-10T11:13:14.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.995+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7815f8a0 con 0x7f7c780d1ae0 2024-05-10T11:13:14.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.996+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c780693f0 con 0x7f7c780d1ae0 2024-05-10T11:13:14.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.996+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c6c044020 con 0x7f7c780d1ae0 2024-05-10T11:13:14.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.997+0000 7f7c75ffb640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c640762d0 0x7f7c64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:14.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.997+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f7c6c0b7c40 con 0x7f7c780d1ae0 2024-05-10T11:13:14.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.997+0000 7f7c7d2ed640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c640762d0 0x7f7c64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:14.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:14.998+0000 7f7c7d2ed640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c640762d0 0x7f7c64078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c70007fd0 tx=0x7f7c70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.001+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7c6c04b030 con 0x7f7c780d1ae0 2024-05-10T11:13:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.269+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7c780b1b30 con 0x7f7c780d1ae0 2024-05-10T11:13:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.271+0000 7f7c75ffb640 1 -- 172.21.15.66:0/695224947 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f7c6c081770 con 0x7f7c780d1ae0 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c640762d0 msgr2=0x7f7c64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c640762d0 0x7f7c64078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c70007fd0 tx=0x7f7c70009040 comp rx=0 tx=0).stop 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 msgr2=0x7f7c78160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 0x7f7c78160380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c000c00 tx=0x7f7c6c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 shutdown_connections 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c640762d0 0x7f7c64078790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c7815d2c0 0x7f7c780cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c780d1ae0 0x7f7c78160380 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 --2- 172.21.15.66:0/695224947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c780b1d70 0x7f7c7814a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 >> 172.21.15.66:0/695224947 conn(0x7f7c780d2df0 msgr2=0x7f7c78070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:15.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 shutdown_connections 2024-05-10T11:13:15.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.273+0000 7f7c7f551640 1 -- 172.21.15.66:0/695224947 wait complete. 2024-05-10T11:13:15.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-10T11:13:15.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.389+0000 7ff042f1c640 1 Processor -- start 2024-05-10T11:13:15.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.389+0000 7ff042f1c640 1 -- start start 2024-05-10T11:13:15.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff042f1c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ac0 0x7ff03c0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff042f1c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff03c0b5690 0x7ff03c0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff042f1c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03c0b5d30 con 0x7ff03c0d1ea0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff042f1c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff03c0d0a70 con 0x7ff03c0b5690 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff042f1c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff03c0d5de0 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff033fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff03c0d1ea0 0x7ff03c0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55462/0 (socket says 172.21.15.66:55462) 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff033fff640 1 -- 172.21.15.66:0/2188637553 learned_addr learned my addr 172.21.15.66:0/2188637553 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff040cb8640 1 --2- 172.21.15.66:0/2188637553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ac0 0x7ff03c0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff0414b9640 1 --2- 172.21.15.66:0/2188637553 >> v2:172.21.15.190:3300/0 conn(0x7ff03c0b5690 0x7ff03c0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff0337fe640 1 -- 172.21.15.66:0/2188637553 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624053011 0 0) 0x7ff03c0b5d30 con 0x7ff03c0d1ea0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff0337fe640 1 -- 172.21.15.66:0/2188637553 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff03c0d1ea0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff0337fe640 1 -- 172.21.15.66:0/2188637553 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1557597839 0 0) 0x7ff024003520 con 0x7ff03c0d1ea0 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff040cb8640 1 -- 172.21.15.66:0/2188637553 >> v2:172.21.15.190:3300/0 conn(0x7ff03c0b5690 msgr2=0x7ff03c0d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff040cb8640 1 --2- 172.21.15.66:0/2188637553 >> v2:172.21.15.190:3300/0 conn(0x7ff03c0b5690 0x7ff03c0d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff040cb8640 1 -- 172.21.15.66:0/2188637553 >> v1:172.21.15.66:6789/0 conn(0x7ff03c0d1ea0 legacy=0x7ff03c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff040cb8640 1 -- 172.21.15.66:0/2188637553 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c0b6730 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.390+0000 7ff0414b9640 1 --2- 172.21.15.66:0/2188637553 >> v2:172.21.15.190:3300/0 conn(0x7ff03c0b5690 0x7ff03c0d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.391+0000 7ff040cb8640 1 --2- 172.21.15.66:0/2188637553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ac0 0x7ff03c0b6010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0380097a0 tx=0x7ff03802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d699cbb8bbce8c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.391+0000 7ff0337fe640 1 -- 172.21.15.66:0/2188637553 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038037070 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.391+0000 7ff0337fe640 1 -- 172.21.15.66:0/2188637553 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03802aba0 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.391+0000 7ff0337fe640 1 -- 172.21.15.66:0/2188637553 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c001670 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 -- 172.21.15.66:0/2188637553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ac0 msgr2=0x7ff03c0b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 --2- 172.21.15.66:0/2188637553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ac0 0x7ff03c0b6010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0380097a0 tx=0x7ff03802a110 comp rx=0 tx=0).stop 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 -- 172.21.15.66:0/2188637553 shutdown_connections 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 --2- 172.21.15.66:0/2188637553 >> v2:172.21.15.190:3300/0 conn(0x7ff03c0b5690 0x7ff03c0d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 --2- 172.21.15.66:0/2188637553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ac0 0x7ff03c0b6010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 -- 172.21.15.66:0/2188637553 >> 172.21.15.66:0/2188637553 conn(0x7ff03c0d5120 msgr2=0x7ff03c0d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 -- 172.21.15.66:0/2188637553 shutdown_connections 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.392+0000 7ff042f1c640 1 -- 172.21.15.66:0/2188637553 wait complete. 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.393+0000 7ff042f1c640 1 Processor -- start 2024-05-10T11:13:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.393+0000 7ff042f1c640 1 -- start start 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff042f1c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03c0b5690 0x7ff03c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff042f1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 0x7ff03c1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff042f1c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ea0 0x7ff03c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff042f1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c0d3440 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff042f1c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c0d1110 con 0x7ff03c0b5690 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff042f1c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff03c0d35c0 con 0x7ff03c0d1ea0 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 0x7ff03c1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 0x7ff03c1f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35712/0 (socket says 172.21.15.66:35712) 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 -- 172.21.15.66:0/3965674068 learned_addr learned my addr 172.21.15.66:0/3965674068 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff040cb8640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03c0b5690 0x7ff03c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff0414b9640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ea0 0x7ff03c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 -- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ea0 msgr2=0x7ff03c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ea0 0x7ff03c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 -- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03c0b5690 msgr2=0x7ff03c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03c0b5690 0x7ff03c158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.394+0000 7ff033fff640 1 -- 172.21.15.66:0/3965674068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c1f5e90 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.395+0000 7ff033fff640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 0x7ff03c1f5950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00c700 tx=0x7ff02c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.395+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c017070 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.395+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02c005ce0 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.395+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c0b2660 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.395+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c007270 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.395+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c0b2c20 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.396+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03c06a220 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.396+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff02c01a070 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.397+0000 7ff0317fa640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0280762d0 0x7ff028078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.397+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7ff02c096680 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.397+0000 7ff040cb8640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0280762d0 0x7ff028078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.398+0000 7ff040cb8640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0280762d0 0x7ff028078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff038034000 tx=0x7ff03802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.401+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff03c1f5e90 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.663+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff03c06d930 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.665+0000 7ff0317fa640 1 -- 172.21.15.66:0/3965674068 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7ff02c05fbe0 con 0x7ff03c0d1ac0 2024-05-10T11:13:15.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0280762d0 msgr2=0x7ff028078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0280762d0 0x7ff028078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff038034000 tx=0x7ff03802e000 comp rx=0 tx=0).stop 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 msgr2=0x7ff03c1f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 0x7ff03c1f5950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00c700 tx=0x7ff02c00cb00 comp rx=0 tx=0).stop 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 shutdown_connections 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0280762d0 0x7ff028078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03c0d1ea0 0x7ff03c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff03c0d1ac0 0x7ff03c1f5950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 --2- 172.21.15.66:0/3965674068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03c0b5690 0x7ff03c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 >> 172.21.15.66:0/3965674068 conn(0x7ff03c0d5120 msgr2=0x7ff03c0cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 shutdown_connections 2024-05-10T11:13:15.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.668+0000 7ff042f1c640 1 -- 172.21.15.66:0/3965674068 wait complete. 2024-05-10T11:13:15.678 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-10T11:13:15.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.785+0000 7ff276faf640 1 Processor -- start 2024-05-10T11:13:15.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.785+0000 7ff276faf640 1 -- start start 2024-05-10T11:13:15.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff276faf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2700cf420 0x7ff2700cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff276faf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2700cb2e0 0x7ff27006e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff276faf640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2700cbc50 con 0x7ff2700d06f0 2024-05-10T11:13:15.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff276faf640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff2700cbf30 con 0x7ff2700cf420 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff276faf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff2700cc210 con 0x7ff2700cb2e0 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff274d4b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2700cf420 0x7ff2700cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff26ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff2700d06f0 0x7ff2700cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55476/0 (socket says 172.21.15.66:55476) 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff26ffff640 1 -- 172.21.15.66:0/2874842766 learned_addr learned my addr 172.21.15.66:0/2874842766 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff27554c640 1 --2- 172.21.15.66:0/2874842766 >> v2:172.21.15.190:3300/0 conn(0x7ff2700cb2e0 0x7ff27006e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff274d4b640 1 -- 172.21.15.66:0/2874842766 >> v2:172.21.15.190:3300/0 conn(0x7ff2700cb2e0 msgr2=0x7ff27006e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff274d4b640 1 --2- 172.21.15.66:0/2874842766 >> v2:172.21.15.190:3300/0 conn(0x7ff2700cb2e0 0x7ff27006e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff274d4b640 1 -- 172.21.15.66:0/2874842766 >> v1:172.21.15.66:6789/0 conn(0x7ff2700d06f0 legacy=0x7ff2700cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff274d4b640 1 -- 172.21.15.66:0/2874842766 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2700cc4f0 con 0x7ff2700cf420 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff26f7fe640 1 -- 172.21.15.66:0/2874842766 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800706355 0 0) 0x7ff2700cbc50 con 0x7ff2700d06f0 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.787+0000 7ff27554c640 1 --2- 172.21.15.66:0/2874842766 >> v2:172.21.15.190:3300/0 conn(0x7ff2700cb2e0 0x7ff27006e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.788+0000 7ff274d4b640 1 --2- 172.21.15.66:0/2874842766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cf420 0x7ff2700cccf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097a0 tx=0x7ff25802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8206aaab7f4568fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.788+0000 7ff26f7fe640 1 -- 172.21.15.66:0/2874842766 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258037070 con 0x7ff2700cf420 2024-05-10T11:13:15.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.788+0000 7ff26f7fe640 1 -- 172.21.15.66:0/2874842766 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258032440 con 0x7ff2700cf420 2024-05-10T11:13:15.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.788+0000 7ff26f7fe640 1 -- 172.21.15.66:0/2874842766 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258032810 con 0x7ff2700cf420 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 -- 172.21.15.66:0/2874842766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cf420 msgr2=0x7ff2700cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 --2- 172.21.15.66:0/2874842766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cf420 0x7ff2700cccf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097a0 tx=0x7ff25802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 -- 172.21.15.66:0/2874842766 shutdown_connections 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 --2- 172.21.15.66:0/2874842766 >> v2:172.21.15.190:3300/0 conn(0x7ff2700cb2e0 0x7ff27006e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 --2- 172.21.15.66:0/2874842766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cf420 0x7ff2700cccf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 -- 172.21.15.66:0/2874842766 >> 172.21.15.66:0/2874842766 conn(0x7ff2700d0c90 msgr2=0x7ff2700d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 -- 172.21.15.66:0/2874842766 shutdown_connections 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.789+0000 7ff276faf640 1 -- 172.21.15.66:0/2874842766 wait complete. 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.790+0000 7ff276faf640 1 Processor -- start 2024-05-10T11:13:15.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.790+0000 7ff276faf640 1 -- start start 2024-05-10T11:13:15.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff276faf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 0x7ff27014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff276faf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2700cf420 0x7ff2700b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff276faf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2700d06f0 0x7ff2701f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff276faf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff27015bc00 con 0x7ff2700cb2e0 2024-05-10T11:13:15.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff276faf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2700cb770 con 0x7ff2700cf420 2024-05-10T11:13:15.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff276faf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2700b6a30 con 0x7ff2700d06f0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 0x7ff27014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 0x7ff27014cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35726/0 (socket says 172.21.15.66:35726) 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 -- 172.21.15.66:0/326056682 learned_addr learned my addr 172.21.15.66:0/326056682 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff26ffff640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2700cf420 0x7ff2700b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 -- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2700d06f0 msgr2=0x7ff2701f4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2700d06f0 0x7ff2701f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 -- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2700cf420 msgr2=0x7ff2700b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2700cf420 0x7ff2700b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 -- 172.21.15.66:0/326056682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27014f0d0 con 0x7ff2700cb2e0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.791+0000 7ff274d4b640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 0x7ff27014cc50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff258035040 tx=0x7ff2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.792+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258037040 con 0x7ff2700cb2e0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.792+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258030770 con 0x7ff2700cb2e0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.792+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27014f3b0 con 0x7ff2700cb2e0 2024-05-10T11:13:15.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.792+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258030b80 con 0x7ff2700cb2e0 2024-05-10T11:13:15.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.792+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27014f970 con 0x7ff2700cb2e0 2024-05-10T11:13:15.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.793+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27006a220 con 0x7ff2700cb2e0 2024-05-10T11:13:15.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.793+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff258044020 con 0x7ff2700cb2e0 2024-05-10T11:13:15.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.794+0000 7ff26d7fa640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2500762d0 0x7ff250078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:15.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.794+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7ff2580b7a60 con 0x7ff2700cb2e0 2024-05-10T11:13:15.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.794+0000 7ff26ffff640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2500762d0 0x7ff250078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:15.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.795+0000 7ff26ffff640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2500762d0 0x7ff250078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2700b64a0 tx=0x7ff260009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:15.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:15.798+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff258032e20 con 0x7ff2700cb2e0 2024-05-10T11:13:16.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.063+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff2700b6c10 con 0x7ff2700cb2e0 2024-05-10T11:13:16.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.065+0000 7ff26d7fa640 1 -- 172.21.15.66:0/326056682 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7ff258081580 con 0x7ff2700cb2e0 2024-05-10T11:13:16.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2500762d0 msgr2=0x7ff250078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2500762d0 0x7ff250078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2700b64a0 tx=0x7ff260009040 comp rx=0 tx=0).stop 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 msgr2=0x7ff27014cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 0x7ff27014cc50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff258035040 tx=0x7ff2580046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 shutdown_connections 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2500762d0 0x7ff250078790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2700d06f0 0x7ff2701f4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2700cf420 0x7ff2700b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 --2- 172.21.15.66:0/326056682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2700cb2e0 0x7ff27014cc50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 >> 172.21.15.66:0/326056682 conn(0x7ff2700d0c90 msgr2=0x7ff27006e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 shutdown_connections 2024-05-10T11:13:16.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.067+0000 7ff276faf640 1 -- 172.21.15.66:0/326056682 wait complete. 2024-05-10T11:13:16.077 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-10T11:13:16.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.182+0000 7fe8fd809640 1 Processor -- start 2024-05-10T11:13:16.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8fd809640 1 -- start start 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8fd809640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe8f80d1ae0 0x7fe8f80d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8fd809640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f80ce5b0 con 0x7fe8f80b1d70 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8fd809640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f815d6a0 con 0x7fe8f815d2c0 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8fd809640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f80d0f00 con 0x7fe8f80d1ae0 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8f77fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe8f80b1d70 0x7fe8f80b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55482/0 (socket says 172.21.15.66:55482) 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.183+0000 7fe8f77fe640 1 -- 172.21.15.66:0/1107927673 learned_addr learned my addr 172.21.15.66:0/1107927673 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f67fc640 1 --2- 172.21.15.66:0/1107927673 >> v2:172.21.15.190:3300/0 conn(0x7fe8f80d1ae0 0x7fe8f80d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725648429 0 0) 0x7fe8f80ce5b0 con 0x7fe8f80b1d70 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e4003520 con 0x7fe8f80b1d70 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3026523196 0 0) 0x7fe8e4003520 con 0x7fe8f80b1d70 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 >> v2:172.21.15.190:3300/0 conn(0x7fe8f80d1ae0 msgr2=0x7fe8f80d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 --2- 172.21.15.66:0/1107927673 >> v2:172.21.15.190:3300/0 conn(0x7fe8f80d1ae0 0x7fe8f80d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 >> v1:172.21.15.190:6789/0 conn(0x7fe8f815d2c0 legacy=0x7fe8f80d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80ce850 con 0x7fe8f80b1d70 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe8e80019f0 con 0x7fe8f80b1d70 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 >> v1:172.21.15.66:6789/0 conn(0x7fe8f80b1d70 legacy=0x7fe8f80b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8e4004800 0x7fe8e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40052e0 0x7fe8e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80d0f00 con 0x7fe8e40039b0 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e400c1b0 con 0x7fe8e4004800 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e400c3b0 con 0x7fe8e40052e0 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f67fc640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8e4004800 0x7fe8e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.184+0000 7fe8f77fe640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40052e0 0x7fe8e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f6ffd640 1 -- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40052e0 msgr2=0x7fe8e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40052e0 0x7fe8e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f6ffd640 1 -- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8e4004800 msgr2=0x7fe8e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8e4004800 0x7fe8e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f77fe640 1 -- 172.21.15.66:0/1107927673 reap_dead start 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f6ffd640 1 -- 172.21.15.66:0/1107927673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e4003520 con 0x7fe8e40039b0 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80ce780 tx=0x7fe8e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8353548c9a5ca85d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0001370 con 0x7fe8e40039b0 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f00052d0 con 0x7fe8e40039b0 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.185+0000 7fe8f5ffb640 1 -- 172.21.15.66:0/1107927673 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f002ab70 con 0x7fe8e40039b0 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 -- 172.21.15.66:0/1107927673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e40039b0 msgr2=0x7fe8e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80ce780 tx=0x7fe8e4005830 comp rx=0 tx=0).stop 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 -- 172.21.15.66:0/1107927673 shutdown_connections 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 --2- 172.21.15.66:0/1107927673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003dd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 -- 172.21.15.66:0/1107927673 >> 172.21.15.66:0/1107927673 conn(0x7fe8f80d2df0 msgr2=0x7fe8f80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:16.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 -- 172.21.15.66:0/1107927673 shutdown_connections 2024-05-10T11:13:16.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.186+0000 7fe8fd809640 1 -- 172.21.15.66:0/1107927673 wait complete. 2024-05-10T11:13:16.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.187+0000 7fe8fd809640 1 Processor -- start 2024-05-10T11:13:16.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.187+0000 7fe8fd809640 1 -- start start 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8fd809640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40039b0 0x7fe8f81f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8fd809640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f81f2d50 0x7fe8f815fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8fd809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 0x7fe8f80a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8fd809640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80afd80 con 0x7fe8f8154f10 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8fd809640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80afaa0 con 0x7fe8f81f2d50 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8fd809640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80d3910 con 0x7fe8e40039b0 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 0x7fe8f80a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 0x7fe8f80a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35752/0 (socket says 172.21.15.66:35752) 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8f77fe640 1 -- 172.21.15.66:0/2226341752 learned_addr learned my addr 172.21.15.66:0/2226341752 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.188+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40039b0 0x7fe8f81f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f67fc640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f81f2d50 0x7fe8f815fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f77fe640 1 -- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40039b0 msgr2=0x7fe8f81f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f77fe640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40039b0 0x7fe8f81f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f77fe640 1 -- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f81f2d50 msgr2=0x7fe8f815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f77fe640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f81f2d50 0x7fe8f815fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f77fe640 1 -- 172.21.15.66:0/2226341752 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f81f31d0 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f67fc640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f81f2d50 0x7fe8f815fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8f77fe640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 0x7fe8f80a01d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8073350 tx=0x7fe8e8007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800ab00 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e8019070 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f81f3460 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80133f0 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.189+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f81f3a20 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.190+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f80693f0 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.191+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8e8013590 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.191+0000 7fe8effff640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8d8076300 0x7fe8d80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.191+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fe8e8097910 con 0x7fe8f8154f10 2024-05-10T11:13:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.191+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8d8076300 0x7fe8d80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.192+0000 7fe8f6ffd640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8d8076300 0x7fe8d80787c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0032000 tx=0x7fe8f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.195+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe8e8061430 con 0x7fe8f8154f10 2024-05-10T11:13:16.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.460+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fe8f80c9750 con 0x7fe8f8154f10 2024-05-10T11:13:16.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.462+0000 7fe8effff640 1 -- 172.21.15.66:0/2226341752 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fe8e8060d30 con 0x7fe8f8154f10 2024-05-10T11:13:16.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8d8076300 msgr2=0x7fe8d80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8d8076300 0x7fe8d80787c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0032000 tx=0x7fe8f002e000 comp rx=0 tx=0).stop 2024-05-10T11:13:16.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 msgr2=0x7fe8f80a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 0x7fe8f80a01d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8073350 tx=0x7fe8e8007b00 comp rx=0 tx=0).stop 2024-05-10T11:13:16.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 shutdown_connections 2024-05-10T11:13:16.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8d8076300 0x7fe8d80787c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8f8154f10 0x7fe8f80a01d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f81f2d50 0x7fe8f815fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 --2- 172.21.15.66:0/2226341752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8e40039b0 0x7fe8f81f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.464+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 >> 172.21.15.66:0/2226341752 conn(0x7fe8f80d2df0 msgr2=0x7fe8f80759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:16.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.465+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 shutdown_connections 2024-05-10T11:13:16.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.465+0000 7fe8fd809640 1 -- 172.21.15.66:0/2226341752 wait complete. 2024-05-10T11:13:16.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:13:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.579+0000 7f3d749d4640 1 Processor -- start 2024-05-10T11:13:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.579+0000 7f3d749d4640 1 -- start start 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d749d4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d7015f3b0 0x7f3d700d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d749d4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3d700d5d30 0x7f3d700d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d749d4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d700d30b0 con 0x7f3d7015f790 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d749d4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3d700d3390 con 0x7f3d7015f3b0 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d749d4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3d700c8c80 con 0x7f3d700d5d30 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d6e59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d7015f3b0 0x7f3d700d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d6e59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d7015f3b0 0x7f3d700d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35760/0 (socket says 172.21.15.66:35760) 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d6e59c640 1 -- 172.21.15.66:0/1158509180 learned_addr learned my addr 172.21.15.66:0/1158509180 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.580+0000 7f3d6ed9d640 1 --2- 172.21.15.66:0/1158509180 >> v2:172.21.15.190:3300/0 conn(0x7f3d700d5d30 0x7f3d700d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6e59c640 1 -- 172.21.15.66:0/1158509180 >> v2:172.21.15.190:3300/0 conn(0x7f3d700d5d30 msgr2=0x7f3d700d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6e59c640 1 --2- 172.21.15.66:0/1158509180 >> v2:172.21.15.190:3300/0 conn(0x7f3d700d5d30 0x7f3d700d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6e59c640 1 -- 172.21.15.66:0/1158509180 >> v1:172.21.15.190:6789/0 conn(0x7f3d7015f790 legacy=0x7f3d700c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6e59c640 1 -- 172.21.15.66:0/1158509180 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d700c8f60 con 0x7f3d7015f3b0 2024-05-10T11:13:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6ed9d640 1 --2- 172.21.15.66:0/1158509180 >> v2:172.21.15.190:3300/0 conn(0x7f3d700d5d30 0x7f3d700d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6e59c640 1 --2- 172.21.15.66:0/1158509180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7015f3b0 0x7f3d700d36f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3d7008d220 tx=0x7f3d6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4e4079379d41cc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6d59a640 1 -- 172.21.15.66:0/1158509180 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60037070 con 0x7f3d7015f3b0 2024-05-10T11:13:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6d59a640 1 -- 172.21.15.66:0/1158509180 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d60032440 con 0x7f3d7015f3b0 2024-05-10T11:13:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.581+0000 7f3d6d59a640 1 -- 172.21.15.66:0/1158509180 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60032810 con 0x7f3d7015f3b0 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 -- 172.21.15.66:0/1158509180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7015f3b0 msgr2=0x7f3d700d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1158509180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7015f3b0 0x7f3d700d36f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3d7008d220 tx=0x7f3d6002a230 comp rx=0 tx=0).stop 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 -- 172.21.15.66:0/1158509180 shutdown_connections 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1158509180 >> v2:172.21.15.190:3300/0 conn(0x7f3d700d5d30 0x7f3d700d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1158509180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7015f3b0 0x7f3d700d36f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 -- 172.21.15.66:0/1158509180 >> 172.21.15.66:0/1158509180 conn(0x7f3d700d5130 msgr2=0x7f3d700d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 -- 172.21.15.66:0/1158509180 shutdown_connections 2024-05-10T11:13:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.582+0000 7f3d749d4640 1 -- 172.21.15.66:0/1158509180 wait complete. 2024-05-10T11:13:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 Processor -- start 2024-05-10T11:13:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 -- start start 2024-05-10T11:13:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d700d5d30 0x7f3d700ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d7015f3b0 0x7f3d701f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 0x7f3d7006df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3d700d0e60 con 0x7f3d701f50e0 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3d700d0ce0 con 0x7f3d700d5d30 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.584+0000 7f3d749d4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3d700d0fe0 con 0x7f3d7015f3b0 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 0x7f3d7006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 0x7f3d7006df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35774/0 (socket says 172.21.15.66:35774) 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 -- 172.21.15.66:0/1377244055 learned_addr learned my addr 172.21.15.66:0/1377244055 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6e59c640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d700d5d30 0x7f3d700ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6dd9b640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d7015f3b0 0x7f3d701f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 -- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d7015f3b0 msgr2=0x7f3d701f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d7015f3b0 0x7f3d701f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 -- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d700d5d30 msgr2=0x7f3d700ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d700d5d30 0x7f3d700ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 -- 172.21.15.66:0/1377244055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d700ce870 con 0x7f3d701f50e0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6dd9b640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d7015f3b0 0x7f3d701f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d6ed9d640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 0x7f3d7006df30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800cef0 tx=0x7f3d6800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6801a070 con 0x7f3d701f50e0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6800d860 con 0x7f3d701f50e0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d700ceb50 con 0x7f3d701f50e0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6800dc50 con 0x7f3d701f50e0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.585+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d701441e0 con 0x7f3d701f50e0 2024-05-10T11:13:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.586+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d700ced20 con 0x7f3d701f50e0 2024-05-10T11:13:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.587+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d6801d070 con 0x7f3d701f50e0 2024-05-10T11:13:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.588+0000 7f3d5effd640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d500762d0 0x7f3d50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.588+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f3d68097c60 con 0x7f3d701f50e0 2024-05-10T11:13:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.588+0000 7f3d6e59c640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d500762d0 0x7f3d50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.588+0000 7f3d6e59c640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d500762d0 0x7f3d50078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d60034000 tx=0x7f3d6002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.592+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3d68061160 con 0x7f3d701f50e0 2024-05-10T11:13:16.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.787+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3d7006a220 con 0x7f3d701f50e0 2024-05-10T11:13:16.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.788+0000 7f3d5effd640 1 -- 172.21.15.66:0/1377244055 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) ==== 84+0+65 (secure 0 0 0) 0x7f3d68065460 con 0x7f3d701f50e0 2024-05-10T11:13:16.787 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:16.787 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:13:16.787 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:16.788 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:13:16.789 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:13:16.789 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:16.789 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d500762d0 msgr2=0x7f3d50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d500762d0 0x7f3d50078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d60034000 tx=0x7f3d6002e000 comp rx=0 tx=0).stop 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 msgr2=0x7f3d7006df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 0x7f3d7006df30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800cef0 tx=0x7f3d6800a710 comp rx=0 tx=0).stop 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 shutdown_connections 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d500762d0 0x7f3d50078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d701f50e0 0x7f3d7006df30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d7015f3b0 0x7f3d701f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 --2- 172.21.15.66:0/1377244055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d700d5d30 0x7f3d700ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 >> 172.21.15.66:0/1377244055 conn(0x7f3d700d5130 msgr2=0x7f3d7015e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:16.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 shutdown_connections 2024-05-10T11:13:16.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.790+0000 7f3d749d4640 1 -- 172.21.15.66:0/1377244055 wait complete. 2024-05-10T11:13:16.800 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:13:16.801 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:13:16.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.909+0000 7fe8a9428640 1 Processor -- start 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.909+0000 7fe8a9428640 1 -- start start 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a9428640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a415f600 0x7fe8a40d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a9428640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe8a40d0b90 0x7fe8a40d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a9428640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40b46b0 con 0x7fe8a40d3b50 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a9428640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a40b4990 con 0x7fe8a40d0b90 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a9428640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a40b4c70 con 0x7fe8a415f600 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe8a40d0b90 0x7fe8a40d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe8a40d0b90 0x7fe8a40d3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35780/0 (socket says 172.21.15.66:35780) 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 -- 172.21.15.66:0/2273162731 learned_addr learned my addr 172.21.15.66:0/2273162731 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a2ffd640 1 --2- 172.21.15.66:0/2273162731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a415f600 0x7fe8a40d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 -- 172.21.15.66:0/2273162731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a415f600 msgr2=0x7fe8a40d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 --2- 172.21.15.66:0/2273162731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a415f600 0x7fe8a40d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 -- 172.21.15.66:0/2273162731 >> v1:172.21.15.190:6789/0 conn(0x7fe8a40d3b50 legacy=0x7fe8a40d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.910+0000 7fe8a27fc640 1 -- 172.21.15.66:0/2273162731 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40b4f50 con 0x7fe8a40d0b90 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.911+0000 7fe8a27fc640 1 --2- 172.21.15.66:0/2273162731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a40d0b90 0x7fe8a40d3610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe898009870 tx=0x7fe89802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ced0906c829451 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.911+0000 7fe8a1ffb640 1 -- 172.21.15.66:0/2273162731 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898037070 con 0x7fe8a40d0b90 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.911+0000 7fe8a1ffb640 1 -- 172.21.15.66:0/2273162731 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe898032440 con 0x7fe8a40d0b90 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.911+0000 7fe8a1ffb640 1 -- 172.21.15.66:0/2273162731 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898032810 con 0x7fe8a40d0b90 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 -- 172.21.15.66:0/2273162731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a40d0b90 msgr2=0x7fe8a40d3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 --2- 172.21.15.66:0/2273162731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a40d0b90 0x7fe8a40d3610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe898009870 tx=0x7fe89802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 -- 172.21.15.66:0/2273162731 shutdown_connections 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 --2- 172.21.15.66:0/2273162731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a40d0b90 0x7fe8a40d3610 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 --2- 172.21.15.66:0/2273162731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a415f600 0x7fe8a40d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 -- 172.21.15.66:0/2273162731 >> 172.21.15.66:0/2273162731 conn(0x7fe8a409e390 msgr2=0x7fe8a40d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 -- 172.21.15.66:0/2273162731 shutdown_connections 2024-05-10T11:13:16.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.912+0000 7fe8a9428640 1 -- 172.21.15.66:0/2273162731 wait complete. 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.913+0000 7fe8a9428640 1 Processor -- start 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.913+0000 7fe8a9428640 1 -- start start 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a9428640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8a40d0b90 0x7fe8a41f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a9428640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a40d3b50 0x7fe8a40b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a9428640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 0x7fe8a415f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a9428640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40b68e0 con 0x7fe8a415f600 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a9428640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40b6760 con 0x7fe8a40d0b90 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a9428640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a40d1d70 con 0x7fe8a40d3b50 2024-05-10T11:13:16.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 0x7fe8a415f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 0x7fe8a415f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35784/0 (socket says 172.21.15.66:35784) 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 -- 172.21.15.66:0/1008800609 learned_addr learned my addr 172.21.15.66:0/1008800609 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a27fc640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a40d3b50 0x7fe8a40b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a2ffd640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8a40d0b90 0x7fe8a41f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 -- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a40d3b50 msgr2=0x7fe8a40b8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a40d3b50 0x7fe8a40b8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 -- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8a40d0b90 msgr2=0x7fe8a41f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.914+0000 7fe8a37fe640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8a40d0b90 0x7fe8a41f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe8a37fe640 1 -- 172.21.15.66:0/1008800609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a41f5580 con 0x7fe8a415f600 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe8a37fe640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 0x7fe8a415f9e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00c7a0 tx=0x7fe89c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c003b70 con 0x7fe8a415f600 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89c003d30 con 0x7fe8a415f600 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00aa90 con 0x7fe8a415f600 2024-05-10T11:13:16.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a41f5860 con 0x7fe8a415f600 2024-05-10T11:13:16.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.915+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a40b7e80 con 0x7fe8a415f600 2024-05-10T11:13:16.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.916+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a406a220 con 0x7fe8a415f600 2024-05-10T11:13:16.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.917+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe89c00ac30 con 0x7fe8a415f600 2024-05-10T11:13:16.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.917+0000 7fe88b7fe640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe890076300 0x7fe8900787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:16.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.917+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fe89c097200 con 0x7fe8a415f600 2024-05-10T11:13:16.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.918+0000 7fe8a2ffd640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe890076300 0x7fe8900787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:16.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.918+0000 7fe8a2ffd640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe890076300 0x7fe8900787c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe8940079a0 tx=0x7fe894008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:16.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:16.922+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe89c0606e0 con 0x7fe8a415f600 2024-05-10T11:13:17.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.110+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe8a40d4e10 con 0x7fe8a415f600 2024-05-10T11:13:17.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.679+0000 7fe88b7fe640 1 -- 172.21.15.66:0/1008800609 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) ==== 138+0+0 (secure 0 0 0) 0x7fe89c0649e0 con 0x7fe8a415f600 2024-05-10T11:13:17.680 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe890076300 msgr2=0x7fe8900787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe890076300 0x7fe8900787c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe8940079a0 tx=0x7fe894008040 comp rx=0 tx=0).stop 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 msgr2=0x7fe8a415f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 0x7fe8a415f9e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00c7a0 tx=0x7fe89c00cc60 comp rx=0 tx=0).stop 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 shutdown_connections 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe890076300 0x7fe8900787c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8a415f600 0x7fe8a415f9e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8a40d3b50 0x7fe8a40b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 --2- 172.21.15.66:0/1008800609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8a40d0b90 0x7fe8a41f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.682+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 >> 172.21.15.66:0/1008800609 conn(0x7fe8a409e390 msgr2=0x7fe8a40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:17.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.683+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 shutdown_connections 2024-05-10T11:13:17.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.683+0000 7fe8a9428640 1 -- 172.21.15.66:0/1008800609 wait complete. 2024-05-10T11:13:17.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:13:17.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.818+0000 7f2972f46640 1 Processor -- start 2024-05-10T11:13:17.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.818+0000 7f2972f46640 1 -- start start 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f2972f46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c160870 0x7f296c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f2972f46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 0x7f296c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f2972f46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296c160c50 con 0x7f296c0cdf90 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f2972f46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f296c0d0120 con 0x7f296c0cfcc0 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f2972f46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f296c0d39d0 con 0x7f296c160870 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f296bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 0x7f296c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:17.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f2970ce2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c160870 0x7f296c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f296bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 0x7f296c0cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:36636/0 (socket says 172.21.15.66:36636) 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.819+0000 7f296bfff640 1 -- 172.21.15.66:0/3087734976 learned_addr learned my addr 172.21.15.66:0/3087734976 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.820+0000 7f2970ce2640 1 -- 172.21.15.66:0/3087734976 >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 msgr2=0x7f296c0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.820+0000 7f2970ce2640 1 --2- 172.21.15.66:0/3087734976 >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 0x7f296c0cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.820+0000 7f2970ce2640 1 -- 172.21.15.66:0/3087734976 >> v1:172.21.15.190:6789/0 conn(0x7f296c0cdf90 legacy=0x7f296c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.820+0000 7f2970ce2640 1 -- 172.21.15.66:0/3087734976 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c0d3cb0 con 0x7f296c160870 2024-05-10T11:13:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.820+0000 7f296bfff640 1 --2- 172.21.15.66:0/3087734976 >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 0x7f296c0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.820+0000 7f2970ce2640 1 --2- 172.21.15.66:0/3087734976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c160870 0x7f296c0cf780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29600097a0 tx=0x7f296002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e59f3942dc813c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f296b7fe640 1 -- 172.21.15.66:0/3087734976 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960037070 con 0x7f296c160870 2024-05-10T11:13:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f296b7fe640 1 -- 172.21.15.66:0/3087734976 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296002ae50 con 0x7f296c160870 2024-05-10T11:13:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f296b7fe640 1 -- 172.21.15.66:0/3087734976 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960032660 con 0x7f296c160870 2024-05-10T11:13:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 -- 172.21.15.66:0/3087734976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c160870 msgr2=0x7f296c0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 --2- 172.21.15.66:0/3087734976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c160870 0x7f296c0cf780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29600097a0 tx=0x7f296002a100 comp rx=0 tx=0).stop 2024-05-10T11:13:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 -- 172.21.15.66:0/3087734976 shutdown_connections 2024-05-10T11:13:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 --2- 172.21.15.66:0/3087734976 >> v2:172.21.15.190:3300/0 conn(0x7f296c0cfcc0 0x7f296c0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 --2- 172.21.15.66:0/3087734976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c160870 0x7f296c0cf780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 -- 172.21.15.66:0/3087734976 >> 172.21.15.66:0/3087734976 conn(0x7f296c0d2eb0 msgr2=0x7f296c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 -- 172.21.15.66:0/3087734976 shutdown_connections 2024-05-10T11:13:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.821+0000 7f2972f46640 1 -- 172.21.15.66:0/3087734976 wait complete. 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.822+0000 7f2972f46640 1 Processor -- start 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 -- start start 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c0cdf90 0x7f296c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f296c0cfcc0 0x7f296c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 0x7f296c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f296c0d1d30 con 0x7f296c160870 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f296c0d1a50 con 0x7f296c0cfcc0 2024-05-10T11:13:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.823+0000 7f2972f46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f296c0d1460 con 0x7f296c0cdf90 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 0x7f296c14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 0x7f296c14fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35792/0 (socket says 172.21.15.66:35792) 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 -- 172.21.15.66:0/2371070922 learned_addr learned my addr 172.21.15.66:0/2371070922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f2970ce2640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c0cdf90 0x7f296c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f296bfff640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f296c0cfcc0 0x7f296c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 -- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c0cdf90 msgr2=0x7f296c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c0cdf90 0x7f296c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 -- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f296c0cfcc0 msgr2=0x7f296c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f296c0cfcc0 0x7f296c15db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 -- 172.21.15.66:0/2371070922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c0cccb0 con 0x7f296c160870 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29714e3640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 0x7f296c14fca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f296400c6e0 tx=0x7f296400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964003b70 con 0x7f296c160870 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2964003d30 con 0x7f296c160870 2024-05-10T11:13:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296c15d030 con 0x7f296c160870 2024-05-10T11:13:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.824+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964005310 con 0x7f296c160870 2024-05-10T11:13:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.825+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296c15d5f0 con 0x7f296c160870 2024-05-10T11:13:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.826+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296c06a220 con 0x7f296c160870 2024-05-10T11:13:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.826+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29640054b0 con 0x7f296c160870 2024-05-10T11:13:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.827+0000 7f29697fa640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29500762d0 0x7f2950078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.827+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5619+0+0 (secure 0 0 0) 0x7f29640972b0 con 0x7f296c160870 2024-05-10T11:13:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.827+0000 7f2970ce2640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29500762d0 0x7f2950078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.828+0000 7f2970ce2640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29500762d0 0x7f2950078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2960034000 tx=0x7f296002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:17.832+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2964060610 con 0x7f296c160870 2024-05-10T11:13:18.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.023+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f296c15d7c0 con 0x7f296c160870 2024-05-10T11:13:18.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.682+0000 7f29697fa640 1 -- 172.21.15.66:0/2371070922 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) ==== 170+0+0 (secure 0 0 0) 0x7f2964064910 con 0x7f296c160870 2024-05-10T11:13:18.681 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29500762d0 msgr2=0x7f2950078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29500762d0 0x7f2950078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2960034000 tx=0x7f296002e000 comp rx=0 tx=0).stop 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 msgr2=0x7f296c14fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 0x7f296c14fca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f296400c6e0 tx=0x7f296400cba0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 shutdown_connections 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29500762d0 0x7f2950078790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f296c160870 0x7f296c14fca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f296c0cfcc0 0x7f296c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 --2- 172.21.15.66:0/2371070922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f296c0cdf90 0x7f296c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 >> 172.21.15.66:0/2371070922 conn(0x7f296c0d2eb0 msgr2=0x7f296c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:18.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.685+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 shutdown_connections 2024-05-10T11:13:18.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.686+0000 7f2972f46640 1 -- 172.21.15.66:0/2371070922 wait complete. 2024-05-10T11:13:18.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:13:18.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.829+0000 7f46a3620640 1 Processor -- start 2024-05-10T11:13:18.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.829+0000 7f46a3620640 1 -- start start 2024-05-10T11:13:18.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a3620640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f469c160530 0x7f469c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:18.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a3620640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c15cfb0 con 0x7f469c06f030 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a3620640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c15d290 con 0x7f469c15c9e0 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a3620640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f469c0ccb60 con 0x7f469c160530 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a0bbb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f469c160530 0x7f469c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a0bbb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f469c160530 0x7f469c15c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35796/0 (socket says 172.21.15.66:35796) 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a0bbb640 1 -- 172.21.15.66:0/454653679 learned_addr learned my addr 172.21.15.66:0/454653679 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a13bc640 1 --1- 172.21.15.66:0/454653679 >> v1:172.21.15.66:6789/0 conn(0x7f469c06f030 0x7f469c06f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55494/0 (socket says 172.21.15.66:55494) 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a0bbb640 1 -- 172.21.15.66:0/454653679 >> v1:172.21.15.190:6789/0 conn(0x7f469c15c9e0 legacy=0x7f469c0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a0bbb640 1 -- 172.21.15.66:0/454653679 >> v1:172.21.15.66:6789/0 conn(0x7f469c06f030 legacy=0x7f469c06f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:18.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.830+0000 7f46a0bbb640 1 -- 172.21.15.66:0/454653679 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c15fd30 con 0x7f469c160530 2024-05-10T11:13:18.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f46a0bbb640 1 --2- 172.21.15.66:0/454653679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c160530 0x7f469c15c4a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f469800d150 tx=0x7f469802c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e31e708a3b0b42 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:18.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f468ffff640 1 -- 172.21.15.66:0/454653679 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698009600 con 0x7f469c160530 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f468ffff640 1 -- 172.21.15.66:0/454653679 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698037070 con 0x7f469c160530 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f468ffff640 1 -- 172.21.15.66:0/454653679 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980099c0 con 0x7f469c160530 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f46a3620640 1 -- 172.21.15.66:0/454653679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c160530 msgr2=0x7f469c15c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f46a3620640 1 --2- 172.21.15.66:0/454653679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c160530 0x7f469c15c4a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f469800d150 tx=0x7f469802c970 comp rx=0 tx=0).stop 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f46a3620640 1 -- 172.21.15.66:0/454653679 shutdown_connections 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f46a3620640 1 --2- 172.21.15.66:0/454653679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c160530 0x7f469c15c4a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.831+0000 7f46a3620640 1 -- 172.21.15.66:0/454653679 >> 172.21.15.66:0/454653679 conn(0x7f469c0d0c90 msgr2=0x7f469c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.832+0000 7f46a3620640 1 -- 172.21.15.66:0/454653679 shutdown_connections 2024-05-10T11:13:18.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.832+0000 7f46a3620640 1 -- 172.21.15.66:0/454653679 wait complete. 2024-05-10T11:13:18.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 Processor -- start 2024-05-10T11:13:18.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 -- start start 2024-05-10T11:13:18.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 0x7f469c0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:18.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c15c9e0 0x7f469c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:18.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c160530 0x7f469c06e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f469c15fa40 con 0x7f469c06f030 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f469c160990 con 0x7f469c160530 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.833+0000 7f46a3620640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f469c0cb910 con 0x7f469c15c9e0 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 0x7f469c0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 0x7f469c0c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35806/0 (socket says 172.21.15.66:35806) 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 -- 172.21.15.66:0/15766702 learned_addr learned my addr 172.21.15.66:0/15766702 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a0bbb640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c15c9e0 0x7f469c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a1bbd640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c160530 0x7f469c06e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 -- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c15c9e0 msgr2=0x7f469c06df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c15c9e0 0x7f469c06df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 -- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c160530 msgr2=0x7f469c06e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c160530 0x7f469c06e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:18.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 -- 172.21.15.66:0/15766702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c0b5fc0 con 0x7f469c06f030 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a0bbb640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c15c9e0 0x7f469c06df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a1bbd640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c160530 0x7f469c06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a13bc640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 0x7f469c0c7170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f469000c3c0 tx=0x7f469000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900074e0 con 0x7f469c06f030 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4690007680 con 0x7f469c06f030 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c0b62a0 con 0x7f469c06f030 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.834+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690004a00 con 0x7f469c06f030 2024-05-10T11:13:18.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.835+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c0b6860 con 0x7f469c06f030 2024-05-10T11:13:18.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.836+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c06a220 con 0x7f469c06f030 2024-05-10T11:13:18.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.836+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f469001a020 con 0x7f469c06f030 2024-05-10T11:13:18.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.837+0000 7f468dffb640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46800762d0 0x7f4680078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:18.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.837+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6001+0+0 (secure 0 0 0) 0x7f4690096e30 con 0x7f469c06f030 2024-05-10T11:13:18.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.837+0000 7f46a0bbb640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46800762d0 0x7f4680078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:18.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.838+0000 7f46a0bbb640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46800762d0 0x7f4680078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4698036000 tx=0x7f469800b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:18.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:18.842+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f46900606f0 con 0x7f469c06f030 2024-05-10T11:13:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.072+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f469c0cf020 con 0x7f469c06f030 2024-05-10T11:13:19.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.718+0000 7f468dffb640 1 -- 172.21.15.66:0/15766702 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f469005fff0 con 0x7f469c06f030 2024-05-10T11:13:19.720 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 5 and data pool 6 2024-05-10T11:13:19.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.724+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46800762d0 msgr2=0x7f4680078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:19.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.724+0000 7f46a3620640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46800762d0 0x7f4680078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4698036000 tx=0x7f469800b000 comp rx=0 tx=0).stop 2024-05-10T11:13:19.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.724+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 msgr2=0x7f469c0c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:19.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.724+0000 7f46a3620640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 0x7f469c0c7170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f469000c3c0 tx=0x7f469000c880 comp rx=0 tx=0).stop 2024-05-10T11:13:19.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.726+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 shutdown_connections 2024-05-10T11:13:19.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.726+0000 7f46a3620640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46800762d0 0x7f4680078790 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4698036000 tx=0x7f469800b000 comp rx=0 tx=0).stop 2024-05-10T11:13:19.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.726+0000 7f46a3620640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c160530 0x7f469c06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.726+0000 7f46a3620640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c15c9e0 0x7f469c06df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.726+0000 7f46a3620640 1 --2- 172.21.15.66:0/15766702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f469c06f030 0x7f469c0c7170 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.726+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 >> 172.21.15.66:0/15766702 conn(0x7f469c0d0c90 msgr2=0x7f469c15a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:19.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.727+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 shutdown_connections 2024-05-10T11:13:19.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.727+0000 7f46a3620640 1 -- 172.21.15.66:0/15766702 wait complete. 2024-05-10T11:13:19.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:19.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.857+0000 7fa370389640 1 Processor -- start 2024-05-10T11:13:19.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.857+0000 7fa370389640 1 -- start start 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa370389640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa36815f290 0x7fa3680d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa370389640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3680702e0 0x7fa3680d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa370389640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36806f3c0 con 0x7fa3680d3280 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa370389640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa3680d36f0 con 0x7fa36815f290 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa370389640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa3680d14c0 con 0x7fa3680702e0 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa36e125640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa36815f290 0x7fa3680d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa36e926640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa3680d3280 0x7fa3680cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55502/0 (socket says 172.21.15.66:55502) 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.858+0000 7fa36e926640 1 -- 172.21.15.66:0/1860392706 learned_addr learned my addr 172.21.15.66:0/1860392706 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36e125640 1 -- 172.21.15.66:0/1860392706 >> v2:172.21.15.190:3300/0 conn(0x7fa3680702e0 msgr2=0x7fa3680d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36d924640 1 --2- 172.21.15.66:0/1860392706 >> v2:172.21.15.190:3300/0 conn(0x7fa3680702e0 0x7fa3680d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36d123640 1 -- 172.21.15.66:0/1860392706 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764252894 0 0) 0x7fa36806f3c0 con 0x7fa3680d3280 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36e125640 1 --2- 172.21.15.66:0/1860392706 >> v2:172.21.15.190:3300/0 conn(0x7fa3680702e0 0x7fa3680d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36e125640 1 -- 172.21.15.66:0/1860392706 >> v1:172.21.15.66:6789/0 conn(0x7fa3680d3280 legacy=0x7fa3680cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36e125640 1 -- 172.21.15.66:0/1860392706 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680d16f0 con 0x7fa36815f290 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36d924640 1 --2- 172.21.15.66:0/1860392706 >> v2:172.21.15.190:3300/0 conn(0x7fa3680702e0 0x7fa3680d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.859+0000 7fa36e125640 1 --2- 172.21.15.66:0/1860392706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa36815f290 0x7fa3680d0f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa36806d600 tx=0x7fa36002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dab67184957f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa36d123640 1 -- 172.21.15.66:0/1860392706 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360007740 con 0x7fa36815f290 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa36d123640 1 -- 172.21.15.66:0/1860392706 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3600078e0 con 0x7fa36815f290 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa36d123640 1 -- 172.21.15.66:0/1860392706 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360007cb0 con 0x7fa36815f290 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 -- 172.21.15.66:0/1860392706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa36815f290 msgr2=0x7fa3680d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 --2- 172.21.15.66:0/1860392706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa36815f290 0x7fa3680d0f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa36806d600 tx=0x7fa36002a710 comp rx=0 tx=0).stop 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 -- 172.21.15.66:0/1860392706 shutdown_connections 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 --2- 172.21.15.66:0/1860392706 >> v2:172.21.15.190:3300/0 conn(0x7fa3680702e0 0x7fa3680d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 --2- 172.21.15.66:0/1860392706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa36815f290 0x7fa3680d0f80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 -- 172.21.15.66:0/1860392706 >> 172.21.15.66:0/1860392706 conn(0x7fa36809ba20 msgr2=0x7fa36809be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:19.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 -- 172.21.15.66:0/1860392706 shutdown_connections 2024-05-10T11:13:19.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.860+0000 7fa370389640 1 -- 172.21.15.66:0/1860392706 wait complete. 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.861+0000 7fa370389640 1 Processor -- start 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.861+0000 7fa370389640 1 -- start start 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa370389640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3680702e0 0x7fa3681585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa370389640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 0x7fa36815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa370389640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa36815f290 0x7fa368161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa370389640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680d1cb0 con 0x7fa3680d3280 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa370389640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680d2300 con 0x7fa36815f290 2024-05-10T11:13:19.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa370389640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa3680d1f90 con 0x7fa3680702e0 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa36d924640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 0x7fa36815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa36d924640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 0x7fa36815ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35824/0 (socket says 172.21.15.66:35824) 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.862+0000 7fa36d924640 1 -- 172.21.15.66:0/3205737379 learned_addr learned my addr 172.21.15.66:0/3205737379 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36e125640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3680702e0 0x7fa3681585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36e926640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa36815f290 0x7fa368161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36d924640 1 -- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3680702e0 msgr2=0x7fa3681585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36d924640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3680702e0 0x7fa3681585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36d924640 1 -- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa36815f290 msgr2=0x7fa368161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36d924640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa36815f290 0x7fa368161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36d924640 1 -- 172.21.15.66:0/3205737379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa368160be0 con 0x7fa3680d3280 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36e125640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3680702e0 0x7fa3681585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36e926640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa36815f290 0x7fa368161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:19.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa36d924640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 0x7fa36815ba50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c7f0 tx=0x7fa35c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c015070 con 0x7fa3680d3280 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35c007820 con 0x7fa3680d3280 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c007bd0 con 0x7fa3680d3280 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa368160ec0 con 0x7fa3680d3280 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.863+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa368161480 con 0x7fa3680d3280 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.864+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa368161970 con 0x7fa3680d3280 2024-05-10T11:13:19.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.865+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa35c018070 con 0x7fa3680d3280 2024-05-10T11:13:19.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.865+0000 7fa366ffd640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3540762d0 0x7fa354078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:19.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.865+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fa35c097890 con 0x7fa3680d3280 2024-05-10T11:13:19.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.866+0000 7fa36e125640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3540762d0 0x7fa354078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:19.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.866+0000 7fa36e125640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3540762d0 0x7fa354078790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa360034000 tx=0x7fa36002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:19.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:19.870+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa35c061060 con 0x7fa3680d3280 2024-05-10T11:13:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.061+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3680d2c20 con 0x7fa3680d3280 2024-05-10T11:13:20.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.063+0000 7fa366ffd640 1 -- 172.21.15.66:0/3205737379 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16955 (secure 0 0 0) 0x7fa35c060960 con 0x7fa3680d3280 2024-05-10T11:13:20.062 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:20.063 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:19.073118+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:17.114677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:18.027556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:20.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3540762d0 msgr2=0x7fa354078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3540762d0 0x7fa354078790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa360034000 tx=0x7fa36002f000 comp rx=0 tx=0).stop 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 msgr2=0x7fa36815ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 0x7fa36815ba50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c7f0 tx=0x7fa35c00ccb0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 shutdown_connections 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3540762d0 0x7fa354078790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa36815f290 0x7fa368161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680d3280 0x7fa36815ba50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 --2- 172.21.15.66:0/3205737379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3680702e0 0x7fa3681585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 >> 172.21.15.66:0/3205737379 conn(0x7fa36809ba20 msgr2=0x7fa3680d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 shutdown_connections 2024-05-10T11:13:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.065+0000 7fa370389640 1 -- 172.21.15.66:0/3205737379 wait complete. 2024-05-10T11:13:20.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:20.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.180+0000 7f7ff9d90640 1 Processor -- start 2024-05-10T11:13:20.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.180+0000 7f7ff9d90640 1 -- start start 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff9d90640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7ff40d5cb0 0x7f7ff40d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff9d90640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40b45f0 con 0x7f7ff4162b30 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff9d90640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40b48d0 con 0x7f7ff4162750 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff9d90640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff40b4f20 con 0x7f7ff40d5cb0 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7febfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7ff40d5cb0 0x7f7ff40d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff3fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7ff4162b30 0x7f7ff40b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55516/0 (socket says 172.21.15.66:55516) 2024-05-10T11:13:20.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff3fff640 1 -- 172.21.15.66:0/1423870440 learned_addr learned my addr 172.21.15.66:0/1423870440 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7febfff640 1 -- 172.21.15.66:0/1423870440 >> v1:172.21.15.190:6789/0 conn(0x7f7ff4162750 legacy=0x7f7ff40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7febfff640 1 -- 172.21.15.66:0/1423870440 >> v1:172.21.15.66:6789/0 conn(0x7f7ff4162b30 legacy=0x7f7ff40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7febfff640 1 -- 172.21.15.66:0/1423870440 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff40b4bb0 con 0x7f7ff40d5cb0 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.181+0000 7f7ff2ffd640 1 -- 172.21.15.66:0/1423870440 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083366522 0 0) 0x7f7ff40b45f0 con 0x7f7ff4162b30 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.182+0000 7f7febfff640 1 --2- 172.21.15.66:0/1423870440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff40d5cb0 0x7f7ff40d3630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0097a0 tx=0x7f7fdc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17070015bd11a1a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.182+0000 7f7ff2ffd640 1 -- 172.21.15.66:0/1423870440 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc037070 con 0x7f7ff40d5cb0 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.182+0000 7f7ff2ffd640 1 -- 172.21.15.66:0/1423870440 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fdc032440 con 0x7f7ff40d5cb0 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.182+0000 7f7ff2ffd640 1 -- 172.21.15.66:0/1423870440 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc032810 con 0x7f7ff40d5cb0 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 -- 172.21.15.66:0/1423870440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff40d5cb0 msgr2=0x7f7ff40d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/1423870440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff40d5cb0 0x7f7ff40d3630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0097a0 tx=0x7f7fdc02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 -- 172.21.15.66:0/1423870440 shutdown_connections 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/1423870440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff40d5cb0 0x7f7ff40d3630 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 -- 172.21.15.66:0/1423870440 >> 172.21.15.66:0/1423870440 conn(0x7f7ff409e3b0 msgr2=0x7f7ff40d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:20.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 -- 172.21.15.66:0/1423870440 shutdown_connections 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.183+0000 7f7ff9d90640 1 -- 172.21.15.66:0/1423870440 wait complete. 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.184+0000 7f7ff9d90640 1 Processor -- start 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.184+0000 7f7ff9d90640 1 -- start start 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff9d90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ff4162750 0x7f7ff414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff9d90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 0x7f7ff406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff9d90640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ff406e190 0x7f7ff40ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff9d90640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40d3f40 con 0x7f7ff4162b30 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff9d90640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40d3dc0 con 0x7f7ff406e190 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff9d90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff40d0fe0 con 0x7f7ff4162750 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 0x7f7ff406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 0x7f7ff406dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35844/0 (socket says 172.21.15.66:35844) 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 -- 172.21.15.66:0/3870102940 learned_addr learned my addr 172.21.15.66:0/3870102940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:20.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff37fe640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ff4162750 0x7f7ff414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff3fff640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ff406e190 0x7f7ff40ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 -- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ff4162750 msgr2=0x7f7ff414e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ff4162750 0x7f7ff414e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 -- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ff406e190 msgr2=0x7f7ff40ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ff406e190 0x7f7ff40ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7febfff640 1 -- 172.21.15.66:0/3870102940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff40b7c40 con 0x7f7ff4162b30 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff3fff640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ff406e190 0x7f7ff40ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.185+0000 7f7ff37fe640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ff4162750 0x7f7ff414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.186+0000 7f7febfff640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 0x7f7ff406dc50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.186+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc037040 con 0x7f7ff4162b30 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.186+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fdc042070 con 0x7f7ff4162b30 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.186+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff40b7f20 con 0x7f7ff4162b30 2024-05-10T11:13:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.186+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc030a70 con 0x7f7ff4162b30 2024-05-10T11:13:20.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.186+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff40b84e0 con 0x7f7ff4162b30 2024-05-10T11:13:20.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.187+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff406a220 con 0x7f7ff4162b30 2024-05-10T11:13:20.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.188+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fdc030c10 con 0x7f7ff4162b30 2024-05-10T11:13:20.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.188+0000 7f7ff0ff9640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fd40762d0 0x7f7fd4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.188+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7fdc0b8210 con 0x7f7ff4162b30 2024-05-10T11:13:20.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.188+0000 7f7ff37fe640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fd40762d0 0x7f7fd4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.189+0000 7f7ff37fe640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fd40762d0 0x7f7fd4078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4007fd0 tx=0x7f7fe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:20.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.192+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7fdc0819e0 con 0x7f7ff4162b30 2024-05-10T11:13:20.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.384+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ff406e570 con 0x7f7ff4162b30 2024-05-10T11:13:20.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.385+0000 7f7ff0ff9640 1 -- 172.21.15.66:0/3870102940 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16955 (secure 0 0 0) 0x7f7fdc0812e0 con 0x7f7ff4162b30 2024-05-10T11:13:20.385 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:20.385 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:19.073118+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:17.114677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:18.027556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:20.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fd40762d0 msgr2=0x7f7fd4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fd40762d0 0x7f7fd4078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4007fd0 tx=0x7f7fe4009040 comp rx=0 tx=0).stop 2024-05-10T11:13:20.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 msgr2=0x7f7ff406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 0x7f7ff406dc50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc0046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 shutdown_connections 2024-05-10T11:13:20.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fd40762d0 0x7f7fd4078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ff406e190 0x7f7ff40ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ff4162b30 0x7f7ff406dc50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 --2- 172.21.15.66:0/3870102940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ff4162750 0x7f7ff414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.387+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 >> 172.21.15.66:0/3870102940 conn(0x7f7ff409e3b0 msgr2=0x7f7ff406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:20.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.388+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 shutdown_connections 2024-05-10T11:13:20.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.388+0000 7f7ff9d90640 1 -- 172.21.15.66:0/3870102940 wait complete. 2024-05-10T11:13:20.399 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:13:20.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.506+0000 7f9a674e3640 1 Processor -- start 2024-05-10T11:13:20.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.506+0000 7f9a674e3640 1 -- start start 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a674e3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9a60162ce0 0x7f9a600b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a674e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a600b4e20 0x7f9a600d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a674e3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a600d4190 con 0x7f9a60162900 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a674e3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9a600cfc40 con 0x7f9a60162ce0 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a674e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9a600d3eb0 con 0x7f9a600b4e20 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9a60162ce0 0x7f9a600b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9a60162ce0 0x7f9a600b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35846/0 (socket says 172.21.15.66:35846) 2024-05-10T11:13:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 -- 172.21.15.66:0/1743653792 learned_addr learned my addr 172.21.15.66:0/1743653792 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a65a80640 1 --2- 172.21.15.66:0/1743653792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a600b4e20 0x7f9a600d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 -- 172.21.15.66:0/1743653792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a600b4e20 msgr2=0x7f9a600d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 --2- 172.21.15.66:0/1743653792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a600b4e20 0x7f9a600d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 -- 172.21.15.66:0/1743653792 >> v1:172.21.15.190:6789/0 conn(0x7f9a60162900 legacy=0x7f9a600d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.507+0000 7f9a64a7e640 1 -- 172.21.15.66:0/1743653792 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a600cfee0 con 0x7f9a60162ce0 2024-05-10T11:13:20.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.508+0000 7f9a64a7e640 1 --2- 172.21.15.66:0/1743653792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a600b48e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009870 tx=0x7f9a5002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1143b066a23932 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.508+0000 7f9a57fff640 1 -- 172.21.15.66:0/1743653792 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50037070 con 0x7f9a60162ce0 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.508+0000 7f9a57fff640 1 -- 172.21.15.66:0/1743653792 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a50032440 con 0x7f9a60162ce0 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.508+0000 7f9a57fff640 1 -- 172.21.15.66:0/1743653792 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50032810 con 0x7f9a60162ce0 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 -- 172.21.15.66:0/1743653792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 msgr2=0x7f9a600b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 --2- 172.21.15.66:0/1743653792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a600b48e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009870 tx=0x7f9a5002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 -- 172.21.15.66:0/1743653792 shutdown_connections 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 --2- 172.21.15.66:0/1743653792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a600b4e20 0x7f9a600d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 --2- 172.21.15.66:0/1743653792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a600b48e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 -- 172.21.15.66:0/1743653792 >> 172.21.15.66:0/1743653792 conn(0x7f9a6009e430 msgr2=0x7f9a600d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 -- 172.21.15.66:0/1743653792 shutdown_connections 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.509+0000 7f9a674e3640 1 -- 172.21.15.66:0/1743653792 wait complete. 2024-05-10T11:13:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.510+0000 7f9a674e3640 1 Processor -- start 2024-05-10T11:13:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.510+0000 7f9a674e3640 1 -- start start 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a674e3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a600b4e20 0x7f9a600b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a674e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a60162900 0x7f9a6014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a674e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a60158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a674e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600b4180 con 0x7f9a60162ce0 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a674e3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600d3b20 con 0x7f9a600b4e20 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a674e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9a600b4300 con 0x7f9a60162900 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a60158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a60158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35860/0 (socket says 172.21.15.66:35860) 2024-05-10T11:13:20.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 -- 172.21.15.66:0/3794860276 learned_addr learned my addr 172.21.15.66:0/3794860276 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a6527f640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a600b4e20 0x7f9a600b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a64a7e640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a60162900 0x7f9a6014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 -- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a60162900 msgr2=0x7f9a6014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a60162900 0x7f9a6014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 -- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a600b4e20 msgr2=0x7f9a600b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a600b4e20 0x7f9a600b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.511+0000 7f9a65a80640 1 -- 172.21.15.66:0/3794860276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6015e230 con 0x7f9a60162ce0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.512+0000 7f9a65a80640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a60158fe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009d30 tx=0x7f9a5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.512+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58018020 con 0x7f9a60162ce0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.512+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a58014480 con 0x7f9a60162ce0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.512+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58014870 con 0x7f9a60162ce0 2024-05-10T11:13:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.512+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6015e510 con 0x7f9a60162ce0 2024-05-10T11:13:20.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.512+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6015ead0 con 0x7f9a60162ce0 2024-05-10T11:13:20.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.513+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6015eea0 con 0x7f9a60162ce0 2024-05-10T11:13:20.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.514+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a58005d10 con 0x7f9a60162ce0 2024-05-10T11:13:20.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.514+0000 7f9a55ffb640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a440762d0 0x7f9a44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:20.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.514+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f9a580981b0 con 0x7f9a60162ce0 2024-05-10T11:13:20.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.515+0000 7f9a6527f640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a440762d0 0x7f9a44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:20.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.515+0000 7f9a6527f640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a440762d0 0x7f9a44078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c007fd0 tx=0x7f9a5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:20.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.518+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9a58022070 con 0x7f9a60162ce0 2024-05-10T11:13:20.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:20.748+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9a6006a220 con 0x7f9a60162ce0 2024-05-10T11:13:21.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.725+0000 7f9a55ffb640 1 -- 172.21.15.66:0/3794860276 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f9a58010040 con 0x7f9a60162ce0 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a440762d0 msgr2=0x7f9a44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a440762d0 0x7f9a44078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c007fd0 tx=0x7f9a5c009040 comp rx=0 tx=0).stop 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 msgr2=0x7f9a60158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a60158fe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009d30 tx=0x7f9a5800c490 comp rx=0 tx=0).stop 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 shutdown_connections 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a440762d0 0x7f9a44078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a60162ce0 0x7f9a60158fe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a60162900 0x7f9a6014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 --2- 172.21.15.66:0/3794860276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a600b4e20 0x7f9a600b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 >> 172.21.15.66:0/3794860276 conn(0x7f9a6009e430 msgr2=0x7f9a6006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 shutdown_connections 2024-05-10T11:13:21.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.728+0000 7f9a674e3640 1 -- 172.21.15.66:0/3794860276 wait complete. 2024-05-10T11:13:21.742 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:13:21.742 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:13:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.856+0000 7f354e1c1640 1 Processor -- start 2024-05-10T11:13:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.856+0000 7f354e1c1640 1 -- start start 2024-05-10T11:13:21.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f354e1c1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f35480ce300 0x7f35480ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:21.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f354e1c1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35480ced20 0x7f354806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:21.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f354e1c1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3548160fa0 con 0x7f354815d050 2024-05-10T11:13:21.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f354e1c1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3548160d50 con 0x7f35480ced20 2024-05-10T11:13:21.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f354e1c1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f35481618d0 con 0x7f35480ce300 2024-05-10T11:13:21.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f3547fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35480ced20 0x7f354806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:21.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f3547fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35480ced20 0x7f354806fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35876/0 (socket says 172.21.15.66:35876) 2024-05-10T11:13:21.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.857+0000 7f3547fff640 1 -- 172.21.15.66:0/139790133 learned_addr learned my addr 172.21.15.66:0/139790133 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:21.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3546ffd640 1 --2- 172.21.15.66:0/139790133 >> v2:172.21.15.190:3300/0 conn(0x7f35480ce300 0x7f35480ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:21.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3547fff640 1 -- 172.21.15.66:0/139790133 >> v2:172.21.15.190:3300/0 conn(0x7f35480ce300 msgr2=0x7f35480ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:21.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3547fff640 1 --2- 172.21.15.66:0/139790133 >> v2:172.21.15.190:3300/0 conn(0x7f35480ce300 0x7f35480ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3547fff640 1 -- 172.21.15.66:0/139790133 >> v1:172.21.15.190:6789/0 conn(0x7f354815d050 legacy=0x7f35480cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:21.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3547fff640 1 -- 172.21.15.66:0/139790133 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3548161280 con 0x7f35480ced20 2024-05-10T11:13:21.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3546ffd640 1 --2- 172.21.15.66:0/139790133 >> v2:172.21.15.190:3300/0 conn(0x7f35480ce300 0x7f35480ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:21.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.858+0000 7f3547fff640 1 --2- 172.21.15.66:0/139790133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35480ced20 0x7f354806fb20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f35480a00b0 tx=0x7f354002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d5f992da93d7af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f35467fc640 1 -- 172.21.15.66:0/139790133 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540036070 con 0x7f35480ced20 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f35467fc640 1 -- 172.21.15.66:0/139790133 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3540031600 con 0x7f35480ced20 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f35467fc640 1 -- 172.21.15.66:0/139790133 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35400319d0 con 0x7f35480ced20 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 -- 172.21.15.66:0/139790133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35480ced20 msgr2=0x7f354806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 --2- 172.21.15.66:0/139790133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35480ced20 0x7f354806fb20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f35480a00b0 tx=0x7f354002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 -- 172.21.15.66:0/139790133 shutdown_connections 2024-05-10T11:13:21.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 --2- 172.21.15.66:0/139790133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35480ced20 0x7f354806fb20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 --2- 172.21.15.66:0/139790133 >> v2:172.21.15.190:3300/0 conn(0x7f35480ce300 0x7f35480ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 -- 172.21.15.66:0/139790133 >> 172.21.15.66:0/139790133 conn(0x7f35480b3c60 msgr2=0x7f35480b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:21.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 -- 172.21.15.66:0/139790133 shutdown_connections 2024-05-10T11:13:21.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.859+0000 7f354e1c1640 1 -- 172.21.15.66:0/139790133 wait complete. 2024-05-10T11:13:21.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.861+0000 7f354e1c1640 1 Processor -- start 2024-05-10T11:13:21.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.861+0000 7f354e1c1640 1 -- start start 2024-05-10T11:13:21.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.861+0000 7f354e1c1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35480ce300 0x7f354814b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:21.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.861+0000 7f354e1c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35480ced20 0x7f35480d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:21.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f354e1c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 0x7f35480d2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:21.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f354e1c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f354815d5b0 con 0x7f354815d050 2024-05-10T11:13:21.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f354e1c1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f354815d430 con 0x7f35480ce300 2024-05-10T11:13:21.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f354e1c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3548070060 con 0x7f35480ced20 2024-05-10T11:13:21.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 0x7f35480d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:21.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 0x7f35480d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35892/0 (socket says 172.21.15.66:35892) 2024-05-10T11:13:21.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 -- 172.21.15.66:0/951598268 learned_addr learned my addr 172.21.15.66:0/951598268 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:21.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3546ffd640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35480ced20 0x7f35480d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:21.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f35477fe640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35480ce300 0x7f354814b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:21.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 -- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35480ced20 msgr2=0x7f35480d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:21.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35480ced20 0x7f35480d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 -- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35480ce300 msgr2=0x7f354814b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:21.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35480ce300 0x7f354814b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:21.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 -- 172.21.15.66:0/951598268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354814bec0 con 0x7f354815d050 2024-05-10T11:13:21.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f3547fff640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 0x7f35480d2080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3540009f40 tx=0x7f3540004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:21.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540036050 con 0x7f354815d050 2024-05-10T11:13:21.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3540042070 con 0x7f354815d050 2024-05-10T11:13:21.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35480b4f20 con 0x7f354815d050 2024-05-10T11:13:21.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540009510 con 0x7f354815d050 2024-05-10T11:13:21.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.862+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35480b54e0 con 0x7f354815d050 2024-05-10T11:13:21.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.863+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354806a220 con 0x7f354815d050 2024-05-10T11:13:21.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.864+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3540007c70 con 0x7f354815d050 2024-05-10T11:13:21.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.864+0000 7f352ffff640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35340762d0 0x7f3534078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:21.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.865+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f35400b8890 con 0x7f354815d050 2024-05-10T11:13:21.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.865+0000 7f35477fe640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35340762d0 0x7f3534078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:21.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.865+0000 7f35477fe640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35340762d0 0x7f3534078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f353800a750 tx=0x7f3538008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:21.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:21.869+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f354814bec0 con 0x7f354815d050 2024-05-10T11:13:22.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.099+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f35480d2ce0 con 0x7f354815d050 2024-05-10T11:13:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.731+0000 7f352ffff640 1 -- 172.21.15.66:0/951598268 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f3540082060 con 0x7f354815d050 2024-05-10T11:13:22.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.733+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35340762d0 msgr2=0x7f3534078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:22.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.733+0000 7f354e1c1640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35340762d0 0x7f3534078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f353800a750 tx=0x7f3538008040 comp rx=0 tx=0).stop 2024-05-10T11:13:22.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.733+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 msgr2=0x7f35480d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:22.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.733+0000 7f354e1c1640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 0x7f35480d2080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3540009f40 tx=0x7f3540004a40 comp rx=0 tx=0).stop 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.733+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 shutdown_connections 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35340762d0 0x7f3534078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354815d050 0x7f35480d2080 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35480ced20 0x7f35480d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 --2- 172.21.15.66:0/951598268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35480ce300 0x7f354814b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 >> 172.21.15.66:0/951598268 conn(0x7f35480b3c60 msgr2=0x7f3548158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 shutdown_connections 2024-05-10T11:13:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.734+0000 7f354e1c1640 1 -- 172.21.15.66:0/951598268 wait complete. 2024-05-10T11:13:22.747 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:13:22.747 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:22.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.858+0000 7f1851f46640 1 Processor -- start 2024-05-10T11:13:22.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.858+0000 7f1851f46640 1 -- start start 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f1851f46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f184c1598c0 0x7f184c06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f1851f46640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f184c0c7390 0x7f184c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f1851f46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184c06f1c0 con 0x7f184c06ec40 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f1851f46640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f184c06f4a0 con 0x7f184c0c7390 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f1851f46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f184c06f780 con 0x7f184c1598c0 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f184bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f184c0c7390 0x7f184c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f184bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f184c0c7390 0x7f184c0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35896/0 (socket says 172.21.15.66:35896) 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.859+0000 7f184bfff640 1 -- 172.21.15.66:0/3512795277 learned_addr learned my addr 172.21.15.66:0/3512795277 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:22.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.860+0000 7f184b7fe640 1 --2- 172.21.15.66:0/3512795277 >> v2:172.21.15.190:3300/0 conn(0x7f184c1598c0 0x7f184c06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.860+0000 7f184bfff640 1 -- 172.21.15.66:0/3512795277 >> v2:172.21.15.190:3300/0 conn(0x7f184c1598c0 msgr2=0x7f184c06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.860+0000 7f184bfff640 1 --2- 172.21.15.66:0/3512795277 >> v2:172.21.15.190:3300/0 conn(0x7f184c1598c0 0x7f184c06e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.860+0000 7f184bfff640 1 -- 172.21.15.66:0/3512795277 >> v1:172.21.15.190:6789/0 conn(0x7f184c06ec40 legacy=0x7f184c0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.860+0000 7f184bfff640 1 -- 172.21.15.66:0/3512795277 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c06fa60 con 0x7f184c0c7390 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.860+0000 7f184bfff640 1 --2- 172.21.15.66:0/3512795277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c0c7390 0x7f184c0cee40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f184c0b3930 tx=0x7f184402c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8379ff4572d782 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f184a7fc640 1 -- 172.21.15.66:0/3512795277 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844009600 con 0x7f184c0c7390 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f184a7fc640 1 -- 172.21.15.66:0/3512795277 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18440097a0 con 0x7f184c0c7390 2024-05-10T11:13:22.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f184a7fc640 1 -- 172.21.15.66:0/3512795277 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844009b70 con 0x7f184c0c7390 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 -- 172.21.15.66:0/3512795277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c0c7390 msgr2=0x7f184c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 --2- 172.21.15.66:0/3512795277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c0c7390 0x7f184c0cee40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f184c0b3930 tx=0x7f184402c900 comp rx=0 tx=0).stop 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 -- 172.21.15.66:0/3512795277 shutdown_connections 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 --2- 172.21.15.66:0/3512795277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c0c7390 0x7f184c0cee40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 --2- 172.21.15.66:0/3512795277 >> v2:172.21.15.190:3300/0 conn(0x7f184c1598c0 0x7f184c06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 -- 172.21.15.66:0/3512795277 >> 172.21.15.66:0/3512795277 conn(0x7f184c0b2900 msgr2=0x7f184c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:22.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 -- 172.21.15.66:0/3512795277 shutdown_connections 2024-05-10T11:13:22.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.861+0000 7f1851f46640 1 -- 172.21.15.66:0/3512795277 wait complete. 2024-05-10T11:13:22.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.862+0000 7f1851f46640 1 Processor -- start 2024-05-10T11:13:22.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 -- start start 2024-05-10T11:13:22.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 0x7f184c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:22.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184c0c7390 0x7f184c0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:22.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f184c1598c0 0x7f184c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:22.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f184c159ca0 con 0x7f184c06ec40 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f184c15c6e0 con 0x7f184c1598c0 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.863+0000 7f1851f46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f184c159e20 con 0x7f184c0c7390 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 0x7f184c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 0x7f184c156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35900/0 (socket says 172.21.15.66:35900) 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 -- 172.21.15.66:0/33312041 learned_addr learned my addr 172.21.15.66:0/33312041 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184bfff640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f184c1598c0 0x7f184c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184affd640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184c0c7390 0x7f184c0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 -- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184c0c7390 msgr2=0x7f184c0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184c0c7390 0x7f184c0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 -- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f184c1598c0 msgr2=0x7f184c14f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f184c1598c0 0x7f184c14f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 -- 172.21.15.66:0/33312041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c0afee0 con 0x7f184c06ec40 2024-05-10T11:13:22.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184bfff640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f184c1598c0 0x7f184c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184affd640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184c0c7390 0x7f184c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f184b7fe640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 0x7f184c156b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f183c00d5f0 tx=0x7f183c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c0125f0 con 0x7f184c06ec40 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c019070 con 0x7f184c06ec40 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184c0b01c0 con 0x7f184c06ec40 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c0129d0 con 0x7f184c06ec40 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.864+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c0cc5f0 con 0x7f184c06ec40 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.865+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184c06a220 con 0x7f184c06ec40 2024-05-10T11:13:22.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.866+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f183c012b70 con 0x7f184c06ec40 2024-05-10T11:13:22.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.867+0000 7f1833fff640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18380762d0 0x7f1838078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:22.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.867+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f183c097b30 con 0x7f184c06ec40 2024-05-10T11:13:22.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.867+0000 7f184affd640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18380762d0 0x7f1838078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:22.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.867+0000 7f184affd640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18380762d0 0x7f1838078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f184c09ed50 tx=0x7f1840009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:22.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:22.871+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f183c061390 con 0x7f184c06ec40 2024-05-10T11:13:23.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.102+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f184c0cfaa0 con 0x7f184c06ec40 2024-05-10T11:13:23.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.102+0000 7f1833fff640 1 -- 172.21.15.66:0/33312041 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f183c060c90 con 0x7f184c06ec40 2024-05-10T11:13:23.102 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:23.102 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:23.102 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18380762d0 msgr2=0x7f1838078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18380762d0 0x7f1838078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f184c09ed50 tx=0x7f1840009040 comp rx=0 tx=0).stop 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 msgr2=0x7f184c156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 0x7f184c156b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f183c00d5f0 tx=0x7f183c00dab0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 shutdown_connections 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18380762d0 0x7f1838078790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f184c1598c0 0x7f184c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184c0c7390 0x7f184c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 --2- 172.21.15.66:0/33312041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f184c06ec40 0x7f184c156b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 >> 172.21.15.66:0/33312041 conn(0x7f184c0b2900 msgr2=0x7f184c158040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:23.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 shutdown_connections 2024-05-10T11:13:23.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.104+0000 7f1851f46640 1 -- 172.21.15.66:0/33312041 wait complete. 2024-05-10T11:13:23.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:23.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.219+0000 7fb5e41af640 1 Processor -- start 2024-05-10T11:13:23.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.219+0000 7fb5e41af640 1 -- start start 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e41af640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb5dc0d59d0 0x7fb5dc0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e41af640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5dc0d2d20 con 0x7fb5dc0d3d80 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e41af640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5dc0d3000 con 0x7fb5dc162940 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e41af640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb5dc162d20 con 0x7fb5dc0d59d0 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e174a640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb5dc0d3d80 0x7fb5dc0d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55520/0 (socket says 172.21.15.66:55520) 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e174a640 1 -- 172.21.15.66:0/331634370 learned_addr learned my addr 172.21.15.66:0/331634370 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.220+0000 7fb5e274c640 1 --2- 172.21.15.66:0/331634370 >> v2:172.21.15.190:3300/0 conn(0x7fb5dc0d59d0 0x7fb5dc0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101782515 0 0) 0x7fb5dc0d2d20 con 0x7fb5dc0d3d80 2024-05-10T11:13:23.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c8003520 con 0x7fb5dc0d3d80 2024-05-10T11:13:23.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3205815058 0 0) 0x7fb5c8003520 con 0x7fb5dc0d3d80 2024-05-10T11:13:23.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 >> v2:172.21.15.190:3300/0 conn(0x7fb5dc0d59d0 msgr2=0x7fb5dc0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:23.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 --2- 172.21.15.66:0/331634370 >> v2:172.21.15.190:3300/0 conn(0x7fb5dc0d59d0 0x7fb5dc0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 >> v1:172.21.15.190:6789/0 conn(0x7fb5dc162940 legacy=0x7fb5dc0d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc0d32e0 con 0x7fb5dc0d3d80 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fb5cc001670 con 0x7fb5dc0d3d80 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 >> v1:172.21.15.66:6789/0 conn(0x7fb5dc0d3d80 legacy=0x7fb5dc0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5c80043b0 0x7fb5c8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c8005120 0x7fb5c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c800c030 con 0x7fb5c80039b0 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c800c1e0 con 0x7fb5c80043b0 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c800c3e0 con 0x7fb5c8005120 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e174a640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5c80043b0 0x7fb5c8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.221+0000 7fb5e274c640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c8005120 0x7fb5c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e1f4b640 1 -- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c8005120 msgr2=0x7fb5c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:23.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c8005120 0x7fb5c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e1f4b640 1 -- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5c80043b0 msgr2=0x7fb5c8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5c80043b0 0x7fb5c8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e274c640 1 -- 172.21.15.66:0/331634370 reap_dead start 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e1f4b640 1 -- 172.21.15.66:0/331634370 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c8003520 con 0x7fb5c80039b0 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8001860 tx=0x7fb5c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae22e12faf53260a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8037070 con 0x7fb5c80039b0 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d802ac30 con 0x7fb5c80039b0 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.222+0000 7fb5e0f49640 1 -- 172.21.15.66:0/331634370 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8001430 con 0x7fb5c80039b0 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 -- 172.21.15.66:0/331634370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5c80039b0 msgr2=0x7fb5c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8001860 tx=0x7fb5c8005830 comp rx=0 tx=0).stop 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 -- 172.21.15.66:0/331634370 shutdown_connections 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 --2- 172.21.15.66:0/331634370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 -- 172.21.15.66:0/331634370 >> 172.21.15.66:0/331634370 conn(0x7fb5dc09e380 msgr2=0x7fb5dc0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:23.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 -- 172.21.15.66:0/331634370 shutdown_connections 2024-05-10T11:13:23.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.223+0000 7fb5e41af640 1 -- 172.21.15.66:0/331634370 wait complete. 2024-05-10T11:13:23.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.224+0000 7fb5e41af640 1 Processor -- start 2024-05-10T11:13:23.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.224+0000 7fb5e41af640 1 -- start start 2024-05-10T11:13:23.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e41af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c80039b0 0x7fb5dc1f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e41af640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5dc0b85f0 0x7fb5dc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e41af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 0x7fb5dc0ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e41af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc0d2390 con 0x7fb5dc0ba200 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e41af640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc0cfc50 con 0x7fb5dc0b85f0 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e41af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5dc0d2510 con 0x7fb5c80039b0 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e274c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 0x7fb5dc0ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e274c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 0x7fb5dc0ba6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35928/0 (socket says 172.21.15.66:35928) 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e274c640 1 -- 172.21.15.66:0/3566362672 learned_addr learned my addr 172.21.15.66:0/3566362672 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c80039b0 0x7fb5dc1f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.225+0000 7fb5e174a640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5dc0b85f0 0x7fb5dc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e274c640 1 -- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c80039b0 msgr2=0x7fb5dc1f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e274c640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c80039b0 0x7fb5dc1f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e274c640 1 -- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5dc0b85f0 msgr2=0x7fb5dc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e274c640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5dc0b85f0 0x7fb5dc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e274c640 1 -- 172.21.15.66:0/3566362672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc1f59e0 con 0x7fb5dc0ba200 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e274c640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 0x7fb5dc0ba6b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0cf790 tx=0x7fb5d400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400fde0 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d4015430 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc0b7e30 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4015820 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.226+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc0b8a80 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.227+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc06a220 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.228+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5d40159c0 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.228+0000 7fb5d27fc640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5c00762d0 0x7fb5c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.229+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fb5d4098430 con 0x7fb5dc0ba200 2024-05-10T11:13:23.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.229+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5c00762d0 0x7fb5c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.229+0000 7fb5e1f4b640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5c00762d0 0x7fb5c0078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8034000 tx=0x7fb5d8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.233+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb5dc1f59e0 con 0x7fb5dc0ba200 2024-05-10T11:13:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.427+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5dc0d2730 con 0x7fb5dc0ba200 2024-05-10T11:13:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.428+0000 7fb5d27fc640 1 -- 172.21.15.66:0/3566362672 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16942 (secure 0 0 0) 0x7fb5d4019030 con 0x7fb5dc0ba200 2024-05-10T11:13:23.428 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:23.428 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":37,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:20.718190+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:17.114677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:18.027556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5c00762d0 msgr2=0x7fb5c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5c00762d0 0x7fb5c0078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8034000 tx=0x7fb5d8009030 comp rx=0 tx=0).stop 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 msgr2=0x7fb5dc0ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 0x7fb5dc0ba6b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0cf790 tx=0x7fb5d400f580 comp rx=0 tx=0).stop 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 shutdown_connections 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5c00762d0 0x7fb5c0078790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5dc0ba200 0x7fb5dc0ba6b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5dc0b85f0 0x7fb5dc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 --2- 172.21.15.66:0/3566362672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5c80039b0 0x7fb5dc1f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 >> 172.21.15.66:0/3566362672 conn(0x7fb5dc09e380 msgr2=0x7fb5dc15e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 shutdown_connections 2024-05-10T11:13:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.431+0000 7fb5e41af640 1 -- 172.21.15.66:0/3566362672 wait complete. 2024-05-10T11:13:23.441 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:13:23.442 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:13:23.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.546+0000 7f1373f51640 1 Processor -- start 2024-05-10T11:13:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.546+0000 7f1373f51640 1 -- start start 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1373f51640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f136c162750 0x7f136c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1373f51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c0d5cb0 0x7f136c0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1373f51640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f136c0b45f0 con 0x7f136c162b30 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1373f51640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f136c0b4f20 con 0x7f136c162750 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1373f51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f136c0d0fe0 con 0x7f136c0d5cb0 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1371ced640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f136c162750 0x7f136c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1371ced640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f136c162750 0x7f136c0d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35944/0 (socket says 172.21.15.66:35944) 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f1371ced640 1 -- 172.21.15.66:0/1776882309 learned_addr learned my addr 172.21.15.66:0/1776882309 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.547+0000 7f13714ec640 1 --2- 172.21.15.66:0/1776882309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c0d5cb0 0x7f136c0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.548+0000 7f1371ced640 1 -- 172.21.15.66:0/1776882309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c0d5cb0 msgr2=0x7f136c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.548+0000 7f1371ced640 1 --2- 172.21.15.66:0/1776882309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c0d5cb0 0x7f136c0d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.548+0000 7f1371ced640 1 -- 172.21.15.66:0/1776882309 >> v1:172.21.15.190:6789/0 conn(0x7f136c162b30 legacy=0x7f136c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.548+0000 7f1371ced640 1 -- 172.21.15.66:0/1776882309 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c0b48d0 con 0x7f136c162750 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.548+0000 7f1371ced640 1 --2- 172.21.15.66:0/1776882309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162750 0x7f136c0d0670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1368009870 tx=0x7f136802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bebd3839f69c994 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1370ceb640 1 -- 172.21.15.66:0/1776882309 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368037070 con 0x7f136c162750 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1370ceb640 1 -- 172.21.15.66:0/1776882309 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368032440 con 0x7f136c162750 2024-05-10T11:13:23.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1370ceb640 1 -- 172.21.15.66:0/1776882309 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368032810 con 0x7f136c162750 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 -- 172.21.15.66:0/1776882309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162750 msgr2=0x7f136c0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 --2- 172.21.15.66:0/1776882309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162750 0x7f136c0d0670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1368009870 tx=0x7f136802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 -- 172.21.15.66:0/1776882309 shutdown_connections 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 --2- 172.21.15.66:0/1776882309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c0d5cb0 0x7f136c0d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 --2- 172.21.15.66:0/1776882309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162750 0x7f136c0d0670 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 -- 172.21.15.66:0/1776882309 >> 172.21.15.66:0/1776882309 conn(0x7f136c09e3b0 msgr2=0x7f136c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 -- 172.21.15.66:0/1776882309 shutdown_connections 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.549+0000 7f1373f51640 1 -- 172.21.15.66:0/1776882309 wait complete. 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.550+0000 7f1373f51640 1 Processor -- start 2024-05-10T11:13:23.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.550+0000 7f1373f51640 1 -- start start 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f1373f51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c162750 0x7f136c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f1373f51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 0x7f136c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f1373f51640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f136c15cd00 0x7f136c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f1373f51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0d0d30 con 0x7f136c162b30 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f1373f51640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0d0bb0 con 0x7f136c15cd00 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f1373f51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f136c0b63c0 con 0x7f136c162750 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f13714ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 0x7f136c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f13714ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 0x7f136c15c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35960/0 (socket says 172.21.15.66:35960) 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.551+0000 7f13714ec640 1 -- 172.21.15.66:0/2278410705 learned_addr learned my addr 172.21.15.66:0/2278410705 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f1371ced640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c162750 0x7f136c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13724ee640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f136c15cd00 0x7f136c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13714ec640 1 -- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c162750 msgr2=0x7f136c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13714ec640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c162750 0x7f136c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13714ec640 1 -- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f136c15cd00 msgr2=0x7f136c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13714ec640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f136c15cd00 0x7f136c15d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13714ec640 1 -- 172.21.15.66:0/2278410705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c0cb2e0 con 0x7f136c162b30 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f1371ced640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c162750 0x7f136c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13714ec640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 0x7f136c15c7c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f135c00e9b0 tx=0x7f135c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c017070 con 0x7f136c162b30 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c00c9a0 con 0x7f136c162b30 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136c0b7ce0 con 0x7f136c162b30 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c00cd90 con 0x7f136c162b30 2024-05-10T11:13:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.552+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136c0b82a0 con 0x7f136c162b30 2024-05-10T11:13:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.553+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136c06a220 con 0x7f136c162b30 2024-05-10T11:13:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.554+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f135c01a070 con 0x7f136c162b30 2024-05-10T11:13:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.554+0000 7f13627fc640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13500762d0 0x7f1350078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.554+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f135c097bd0 con 0x7f136c162b30 2024-05-10T11:13:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.555+0000 7f1371ced640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13500762d0 0x7f1350078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.555+0000 7f1371ced640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13500762d0 0x7f1350078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1368034000 tx=0x7f136802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.558+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f135c061310 con 0x7f136c162b30 2024-05-10T11:13:23.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.751+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f136c0d1850 con 0x7f13500762d0 2024-05-10T11:13:23.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.757+0000 7f13627fc640 1 -- 172.21.15.66:0/2278410705 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250038 (secure 0 0 0) 0x7f136c0d1850 con 0x7f13500762d0 2024-05-10T11:13:23.760 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:23.761 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:13:23.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13500762d0 msgr2=0x7f1350078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13500762d0 0x7f1350078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1368034000 tx=0x7f136802e000 comp rx=0 tx=0).stop 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 msgr2=0x7f136c15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 0x7f136c15c7c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f135c00e9b0 tx=0x7f135c00ee70 comp rx=0 tx=0).stop 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 shutdown_connections 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13500762d0 0x7f1350078790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f136c15cd00 0x7f136c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136c162b30 0x7f136c15c7c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 --2- 172.21.15.66:0/2278410705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f136c162750 0x7f136c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 >> 172.21.15.66:0/2278410705 conn(0x7f136c09e3b0 msgr2=0x7f136c0d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 shutdown_connections 2024-05-10T11:13:23.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.761+0000 7f1373f51640 1 -- 172.21.15.66:0/2278410705 wait complete. 2024-05-10T11:13:23.771 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-10T11:13:23.696740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220544,"kb_used_data":4364,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754176,"statfs":{"total":773094113280,"available":772868276224,"internally_reserved":0,"allocated":4468736,"data_stored":2551025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001475"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764580+0000","last_change":"2024-05-10T11:13:19.732597+0000","last_active":"2024-05-10T11:13:20.764580+0000","last_peered":"2024-05-10T11:13:20.764580+0000","last_clean":"2024-05-10T11:13:20.764580+0000","last_became_active":"2024-05-10T11:13:19.732175+0000","last_became_peered":"2024-05-10T11:13:19.732175+0000","last_unstale":"2024-05-10T11:13:20.764580+0000","last_undegraded":"2024-05-10T11:13:20.764580+0000","last_fullsized":"2024-05-10T11:13:20.764580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:36.288762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763960+0000","last_change":"2024-05-10T11:13:19.739881+0000","last_active":"2024-05-10T11:13:20.763960+0000","last_peered":"2024-05-10T11:13:20.763960+0000","last_clean":"2024-05-10T11:13:20.763960+0000","last_became_active":"2024-05-10T11:13:19.739453+0000","last_became_peered":"2024-05-10T11:13:19.739453+0000","last_unstale":"2024-05-10T11:13:20.763960+0000","last_undegraded":"2024-05-10T11:13:20.763960+0000","last_fullsized":"2024-05-10T11:13:20.763960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729120+0000","last_change":"2024-05-10T11:13:19.733275+0000","last_active":"2024-05-10T11:13:20.729120+0000","last_peered":"2024-05-10T11:13:20.729120+0000","last_clean":"2024-05-10T11:13:20.729120+0000","last_became_active":"2024-05-10T11:13:19.732987+0000","last_became_peered":"2024-05-10T11:13:19.732987+0000","last_unstale":"2024-05-10T11:13:20.729120+0000","last_undegraded":"2024-05-10T11:13:20.729120+0000","last_fullsized":"2024-05-10T11:13:20.729120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:56.702776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728116+0000","last_change":"2024-05-10T11:13:19.733990+0000","last_active":"2024-05-10T11:13:20.728116+0000","last_peered":"2024-05-10T11:13:20.728116+0000","last_clean":"2024-05-10T11:13:20.728116+0000","last_became_active":"2024-05-10T11:13:19.733699+0000","last_became_peered":"2024-05-10T11:13:19.733699+0000","last_unstale":"2024-05-10T11:13:20.728116+0000","last_undegraded":"2024-05-10T11:13:20.728116+0000","last_fullsized":"2024-05-10T11:13:20.728116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:11.815701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.732957+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.732674+0000","last_became_peered":"2024-05-10T11:13:19.732674+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:46.137307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763665+0000","last_change":"2024-05-10T11:13:19.738793+0000","last_active":"2024-05-10T11:13:20.763665+0000","last_peered":"2024-05-10T11:13:20.763665+0000","last_clean":"2024-05-10T11:13:20.763665+0000","last_became_active":"2024-05-10T11:13:19.738522+0000","last_became_peered":"2024-05-10T11:13:19.738522+0000","last_unstale":"2024-05-10T11:13:20.763665+0000","last_undegraded":"2024-05-10T11:13:20.763665+0000","last_fullsized":"2024-05-10T11:13:20.763665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734297+0000","last_change":"2024-05-10T11:13:19.727429+0000","last_active":"2024-05-10T11:13:20.734297+0000","last_peered":"2024-05-10T11:13:20.734297+0000","last_clean":"2024-05-10T11:13:20.734297+0000","last_became_active":"2024-05-10T11:13:19.727146+0000","last_became_peered":"2024-05-10T11:13:19.727146+0000","last_unstale":"2024-05-10T11:13:20.734297+0000","last_undegraded":"2024-05-10T11:13:20.734297+0000","last_fullsized":"2024-05-10T11:13:20.734297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:07.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764030+0000","last_change":"2024-05-10T11:13:19.729084+0000","last_active":"2024-05-10T11:13:20.764030+0000","last_peered":"2024-05-10T11:13:20.764030+0000","last_clean":"2024-05-10T11:13:20.764030+0000","last_became_active":"2024-05-10T11:13:19.728796+0000","last_became_peered":"2024-05-10T11:13:19.728796+0000","last_unstale":"2024-05-10T11:13:20.764030+0000","last_undegraded":"2024-05-10T11:13:20.764030+0000","last_fullsized":"2024-05-10T11:13:20.764030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729383+0000","last_change":"2024-05-10T11:13:19.735425+0000","last_active":"2024-05-10T11:13:20.729383+0000","last_peered":"2024-05-10T11:13:20.729383+0000","last_clean":"2024-05-10T11:13:20.729383+0000","last_became_active":"2024-05-10T11:13:19.735053+0000","last_became_peered":"2024-05-10T11:13:19.735053+0000","last_unstale":"2024-05-10T11:13:20.729383+0000","last_undegraded":"2024-05-10T11:13:20.729383+0000","last_fullsized":"2024-05-10T11:13:20.729383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:04.283560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734820+0000","last_change":"2024-05-10T11:13:19.725056+0000","last_active":"2024-05-10T11:13:20.734820+0000","last_peered":"2024-05-10T11:13:20.734820+0000","last_clean":"2024-05-10T11:13:20.734820+0000","last_became_active":"2024-05-10T11:13:19.724833+0000","last_became_peered":"2024-05-10T11:13:19.724833+0000","last_unstale":"2024-05-10T11:13:20.734820+0000","last_undegraded":"2024-05-10T11:13:20.734820+0000","last_fullsized":"2024-05-10T11:13:20.734820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734748+0000","last_change":"2024-05-10T11:13:19.726523+0000","last_active":"2024-05-10T11:13:20.734748+0000","last_peered":"2024-05-10T11:13:20.734748+0000","last_clean":"2024-05-10T11:13:20.734748+0000","last_became_active":"2024-05-10T11:13:19.726280+0000","last_became_peered":"2024-05-10T11:13:19.726280+0000","last_unstale":"2024-05-10T11:13:20.734748+0000","last_undegraded":"2024-05-10T11:13:20.734748+0000","last_fullsized":"2024-05-10T11:13:20.734748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729035+0000","last_change":"2024-05-10T11:13:19.734209+0000","last_active":"2024-05-10T11:13:20.729035+0000","last_peered":"2024-05-10T11:13:20.729035+0000","last_clean":"2024-05-10T11:13:20.729035+0000","last_became_active":"2024-05-10T11:13:19.733951+0000","last_became_peered":"2024-05-10T11:13:19.733951+0000","last_unstale":"2024-05-10T11:13:20.729035+0000","last_undegraded":"2024-05-10T11:13:20.729035+0000","last_fullsized":"2024-05-10T11:13:20.729035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734619+0000","last_change":"2024-05-10T11:13:19.725439+0000","last_active":"2024-05-10T11:13:20.734619+0000","last_peered":"2024-05-10T11:13:20.734619+0000","last_clean":"2024-05-10T11:13:20.734619+0000","last_became_active":"2024-05-10T11:13:19.725149+0000","last_became_peered":"2024-05-10T11:13:19.725149+0000","last_unstale":"2024-05-10T11:13:20.734619+0000","last_undegraded":"2024-05-10T11:13:20.734619+0000","last_fullsized":"2024-05-10T11:13:20.734619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692849+0000","last_change":"2024-05-10T11:13:18.692849+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692849+0000","last_undegraded":"2024-05-10T11:13:18.692849+0000","last_fullsized":"2024-05-10T11:13:18.692849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734333+0000","last_change":"2024-05-10T11:13:19.730590+0000","last_active":"2024-05-10T11:13:20.734333+0000","last_peered":"2024-05-10T11:13:20.734333+0000","last_clean":"2024-05-10T11:13:20.734333+0000","last_became_active":"2024-05-10T11:13:19.730313+0000","last_became_peered":"2024-05-10T11:13:19.730313+0000","last_unstale":"2024-05-10T11:13:20.734333+0000","last_undegraded":"2024-05-10T11:13:20.734333+0000","last_fullsized":"2024-05-10T11:13:20.734333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:01.085545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692041+0000","last_change":"2024-05-10T11:13:18.692041+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692041+0000","last_undegraded":"2024-05-10T11:13:18.692041+0000","last_fullsized":"2024-05-10T11:13:18.692041+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690905+0000","last_change":"2024-05-10T11:13:18.690905+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690905+0000","last_undegraded":"2024-05-10T11:13:18.690905+0000","last_fullsized":"2024-05-10T11:13:18.690905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690085+0000","last_change":"2024-05-10T11:13:18.690085+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690085+0000","last_undegraded":"2024-05-10T11:13:18.690085+0000","last_fullsized":"2024-05-10T11:13:18.690085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728062+0000","last_change":"2024-05-10T11:13:19.739810+0000","last_active":"2024-05-10T11:13:20.728062+0000","last_peered":"2024-05-10T11:13:20.728062+0000","last_clean":"2024-05-10T11:13:20.728062+0000","last_became_active":"2024-05-10T11:13:19.739560+0000","last_became_peered":"2024-05-10T11:13:19.739560+0000","last_unstale":"2024-05-10T11:13:20.728062+0000","last_undegraded":"2024-05-10T11:13:20.728062+0000","last_fullsized":"2024-05-10T11:13:20.728062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:51.141564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691010+0000","last_change":"2024-05-10T11:13:18.691010+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691010+0000","last_undegraded":"2024-05-10T11:13:18.691010+0000","last_fullsized":"2024-05-10T11:13:18.691010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734374+0000","last_change":"2024-05-10T11:13:19.727819+0000","last_active":"2024-05-10T11:13:20.734374+0000","last_peered":"2024-05-10T11:13:20.734374+0000","last_clean":"2024-05-10T11:13:20.734374+0000","last_became_active":"2024-05-10T11:13:19.727526+0000","last_became_peered":"2024-05-10T11:13:19.727526+0000","last_unstale":"2024-05-10T11:13:20.734374+0000","last_undegraded":"2024-05-10T11:13:20.734374+0000","last_fullsized":"2024-05-10T11:13:20.734374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:32.694277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691731+0000","last_change":"2024-05-10T11:13:18.691731+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691731+0000","last_undegraded":"2024-05-10T11:13:18.691731+0000","last_fullsized":"2024-05-10T11:13:18.691731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692089+0000","last_change":"2024-05-10T11:13:18.692089+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692089+0000","last_undegraded":"2024-05-10T11:13:18.692089+0000","last_fullsized":"2024-05-10T11:13:18.692089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727985+0000","last_change":"2024-05-10T11:13:19.727643+0000","last_active":"2024-05-10T11:13:20.727985+0000","last_peered":"2024-05-10T11:13:20.727985+0000","last_clean":"2024-05-10T11:13:20.727985+0000","last_became_active":"2024-05-10T11:13:19.727379+0000","last_became_peered":"2024-05-10T11:13:19.727379+0000","last_unstale":"2024-05-10T11:13:20.727985+0000","last_undegraded":"2024-05-10T11:13:20.727985+0000","last_fullsized":"2024-05-10T11:13:20.727985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.505846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689029+0000","last_change":"2024-05-10T11:13:18.689029+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689029+0000","last_undegraded":"2024-05-10T11:13:18.689029+0000","last_fullsized":"2024-05-10T11:13:18.689029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763926+0000","last_change":"2024-05-10T11:13:19.736103+0000","last_active":"2024-05-10T11:13:20.763926+0000","last_peered":"2024-05-10T11:13:20.763926+0000","last_clean":"2024-05-10T11:13:20.763926+0000","last_became_active":"2024-05-10T11:13:19.735808+0000","last_became_peered":"2024-05-10T11:13:19.735808+0000","last_unstale":"2024-05-10T11:13:20.763926+0000","last_undegraded":"2024-05-10T11:13:20.763926+0000","last_fullsized":"2024-05-10T11:13:20.763926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690230+0000","last_change":"2024-05-10T11:13:18.690230+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690230+0000","last_undegraded":"2024-05-10T11:13:18.690230+0000","last_fullsized":"2024-05-10T11:13:18.690230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734617+0000","last_change":"2024-05-10T11:13:19.728392+0000","last_active":"2024-05-10T11:13:20.734617+0000","last_peered":"2024-05-10T11:13:20.734617+0000","last_clean":"2024-05-10T11:13:20.734617+0000","last_became_active":"2024-05-10T11:13:19.728114+0000","last_became_peered":"2024-05-10T11:13:19.728114+0000","last_unstale":"2024-05-10T11:13:20.734617+0000","last_undegraded":"2024-05-10T11:13:20.734617+0000","last_fullsized":"2024-05-10T11:13:20.734617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689673+0000","last_change":"2024-05-10T11:13:18.689673+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689673+0000","last_undegraded":"2024-05-10T11:13:18.689673+0000","last_fullsized":"2024-05-10T11:13:18.689673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689192+0000","last_change":"2024-05-10T11:13:18.689192+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689192+0000","last_undegraded":"2024-05-10T11:13:18.689192+0000","last_fullsized":"2024-05-10T11:13:18.689192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690641+0000","last_change":"2024-05-10T11:13:18.690641+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690641+0000","last_undegraded":"2024-05-10T11:13:18.690641+0000","last_fullsized":"2024-05-10T11:13:18.690641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763545+0000","last_change":"2024-05-10T11:13:19.740012+0000","last_active":"2024-05-10T11:13:20.763545+0000","last_peered":"2024-05-10T11:13:20.763545+0000","last_clean":"2024-05-10T11:13:20.763545+0000","last_became_active":"2024-05-10T11:13:19.739697+0000","last_became_peered":"2024-05-10T11:13:19.739697+0000","last_unstale":"2024-05-10T11:13:20.763545+0000","last_undegraded":"2024-05-10T11:13:20.763545+0000","last_fullsized":"2024-05-10T11:13:20.763545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:16.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691264+0000","last_change":"2024-05-10T11:13:18.691264+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691264+0000","last_undegraded":"2024-05-10T11:13:18.691264+0000","last_fullsized":"2024-05-10T11:13:18.691264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704247+0000","last_change":"2024-05-10T11:13:18.702772+0000","last_active":"2024-05-10T11:13:18.704247+0000","last_peered":"2024-05-10T11:13:18.704247+0000","last_clean":"2024-05-10T11:13:18.704247+0000","last_became_active":"2024-05-10T11:13:18.702477+0000","last_became_peered":"2024-05-10T11:13:18.702477+0000","last_unstale":"2024-05-10T11:13:18.704247+0000","last_undegraded":"2024-05-10T11:13:18.704247+0000","last_fullsized":"2024-05-10T11:13:18.704247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764207+0000","last_change":"2024-05-10T11:13:19.738117+0000","last_active":"2024-05-10T11:13:20.764207+0000","last_peered":"2024-05-10T11:13:20.764207+0000","last_clean":"2024-05-10T11:13:20.764207+0000","last_became_active":"2024-05-10T11:13:19.737853+0000","last_became_peered":"2024-05-10T11:13:19.737853+0000","last_unstale":"2024-05-10T11:13:20.764207+0000","last_undegraded":"2024-05-10T11:13:20.764207+0000","last_fullsized":"2024-05-10T11:13:20.764207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729137+0000","last_change":"2024-05-10T11:13:18.700836+0000","last_active":"2024-05-10T11:13:20.729137+0000","last_peered":"2024-05-10T11:13:20.729137+0000","last_clean":"2024-05-10T11:13:20.729137+0000","last_became_active":"2024-05-10T11:13:18.700475+0000","last_became_peered":"2024-05-10T11:13:18.700475+0000","last_unstale":"2024-05-10T11:13:20.729137+0000","last_undegraded":"2024-05-10T11:13:20.729137+0000","last_fullsized":"2024-05-10T11:13:20.729137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689669+0000","last_change":"2024-05-10T11:13:18.689669+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689669+0000","last_undegraded":"2024-05-10T11:13:18.689669+0000","last_fullsized":"2024-05-10T11:13:18.689669+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764281+0000","last_change":"2024-05-10T11:13:18.704118+0000","last_active":"2024-05-10T11:13:20.764281+0000","last_peered":"2024-05-10T11:13:20.764281+0000","last_clean":"2024-05-10T11:13:20.764281+0000","last_became_active":"2024-05-10T11:13:18.703845+0000","last_became_peered":"2024-05-10T11:13:18.703845+0000","last_unstale":"2024-05-10T11:13:20.764281+0000","last_undegraded":"2024-05-10T11:13:20.764281+0000","last_fullsized":"2024-05-10T11:13:20.764281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764493+0000","last_change":"2024-05-10T11:13:19.724203+0000","last_active":"2024-05-10T11:13:20.764493+0000","last_peered":"2024-05-10T11:13:20.764493+0000","last_clean":"2024-05-10T11:13:20.764493+0000","last_became_active":"2024-05-10T11:13:19.723950+0000","last_became_peered":"2024-05-10T11:13:19.723950+0000","last_unstale":"2024-05-10T11:13:20.764493+0000","last_undegraded":"2024-05-10T11:13:20.764493+0000","last_fullsized":"2024-05-10T11:13:20.764493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:39.970327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705781+0000","last_change":"2024-05-10T11:13:18.704981+0000","last_active":"2024-05-10T11:13:18.705781+0000","last_peered":"2024-05-10T11:13:18.705781+0000","last_clean":"2024-05-10T11:13:18.705781+0000","last_became_active":"2024-05-10T11:13:18.704637+0000","last_became_peered":"2024-05-10T11:13:18.704637+0000","last_unstale":"2024-05-10T11:13:18.705781+0000","last_undegraded":"2024-05-10T11:13:18.705781+0000","last_fullsized":"2024-05-10T11:13:18.705781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728868+0000","last_change":"2024-05-10T11:13:19.730788+0000","last_active":"2024-05-10T11:13:20.728868+0000","last_peered":"2024-05-10T11:13:20.728868+0000","last_clean":"2024-05-10T11:13:20.728868+0000","last_became_active":"2024-05-10T11:13:19.730539+0000","last_became_peered":"2024-05-10T11:13:19.730539+0000","last_unstale":"2024-05-10T11:13:20.728868+0000","last_undegraded":"2024-05-10T11:13:20.728868+0000","last_fullsized":"2024-05-10T11:13:20.728868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734629+0000","last_change":"2024-05-10T11:13:18.701666+0000","last_active":"2024-05-10T11:13:20.734629+0000","last_peered":"2024-05-10T11:13:20.734629+0000","last_clean":"2024-05-10T11:13:20.734629+0000","last_became_active":"2024-05-10T11:13:18.701440+0000","last_became_peered":"2024-05-10T11:13:18.701440+0000","last_unstale":"2024-05-10T11:13:20.734629+0000","last_undegraded":"2024-05-10T11:13:20.734629+0000","last_fullsized":"2024-05-10T11:13:20.734629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:52.343488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734546+0000","last_change":"2024-05-10T11:13:19.728464+0000","last_active":"2024-05-10T11:13:20.734546+0000","last_peered":"2024-05-10T11:13:20.734546+0000","last_clean":"2024-05-10T11:13:20.734546+0000","last_became_active":"2024-05-10T11:13:19.728193+0000","last_became_peered":"2024-05-10T11:13:19.728193+0000","last_unstale":"2024-05-10T11:13:20.734546+0000","last_undegraded":"2024-05-10T11:13:20.734546+0000","last_fullsized":"2024-05-10T11:13:20.734546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704589+0000","last_change":"2024-05-10T11:13:18.703185+0000","last_active":"2024-05-10T11:13:18.704589+0000","last_peered":"2024-05-10T11:13:18.704589+0000","last_clean":"2024-05-10T11:13:18.704589+0000","last_became_active":"2024-05-10T11:13:18.702911+0000","last_became_peered":"2024-05-10T11:13:18.702911+0000","last_unstale":"2024-05-10T11:13:18.704589+0000","last_undegraded":"2024-05-10T11:13:18.704589+0000","last_fullsized":"2024-05-10T11:13:18.704589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:36.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689164+0000","last_change":"2024-05-10T11:13:18.689164+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689164+0000","last_undegraded":"2024-05-10T11:13:18.689164+0000","last_fullsized":"2024-05-10T11:13:18.689164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763506+0000","last_change":"2024-05-10T11:13:18.699755+0000","last_active":"2024-05-10T11:13:20.763506+0000","last_peered":"2024-05-10T11:13:20.763506+0000","last_clean":"2024-05-10T11:13:20.763506+0000","last_became_active":"2024-05-10T11:13:18.698729+0000","last_became_peered":"2024-05-10T11:13:18.698729+0000","last_unstale":"2024-05-10T11:13:20.763506+0000","last_undegraded":"2024-05-10T11:13:20.763506+0000","last_fullsized":"2024-05-10T11:13:20.763506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763828+0000","last_change":"2024-05-10T11:13:19.725730+0000","last_active":"2024-05-10T11:13:20.763828+0000","last_peered":"2024-05-10T11:13:20.763828+0000","last_clean":"2024-05-10T11:13:20.763828+0000","last_became_active":"2024-05-10T11:13:19.725477+0000","last_became_peered":"2024-05-10T11:13:19.725477+0000","last_unstale":"2024-05-10T11:13:20.763828+0000","last_undegraded":"2024-05-10T11:13:20.763828+0000","last_fullsized":"2024-05-10T11:13:20.763828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700727+0000","last_change":"2024-05-10T11:13:18.695029+0000","last_active":"2024-05-10T11:13:18.700727+0000","last_peered":"2024-05-10T11:13:18.700727+0000","last_clean":"2024-05-10T11:13:18.700727+0000","last_became_active":"2024-05-10T11:13:18.694723+0000","last_became_peered":"2024-05-10T11:13:18.694723+0000","last_unstale":"2024-05-10T11:13:18.700727+0000","last_undegraded":"2024-05-10T11:13:18.700727+0000","last_fullsized":"2024-05-10T11:13:18.700727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728096+0000","last_change":"2024-05-10T11:13:19.733886+0000","last_active":"2024-05-10T11:13:20.728096+0000","last_peered":"2024-05-10T11:13:20.728096+0000","last_clean":"2024-05-10T11:13:20.728096+0000","last_became_active":"2024-05-10T11:13:19.733588+0000","last_became_peered":"2024-05-10T11:13:19.733588+0000","last_unstale":"2024-05-10T11:13:20.728096+0000","last_undegraded":"2024-05-10T11:13:20.728096+0000","last_fullsized":"2024-05-10T11:13:20.728096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.288584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764521+0000","last_change":"2024-05-10T11:13:18.703232+0000","last_active":"2024-05-10T11:13:20.764521+0000","last_peered":"2024-05-10T11:13:20.764521+0000","last_clean":"2024-05-10T11:13:20.764521+0000","last_became_active":"2024-05-10T11:13:18.702937+0000","last_became_peered":"2024-05-10T11:13:18.702937+0000","last_unstale":"2024-05-10T11:13:20.764521+0000","last_undegraded":"2024-05-10T11:13:20.764521+0000","last_fullsized":"2024-05-10T11:13:20.764521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:51.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691955+0000","last_change":"2024-05-10T11:13:18.691955+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691955+0000","last_undegraded":"2024-05-10T11:13:18.691955+0000","last_fullsized":"2024-05-10T11:13:18.691955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734878+0000","last_change":"2024-05-10T11:13:18.700131+0000","last_active":"2024-05-10T11:13:20.734878+0000","last_peered":"2024-05-10T11:13:20.734878+0000","last_clean":"2024-05-10T11:13:20.734878+0000","last_became_active":"2024-05-10T11:13:18.698727+0000","last_became_peered":"2024-05-10T11:13:18.698727+0000","last_unstale":"2024-05-10T11:13:20.734878+0000","last_undegraded":"2024-05-10T11:13:20.734878+0000","last_fullsized":"2024-05-10T11:13:20.734878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:23.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729206+0000","last_change":"2024-05-10T11:13:19.729385+0000","last_active":"2024-05-10T11:13:20.729206+0000","last_peered":"2024-05-10T11:13:20.729206+0000","last_clean":"2024-05-10T11:13:20.729206+0000","last_became_active":"2024-05-10T11:13:19.729088+0000","last_became_peered":"2024-05-10T11:13:19.729088+0000","last_unstale":"2024-05-10T11:13:20.729206+0000","last_undegraded":"2024-05-10T11:13:20.729206+0000","last_fullsized":"2024-05-10T11:13:20.729206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:02.574628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734843+0000","last_change":"2024-05-10T11:13:18.697361+0000","last_active":"2024-05-10T11:13:20.734843+0000","last_peered":"2024-05-10T11:13:20.734843+0000","last_clean":"2024-05-10T11:13:20.734843+0000","last_became_active":"2024-05-10T11:13:18.697069+0000","last_became_peered":"2024-05-10T11:13:18.697069+0000","last_unstale":"2024-05-10T11:13:20.734843+0000","last_undegraded":"2024-05-10T11:13:20.734843+0000","last_fullsized":"2024-05-10T11:13:20.734843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:43.028126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690403+0000","last_change":"2024-05-10T11:13:18.690403+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690403+0000","last_undegraded":"2024-05-10T11:13:18.690403+0000","last_fullsized":"2024-05-10T11:13:18.690403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764452+0000","last_change":"2024-05-10T11:13:18.704317+0000","last_active":"2024-05-10T11:13:20.764452+0000","last_peered":"2024-05-10T11:13:20.764452+0000","last_clean":"2024-05-10T11:13:20.764452+0000","last_became_active":"2024-05-10T11:13:18.704016+0000","last_became_peered":"2024-05-10T11:13:18.704016+0000","last_unstale":"2024-05-10T11:13:20.764452+0000","last_undegraded":"2024-05-10T11:13:20.764452+0000","last_fullsized":"2024-05-10T11:13:20.764452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728896+0000","last_change":"2024-05-10T11:13:19.735706+0000","last_active":"2024-05-10T11:13:20.728896+0000","last_peered":"2024-05-10T11:13:20.728896+0000","last_clean":"2024-05-10T11:13:20.728896+0000","last_became_active":"2024-05-10T11:13:19.734578+0000","last_became_peered":"2024-05-10T11:13:19.734578+0000","last_unstale":"2024-05-10T11:13:20.728896+0000","last_undegraded":"2024-05-10T11:13:20.728896+0000","last_fullsized":"2024-05-10T11:13:20.728896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764164+0000","last_change":"2024-05-10T11:13:18.702219+0000","last_active":"2024-05-10T11:13:20.764164+0000","last_peered":"2024-05-10T11:13:20.764164+0000","last_clean":"2024-05-10T11:13:20.764164+0000","last_became_active":"2024-05-10T11:13:18.701933+0000","last_became_peered":"2024-05-10T11:13:18.701933+0000","last_unstale":"2024-05-10T11:13:20.764164+0000","last_undegraded":"2024-05-10T11:13:20.764164+0000","last_fullsized":"2024-05-10T11:13:20.764164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:38.664408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764507+0000","last_change":"2024-05-10T11:13:19.732843+0000","last_active":"2024-05-10T11:13:20.764507+0000","last_peered":"2024-05-10T11:13:20.764507+0000","last_clean":"2024-05-10T11:13:20.764507+0000","last_became_active":"2024-05-10T11:13:19.732571+0000","last_became_peered":"2024-05-10T11:13:19.732571+0000","last_unstale":"2024-05-10T11:13:20.764507+0000","last_undegraded":"2024-05-10T11:13:20.764507+0000","last_fullsized":"2024-05-10T11:13:20.764507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:23.903648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763464+0000","last_change":"2024-05-10T11:13:18.699460+0000","last_active":"2024-05-10T11:13:20.763464+0000","last_peered":"2024-05-10T11:13:20.763464+0000","last_clean":"2024-05-10T11:13:20.763464+0000","last_became_active":"2024-05-10T11:13:18.699144+0000","last_became_peered":"2024-05-10T11:13:18.699144+0000","last_unstale":"2024-05-10T11:13:20.763464+0000","last_undegraded":"2024-05-10T11:13:20.763464+0000","last_fullsized":"2024-05-10T11:13:20.763464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690745+0000","last_change":"2024-05-10T11:13:18.690745+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690745+0000","last_undegraded":"2024-05-10T11:13:18.690745+0000","last_fullsized":"2024-05-10T11:13:18.690745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705229+0000","last_change":"2024-05-10T11:13:18.703149+0000","last_active":"2024-05-10T11:13:18.705229+0000","last_peered":"2024-05-10T11:13:18.705229+0000","last_clean":"2024-05-10T11:13:18.705229+0000","last_became_active":"2024-05-10T11:13:18.702580+0000","last_became_peered":"2024-05-10T11:13:18.702580+0000","last_unstale":"2024-05-10T11:13:18.705229+0000","last_undegraded":"2024-05-10T11:13:18.705229+0000","last_fullsized":"2024-05-10T11:13:18.705229+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763969+0000","last_change":"2024-05-10T11:13:19.733267+0000","last_active":"2024-05-10T11:13:20.763969+0000","last_peered":"2024-05-10T11:13:20.763969+0000","last_clean":"2024-05-10T11:13:20.763969+0000","last_became_active":"2024-05-10T11:13:19.732862+0000","last_became_peered":"2024-05-10T11:13:19.732862+0000","last_unstale":"2024-05-10T11:13:20.763969+0000","last_undegraded":"2024-05-10T11:13:20.763969+0000","last_fullsized":"2024-05-10T11:13:20.763969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.703353+0000","last_change":"2024-05-10T11:13:18.701542+0000","last_active":"2024-05-10T11:13:18.703353+0000","last_peered":"2024-05-10T11:13:18.703353+0000","last_clean":"2024-05-10T11:13:18.703353+0000","last_became_active":"2024-05-10T11:13:18.701286+0000","last_became_peered":"2024-05-10T11:13:18.701286+0000","last_unstale":"2024-05-10T11:13:18.703353+0000","last_undegraded":"2024-05-10T11:13:18.703353+0000","last_fullsized":"2024-05-10T11:13:18.703353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:44.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764415+0000","last_change":"2024-05-10T11:13:19.718590+0000","last_active":"2024-05-10T11:13:20.764415+0000","last_peered":"2024-05-10T11:13:20.764415+0000","last_clean":"2024-05-10T11:13:20.764415+0000","last_became_active":"2024-05-10T11:13:19.718038+0000","last_became_peered":"2024-05-10T11:13:19.718038+0000","last_unstale":"2024-05-10T11:13:20.764415+0000","last_undegraded":"2024-05-10T11:13:20.764415+0000","last_fullsized":"2024-05-10T11:13:20.764415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734879+0000","last_change":"2024-05-10T11:13:18.693532+0000","last_active":"2024-05-10T11:13:20.734879+0000","last_peered":"2024-05-10T11:13:20.734879+0000","last_clean":"2024-05-10T11:13:20.734879+0000","last_became_active":"2024-05-10T11:13:18.693207+0000","last_became_peered":"2024-05-10T11:13:18.693207+0000","last_unstale":"2024-05-10T11:13:20.734879+0000","last_undegraded":"2024-05-10T11:13:20.734879+0000","last_fullsized":"2024-05-10T11:13:20.734879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734818+0000","last_change":"2024-05-10T11:13:19.729201+0000","last_active":"2024-05-10T11:13:20.734818+0000","last_peered":"2024-05-10T11:13:20.734818+0000","last_clean":"2024-05-10T11:13:20.734818+0000","last_became_active":"2024-05-10T11:13:19.728950+0000","last_became_peered":"2024-05-10T11:13:19.728950+0000","last_unstale":"2024-05-10T11:13:20.734818+0000","last_undegraded":"2024-05-10T11:13:20.734818+0000","last_fullsized":"2024-05-10T11:13:20.734818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700757+0000","last_change":"2024-05-10T11:13:18.694811+0000","last_active":"2024-05-10T11:13:18.700757+0000","last_peered":"2024-05-10T11:13:18.700757+0000","last_clean":"2024-05-10T11:13:18.700757+0000","last_became_active":"2024-05-10T11:13:18.692974+0000","last_became_peered":"2024-05-10T11:13:18.692974+0000","last_unstale":"2024-05-10T11:13:18.700757+0000","last_undegraded":"2024-05-10T11:13:18.700757+0000","last_fullsized":"2024-05-10T11:13:18.700757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688501+0000","last_change":"2024-05-10T11:13:18.688501+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688501+0000","last_undegraded":"2024-05-10T11:13:18.688501+0000","last_fullsized":"2024-05-10T11:13:18.688501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727939+0000","last_change":"2024-05-10T11:13:18.698741+0000","last_active":"2024-05-10T11:13:20.727939+0000","last_peered":"2024-05-10T11:13:20.727939+0000","last_clean":"2024-05-10T11:13:20.727939+0000","last_became_active":"2024-05-10T11:13:18.698440+0000","last_became_peered":"2024-05-10T11:13:18.698440+0000","last_unstale":"2024-05-10T11:13:20.727939+0000","last_undegraded":"2024-05-10T11:13:20.727939+0000","last_fullsized":"2024-05-10T11:13:20.727939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:19:16.570254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.739604+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.739272+0000","last_became_peered":"2024-05-10T11:13:19.739272+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:33.487420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763735+0000","last_change":"2024-05-10T11:13:18.703465+0000","last_active":"2024-05-10T11:13:20.763735+0000","last_peered":"2024-05-10T11:13:20.763735+0000","last_clean":"2024-05-10T11:13:20.763735+0000","last_became_active":"2024-05-10T11:13:18.702762+0000","last_became_peered":"2024-05-10T11:13:18.702762+0000","last_unstale":"2024-05-10T11:13:20.763735+0000","last_undegraded":"2024-05-10T11:13:20.763735+0000","last_fullsized":"2024-05-10T11:13:20.763735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:10.813728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690588+0000","last_change":"2024-05-10T11:13:18.690588+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690588+0000","last_undegraded":"2024-05-10T11:13:18.690588+0000","last_fullsized":"2024-05-10T11:13:18.690588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727850+0000","last_change":"2024-05-10T11:13:18.702301+0000","last_active":"2024-05-10T11:13:20.727850+0000","last_peered":"2024-05-10T11:13:20.727850+0000","last_clean":"2024-05-10T11:13:20.727850+0000","last_became_active":"2024-05-10T11:13:18.702020+0000","last_became_peered":"2024-05-10T11:13:18.702020+0000","last_unstale":"2024-05-10T11:13:20.727850+0000","last_undegraded":"2024-05-10T11:13:20.727850+0000","last_fullsized":"2024-05-10T11:13:20.727850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:23.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728994+0000","last_change":"2024-05-10T11:13:19.730034+0000","last_active":"2024-05-10T11:13:20.728994+0000","last_peered":"2024-05-10T11:13:20.728994+0000","last_clean":"2024-05-10T11:13:20.728994+0000","last_became_active":"2024-05-10T11:13:19.729784+0000","last_became_peered":"2024-05-10T11:13:19.729784+0000","last_unstale":"2024-05-10T11:13:20.728994+0000","last_undegraded":"2024-05-10T11:13:20.728994+0000","last_fullsized":"2024-05-10T11:13:20.728994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727817+0000","last_change":"2024-05-10T11:13:18.703123+0000","last_active":"2024-05-10T11:13:20.727817+0000","last_peered":"2024-05-10T11:13:20.727817+0000","last_clean":"2024-05-10T11:13:20.727817+0000","last_became_active":"2024-05-10T11:13:18.702855+0000","last_became_peered":"2024-05-10T11:13:18.702855+0000","last_unstale":"2024-05-10T11:13:20.727817+0000","last_undegraded":"2024-05-10T11:13:20.727817+0000","last_fullsized":"2024-05-10T11:13:20.727817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:55.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734500+0000","last_change":"2024-05-10T11:13:19.723348+0000","last_active":"2024-05-10T11:13:20.734500+0000","last_peered":"2024-05-10T11:13:20.734500+0000","last_clean":"2024-05-10T11:13:20.734500+0000","last_became_active":"2024-05-10T11:13:19.723074+0000","last_became_peered":"2024-05-10T11:13:19.723074+0000","last_unstale":"2024-05-10T11:13:20.734500+0000","last_undegraded":"2024-05-10T11:13:20.734500+0000","last_fullsized":"2024-05-10T11:13:20.734500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:34.461837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700305+0000","last_change":"2024-05-10T11:13:18.698251+0000","last_active":"2024-05-10T11:13:18.700305+0000","last_peered":"2024-05-10T11:13:18.700305+0000","last_clean":"2024-05-10T11:13:18.700305+0000","last_became_active":"2024-05-10T11:13:18.697970+0000","last_became_peered":"2024-05-10T11:13:18.697970+0000","last_unstale":"2024-05-10T11:13:18.700305+0000","last_undegraded":"2024-05-10T11:13:18.700305+0000","last_fullsized":"2024-05-10T11:13:18.700305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:31.620398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764112+0000","last_change":"2024-05-10T11:13:19.725035+0000","last_active":"2024-05-10T11:13:20.764112+0000","last_peered":"2024-05-10T11:13:20.764112+0000","last_clean":"2024-05-10T11:13:20.764112+0000","last_became_active":"2024-05-10T11:13:19.724781+0000","last_became_peered":"2024-05-10T11:13:19.724781+0000","last_unstale":"2024-05-10T11:13:20.764112+0000","last_undegraded":"2024-05-10T11:13:20.764112+0000","last_fullsized":"2024-05-10T11:13:20.764112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727630+0000","last_change":"2024-05-10T11:13:18.703414+0000","last_active":"2024-05-10T11:13:20.727630+0000","last_peered":"2024-05-10T11:13:20.727630+0000","last_clean":"2024-05-10T11:13:20.727630+0000","last_became_active":"2024-05-10T11:13:18.702852+0000","last_became_peered":"2024-05-10T11:13:18.702852+0000","last_unstale":"2024-05-10T11:13:20.727630+0000","last_undegraded":"2024-05-10T11:13:20.727630+0000","last_fullsized":"2024-05-10T11:13:20.727630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:34.714357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763678+0000","last_change":"2024-05-10T11:13:19.736920+0000","last_active":"2024-05-10T11:13:20.763678+0000","last_peered":"2024-05-10T11:13:20.763678+0000","last_clean":"2024-05-10T11:13:20.763678+0000","last_became_active":"2024-05-10T11:13:19.736619+0000","last_became_peered":"2024-05-10T11:13:19.736619+0000","last_unstale":"2024-05-10T11:13:20.763678+0000","last_undegraded":"2024-05-10T11:13:20.763678+0000","last_fullsized":"2024-05-10T11:13:20.763678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734954+0000","last_change":"2024-05-10T11:13:18.696813+0000","last_active":"2024-05-10T11:13:20.734954+0000","last_peered":"2024-05-10T11:13:20.734954+0000","last_clean":"2024-05-10T11:13:20.734954+0000","last_became_active":"2024-05-10T11:13:18.696527+0000","last_became_peered":"2024-05-10T11:13:18.696527+0000","last_unstale":"2024-05-10T11:13:20.734954+0000","last_undegraded":"2024-05-10T11:13:20.734954+0000","last_fullsized":"2024-05-10T11:13:20.734954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691526+0000","last_change":"2024-05-10T11:13:18.691526+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691526+0000","last_undegraded":"2024-05-10T11:13:18.691526+0000","last_fullsized":"2024-05-10T11:13:18.691526+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728077+0000","last_change":"2024-05-10T11:13:18.699474+0000","last_active":"2024-05-10T11:13:20.728077+0000","last_peered":"2024-05-10T11:13:20.728077+0000","last_clean":"2024-05-10T11:13:20.728077+0000","last_became_active":"2024-05-10T11:13:18.699197+0000","last_became_peered":"2024-05-10T11:13:18.699197+0000","last_unstale":"2024-05-10T11:13:20.728077+0000","last_undegraded":"2024-05-10T11:13:20.728077+0000","last_fullsized":"2024-05-10T11:13:20.728077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:03:28.008509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764106+0000","last_change":"2024-05-10T11:13:19.727718+0000","last_active":"2024-05-10T11:13:20.764106+0000","last_peered":"2024-05-10T11:13:20.764106+0000","last_clean":"2024-05-10T11:13:20.764106+0000","last_became_active":"2024-05-10T11:13:19.727454+0000","last_became_peered":"2024-05-10T11:13:19.727454+0000","last_unstale":"2024-05-10T11:13:20.764106+0000","last_undegraded":"2024-05-10T11:13:20.764106+0000","last_fullsized":"2024-05-10T11:13:20.764106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729121+0000","last_change":"2024-05-10T11:13:18.701654+0000","last_active":"2024-05-10T11:13:20.729121+0000","last_peered":"2024-05-10T11:13:20.729121+0000","last_clean":"2024-05-10T11:13:20.729121+0000","last_became_active":"2024-05-10T11:13:18.701372+0000","last_became_peered":"2024-05-10T11:13:18.701372+0000","last_unstale":"2024-05-10T11:13:20.729121+0000","last_undegraded":"2024-05-10T11:13:20.729121+0000","last_fullsized":"2024-05-10T11:13:20.729121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729040+0000","last_change":"2024-05-10T11:13:19.738281+0000","last_active":"2024-05-10T11:13:20.729040+0000","last_peered":"2024-05-10T11:13:20.729040+0000","last_clean":"2024-05-10T11:13:20.729040+0000","last_became_active":"2024-05-10T11:13:19.738024+0000","last_became_peered":"2024-05-10T11:13:19.738024+0000","last_unstale":"2024-05-10T11:13:20.729040+0000","last_undegraded":"2024-05-10T11:13:20.729040+0000","last_fullsized":"2024-05-10T11:13:20.729040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:05.391289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729085+0000","last_change":"2024-05-10T11:13:18.699063+0000","last_active":"2024-05-10T11:13:20.729085+0000","last_peered":"2024-05-10T11:13:20.729085+0000","last_clean":"2024-05-10T11:13:20.729085+0000","last_became_active":"2024-05-10T11:13:18.698161+0000","last_became_peered":"2024-05-10T11:13:18.698161+0000","last_unstale":"2024-05-10T11:13:20.729085+0000","last_undegraded":"2024-05-10T11:13:20.729085+0000","last_fullsized":"2024-05-10T11:13:20.729085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763552+0000","last_change":"2024-05-10T11:13:19.727035+0000","last_active":"2024-05-10T11:13:20.763552+0000","last_peered":"2024-05-10T11:13:20.763552+0000","last_clean":"2024-05-10T11:13:20.763552+0000","last_became_active":"2024-05-10T11:13:19.726701+0000","last_became_peered":"2024-05-10T11:13:19.726701+0000","last_unstale":"2024-05-10T11:13:20.763552+0000","last_undegraded":"2024-05-10T11:13:20.763552+0000","last_fullsized":"2024-05-10T11:13:20.763552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:26.394487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704029+0000","last_change":"2024-05-10T11:13:18.701428+0000","last_active":"2024-05-10T11:13:18.704029+0000","last_peered":"2024-05-10T11:13:18.704029+0000","last_clean":"2024-05-10T11:13:18.704029+0000","last_became_active":"2024-05-10T11:13:18.701155+0000","last_became_peered":"2024-05-10T11:13:18.701155+0000","last_unstale":"2024-05-10T11:13:18.704029+0000","last_undegraded":"2024-05-10T11:13:18.704029+0000","last_fullsized":"2024-05-10T11:13:18.704029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:15.935603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688495+0000","last_change":"2024-05-10T11:13:18.688495+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688495+0000","last_undegraded":"2024-05-10T11:13:18.688495+0000","last_fullsized":"2024-05-10T11:13:18.688495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.701773+0000","last_change":"2024-05-10T11:13:18.699343+0000","last_active":"2024-05-10T11:13:18.701773+0000","last_peered":"2024-05-10T11:13:18.701773+0000","last_clean":"2024-05-10T11:13:18.701773+0000","last_became_active":"2024-05-10T11:13:18.699076+0000","last_became_peered":"2024-05-10T11:13:18.699076+0000","last_unstale":"2024-05-10T11:13:18.701773+0000","last_undegraded":"2024-05-10T11:13:18.701773+0000","last_fullsized":"2024-05-10T11:13:18.701773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:13.688833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690102+0000","last_change":"2024-05-10T11:13:18.690102+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690102+0000","last_undegraded":"2024-05-10T11:13:18.690102+0000","last_fullsized":"2024-05-10T11:13:18.690102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764082+0000","last_change":"2024-05-10T11:13:18.702463+0000","last_active":"2024-05-10T11:13:20.764082+0000","last_peered":"2024-05-10T11:13:20.764082+0000","last_clean":"2024-05-10T11:13:20.764082+0000","last_became_active":"2024-05-10T11:13:18.702201+0000","last_became_peered":"2024-05-10T11:13:18.702201+0000","last_unstale":"2024-05-10T11:13:20.764082+0000","last_undegraded":"2024-05-10T11:13:20.764082+0000","last_fullsized":"2024-05-10T11:13:20.764082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734809+0000","last_change":"2024-05-10T11:13:19.735527+0000","last_active":"2024-05-10T11:13:20.734809+0000","last_peered":"2024-05-10T11:13:20.734809+0000","last_clean":"2024-05-10T11:13:20.734809+0000","last_became_active":"2024-05-10T11:13:19.734366+0000","last_became_peered":"2024-05-10T11:13:19.734366+0000","last_unstale":"2024-05-10T11:13:20.734809+0000","last_undegraded":"2024-05-10T11:13:20.734809+0000","last_fullsized":"2024-05-10T11:13:20.734809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.699619+0000","last_change":"2024-05-10T11:13:18.696982+0000","last_active":"2024-05-10T11:13:18.699619+0000","last_peered":"2024-05-10T11:13:18.699619+0000","last_clean":"2024-05-10T11:13:18.699619+0000","last_became_active":"2024-05-10T11:13:18.696733+0000","last_became_peered":"2024-05-10T11:13:18.696733+0000","last_unstale":"2024-05-10T11:13:18.699619+0000","last_undegraded":"2024-05-10T11:13:18.699619+0000","last_fullsized":"2024-05-10T11:13:18.699619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.692315+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:18.692315+0000","last_peered":"2024-05-10T11:13:18.692315+0000","last_clean":"2024-05-10T11:13:18.692315+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:18.692315+0000","last_undegraded":"2024-05-10T11:13:18.692315+0000","last_fullsized":"2024-05-10T11:13:18.692315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":747748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":157380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":164047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":179552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":768308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":178018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:13:23.776 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:13:23.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.917+0000 7f0d91f0a640 1 Processor -- start 2024-05-10T11:13:23.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.917+0000 7f0d91f0a640 1 -- start start 2024-05-10T11:13:23.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d91f0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c15f4e0 0x7f0d8c06d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d91f0a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d8c15f8c0 0x7f0d8c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d91f0a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8c06e8c0 con 0x7f0d8c06e450 2024-05-10T11:13:23.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d91f0a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0d8c0b23f0 con 0x7f0d8c15f8c0 2024-05-10T11:13:23.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d91f0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c0b4150 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d8affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d8c15f8c0 0x7f0d8c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d8affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d8c15f8c0 0x7f0d8c06df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35974/0 (socket says 172.21.15.66:35974) 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d8affd640 1 -- 172.21.15.66:0/3810501419 learned_addr learned my addr 172.21.15.66:0/3810501419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.918+0000 7f0d8b7fe640 1 --2- 172.21.15.66:0/3810501419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c15f4e0 0x7f0d8c06d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.919+0000 7f0d8affd640 1 -- 172.21.15.66:0/3810501419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c15f4e0 msgr2=0x7f0d8c06d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.919+0000 7f0d8affd640 1 --2- 172.21.15.66:0/3810501419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c15f4e0 0x7f0d8c06d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.919+0000 7f0d8affd640 1 -- 172.21.15.66:0/3810501419 >> v1:172.21.15.190:6789/0 conn(0x7f0d8c06e450 legacy=0x7f0d8c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:23.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.919+0000 7f0d8affd640 1 -- 172.21.15.66:0/3810501419 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c0b3540 con 0x7f0d8c15f8c0 2024-05-10T11:13:23.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.919+0000 7f0d8affd640 1 --2- 172.21.15.66:0/3810501419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c06df10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009870 tx=0x7f0d8002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f61e04b8834aa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.919+0000 7f0d8a7fc640 1 -- 172.21.15.66:0/3810501419 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80037070 con 0x7f0d8c15f8c0 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d8a7fc640 1 -- 172.21.15.66:0/3810501419 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d80032440 con 0x7f0d8c15f8c0 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d8a7fc640 1 -- 172.21.15.66:0/3810501419 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80032810 con 0x7f0d8c15f8c0 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 -- 172.21.15.66:0/3810501419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f8c0 msgr2=0x7f0d8c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/3810501419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c06df10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009870 tx=0x7f0d8002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 -- 172.21.15.66:0/3810501419 shutdown_connections 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/3810501419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c06df10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/3810501419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c15f4e0 0x7f0d8c06d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 -- 172.21.15.66:0/3810501419 >> 172.21.15.66:0/3810501419 conn(0x7f0d8c0d2df0 msgr2=0x7f0d8c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 -- 172.21.15.66:0/3810501419 shutdown_connections 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.920+0000 7f0d91f0a640 1 -- 172.21.15.66:0/3810501419 wait complete. 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.921+0000 7f0d91f0a640 1 Processor -- start 2024-05-10T11:13:23.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 -- start start 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c06e450 0x7f0d8c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 0x7f0d8c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c0b3de0 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c0b3b00 con 0x7f0d8c15f8c0 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d91f0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c0b45e0 con 0x7f0d8c06e450 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d8affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 0x7f0d8c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d8affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 0x7f0d8c0c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35984/0 (socket says 172.21.15.66:35984) 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.922+0000 7f0d8affd640 1 -- 172.21.15.66:0/2445745617 learned_addr learned my addr 172.21.15.66:0/2445745617 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8b7fe640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c06e450 0x7f0d8c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8bfff640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8affd640 1 -- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c06e450 msgr2=0x7f0d8c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8affd640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c06e450 0x7f0d8c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8affd640 1 -- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d8c15f8c0 msgr2=0x7f0d8c161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8affd640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8affd640 1 -- 172.21.15.66:0/2445745617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c0c9320 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8bfff640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d8affd640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 0x7f0d8c0c8de0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0d80000c00 tx=0x7f0d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80041020 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d800306c0 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80037040 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c156070 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.923+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c156630 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.924+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c06a220 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.925+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d80044020 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.926+0000 7f0d73fff640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d78076300 0x7f0d780787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:23.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.926+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f0d800b7fe0 con 0x7f0d8c15f4e0 2024-05-10T11:13:23.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.926+0000 7f0d8b7fe640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d78076300 0x7f0d780787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:23.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.926+0000 7f0d8b7fe640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d78076300 0x7f0d780787c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c006fd0 tx=0x7f0d7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:23.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:23.930+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0d8004b030 con 0x7f0d8c15f4e0 2024-05-10T11:13:24.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.118+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d8c071510 con 0x7f0d78076300 2024-05-10T11:13:24.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.124+0000 7f0d73fff640 1 -- 172.21.15.66:0/2445745617 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250038 (secure 0 0 0) 0x7f0d8c071510 con 0x7f0d78076300 2024-05-10T11:13:24.126 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:24.127 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d78076300 msgr2=0x7f0d780787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d78076300 0x7f0d780787c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c006fd0 tx=0x7f0d7c008040 comp rx=0 tx=0).stop 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 msgr2=0x7f0d8c0c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 0x7f0d8c0c8de0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0d80000c00 tx=0x7f0d800046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 shutdown_connections 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d78076300 0x7f0d780787c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d8c15f8c0 0x7f0d8c161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c15f4e0 0x7f0d8c0c8de0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 --2- 172.21.15.66:0/2445745617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d8c06e450 0x7f0d8c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 >> 172.21.15.66:0/2445745617 conn(0x7f0d8c0d2df0 msgr2=0x7f0d8c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 shutdown_connections 2024-05-10T11:13:24.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.127+0000 7f0d91f0a640 1 -- 172.21.15.66:0/2445745617 wait complete. 2024-05-10T11:13:24.138 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-10T11:13:23.696740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220544,"kb_used_data":4364,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754176,"statfs":{"total":773094113280,"available":772868276224,"internally_reserved":0,"allocated":4468736,"data_stored":2551025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001475"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764580+0000","last_change":"2024-05-10T11:13:19.732597+0000","last_active":"2024-05-10T11:13:20.764580+0000","last_peered":"2024-05-10T11:13:20.764580+0000","last_clean":"2024-05-10T11:13:20.764580+0000","last_became_active":"2024-05-10T11:13:19.732175+0000","last_became_peered":"2024-05-10T11:13:19.732175+0000","last_unstale":"2024-05-10T11:13:20.764580+0000","last_undegraded":"2024-05-10T11:13:20.764580+0000","last_fullsized":"2024-05-10T11:13:20.764580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:36.288762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763960+0000","last_change":"2024-05-10T11:13:19.739881+0000","last_active":"2024-05-10T11:13:20.763960+0000","last_peered":"2024-05-10T11:13:20.763960+0000","last_clean":"2024-05-10T11:13:20.763960+0000","last_became_active":"2024-05-10T11:13:19.739453+0000","last_became_peered":"2024-05-10T11:13:19.739453+0000","last_unstale":"2024-05-10T11:13:20.763960+0000","last_undegraded":"2024-05-10T11:13:20.763960+0000","last_fullsized":"2024-05-10T11:13:20.763960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729120+0000","last_change":"2024-05-10T11:13:19.733275+0000","last_active":"2024-05-10T11:13:20.729120+0000","last_peered":"2024-05-10T11:13:20.729120+0000","last_clean":"2024-05-10T11:13:20.729120+0000","last_became_active":"2024-05-10T11:13:19.732987+0000","last_became_peered":"2024-05-10T11:13:19.732987+0000","last_unstale":"2024-05-10T11:13:20.729120+0000","last_undegraded":"2024-05-10T11:13:20.729120+0000","last_fullsized":"2024-05-10T11:13:20.729120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:56.702776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728116+0000","last_change":"2024-05-10T11:13:19.733990+0000","last_active":"2024-05-10T11:13:20.728116+0000","last_peered":"2024-05-10T11:13:20.728116+0000","last_clean":"2024-05-10T11:13:20.728116+0000","last_became_active":"2024-05-10T11:13:19.733699+0000","last_became_peered":"2024-05-10T11:13:19.733699+0000","last_unstale":"2024-05-10T11:13:20.728116+0000","last_undegraded":"2024-05-10T11:13:20.728116+0000","last_fullsized":"2024-05-10T11:13:20.728116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:11.815701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.732957+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.732674+0000","last_became_peered":"2024-05-10T11:13:19.732674+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:46.137307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763665+0000","last_change":"2024-05-10T11:13:19.738793+0000","last_active":"2024-05-10T11:13:20.763665+0000","last_peered":"2024-05-10T11:13:20.763665+0000","last_clean":"2024-05-10T11:13:20.763665+0000","last_became_active":"2024-05-10T11:13:19.738522+0000","last_became_peered":"2024-05-10T11:13:19.738522+0000","last_unstale":"2024-05-10T11:13:20.763665+0000","last_undegraded":"2024-05-10T11:13:20.763665+0000","last_fullsized":"2024-05-10T11:13:20.763665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734297+0000","last_change":"2024-05-10T11:13:19.727429+0000","last_active":"2024-05-10T11:13:20.734297+0000","last_peered":"2024-05-10T11:13:20.734297+0000","last_clean":"2024-05-10T11:13:20.734297+0000","last_became_active":"2024-05-10T11:13:19.727146+0000","last_became_peered":"2024-05-10T11:13:19.727146+0000","last_unstale":"2024-05-10T11:13:20.734297+0000","last_undegraded":"2024-05-10T11:13:20.734297+0000","last_fullsized":"2024-05-10T11:13:20.734297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:07.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764030+0000","last_change":"2024-05-10T11:13:19.729084+0000","last_active":"2024-05-10T11:13:20.764030+0000","last_peered":"2024-05-10T11:13:20.764030+0000","last_clean":"2024-05-10T11:13:20.764030+0000","last_became_active":"2024-05-10T11:13:19.728796+0000","last_became_peered":"2024-05-10T11:13:19.728796+0000","last_unstale":"2024-05-10T11:13:20.764030+0000","last_undegraded":"2024-05-10T11:13:20.764030+0000","last_fullsized":"2024-05-10T11:13:20.764030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729383+0000","last_change":"2024-05-10T11:13:19.735425+0000","last_active":"2024-05-10T11:13:20.729383+0000","last_peered":"2024-05-10T11:13:20.729383+0000","last_clean":"2024-05-10T11:13:20.729383+0000","last_became_active":"2024-05-10T11:13:19.735053+0000","last_became_peered":"2024-05-10T11:13:19.735053+0000","last_unstale":"2024-05-10T11:13:20.729383+0000","last_undegraded":"2024-05-10T11:13:20.729383+0000","last_fullsized":"2024-05-10T11:13:20.729383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:04.283560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734820+0000","last_change":"2024-05-10T11:13:19.725056+0000","last_active":"2024-05-10T11:13:20.734820+0000","last_peered":"2024-05-10T11:13:20.734820+0000","last_clean":"2024-05-10T11:13:20.734820+0000","last_became_active":"2024-05-10T11:13:19.724833+0000","last_became_peered":"2024-05-10T11:13:19.724833+0000","last_unstale":"2024-05-10T11:13:20.734820+0000","last_undegraded":"2024-05-10T11:13:20.734820+0000","last_fullsized":"2024-05-10T11:13:20.734820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734748+0000","last_change":"2024-05-10T11:13:19.726523+0000","last_active":"2024-05-10T11:13:20.734748+0000","last_peered":"2024-05-10T11:13:20.734748+0000","last_clean":"2024-05-10T11:13:20.734748+0000","last_became_active":"2024-05-10T11:13:19.726280+0000","last_became_peered":"2024-05-10T11:13:19.726280+0000","last_unstale":"2024-05-10T11:13:20.734748+0000","last_undegraded":"2024-05-10T11:13:20.734748+0000","last_fullsized":"2024-05-10T11:13:20.734748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729035+0000","last_change":"2024-05-10T11:13:19.734209+0000","last_active":"2024-05-10T11:13:20.729035+0000","last_peered":"2024-05-10T11:13:20.729035+0000","last_clean":"2024-05-10T11:13:20.729035+0000","last_became_active":"2024-05-10T11:13:19.733951+0000","last_became_peered":"2024-05-10T11:13:19.733951+0000","last_unstale":"2024-05-10T11:13:20.729035+0000","last_undegraded":"2024-05-10T11:13:20.729035+0000","last_fullsized":"2024-05-10T11:13:20.729035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734619+0000","last_change":"2024-05-10T11:13:19.725439+0000","last_active":"2024-05-10T11:13:20.734619+0000","last_peered":"2024-05-10T11:13:20.734619+0000","last_clean":"2024-05-10T11:13:20.734619+0000","last_became_active":"2024-05-10T11:13:19.725149+0000","last_became_peered":"2024-05-10T11:13:19.725149+0000","last_unstale":"2024-05-10T11:13:20.734619+0000","last_undegraded":"2024-05-10T11:13:20.734619+0000","last_fullsized":"2024-05-10T11:13:20.734619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692849+0000","last_change":"2024-05-10T11:13:18.692849+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692849+0000","last_undegraded":"2024-05-10T11:13:18.692849+0000","last_fullsized":"2024-05-10T11:13:18.692849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734333+0000","last_change":"2024-05-10T11:13:19.730590+0000","last_active":"2024-05-10T11:13:20.734333+0000","last_peered":"2024-05-10T11:13:20.734333+0000","last_clean":"2024-05-10T11:13:20.734333+0000","last_became_active":"2024-05-10T11:13:19.730313+0000","last_became_peered":"2024-05-10T11:13:19.730313+0000","last_unstale":"2024-05-10T11:13:20.734333+0000","last_undegraded":"2024-05-10T11:13:20.734333+0000","last_fullsized":"2024-05-10T11:13:20.734333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:01.085545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692041+0000","last_change":"2024-05-10T11:13:18.692041+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692041+0000","last_undegraded":"2024-05-10T11:13:18.692041+0000","last_fullsized":"2024-05-10T11:13:18.692041+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690905+0000","last_change":"2024-05-10T11:13:18.690905+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690905+0000","last_undegraded":"2024-05-10T11:13:18.690905+0000","last_fullsized":"2024-05-10T11:13:18.690905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690085+0000","last_change":"2024-05-10T11:13:18.690085+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690085+0000","last_undegraded":"2024-05-10T11:13:18.690085+0000","last_fullsized":"2024-05-10T11:13:18.690085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728062+0000","last_change":"2024-05-10T11:13:19.739810+0000","last_active":"2024-05-10T11:13:20.728062+0000","last_peered":"2024-05-10T11:13:20.728062+0000","last_clean":"2024-05-10T11:13:20.728062+0000","last_became_active":"2024-05-10T11:13:19.739560+0000","last_became_peered":"2024-05-10T11:13:19.739560+0000","last_unstale":"2024-05-10T11:13:20.728062+0000","last_undegraded":"2024-05-10T11:13:20.728062+0000","last_fullsized":"2024-05-10T11:13:20.728062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:51.141564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691010+0000","last_change":"2024-05-10T11:13:18.691010+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691010+0000","last_undegraded":"2024-05-10T11:13:18.691010+0000","last_fullsized":"2024-05-10T11:13:18.691010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734374+0000","last_change":"2024-05-10T11:13:19.727819+0000","last_active":"2024-05-10T11:13:20.734374+0000","last_peered":"2024-05-10T11:13:20.734374+0000","last_clean":"2024-05-10T11:13:20.734374+0000","last_became_active":"2024-05-10T11:13:19.727526+0000","last_became_peered":"2024-05-10T11:13:19.727526+0000","last_unstale":"2024-05-10T11:13:20.734374+0000","last_undegraded":"2024-05-10T11:13:20.734374+0000","last_fullsized":"2024-05-10T11:13:20.734374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:32.694277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691731+0000","last_change":"2024-05-10T11:13:18.691731+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691731+0000","last_undegraded":"2024-05-10T11:13:18.691731+0000","last_fullsized":"2024-05-10T11:13:18.691731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692089+0000","last_change":"2024-05-10T11:13:18.692089+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692089+0000","last_undegraded":"2024-05-10T11:13:18.692089+0000","last_fullsized":"2024-05-10T11:13:18.692089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727985+0000","last_change":"2024-05-10T11:13:19.727643+0000","last_active":"2024-05-10T11:13:20.727985+0000","last_peered":"2024-05-10T11:13:20.727985+0000","last_clean":"2024-05-10T11:13:20.727985+0000","last_became_active":"2024-05-10T11:13:19.727379+0000","last_became_peered":"2024-05-10T11:13:19.727379+0000","last_unstale":"2024-05-10T11:13:20.727985+0000","last_undegraded":"2024-05-10T11:13:20.727985+0000","last_fullsized":"2024-05-10T11:13:20.727985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.505846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689029+0000","last_change":"2024-05-10T11:13:18.689029+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689029+0000","last_undegraded":"2024-05-10T11:13:18.689029+0000","last_fullsized":"2024-05-10T11:13:18.689029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763926+0000","last_change":"2024-05-10T11:13:19.736103+0000","last_active":"2024-05-10T11:13:20.763926+0000","last_peered":"2024-05-10T11:13:20.763926+0000","last_clean":"2024-05-10T11:13:20.763926+0000","last_became_active":"2024-05-10T11:13:19.735808+0000","last_became_peered":"2024-05-10T11:13:19.735808+0000","last_unstale":"2024-05-10T11:13:20.763926+0000","last_undegraded":"2024-05-10T11:13:20.763926+0000","last_fullsized":"2024-05-10T11:13:20.763926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690230+0000","last_change":"2024-05-10T11:13:18.690230+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690230+0000","last_undegraded":"2024-05-10T11:13:18.690230+0000","last_fullsized":"2024-05-10T11:13:18.690230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734617+0000","last_change":"2024-05-10T11:13:19.728392+0000","last_active":"2024-05-10T11:13:20.734617+0000","last_peered":"2024-05-10T11:13:20.734617+0000","last_clean":"2024-05-10T11:13:20.734617+0000","last_became_active":"2024-05-10T11:13:19.728114+0000","last_became_peered":"2024-05-10T11:13:19.728114+0000","last_unstale":"2024-05-10T11:13:20.734617+0000","last_undegraded":"2024-05-10T11:13:20.734617+0000","last_fullsized":"2024-05-10T11:13:20.734617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689673+0000","last_change":"2024-05-10T11:13:18.689673+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689673+0000","last_undegraded":"2024-05-10T11:13:18.689673+0000","last_fullsized":"2024-05-10T11:13:18.689673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689192+0000","last_change":"2024-05-10T11:13:18.689192+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689192+0000","last_undegraded":"2024-05-10T11:13:18.689192+0000","last_fullsized":"2024-05-10T11:13:18.689192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690641+0000","last_change":"2024-05-10T11:13:18.690641+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690641+0000","last_undegraded":"2024-05-10T11:13:18.690641+0000","last_fullsized":"2024-05-10T11:13:18.690641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763545+0000","last_change":"2024-05-10T11:13:19.740012+0000","last_active":"2024-05-10T11:13:20.763545+0000","last_peered":"2024-05-10T11:13:20.763545+0000","last_clean":"2024-05-10T11:13:20.763545+0000","last_became_active":"2024-05-10T11:13:19.739697+0000","last_became_peered":"2024-05-10T11:13:19.739697+0000","last_unstale":"2024-05-10T11:13:20.763545+0000","last_undegraded":"2024-05-10T11:13:20.763545+0000","last_fullsized":"2024-05-10T11:13:20.763545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:16.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691264+0000","last_change":"2024-05-10T11:13:18.691264+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691264+0000","last_undegraded":"2024-05-10T11:13:18.691264+0000","last_fullsized":"2024-05-10T11:13:18.691264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704247+0000","last_change":"2024-05-10T11:13:18.702772+0000","last_active":"2024-05-10T11:13:18.704247+0000","last_peered":"2024-05-10T11:13:18.704247+0000","last_clean":"2024-05-10T11:13:18.704247+0000","last_became_active":"2024-05-10T11:13:18.702477+0000","last_became_peered":"2024-05-10T11:13:18.702477+0000","last_unstale":"2024-05-10T11:13:18.704247+0000","last_undegraded":"2024-05-10T11:13:18.704247+0000","last_fullsized":"2024-05-10T11:13:18.704247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764207+0000","last_change":"2024-05-10T11:13:19.738117+0000","last_active":"2024-05-10T11:13:20.764207+0000","last_peered":"2024-05-10T11:13:20.764207+0000","last_clean":"2024-05-10T11:13:20.764207+0000","last_became_active":"2024-05-10T11:13:19.737853+0000","last_became_peered":"2024-05-10T11:13:19.737853+0000","last_unstale":"2024-05-10T11:13:20.764207+0000","last_undegraded":"2024-05-10T11:13:20.764207+0000","last_fullsized":"2024-05-10T11:13:20.764207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729137+0000","last_change":"2024-05-10T11:13:18.700836+0000","last_active":"2024-05-10T11:13:20.729137+0000","last_peered":"2024-05-10T11:13:20.729137+0000","last_clean":"2024-05-10T11:13:20.729137+0000","last_became_active":"2024-05-10T11:13:18.700475+0000","last_became_peered":"2024-05-10T11:13:18.700475+0000","last_unstale":"2024-05-10T11:13:20.729137+0000","last_undegraded":"2024-05-10T11:13:20.729137+0000","last_fullsized":"2024-05-10T11:13:20.729137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689669+0000","last_change":"2024-05-10T11:13:18.689669+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689669+0000","last_undegraded":"2024-05-10T11:13:18.689669+0000","last_fullsized":"2024-05-10T11:13:18.689669+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764281+0000","last_change":"2024-05-10T11:13:18.704118+0000","last_active":"2024-05-10T11:13:20.764281+0000","last_peered":"2024-05-10T11:13:20.764281+0000","last_clean":"2024-05-10T11:13:20.764281+0000","last_became_active":"2024-05-10T11:13:18.703845+0000","last_became_peered":"2024-05-10T11:13:18.703845+0000","last_unstale":"2024-05-10T11:13:20.764281+0000","last_undegraded":"2024-05-10T11:13:20.764281+0000","last_fullsized":"2024-05-10T11:13:20.764281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764493+0000","last_change":"2024-05-10T11:13:19.724203+0000","last_active":"2024-05-10T11:13:20.764493+0000","last_peered":"2024-05-10T11:13:20.764493+0000","last_clean":"2024-05-10T11:13:20.764493+0000","last_became_active":"2024-05-10T11:13:19.723950+0000","last_became_peered":"2024-05-10T11:13:19.723950+0000","last_unstale":"2024-05-10T11:13:20.764493+0000","last_undegraded":"2024-05-10T11:13:20.764493+0000","last_fullsized":"2024-05-10T11:13:20.764493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:39.970327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705781+0000","last_change":"2024-05-10T11:13:18.704981+0000","last_active":"2024-05-10T11:13:18.705781+0000","last_peered":"2024-05-10T11:13:18.705781+0000","last_clean":"2024-05-10T11:13:18.705781+0000","last_became_active":"2024-05-10T11:13:18.704637+0000","last_became_peered":"2024-05-10T11:13:18.704637+0000","last_unstale":"2024-05-10T11:13:18.705781+0000","last_undegraded":"2024-05-10T11:13:18.705781+0000","last_fullsized":"2024-05-10T11:13:18.705781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728868+0000","last_change":"2024-05-10T11:13:19.730788+0000","last_active":"2024-05-10T11:13:20.728868+0000","last_peered":"2024-05-10T11:13:20.728868+0000","last_clean":"2024-05-10T11:13:20.728868+0000","last_became_active":"2024-05-10T11:13:19.730539+0000","last_became_peered":"2024-05-10T11:13:19.730539+0000","last_unstale":"2024-05-10T11:13:20.728868+0000","last_undegraded":"2024-05-10T11:13:20.728868+0000","last_fullsized":"2024-05-10T11:13:20.728868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734629+0000","last_change":"2024-05-10T11:13:18.701666+0000","last_active":"2024-05-10T11:13:20.734629+0000","last_peered":"2024-05-10T11:13:20.734629+0000","last_clean":"2024-05-10T11:13:20.734629+0000","last_became_active":"2024-05-10T11:13:18.701440+0000","last_became_peered":"2024-05-10T11:13:18.701440+0000","last_unstale":"2024-05-10T11:13:20.734629+0000","last_undegraded":"2024-05-10T11:13:20.734629+0000","last_fullsized":"2024-05-10T11:13:20.734629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:52.343488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734546+0000","last_change":"2024-05-10T11:13:19.728464+0000","last_active":"2024-05-10T11:13:20.734546+0000","last_peered":"2024-05-10T11:13:20.734546+0000","last_clean":"2024-05-10T11:13:20.734546+0000","last_became_active":"2024-05-10T11:13:19.728193+0000","last_became_peered":"2024-05-10T11:13:19.728193+0000","last_unstale":"2024-05-10T11:13:20.734546+0000","last_undegraded":"2024-05-10T11:13:20.734546+0000","last_fullsized":"2024-05-10T11:13:20.734546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704589+0000","last_change":"2024-05-10T11:13:18.703185+0000","last_active":"2024-05-10T11:13:18.704589+0000","last_peered":"2024-05-10T11:13:18.704589+0000","last_clean":"2024-05-10T11:13:18.704589+0000","last_became_active":"2024-05-10T11:13:18.702911+0000","last_became_peered":"2024-05-10T11:13:18.702911+0000","last_unstale":"2024-05-10T11:13:18.704589+0000","last_undegraded":"2024-05-10T11:13:18.704589+0000","last_fullsized":"2024-05-10T11:13:18.704589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:36.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689164+0000","last_change":"2024-05-10T11:13:18.689164+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689164+0000","last_undegraded":"2024-05-10T11:13:18.689164+0000","last_fullsized":"2024-05-10T11:13:18.689164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763506+0000","last_change":"2024-05-10T11:13:18.699755+0000","last_active":"2024-05-10T11:13:20.763506+0000","last_peered":"2024-05-10T11:13:20.763506+0000","last_clean":"2024-05-10T11:13:20.763506+0000","last_became_active":"2024-05-10T11:13:18.698729+0000","last_became_peered":"2024-05-10T11:13:18.698729+0000","last_unstale":"2024-05-10T11:13:20.763506+0000","last_undegraded":"2024-05-10T11:13:20.763506+0000","last_fullsized":"2024-05-10T11:13:20.763506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763828+0000","last_change":"2024-05-10T11:13:19.725730+0000","last_active":"2024-05-10T11:13:20.763828+0000","last_peered":"2024-05-10T11:13:20.763828+0000","last_clean":"2024-05-10T11:13:20.763828+0000","last_became_active":"2024-05-10T11:13:19.725477+0000","last_became_peered":"2024-05-10T11:13:19.725477+0000","last_unstale":"2024-05-10T11:13:20.763828+0000","last_undegraded":"2024-05-10T11:13:20.763828+0000","last_fullsized":"2024-05-10T11:13:20.763828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700727+0000","last_change":"2024-05-10T11:13:18.695029+0000","last_active":"2024-05-10T11:13:18.700727+0000","last_peered":"2024-05-10T11:13:18.700727+0000","last_clean":"2024-05-10T11:13:18.700727+0000","last_became_active":"2024-05-10T11:13:18.694723+0000","last_became_peered":"2024-05-10T11:13:18.694723+0000","last_unstale":"2024-05-10T11:13:18.700727+0000","last_undegraded":"2024-05-10T11:13:18.700727+0000","last_fullsized":"2024-05-10T11:13:18.700727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728096+0000","last_change":"2024-05-10T11:13:19.733886+0000","last_active":"2024-05-10T11:13:20.728096+0000","last_peered":"2024-05-10T11:13:20.728096+0000","last_clean":"2024-05-10T11:13:20.728096+0000","last_became_active":"2024-05-10T11:13:19.733588+0000","last_became_peered":"2024-05-10T11:13:19.733588+0000","last_unstale":"2024-05-10T11:13:20.728096+0000","last_undegraded":"2024-05-10T11:13:20.728096+0000","last_fullsized":"2024-05-10T11:13:20.728096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.288584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764521+0000","last_change":"2024-05-10T11:13:18.703232+0000","last_active":"2024-05-10T11:13:20.764521+0000","last_peered":"2024-05-10T11:13:20.764521+0000","last_clean":"2024-05-10T11:13:20.764521+0000","last_became_active":"2024-05-10T11:13:18.702937+0000","last_became_peered":"2024-05-10T11:13:18.702937+0000","last_unstale":"2024-05-10T11:13:20.764521+0000","last_undegraded":"2024-05-10T11:13:20.764521+0000","last_fullsized":"2024-05-10T11:13:20.764521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:51.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691955+0000","last_change":"2024-05-10T11:13:18.691955+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691955+0000","last_undegraded":"2024-05-10T11:13:18.691955+0000","last_fullsized":"2024-05-10T11:13:18.691955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734878+0000","last_change":"2024-05-10T11:13:18.700131+0000","last_active":"2024-05-10T11:13:20.734878+0000","last_peered":"2024-05-10T11:13:20.734878+0000","last_clean":"2024-05-10T11:13:20.734878+0000","last_became_active":"2024-05-10T11:13:18.698727+0000","last_became_peered":"2024-05-10T11:13:18.698727+0000","last_unstale":"2024-05-10T11:13:20.734878+0000","last_undegraded":"2024-05-10T11:13:20.734878+0000","last_fullsized":"2024-05-10T11:13:20.734878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:23.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729206+0000","last_change":"2024-05-10T11:13:19.729385+0000","last_active":"2024-05-10T11:13:20.729206+0000","last_peered":"2024-05-10T11:13:20.729206+0000","last_clean":"2024-05-10T11:13:20.729206+0000","last_became_active":"2024-05-10T11:13:19.729088+0000","last_became_peered":"2024-05-10T11:13:19.729088+0000","last_unstale":"2024-05-10T11:13:20.729206+0000","last_undegraded":"2024-05-10T11:13:20.729206+0000","last_fullsized":"2024-05-10T11:13:20.729206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:02.574628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734843+0000","last_change":"2024-05-10T11:13:18.697361+0000","last_active":"2024-05-10T11:13:20.734843+0000","last_peered":"2024-05-10T11:13:20.734843+0000","last_clean":"2024-05-10T11:13:20.734843+0000","last_became_active":"2024-05-10T11:13:18.697069+0000","last_became_peered":"2024-05-10T11:13:18.697069+0000","last_unstale":"2024-05-10T11:13:20.734843+0000","last_undegraded":"2024-05-10T11:13:20.734843+0000","last_fullsized":"2024-05-10T11:13:20.734843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:43.028126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690403+0000","last_change":"2024-05-10T11:13:18.690403+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690403+0000","last_undegraded":"2024-05-10T11:13:18.690403+0000","last_fullsized":"2024-05-10T11:13:18.690403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764452+0000","last_change":"2024-05-10T11:13:18.704317+0000","last_active":"2024-05-10T11:13:20.764452+0000","last_peered":"2024-05-10T11:13:20.764452+0000","last_clean":"2024-05-10T11:13:20.764452+0000","last_became_active":"2024-05-10T11:13:18.704016+0000","last_became_peered":"2024-05-10T11:13:18.704016+0000","last_unstale":"2024-05-10T11:13:20.764452+0000","last_undegraded":"2024-05-10T11:13:20.764452+0000","last_fullsized":"2024-05-10T11:13:20.764452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728896+0000","last_change":"2024-05-10T11:13:19.735706+0000","last_active":"2024-05-10T11:13:20.728896+0000","last_peered":"2024-05-10T11:13:20.728896+0000","last_clean":"2024-05-10T11:13:20.728896+0000","last_became_active":"2024-05-10T11:13:19.734578+0000","last_became_peered":"2024-05-10T11:13:19.734578+0000","last_unstale":"2024-05-10T11:13:20.728896+0000","last_undegraded":"2024-05-10T11:13:20.728896+0000","last_fullsized":"2024-05-10T11:13:20.728896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764164+0000","last_change":"2024-05-10T11:13:18.702219+0000","last_active":"2024-05-10T11:13:20.764164+0000","last_peered":"2024-05-10T11:13:20.764164+0000","last_clean":"2024-05-10T11:13:20.764164+0000","last_became_active":"2024-05-10T11:13:18.701933+0000","last_became_peered":"2024-05-10T11:13:18.701933+0000","last_unstale":"2024-05-10T11:13:20.764164+0000","last_undegraded":"2024-05-10T11:13:20.764164+0000","last_fullsized":"2024-05-10T11:13:20.764164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:38.664408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764507+0000","last_change":"2024-05-10T11:13:19.732843+0000","last_active":"2024-05-10T11:13:20.764507+0000","last_peered":"2024-05-10T11:13:20.764507+0000","last_clean":"2024-05-10T11:13:20.764507+0000","last_became_active":"2024-05-10T11:13:19.732571+0000","last_became_peered":"2024-05-10T11:13:19.732571+0000","last_unstale":"2024-05-10T11:13:20.764507+0000","last_undegraded":"2024-05-10T11:13:20.764507+0000","last_fullsized":"2024-05-10T11:13:20.764507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:23.903648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763464+0000","last_change":"2024-05-10T11:13:18.699460+0000","last_active":"2024-05-10T11:13:20.763464+0000","last_peered":"2024-05-10T11:13:20.763464+0000","last_clean":"2024-05-10T11:13:20.763464+0000","last_became_active":"2024-05-10T11:13:18.699144+0000","last_became_peered":"2024-05-10T11:13:18.699144+0000","last_unstale":"2024-05-10T11:13:20.763464+0000","last_undegraded":"2024-05-10T11:13:20.763464+0000","last_fullsized":"2024-05-10T11:13:20.763464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690745+0000","last_change":"2024-05-10T11:13:18.690745+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690745+0000","last_undegraded":"2024-05-10T11:13:18.690745+0000","last_fullsized":"2024-05-10T11:13:18.690745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705229+0000","last_change":"2024-05-10T11:13:18.703149+0000","last_active":"2024-05-10T11:13:18.705229+0000","last_peered":"2024-05-10T11:13:18.705229+0000","last_clean":"2024-05-10T11:13:18.705229+0000","last_became_active":"2024-05-10T11:13:18.702580+0000","last_became_peered":"2024-05-10T11:13:18.702580+0000","last_unstale":"2024-05-10T11:13:18.705229+0000","last_undegraded":"2024-05-10T11:13:18.705229+0000","last_fullsized":"2024-05-10T11:13:18.705229+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763969+0000","last_change":"2024-05-10T11:13:19.733267+0000","last_active":"2024-05-10T11:13:20.763969+0000","last_peered":"2024-05-10T11:13:20.763969+0000","last_clean":"2024-05-10T11:13:20.763969+0000","last_became_active":"2024-05-10T11:13:19.732862+0000","last_became_peered":"2024-05-10T11:13:19.732862+0000","last_unstale":"2024-05-10T11:13:20.763969+0000","last_undegraded":"2024-05-10T11:13:20.763969+0000","last_fullsized":"2024-05-10T11:13:20.763969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.703353+0000","last_change":"2024-05-10T11:13:18.701542+0000","last_active":"2024-05-10T11:13:18.703353+0000","last_peered":"2024-05-10T11:13:18.703353+0000","last_clean":"2024-05-10T11:13:18.703353+0000","last_became_active":"2024-05-10T11:13:18.701286+0000","last_became_peered":"2024-05-10T11:13:18.701286+0000","last_unstale":"2024-05-10T11:13:18.703353+0000","last_undegraded":"2024-05-10T11:13:18.703353+0000","last_fullsized":"2024-05-10T11:13:18.703353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:44.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764415+0000","last_change":"2024-05-10T11:13:19.718590+0000","last_active":"2024-05-10T11:13:20.764415+0000","last_peered":"2024-05-10T11:13:20.764415+0000","last_clean":"2024-05-10T11:13:20.764415+0000","last_became_active":"2024-05-10T11:13:19.718038+0000","last_became_peered":"2024-05-10T11:13:19.718038+0000","last_unstale":"2024-05-10T11:13:20.764415+0000","last_undegraded":"2024-05-10T11:13:20.764415+0000","last_fullsized":"2024-05-10T11:13:20.764415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734879+0000","last_change":"2024-05-10T11:13:18.693532+0000","last_active":"2024-05-10T11:13:20.734879+0000","last_peered":"2024-05-10T11:13:20.734879+0000","last_clean":"2024-05-10T11:13:20.734879+0000","last_became_active":"2024-05-10T11:13:18.693207+0000","last_became_peered":"2024-05-10T11:13:18.693207+0000","last_unstale":"2024-05-10T11:13:20.734879+0000","last_undegraded":"2024-05-10T11:13:20.734879+0000","last_fullsized":"2024-05-10T11:13:20.734879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734818+0000","last_change":"2024-05-10T11:13:19.729201+0000","last_active":"2024-05-10T11:13:20.734818+0000","last_peered":"2024-05-10T11:13:20.734818+0000","last_clean":"2024-05-10T11:13:20.734818+0000","last_became_active":"2024-05-10T11:13:19.728950+0000","last_became_peered":"2024-05-10T11:13:19.728950+0000","last_unstale":"2024-05-10T11:13:20.734818+0000","last_undegraded":"2024-05-10T11:13:20.734818+0000","last_fullsized":"2024-05-10T11:13:20.734818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700757+0000","last_change":"2024-05-10T11:13:18.694811+0000","last_active":"2024-05-10T11:13:18.700757+0000","last_peered":"2024-05-10T11:13:18.700757+0000","last_clean":"2024-05-10T11:13:18.700757+0000","last_became_active":"2024-05-10T11:13:18.692974+0000","last_became_peered":"2024-05-10T11:13:18.692974+0000","last_unstale":"2024-05-10T11:13:18.700757+0000","last_undegraded":"2024-05-10T11:13:18.700757+0000","last_fullsized":"2024-05-10T11:13:18.700757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688501+0000","last_change":"2024-05-10T11:13:18.688501+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688501+0000","last_undegraded":"2024-05-10T11:13:18.688501+0000","last_fullsized":"2024-05-10T11:13:18.688501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727939+0000","last_change":"2024-05-10T11:13:18.698741+0000","last_active":"2024-05-10T11:13:20.727939+0000","last_peered":"2024-05-10T11:13:20.727939+0000","last_clean":"2024-05-10T11:13:20.727939+0000","last_became_active":"2024-05-10T11:13:18.698440+0000","last_became_peered":"2024-05-10T11:13:18.698440+0000","last_unstale":"2024-05-10T11:13:20.727939+0000","last_undegraded":"2024-05-10T11:13:20.727939+0000","last_fullsized":"2024-05-10T11:13:20.727939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:19:16.570254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.739604+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.739272+0000","last_became_peered":"2024-05-10T11:13:19.739272+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:33.487420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763735+0000","last_change":"2024-05-10T11:13:18.703465+0000","last_active":"2024-05-10T11:13:20.763735+0000","last_peered":"2024-05-10T11:13:20.763735+0000","last_clean":"2024-05-10T11:13:20.763735+0000","last_became_active":"2024-05-10T11:13:18.702762+0000","last_became_peered":"2024-05-10T11:13:18.702762+0000","last_unstale":"2024-05-10T11:13:20.763735+0000","last_undegraded":"2024-05-10T11:13:20.763735+0000","last_fullsized":"2024-05-10T11:13:20.763735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:10.813728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690588+0000","last_change":"2024-05-10T11:13:18.690588+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690588+0000","last_undegraded":"2024-05-10T11:13:18.690588+0000","last_fullsized":"2024-05-10T11:13:18.690588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727850+0000","last_change":"2024-05-10T11:13:18.702301+0000","last_active":"2024-05-10T11:13:20.727850+0000","last_peered":"2024-05-10T11:13:20.727850+0000","last_clean":"2024-05-10T11:13:20.727850+0000","last_became_active":"2024-05-10T11:13:18.702020+0000","last_became_peered":"2024-05-10T11:13:18.702020+0000","last_unstale":"2024-05-10T11:13:20.727850+0000","last_undegraded":"2024-05-10T11:13:20.727850+0000","last_fullsized":"2024-05-10T11:13:20.727850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:23.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728994+0000","last_change":"2024-05-10T11:13:19.730034+0000","last_active":"2024-05-10T11:13:20.728994+0000","last_peered":"2024-05-10T11:13:20.728994+0000","last_clean":"2024-05-10T11:13:20.728994+0000","last_became_active":"2024-05-10T11:13:19.729784+0000","last_became_peered":"2024-05-10T11:13:19.729784+0000","last_unstale":"2024-05-10T11:13:20.728994+0000","last_undegraded":"2024-05-10T11:13:20.728994+0000","last_fullsized":"2024-05-10T11:13:20.728994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727817+0000","last_change":"2024-05-10T11:13:18.703123+0000","last_active":"2024-05-10T11:13:20.727817+0000","last_peered":"2024-05-10T11:13:20.727817+0000","last_clean":"2024-05-10T11:13:20.727817+0000","last_became_active":"2024-05-10T11:13:18.702855+0000","last_became_peered":"2024-05-10T11:13:18.702855+0000","last_unstale":"2024-05-10T11:13:20.727817+0000","last_undegraded":"2024-05-10T11:13:20.727817+0000","last_fullsized":"2024-05-10T11:13:20.727817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:55.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734500+0000","last_change":"2024-05-10T11:13:19.723348+0000","last_active":"2024-05-10T11:13:20.734500+0000","last_peered":"2024-05-10T11:13:20.734500+0000","last_clean":"2024-05-10T11:13:20.734500+0000","last_became_active":"2024-05-10T11:13:19.723074+0000","last_became_peered":"2024-05-10T11:13:19.723074+0000","last_unstale":"2024-05-10T11:13:20.734500+0000","last_undegraded":"2024-05-10T11:13:20.734500+0000","last_fullsized":"2024-05-10T11:13:20.734500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:34.461837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700305+0000","last_change":"2024-05-10T11:13:18.698251+0000","last_active":"2024-05-10T11:13:18.700305+0000","last_peered":"2024-05-10T11:13:18.700305+0000","last_clean":"2024-05-10T11:13:18.700305+0000","last_became_active":"2024-05-10T11:13:18.697970+0000","last_became_peered":"2024-05-10T11:13:18.697970+0000","last_unstale":"2024-05-10T11:13:18.700305+0000","last_undegraded":"2024-05-10T11:13:18.700305+0000","last_fullsized":"2024-05-10T11:13:18.700305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:31.620398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764112+0000","last_change":"2024-05-10T11:13:19.725035+0000","last_active":"2024-05-10T11:13:20.764112+0000","last_peered":"2024-05-10T11:13:20.764112+0000","last_clean":"2024-05-10T11:13:20.764112+0000","last_became_active":"2024-05-10T11:13:19.724781+0000","last_became_peered":"2024-05-10T11:13:19.724781+0000","last_unstale":"2024-05-10T11:13:20.764112+0000","last_undegraded":"2024-05-10T11:13:20.764112+0000","last_fullsized":"2024-05-10T11:13:20.764112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727630+0000","last_change":"2024-05-10T11:13:18.703414+0000","last_active":"2024-05-10T11:13:20.727630+0000","last_peered":"2024-05-10T11:13:20.727630+0000","last_clean":"2024-05-10T11:13:20.727630+0000","last_became_active":"2024-05-10T11:13:18.702852+0000","last_became_peered":"2024-05-10T11:13:18.702852+0000","last_unstale":"2024-05-10T11:13:20.727630+0000","last_undegraded":"2024-05-10T11:13:20.727630+0000","last_fullsized":"2024-05-10T11:13:20.727630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:34.714357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763678+0000","last_change":"2024-05-10T11:13:19.736920+0000","last_active":"2024-05-10T11:13:20.763678+0000","last_peered":"2024-05-10T11:13:20.763678+0000","last_clean":"2024-05-10T11:13:20.763678+0000","last_became_active":"2024-05-10T11:13:19.736619+0000","last_became_peered":"2024-05-10T11:13:19.736619+0000","last_unstale":"2024-05-10T11:13:20.763678+0000","last_undegraded":"2024-05-10T11:13:20.763678+0000","last_fullsized":"2024-05-10T11:13:20.763678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734954+0000","last_change":"2024-05-10T11:13:18.696813+0000","last_active":"2024-05-10T11:13:20.734954+0000","last_peered":"2024-05-10T11:13:20.734954+0000","last_clean":"2024-05-10T11:13:20.734954+0000","last_became_active":"2024-05-10T11:13:18.696527+0000","last_became_peered":"2024-05-10T11:13:18.696527+0000","last_unstale":"2024-05-10T11:13:20.734954+0000","last_undegraded":"2024-05-10T11:13:20.734954+0000","last_fullsized":"2024-05-10T11:13:20.734954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691526+0000","last_change":"2024-05-10T11:13:18.691526+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691526+0000","last_undegraded":"2024-05-10T11:13:18.691526+0000","last_fullsized":"2024-05-10T11:13:18.691526+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728077+0000","last_change":"2024-05-10T11:13:18.699474+0000","last_active":"2024-05-10T11:13:20.728077+0000","last_peered":"2024-05-10T11:13:20.728077+0000","last_clean":"2024-05-10T11:13:20.728077+0000","last_became_active":"2024-05-10T11:13:18.699197+0000","last_became_peered":"2024-05-10T11:13:18.699197+0000","last_unstale":"2024-05-10T11:13:20.728077+0000","last_undegraded":"2024-05-10T11:13:20.728077+0000","last_fullsized":"2024-05-10T11:13:20.728077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:03:28.008509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764106+0000","last_change":"2024-05-10T11:13:19.727718+0000","last_active":"2024-05-10T11:13:20.764106+0000","last_peered":"2024-05-10T11:13:20.764106+0000","last_clean":"2024-05-10T11:13:20.764106+0000","last_became_active":"2024-05-10T11:13:19.727454+0000","last_became_peered":"2024-05-10T11:13:19.727454+0000","last_unstale":"2024-05-10T11:13:20.764106+0000","last_undegraded":"2024-05-10T11:13:20.764106+0000","last_fullsized":"2024-05-10T11:13:20.764106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729121+0000","last_change":"2024-05-10T11:13:18.701654+0000","last_active":"2024-05-10T11:13:20.729121+0000","last_peered":"2024-05-10T11:13:20.729121+0000","last_clean":"2024-05-10T11:13:20.729121+0000","last_became_active":"2024-05-10T11:13:18.701372+0000","last_became_peered":"2024-05-10T11:13:18.701372+0000","last_unstale":"2024-05-10T11:13:20.729121+0000","last_undegraded":"2024-05-10T11:13:20.729121+0000","last_fullsized":"2024-05-10T11:13:20.729121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729040+0000","last_change":"2024-05-10T11:13:19.738281+0000","last_active":"2024-05-10T11:13:20.729040+0000","last_peered":"2024-05-10T11:13:20.729040+0000","last_clean":"2024-05-10T11:13:20.729040+0000","last_became_active":"2024-05-10T11:13:19.738024+0000","last_became_peered":"2024-05-10T11:13:19.738024+0000","last_unstale":"2024-05-10T11:13:20.729040+0000","last_undegraded":"2024-05-10T11:13:20.729040+0000","last_fullsized":"2024-05-10T11:13:20.729040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:05.391289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729085+0000","last_change":"2024-05-10T11:13:18.699063+0000","last_active":"2024-05-10T11:13:20.729085+0000","last_peered":"2024-05-10T11:13:20.729085+0000","last_clean":"2024-05-10T11:13:20.729085+0000","last_became_active":"2024-05-10T11:13:18.698161+0000","last_became_peered":"2024-05-10T11:13:18.698161+0000","last_unstale":"2024-05-10T11:13:20.729085+0000","last_undegraded":"2024-05-10T11:13:20.729085+0000","last_fullsized":"2024-05-10T11:13:20.729085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763552+0000","last_change":"2024-05-10T11:13:19.727035+0000","last_active":"2024-05-10T11:13:20.763552+0000","last_peered":"2024-05-10T11:13:20.763552+0000","last_clean":"2024-05-10T11:13:20.763552+0000","last_became_active":"2024-05-10T11:13:19.726701+0000","last_became_peered":"2024-05-10T11:13:19.726701+0000","last_unstale":"2024-05-10T11:13:20.763552+0000","last_undegraded":"2024-05-10T11:13:20.763552+0000","last_fullsized":"2024-05-10T11:13:20.763552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:26.394487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704029+0000","last_change":"2024-05-10T11:13:18.701428+0000","last_active":"2024-05-10T11:13:18.704029+0000","last_peered":"2024-05-10T11:13:18.704029+0000","last_clean":"2024-05-10T11:13:18.704029+0000","last_became_active":"2024-05-10T11:13:18.701155+0000","last_became_peered":"2024-05-10T11:13:18.701155+0000","last_unstale":"2024-05-10T11:13:18.704029+0000","last_undegraded":"2024-05-10T11:13:18.704029+0000","last_fullsized":"2024-05-10T11:13:18.704029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:15.935603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688495+0000","last_change":"2024-05-10T11:13:18.688495+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688495+0000","last_undegraded":"2024-05-10T11:13:18.688495+0000","last_fullsized":"2024-05-10T11:13:18.688495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.701773+0000","last_change":"2024-05-10T11:13:18.699343+0000","last_active":"2024-05-10T11:13:18.701773+0000","last_peered":"2024-05-10T11:13:18.701773+0000","last_clean":"2024-05-10T11:13:18.701773+0000","last_became_active":"2024-05-10T11:13:18.699076+0000","last_became_peered":"2024-05-10T11:13:18.699076+0000","last_unstale":"2024-05-10T11:13:18.701773+0000","last_undegraded":"2024-05-10T11:13:18.701773+0000","last_fullsized":"2024-05-10T11:13:18.701773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:13.688833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690102+0000","last_change":"2024-05-10T11:13:18.690102+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690102+0000","last_undegraded":"2024-05-10T11:13:18.690102+0000","last_fullsized":"2024-05-10T11:13:18.690102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764082+0000","last_change":"2024-05-10T11:13:18.702463+0000","last_active":"2024-05-10T11:13:20.764082+0000","last_peered":"2024-05-10T11:13:20.764082+0000","last_clean":"2024-05-10T11:13:20.764082+0000","last_became_active":"2024-05-10T11:13:18.702201+0000","last_became_peered":"2024-05-10T11:13:18.702201+0000","last_unstale":"2024-05-10T11:13:20.764082+0000","last_undegraded":"2024-05-10T11:13:20.764082+0000","last_fullsized":"2024-05-10T11:13:20.764082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734809+0000","last_change":"2024-05-10T11:13:19.735527+0000","last_active":"2024-05-10T11:13:20.734809+0000","last_peered":"2024-05-10T11:13:20.734809+0000","last_clean":"2024-05-10T11:13:20.734809+0000","last_became_active":"2024-05-10T11:13:19.734366+0000","last_became_peered":"2024-05-10T11:13:19.734366+0000","last_unstale":"2024-05-10T11:13:20.734809+0000","last_undegraded":"2024-05-10T11:13:20.734809+0000","last_fullsized":"2024-05-10T11:13:20.734809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.699619+0000","last_change":"2024-05-10T11:13:18.696982+0000","last_active":"2024-05-10T11:13:18.699619+0000","last_peered":"2024-05-10T11:13:18.699619+0000","last_clean":"2024-05-10T11:13:18.699619+0000","last_became_active":"2024-05-10T11:13:18.696733+0000","last_became_peered":"2024-05-10T11:13:18.696733+0000","last_unstale":"2024-05-10T11:13:18.699619+0000","last_undegraded":"2024-05-10T11:13:18.699619+0000","last_fullsized":"2024-05-10T11:13:18.699619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.692315+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:18.692315+0000","last_peered":"2024-05-10T11:13:18.692315+0000","last_clean":"2024-05-10T11:13:18.692315+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:18.692315+0000","last_undegraded":"2024-05-10T11:13:18.692315+0000","last_fullsized":"2024-05-10T11:13:18.692315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":747748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":157380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":164047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":179552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":768308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":178018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:13:24.141 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:13:24.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.283+0000 7f5e1977f640 1 Processor -- start 2024-05-10T11:13:24.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.283+0000 7f5e1977f640 1 -- start start 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e1977f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e1415f4e0 0x7f5e1406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e1977f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1406e620 0x7f5e140d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e1977f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e140b0a90 con 0x7f5e1415f8c0 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e1977f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5e140b23f0 con 0x7f5e1415f4e0 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e1977f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5e140b4150 con 0x7f5e1406e620 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e1415f4e0 0x7f5e1406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e1415f4e0 0x7f5e1406d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35996/0 (socket says 172.21.15.66:35996) 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2953236096 learned_addr learned my addr 172.21.15.66:0/2953236096 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2953236096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1406e620 msgr2=0x7f5e140d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e137fe640 1 --2- 172.21.15.66:0/2953236096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1406e620 0x7f5e140d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 --2- 172.21.15.66:0/2953236096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1406e620 0x7f5e140d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2953236096 >> v1:172.21.15.190:6789/0 conn(0x7f5e1415f8c0 legacy=0x7f5e1406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:24.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.284+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2953236096 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e140b3540 con 0x7f5e1415f4e0 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.285+0000 7f5e12ffd640 1 --2- 172.21.15.66:0/2953236096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1415f4e0 0x7f5e1406d9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e34ec609042ba26 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.285+0000 7f5e11ffb640 1 -- 172.21.15.66:0/2953236096 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04037070 con 0x7f5e1415f4e0 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.285+0000 7f5e11ffb640 1 -- 172.21.15.66:0/2953236096 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e04032440 con 0x7f5e1415f4e0 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.285+0000 7f5e11ffb640 1 -- 172.21.15.66:0/2953236096 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04032810 con 0x7f5e1415f4e0 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 -- 172.21.15.66:0/2953236096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1415f4e0 msgr2=0x7f5e1406d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2953236096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1415f4e0 0x7f5e1406d9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e0402a180 comp rx=0 tx=0).stop 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 -- 172.21.15.66:0/2953236096 shutdown_connections 2024-05-10T11:13:24.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2953236096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1406e620 0x7f5e140d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2953236096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1415f4e0 0x7f5e1406d9d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 -- 172.21.15.66:0/2953236096 >> 172.21.15.66:0/2953236096 conn(0x7f5e140d2df0 msgr2=0x7f5e140d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:24.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 -- 172.21.15.66:0/2953236096 shutdown_connections 2024-05-10T11:13:24.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.286+0000 7f5e1977f640 1 -- 172.21.15.66:0/2953236096 wait complete. 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.287+0000 7f5e1977f640 1 Processor -- start 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.287+0000 7f5e1977f640 1 -- start start 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e1977f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 0x7f5e140b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e1977f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e1415f4e0 0x7f5e140b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e1977f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1415f8c0 0x7f5e141521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e1977f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e140b3de0 con 0x7f5e1406e620 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e1977f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5e140b3b00 con 0x7f5e1415f4e0 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e1977f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5e140b45e0 con 0x7f5e1415f8c0 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e12ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 0x7f5e140b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e12ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 0x7f5e140b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36010/0 (socket says 172.21.15.66:36010) 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2748841051 learned_addr learned my addr 172.21.15.66:0/2748841051 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:24.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e137fe640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1415f8c0 0x7f5e141521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.288+0000 7f5e127fc640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e1415f4e0 0x7f5e140b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1415f8c0 msgr2=0x7f5e141521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e12ffd640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1415f8c0 0x7f5e141521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e1415f4e0 msgr2=0x7f5e140b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e12ffd640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e1415f4e0 0x7f5e140b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e12ffd640 1 -- 172.21.15.66:0/2748841051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e140b4fc0 con 0x7f5e1406e620 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e137fe640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1415f8c0 0x7f5e141521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e127fc640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e1415f4e0 0x7f5e140b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e12ffd640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 0x7f5e140b48c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04041020 con 0x7f5e1406e620 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e04030970 con 0x7f5e1406e620 2024-05-10T11:13:24.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04037040 con 0x7f5e1406e620 2024-05-10T11:13:24.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e140b52a0 con 0x7f5e1406e620 2024-05-10T11:13:24.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.289+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e140b5860 con 0x7f5e1406e620 2024-05-10T11:13:24.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.290+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e1406a220 con 0x7f5e1406e620 2024-05-10T11:13:24.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.291+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e04044020 con 0x7f5e1406e620 2024-05-10T11:13:24.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.291+0000 7f5dfb7fe640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e000762d0 0x7f5e00078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.291+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f5e040b8170 con 0x7f5e1406e620 2024-05-10T11:13:24.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.291+0000 7f5e127fc640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e000762d0 0x7f5e00078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.292+0000 7f5e127fc640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e000762d0 0x7f5e00078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e08007fd0 tx=0x7f5e08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:24.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.296+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5e0404b030 con 0x7f5e1406e620 2024-05-10T11:13:24.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.486+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e1406f0e0 con 0x7f5e000762d0 2024-05-10T11:13:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.492+0000 7f5dfb7fe640 1 -- 172.21.15.66:0/2748841051 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250038 (secure 0 0 0) 0x7f5e1406f0e0 con 0x7f5e000762d0 2024-05-10T11:13:24.494 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e000762d0 msgr2=0x7f5e00078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e000762d0 0x7f5e00078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e08007fd0 tx=0x7f5e08009040 comp rx=0 tx=0).stop 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 msgr2=0x7f5e140b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 0x7f5e140b48c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e040046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 shutdown_connections 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e000762d0 0x7f5e00078790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e1415f8c0 0x7f5e141521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e1415f4e0 0x7f5e140b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 --2- 172.21.15.66:0/2748841051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e1406e620 0x7f5e140b48c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 >> 172.21.15.66:0/2748841051 conn(0x7f5e140d2df0 msgr2=0x7f5e14071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 shutdown_connections 2024-05-10T11:13:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.495+0000 7f5e1977f640 1 -- 172.21.15.66:0/2748841051 wait complete. 2024-05-10T11:13:24.506 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-10T11:13:23.696740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220544,"kb_used_data":4364,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754176,"statfs":{"total":773094113280,"available":772868276224,"internally_reserved":0,"allocated":4468736,"data_stored":2551025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001475"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764580+0000","last_change":"2024-05-10T11:13:19.732597+0000","last_active":"2024-05-10T11:13:20.764580+0000","last_peered":"2024-05-10T11:13:20.764580+0000","last_clean":"2024-05-10T11:13:20.764580+0000","last_became_active":"2024-05-10T11:13:19.732175+0000","last_became_peered":"2024-05-10T11:13:19.732175+0000","last_unstale":"2024-05-10T11:13:20.764580+0000","last_undegraded":"2024-05-10T11:13:20.764580+0000","last_fullsized":"2024-05-10T11:13:20.764580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:36.288762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763960+0000","last_change":"2024-05-10T11:13:19.739881+0000","last_active":"2024-05-10T11:13:20.763960+0000","last_peered":"2024-05-10T11:13:20.763960+0000","last_clean":"2024-05-10T11:13:20.763960+0000","last_became_active":"2024-05-10T11:13:19.739453+0000","last_became_peered":"2024-05-10T11:13:19.739453+0000","last_unstale":"2024-05-10T11:13:20.763960+0000","last_undegraded":"2024-05-10T11:13:20.763960+0000","last_fullsized":"2024-05-10T11:13:20.763960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729120+0000","last_change":"2024-05-10T11:13:19.733275+0000","last_active":"2024-05-10T11:13:20.729120+0000","last_peered":"2024-05-10T11:13:20.729120+0000","last_clean":"2024-05-10T11:13:20.729120+0000","last_became_active":"2024-05-10T11:13:19.732987+0000","last_became_peered":"2024-05-10T11:13:19.732987+0000","last_unstale":"2024-05-10T11:13:20.729120+0000","last_undegraded":"2024-05-10T11:13:20.729120+0000","last_fullsized":"2024-05-10T11:13:20.729120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:56.702776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728116+0000","last_change":"2024-05-10T11:13:19.733990+0000","last_active":"2024-05-10T11:13:20.728116+0000","last_peered":"2024-05-10T11:13:20.728116+0000","last_clean":"2024-05-10T11:13:20.728116+0000","last_became_active":"2024-05-10T11:13:19.733699+0000","last_became_peered":"2024-05-10T11:13:19.733699+0000","last_unstale":"2024-05-10T11:13:20.728116+0000","last_undegraded":"2024-05-10T11:13:20.728116+0000","last_fullsized":"2024-05-10T11:13:20.728116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:11.815701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.732957+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.732674+0000","last_became_peered":"2024-05-10T11:13:19.732674+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:46.137307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763665+0000","last_change":"2024-05-10T11:13:19.738793+0000","last_active":"2024-05-10T11:13:20.763665+0000","last_peered":"2024-05-10T11:13:20.763665+0000","last_clean":"2024-05-10T11:13:20.763665+0000","last_became_active":"2024-05-10T11:13:19.738522+0000","last_became_peered":"2024-05-10T11:13:19.738522+0000","last_unstale":"2024-05-10T11:13:20.763665+0000","last_undegraded":"2024-05-10T11:13:20.763665+0000","last_fullsized":"2024-05-10T11:13:20.763665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734297+0000","last_change":"2024-05-10T11:13:19.727429+0000","last_active":"2024-05-10T11:13:20.734297+0000","last_peered":"2024-05-10T11:13:20.734297+0000","last_clean":"2024-05-10T11:13:20.734297+0000","last_became_active":"2024-05-10T11:13:19.727146+0000","last_became_peered":"2024-05-10T11:13:19.727146+0000","last_unstale":"2024-05-10T11:13:20.734297+0000","last_undegraded":"2024-05-10T11:13:20.734297+0000","last_fullsized":"2024-05-10T11:13:20.734297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:07.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764030+0000","last_change":"2024-05-10T11:13:19.729084+0000","last_active":"2024-05-10T11:13:20.764030+0000","last_peered":"2024-05-10T11:13:20.764030+0000","last_clean":"2024-05-10T11:13:20.764030+0000","last_became_active":"2024-05-10T11:13:19.728796+0000","last_became_peered":"2024-05-10T11:13:19.728796+0000","last_unstale":"2024-05-10T11:13:20.764030+0000","last_undegraded":"2024-05-10T11:13:20.764030+0000","last_fullsized":"2024-05-10T11:13:20.764030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729383+0000","last_change":"2024-05-10T11:13:19.735425+0000","last_active":"2024-05-10T11:13:20.729383+0000","last_peered":"2024-05-10T11:13:20.729383+0000","last_clean":"2024-05-10T11:13:20.729383+0000","last_became_active":"2024-05-10T11:13:19.735053+0000","last_became_peered":"2024-05-10T11:13:19.735053+0000","last_unstale":"2024-05-10T11:13:20.729383+0000","last_undegraded":"2024-05-10T11:13:20.729383+0000","last_fullsized":"2024-05-10T11:13:20.729383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:04.283560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734820+0000","last_change":"2024-05-10T11:13:19.725056+0000","last_active":"2024-05-10T11:13:20.734820+0000","last_peered":"2024-05-10T11:13:20.734820+0000","last_clean":"2024-05-10T11:13:20.734820+0000","last_became_active":"2024-05-10T11:13:19.724833+0000","last_became_peered":"2024-05-10T11:13:19.724833+0000","last_unstale":"2024-05-10T11:13:20.734820+0000","last_undegraded":"2024-05-10T11:13:20.734820+0000","last_fullsized":"2024-05-10T11:13:20.734820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734748+0000","last_change":"2024-05-10T11:13:19.726523+0000","last_active":"2024-05-10T11:13:20.734748+0000","last_peered":"2024-05-10T11:13:20.734748+0000","last_clean":"2024-05-10T11:13:20.734748+0000","last_became_active":"2024-05-10T11:13:19.726280+0000","last_became_peered":"2024-05-10T11:13:19.726280+0000","last_unstale":"2024-05-10T11:13:20.734748+0000","last_undegraded":"2024-05-10T11:13:20.734748+0000","last_fullsized":"2024-05-10T11:13:20.734748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729035+0000","last_change":"2024-05-10T11:13:19.734209+0000","last_active":"2024-05-10T11:13:20.729035+0000","last_peered":"2024-05-10T11:13:20.729035+0000","last_clean":"2024-05-10T11:13:20.729035+0000","last_became_active":"2024-05-10T11:13:19.733951+0000","last_became_peered":"2024-05-10T11:13:19.733951+0000","last_unstale":"2024-05-10T11:13:20.729035+0000","last_undegraded":"2024-05-10T11:13:20.729035+0000","last_fullsized":"2024-05-10T11:13:20.729035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734619+0000","last_change":"2024-05-10T11:13:19.725439+0000","last_active":"2024-05-10T11:13:20.734619+0000","last_peered":"2024-05-10T11:13:20.734619+0000","last_clean":"2024-05-10T11:13:20.734619+0000","last_became_active":"2024-05-10T11:13:19.725149+0000","last_became_peered":"2024-05-10T11:13:19.725149+0000","last_unstale":"2024-05-10T11:13:20.734619+0000","last_undegraded":"2024-05-10T11:13:20.734619+0000","last_fullsized":"2024-05-10T11:13:20.734619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692849+0000","last_change":"2024-05-10T11:13:18.692849+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692849+0000","last_undegraded":"2024-05-10T11:13:18.692849+0000","last_fullsized":"2024-05-10T11:13:18.692849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734333+0000","last_change":"2024-05-10T11:13:19.730590+0000","last_active":"2024-05-10T11:13:20.734333+0000","last_peered":"2024-05-10T11:13:20.734333+0000","last_clean":"2024-05-10T11:13:20.734333+0000","last_became_active":"2024-05-10T11:13:19.730313+0000","last_became_peered":"2024-05-10T11:13:19.730313+0000","last_unstale":"2024-05-10T11:13:20.734333+0000","last_undegraded":"2024-05-10T11:13:20.734333+0000","last_fullsized":"2024-05-10T11:13:20.734333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:01.085545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692041+0000","last_change":"2024-05-10T11:13:18.692041+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692041+0000","last_undegraded":"2024-05-10T11:13:18.692041+0000","last_fullsized":"2024-05-10T11:13:18.692041+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690905+0000","last_change":"2024-05-10T11:13:18.690905+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690905+0000","last_undegraded":"2024-05-10T11:13:18.690905+0000","last_fullsized":"2024-05-10T11:13:18.690905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690085+0000","last_change":"2024-05-10T11:13:18.690085+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690085+0000","last_undegraded":"2024-05-10T11:13:18.690085+0000","last_fullsized":"2024-05-10T11:13:18.690085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728062+0000","last_change":"2024-05-10T11:13:19.739810+0000","last_active":"2024-05-10T11:13:20.728062+0000","last_peered":"2024-05-10T11:13:20.728062+0000","last_clean":"2024-05-10T11:13:20.728062+0000","last_became_active":"2024-05-10T11:13:19.739560+0000","last_became_peered":"2024-05-10T11:13:19.739560+0000","last_unstale":"2024-05-10T11:13:20.728062+0000","last_undegraded":"2024-05-10T11:13:20.728062+0000","last_fullsized":"2024-05-10T11:13:20.728062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:51.141564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691010+0000","last_change":"2024-05-10T11:13:18.691010+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691010+0000","last_undegraded":"2024-05-10T11:13:18.691010+0000","last_fullsized":"2024-05-10T11:13:18.691010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734374+0000","last_change":"2024-05-10T11:13:19.727819+0000","last_active":"2024-05-10T11:13:20.734374+0000","last_peered":"2024-05-10T11:13:20.734374+0000","last_clean":"2024-05-10T11:13:20.734374+0000","last_became_active":"2024-05-10T11:13:19.727526+0000","last_became_peered":"2024-05-10T11:13:19.727526+0000","last_unstale":"2024-05-10T11:13:20.734374+0000","last_undegraded":"2024-05-10T11:13:20.734374+0000","last_fullsized":"2024-05-10T11:13:20.734374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:32.694277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691731+0000","last_change":"2024-05-10T11:13:18.691731+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691731+0000","last_undegraded":"2024-05-10T11:13:18.691731+0000","last_fullsized":"2024-05-10T11:13:18.691731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692089+0000","last_change":"2024-05-10T11:13:18.692089+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692089+0000","last_undegraded":"2024-05-10T11:13:18.692089+0000","last_fullsized":"2024-05-10T11:13:18.692089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727985+0000","last_change":"2024-05-10T11:13:19.727643+0000","last_active":"2024-05-10T11:13:20.727985+0000","last_peered":"2024-05-10T11:13:20.727985+0000","last_clean":"2024-05-10T11:13:20.727985+0000","last_became_active":"2024-05-10T11:13:19.727379+0000","last_became_peered":"2024-05-10T11:13:19.727379+0000","last_unstale":"2024-05-10T11:13:20.727985+0000","last_undegraded":"2024-05-10T11:13:20.727985+0000","last_fullsized":"2024-05-10T11:13:20.727985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.505846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689029+0000","last_change":"2024-05-10T11:13:18.689029+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689029+0000","last_undegraded":"2024-05-10T11:13:18.689029+0000","last_fullsized":"2024-05-10T11:13:18.689029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763926+0000","last_change":"2024-05-10T11:13:19.736103+0000","last_active":"2024-05-10T11:13:20.763926+0000","last_peered":"2024-05-10T11:13:20.763926+0000","last_clean":"2024-05-10T11:13:20.763926+0000","last_became_active":"2024-05-10T11:13:19.735808+0000","last_became_peered":"2024-05-10T11:13:19.735808+0000","last_unstale":"2024-05-10T11:13:20.763926+0000","last_undegraded":"2024-05-10T11:13:20.763926+0000","last_fullsized":"2024-05-10T11:13:20.763926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690230+0000","last_change":"2024-05-10T11:13:18.690230+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690230+0000","last_undegraded":"2024-05-10T11:13:18.690230+0000","last_fullsized":"2024-05-10T11:13:18.690230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734617+0000","last_change":"2024-05-10T11:13:19.728392+0000","last_active":"2024-05-10T11:13:20.734617+0000","last_peered":"2024-05-10T11:13:20.734617+0000","last_clean":"2024-05-10T11:13:20.734617+0000","last_became_active":"2024-05-10T11:13:19.728114+0000","last_became_peered":"2024-05-10T11:13:19.728114+0000","last_unstale":"2024-05-10T11:13:20.734617+0000","last_undegraded":"2024-05-10T11:13:20.734617+0000","last_fullsized":"2024-05-10T11:13:20.734617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689673+0000","last_change":"2024-05-10T11:13:18.689673+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689673+0000","last_undegraded":"2024-05-10T11:13:18.689673+0000","last_fullsized":"2024-05-10T11:13:18.689673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689192+0000","last_change":"2024-05-10T11:13:18.689192+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689192+0000","last_undegraded":"2024-05-10T11:13:18.689192+0000","last_fullsized":"2024-05-10T11:13:18.689192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690641+0000","last_change":"2024-05-10T11:13:18.690641+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690641+0000","last_undegraded":"2024-05-10T11:13:18.690641+0000","last_fullsized":"2024-05-10T11:13:18.690641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763545+0000","last_change":"2024-05-10T11:13:19.740012+0000","last_active":"2024-05-10T11:13:20.763545+0000","last_peered":"2024-05-10T11:13:20.763545+0000","last_clean":"2024-05-10T11:13:20.763545+0000","last_became_active":"2024-05-10T11:13:19.739697+0000","last_became_peered":"2024-05-10T11:13:19.739697+0000","last_unstale":"2024-05-10T11:13:20.763545+0000","last_undegraded":"2024-05-10T11:13:20.763545+0000","last_fullsized":"2024-05-10T11:13:20.763545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:16.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691264+0000","last_change":"2024-05-10T11:13:18.691264+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691264+0000","last_undegraded":"2024-05-10T11:13:18.691264+0000","last_fullsized":"2024-05-10T11:13:18.691264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704247+0000","last_change":"2024-05-10T11:13:18.702772+0000","last_active":"2024-05-10T11:13:18.704247+0000","last_peered":"2024-05-10T11:13:18.704247+0000","last_clean":"2024-05-10T11:13:18.704247+0000","last_became_active":"2024-05-10T11:13:18.702477+0000","last_became_peered":"2024-05-10T11:13:18.702477+0000","last_unstale":"2024-05-10T11:13:18.704247+0000","last_undegraded":"2024-05-10T11:13:18.704247+0000","last_fullsized":"2024-05-10T11:13:18.704247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764207+0000","last_change":"2024-05-10T11:13:19.738117+0000","last_active":"2024-05-10T11:13:20.764207+0000","last_peered":"2024-05-10T11:13:20.764207+0000","last_clean":"2024-05-10T11:13:20.764207+0000","last_became_active":"2024-05-10T11:13:19.737853+0000","last_became_peered":"2024-05-10T11:13:19.737853+0000","last_unstale":"2024-05-10T11:13:20.764207+0000","last_undegraded":"2024-05-10T11:13:20.764207+0000","last_fullsized":"2024-05-10T11:13:20.764207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729137+0000","last_change":"2024-05-10T11:13:18.700836+0000","last_active":"2024-05-10T11:13:20.729137+0000","last_peered":"2024-05-10T11:13:20.729137+0000","last_clean":"2024-05-10T11:13:20.729137+0000","last_became_active":"2024-05-10T11:13:18.700475+0000","last_became_peered":"2024-05-10T11:13:18.700475+0000","last_unstale":"2024-05-10T11:13:20.729137+0000","last_undegraded":"2024-05-10T11:13:20.729137+0000","last_fullsized":"2024-05-10T11:13:20.729137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689669+0000","last_change":"2024-05-10T11:13:18.689669+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689669+0000","last_undegraded":"2024-05-10T11:13:18.689669+0000","last_fullsized":"2024-05-10T11:13:18.689669+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764281+0000","last_change":"2024-05-10T11:13:18.704118+0000","last_active":"2024-05-10T11:13:20.764281+0000","last_peered":"2024-05-10T11:13:20.764281+0000","last_clean":"2024-05-10T11:13:20.764281+0000","last_became_active":"2024-05-10T11:13:18.703845+0000","last_became_peered":"2024-05-10T11:13:18.703845+0000","last_unstale":"2024-05-10T11:13:20.764281+0000","last_undegraded":"2024-05-10T11:13:20.764281+0000","last_fullsized":"2024-05-10T11:13:20.764281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764493+0000","last_change":"2024-05-10T11:13:19.724203+0000","last_active":"2024-05-10T11:13:20.764493+0000","last_peered":"2024-05-10T11:13:20.764493+0000","last_clean":"2024-05-10T11:13:20.764493+0000","last_became_active":"2024-05-10T11:13:19.723950+0000","last_became_peered":"2024-05-10T11:13:19.723950+0000","last_unstale":"2024-05-10T11:13:20.764493+0000","last_undegraded":"2024-05-10T11:13:20.764493+0000","last_fullsized":"2024-05-10T11:13:20.764493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:39.970327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705781+0000","last_change":"2024-05-10T11:13:18.704981+0000","last_active":"2024-05-10T11:13:18.705781+0000","last_peered":"2024-05-10T11:13:18.705781+0000","last_clean":"2024-05-10T11:13:18.705781+0000","last_became_active":"2024-05-10T11:13:18.704637+0000","last_became_peered":"2024-05-10T11:13:18.704637+0000","last_unstale":"2024-05-10T11:13:18.705781+0000","last_undegraded":"2024-05-10T11:13:18.705781+0000","last_fullsized":"2024-05-10T11:13:18.705781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728868+0000","last_change":"2024-05-10T11:13:19.730788+0000","last_active":"2024-05-10T11:13:20.728868+0000","last_peered":"2024-05-10T11:13:20.728868+0000","last_clean":"2024-05-10T11:13:20.728868+0000","last_became_active":"2024-05-10T11:13:19.730539+0000","last_became_peered":"2024-05-10T11:13:19.730539+0000","last_unstale":"2024-05-10T11:13:20.728868+0000","last_undegraded":"2024-05-10T11:13:20.728868+0000","last_fullsized":"2024-05-10T11:13:20.728868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734629+0000","last_change":"2024-05-10T11:13:18.701666+0000","last_active":"2024-05-10T11:13:20.734629+0000","last_peered":"2024-05-10T11:13:20.734629+0000","last_clean":"2024-05-10T11:13:20.734629+0000","last_became_active":"2024-05-10T11:13:18.701440+0000","last_became_peered":"2024-05-10T11:13:18.701440+0000","last_unstale":"2024-05-10T11:13:20.734629+0000","last_undegraded":"2024-05-10T11:13:20.734629+0000","last_fullsized":"2024-05-10T11:13:20.734629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:52.343488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734546+0000","last_change":"2024-05-10T11:13:19.728464+0000","last_active":"2024-05-10T11:13:20.734546+0000","last_peered":"2024-05-10T11:13:20.734546+0000","last_clean":"2024-05-10T11:13:20.734546+0000","last_became_active":"2024-05-10T11:13:19.728193+0000","last_became_peered":"2024-05-10T11:13:19.728193+0000","last_unstale":"2024-05-10T11:13:20.734546+0000","last_undegraded":"2024-05-10T11:13:20.734546+0000","last_fullsized":"2024-05-10T11:13:20.734546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704589+0000","last_change":"2024-05-10T11:13:18.703185+0000","last_active":"2024-05-10T11:13:18.704589+0000","last_peered":"2024-05-10T11:13:18.704589+0000","last_clean":"2024-05-10T11:13:18.704589+0000","last_became_active":"2024-05-10T11:13:18.702911+0000","last_became_peered":"2024-05-10T11:13:18.702911+0000","last_unstale":"2024-05-10T11:13:18.704589+0000","last_undegraded":"2024-05-10T11:13:18.704589+0000","last_fullsized":"2024-05-10T11:13:18.704589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:36.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689164+0000","last_change":"2024-05-10T11:13:18.689164+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689164+0000","last_undegraded":"2024-05-10T11:13:18.689164+0000","last_fullsized":"2024-05-10T11:13:18.689164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763506+0000","last_change":"2024-05-10T11:13:18.699755+0000","last_active":"2024-05-10T11:13:20.763506+0000","last_peered":"2024-05-10T11:13:20.763506+0000","last_clean":"2024-05-10T11:13:20.763506+0000","last_became_active":"2024-05-10T11:13:18.698729+0000","last_became_peered":"2024-05-10T11:13:18.698729+0000","last_unstale":"2024-05-10T11:13:20.763506+0000","last_undegraded":"2024-05-10T11:13:20.763506+0000","last_fullsized":"2024-05-10T11:13:20.763506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763828+0000","last_change":"2024-05-10T11:13:19.725730+0000","last_active":"2024-05-10T11:13:20.763828+0000","last_peered":"2024-05-10T11:13:20.763828+0000","last_clean":"2024-05-10T11:13:20.763828+0000","last_became_active":"2024-05-10T11:13:19.725477+0000","last_became_peered":"2024-05-10T11:13:19.725477+0000","last_unstale":"2024-05-10T11:13:20.763828+0000","last_undegraded":"2024-05-10T11:13:20.763828+0000","last_fullsized":"2024-05-10T11:13:20.763828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700727+0000","last_change":"2024-05-10T11:13:18.695029+0000","last_active":"2024-05-10T11:13:18.700727+0000","last_peered":"2024-05-10T11:13:18.700727+0000","last_clean":"2024-05-10T11:13:18.700727+0000","last_became_active":"2024-05-10T11:13:18.694723+0000","last_became_peered":"2024-05-10T11:13:18.694723+0000","last_unstale":"2024-05-10T11:13:18.700727+0000","last_undegraded":"2024-05-10T11:13:18.700727+0000","last_fullsized":"2024-05-10T11:13:18.700727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728096+0000","last_change":"2024-05-10T11:13:19.733886+0000","last_active":"2024-05-10T11:13:20.728096+0000","last_peered":"2024-05-10T11:13:20.728096+0000","last_clean":"2024-05-10T11:13:20.728096+0000","last_became_active":"2024-05-10T11:13:19.733588+0000","last_became_peered":"2024-05-10T11:13:19.733588+0000","last_unstale":"2024-05-10T11:13:20.728096+0000","last_undegraded":"2024-05-10T11:13:20.728096+0000","last_fullsized":"2024-05-10T11:13:20.728096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.288584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764521+0000","last_change":"2024-05-10T11:13:18.703232+0000","last_active":"2024-05-10T11:13:20.764521+0000","last_peered":"2024-05-10T11:13:20.764521+0000","last_clean":"2024-05-10T11:13:20.764521+0000","last_became_active":"2024-05-10T11:13:18.702937+0000","last_became_peered":"2024-05-10T11:13:18.702937+0000","last_unstale":"2024-05-10T11:13:20.764521+0000","last_undegraded":"2024-05-10T11:13:20.764521+0000","last_fullsized":"2024-05-10T11:13:20.764521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:51.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691955+0000","last_change":"2024-05-10T11:13:18.691955+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691955+0000","last_undegraded":"2024-05-10T11:13:18.691955+0000","last_fullsized":"2024-05-10T11:13:18.691955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734878+0000","last_change":"2024-05-10T11:13:18.700131+0000","last_active":"2024-05-10T11:13:20.734878+0000","last_peered":"2024-05-10T11:13:20.734878+0000","last_clean":"2024-05-10T11:13:20.734878+0000","last_became_active":"2024-05-10T11:13:18.698727+0000","last_became_peered":"2024-05-10T11:13:18.698727+0000","last_unstale":"2024-05-10T11:13:20.734878+0000","last_undegraded":"2024-05-10T11:13:20.734878+0000","last_fullsized":"2024-05-10T11:13:20.734878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:23.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729206+0000","last_change":"2024-05-10T11:13:19.729385+0000","last_active":"2024-05-10T11:13:20.729206+0000","last_peered":"2024-05-10T11:13:20.729206+0000","last_clean":"2024-05-10T11:13:20.729206+0000","last_became_active":"2024-05-10T11:13:19.729088+0000","last_became_peered":"2024-05-10T11:13:19.729088+0000","last_unstale":"2024-05-10T11:13:20.729206+0000","last_undegraded":"2024-05-10T11:13:20.729206+0000","last_fullsized":"2024-05-10T11:13:20.729206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:02.574628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734843+0000","last_change":"2024-05-10T11:13:18.697361+0000","last_active":"2024-05-10T11:13:20.734843+0000","last_peered":"2024-05-10T11:13:20.734843+0000","last_clean":"2024-05-10T11:13:20.734843+0000","last_became_active":"2024-05-10T11:13:18.697069+0000","last_became_peered":"2024-05-10T11:13:18.697069+0000","last_unstale":"2024-05-10T11:13:20.734843+0000","last_undegraded":"2024-05-10T11:13:20.734843+0000","last_fullsized":"2024-05-10T11:13:20.734843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:43.028126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690403+0000","last_change":"2024-05-10T11:13:18.690403+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690403+0000","last_undegraded":"2024-05-10T11:13:18.690403+0000","last_fullsized":"2024-05-10T11:13:18.690403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764452+0000","last_change":"2024-05-10T11:13:18.704317+0000","last_active":"2024-05-10T11:13:20.764452+0000","last_peered":"2024-05-10T11:13:20.764452+0000","last_clean":"2024-05-10T11:13:20.764452+0000","last_became_active":"2024-05-10T11:13:18.704016+0000","last_became_peered":"2024-05-10T11:13:18.704016+0000","last_unstale":"2024-05-10T11:13:20.764452+0000","last_undegraded":"2024-05-10T11:13:20.764452+0000","last_fullsized":"2024-05-10T11:13:20.764452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728896+0000","last_change":"2024-05-10T11:13:19.735706+0000","last_active":"2024-05-10T11:13:20.728896+0000","last_peered":"2024-05-10T11:13:20.728896+0000","last_clean":"2024-05-10T11:13:20.728896+0000","last_became_active":"2024-05-10T11:13:19.734578+0000","last_became_peered":"2024-05-10T11:13:19.734578+0000","last_unstale":"2024-05-10T11:13:20.728896+0000","last_undegraded":"2024-05-10T11:13:20.728896+0000","last_fullsized":"2024-05-10T11:13:20.728896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764164+0000","last_change":"2024-05-10T11:13:18.702219+0000","last_active":"2024-05-10T11:13:20.764164+0000","last_peered":"2024-05-10T11:13:20.764164+0000","last_clean":"2024-05-10T11:13:20.764164+0000","last_became_active":"2024-05-10T11:13:18.701933+0000","last_became_peered":"2024-05-10T11:13:18.701933+0000","last_unstale":"2024-05-10T11:13:20.764164+0000","last_undegraded":"2024-05-10T11:13:20.764164+0000","last_fullsized":"2024-05-10T11:13:20.764164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:38.664408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764507+0000","last_change":"2024-05-10T11:13:19.732843+0000","last_active":"2024-05-10T11:13:20.764507+0000","last_peered":"2024-05-10T11:13:20.764507+0000","last_clean":"2024-05-10T11:13:20.764507+0000","last_became_active":"2024-05-10T11:13:19.732571+0000","last_became_peered":"2024-05-10T11:13:19.732571+0000","last_unstale":"2024-05-10T11:13:20.764507+0000","last_undegraded":"2024-05-10T11:13:20.764507+0000","last_fullsized":"2024-05-10T11:13:20.764507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:23.903648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763464+0000","last_change":"2024-05-10T11:13:18.699460+0000","last_active":"2024-05-10T11:13:20.763464+0000","last_peered":"2024-05-10T11:13:20.763464+0000","last_clean":"2024-05-10T11:13:20.763464+0000","last_became_active":"2024-05-10T11:13:18.699144+0000","last_became_peered":"2024-05-10T11:13:18.699144+0000","last_unstale":"2024-05-10T11:13:20.763464+0000","last_undegraded":"2024-05-10T11:13:20.763464+0000","last_fullsized":"2024-05-10T11:13:20.763464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690745+0000","last_change":"2024-05-10T11:13:18.690745+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690745+0000","last_undegraded":"2024-05-10T11:13:18.690745+0000","last_fullsized":"2024-05-10T11:13:18.690745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705229+0000","last_change":"2024-05-10T11:13:18.703149+0000","last_active":"2024-05-10T11:13:18.705229+0000","last_peered":"2024-05-10T11:13:18.705229+0000","last_clean":"2024-05-10T11:13:18.705229+0000","last_became_active":"2024-05-10T11:13:18.702580+0000","last_became_peered":"2024-05-10T11:13:18.702580+0000","last_unstale":"2024-05-10T11:13:18.705229+0000","last_undegraded":"2024-05-10T11:13:18.705229+0000","last_fullsized":"2024-05-10T11:13:18.705229+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763969+0000","last_change":"2024-05-10T11:13:19.733267+0000","last_active":"2024-05-10T11:13:20.763969+0000","last_peered":"2024-05-10T11:13:20.763969+0000","last_clean":"2024-05-10T11:13:20.763969+0000","last_became_active":"2024-05-10T11:13:19.732862+0000","last_became_peered":"2024-05-10T11:13:19.732862+0000","last_unstale":"2024-05-10T11:13:20.763969+0000","last_undegraded":"2024-05-10T11:13:20.763969+0000","last_fullsized":"2024-05-10T11:13:20.763969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.703353+0000","last_change":"2024-05-10T11:13:18.701542+0000","last_active":"2024-05-10T11:13:18.703353+0000","last_peered":"2024-05-10T11:13:18.703353+0000","last_clean":"2024-05-10T11:13:18.703353+0000","last_became_active":"2024-05-10T11:13:18.701286+0000","last_became_peered":"2024-05-10T11:13:18.701286+0000","last_unstale":"2024-05-10T11:13:18.703353+0000","last_undegraded":"2024-05-10T11:13:18.703353+0000","last_fullsized":"2024-05-10T11:13:18.703353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:44.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764415+0000","last_change":"2024-05-10T11:13:19.718590+0000","last_active":"2024-05-10T11:13:20.764415+0000","last_peered":"2024-05-10T11:13:20.764415+0000","last_clean":"2024-05-10T11:13:20.764415+0000","last_became_active":"2024-05-10T11:13:19.718038+0000","last_became_peered":"2024-05-10T11:13:19.718038+0000","last_unstale":"2024-05-10T11:13:20.764415+0000","last_undegraded":"2024-05-10T11:13:20.764415+0000","last_fullsized":"2024-05-10T11:13:20.764415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734879+0000","last_change":"2024-05-10T11:13:18.693532+0000","last_active":"2024-05-10T11:13:20.734879+0000","last_peered":"2024-05-10T11:13:20.734879+0000","last_clean":"2024-05-10T11:13:20.734879+0000","last_became_active":"2024-05-10T11:13:18.693207+0000","last_became_peered":"2024-05-10T11:13:18.693207+0000","last_unstale":"2024-05-10T11:13:20.734879+0000","last_undegraded":"2024-05-10T11:13:20.734879+0000","last_fullsized":"2024-05-10T11:13:20.734879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734818+0000","last_change":"2024-05-10T11:13:19.729201+0000","last_active":"2024-05-10T11:13:20.734818+0000","last_peered":"2024-05-10T11:13:20.734818+0000","last_clean":"2024-05-10T11:13:20.734818+0000","last_became_active":"2024-05-10T11:13:19.728950+0000","last_became_peered":"2024-05-10T11:13:19.728950+0000","last_unstale":"2024-05-10T11:13:20.734818+0000","last_undegraded":"2024-05-10T11:13:20.734818+0000","last_fullsized":"2024-05-10T11:13:20.734818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700757+0000","last_change":"2024-05-10T11:13:18.694811+0000","last_active":"2024-05-10T11:13:18.700757+0000","last_peered":"2024-05-10T11:13:18.700757+0000","last_clean":"2024-05-10T11:13:18.700757+0000","last_became_active":"2024-05-10T11:13:18.692974+0000","last_became_peered":"2024-05-10T11:13:18.692974+0000","last_unstale":"2024-05-10T11:13:18.700757+0000","last_undegraded":"2024-05-10T11:13:18.700757+0000","last_fullsized":"2024-05-10T11:13:18.700757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688501+0000","last_change":"2024-05-10T11:13:18.688501+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688501+0000","last_undegraded":"2024-05-10T11:13:18.688501+0000","last_fullsized":"2024-05-10T11:13:18.688501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727939+0000","last_change":"2024-05-10T11:13:18.698741+0000","last_active":"2024-05-10T11:13:20.727939+0000","last_peered":"2024-05-10T11:13:20.727939+0000","last_clean":"2024-05-10T11:13:20.727939+0000","last_became_active":"2024-05-10T11:13:18.698440+0000","last_became_peered":"2024-05-10T11:13:18.698440+0000","last_unstale":"2024-05-10T11:13:20.727939+0000","last_undegraded":"2024-05-10T11:13:20.727939+0000","last_fullsized":"2024-05-10T11:13:20.727939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:19:16.570254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.739604+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.739272+0000","last_became_peered":"2024-05-10T11:13:19.739272+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:33.487420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763735+0000","last_change":"2024-05-10T11:13:18.703465+0000","last_active":"2024-05-10T11:13:20.763735+0000","last_peered":"2024-05-10T11:13:20.763735+0000","last_clean":"2024-05-10T11:13:20.763735+0000","last_became_active":"2024-05-10T11:13:18.702762+0000","last_became_peered":"2024-05-10T11:13:18.702762+0000","last_unstale":"2024-05-10T11:13:20.763735+0000","last_undegraded":"2024-05-10T11:13:20.763735+0000","last_fullsized":"2024-05-10T11:13:20.763735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:10.813728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690588+0000","last_change":"2024-05-10T11:13:18.690588+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690588+0000","last_undegraded":"2024-05-10T11:13:18.690588+0000","last_fullsized":"2024-05-10T11:13:18.690588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727850+0000","last_change":"2024-05-10T11:13:18.702301+0000","last_active":"2024-05-10T11:13:20.727850+0000","last_peered":"2024-05-10T11:13:20.727850+0000","last_clean":"2024-05-10T11:13:20.727850+0000","last_became_active":"2024-05-10T11:13:18.702020+0000","last_became_peered":"2024-05-10T11:13:18.702020+0000","last_unstale":"2024-05-10T11:13:20.727850+0000","last_undegraded":"2024-05-10T11:13:20.727850+0000","last_fullsized":"2024-05-10T11:13:20.727850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:23.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728994+0000","last_change":"2024-05-10T11:13:19.730034+0000","last_active":"2024-05-10T11:13:20.728994+0000","last_peered":"2024-05-10T11:13:20.728994+0000","last_clean":"2024-05-10T11:13:20.728994+0000","last_became_active":"2024-05-10T11:13:19.729784+0000","last_became_peered":"2024-05-10T11:13:19.729784+0000","last_unstale":"2024-05-10T11:13:20.728994+0000","last_undegraded":"2024-05-10T11:13:20.728994+0000","last_fullsized":"2024-05-10T11:13:20.728994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727817+0000","last_change":"2024-05-10T11:13:18.703123+0000","last_active":"2024-05-10T11:13:20.727817+0000","last_peered":"2024-05-10T11:13:20.727817+0000","last_clean":"2024-05-10T11:13:20.727817+0000","last_became_active":"2024-05-10T11:13:18.702855+0000","last_became_peered":"2024-05-10T11:13:18.702855+0000","last_unstale":"2024-05-10T11:13:20.727817+0000","last_undegraded":"2024-05-10T11:13:20.727817+0000","last_fullsized":"2024-05-10T11:13:20.727817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:55.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734500+0000","last_change":"2024-05-10T11:13:19.723348+0000","last_active":"2024-05-10T11:13:20.734500+0000","last_peered":"2024-05-10T11:13:20.734500+0000","last_clean":"2024-05-10T11:13:20.734500+0000","last_became_active":"2024-05-10T11:13:19.723074+0000","last_became_peered":"2024-05-10T11:13:19.723074+0000","last_unstale":"2024-05-10T11:13:20.734500+0000","last_undegraded":"2024-05-10T11:13:20.734500+0000","last_fullsized":"2024-05-10T11:13:20.734500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:34.461837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700305+0000","last_change":"2024-05-10T11:13:18.698251+0000","last_active":"2024-05-10T11:13:18.700305+0000","last_peered":"2024-05-10T11:13:18.700305+0000","last_clean":"2024-05-10T11:13:18.700305+0000","last_became_active":"2024-05-10T11:13:18.697970+0000","last_became_peered":"2024-05-10T11:13:18.697970+0000","last_unstale":"2024-05-10T11:13:18.700305+0000","last_undegraded":"2024-05-10T11:13:18.700305+0000","last_fullsized":"2024-05-10T11:13:18.700305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:31.620398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764112+0000","last_change":"2024-05-10T11:13:19.725035+0000","last_active":"2024-05-10T11:13:20.764112+0000","last_peered":"2024-05-10T11:13:20.764112+0000","last_clean":"2024-05-10T11:13:20.764112+0000","last_became_active":"2024-05-10T11:13:19.724781+0000","last_became_peered":"2024-05-10T11:13:19.724781+0000","last_unstale":"2024-05-10T11:13:20.764112+0000","last_undegraded":"2024-05-10T11:13:20.764112+0000","last_fullsized":"2024-05-10T11:13:20.764112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727630+0000","last_change":"2024-05-10T11:13:18.703414+0000","last_active":"2024-05-10T11:13:20.727630+0000","last_peered":"2024-05-10T11:13:20.727630+0000","last_clean":"2024-05-10T11:13:20.727630+0000","last_became_active":"2024-05-10T11:13:18.702852+0000","last_became_peered":"2024-05-10T11:13:18.702852+0000","last_unstale":"2024-05-10T11:13:20.727630+0000","last_undegraded":"2024-05-10T11:13:20.727630+0000","last_fullsized":"2024-05-10T11:13:20.727630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:34.714357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763678+0000","last_change":"2024-05-10T11:13:19.736920+0000","last_active":"2024-05-10T11:13:20.763678+0000","last_peered":"2024-05-10T11:13:20.763678+0000","last_clean":"2024-05-10T11:13:20.763678+0000","last_became_active":"2024-05-10T11:13:19.736619+0000","last_became_peered":"2024-05-10T11:13:19.736619+0000","last_unstale":"2024-05-10T11:13:20.763678+0000","last_undegraded":"2024-05-10T11:13:20.763678+0000","last_fullsized":"2024-05-10T11:13:20.763678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734954+0000","last_change":"2024-05-10T11:13:18.696813+0000","last_active":"2024-05-10T11:13:20.734954+0000","last_peered":"2024-05-10T11:13:20.734954+0000","last_clean":"2024-05-10T11:13:20.734954+0000","last_became_active":"2024-05-10T11:13:18.696527+0000","last_became_peered":"2024-05-10T11:13:18.696527+0000","last_unstale":"2024-05-10T11:13:20.734954+0000","last_undegraded":"2024-05-10T11:13:20.734954+0000","last_fullsized":"2024-05-10T11:13:20.734954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691526+0000","last_change":"2024-05-10T11:13:18.691526+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691526+0000","last_undegraded":"2024-05-10T11:13:18.691526+0000","last_fullsized":"2024-05-10T11:13:18.691526+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728077+0000","last_change":"2024-05-10T11:13:18.699474+0000","last_active":"2024-05-10T11:13:20.728077+0000","last_peered":"2024-05-10T11:13:20.728077+0000","last_clean":"2024-05-10T11:13:20.728077+0000","last_became_active":"2024-05-10T11:13:18.699197+0000","last_became_peered":"2024-05-10T11:13:18.699197+0000","last_unstale":"2024-05-10T11:13:20.728077+0000","last_undegraded":"2024-05-10T11:13:20.728077+0000","last_fullsized":"2024-05-10T11:13:20.728077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:03:28.008509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764106+0000","last_change":"2024-05-10T11:13:19.727718+0000","last_active":"2024-05-10T11:13:20.764106+0000","last_peered":"2024-05-10T11:13:20.764106+0000","last_clean":"2024-05-10T11:13:20.764106+0000","last_became_active":"2024-05-10T11:13:19.727454+0000","last_became_peered":"2024-05-10T11:13:19.727454+0000","last_unstale":"2024-05-10T11:13:20.764106+0000","last_undegraded":"2024-05-10T11:13:20.764106+0000","last_fullsized":"2024-05-10T11:13:20.764106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729121+0000","last_change":"2024-05-10T11:13:18.701654+0000","last_active":"2024-05-10T11:13:20.729121+0000","last_peered":"2024-05-10T11:13:20.729121+0000","last_clean":"2024-05-10T11:13:20.729121+0000","last_became_active":"2024-05-10T11:13:18.701372+0000","last_became_peered":"2024-05-10T11:13:18.701372+0000","last_unstale":"2024-05-10T11:13:20.729121+0000","last_undegraded":"2024-05-10T11:13:20.729121+0000","last_fullsized":"2024-05-10T11:13:20.729121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729040+0000","last_change":"2024-05-10T11:13:19.738281+0000","last_active":"2024-05-10T11:13:20.729040+0000","last_peered":"2024-05-10T11:13:20.729040+0000","last_clean":"2024-05-10T11:13:20.729040+0000","last_became_active":"2024-05-10T11:13:19.738024+0000","last_became_peered":"2024-05-10T11:13:19.738024+0000","last_unstale":"2024-05-10T11:13:20.729040+0000","last_undegraded":"2024-05-10T11:13:20.729040+0000","last_fullsized":"2024-05-10T11:13:20.729040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:05.391289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729085+0000","last_change":"2024-05-10T11:13:18.699063+0000","last_active":"2024-05-10T11:13:20.729085+0000","last_peered":"2024-05-10T11:13:20.729085+0000","last_clean":"2024-05-10T11:13:20.729085+0000","last_became_active":"2024-05-10T11:13:18.698161+0000","last_became_peered":"2024-05-10T11:13:18.698161+0000","last_unstale":"2024-05-10T11:13:20.729085+0000","last_undegraded":"2024-05-10T11:13:20.729085+0000","last_fullsized":"2024-05-10T11:13:20.729085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763552+0000","last_change":"2024-05-10T11:13:19.727035+0000","last_active":"2024-05-10T11:13:20.763552+0000","last_peered":"2024-05-10T11:13:20.763552+0000","last_clean":"2024-05-10T11:13:20.763552+0000","last_became_active":"2024-05-10T11:13:19.726701+0000","last_became_peered":"2024-05-10T11:13:19.726701+0000","last_unstale":"2024-05-10T11:13:20.763552+0000","last_undegraded":"2024-05-10T11:13:20.763552+0000","last_fullsized":"2024-05-10T11:13:20.763552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:26.394487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704029+0000","last_change":"2024-05-10T11:13:18.701428+0000","last_active":"2024-05-10T11:13:18.704029+0000","last_peered":"2024-05-10T11:13:18.704029+0000","last_clean":"2024-05-10T11:13:18.704029+0000","last_became_active":"2024-05-10T11:13:18.701155+0000","last_became_peered":"2024-05-10T11:13:18.701155+0000","last_unstale":"2024-05-10T11:13:18.704029+0000","last_undegraded":"2024-05-10T11:13:18.704029+0000","last_fullsized":"2024-05-10T11:13:18.704029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:15.935603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688495+0000","last_change":"2024-05-10T11:13:18.688495+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688495+0000","last_undegraded":"2024-05-10T11:13:18.688495+0000","last_fullsized":"2024-05-10T11:13:18.688495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.701773+0000","last_change":"2024-05-10T11:13:18.699343+0000","last_active":"2024-05-10T11:13:18.701773+0000","last_peered":"2024-05-10T11:13:18.701773+0000","last_clean":"2024-05-10T11:13:18.701773+0000","last_became_active":"2024-05-10T11:13:18.699076+0000","last_became_peered":"2024-05-10T11:13:18.699076+0000","last_unstale":"2024-05-10T11:13:18.701773+0000","last_undegraded":"2024-05-10T11:13:18.701773+0000","last_fullsized":"2024-05-10T11:13:18.701773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:13.688833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690102+0000","last_change":"2024-05-10T11:13:18.690102+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690102+0000","last_undegraded":"2024-05-10T11:13:18.690102+0000","last_fullsized":"2024-05-10T11:13:18.690102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764082+0000","last_change":"2024-05-10T11:13:18.702463+0000","last_active":"2024-05-10T11:13:20.764082+0000","last_peered":"2024-05-10T11:13:20.764082+0000","last_clean":"2024-05-10T11:13:20.764082+0000","last_became_active":"2024-05-10T11:13:18.702201+0000","last_became_peered":"2024-05-10T11:13:18.702201+0000","last_unstale":"2024-05-10T11:13:20.764082+0000","last_undegraded":"2024-05-10T11:13:20.764082+0000","last_fullsized":"2024-05-10T11:13:20.764082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734809+0000","last_change":"2024-05-10T11:13:19.735527+0000","last_active":"2024-05-10T11:13:20.734809+0000","last_peered":"2024-05-10T11:13:20.734809+0000","last_clean":"2024-05-10T11:13:20.734809+0000","last_became_active":"2024-05-10T11:13:19.734366+0000","last_became_peered":"2024-05-10T11:13:19.734366+0000","last_unstale":"2024-05-10T11:13:20.734809+0000","last_undegraded":"2024-05-10T11:13:20.734809+0000","last_fullsized":"2024-05-10T11:13:20.734809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.699619+0000","last_change":"2024-05-10T11:13:18.696982+0000","last_active":"2024-05-10T11:13:18.699619+0000","last_peered":"2024-05-10T11:13:18.699619+0000","last_clean":"2024-05-10T11:13:18.699619+0000","last_became_active":"2024-05-10T11:13:18.696733+0000","last_became_peered":"2024-05-10T11:13:18.696733+0000","last_unstale":"2024-05-10T11:13:18.699619+0000","last_undegraded":"2024-05-10T11:13:18.699619+0000","last_fullsized":"2024-05-10T11:13:18.699619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.692315+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:18.692315+0000","last_peered":"2024-05-10T11:13:18.692315+0000","last_clean":"2024-05-10T11:13:18.692315+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:18.692315+0000","last_undegraded":"2024-05-10T11:13:18.692315+0000","last_fullsized":"2024-05-10T11:13:18.692315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":747748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":157380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":164047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":179552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":768308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":178018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:13:24.509 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-05-10T11:13:24.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.692849+0000', 'last_change': '2024-05-10T11:13:18.692849+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.692849+0000', 'last_undegraded': '2024-05-10T11:13:18.692849+0000', 'last_fullsized': '2024-05-10T11:13:18.692849+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.509 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.692041+0000', 'last_change': '2024-05-10T11:13:18.692041+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.692041+0000', 'last_undegraded': '2024-05-10T11:13:18.692041+0000', 'last_fullsized': '2024-05-10T11:13:18.692041+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690905+0000', 'last_change': '2024-05-10T11:13:18.690905+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690905+0000', 'last_undegraded': '2024-05-10T11:13:18.690905+0000', 'last_fullsized': '2024-05-10T11:13:18.690905+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690085+0000', 'last_change': '2024-05-10T11:13:18.690085+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690085+0000', 'last_undegraded': '2024-05-10T11:13:18.690085+0000', 'last_fullsized': '2024-05-10T11:13:18.690085+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.691010+0000', 'last_change': '2024-05-10T11:13:18.691010+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.691010+0000', 'last_undegraded': '2024-05-10T11:13:18.691010+0000', 'last_fullsized': '2024-05-10T11:13:18.691010+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.691731+0000', 'last_change': '2024-05-10T11:13:18.691731+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.691731+0000', 'last_undegraded': '2024-05-10T11:13:18.691731+0000', 'last_fullsized': '2024-05-10T11:13:18.691731+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.510 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.692089+0000', 'last_change': '2024-05-10T11:13:18.692089+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.692089+0000', 'last_undegraded': '2024-05-10T11:13:18.692089+0000', 'last_fullsized': '2024-05-10T11:13:18.692089+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.689029+0000', 'last_change': '2024-05-10T11:13:18.689029+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.689029+0000', 'last_undegraded': '2024-05-10T11:13:18.689029+0000', 'last_fullsized': '2024-05-10T11:13:18.689029+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690230+0000', 'last_change': '2024-05-10T11:13:18.690230+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690230+0000', 'last_undegraded': '2024-05-10T11:13:18.690230+0000', 'last_fullsized': '2024-05-10T11:13:18.690230+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.689673+0000', 'last_change': '2024-05-10T11:13:18.689673+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.689673+0000', 'last_undegraded': '2024-05-10T11:13:18.689673+0000', 'last_fullsized': '2024-05-10T11:13:18.689673+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.689192+0000', 'last_change': '2024-05-10T11:13:18.689192+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.689192+0000', 'last_undegraded': '2024-05-10T11:13:18.689192+0000', 'last_fullsized': '2024-05-10T11:13:18.689192+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-05-10T11:13:24.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690641+0000', 'last_change': '2024-05-10T11:13:18.690641+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690641+0000', 'last_undegraded': '2024-05-10T11:13:18.690641+0000', 'last_fullsized': '2024-05-10T11:13:18.690641+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.691264+0000', 'last_change': '2024-05-10T11:13:18.691264+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.691264+0000', 'last_undegraded': '2024-05-10T11:13:18.691264+0000', 'last_fullsized': '2024-05-10T11:13:18.691264+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.689669+0000', 'last_change': '2024-05-10T11:13:18.689669+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.689669+0000', 'last_undegraded': '2024-05-10T11:13:18.689669+0000', 'last_fullsized': '2024-05-10T11:13:18.689669+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.689164+0000', 'last_change': '2024-05-10T11:13:18.689164+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.689164+0000', 'last_undegraded': '2024-05-10T11:13:18.689164+0000', 'last_fullsized': '2024-05-10T11:13:18.689164+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.691955+0000', 'last_change': '2024-05-10T11:13:18.691955+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.691955+0000', 'last_undegraded': '2024-05-10T11:13:18.691955+0000', 'last_fullsized': '2024-05-10T11:13:18.691955+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690403+0000', 'last_change': '2024-05-10T11:13:18.690403+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690403+0000', 'last_undegraded': '2024-05-10T11:13:18.690403+0000', 'last_fullsized': '2024-05-10T11:13:18.690403+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.512 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690745+0000', 'last_change': '2024-05-10T11:13:18.690745+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690745+0000', 'last_undegraded': '2024-05-10T11:13:18.690745+0000', 'last_fullsized': '2024-05-10T11:13:18.690745+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.688501+0000', 'last_change': '2024-05-10T11:13:18.688501+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.688501+0000', 'last_undegraded': '2024-05-10T11:13:18.688501+0000', 'last_fullsized': '2024-05-10T11:13:18.688501+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690588+0000', 'last_change': '2024-05-10T11:13:18.690588+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690588+0000', 'last_undegraded': '2024-05-10T11:13:18.690588+0000', 'last_fullsized': '2024-05-10T11:13:18.690588+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.691526+0000', 'last_change': '2024-05-10T11:13:18.691526+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.691526+0000', 'last_undegraded': '2024-05-10T11:13:18.691526+0000', 'last_fullsized': '2024-05-10T11:13:18.691526+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.688495+0000', 'last_change': '2024-05-10T11:13:18.688495+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.688495+0000', 'last_undegraded': '2024-05-10T11:13:18.688495+0000', 'last_fullsized': '2024-05-10T11:13:18.688495+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-05-10T11:13:24.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:18.690102+0000', 'last_change': '2024-05-10T11:13:18.690102+0000', 'last_active': '2024-05-10T11:13:18.679936+0000', 'last_peered': '2024-05-10T11:13:18.679936+0000', 'last_clean': '2024-05-10T11:13:18.679936+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:18.690102+0000', 'last_undegraded': '2024-05-10T11:13:18.690102+0000', 'last_fullsized': '2024-05-10T11:13:18.690102+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:18.679936+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:13:24.514 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T11:13:24.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.650+0000 7f5765186640 1 Processor -- start 2024-05-10T11:13:24.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.650+0000 7f5765186640 1 -- start start 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f5765186640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 0x7f57600b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f5765186640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f57600d3d80 0x7f57600d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f5765186640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57600d2d20 con 0x7f57600d59d0 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f5765186640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5760162d20 con 0x7f57600d3d80 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f5765186640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57600d3000 con 0x7f5760162940 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575e59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f57600d59d0 0x7f57600d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49396/0 (socket says 172.21.15.66:49396) 2024-05-10T11:13:24.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575e59c640 1 -- 172.21.15.66:0/2047535190 learned_addr learned my addr 172.21.15.66:0/2047535190 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575ed9d640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 0x7f57600b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575f59e640 1 --2- 172.21.15.66:0/2047535190 >> v2:172.21.15.190:3300/0 conn(0x7f57600d3d80 0x7f57600d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609245837 0 0) 0x7f57600d2d20 con 0x7f57600d59d0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5748003520 con 0x7f57600d59d0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817156347 0 0) 0x7f5748003520 con 0x7f57600d59d0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 msgr2=0x7f57600b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 0x7f57600b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 >> v2:172.21.15.190:3300/0 conn(0x7f57600d3d80 msgr2=0x7f57600d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 --2- 172.21.15.66:0/2047535190 >> v2:172.21.15.190:3300/0 conn(0x7f57600d3d80 0x7f57600d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57600d32e0 con 0x7f57600d59d0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f5754001670 con 0x7f57600d59d0 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 >> v1:172.21.15.66:6789/0 conn(0x7f57600d59d0 legacy=0x7f57600d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5748003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.651+0000 7f575dd9b640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 0x7f5748004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575dd9b640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5748004d40 0x7f57480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57600d3000 con 0x7f57480039b0 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f574800b9c0 con 0x7f5748004d40 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f574800bb40 con 0x7f5760162940 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575ed9d640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5748003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575e59c640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 0x7f5748004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575f59e640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5748004d40 0x7f57480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575ed9d640 1 -- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 msgr2=0x7f5748004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575ed9d640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760162940 0x7f5748004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575ed9d640 1 -- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5748004d40 msgr2=0x7f57480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575ed9d640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5748004d40 0x7f57480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575ed9d640 1 -- 172.21.15.66:0/2047535190 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5748003520 con 0x7f57480039b0 2024-05-10T11:13:24.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.652+0000 7f575f59e640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5748004d40 0x7f57480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f575ed9d640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5748003dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5750009ac0 tx=0x7f5748005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaed00bb2fe4a392 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750036070 con 0x7f57480039b0 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5750031400 con 0x7f57480039b0 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f575dd9b640 1 -- 172.21.15.66:0/2047535190 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750009690 con 0x7f57480039b0 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f5765186640 1 -- 172.21.15.66:0/2047535190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 msgr2=0x7f5748003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f5765186640 1 --2- 172.21.15.66:0/2047535190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5748003dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5750009ac0 tx=0x7f5748005830 comp rx=0 tx=0).stop 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f575f59e640 1 -- 172.21.15.66:0/2047535190 reap_dead start 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f5765186640 1 -- 172.21.15.66:0/2047535190 shutdown_connections 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f5765186640 1 -- 172.21.15.66:0/2047535190 >> 172.21.15.66:0/2047535190 conn(0x7f576009e380 msgr2=0x7f57600d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f5765186640 1 -- 172.21.15.66:0/2047535190 shutdown_connections 2024-05-10T11:13:24.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.653+0000 7f5765186640 1 -- 172.21.15.66:0/2047535190 wait complete. 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.655+0000 7f5765186640 1 Processor -- start 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.655+0000 7f5765186640 1 -- start start 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5760152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760160890 0x7f5760160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5760162d20 0x7f57601631d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57600d2390 con 0x7f57480039b0 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57600cfc50 con 0x7f5760162d20 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57600d2510 con 0x7f5760160890 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5760152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5760152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47068/0 (socket says 172.21.15.66:47068) 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 -- 172.21.15.66:0/1361418811 learned_addr learned my addr 172.21.15.66:0/1361418811 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 -- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760160890 msgr2=0x7f5760160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760160890 0x7f5760160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 -- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5760162d20 msgr2=0x7f57601631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5760162d20 0x7f57601631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 -- 172.21.15.66:0/1361418811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5760161350 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f575ed9d640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5760152740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5750034040 tx=0x7f5750004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750040020 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5750003b40 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750036040 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576015e880 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.656+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576015ee40 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.658+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576015e670 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.658+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5750043020 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.659+0000 7f57477fe640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f574c0762d0 0x7f574c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.659+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f57500b7850 con 0x7f57480039b0 2024-05-10T11:13:24.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.659+0000 7f575e59c640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f574c0762d0 0x7f574c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:24.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.659+0000 7f575e59c640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f574c0762d0 0x7f574c078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5754001050 tx=0x7f5754000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:24.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.663+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f575004a070 con 0x7f57480039b0 2024-05-10T11:13:24.672 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:13:24.673+0000 7fbaa670d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:13:24.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.930+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f576006a220 con 0x7f57480039b0 2024-05-10T11:13:24.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.931+0000 7f57477fe640 1 -- 172.21.15.66:0/1361418811 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1646 (secure 0 0 0) 0x7f57500044e0 con 0x7f57480039b0 2024-05-10T11:13:24.930 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:24.930 INFO:teuthology.orchestra.run.smithi066.stdout:{"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":77,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1715339538,"num_in_osds":8,"osd_in_since":1715339529,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"creating+peering","count":23}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":592196,"bytes_used":225837056,"bytes_avail":772868276224,"bytes_total":773094113280,"inactive_pgs_ratio":0.23711340129375458,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4920}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-05-10T11:13:19.695962+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T11:13:24.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f574c0762d0 msgr2=0x7f574c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f574c0762d0 0x7f574c078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5754001050 tx=0x7f5754000fe0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 msgr2=0x7f5760152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5760152740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5750034040 tx=0x7f5750004730 comp rx=0 tx=0).stop 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 shutdown_connections 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f574c0762d0 0x7f574c078790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5760162d20 0x7f57601631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5760160890 0x7f5760160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 --2- 172.21.15.66:0/1361418811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57480039b0 0x7f5760152740 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 >> 172.21.15.66:0/1361418811 conn(0x7f576009e380 msgr2=0x7f57600d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 shutdown_connections 2024-05-10T11:13:24.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:24.933+0000 7f5765186640 1 -- 172.21.15.66:0/1361418811 wait complete. 2024-05-10T11:13:24.943 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T11:13:24.944 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:13:25.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.047+0000 7f59f78a0640 1 Processor -- start 2024-05-10T11:13:25.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.047+0000 7f59f78a0640 1 -- start start 2024-05-10T11:13:25.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f78a0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f59f00d1aa0 0x7f59f00d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:25.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f78a0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59f00d3340 0x7f59f00ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:25.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f78a0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f0072330 con 0x7f59f015d290 2024-05-10T11:13:25.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f78a0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f59f00d37d0 con 0x7f59f00d3340 2024-05-10T11:13:25.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f78a0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f59f0071d70 con 0x7f59f00d1aa0 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f5e3d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59f00d3340 0x7f59f00ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f5e3d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59f00d3340 0x7f59f00ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47082/0 (socket says 172.21.15.66:47082) 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.048+0000 7f59f5e3d640 1 -- 172.21.15.66:0/137070387 learned_addr learned my addr 172.21.15.66:0/137070387 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.049+0000 7f59f4e3b640 1 --2- 172.21.15.66:0/137070387 >> v2:172.21.15.190:3300/0 conn(0x7f59f00d1aa0 0x7f59f00d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.049+0000 7f59f5e3d640 1 -- 172.21.15.66:0/137070387 >> v2:172.21.15.190:3300/0 conn(0x7f59f00d1aa0 msgr2=0x7f59f00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.049+0000 7f59f5e3d640 1 --2- 172.21.15.66:0/137070387 >> v2:172.21.15.190:3300/0 conn(0x7f59f00d1aa0 0x7f59f00d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.049+0000 7f59f5e3d640 1 -- 172.21.15.66:0/137070387 >> v1:172.21.15.190:6789/0 conn(0x7f59f015d290 legacy=0x7f59f0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.049+0000 7f59f5e3d640 1 -- 172.21.15.66:0/137070387 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f0072050 con 0x7f59f00d3340 2024-05-10T11:13:25.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.049+0000 7f59f4e3b640 1 --2- 172.21.15.66:0/137070387 >> v2:172.21.15.190:3300/0 conn(0x7f59f00d1aa0 0x7f59f00d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:25.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f5e3d640 1 --2- 172.21.15.66:0/137070387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00ce270 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f59f006d220 tx=0x7f59e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf82e9ce597f12d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:25.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59effff640 1 -- 172.21.15.66:0/137070387 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8037070 con 0x7f59f00d3340 2024-05-10T11:13:25.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59effff640 1 -- 172.21.15.66:0/137070387 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e8032440 con 0x7f59f00d3340 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59effff640 1 -- 172.21.15.66:0/137070387 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8032810 con 0x7f59f00d3340 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 -- 172.21.15.66:0/137070387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 msgr2=0x7f59f00ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 --2- 172.21.15.66:0/137070387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00ce270 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f59f006d220 tx=0x7f59e802a270 comp rx=0 tx=0).stop 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 -- 172.21.15.66:0/137070387 shutdown_connections 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 --2- 172.21.15.66:0/137070387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00ce270 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 --2- 172.21.15.66:0/137070387 >> v2:172.21.15.190:3300/0 conn(0x7f59f00d1aa0 0x7f59f00d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 -- 172.21.15.66:0/137070387 >> 172.21.15.66:0/137070387 conn(0x7f59f009ba20 msgr2=0x7f59f009be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 -- 172.21.15.66:0/137070387 shutdown_connections 2024-05-10T11:13:25.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.050+0000 7f59f78a0640 1 -- 172.21.15.66:0/137070387 wait complete. 2024-05-10T11:13:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 Processor -- start 2024-05-10T11:13:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 -- start start 2024-05-10T11:13:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59f00d1aa0 0x7f59f00c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59f015d290 0x7f59f01f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59f0071a50 con 0x7f59f00d3340 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00cdd50 con 0x7f59f00d1aa0 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f78a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f59f00ce7b0 con 0x7f59f015d290 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f4e3b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f4e3b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47098/0 (socket says 172.21.15.66:47098) 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.052+0000 7f59f4e3b640 1 -- 172.21.15.66:0/2907818239 learned_addr learned my addr 172.21.15.66:0/2907818239 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f563c640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59f00d1aa0 0x7f59f00c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f5e3d640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59f015d290 0x7f59f01f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f4e3b640 1 -- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59f015d290 msgr2=0x7f59f01f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f4e3b640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59f015d290 0x7f59f01f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f4e3b640 1 -- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59f00d1aa0 msgr2=0x7f59f00c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f4e3b640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59f00d1aa0 0x7f59f00c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f4e3b640 1 -- 172.21.15.66:0/2907818239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00c7420 con 0x7f59f00d3340 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f5e3d640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59f015d290 0x7f59f01f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f4e3b640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00c6ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f59e400e810 tx=0x7f59e400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:25.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e400f040 con 0x7f59f00d3340 2024-05-10T11:13:25.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e4004030 con 0x7f59f00d3340 2024-05-10T11:13:25.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f00c7700 con 0x7f59f00d3340 2024-05-10T11:13:25.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4004400 con 0x7f59f00d3340 2024-05-10T11:13:25.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.053+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f00c7cc0 con 0x7f59f00d3340 2024-05-10T11:13:25.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.054+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f00693f0 con 0x7f59f00d3340 2024-05-10T11:13:25.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.055+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f59e400c6d0 con 0x7f59f00d3340 2024-05-10T11:13:25.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.056+0000 7f59edffb640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59dc076300 0x7f59dc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:25.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.056+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f59e40973c0 con 0x7f59f00d3340 2024-05-10T11:13:25.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.056+0000 7f59f563c640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59dc076300 0x7f59dc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:25.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.057+0000 7f59f563c640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59dc076300 0x7f59dc0787c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59e0001c80 tx=0x7f59e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:25.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.060+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f59e4017020 con 0x7f59f00d3340 2024-05-10T11:13:25.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.250+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59f00d1120 con 0x7f59dc076300 2024-05-10T11:13:25.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.257+0000 7f59edffb640 1 -- 172.21.15.66:0/2907818239 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250038 (secure 0 0 0) 0x7f59f00d1120 con 0x7f59dc076300 2024-05-10T11:13:25.258 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:25.260 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:13:25.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59dc076300 msgr2=0x7f59dc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:25.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59dc076300 0x7f59dc0787c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59e0001c80 tx=0x7f59e0009040 comp rx=0 tx=0).stop 2024-05-10T11:13:25.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 msgr2=0x7f59f00c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00c6ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f59e400e810 tx=0x7f59e400ecd0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 shutdown_connections 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59dc076300 0x7f59dc0787c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59f015d290 0x7f59f01f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f00d3340 0x7f59f00c6ce0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 --2- 172.21.15.66:0/2907818239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59f00d1aa0 0x7f59f00c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 >> 172.21.15.66:0/2907818239 conn(0x7f59f009ba20 msgr2=0x7f59f00b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 shutdown_connections 2024-05-10T11:13:25.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:25.260+0000 7f59f78a0640 1 -- 172.21.15.66:0/2907818239 wait complete. 2024-05-10T11:13:25.270 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-10T11:13:23.696740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220544,"kb_used_data":4364,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754176,"statfs":{"total":773094113280,"available":772868276224,"internally_reserved":0,"allocated":4468736,"data_stored":2551025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001475"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764580+0000","last_change":"2024-05-10T11:13:19.732597+0000","last_active":"2024-05-10T11:13:20.764580+0000","last_peered":"2024-05-10T11:13:20.764580+0000","last_clean":"2024-05-10T11:13:20.764580+0000","last_became_active":"2024-05-10T11:13:19.732175+0000","last_became_peered":"2024-05-10T11:13:19.732175+0000","last_unstale":"2024-05-10T11:13:20.764580+0000","last_undegraded":"2024-05-10T11:13:20.764580+0000","last_fullsized":"2024-05-10T11:13:20.764580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:36.288762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763960+0000","last_change":"2024-05-10T11:13:19.739881+0000","last_active":"2024-05-10T11:13:20.763960+0000","last_peered":"2024-05-10T11:13:20.763960+0000","last_clean":"2024-05-10T11:13:20.763960+0000","last_became_active":"2024-05-10T11:13:19.739453+0000","last_became_peered":"2024-05-10T11:13:19.739453+0000","last_unstale":"2024-05-10T11:13:20.763960+0000","last_undegraded":"2024-05-10T11:13:20.763960+0000","last_fullsized":"2024-05-10T11:13:20.763960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729120+0000","last_change":"2024-05-10T11:13:19.733275+0000","last_active":"2024-05-10T11:13:20.729120+0000","last_peered":"2024-05-10T11:13:20.729120+0000","last_clean":"2024-05-10T11:13:20.729120+0000","last_became_active":"2024-05-10T11:13:19.732987+0000","last_became_peered":"2024-05-10T11:13:19.732987+0000","last_unstale":"2024-05-10T11:13:20.729120+0000","last_undegraded":"2024-05-10T11:13:20.729120+0000","last_fullsized":"2024-05-10T11:13:20.729120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:56.702776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728116+0000","last_change":"2024-05-10T11:13:19.733990+0000","last_active":"2024-05-10T11:13:20.728116+0000","last_peered":"2024-05-10T11:13:20.728116+0000","last_clean":"2024-05-10T11:13:20.728116+0000","last_became_active":"2024-05-10T11:13:19.733699+0000","last_became_peered":"2024-05-10T11:13:19.733699+0000","last_unstale":"2024-05-10T11:13:20.728116+0000","last_undegraded":"2024-05-10T11:13:20.728116+0000","last_fullsized":"2024-05-10T11:13:20.728116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:11.815701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.732957+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.732674+0000","last_became_peered":"2024-05-10T11:13:19.732674+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:46.137307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763665+0000","last_change":"2024-05-10T11:13:19.738793+0000","last_active":"2024-05-10T11:13:20.763665+0000","last_peered":"2024-05-10T11:13:20.763665+0000","last_clean":"2024-05-10T11:13:20.763665+0000","last_became_active":"2024-05-10T11:13:19.738522+0000","last_became_peered":"2024-05-10T11:13:19.738522+0000","last_unstale":"2024-05-10T11:13:20.763665+0000","last_undegraded":"2024-05-10T11:13:20.763665+0000","last_fullsized":"2024-05-10T11:13:20.763665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734297+0000","last_change":"2024-05-10T11:13:19.727429+0000","last_active":"2024-05-10T11:13:20.734297+0000","last_peered":"2024-05-10T11:13:20.734297+0000","last_clean":"2024-05-10T11:13:20.734297+0000","last_became_active":"2024-05-10T11:13:19.727146+0000","last_became_peered":"2024-05-10T11:13:19.727146+0000","last_unstale":"2024-05-10T11:13:20.734297+0000","last_undegraded":"2024-05-10T11:13:20.734297+0000","last_fullsized":"2024-05-10T11:13:20.734297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:07.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764030+0000","last_change":"2024-05-10T11:13:19.729084+0000","last_active":"2024-05-10T11:13:20.764030+0000","last_peered":"2024-05-10T11:13:20.764030+0000","last_clean":"2024-05-10T11:13:20.764030+0000","last_became_active":"2024-05-10T11:13:19.728796+0000","last_became_peered":"2024-05-10T11:13:19.728796+0000","last_unstale":"2024-05-10T11:13:20.764030+0000","last_undegraded":"2024-05-10T11:13:20.764030+0000","last_fullsized":"2024-05-10T11:13:20.764030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729383+0000","last_change":"2024-05-10T11:13:19.735425+0000","last_active":"2024-05-10T11:13:20.729383+0000","last_peered":"2024-05-10T11:13:20.729383+0000","last_clean":"2024-05-10T11:13:20.729383+0000","last_became_active":"2024-05-10T11:13:19.735053+0000","last_became_peered":"2024-05-10T11:13:19.735053+0000","last_unstale":"2024-05-10T11:13:20.729383+0000","last_undegraded":"2024-05-10T11:13:20.729383+0000","last_fullsized":"2024-05-10T11:13:20.729383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:04.283560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734820+0000","last_change":"2024-05-10T11:13:19.725056+0000","last_active":"2024-05-10T11:13:20.734820+0000","last_peered":"2024-05-10T11:13:20.734820+0000","last_clean":"2024-05-10T11:13:20.734820+0000","last_became_active":"2024-05-10T11:13:19.724833+0000","last_became_peered":"2024-05-10T11:13:19.724833+0000","last_unstale":"2024-05-10T11:13:20.734820+0000","last_undegraded":"2024-05-10T11:13:20.734820+0000","last_fullsized":"2024-05-10T11:13:20.734820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734748+0000","last_change":"2024-05-10T11:13:19.726523+0000","last_active":"2024-05-10T11:13:20.734748+0000","last_peered":"2024-05-10T11:13:20.734748+0000","last_clean":"2024-05-10T11:13:20.734748+0000","last_became_active":"2024-05-10T11:13:19.726280+0000","last_became_peered":"2024-05-10T11:13:19.726280+0000","last_unstale":"2024-05-10T11:13:20.734748+0000","last_undegraded":"2024-05-10T11:13:20.734748+0000","last_fullsized":"2024-05-10T11:13:20.734748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729035+0000","last_change":"2024-05-10T11:13:19.734209+0000","last_active":"2024-05-10T11:13:20.729035+0000","last_peered":"2024-05-10T11:13:20.729035+0000","last_clean":"2024-05-10T11:13:20.729035+0000","last_became_active":"2024-05-10T11:13:19.733951+0000","last_became_peered":"2024-05-10T11:13:19.733951+0000","last_unstale":"2024-05-10T11:13:20.729035+0000","last_undegraded":"2024-05-10T11:13:20.729035+0000","last_fullsized":"2024-05-10T11:13:20.729035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734619+0000","last_change":"2024-05-10T11:13:19.725439+0000","last_active":"2024-05-10T11:13:20.734619+0000","last_peered":"2024-05-10T11:13:20.734619+0000","last_clean":"2024-05-10T11:13:20.734619+0000","last_became_active":"2024-05-10T11:13:19.725149+0000","last_became_peered":"2024-05-10T11:13:19.725149+0000","last_unstale":"2024-05-10T11:13:20.734619+0000","last_undegraded":"2024-05-10T11:13:20.734619+0000","last_fullsized":"2024-05-10T11:13:20.734619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692849+0000","last_change":"2024-05-10T11:13:18.692849+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692849+0000","last_undegraded":"2024-05-10T11:13:18.692849+0000","last_fullsized":"2024-05-10T11:13:18.692849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734333+0000","last_change":"2024-05-10T11:13:19.730590+0000","last_active":"2024-05-10T11:13:20.734333+0000","last_peered":"2024-05-10T11:13:20.734333+0000","last_clean":"2024-05-10T11:13:20.734333+0000","last_became_active":"2024-05-10T11:13:19.730313+0000","last_became_peered":"2024-05-10T11:13:19.730313+0000","last_unstale":"2024-05-10T11:13:20.734333+0000","last_undegraded":"2024-05-10T11:13:20.734333+0000","last_fullsized":"2024-05-10T11:13:20.734333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:01.085545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692041+0000","last_change":"2024-05-10T11:13:18.692041+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692041+0000","last_undegraded":"2024-05-10T11:13:18.692041+0000","last_fullsized":"2024-05-10T11:13:18.692041+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690905+0000","last_change":"2024-05-10T11:13:18.690905+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690905+0000","last_undegraded":"2024-05-10T11:13:18.690905+0000","last_fullsized":"2024-05-10T11:13:18.690905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690085+0000","last_change":"2024-05-10T11:13:18.690085+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690085+0000","last_undegraded":"2024-05-10T11:13:18.690085+0000","last_fullsized":"2024-05-10T11:13:18.690085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728062+0000","last_change":"2024-05-10T11:13:19.739810+0000","last_active":"2024-05-10T11:13:20.728062+0000","last_peered":"2024-05-10T11:13:20.728062+0000","last_clean":"2024-05-10T11:13:20.728062+0000","last_became_active":"2024-05-10T11:13:19.739560+0000","last_became_peered":"2024-05-10T11:13:19.739560+0000","last_unstale":"2024-05-10T11:13:20.728062+0000","last_undegraded":"2024-05-10T11:13:20.728062+0000","last_fullsized":"2024-05-10T11:13:20.728062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:51.141564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691010+0000","last_change":"2024-05-10T11:13:18.691010+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691010+0000","last_undegraded":"2024-05-10T11:13:18.691010+0000","last_fullsized":"2024-05-10T11:13:18.691010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734374+0000","last_change":"2024-05-10T11:13:19.727819+0000","last_active":"2024-05-10T11:13:20.734374+0000","last_peered":"2024-05-10T11:13:20.734374+0000","last_clean":"2024-05-10T11:13:20.734374+0000","last_became_active":"2024-05-10T11:13:19.727526+0000","last_became_peered":"2024-05-10T11:13:19.727526+0000","last_unstale":"2024-05-10T11:13:20.734374+0000","last_undegraded":"2024-05-10T11:13:20.734374+0000","last_fullsized":"2024-05-10T11:13:20.734374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:32.694277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691731+0000","last_change":"2024-05-10T11:13:18.691731+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691731+0000","last_undegraded":"2024-05-10T11:13:18.691731+0000","last_fullsized":"2024-05-10T11:13:18.691731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.692089+0000","last_change":"2024-05-10T11:13:18.692089+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.692089+0000","last_undegraded":"2024-05-10T11:13:18.692089+0000","last_fullsized":"2024-05-10T11:13:18.692089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727985+0000","last_change":"2024-05-10T11:13:19.727643+0000","last_active":"2024-05-10T11:13:20.727985+0000","last_peered":"2024-05-10T11:13:20.727985+0000","last_clean":"2024-05-10T11:13:20.727985+0000","last_became_active":"2024-05-10T11:13:19.727379+0000","last_became_peered":"2024-05-10T11:13:19.727379+0000","last_unstale":"2024-05-10T11:13:20.727985+0000","last_undegraded":"2024-05-10T11:13:20.727985+0000","last_fullsized":"2024-05-10T11:13:20.727985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.505846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689029+0000","last_change":"2024-05-10T11:13:18.689029+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689029+0000","last_undegraded":"2024-05-10T11:13:18.689029+0000","last_fullsized":"2024-05-10T11:13:18.689029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763926+0000","last_change":"2024-05-10T11:13:19.736103+0000","last_active":"2024-05-10T11:13:20.763926+0000","last_peered":"2024-05-10T11:13:20.763926+0000","last_clean":"2024-05-10T11:13:20.763926+0000","last_became_active":"2024-05-10T11:13:19.735808+0000","last_became_peered":"2024-05-10T11:13:19.735808+0000","last_unstale":"2024-05-10T11:13:20.763926+0000","last_undegraded":"2024-05-10T11:13:20.763926+0000","last_fullsized":"2024-05-10T11:13:20.763926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690230+0000","last_change":"2024-05-10T11:13:18.690230+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690230+0000","last_undegraded":"2024-05-10T11:13:18.690230+0000","last_fullsized":"2024-05-10T11:13:18.690230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734617+0000","last_change":"2024-05-10T11:13:19.728392+0000","last_active":"2024-05-10T11:13:20.734617+0000","last_peered":"2024-05-10T11:13:20.734617+0000","last_clean":"2024-05-10T11:13:20.734617+0000","last_became_active":"2024-05-10T11:13:19.728114+0000","last_became_peered":"2024-05-10T11:13:19.728114+0000","last_unstale":"2024-05-10T11:13:20.734617+0000","last_undegraded":"2024-05-10T11:13:20.734617+0000","last_fullsized":"2024-05-10T11:13:20.734617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689673+0000","last_change":"2024-05-10T11:13:18.689673+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689673+0000","last_undegraded":"2024-05-10T11:13:18.689673+0000","last_fullsized":"2024-05-10T11:13:18.689673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689192+0000","last_change":"2024-05-10T11:13:18.689192+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689192+0000","last_undegraded":"2024-05-10T11:13:18.689192+0000","last_fullsized":"2024-05-10T11:13:18.689192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690641+0000","last_change":"2024-05-10T11:13:18.690641+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690641+0000","last_undegraded":"2024-05-10T11:13:18.690641+0000","last_fullsized":"2024-05-10T11:13:18.690641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763545+0000","last_change":"2024-05-10T11:13:19.740012+0000","last_active":"2024-05-10T11:13:20.763545+0000","last_peered":"2024-05-10T11:13:20.763545+0000","last_clean":"2024-05-10T11:13:20.763545+0000","last_became_active":"2024-05-10T11:13:19.739697+0000","last_became_peered":"2024-05-10T11:13:19.739697+0000","last_unstale":"2024-05-10T11:13:20.763545+0000","last_undegraded":"2024-05-10T11:13:20.763545+0000","last_fullsized":"2024-05-10T11:13:20.763545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:16.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691264+0000","last_change":"2024-05-10T11:13:18.691264+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691264+0000","last_undegraded":"2024-05-10T11:13:18.691264+0000","last_fullsized":"2024-05-10T11:13:18.691264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704247+0000","last_change":"2024-05-10T11:13:18.702772+0000","last_active":"2024-05-10T11:13:18.704247+0000","last_peered":"2024-05-10T11:13:18.704247+0000","last_clean":"2024-05-10T11:13:18.704247+0000","last_became_active":"2024-05-10T11:13:18.702477+0000","last_became_peered":"2024-05-10T11:13:18.702477+0000","last_unstale":"2024-05-10T11:13:18.704247+0000","last_undegraded":"2024-05-10T11:13:18.704247+0000","last_fullsized":"2024-05-10T11:13:18.704247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764207+0000","last_change":"2024-05-10T11:13:19.738117+0000","last_active":"2024-05-10T11:13:20.764207+0000","last_peered":"2024-05-10T11:13:20.764207+0000","last_clean":"2024-05-10T11:13:20.764207+0000","last_became_active":"2024-05-10T11:13:19.737853+0000","last_became_peered":"2024-05-10T11:13:19.737853+0000","last_unstale":"2024-05-10T11:13:20.764207+0000","last_undegraded":"2024-05-10T11:13:20.764207+0000","last_fullsized":"2024-05-10T11:13:20.764207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729137+0000","last_change":"2024-05-10T11:13:18.700836+0000","last_active":"2024-05-10T11:13:20.729137+0000","last_peered":"2024-05-10T11:13:20.729137+0000","last_clean":"2024-05-10T11:13:20.729137+0000","last_became_active":"2024-05-10T11:13:18.700475+0000","last_became_peered":"2024-05-10T11:13:18.700475+0000","last_unstale":"2024-05-10T11:13:20.729137+0000","last_undegraded":"2024-05-10T11:13:20.729137+0000","last_fullsized":"2024-05-10T11:13:20.729137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689669+0000","last_change":"2024-05-10T11:13:18.689669+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689669+0000","last_undegraded":"2024-05-10T11:13:18.689669+0000","last_fullsized":"2024-05-10T11:13:18.689669+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764281+0000","last_change":"2024-05-10T11:13:18.704118+0000","last_active":"2024-05-10T11:13:20.764281+0000","last_peered":"2024-05-10T11:13:20.764281+0000","last_clean":"2024-05-10T11:13:20.764281+0000","last_became_active":"2024-05-10T11:13:18.703845+0000","last_became_peered":"2024-05-10T11:13:18.703845+0000","last_unstale":"2024-05-10T11:13:20.764281+0000","last_undegraded":"2024-05-10T11:13:20.764281+0000","last_fullsized":"2024-05-10T11:13:20.764281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764493+0000","last_change":"2024-05-10T11:13:19.724203+0000","last_active":"2024-05-10T11:13:20.764493+0000","last_peered":"2024-05-10T11:13:20.764493+0000","last_clean":"2024-05-10T11:13:20.764493+0000","last_became_active":"2024-05-10T11:13:19.723950+0000","last_became_peered":"2024-05-10T11:13:19.723950+0000","last_unstale":"2024-05-10T11:13:20.764493+0000","last_undegraded":"2024-05-10T11:13:20.764493+0000","last_fullsized":"2024-05-10T11:13:20.764493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:39.970327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705781+0000","last_change":"2024-05-10T11:13:18.704981+0000","last_active":"2024-05-10T11:13:18.705781+0000","last_peered":"2024-05-10T11:13:18.705781+0000","last_clean":"2024-05-10T11:13:18.705781+0000","last_became_active":"2024-05-10T11:13:18.704637+0000","last_became_peered":"2024-05-10T11:13:18.704637+0000","last_unstale":"2024-05-10T11:13:18.705781+0000","last_undegraded":"2024-05-10T11:13:18.705781+0000","last_fullsized":"2024-05-10T11:13:18.705781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728868+0000","last_change":"2024-05-10T11:13:19.730788+0000","last_active":"2024-05-10T11:13:20.728868+0000","last_peered":"2024-05-10T11:13:20.728868+0000","last_clean":"2024-05-10T11:13:20.728868+0000","last_became_active":"2024-05-10T11:13:19.730539+0000","last_became_peered":"2024-05-10T11:13:19.730539+0000","last_unstale":"2024-05-10T11:13:20.728868+0000","last_undegraded":"2024-05-10T11:13:20.728868+0000","last_fullsized":"2024-05-10T11:13:20.728868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734629+0000","last_change":"2024-05-10T11:13:18.701666+0000","last_active":"2024-05-10T11:13:20.734629+0000","last_peered":"2024-05-10T11:13:20.734629+0000","last_clean":"2024-05-10T11:13:20.734629+0000","last_became_active":"2024-05-10T11:13:18.701440+0000","last_became_peered":"2024-05-10T11:13:18.701440+0000","last_unstale":"2024-05-10T11:13:20.734629+0000","last_undegraded":"2024-05-10T11:13:20.734629+0000","last_fullsized":"2024-05-10T11:13:20.734629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:52.343488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734546+0000","last_change":"2024-05-10T11:13:19.728464+0000","last_active":"2024-05-10T11:13:20.734546+0000","last_peered":"2024-05-10T11:13:20.734546+0000","last_clean":"2024-05-10T11:13:20.734546+0000","last_became_active":"2024-05-10T11:13:19.728193+0000","last_became_peered":"2024-05-10T11:13:19.728193+0000","last_unstale":"2024-05-10T11:13:20.734546+0000","last_undegraded":"2024-05-10T11:13:20.734546+0000","last_fullsized":"2024-05-10T11:13:20.734546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704589+0000","last_change":"2024-05-10T11:13:18.703185+0000","last_active":"2024-05-10T11:13:18.704589+0000","last_peered":"2024-05-10T11:13:18.704589+0000","last_clean":"2024-05-10T11:13:18.704589+0000","last_became_active":"2024-05-10T11:13:18.702911+0000","last_became_peered":"2024-05-10T11:13:18.702911+0000","last_unstale":"2024-05-10T11:13:18.704589+0000","last_undegraded":"2024-05-10T11:13:18.704589+0000","last_fullsized":"2024-05-10T11:13:18.704589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:36.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.689164+0000","last_change":"2024-05-10T11:13:18.689164+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.689164+0000","last_undegraded":"2024-05-10T11:13:18.689164+0000","last_fullsized":"2024-05-10T11:13:18.689164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763506+0000","last_change":"2024-05-10T11:13:18.699755+0000","last_active":"2024-05-10T11:13:20.763506+0000","last_peered":"2024-05-10T11:13:20.763506+0000","last_clean":"2024-05-10T11:13:20.763506+0000","last_became_active":"2024-05-10T11:13:18.698729+0000","last_became_peered":"2024-05-10T11:13:18.698729+0000","last_unstale":"2024-05-10T11:13:20.763506+0000","last_undegraded":"2024-05-10T11:13:20.763506+0000","last_fullsized":"2024-05-10T11:13:20.763506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763828+0000","last_change":"2024-05-10T11:13:19.725730+0000","last_active":"2024-05-10T11:13:20.763828+0000","last_peered":"2024-05-10T11:13:20.763828+0000","last_clean":"2024-05-10T11:13:20.763828+0000","last_became_active":"2024-05-10T11:13:19.725477+0000","last_became_peered":"2024-05-10T11:13:19.725477+0000","last_unstale":"2024-05-10T11:13:20.763828+0000","last_undegraded":"2024-05-10T11:13:20.763828+0000","last_fullsized":"2024-05-10T11:13:20.763828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700727+0000","last_change":"2024-05-10T11:13:18.695029+0000","last_active":"2024-05-10T11:13:18.700727+0000","last_peered":"2024-05-10T11:13:18.700727+0000","last_clean":"2024-05-10T11:13:18.700727+0000","last_became_active":"2024-05-10T11:13:18.694723+0000","last_became_peered":"2024-05-10T11:13:18.694723+0000","last_unstale":"2024-05-10T11:13:18.700727+0000","last_undegraded":"2024-05-10T11:13:18.700727+0000","last_fullsized":"2024-05-10T11:13:18.700727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728096+0000","last_change":"2024-05-10T11:13:19.733886+0000","last_active":"2024-05-10T11:13:20.728096+0000","last_peered":"2024-05-10T11:13:20.728096+0000","last_clean":"2024-05-10T11:13:20.728096+0000","last_became_active":"2024-05-10T11:13:19.733588+0000","last_became_peered":"2024-05-10T11:13:19.733588+0000","last_unstale":"2024-05-10T11:13:20.728096+0000","last_undegraded":"2024-05-10T11:13:20.728096+0000","last_fullsized":"2024-05-10T11:13:20.728096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.288584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764521+0000","last_change":"2024-05-10T11:13:18.703232+0000","last_active":"2024-05-10T11:13:20.764521+0000","last_peered":"2024-05-10T11:13:20.764521+0000","last_clean":"2024-05-10T11:13:20.764521+0000","last_became_active":"2024-05-10T11:13:18.702937+0000","last_became_peered":"2024-05-10T11:13:18.702937+0000","last_unstale":"2024-05-10T11:13:20.764521+0000","last_undegraded":"2024-05-10T11:13:20.764521+0000","last_fullsized":"2024-05-10T11:13:20.764521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:51.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691955+0000","last_change":"2024-05-10T11:13:18.691955+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691955+0000","last_undegraded":"2024-05-10T11:13:18.691955+0000","last_fullsized":"2024-05-10T11:13:18.691955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734878+0000","last_change":"2024-05-10T11:13:18.700131+0000","last_active":"2024-05-10T11:13:20.734878+0000","last_peered":"2024-05-10T11:13:20.734878+0000","last_clean":"2024-05-10T11:13:20.734878+0000","last_became_active":"2024-05-10T11:13:18.698727+0000","last_became_peered":"2024-05-10T11:13:18.698727+0000","last_unstale":"2024-05-10T11:13:20.734878+0000","last_undegraded":"2024-05-10T11:13:20.734878+0000","last_fullsized":"2024-05-10T11:13:20.734878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:23.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729206+0000","last_change":"2024-05-10T11:13:19.729385+0000","last_active":"2024-05-10T11:13:20.729206+0000","last_peered":"2024-05-10T11:13:20.729206+0000","last_clean":"2024-05-10T11:13:20.729206+0000","last_became_active":"2024-05-10T11:13:19.729088+0000","last_became_peered":"2024-05-10T11:13:19.729088+0000","last_unstale":"2024-05-10T11:13:20.729206+0000","last_undegraded":"2024-05-10T11:13:20.729206+0000","last_fullsized":"2024-05-10T11:13:20.729206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:02.574628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734843+0000","last_change":"2024-05-10T11:13:18.697361+0000","last_active":"2024-05-10T11:13:20.734843+0000","last_peered":"2024-05-10T11:13:20.734843+0000","last_clean":"2024-05-10T11:13:20.734843+0000","last_became_active":"2024-05-10T11:13:18.697069+0000","last_became_peered":"2024-05-10T11:13:18.697069+0000","last_unstale":"2024-05-10T11:13:20.734843+0000","last_undegraded":"2024-05-10T11:13:20.734843+0000","last_fullsized":"2024-05-10T11:13:20.734843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:43.028126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690403+0000","last_change":"2024-05-10T11:13:18.690403+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690403+0000","last_undegraded":"2024-05-10T11:13:18.690403+0000","last_fullsized":"2024-05-10T11:13:18.690403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764452+0000","last_change":"2024-05-10T11:13:18.704317+0000","last_active":"2024-05-10T11:13:20.764452+0000","last_peered":"2024-05-10T11:13:20.764452+0000","last_clean":"2024-05-10T11:13:20.764452+0000","last_became_active":"2024-05-10T11:13:18.704016+0000","last_became_peered":"2024-05-10T11:13:18.704016+0000","last_unstale":"2024-05-10T11:13:20.764452+0000","last_undegraded":"2024-05-10T11:13:20.764452+0000","last_fullsized":"2024-05-10T11:13:20.764452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728896+0000","last_change":"2024-05-10T11:13:19.735706+0000","last_active":"2024-05-10T11:13:20.728896+0000","last_peered":"2024-05-10T11:13:20.728896+0000","last_clean":"2024-05-10T11:13:20.728896+0000","last_became_active":"2024-05-10T11:13:19.734578+0000","last_became_peered":"2024-05-10T11:13:19.734578+0000","last_unstale":"2024-05-10T11:13:20.728896+0000","last_undegraded":"2024-05-10T11:13:20.728896+0000","last_fullsized":"2024-05-10T11:13:20.728896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764164+0000","last_change":"2024-05-10T11:13:18.702219+0000","last_active":"2024-05-10T11:13:20.764164+0000","last_peered":"2024-05-10T11:13:20.764164+0000","last_clean":"2024-05-10T11:13:20.764164+0000","last_became_active":"2024-05-10T11:13:18.701933+0000","last_became_peered":"2024-05-10T11:13:18.701933+0000","last_unstale":"2024-05-10T11:13:20.764164+0000","last_undegraded":"2024-05-10T11:13:20.764164+0000","last_fullsized":"2024-05-10T11:13:20.764164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:38.664408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764507+0000","last_change":"2024-05-10T11:13:19.732843+0000","last_active":"2024-05-10T11:13:20.764507+0000","last_peered":"2024-05-10T11:13:20.764507+0000","last_clean":"2024-05-10T11:13:20.764507+0000","last_became_active":"2024-05-10T11:13:19.732571+0000","last_became_peered":"2024-05-10T11:13:19.732571+0000","last_unstale":"2024-05-10T11:13:20.764507+0000","last_undegraded":"2024-05-10T11:13:20.764507+0000","last_fullsized":"2024-05-10T11:13:20.764507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:23.903648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763464+0000","last_change":"2024-05-10T11:13:18.699460+0000","last_active":"2024-05-10T11:13:20.763464+0000","last_peered":"2024-05-10T11:13:20.763464+0000","last_clean":"2024-05-10T11:13:20.763464+0000","last_became_active":"2024-05-10T11:13:18.699144+0000","last_became_peered":"2024-05-10T11:13:18.699144+0000","last_unstale":"2024-05-10T11:13:20.763464+0000","last_undegraded":"2024-05-10T11:13:20.763464+0000","last_fullsized":"2024-05-10T11:13:20.763464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690745+0000","last_change":"2024-05-10T11:13:18.690745+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690745+0000","last_undegraded":"2024-05-10T11:13:18.690745+0000","last_fullsized":"2024-05-10T11:13:18.690745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.705229+0000","last_change":"2024-05-10T11:13:18.703149+0000","last_active":"2024-05-10T11:13:18.705229+0000","last_peered":"2024-05-10T11:13:18.705229+0000","last_clean":"2024-05-10T11:13:18.705229+0000","last_became_active":"2024-05-10T11:13:18.702580+0000","last_became_peered":"2024-05-10T11:13:18.702580+0000","last_unstale":"2024-05-10T11:13:18.705229+0000","last_undegraded":"2024-05-10T11:13:18.705229+0000","last_fullsized":"2024-05-10T11:13:18.705229+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:20.551756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763969+0000","last_change":"2024-05-10T11:13:19.733267+0000","last_active":"2024-05-10T11:13:20.763969+0000","last_peered":"2024-05-10T11:13:20.763969+0000","last_clean":"2024-05-10T11:13:20.763969+0000","last_became_active":"2024-05-10T11:13:19.732862+0000","last_became_peered":"2024-05-10T11:13:19.732862+0000","last_unstale":"2024-05-10T11:13:20.763969+0000","last_undegraded":"2024-05-10T11:13:20.763969+0000","last_fullsized":"2024-05-10T11:13:20.763969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.703353+0000","last_change":"2024-05-10T11:13:18.701542+0000","last_active":"2024-05-10T11:13:18.703353+0000","last_peered":"2024-05-10T11:13:18.703353+0000","last_clean":"2024-05-10T11:13:18.703353+0000","last_became_active":"2024-05-10T11:13:18.701286+0000","last_became_peered":"2024-05-10T11:13:18.701286+0000","last_unstale":"2024-05-10T11:13:18.703353+0000","last_undegraded":"2024-05-10T11:13:18.703353+0000","last_fullsized":"2024-05-10T11:13:18.703353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:44.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764415+0000","last_change":"2024-05-10T11:13:19.718590+0000","last_active":"2024-05-10T11:13:20.764415+0000","last_peered":"2024-05-10T11:13:20.764415+0000","last_clean":"2024-05-10T11:13:20.764415+0000","last_became_active":"2024-05-10T11:13:19.718038+0000","last_became_peered":"2024-05-10T11:13:19.718038+0000","last_unstale":"2024-05-10T11:13:20.764415+0000","last_undegraded":"2024-05-10T11:13:20.764415+0000","last_fullsized":"2024-05-10T11:13:20.764415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734879+0000","last_change":"2024-05-10T11:13:18.693532+0000","last_active":"2024-05-10T11:13:20.734879+0000","last_peered":"2024-05-10T11:13:20.734879+0000","last_clean":"2024-05-10T11:13:20.734879+0000","last_became_active":"2024-05-10T11:13:18.693207+0000","last_became_peered":"2024-05-10T11:13:18.693207+0000","last_unstale":"2024-05-10T11:13:20.734879+0000","last_undegraded":"2024-05-10T11:13:20.734879+0000","last_fullsized":"2024-05-10T11:13:20.734879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734818+0000","last_change":"2024-05-10T11:13:19.729201+0000","last_active":"2024-05-10T11:13:20.734818+0000","last_peered":"2024-05-10T11:13:20.734818+0000","last_clean":"2024-05-10T11:13:20.734818+0000","last_became_active":"2024-05-10T11:13:19.728950+0000","last_became_peered":"2024-05-10T11:13:19.728950+0000","last_unstale":"2024-05-10T11:13:20.734818+0000","last_undegraded":"2024-05-10T11:13:20.734818+0000","last_fullsized":"2024-05-10T11:13:20.734818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700757+0000","last_change":"2024-05-10T11:13:18.694811+0000","last_active":"2024-05-10T11:13:18.700757+0000","last_peered":"2024-05-10T11:13:18.700757+0000","last_clean":"2024-05-10T11:13:18.700757+0000","last_became_active":"2024-05-10T11:13:18.692974+0000","last_became_peered":"2024-05-10T11:13:18.692974+0000","last_unstale":"2024-05-10T11:13:18.700757+0000","last_undegraded":"2024-05-10T11:13:18.700757+0000","last_fullsized":"2024-05-10T11:13:18.700757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:50:56.822130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688501+0000","last_change":"2024-05-10T11:13:18.688501+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688501+0000","last_undegraded":"2024-05-10T11:13:18.688501+0000","last_fullsized":"2024-05-10T11:13:18.688501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727939+0000","last_change":"2024-05-10T11:13:18.698741+0000","last_active":"2024-05-10T11:13:20.727939+0000","last_peered":"2024-05-10T11:13:20.727939+0000","last_clean":"2024-05-10T11:13:20.727939+0000","last_became_active":"2024-05-10T11:13:18.698440+0000","last_became_peered":"2024-05-10T11:13:18.698440+0000","last_unstale":"2024-05-10T11:13:20.727939+0000","last_undegraded":"2024-05-10T11:13:20.727939+0000","last_fullsized":"2024-05-10T11:13:20.727939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:19:16.570254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.739604+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.739272+0000","last_became_peered":"2024-05-10T11:13:19.739272+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:33.487420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763735+0000","last_change":"2024-05-10T11:13:18.703465+0000","last_active":"2024-05-10T11:13:20.763735+0000","last_peered":"2024-05-10T11:13:20.763735+0000","last_clean":"2024-05-10T11:13:20.763735+0000","last_became_active":"2024-05-10T11:13:18.702762+0000","last_became_peered":"2024-05-10T11:13:18.702762+0000","last_unstale":"2024-05-10T11:13:20.763735+0000","last_undegraded":"2024-05-10T11:13:20.763735+0000","last_fullsized":"2024-05-10T11:13:20.763735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:10.813728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690588+0000","last_change":"2024-05-10T11:13:18.690588+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690588+0000","last_undegraded":"2024-05-10T11:13:18.690588+0000","last_fullsized":"2024-05-10T11:13:18.690588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727850+0000","last_change":"2024-05-10T11:13:18.702301+0000","last_active":"2024-05-10T11:13:20.727850+0000","last_peered":"2024-05-10T11:13:20.727850+0000","last_clean":"2024-05-10T11:13:20.727850+0000","last_became_active":"2024-05-10T11:13:18.702020+0000","last_became_peered":"2024-05-10T11:13:18.702020+0000","last_unstale":"2024-05-10T11:13:20.727850+0000","last_undegraded":"2024-05-10T11:13:20.727850+0000","last_fullsized":"2024-05-10T11:13:20.727850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:23.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728994+0000","last_change":"2024-05-10T11:13:19.730034+0000","last_active":"2024-05-10T11:13:20.728994+0000","last_peered":"2024-05-10T11:13:20.728994+0000","last_clean":"2024-05-10T11:13:20.728994+0000","last_became_active":"2024-05-10T11:13:19.729784+0000","last_became_peered":"2024-05-10T11:13:19.729784+0000","last_unstale":"2024-05-10T11:13:20.728994+0000","last_undegraded":"2024-05-10T11:13:20.728994+0000","last_fullsized":"2024-05-10T11:13:20.728994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727817+0000","last_change":"2024-05-10T11:13:18.703123+0000","last_active":"2024-05-10T11:13:20.727817+0000","last_peered":"2024-05-10T11:13:20.727817+0000","last_clean":"2024-05-10T11:13:20.727817+0000","last_became_active":"2024-05-10T11:13:18.702855+0000","last_became_peered":"2024-05-10T11:13:18.702855+0000","last_unstale":"2024-05-10T11:13:20.727817+0000","last_undegraded":"2024-05-10T11:13:20.727817+0000","last_fullsized":"2024-05-10T11:13:20.727817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:55.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734500+0000","last_change":"2024-05-10T11:13:19.723348+0000","last_active":"2024-05-10T11:13:20.734500+0000","last_peered":"2024-05-10T11:13:20.734500+0000","last_clean":"2024-05-10T11:13:20.734500+0000","last_became_active":"2024-05-10T11:13:19.723074+0000","last_became_peered":"2024-05-10T11:13:19.723074+0000","last_unstale":"2024-05-10T11:13:20.734500+0000","last_undegraded":"2024-05-10T11:13:20.734500+0000","last_fullsized":"2024-05-10T11:13:20.734500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:34.461837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.700305+0000","last_change":"2024-05-10T11:13:18.698251+0000","last_active":"2024-05-10T11:13:18.700305+0000","last_peered":"2024-05-10T11:13:18.700305+0000","last_clean":"2024-05-10T11:13:18.700305+0000","last_became_active":"2024-05-10T11:13:18.697970+0000","last_became_peered":"2024-05-10T11:13:18.697970+0000","last_unstale":"2024-05-10T11:13:18.700305+0000","last_undegraded":"2024-05-10T11:13:18.700305+0000","last_fullsized":"2024-05-10T11:13:18.700305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:31.620398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764112+0000","last_change":"2024-05-10T11:13:19.725035+0000","last_active":"2024-05-10T11:13:20.764112+0000","last_peered":"2024-05-10T11:13:20.764112+0000","last_clean":"2024-05-10T11:13:20.764112+0000","last_became_active":"2024-05-10T11:13:19.724781+0000","last_became_peered":"2024-05-10T11:13:19.724781+0000","last_unstale":"2024-05-10T11:13:20.764112+0000","last_undegraded":"2024-05-10T11:13:20.764112+0000","last_fullsized":"2024-05-10T11:13:20.764112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727630+0000","last_change":"2024-05-10T11:13:18.703414+0000","last_active":"2024-05-10T11:13:20.727630+0000","last_peered":"2024-05-10T11:13:20.727630+0000","last_clean":"2024-05-10T11:13:20.727630+0000","last_became_active":"2024-05-10T11:13:18.702852+0000","last_became_peered":"2024-05-10T11:13:18.702852+0000","last_unstale":"2024-05-10T11:13:20.727630+0000","last_undegraded":"2024-05-10T11:13:20.727630+0000","last_fullsized":"2024-05-10T11:13:20.727630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:34.714357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763678+0000","last_change":"2024-05-10T11:13:19.736920+0000","last_active":"2024-05-10T11:13:20.763678+0000","last_peered":"2024-05-10T11:13:20.763678+0000","last_clean":"2024-05-10T11:13:20.763678+0000","last_became_active":"2024-05-10T11:13:19.736619+0000","last_became_peered":"2024-05-10T11:13:19.736619+0000","last_unstale":"2024-05-10T11:13:20.763678+0000","last_undegraded":"2024-05-10T11:13:20.763678+0000","last_fullsized":"2024-05-10T11:13:20.763678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734954+0000","last_change":"2024-05-10T11:13:18.696813+0000","last_active":"2024-05-10T11:13:20.734954+0000","last_peered":"2024-05-10T11:13:20.734954+0000","last_clean":"2024-05-10T11:13:20.734954+0000","last_became_active":"2024-05-10T11:13:18.696527+0000","last_became_peered":"2024-05-10T11:13:18.696527+0000","last_unstale":"2024-05-10T11:13:20.734954+0000","last_undegraded":"2024-05-10T11:13:20.734954+0000","last_fullsized":"2024-05-10T11:13:20.734954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.691526+0000","last_change":"2024-05-10T11:13:18.691526+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.691526+0000","last_undegraded":"2024-05-10T11:13:18.691526+0000","last_fullsized":"2024-05-10T11:13:18.691526+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728077+0000","last_change":"2024-05-10T11:13:18.699474+0000","last_active":"2024-05-10T11:13:20.728077+0000","last_peered":"2024-05-10T11:13:20.728077+0000","last_clean":"2024-05-10T11:13:20.728077+0000","last_became_active":"2024-05-10T11:13:18.699197+0000","last_became_peered":"2024-05-10T11:13:18.699197+0000","last_unstale":"2024-05-10T11:13:20.728077+0000","last_undegraded":"2024-05-10T11:13:20.728077+0000","last_fullsized":"2024-05-10T11:13:20.728077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:03:28.008509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764106+0000","last_change":"2024-05-10T11:13:19.727718+0000","last_active":"2024-05-10T11:13:20.764106+0000","last_peered":"2024-05-10T11:13:20.764106+0000","last_clean":"2024-05-10T11:13:20.764106+0000","last_became_active":"2024-05-10T11:13:19.727454+0000","last_became_peered":"2024-05-10T11:13:19.727454+0000","last_unstale":"2024-05-10T11:13:20.764106+0000","last_undegraded":"2024-05-10T11:13:20.764106+0000","last_fullsized":"2024-05-10T11:13:20.764106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729121+0000","last_change":"2024-05-10T11:13:18.701654+0000","last_active":"2024-05-10T11:13:20.729121+0000","last_peered":"2024-05-10T11:13:20.729121+0000","last_clean":"2024-05-10T11:13:20.729121+0000","last_became_active":"2024-05-10T11:13:18.701372+0000","last_became_peered":"2024-05-10T11:13:18.701372+0000","last_unstale":"2024-05-10T11:13:20.729121+0000","last_undegraded":"2024-05-10T11:13:20.729121+0000","last_fullsized":"2024-05-10T11:13:20.729121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729040+0000","last_change":"2024-05-10T11:13:19.738281+0000","last_active":"2024-05-10T11:13:20.729040+0000","last_peered":"2024-05-10T11:13:20.729040+0000","last_clean":"2024-05-10T11:13:20.729040+0000","last_became_active":"2024-05-10T11:13:19.738024+0000","last_became_peered":"2024-05-10T11:13:19.738024+0000","last_unstale":"2024-05-10T11:13:20.729040+0000","last_undegraded":"2024-05-10T11:13:20.729040+0000","last_fullsized":"2024-05-10T11:13:20.729040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:05.391289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729085+0000","last_change":"2024-05-10T11:13:18.699063+0000","last_active":"2024-05-10T11:13:20.729085+0000","last_peered":"2024-05-10T11:13:20.729085+0000","last_clean":"2024-05-10T11:13:20.729085+0000","last_became_active":"2024-05-10T11:13:18.698161+0000","last_became_peered":"2024-05-10T11:13:18.698161+0000","last_unstale":"2024-05-10T11:13:20.729085+0000","last_undegraded":"2024-05-10T11:13:20.729085+0000","last_fullsized":"2024-05-10T11:13:20.729085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763552+0000","last_change":"2024-05-10T11:13:19.727035+0000","last_active":"2024-05-10T11:13:20.763552+0000","last_peered":"2024-05-10T11:13:20.763552+0000","last_clean":"2024-05-10T11:13:20.763552+0000","last_became_active":"2024-05-10T11:13:19.726701+0000","last_became_peered":"2024-05-10T11:13:19.726701+0000","last_unstale":"2024-05-10T11:13:20.763552+0000","last_undegraded":"2024-05-10T11:13:20.763552+0000","last_fullsized":"2024-05-10T11:13:20.763552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:26.394487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.704029+0000","last_change":"2024-05-10T11:13:18.701428+0000","last_active":"2024-05-10T11:13:18.704029+0000","last_peered":"2024-05-10T11:13:18.704029+0000","last_clean":"2024-05-10T11:13:18.704029+0000","last_became_active":"2024-05-10T11:13:18.701155+0000","last_became_peered":"2024-05-10T11:13:18.701155+0000","last_unstale":"2024-05-10T11:13:18.704029+0000","last_undegraded":"2024-05-10T11:13:18.704029+0000","last_fullsized":"2024-05-10T11:13:18.704029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:15.935603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.688495+0000","last_change":"2024-05-10T11:13:18.688495+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.688495+0000","last_undegraded":"2024-05-10T11:13:18.688495+0000","last_fullsized":"2024-05-10T11:13:18.688495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.701773+0000","last_change":"2024-05-10T11:13:18.699343+0000","last_active":"2024-05-10T11:13:18.701773+0000","last_peered":"2024-05-10T11:13:18.701773+0000","last_clean":"2024-05-10T11:13:18.701773+0000","last_became_active":"2024-05-10T11:13:18.699076+0000","last_became_peered":"2024-05-10T11:13:18.699076+0000","last_unstale":"2024-05-10T11:13:18.701773+0000","last_undegraded":"2024-05-10T11:13:18.701773+0000","last_fullsized":"2024-05-10T11:13:18.701773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:13.688833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-05-10T11:13:18.690102+0000","last_change":"2024-05-10T11:13:18.690102+0000","last_active":"2024-05-10T11:13:18.679936+0000","last_peered":"2024-05-10T11:13:18.679936+0000","last_clean":"2024-05-10T11:13:18.679936+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:18.690102+0000","last_undegraded":"2024-05-10T11:13:18.690102+0000","last_fullsized":"2024-05-10T11:13:18.690102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764082+0000","last_change":"2024-05-10T11:13:18.702463+0000","last_active":"2024-05-10T11:13:20.764082+0000","last_peered":"2024-05-10T11:13:20.764082+0000","last_clean":"2024-05-10T11:13:20.764082+0000","last_became_active":"2024-05-10T11:13:18.702201+0000","last_became_peered":"2024-05-10T11:13:18.702201+0000","last_unstale":"2024-05-10T11:13:20.764082+0000","last_undegraded":"2024-05-10T11:13:20.764082+0000","last_fullsized":"2024-05-10T11:13:20.764082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734809+0000","last_change":"2024-05-10T11:13:19.735527+0000","last_active":"2024-05-10T11:13:20.734809+0000","last_peered":"2024-05-10T11:13:20.734809+0000","last_clean":"2024-05-10T11:13:20.734809+0000","last_became_active":"2024-05-10T11:13:19.734366+0000","last_became_peered":"2024-05-10T11:13:19.734366+0000","last_unstale":"2024-05-10T11:13:20.734809+0000","last_undegraded":"2024-05-10T11:13:20.734809+0000","last_fullsized":"2024-05-10T11:13:20.734809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.699619+0000","last_change":"2024-05-10T11:13:18.696982+0000","last_active":"2024-05-10T11:13:18.699619+0000","last_peered":"2024-05-10T11:13:18.699619+0000","last_clean":"2024-05-10T11:13:18.699619+0000","last_became_active":"2024-05-10T11:13:18.696733+0000","last_became_peered":"2024-05-10T11:13:18.696733+0000","last_unstale":"2024-05-10T11:13:18.699619+0000","last_undegraded":"2024-05-10T11:13:18.699619+0000","last_fullsized":"2024-05-10T11:13:18.699619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T11:13:18.692315+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:18.692315+0000","last_peered":"2024-05-10T11:13:18.692315+0000","last_clean":"2024-05-10T11:13:18.692315+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:18.692315+0000","last_undegraded":"2024-05-10T11:13:18.692315+0000","last_fullsized":"2024-05-10T11:13:18.692315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":747748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":157380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":164047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":179552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":768308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":178018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:13:28.275 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:13:28.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.393+0000 7fda74f78640 1 Processor -- start 2024-05-10T11:13:28.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.393+0000 7fda74f78640 1 -- start start 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda74f78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 0x7fda700d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda74f78640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda700b5e80 con 0x7fda70162dd0 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda74f78640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda700d5c50 con 0x7fda700d3980 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda74f78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fda700b5c30 con 0x7fda700d2270 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda6dd9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fda70162dd0 0x7fda700cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49402/0 (socket says 172.21.15.66:49402) 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda6dd9b640 1 -- 172.21.15.66:0/809744363 learned_addr learned my addr 172.21.15.66:0/809744363 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.394+0000 7fda6ed9d640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 0x7fda700d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964725316 0 0) 0x7fda700b5e80 con 0x7fda70162dd0 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda58003520 con 0x7fda70162dd0 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117841133 0 0) 0x7fda700d5c50 con 0x7fda700d3980 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda700b5e80 con 0x7fda700d3980 2024-05-10T11:13:28.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 421987505 0 0) 0x7fda58003520 con 0x7fda70162dd0 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 msgr2=0x7fda700d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 0x7fda700d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 >> v1:172.21.15.190:6789/0 conn(0x7fda700d3980 legacy=0x7fda701626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda700d5f30 con 0x7fda70162dd0 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fda640019f0 con 0x7fda70162dd0 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 >> v1:172.21.15.66:6789/0 conn(0x7fda70162dd0 legacy=0x7fda700cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda58003b70 0x7fda58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 0x7fda58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda700b5c30 con 0x7fda58004d40 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fda5800ba70 con 0x7fda58003b70 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fda5800bc20 con 0x7fda700d2270 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6ed9d640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6dd9b640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 0x7fda58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6e59c640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda58003b70 0x7fda58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6ed9d640 1 -- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 msgr2=0x7fda58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6ed9d640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda700d2270 0x7fda58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6ed9d640 1 -- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda58003b70 msgr2=0x7fda58003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6ed9d640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda58003b70 0x7fda58003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.395+0000 7fda6ed9d640 1 -- 172.21.15.66:0/809744363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda58003520 con 0x7fda58004d40 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.396+0000 7fda6ed9d640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda580051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fda68009a90 tx=0x7fda58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df6bbf38b80a155 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.396+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68036070 con 0x7fda58004d40 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.396+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda68031400 con 0x7fda58004d40 2024-05-10T11:13:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.396+0000 7fda6d59a640 1 -- 172.21.15.66:0/809744363 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68009690 con 0x7fda58004d40 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda74f78640 1 -- 172.21.15.66:0/809744363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 msgr2=0x7fda580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda74f78640 1 --2- 172.21.15.66:0/809744363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda580051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fda68009a90 tx=0x7fda58005830 comp rx=0 tx=0).stop 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda6ed9d640 1 -- 172.21.15.66:0/809744363 reap_dead start 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda74f78640 1 -- 172.21.15.66:0/809744363 shutdown_connections 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda74f78640 1 -- 172.21.15.66:0/809744363 >> 172.21.15.66:0/809744363 conn(0x7fda700d5130 msgr2=0x7fda700d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda74f78640 1 -- 172.21.15.66:0/809744363 shutdown_connections 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.397+0000 7fda74f78640 1 -- 172.21.15.66:0/809744363 wait complete. 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 Processor -- start 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 -- start start 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda70157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda7014c280 0x7fda70155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda701563c0 0x7fda7015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda700b6890 con 0x7fda58004d40 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fda700d31f0 con 0x7fda7014c280 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda74f78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fda700b6160 con 0x7fda701563c0 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.399+0000 7fda6e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda70157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda70157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47120/0 (socket says 172.21.15.66:47120) 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 -- 172.21.15.66:0/3841883247 learned_addr learned my addr 172.21.15.66:0/3841883247 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6dd9b640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda7014c280 0x7fda70155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6ed9d640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda701563c0 0x7fda7015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 -- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda701563c0 msgr2=0x7fda7015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda701563c0 0x7fda7015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 -- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda7014c280 msgr2=0x7fda70155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda7014c280 0x7fda70155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 -- 172.21.15.66:0/3841883247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda70157e40 con 0x7fda58004d40 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda6e59c640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda70157900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda6000f7a0 tx=0x7fda6000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6000fe50 con 0x7fda58004d40 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda60018070 con 0x7fda58004d40 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda70156860 con 0x7fda58004d40 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6000d730 con 0x7fda58004d40 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.400+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda70156e20 con 0x7fda58004d40 2024-05-10T11:13:28.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.401+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7006a220 con 0x7fda58004d40 2024-05-10T11:13:28.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.402+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda6000d8d0 con 0x7fda58004d40 2024-05-10T11:13:28.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.402+0000 7fda5effd640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda50076300 0x7fda500787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.403+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fda60097590 con 0x7fda58004d40 2024-05-10T11:13:28.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.403+0000 7fda6dd9b640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda50076300 0x7fda500787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.403+0000 7fda6dd9b640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda50076300 0x7fda500787c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda70155520 tx=0x7fda64006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:28.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.407+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fda60060710 con 0x7fda58004d40 2024-05-10T11:13:28.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.595+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda700b1e10 con 0x7fda50076300 2024-05-10T11:13:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.601+0000 7fda5effd640 1 -- 172.21.15.66:0/3841883247 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7fda700b1e10 con 0x7fda50076300 2024-05-10T11:13:28.603 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:13:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda50076300 msgr2=0x7fda500787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda50076300 0x7fda500787c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda70155520 tx=0x7fda64006040 comp rx=0 tx=0).stop 2024-05-10T11:13:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 msgr2=0x7fda70157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda70157900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda6000f7a0 tx=0x7fda6000fc60 comp rx=0 tx=0).stop 2024-05-10T11:13:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 shutdown_connections 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda50076300 0x7fda500787c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda701563c0 0x7fda7015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda7014c280 0x7fda70155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 --2- 172.21.15.66:0/3841883247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda58004d40 0x7fda70157900 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 >> 172.21.15.66:0/3841883247 conn(0x7fda700d5130 msgr2=0x7fda701601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 shutdown_connections 2024-05-10T11:13:28.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.604+0000 7fda74f78640 1 -- 172.21.15.66:0/3841883247 wait complete. 2024-05-10T11:13:28.615 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-05-10T11:13:27.697966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220672,"kb_used_data":4488,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754048,"statfs":{"total":773094113280,"available":772868145152,"internally_reserved":0,"allocated":4595712,"data_stored":2608804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002219"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764580+0000","last_change":"2024-05-10T11:13:19.732597+0000","last_active":"2024-05-10T11:13:20.764580+0000","last_peered":"2024-05-10T11:13:20.764580+0000","last_clean":"2024-05-10T11:13:20.764580+0000","last_became_active":"2024-05-10T11:13:19.732175+0000","last_became_peered":"2024-05-10T11:13:19.732175+0000","last_unstale":"2024-05-10T11:13:20.764580+0000","last_undegraded":"2024-05-10T11:13:20.764580+0000","last_fullsized":"2024-05-10T11:13:20.764580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:36.288762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763960+0000","last_change":"2024-05-10T11:13:19.739881+0000","last_active":"2024-05-10T11:13:20.763960+0000","last_peered":"2024-05-10T11:13:20.763960+0000","last_clean":"2024-05-10T11:13:20.763960+0000","last_became_active":"2024-05-10T11:13:19.739453+0000","last_became_peered":"2024-05-10T11:13:19.739453+0000","last_unstale":"2024-05-10T11:13:20.763960+0000","last_undegraded":"2024-05-10T11:13:20.763960+0000","last_fullsized":"2024-05-10T11:13:20.763960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729120+0000","last_change":"2024-05-10T11:13:19.733275+0000","last_active":"2024-05-10T11:13:20.729120+0000","last_peered":"2024-05-10T11:13:20.729120+0000","last_clean":"2024-05-10T11:13:20.729120+0000","last_became_active":"2024-05-10T11:13:19.732987+0000","last_became_peered":"2024-05-10T11:13:19.732987+0000","last_unstale":"2024-05-10T11:13:20.729120+0000","last_undegraded":"2024-05-10T11:13:20.729120+0000","last_fullsized":"2024-05-10T11:13:20.729120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:56.702776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728116+0000","last_change":"2024-05-10T11:13:19.733990+0000","last_active":"2024-05-10T11:13:20.728116+0000","last_peered":"2024-05-10T11:13:20.728116+0000","last_clean":"2024-05-10T11:13:20.728116+0000","last_became_active":"2024-05-10T11:13:19.733699+0000","last_became_peered":"2024-05-10T11:13:19.733699+0000","last_unstale":"2024-05-10T11:13:20.728116+0000","last_undegraded":"2024-05-10T11:13:20.728116+0000","last_fullsized":"2024-05-10T11:13:20.728116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:11.815701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.732957+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.732674+0000","last_became_peered":"2024-05-10T11:13:19.732674+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:48:46.137307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763665+0000","last_change":"2024-05-10T11:13:19.738793+0000","last_active":"2024-05-10T11:13:20.763665+0000","last_peered":"2024-05-10T11:13:20.763665+0000","last_clean":"2024-05-10T11:13:20.763665+0000","last_became_active":"2024-05-10T11:13:19.738522+0000","last_became_peered":"2024-05-10T11:13:19.738522+0000","last_unstale":"2024-05-10T11:13:20.763665+0000","last_undegraded":"2024-05-10T11:13:20.763665+0000","last_fullsized":"2024-05-10T11:13:20.763665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734297+0000","last_change":"2024-05-10T11:13:19.727429+0000","last_active":"2024-05-10T11:13:20.734297+0000","last_peered":"2024-05-10T11:13:20.734297+0000","last_clean":"2024-05-10T11:13:20.734297+0000","last_became_active":"2024-05-10T11:13:19.727146+0000","last_became_peered":"2024-05-10T11:13:19.727146+0000","last_unstale":"2024-05-10T11:13:20.734297+0000","last_undegraded":"2024-05-10T11:13:20.734297+0000","last_fullsized":"2024-05-10T11:13:20.734297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:07.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764030+0000","last_change":"2024-05-10T11:13:19.729084+0000","last_active":"2024-05-10T11:13:20.764030+0000","last_peered":"2024-05-10T11:13:20.764030+0000","last_clean":"2024-05-10T11:13:20.764030+0000","last_became_active":"2024-05-10T11:13:19.728796+0000","last_became_peered":"2024-05-10T11:13:19.728796+0000","last_unstale":"2024-05-10T11:13:20.764030+0000","last_undegraded":"2024-05-10T11:13:20.764030+0000","last_fullsized":"2024-05-10T11:13:20.764030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729383+0000","last_change":"2024-05-10T11:13:19.735425+0000","last_active":"2024-05-10T11:13:20.729383+0000","last_peered":"2024-05-10T11:13:20.729383+0000","last_clean":"2024-05-10T11:13:20.729383+0000","last_became_active":"2024-05-10T11:13:19.735053+0000","last_became_peered":"2024-05-10T11:13:19.735053+0000","last_unstale":"2024-05-10T11:13:20.729383+0000","last_undegraded":"2024-05-10T11:13:20.729383+0000","last_fullsized":"2024-05-10T11:13:20.729383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:04.283560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734820+0000","last_change":"2024-05-10T11:13:19.725056+0000","last_active":"2024-05-10T11:13:20.734820+0000","last_peered":"2024-05-10T11:13:20.734820+0000","last_clean":"2024-05-10T11:13:20.734820+0000","last_became_active":"2024-05-10T11:13:19.724833+0000","last_became_peered":"2024-05-10T11:13:19.724833+0000","last_unstale":"2024-05-10T11:13:20.734820+0000","last_undegraded":"2024-05-10T11:13:20.734820+0000","last_fullsized":"2024-05-10T11:13:20.734820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734748+0000","last_change":"2024-05-10T11:13:19.726523+0000","last_active":"2024-05-10T11:13:20.734748+0000","last_peered":"2024-05-10T11:13:20.734748+0000","last_clean":"2024-05-10T11:13:20.734748+0000","last_became_active":"2024-05-10T11:13:19.726280+0000","last_became_peered":"2024-05-10T11:13:19.726280+0000","last_unstale":"2024-05-10T11:13:20.734748+0000","last_undegraded":"2024-05-10T11:13:20.734748+0000","last_fullsized":"2024-05-10T11:13:20.734748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:46.501677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729035+0000","last_change":"2024-05-10T11:13:19.734209+0000","last_active":"2024-05-10T11:13:20.729035+0000","last_peered":"2024-05-10T11:13:20.729035+0000","last_clean":"2024-05-10T11:13:20.729035+0000","last_became_active":"2024-05-10T11:13:19.733951+0000","last_became_peered":"2024-05-10T11:13:19.733951+0000","last_unstale":"2024-05-10T11:13:20.729035+0000","last_undegraded":"2024-05-10T11:13:20.729035+0000","last_fullsized":"2024-05-10T11:13:20.729035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734619+0000","last_change":"2024-05-10T11:13:19.725439+0000","last_active":"2024-05-10T11:13:20.734619+0000","last_peered":"2024-05-10T11:13:20.734619+0000","last_clean":"2024-05-10T11:13:20.734619+0000","last_became_active":"2024-05-10T11:13:19.725149+0000","last_became_peered":"2024-05-10T11:13:19.725149+0000","last_unstale":"2024-05-10T11:13:20.734619+0000","last_undegraded":"2024-05-10T11:13:20.734619+0000","last_fullsized":"2024-05-10T11:13:20.734619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764229+0000","last_change":"2024-05-10T11:13:19.734393+0000","last_active":"2024-05-10T11:13:20.764229+0000","last_peered":"2024-05-10T11:13:20.764229+0000","last_clean":"2024-05-10T11:13:20.764229+0000","last_became_active":"2024-05-10T11:13:19.733930+0000","last_became_peered":"2024-05-10T11:13:19.733930+0000","last_unstale":"2024-05-10T11:13:20.764229+0000","last_undegraded":"2024-05-10T11:13:20.764229+0000","last_fullsized":"2024-05-10T11:13:20.764229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:20.157952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734333+0000","last_change":"2024-05-10T11:13:19.730590+0000","last_active":"2024-05-10T11:13:20.734333+0000","last_peered":"2024-05-10T11:13:20.734333+0000","last_clean":"2024-05-10T11:13:20.734333+0000","last_became_active":"2024-05-10T11:13:19.730313+0000","last_became_peered":"2024-05-10T11:13:19.730313+0000","last_unstale":"2024-05-10T11:13:20.734333+0000","last_undegraded":"2024-05-10T11:13:20.734333+0000","last_fullsized":"2024-05-10T11:13:20.734333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:01.085545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764473+0000","last_change":"2024-05-10T11:13:19.728358+0000","last_active":"2024-05-10T11:13:20.764473+0000","last_peered":"2024-05-10T11:13:20.764473+0000","last_clean":"2024-05-10T11:13:20.764473+0000","last_became_active":"2024-05-10T11:13:19.728073+0000","last_became_peered":"2024-05-10T11:13:19.728073+0000","last_unstale":"2024-05-10T11:13:20.764473+0000","last_undegraded":"2024-05-10T11:13:20.764473+0000","last_fullsized":"2024-05-10T11:13:20.764473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:40.393397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764815+0000","last_change":"2024-05-10T11:13:19.735264+0000","last_active":"2024-05-10T11:13:20.764815+0000","last_peered":"2024-05-10T11:13:20.764815+0000","last_clean":"2024-05-10T11:13:20.764815+0000","last_became_active":"2024-05-10T11:13:19.734992+0000","last_became_peered":"2024-05-10T11:13:19.734992+0000","last_unstale":"2024-05-10T11:13:20.764815+0000","last_undegraded":"2024-05-10T11:13:20.764815+0000","last_fullsized":"2024-05-10T11:13:20.764815+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:25.110109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765280+0000","last_change":"2024-05-10T11:13:19.730149+0000","last_active":"2024-05-10T11:13:20.765280+0000","last_peered":"2024-05-10T11:13:20.765280+0000","last_clean":"2024-05-10T11:13:20.765280+0000","last_became_active":"2024-05-10T11:13:19.729863+0000","last_became_peered":"2024-05-10T11:13:19.729863+0000","last_unstale":"2024-05-10T11:13:20.765280+0000","last_undegraded":"2024-05-10T11:13:20.765280+0000","last_fullsized":"2024-05-10T11:13:20.765280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:29:05.368416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728062+0000","last_change":"2024-05-10T11:13:19.739810+0000","last_active":"2024-05-10T11:13:20.728062+0000","last_peered":"2024-05-10T11:13:20.728062+0000","last_clean":"2024-05-10T11:13:20.728062+0000","last_became_active":"2024-05-10T11:13:19.739560+0000","last_became_peered":"2024-05-10T11:13:19.739560+0000","last_unstale":"2024-05-10T11:13:20.728062+0000","last_undegraded":"2024-05-10T11:13:20.728062+0000","last_fullsized":"2024-05-10T11:13:20.728062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:51.141564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765308+0000","last_change":"2024-05-10T11:13:19.733481+0000","last_active":"2024-05-10T11:13:20.765308+0000","last_peered":"2024-05-10T11:13:20.765308+0000","last_clean":"2024-05-10T11:13:20.765308+0000","last_became_active":"2024-05-10T11:13:19.733020+0000","last_became_peered":"2024-05-10T11:13:19.733020+0000","last_unstale":"2024-05-10T11:13:20.765308+0000","last_undegraded":"2024-05-10T11:13:20.765308+0000","last_fullsized":"2024-05-10T11:13:20.765308+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:59.773062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734374+0000","last_change":"2024-05-10T11:13:19.727819+0000","last_active":"2024-05-10T11:13:20.734374+0000","last_peered":"2024-05-10T11:13:20.734374+0000","last_clean":"2024-05-10T11:13:20.734374+0000","last_became_active":"2024-05-10T11:13:19.727526+0000","last_became_peered":"2024-05-10T11:13:19.727526+0000","last_unstale":"2024-05-10T11:13:20.734374+0000","last_undegraded":"2024-05-10T11:13:20.734374+0000","last_fullsized":"2024-05-10T11:13:20.734374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:32.694277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764378+0000","last_change":"2024-05-10T11:13:19.732938+0000","last_active":"2024-05-10T11:13:20.764378+0000","last_peered":"2024-05-10T11:13:20.764378+0000","last_clean":"2024-05-10T11:13:20.764378+0000","last_became_active":"2024-05-10T11:13:19.732649+0000","last_became_peered":"2024-05-10T11:13:19.732649+0000","last_unstale":"2024-05-10T11:13:20.764378+0000","last_undegraded":"2024-05-10T11:13:20.764378+0000","last_fullsized":"2024-05-10T11:13:20.764378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:13.804615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764149+0000","last_change":"2024-05-10T11:13:19.732200+0000","last_active":"2024-05-10T11:13:20.764149+0000","last_peered":"2024-05-10T11:13:20.764149+0000","last_clean":"2024-05-10T11:13:20.764149+0000","last_became_active":"2024-05-10T11:13:19.731919+0000","last_became_peered":"2024-05-10T11:13:19.731919+0000","last_unstale":"2024-05-10T11:13:20.764149+0000","last_undegraded":"2024-05-10T11:13:20.764149+0000","last_fullsized":"2024-05-10T11:13:20.764149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:56:40.593838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727985+0000","last_change":"2024-05-10T11:13:19.727643+0000","last_active":"2024-05-10T11:13:20.727985+0000","last_peered":"2024-05-10T11:13:20.727985+0000","last_clean":"2024-05-10T11:13:20.727985+0000","last_became_active":"2024-05-10T11:13:19.727379+0000","last_became_peered":"2024-05-10T11:13:19.727379+0000","last_unstale":"2024-05-10T11:13:20.727985+0000","last_undegraded":"2024-05-10T11:13:20.727985+0000","last_fullsized":"2024-05-10T11:13:20.727985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.505846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765242+0000","last_change":"2024-05-10T11:13:19.730926+0000","last_active":"2024-05-10T11:13:20.765242+0000","last_peered":"2024-05-10T11:13:20.765242+0000","last_clean":"2024-05-10T11:13:20.765242+0000","last_became_active":"2024-05-10T11:13:19.730660+0000","last_became_peered":"2024-05-10T11:13:19.730660+0000","last_unstale":"2024-05-10T11:13:20.765242+0000","last_undegraded":"2024-05-10T11:13:20.765242+0000","last_fullsized":"2024-05-10T11:13:20.765242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:20.157952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763926+0000","last_change":"2024-05-10T11:13:19.736103+0000","last_active":"2024-05-10T11:13:20.763926+0000","last_peered":"2024-05-10T11:13:20.763926+0000","last_clean":"2024-05-10T11:13:20.763926+0000","last_became_active":"2024-05-10T11:13:19.735808+0000","last_became_peered":"2024-05-10T11:13:19.735808+0000","last_unstale":"2024-05-10T11:13:20.763926+0000","last_undegraded":"2024-05-10T11:13:20.763926+0000","last_fullsized":"2024-05-10T11:13:20.763926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765071+0000","last_change":"2024-05-10T11:13:19.739366+0000","last_active":"2024-05-10T11:13:20.765071+0000","last_peered":"2024-05-10T11:13:20.765071+0000","last_clean":"2024-05-10T11:13:20.765071+0000","last_became_active":"2024-05-10T11:13:19.739095+0000","last_became_peered":"2024-05-10T11:13:19.739095+0000","last_unstale":"2024-05-10T11:13:20.765071+0000","last_undegraded":"2024-05-10T11:13:20.765071+0000","last_fullsized":"2024-05-10T11:13:20.765071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:52.143743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734617+0000","last_change":"2024-05-10T11:13:19.728392+0000","last_active":"2024-05-10T11:13:20.734617+0000","last_peered":"2024-05-10T11:13:20.734617+0000","last_clean":"2024-05-10T11:13:20.734617+0000","last_became_active":"2024-05-10T11:13:19.728114+0000","last_became_peered":"2024-05-10T11:13:19.728114+0000","last_unstale":"2024-05-10T11:13:20.734617+0000","last_undegraded":"2024-05-10T11:13:20.734617+0000","last_fullsized":"2024-05-10T11:13:20.734617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:18.520167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764784+0000","last_change":"2024-05-10T11:13:19.727881+0000","last_active":"2024-05-10T11:13:20.764784+0000","last_peered":"2024-05-10T11:13:20.764784+0000","last_clean":"2024-05-10T11:13:20.764784+0000","last_became_active":"2024-05-10T11:13:19.727574+0000","last_became_peered":"2024-05-10T11:13:19.727574+0000","last_unstale":"2024-05-10T11:13:20.764784+0000","last_undegraded":"2024-05-10T11:13:20.764784+0000","last_fullsized":"2024-05-10T11:13:20.764784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.384100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764901+0000","last_change":"2024-05-10T11:13:19.719630+0000","last_active":"2024-05-10T11:13:20.764901+0000","last_peered":"2024-05-10T11:13:20.764901+0000","last_clean":"2024-05-10T11:13:20.764901+0000","last_became_active":"2024-05-10T11:13:19.719349+0000","last_became_peered":"2024-05-10T11:13:19.719349+0000","last_unstale":"2024-05-10T11:13:20.764901+0000","last_undegraded":"2024-05-10T11:13:20.764901+0000","last_fullsized":"2024-05-10T11:13:20.764901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:13:11.956545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764247+0000","last_change":"2024-05-10T11:13:19.731314+0000","last_active":"2024-05-10T11:13:20.764247+0000","last_peered":"2024-05-10T11:13:20.764247+0000","last_clean":"2024-05-10T11:13:20.764247+0000","last_became_active":"2024-05-10T11:13:19.731047+0000","last_became_peered":"2024-05-10T11:13:19.731047+0000","last_unstale":"2024-05-10T11:13:20.764247+0000","last_undegraded":"2024-05-10T11:13:20.764247+0000","last_fullsized":"2024-05-10T11:13:20.764247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:49.816641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763545+0000","last_change":"2024-05-10T11:13:19.740012+0000","last_active":"2024-05-10T11:13:20.763545+0000","last_peered":"2024-05-10T11:13:20.763545+0000","last_clean":"2024-05-10T11:13:20.763545+0000","last_became_active":"2024-05-10T11:13:19.739697+0000","last_became_peered":"2024-05-10T11:13:19.739697+0000","last_unstale":"2024-05-10T11:13:20.763545+0000","last_undegraded":"2024-05-10T11:13:20.763545+0000","last_fullsized":"2024-05-10T11:13:20.763545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:16.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764398+0000","last_change":"2024-05-10T11:13:19.727636+0000","last_active":"2024-05-10T11:13:20.764398+0000","last_peered":"2024-05-10T11:13:20.764398+0000","last_clean":"2024-05-10T11:13:20.764398+0000","last_became_active":"2024-05-10T11:13:19.727408+0000","last_became_peered":"2024-05-10T11:13:19.727408+0000","last_unstale":"2024-05-10T11:13:20.764398+0000","last_undegraded":"2024-05-10T11:13:20.764398+0000","last_fullsized":"2024-05-10T11:13:20.764398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.328360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765295+0000","last_change":"2024-05-10T11:13:18.702772+0000","last_active":"2024-05-10T11:13:20.765295+0000","last_peered":"2024-05-10T11:13:20.765295+0000","last_clean":"2024-05-10T11:13:20.765295+0000","last_became_active":"2024-05-10T11:13:18.702477+0000","last_became_peered":"2024-05-10T11:13:18.702477+0000","last_unstale":"2024-05-10T11:13:20.765295+0000","last_undegraded":"2024-05-10T11:13:20.765295+0000","last_fullsized":"2024-05-10T11:13:20.765295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:31.620398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764207+0000","last_change":"2024-05-10T11:13:19.738117+0000","last_active":"2024-05-10T11:13:20.764207+0000","last_peered":"2024-05-10T11:13:20.764207+0000","last_clean":"2024-05-10T11:13:20.764207+0000","last_became_active":"2024-05-10T11:13:19.737853+0000","last_became_peered":"2024-05-10T11:13:19.737853+0000","last_unstale":"2024-05-10T11:13:20.764207+0000","last_undegraded":"2024-05-10T11:13:20.764207+0000","last_fullsized":"2024-05-10T11:13:20.764207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:52.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729137+0000","last_change":"2024-05-10T11:13:18.700836+0000","last_active":"2024-05-10T11:13:20.729137+0000","last_peered":"2024-05-10T11:13:20.729137+0000","last_clean":"2024-05-10T11:13:20.729137+0000","last_became_active":"2024-05-10T11:13:18.700475+0000","last_became_peered":"2024-05-10T11:13:18.700475+0000","last_unstale":"2024-05-10T11:13:20.729137+0000","last_undegraded":"2024-05-10T11:13:20.729137+0000","last_fullsized":"2024-05-10T11:13:20.729137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765482+0000","last_change":"2024-05-10T11:13:19.727623+0000","last_active":"2024-05-10T11:13:20.765482+0000","last_peered":"2024-05-10T11:13:20.765482+0000","last_clean":"2024-05-10T11:13:20.765482+0000","last_became_active":"2024-05-10T11:13:19.727371+0000","last_became_peered":"2024-05-10T11:13:19.727371+0000","last_unstale":"2024-05-10T11:13:20.765482+0000","last_undegraded":"2024-05-10T11:13:20.765482+0000","last_fullsized":"2024-05-10T11:13:20.765482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:03.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764281+0000","last_change":"2024-05-10T11:13:18.704118+0000","last_active":"2024-05-10T11:13:20.764281+0000","last_peered":"2024-05-10T11:13:20.764281+0000","last_clean":"2024-05-10T11:13:20.764281+0000","last_became_active":"2024-05-10T11:13:18.703845+0000","last_became_peered":"2024-05-10T11:13:18.703845+0000","last_unstale":"2024-05-10T11:13:20.764281+0000","last_undegraded":"2024-05-10T11:13:20.764281+0000","last_fullsized":"2024-05-10T11:13:20.764281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764493+0000","last_change":"2024-05-10T11:13:19.724203+0000","last_active":"2024-05-10T11:13:20.764493+0000","last_peered":"2024-05-10T11:13:20.764493+0000","last_clean":"2024-05-10T11:13:20.764493+0000","last_became_active":"2024-05-10T11:13:19.723950+0000","last_became_peered":"2024-05-10T11:13:19.723950+0000","last_unstale":"2024-05-10T11:13:20.764493+0000","last_undegraded":"2024-05-10T11:13:20.764493+0000","last_fullsized":"2024-05-10T11:13:20.764493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:39.970327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765546+0000","last_change":"2024-05-10T11:13:18.704981+0000","last_active":"2024-05-10T11:13:20.765546+0000","last_peered":"2024-05-10T11:13:20.765546+0000","last_clean":"2024-05-10T11:13:20.765546+0000","last_became_active":"2024-05-10T11:13:18.704637+0000","last_became_peered":"2024-05-10T11:13:18.704637+0000","last_unstale":"2024-05-10T11:13:20.765546+0000","last_undegraded":"2024-05-10T11:13:20.765546+0000","last_fullsized":"2024-05-10T11:13:20.765546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:58.054897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728868+0000","last_change":"2024-05-10T11:13:19.730788+0000","last_active":"2024-05-10T11:13:20.728868+0000","last_peered":"2024-05-10T11:13:20.728868+0000","last_clean":"2024-05-10T11:13:20.728868+0000","last_became_active":"2024-05-10T11:13:19.730539+0000","last_became_peered":"2024-05-10T11:13:19.730539+0000","last_unstale":"2024-05-10T11:13:20.728868+0000","last_undegraded":"2024-05-10T11:13:20.728868+0000","last_fullsized":"2024-05-10T11:13:20.728868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:13.968727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734629+0000","last_change":"2024-05-10T11:13:18.701666+0000","last_active":"2024-05-10T11:13:20.734629+0000","last_peered":"2024-05-10T11:13:20.734629+0000","last_clean":"2024-05-10T11:13:20.734629+0000","last_became_active":"2024-05-10T11:13:18.701440+0000","last_became_peered":"2024-05-10T11:13:18.701440+0000","last_unstale":"2024-05-10T11:13:20.734629+0000","last_undegraded":"2024-05-10T11:13:20.734629+0000","last_fullsized":"2024-05-10T11:13:20.734629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:52.343488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734546+0000","last_change":"2024-05-10T11:13:19.728464+0000","last_active":"2024-05-10T11:13:20.734546+0000","last_peered":"2024-05-10T11:13:20.734546+0000","last_clean":"2024-05-10T11:13:20.734546+0000","last_became_active":"2024-05-10T11:13:19.728193+0000","last_became_peered":"2024-05-10T11:13:19.728193+0000","last_unstale":"2024-05-10T11:13:20.734546+0000","last_undegraded":"2024-05-10T11:13:20.734546+0000","last_fullsized":"2024-05-10T11:13:20.734546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764445+0000","last_change":"2024-05-10T11:13:18.703185+0000","last_active":"2024-05-10T11:13:20.764445+0000","last_peered":"2024-05-10T11:13:20.764445+0000","last_clean":"2024-05-10T11:13:20.764445+0000","last_became_active":"2024-05-10T11:13:18.702911+0000","last_became_peered":"2024-05-10T11:13:18.702911+0000","last_unstale":"2024-05-10T11:13:20.764445+0000","last_undegraded":"2024-05-10T11:13:20.764445+0000","last_fullsized":"2024-05-10T11:13:20.764445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:57.889143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764583+0000","last_change":"2024-05-10T11:13:19.736557+0000","last_active":"2024-05-10T11:13:20.764583+0000","last_peered":"2024-05-10T11:13:20.764583+0000","last_clean":"2024-05-10T11:13:20.764583+0000","last_became_active":"2024-05-10T11:13:19.735969+0000","last_became_peered":"2024-05-10T11:13:19.735969+0000","last_unstale":"2024-05-10T11:13:20.764583+0000","last_undegraded":"2024-05-10T11:13:20.764583+0000","last_fullsized":"2024-05-10T11:13:20.764583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:52:16.878310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763506+0000","last_change":"2024-05-10T11:13:18.699755+0000","last_active":"2024-05-10T11:13:20.763506+0000","last_peered":"2024-05-10T11:13:20.763506+0000","last_clean":"2024-05-10T11:13:20.763506+0000","last_became_active":"2024-05-10T11:13:18.698729+0000","last_became_peered":"2024-05-10T11:13:18.698729+0000","last_unstale":"2024-05-10T11:13:20.763506+0000","last_undegraded":"2024-05-10T11:13:20.763506+0000","last_fullsized":"2024-05-10T11:13:20.763506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:47.960003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763828+0000","last_change":"2024-05-10T11:13:19.725730+0000","last_active":"2024-05-10T11:13:20.763828+0000","last_peered":"2024-05-10T11:13:20.763828+0000","last_clean":"2024-05-10T11:13:20.763828+0000","last_became_active":"2024-05-10T11:13:19.725477+0000","last_became_peered":"2024-05-10T11:13:19.725477+0000","last_unstale":"2024-05-10T11:13:20.763828+0000","last_undegraded":"2024-05-10T11:13:20.763828+0000","last_fullsized":"2024-05-10T11:13:20.763828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763845+0000","last_change":"2024-05-10T11:13:18.695029+0000","last_active":"2024-05-10T11:13:20.763845+0000","last_peered":"2024-05-10T11:13:20.763845+0000","last_clean":"2024-05-10T11:13:20.763845+0000","last_became_active":"2024-05-10T11:13:18.694723+0000","last_became_peered":"2024-05-10T11:13:18.694723+0000","last_unstale":"2024-05-10T11:13:20.763845+0000","last_undegraded":"2024-05-10T11:13:20.763845+0000","last_fullsized":"2024-05-10T11:13:20.763845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:36.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728096+0000","last_change":"2024-05-10T11:13:19.733886+0000","last_active":"2024-05-10T11:13:20.728096+0000","last_peered":"2024-05-10T11:13:20.728096+0000","last_clean":"2024-05-10T11:13:20.728096+0000","last_became_active":"2024-05-10T11:13:19.733588+0000","last_became_peered":"2024-05-10T11:13:19.733588+0000","last_unstale":"2024-05-10T11:13:20.728096+0000","last_undegraded":"2024-05-10T11:13:20.728096+0000","last_fullsized":"2024-05-10T11:13:20.728096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.288584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764521+0000","last_change":"2024-05-10T11:13:18.703232+0000","last_active":"2024-05-10T11:13:20.764521+0000","last_peered":"2024-05-10T11:13:20.764521+0000","last_clean":"2024-05-10T11:13:20.764521+0000","last_became_active":"2024-05-10T11:13:18.702937+0000","last_became_peered":"2024-05-10T11:13:18.702937+0000","last_unstale":"2024-05-10T11:13:20.764521+0000","last_undegraded":"2024-05-10T11:13:20.764521+0000","last_fullsized":"2024-05-10T11:13:20.764521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:51.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764325+0000","last_change":"2024-05-10T11:13:19.726120+0000","last_active":"2024-05-10T11:13:20.764325+0000","last_peered":"2024-05-10T11:13:20.764325+0000","last_clean":"2024-05-10T11:13:20.764325+0000","last_became_active":"2024-05-10T11:13:19.725840+0000","last_became_peered":"2024-05-10T11:13:19.725840+0000","last_unstale":"2024-05-10T11:13:20.764325+0000","last_undegraded":"2024-05-10T11:13:20.764325+0000","last_fullsized":"2024-05-10T11:13:20.764325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:33.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734878+0000","last_change":"2024-05-10T11:13:18.700131+0000","last_active":"2024-05-10T11:13:20.734878+0000","last_peered":"2024-05-10T11:13:20.734878+0000","last_clean":"2024-05-10T11:13:20.734878+0000","last_became_active":"2024-05-10T11:13:18.698727+0000","last_became_peered":"2024-05-10T11:13:18.698727+0000","last_unstale":"2024-05-10T11:13:20.734878+0000","last_undegraded":"2024-05-10T11:13:20.734878+0000","last_fullsized":"2024-05-10T11:13:20.734878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:23.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729206+0000","last_change":"2024-05-10T11:13:19.729385+0000","last_active":"2024-05-10T11:13:20.729206+0000","last_peered":"2024-05-10T11:13:20.729206+0000","last_clean":"2024-05-10T11:13:20.729206+0000","last_became_active":"2024-05-10T11:13:19.729088+0000","last_became_peered":"2024-05-10T11:13:19.729088+0000","last_unstale":"2024-05-10T11:13:20.729206+0000","last_undegraded":"2024-05-10T11:13:20.729206+0000","last_fullsized":"2024-05-10T11:13:20.729206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:02.574628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734843+0000","last_change":"2024-05-10T11:13:18.697361+0000","last_active":"2024-05-10T11:13:20.734843+0000","last_peered":"2024-05-10T11:13:20.734843+0000","last_clean":"2024-05-10T11:13:20.734843+0000","last_became_active":"2024-05-10T11:13:18.697069+0000","last_became_peered":"2024-05-10T11:13:18.697069+0000","last_unstale":"2024-05-10T11:13:20.734843+0000","last_undegraded":"2024-05-10T11:13:20.734843+0000","last_fullsized":"2024-05-10T11:13:20.734843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:43.028126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765641+0000","last_change":"2024-05-10T11:13:19.731665+0000","last_active":"2024-05-10T11:13:20.765641+0000","last_peered":"2024-05-10T11:13:20.765641+0000","last_clean":"2024-05-10T11:13:20.765641+0000","last_became_active":"2024-05-10T11:13:19.731367+0000","last_became_peered":"2024-05-10T11:13:19.731367+0000","last_unstale":"2024-05-10T11:13:20.765641+0000","last_undegraded":"2024-05-10T11:13:20.765641+0000","last_fullsized":"2024-05-10T11:13:20.765641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:56:40.593838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764452+0000","last_change":"2024-05-10T11:13:18.704317+0000","last_active":"2024-05-10T11:13:20.764452+0000","last_peered":"2024-05-10T11:13:20.764452+0000","last_clean":"2024-05-10T11:13:20.764452+0000","last_became_active":"2024-05-10T11:13:18.704016+0000","last_became_peered":"2024-05-10T11:13:18.704016+0000","last_unstale":"2024-05-10T11:13:20.764452+0000","last_undegraded":"2024-05-10T11:13:20.764452+0000","last_fullsized":"2024-05-10T11:13:20.764452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728896+0000","last_change":"2024-05-10T11:13:19.735706+0000","last_active":"2024-05-10T11:13:20.728896+0000","last_peered":"2024-05-10T11:13:20.728896+0000","last_clean":"2024-05-10T11:13:20.728896+0000","last_became_active":"2024-05-10T11:13:19.734578+0000","last_became_peered":"2024-05-10T11:13:19.734578+0000","last_unstale":"2024-05-10T11:13:20.728896+0000","last_undegraded":"2024-05-10T11:13:20.728896+0000","last_fullsized":"2024-05-10T11:13:20.728896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764164+0000","last_change":"2024-05-10T11:13:18.702219+0000","last_active":"2024-05-10T11:13:20.764164+0000","last_peered":"2024-05-10T11:13:20.764164+0000","last_clean":"2024-05-10T11:13:20.764164+0000","last_became_active":"2024-05-10T11:13:18.701933+0000","last_became_peered":"2024-05-10T11:13:18.701933+0000","last_unstale":"2024-05-10T11:13:20.764164+0000","last_undegraded":"2024-05-10T11:13:20.764164+0000","last_fullsized":"2024-05-10T11:13:20.764164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:38.664408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764507+0000","last_change":"2024-05-10T11:13:19.732843+0000","last_active":"2024-05-10T11:13:20.764507+0000","last_peered":"2024-05-10T11:13:20.764507+0000","last_clean":"2024-05-10T11:13:20.764507+0000","last_became_active":"2024-05-10T11:13:19.732571+0000","last_became_peered":"2024-05-10T11:13:19.732571+0000","last_unstale":"2024-05-10T11:13:20.764507+0000","last_undegraded":"2024-05-10T11:13:20.764507+0000","last_fullsized":"2024-05-10T11:13:20.764507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:23.903648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763464+0000","last_change":"2024-05-10T11:13:18.699460+0000","last_active":"2024-05-10T11:13:20.763464+0000","last_peered":"2024-05-10T11:13:20.763464+0000","last_clean":"2024-05-10T11:13:20.763464+0000","last_became_active":"2024-05-10T11:13:18.699144+0000","last_became_peered":"2024-05-10T11:13:18.699144+0000","last_unstale":"2024-05-10T11:13:20.763464+0000","last_undegraded":"2024-05-10T11:13:20.763464+0000","last_fullsized":"2024-05-10T11:13:20.763464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764930+0000","last_change":"2024-05-10T11:13:19.730679+0000","last_active":"2024-05-10T11:13:20.764930+0000","last_peered":"2024-05-10T11:13:20.764930+0000","last_clean":"2024-05-10T11:13:20.764930+0000","last_became_active":"2024-05-10T11:13:19.730360+0000","last_became_peered":"2024-05-10T11:13:19.730360+0000","last_unstale":"2024-05-10T11:13:20.764930+0000","last_undegraded":"2024-05-10T11:13:20.764930+0000","last_fullsized":"2024-05-10T11:13:20.764930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:10:30.965683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764548+0000","last_change":"2024-05-10T11:13:18.703149+0000","last_active":"2024-05-10T11:13:20.764548+0000","last_peered":"2024-05-10T11:13:20.764548+0000","last_clean":"2024-05-10T11:13:20.764548+0000","last_became_active":"2024-05-10T11:13:18.702580+0000","last_became_peered":"2024-05-10T11:13:18.702580+0000","last_unstale":"2024-05-10T11:13:20.764548+0000","last_undegraded":"2024-05-10T11:13:20.764548+0000","last_fullsized":"2024-05-10T11:13:20.764548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:13.688833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763969+0000","last_change":"2024-05-10T11:13:19.733267+0000","last_active":"2024-05-10T11:13:20.763969+0000","last_peered":"2024-05-10T11:13:20.763969+0000","last_clean":"2024-05-10T11:13:20.763969+0000","last_became_active":"2024-05-10T11:13:19.732862+0000","last_became_peered":"2024-05-10T11:13:19.732862+0000","last_unstale":"2024-05-10T11:13:20.763969+0000","last_undegraded":"2024-05-10T11:13:20.763969+0000","last_fullsized":"2024-05-10T11:13:20.763969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:06.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764523+0000","last_change":"2024-05-10T11:13:18.701542+0000","last_active":"2024-05-10T11:13:20.764523+0000","last_peered":"2024-05-10T11:13:20.764523+0000","last_clean":"2024-05-10T11:13:20.764523+0000","last_became_active":"2024-05-10T11:13:18.701286+0000","last_became_peered":"2024-05-10T11:13:18.701286+0000","last_unstale":"2024-05-10T11:13:20.764523+0000","last_undegraded":"2024-05-10T11:13:20.764523+0000","last_fullsized":"2024-05-10T11:13:20.764523+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:18.556984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764415+0000","last_change":"2024-05-10T11:13:19.718590+0000","last_active":"2024-05-10T11:13:20.764415+0000","last_peered":"2024-05-10T11:13:20.764415+0000","last_clean":"2024-05-10T11:13:20.764415+0000","last_became_active":"2024-05-10T11:13:19.718038+0000","last_became_peered":"2024-05-10T11:13:19.718038+0000","last_unstale":"2024-05-10T11:13:20.764415+0000","last_undegraded":"2024-05-10T11:13:20.764415+0000","last_fullsized":"2024-05-10T11:13:20.764415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:17.376491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734879+0000","last_change":"2024-05-10T11:13:18.693532+0000","last_active":"2024-05-10T11:13:20.734879+0000","last_peered":"2024-05-10T11:13:20.734879+0000","last_clean":"2024-05-10T11:13:20.734879+0000","last_became_active":"2024-05-10T11:13:18.693207+0000","last_became_peered":"2024-05-10T11:13:18.693207+0000","last_unstale":"2024-05-10T11:13:20.734879+0000","last_undegraded":"2024-05-10T11:13:20.734879+0000","last_fullsized":"2024-05-10T11:13:20.734879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734818+0000","last_change":"2024-05-10T11:13:19.729201+0000","last_active":"2024-05-10T11:13:20.734818+0000","last_peered":"2024-05-10T11:13:20.734818+0000","last_clean":"2024-05-10T11:13:20.734818+0000","last_became_active":"2024-05-10T11:13:19.728950+0000","last_became_peered":"2024-05-10T11:13:19.728950+0000","last_unstale":"2024-05-10T11:13:20.734818+0000","last_undegraded":"2024-05-10T11:13:20.734818+0000","last_fullsized":"2024-05-10T11:13:20.734818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765591+0000","last_change":"2024-05-10T11:13:18.694811+0000","last_active":"2024-05-10T11:13:20.765591+0000","last_peered":"2024-05-10T11:13:20.765591+0000","last_clean":"2024-05-10T11:13:20.765591+0000","last_became_active":"2024-05-10T11:13:18.692974+0000","last_became_peered":"2024-05-10T11:13:18.692974+0000","last_unstale":"2024-05-10T11:13:20.765591+0000","last_undegraded":"2024-05-10T11:13:20.765591+0000","last_fullsized":"2024-05-10T11:13:20.765591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:18.556984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765342+0000","last_change":"2024-05-10T11:13:19.731536+0000","last_active":"2024-05-10T11:13:20.765342+0000","last_peered":"2024-05-10T11:13:20.765342+0000","last_clean":"2024-05-10T11:13:20.765342+0000","last_became_active":"2024-05-10T11:13:19.731198+0000","last_became_peered":"2024-05-10T11:13:19.731198+0000","last_unstale":"2024-05-10T11:13:20.765342+0000","last_undegraded":"2024-05-10T11:13:20.765342+0000","last_fullsized":"2024-05-10T11:13:20.765342+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:35.575111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727939+0000","last_change":"2024-05-10T11:13:18.698741+0000","last_active":"2024-05-10T11:13:20.727939+0000","last_peered":"2024-05-10T11:13:20.727939+0000","last_clean":"2024-05-10T11:13:20.727939+0000","last_became_active":"2024-05-10T11:13:18.698440+0000","last_became_peered":"2024-05-10T11:13:18.698440+0000","last_unstale":"2024-05-10T11:13:20.727939+0000","last_undegraded":"2024-05-10T11:13:20.727939+0000","last_fullsized":"2024-05-10T11:13:20.727939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:19:16.570254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727931+0000","last_change":"2024-05-10T11:13:19.739604+0000","last_active":"2024-05-10T11:13:20.727931+0000","last_peered":"2024-05-10T11:13:20.727931+0000","last_clean":"2024-05-10T11:13:20.727931+0000","last_became_active":"2024-05-10T11:13:19.739272+0000","last_became_peered":"2024-05-10T11:13:19.739272+0000","last_unstale":"2024-05-10T11:13:20.727931+0000","last_undegraded":"2024-05-10T11:13:20.727931+0000","last_fullsized":"2024-05-10T11:13:20.727931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:33.487420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763735+0000","last_change":"2024-05-10T11:13:18.703465+0000","last_active":"2024-05-10T11:13:20.763735+0000","last_peered":"2024-05-10T11:13:20.763735+0000","last_clean":"2024-05-10T11:13:20.763735+0000","last_became_active":"2024-05-10T11:13:18.702762+0000","last_became_peered":"2024-05-10T11:13:18.702762+0000","last_unstale":"2024-05-10T11:13:20.763735+0000","last_undegraded":"2024-05-10T11:13:20.763735+0000","last_fullsized":"2024-05-10T11:13:20.763735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:10.813728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764817+0000","last_change":"2024-05-10T11:13:19.730007+0000","last_active":"2024-05-10T11:13:20.764817+0000","last_peered":"2024-05-10T11:13:20.764817+0000","last_clean":"2024-05-10T11:13:20.764817+0000","last_became_active":"2024-05-10T11:13:19.729746+0000","last_became_peered":"2024-05-10T11:13:19.729746+0000","last_unstale":"2024-05-10T11:13:20.764817+0000","last_undegraded":"2024-05-10T11:13:20.764817+0000","last_fullsized":"2024-05-10T11:13:20.764817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:21.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727850+0000","last_change":"2024-05-10T11:13:18.702301+0000","last_active":"2024-05-10T11:13:20.727850+0000","last_peered":"2024-05-10T11:13:20.727850+0000","last_clean":"2024-05-10T11:13:20.727850+0000","last_became_active":"2024-05-10T11:13:18.702020+0000","last_became_peered":"2024-05-10T11:13:18.702020+0000","last_unstale":"2024-05-10T11:13:20.727850+0000","last_undegraded":"2024-05-10T11:13:20.727850+0000","last_fullsized":"2024-05-10T11:13:20.727850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:23.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728994+0000","last_change":"2024-05-10T11:13:19.730034+0000","last_active":"2024-05-10T11:13:20.728994+0000","last_peered":"2024-05-10T11:13:20.728994+0000","last_clean":"2024-05-10T11:13:20.728994+0000","last_became_active":"2024-05-10T11:13:19.729784+0000","last_became_peered":"2024-05-10T11:13:19.729784+0000","last_unstale":"2024-05-10T11:13:20.728994+0000","last_undegraded":"2024-05-10T11:13:20.728994+0000","last_fullsized":"2024-05-10T11:13:20.728994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:39.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727817+0000","last_change":"2024-05-10T11:13:18.703123+0000","last_active":"2024-05-10T11:13:20.727817+0000","last_peered":"2024-05-10T11:13:20.727817+0000","last_clean":"2024-05-10T11:13:20.727817+0000","last_became_active":"2024-05-10T11:13:18.702855+0000","last_became_peered":"2024-05-10T11:13:18.702855+0000","last_unstale":"2024-05-10T11:13:20.727817+0000","last_undegraded":"2024-05-10T11:13:20.727817+0000","last_fullsized":"2024-05-10T11:13:20.727817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:55.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734500+0000","last_change":"2024-05-10T11:13:19.723348+0000","last_active":"2024-05-10T11:13:20.734500+0000","last_peered":"2024-05-10T11:13:20.734500+0000","last_clean":"2024-05-10T11:13:20.734500+0000","last_became_active":"2024-05-10T11:13:19.723074+0000","last_became_peered":"2024-05-10T11:13:19.723074+0000","last_unstale":"2024-05-10T11:13:20.734500+0000","last_undegraded":"2024-05-10T11:13:20.734500+0000","last_fullsized":"2024-05-10T11:13:20.734500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:34.461837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764351+0000","last_change":"2024-05-10T11:13:18.698251+0000","last_active":"2024-05-10T11:13:20.764351+0000","last_peered":"2024-05-10T11:13:20.764351+0000","last_clean":"2024-05-10T11:13:20.764351+0000","last_became_active":"2024-05-10T11:13:18.697970+0000","last_became_peered":"2024-05-10T11:13:18.697970+0000","last_unstale":"2024-05-10T11:13:20.764351+0000","last_undegraded":"2024-05-10T11:13:20.764351+0000","last_fullsized":"2024-05-10T11:13:20.764351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:58.054897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764112+0000","last_change":"2024-05-10T11:13:19.725035+0000","last_active":"2024-05-10T11:13:20.764112+0000","last_peered":"2024-05-10T11:13:20.764112+0000","last_clean":"2024-05-10T11:13:20.764112+0000","last_became_active":"2024-05-10T11:13:19.724781+0000","last_became_peered":"2024-05-10T11:13:19.724781+0000","last_unstale":"2024-05-10T11:13:20.764112+0000","last_undegraded":"2024-05-10T11:13:20.764112+0000","last_fullsized":"2024-05-10T11:13:20.764112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:37.205486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.727630+0000","last_change":"2024-05-10T11:13:18.703414+0000","last_active":"2024-05-10T11:13:20.727630+0000","last_peered":"2024-05-10T11:13:20.727630+0000","last_clean":"2024-05-10T11:13:20.727630+0000","last_became_active":"2024-05-10T11:13:18.702852+0000","last_became_peered":"2024-05-10T11:13:18.702852+0000","last_unstale":"2024-05-10T11:13:20.727630+0000","last_undegraded":"2024-05-10T11:13:20.727630+0000","last_fullsized":"2024-05-10T11:13:20.727630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:34.714357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763678+0000","last_change":"2024-05-10T11:13:19.736920+0000","last_active":"2024-05-10T11:13:20.763678+0000","last_peered":"2024-05-10T11:13:20.763678+0000","last_clean":"2024-05-10T11:13:20.763678+0000","last_became_active":"2024-05-10T11:13:19.736619+0000","last_became_peered":"2024-05-10T11:13:19.736619+0000","last_unstale":"2024-05-10T11:13:20.763678+0000","last_undegraded":"2024-05-10T11:13:20.763678+0000","last_fullsized":"2024-05-10T11:13:20.763678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:59.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734954+0000","last_change":"2024-05-10T11:13:18.696813+0000","last_active":"2024-05-10T11:13:20.734954+0000","last_peered":"2024-05-10T11:13:20.734954+0000","last_clean":"2024-05-10T11:13:20.734954+0000","last_became_active":"2024-05-10T11:13:18.696527+0000","last_became_peered":"2024-05-10T11:13:18.696527+0000","last_unstale":"2024-05-10T11:13:20.734954+0000","last_undegraded":"2024-05-10T11:13:20.734954+0000","last_fullsized":"2024-05-10T11:13:20.734954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:58.110870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764680+0000","last_change":"2024-05-10T11:13:19.726363+0000","last_active":"2024-05-10T11:13:20.764680+0000","last_peered":"2024-05-10T11:13:20.764680+0000","last_clean":"2024-05-10T11:13:20.764680+0000","last_became_active":"2024-05-10T11:13:19.726066+0000","last_became_peered":"2024-05-10T11:13:19.726066+0000","last_unstale":"2024-05-10T11:13:20.764680+0000","last_undegraded":"2024-05-10T11:13:20.764680+0000","last_fullsized":"2024-05-10T11:13:20.764680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:32.708062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.728077+0000","last_change":"2024-05-10T11:13:18.699474+0000","last_active":"2024-05-10T11:13:20.728077+0000","last_peered":"2024-05-10T11:13:20.728077+0000","last_clean":"2024-05-10T11:13:20.728077+0000","last_became_active":"2024-05-10T11:13:18.699197+0000","last_became_peered":"2024-05-10T11:13:18.699197+0000","last_unstale":"2024-05-10T11:13:20.728077+0000","last_undegraded":"2024-05-10T11:13:20.728077+0000","last_fullsized":"2024-05-10T11:13:20.728077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:03:28.008509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764106+0000","last_change":"2024-05-10T11:13:19.727718+0000","last_active":"2024-05-10T11:13:20.764106+0000","last_peered":"2024-05-10T11:13:20.764106+0000","last_clean":"2024-05-10T11:13:20.764106+0000","last_became_active":"2024-05-10T11:13:19.727454+0000","last_became_peered":"2024-05-10T11:13:19.727454+0000","last_unstale":"2024-05-10T11:13:20.764106+0000","last_undegraded":"2024-05-10T11:13:20.764106+0000","last_fullsized":"2024-05-10T11:13:20.764106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729121+0000","last_change":"2024-05-10T11:13:18.701654+0000","last_active":"2024-05-10T11:13:20.729121+0000","last_peered":"2024-05-10T11:13:20.729121+0000","last_clean":"2024-05-10T11:13:20.729121+0000","last_became_active":"2024-05-10T11:13:18.701372+0000","last_became_peered":"2024-05-10T11:13:18.701372+0000","last_unstale":"2024-05-10T11:13:20.729121+0000","last_undegraded":"2024-05-10T11:13:20.729121+0000","last_fullsized":"2024-05-10T11:13:20.729121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:48.552797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729040+0000","last_change":"2024-05-10T11:13:19.738281+0000","last_active":"2024-05-10T11:13:20.729040+0000","last_peered":"2024-05-10T11:13:20.729040+0000","last_clean":"2024-05-10T11:13:20.729040+0000","last_became_active":"2024-05-10T11:13:19.738024+0000","last_became_peered":"2024-05-10T11:13:19.738024+0000","last_unstale":"2024-05-10T11:13:20.729040+0000","last_undegraded":"2024-05-10T11:13:20.729040+0000","last_fullsized":"2024-05-10T11:13:20.729040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:05.391289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.729085+0000","last_change":"2024-05-10T11:13:18.699063+0000","last_active":"2024-05-10T11:13:20.729085+0000","last_peered":"2024-05-10T11:13:20.729085+0000","last_clean":"2024-05-10T11:13:20.729085+0000","last_became_active":"2024-05-10T11:13:18.698161+0000","last_became_peered":"2024-05-10T11:13:18.698161+0000","last_unstale":"2024-05-10T11:13:20.729085+0000","last_undegraded":"2024-05-10T11:13:20.729085+0000","last_fullsized":"2024-05-10T11:13:20.729085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:45.992377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763552+0000","last_change":"2024-05-10T11:13:19.727035+0000","last_active":"2024-05-10T11:13:20.763552+0000","last_peered":"2024-05-10T11:13:20.763552+0000","last_clean":"2024-05-10T11:13:20.763552+0000","last_became_active":"2024-05-10T11:13:19.726701+0000","last_became_peered":"2024-05-10T11:13:19.726701+0000","last_unstale":"2024-05-10T11:13:20.763552+0000","last_undegraded":"2024-05-10T11:13:20.763552+0000","last_fullsized":"2024-05-10T11:13:20.763552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:26.394487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765010+0000","last_change":"2024-05-10T11:13:18.701428+0000","last_active":"2024-05-10T11:13:20.765010+0000","last_peered":"2024-05-10T11:13:20.765010+0000","last_clean":"2024-05-10T11:13:20.765010+0000","last_became_active":"2024-05-10T11:13:18.701155+0000","last_became_peered":"2024-05-10T11:13:18.701155+0000","last_unstale":"2024-05-10T11:13:20.765010+0000","last_undegraded":"2024-05-10T11:13:20.765010+0000","last_fullsized":"2024-05-10T11:13:20.765010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:43.163228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765260+0000","last_change":"2024-05-10T11:13:19.737073+0000","last_active":"2024-05-10T11:13:20.765260+0000","last_peered":"2024-05-10T11:13:20.765260+0000","last_clean":"2024-05-10T11:13:20.765260+0000","last_became_active":"2024-05-10T11:13:19.736803+0000","last_became_peered":"2024-05-10T11:13:19.736803+0000","last_unstale":"2024-05-10T11:13:20.765260+0000","last_undegraded":"2024-05-10T11:13:20.765260+0000","last_fullsized":"2024-05-10T11:13:20.765260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:15.576327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.763879+0000","last_change":"2024-05-10T11:13:18.699343+0000","last_active":"2024-05-10T11:13:20.763879+0000","last_peered":"2024-05-10T11:13:20.763879+0000","last_clean":"2024-05-10T11:13:20.763879+0000","last_became_active":"2024-05-10T11:13:18.699076+0000","last_became_peered":"2024-05-10T11:13:18.699076+0000","last_unstale":"2024-05-10T11:13:20.763879+0000","last_undegraded":"2024-05-10T11:13:20.763879+0000","last_fullsized":"2024-05-10T11:13:20.763879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:44.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.765049+0000","last_change":"2024-05-10T11:13:19.724283+0000","last_active":"2024-05-10T11:13:20.765049+0000","last_peered":"2024-05-10T11:13:20.765049+0000","last_clean":"2024-05-10T11:13:20.765049+0000","last_became_active":"2024-05-10T11:13:19.724003+0000","last_became_peered":"2024-05-10T11:13:19.724003+0000","last_unstale":"2024-05-10T11:13:20.765049+0000","last_undegraded":"2024-05-10T11:13:20.765049+0000","last_fullsized":"2024-05-10T11:13:20.765049+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:04.254276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764082+0000","last_change":"2024-05-10T11:13:18.702463+0000","last_active":"2024-05-10T11:13:20.764082+0000","last_peered":"2024-05-10T11:13:20.764082+0000","last_clean":"2024-05-10T11:13:20.764082+0000","last_became_active":"2024-05-10T11:13:18.702201+0000","last_became_peered":"2024-05-10T11:13:18.702201+0000","last_unstale":"2024-05-10T11:13:20.764082+0000","last_undegraded":"2024-05-10T11:13:20.764082+0000","last_fullsized":"2024-05-10T11:13:20.764082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:12.966753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.734809+0000","last_change":"2024-05-10T11:13:19.735527+0000","last_active":"2024-05-10T11:13:20.734809+0000","last_peered":"2024-05-10T11:13:20.734809+0000","last_clean":"2024-05-10T11:13:20.734809+0000","last_became_active":"2024-05-10T11:13:19.734366+0000","last_became_peered":"2024-05-10T11:13:19.734366+0000","last_unstale":"2024-05-10T11:13:20.734809+0000","last_undegraded":"2024-05-10T11:13:20.734809+0000","last_fullsized":"2024-05-10T11:13:20.734809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:18.679936+0000","last_clean_scrub_stamp":"2024-05-10T11:13:18.679936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:11.655932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764286+0000","last_change":"2024-05-10T11:13:18.696982+0000","last_active":"2024-05-10T11:13:20.764286+0000","last_peered":"2024-05-10T11:13:20.764286+0000","last_clean":"2024-05-10T11:13:20.764286+0000","last_became_active":"2024-05-10T11:13:18.696733+0000","last_became_peered":"2024-05-10T11:13:18.696733+0000","last_unstale":"2024-05-10T11:13:20.764286+0000","last_undegraded":"2024-05-10T11:13:20.764286+0000","last_fullsized":"2024-05-10T11:13:20.764286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:17.677962+0000","last_clean_scrub_stamp":"2024-05-10T11:13:17.677962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:45.012676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":139,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T11:13:20.764662+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:20.764662+0000","last_peered":"2024-05-10T11:13:20.764662+0000","last_clean":"2024-05-10T11:13:20.764662+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:20.764662+0000","last_undegraded":"2024-05-10T11:13:20.764662+0000","last_fullsized":"2024-05-10T11:13:20.764662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1028096,"data_stored":769956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":178488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":179552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":177996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":768308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":178018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:13:28.618 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:13:28.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:13:28.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.767+0000 7fe848f19640 1 Processor -- start 2024-05-10T11:13:28.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.767+0000 7fe848f19640 1 -- start start 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe848f19640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe844162ce0 0x7fe8440b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe848f19640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8440d4190 con 0x7fe844162900 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe848f19640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8440cfc40 con 0x7fe8440b4e20 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe848f19640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe8440d3eb0 con 0x7fe844162ce0 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe84259c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe844162900 0x7fe8440d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49406/0 (socket says 172.21.15.66:49406) 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe84259c640 1 -- 172.21.15.66:0/3527384808 learned_addr learned my addr 172.21.15.66:0/3527384808 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620685777 0 0) 0x7fe834001110 con 0x7fe844162900 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3527384808 >> v2:172.21.15.190:3300/0 conn(0x7fe844162ce0 0x7fe8440b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe830003520 con 0x7fe844162900 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2726191385 0 0) 0x7fe830003520 con 0x7fe844162900 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 >> v2:172.21.15.190:3300/0 conn(0x7fe844162ce0 msgr2=0x7fe8440b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 --2- 172.21.15.66:0/3527384808 >> v2:172.21.15.190:3300/0 conn(0x7fe844162ce0 0x7fe8440b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 >> v1:172.21.15.190:6789/0 conn(0x7fe8440b4e20 legacy=0x7fe8440d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8440cfee0 con 0x7fe844162900 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe834001840 con 0x7fe844162900 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 >> v1:172.21.15.66:6789/0 conn(0x7fe844162900 legacy=0x7fe8440d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8300039b0 0x7fe830003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.768+0000 7fe841d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8300051c0 0x7fe83000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440d3eb0 con 0x7fe830004800 2024-05-10T11:13:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe83000c160 con 0x7fe8300051c0 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe83000c360 con 0x7fe8300039b0 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe84259c640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8300039b0 0x7fe830003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe842d9d640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8300051c0 0x7fe83000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe839d9b640 1 -- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8300039b0 msgr2=0x7fe830003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8300039b0 0x7fe830003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe839d9b640 1 -- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8300051c0 msgr2=0x7fe83000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8300051c0 0x7fe83000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe839d9b640 1 -- 172.21.15.66:0/3527384808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe830003520 con 0x7fe830004800 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe842d9d640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8300051c0 0x7fe83000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.769+0000 7fe842d9d640 1 -- 172.21.15.66:0/3527384808 reap_dead start 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe830004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009ac0 tx=0x7fe830005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392111ce6fac8f17 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c036070 con 0x7fe830004800 2024-05-10T11:13:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe82c031400 con 0x7fe830004800 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe841d9b640 1 -- 172.21.15.66:0/3527384808 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c009690 con 0x7fe830004800 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 -- 172.21.15.66:0/3527384808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 msgr2=0x7fe830004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe830004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009ac0 tx=0x7fe830005830 comp rx=0 tx=0).stop 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 -- 172.21.15.66:0/3527384808 shutdown_connections 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 --2- 172.21.15.66:0/3527384808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe830004c80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 -- 172.21.15.66:0/3527384808 >> 172.21.15.66:0/3527384808 conn(0x7fe84409e430 msgr2=0x7fe8440d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 -- 172.21.15.66:0/3527384808 shutdown_connections 2024-05-10T11:13:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.770+0000 7fe848f19640 1 -- 172.21.15.66:0/3527384808 wait complete. 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.772+0000 7fe848f19640 1 Processor -- start 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.772+0000 7fe848f19640 1 -- start start 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe848f19640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe8440b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe848f19640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84415af70 0x7fe84415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe848f19640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440b7c90 0x7fe8440b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe848f19640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440b4300 con 0x7fe830004800 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe848f19640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440b4180 con 0x7fe84415af70 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe848f19640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8440b48e0 con 0x7fe8440b7c90 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe8440b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe8440b9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47134/0 (socket says 172.21.15.66:47134) 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 -- 172.21.15.66:0/3958874887 learned_addr learned my addr 172.21.15.66:0/3958874887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe842d9d640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440b7c90 0x7fe8440b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84415af70 0x7fe84415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 -- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440b7c90 msgr2=0x7fe8440b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440b7c90 0x7fe8440b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 -- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84415af70 msgr2=0x7fe84415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84415af70 0x7fe84415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 -- 172.21.15.66:0/3958874887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8440b88a0 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe84259c640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe8440b9720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe834007290 tx=0x7fe834007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.773+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83400f960 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.774+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834018070 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.774+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83400fd80 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.774+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8440b8b80 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.774+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8440b2860 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.775+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84406a220 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.775+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe83401d460 con 0x7fe830004800 2024-05-10T11:13:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.776+0000 7fe83b7fe640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe824076300 0x7fe8240787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.776+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fe834097700 con 0x7fe830004800 2024-05-10T11:13:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.776+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe824076300 0x7fe8240787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.777+0000 7fe839d9b640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe824076300 0x7fe8240787c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe82c033000 tx=0x7fe82c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:28.780+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe8440d4190 con 0x7fe830004800 2024-05-10T11:13:29.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.048+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe8440b2a30 con 0x7fe830004800 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.050+0000 7fe83b7fe640 1 -- 172.21.15.66:0/3958874887 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fe834060ed0 con 0x7fe830004800 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:13:29.050 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe824076300 msgr2=0x7fe8240787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe824076300 0x7fe8240787c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe82c033000 tx=0x7fe82c008030 comp rx=0 tx=0).stop 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 msgr2=0x7fe8440b9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe8440b9720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe834007290 tx=0x7fe834007690 comp rx=0 tx=0).stop 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 shutdown_connections 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe824076300 0x7fe8240787c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440b7c90 0x7fe8440b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84415af70 0x7fe84415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 --2- 172.21.15.66:0/3958874887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe830004800 0x7fe8440b9720 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 >> 172.21.15.66:0/3958874887 conn(0x7fe84409e430 msgr2=0x7fe84415e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 shutdown_connections 2024-05-10T11:13:29.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.053+0000 7fe848f19640 1 -- 172.21.15.66:0/3958874887 wait complete. 2024-05-10T11:13:29.064 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:29.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.168+0000 7f240c6da640 1 Processor -- start 2024-05-10T11:13:29.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.168+0000 7f240c6da640 1 -- start start 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240c6da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f24040d59d0 0x7f24040b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240c6da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24040d2d20 con 0x7f2404162940 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240c6da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24040d3000 con 0x7f24040d3d80 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240c6da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2404162d20 con 0x7f24040d59d0 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240ac77640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f24040d59d0 0x7f24040b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240a476640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2404162940 0x7f24040d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49408/0 (socket says 172.21.15.66:49408) 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240a476640 1 -- 172.21.15.66:0/980747562 learned_addr learned my addr 172.21.15.66:0/980747562 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240ac77640 1 -- 172.21.15.66:0/980747562 >> v1:172.21.15.190:6789/0 conn(0x7f24040d3d80 legacy=0x7f24040d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240ac77640 1 -- 172.21.15.66:0/980747562 >> v1:172.21.15.66:6789/0 conn(0x7f2404162940 legacy=0x7f24040d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f240ac77640 1 -- 172.21.15.66:0/980747562 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24040d32e0 con 0x7f24040d59d0 2024-05-10T11:13:29.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.169+0000 7f2409474640 1 -- 172.21.15.66:0/980747562 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777779437 0 0) 0x7f24040d2d20 con 0x7f2404162940 2024-05-10T11:13:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.170+0000 7f240ac77640 1 --2- 172.21.15.66:0/980747562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d59d0 0x7f24040b5e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009d90 tx=0x7f23fc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce5c9cdf0b32c07 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.170+0000 7f2409474640 1 -- 172.21.15.66:0/980747562 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc031600 con 0x7f24040d59d0 2024-05-10T11:13:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.170+0000 7f2409474640 1 -- 172.21.15.66:0/980747562 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc0317a0 con 0x7f24040d59d0 2024-05-10T11:13:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.170+0000 7f2409474640 1 -- 172.21.15.66:0/980747562 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc031b70 con 0x7f24040d59d0 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 -- 172.21.15.66:0/980747562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d59d0 msgr2=0x7f24040b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 --2- 172.21.15.66:0/980747562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d59d0 0x7f24040b5e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009d90 tx=0x7f23fc02a610 comp rx=0 tx=0).stop 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 -- 172.21.15.66:0/980747562 shutdown_connections 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 --2- 172.21.15.66:0/980747562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d59d0 0x7f24040b5e20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 -- 172.21.15.66:0/980747562 >> 172.21.15.66:0/980747562 conn(0x7f240409e380 msgr2=0x7f24040d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 -- 172.21.15.66:0/980747562 shutdown_connections 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.171+0000 7f240c6da640 1 -- 172.21.15.66:0/980747562 wait complete. 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.172+0000 7f240c6da640 1 Processor -- start 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.172+0000 7f240c6da640 1 -- start start 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 0x7f2404153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24040d59d0 0x7f24041f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2404162940 0x7f24041f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24040d2390 con 0x7f24040d3d80 2024-05-10T11:13:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24040cfc50 con 0x7f2404162940 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f24040d2510 con 0x7f24040d59d0 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 0x7f2404153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 0x7f2404153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47150/0 (socket says 172.21.15.66:47150) 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 -- 172.21.15.66:0/4032518554 learned_addr learned my addr 172.21.15.66:0/4032518554 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f2409c75640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24040d59d0 0x7f24041f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240ac77640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2404162940 0x7f24041f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 -- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24040d59d0 msgr2=0x7f24041f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24040d59d0 0x7f24041f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 -- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2404162940 msgr2=0x7f24041f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2404162940 0x7f24041f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 -- 172.21.15.66:0/4032518554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041f8f60 con 0x7f24040d3d80 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240a476640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 0x7f2404153400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f240000c430 tx=0x7f240000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24000074e0 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24000047e0 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400004bd0 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.173+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041f9240 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.174+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041f5520 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.174+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24041f9410 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.175+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2400011070 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.176+0000 7f23faffd640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23e80762d0 0x7f23e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.176+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f2400097350 con 0x7f24040d3d80 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.176+0000 7f2409c75640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23e80762d0 0x7f23e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.176+0000 7f2409c75640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23e80762d0 0x7f23e8078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f240415de30 tx=0x7f23f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.180+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2400060bb0 con 0x7f24040d3d80 2024-05-10T11:13:29.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.412+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24041f5050 con 0x7f24040d3d80 2024-05-10T11:13:29.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.412+0000 7f23faffd640 1 -- 172.21.15.66:0/4032518554 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f24000604b0 con 0x7f24040d3d80 2024-05-10T11:13:29.412 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:29.412 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:29.412 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:29.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23e80762d0 msgr2=0x7f23e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23e80762d0 0x7f23e8078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f240415de30 tx=0x7f23f4009040 comp rx=0 tx=0).stop 2024-05-10T11:13:29.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 msgr2=0x7f2404153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 0x7f2404153400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f240000c430 tx=0x7f240000c8f0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 shutdown_connections 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23e80762d0 0x7f23e8078790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2404162940 0x7f24041f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24040d59d0 0x7f24041f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 --2- 172.21.15.66:0/4032518554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24040d3d80 0x7f2404153400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 >> 172.21.15.66:0/4032518554 conn(0x7f240409e380 msgr2=0x7f24040b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 shutdown_connections 2024-05-10T11:13:29.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.415+0000 7f240c6da640 1 -- 172.21.15.66:0/4032518554 wait complete. 2024-05-10T11:13:29.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:13:19.073081+0000', 'modified': '2024-05-10T11:13:22.099813+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6835/967061575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 967061575}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 967061575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4920, 'qdb_cluster': [4920]} 2024-05-10T11:13:29.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:13:29.828 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T11:13:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.939+0000 7efe42c99640 1 Processor -- start 2024-05-10T11:13:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.939+0000 7efe42c99640 1 -- start start 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe42c99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe42c99640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efe3c0d0230 0x7efe3c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe42c99640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c15fc90 con 0x7efe3c0cfbb0 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe42c99640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c06ee50 con 0x7efe3c0d0230 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe42c99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c0b8c40 con 0x7efe3c0b8860 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efe3c0d0230 0x7efe3c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efe3c0d0230 0x7efe3c0cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47166/0 (socket says 172.21.15.66:47166) 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 -- 172.21.15.66:0/1479349031 learned_addr learned my addr 172.21.15.66:0/1479349031 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe40a35640 1 --2- 172.21.15.66:0/1479349031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 -- 172.21.15.66:0/1479349031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 msgr2=0x7efe3c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 --2- 172.21.15.66:0/1479349031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 -- 172.21.15.66:0/1479349031 >> v1:172.21.15.190:6789/0 conn(0x7efe3c0cfbb0 legacy=0x7efe3c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.940+0000 7efe33fff640 1 -- 172.21.15.66:0/1479349031 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0cd570 con 0x7efe3c0d0230 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.941+0000 7efe33fff640 1 --2- 172.21.15.66:0/1479349031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0cf670 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009870 tx=0x7efe2c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ec8591eabac5e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.941+0000 7efe337fe640 1 -- 172.21.15.66:0/1479349031 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c037070 con 0x7efe3c0d0230 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.941+0000 7efe337fe640 1 -- 172.21.15.66:0/1479349031 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c032440 con 0x7efe3c0d0230 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.941+0000 7efe337fe640 1 -- 172.21.15.66:0/1479349031 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c032810 con 0x7efe3c0d0230 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 -- 172.21.15.66:0/1479349031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 msgr2=0x7efe3c0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 --2- 172.21.15.66:0/1479349031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0cf670 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009870 tx=0x7efe2c02a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 -- 172.21.15.66:0/1479349031 shutdown_connections 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 --2- 172.21.15.66:0/1479349031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0cf670 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 --2- 172.21.15.66:0/1479349031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 -- 172.21.15.66:0/1479349031 >> 172.21.15.66:0/1479349031 conn(0x7efe3c0d2df0 msgr2=0x7efe3c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 -- 172.21.15.66:0/1479349031 shutdown_connections 2024-05-10T11:13:29.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.942+0000 7efe42c99640 1 -- 172.21.15.66:0/1479349031 wait complete. 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.943+0000 7efe42c99640 1 Processor -- start 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.943+0000 7efe42c99640 1 -- start start 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe42c99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe42c99640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c0cfbb0 0x7efe3c0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe42c99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe42c99640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0cde10 con 0x7efe3c0d0230 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe42c99640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0cdb30 con 0x7efe3c0cfbb0 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe42c99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c06ea60 con 0x7efe3c0b8860 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe41236640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe41236640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47176/0 (socket says 172.21.15.66:47176) 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe41236640 1 -- 172.21.15.66:0/3498660362 learned_addr learned my addr 172.21.15.66:0/3498660362 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe33fff640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c0cfbb0 0x7efe3c0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.944+0000 7efe40a35640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe41236640 1 -- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 msgr2=0x7efe3c154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe41236640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe41236640 1 -- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c0cfbb0 msgr2=0x7efe3c0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe41236640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c0cfbb0 0x7efe3c0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe41236640 1 -- 172.21.15.66:0/3498660362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0cd190 con 0x7efe3c0d0230 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe41236640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0b6770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c7d0 tx=0x7efe3400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe317fa640 1 -- 172.21.15.66:0/3498660362 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34003b70 con 0x7efe3c0d0230 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe317fa640 1 -- 172.21.15.66:0/3498660362 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34003d30 con 0x7efe3c0d0230 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c0cafb0 con 0x7efe3c0d0230 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe317fa640 1 -- 172.21.15.66:0/3498660362 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3400aa90 con 0x7efe3c0d0230 2024-05-10T11:13:29.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.945+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c0ca960 con 0x7efe3c0d0230 2024-05-10T11:13:29.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.947+0000 7efe317fa640 1 -- 172.21.15.66:0/3498660362 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe3400ac30 con 0x7efe3c0d0230 2024-05-10T11:13:29.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.947+0000 7efe317fa640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe280762d0 0x7efe28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.947+0000 7efe317fa640 1 -- 172.21.15.66:0/3498660362 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7efe34097540 con 0x7efe3c0d0230 2024-05-10T11:13:29.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.948+0000 7efe40a35640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe280762d0 0x7efe28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.948+0000 7efe459b9740 1 Processor -- start 2024-05-10T11:13:29.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.948+0000 7efe459b9740 1 -- start start 2024-05-10T11:13:29.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.948+0000 7efe40a35640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe280762d0 0x7efe28078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe38009aa0 tx=0x7efe38009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe459b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47be1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47be1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bb1bb0 0x55dd47bb53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe459b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd47b1b8d0 con 0x55dd47bdef50 2024-05-10T11:13:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dd47ad4c10 con 0x55dd47bb1bb0 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dd47b17890 con 0x55dd47bdf330 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47be1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47be1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47178/0 (socket says 172.21.15.66:47178) 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 -- 172.21.15.66:0/2731915690 learned_addr learned my addr 172.21.15.66:0/2731915690 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe41236640 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bb1bb0 0x55dd47bb53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe33fff640 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47be1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 -- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 msgr2=0x55dd47be1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47be1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 -- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bb1bb0 msgr2=0x55dd47bb53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bb1bb0 0x55dd47bb53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 -- 172.21.15.66:0/2731915690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd47adc5d0 con 0x55dd47bdef50 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe40a35640 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47be1760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe38004440 tx=0x7efe38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e3d26e008ce80d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe227fc640 1 -- 172.21.15.66:0/2731915690 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3801b070 con 0x55dd47bdef50 2024-05-10T11:13:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe227fc640 1 -- 172.21.15.66:0/2731915690 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe38027070 con 0x55dd47bdef50 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.949+0000 7efe227fc640 1 -- 172.21.15.66:0/2731915690 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38003a20 con 0x55dd47bdef50 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 -- 172.21.15.66:0/2731915690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 msgr2=0x55dd47be1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47be1760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe38004440 tx=0x7efe38014000 comp rx=0 tx=0).stop 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 -- 172.21.15.66:0/2731915690 shutdown_connections 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bb1bb0 0x55dd47bb53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47be1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 --2- 172.21.15.66:0/2731915690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47be1760 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 -- 172.21.15.66:0/2731915690 >> 172.21.15.66:0/2731915690 conn(0x55dd47bb3e20 msgr2=0x55dd47bfc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 -- 172.21.15.66:0/2731915690 shutdown_connections 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.950+0000 7efe459b9740 1 -- 172.21.15.66:0/2731915690 wait complete. 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.951+0000 7efe459b9740 1 -- start start 2024-05-10T11:13:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.951+0000 7efe459b9740 1 Processor -- start 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47bde610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdf330 0x55dd47c04180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47be30d0 0x55dd47c0c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd47bb6fd0 con 0x55dd47bdef50 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dd47ad8760 con 0x55dd47bdf330 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dd47bb72b0 con 0x55dd47be30d0 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 10 client.0 _ll_register_callbacks cb 0x55dd47b11cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:13:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47bde610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47bde610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47180/0 (socket says 172.21.15.66:47180) 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 -- 172.21.15.66:0/3952353399 learned_addr learned my addr 172.21.15.66:0/3952353399 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe33fff640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdf330 0x55dd47c04180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe41236640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47be30d0 0x55dd47c0c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 -- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47be30d0 msgr2=0x55dd47c0c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47be30d0 0x55dd47c0c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 -- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdf330 msgr2=0x55dd47c04180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdf330 0x55dd47c04180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 -- 172.21.15.66:0/3952353399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd4782d2d0 con 0x55dd47bdef50 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe40a35640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47bde610 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55dd47bb94b0 tx=0x7efe38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0de8f5f23b664c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe1b7fe640 1 -- 172.21.15.66:0/3952353399 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3801b040 con 0x55dd47bdef50 2024-05-10T11:13:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe1b7fe640 1 -- 172.21.15.66:0/3952353399 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7efe38035470 con 0x55dd47bdef50 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.952+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe38027070 con 0x55dd47bdef50 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe1b7fe640 1 -- 172.21.15.66:0/3952353399 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efe3803d050 con 0x55dd47bdef50 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 10 client.5100 fetch_fsmap learned FSMap version 17 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55dd478f76b0 con 0x55dd47bdef50 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe1b7fe640 1 -- 172.21.15.66:0/3952353399 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe38027070 con 0x55dd47bdef50 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe1b7fe640 1 -- 172.21.15.66:0/3952353399 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7efe38040020 con 0x55dd47bdef50 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 10 client.5100 fetch_fsmap finished waiting for FSMap version 17 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 10 client.5100 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 20 client.5100 populate_metadata read hostname 'smithi066' 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bffaa0 0x55dd47c01750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 4 client.5100 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 --> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd47a9f760 con 0x55dd47bffaa0 2024-05-10T11:13:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe33fff640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bffaa0 0x55dd47c01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe33fff640 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bffaa0 0x55dd47c01750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88b041e9b4afe1bf server_cookie=9b12300521d71cb3 in_seq=0 out_seq=0 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.953+0000 7efe1b7fe640 10 client.5100 ms_handle_connect on v2:172.21.15.66:6834/967061575 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe1b7fe640 1 -- 172.21.15.66:0/3952353399 <== mds.0 v2:172.21.15.66:6834/967061575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dd47a9f760 con 0x55dd47bffaa0 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe1b7fe640 10 client.5100 handle_command_reply: tid=0 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 client.5100 shutdown 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 msgr2=0x55dd47bde610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47bde610 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55dd47bb94b0 tx=0x7efe38004730 comp rx=0 tx=0).stop 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 shutdown_connections 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bffaa0 0x55dd47c01750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47be30d0 0x55dd47c0c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdf330 0x55dd47c04180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 --2- 172.21.15.66:0/3952353399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdef50 0x55dd47bde610 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe1b7fe640 0 client.5100 ms_handle_reset on v2:172.21.15.66:6834/967061575 2024-05-10T11:13:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.954+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 >> 172.21.15.66:0/3952353399 conn(0x55dd47bb1bb0 msgr2=0x55dd47bb2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.955+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 shutdown_connections 2024-05-10T11:13:29.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.955+0000 7efe459b9740 1 -- 172.21.15.66:0/3952353399 wait complete. 2024-05-10T11:13:29.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.955+0000 7efe459b9740 20 client.5100 trim_cache size 0 max 16384 2024-05-10T11:13:29.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.973+0000 7efe459b9740 1 Processor -- start 2024-05-10T11:13:29.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.973+0000 7efe459b9740 1 -- start start 2024-05-10T11:13:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdef50 0x55dd47c01c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe459b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 0x55dd47c02b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47be30d0 0x55dd47c205b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe459b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c200f90 con 0x55dd47bdf330 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0c9090 con 0x55dd47be30d0 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c200ae0 con 0x55dd47bdef50 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 0x55dd47c02b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 0x55dd47c02b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47186/0 (socket says 172.21.15.66:47186) 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 -- 172.21.15.66:0/2557207344 learned_addr learned my addr 172.21.15.66:0/2557207344 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 -- 172.21.15.66:0/2557207344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdef50 msgr2=0x55dd47c01c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdef50 0x55dd47c01c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 -- 172.21.15.66:0/2557207344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47be30d0 msgr2=0x55dd47c205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47be30d0 0x55dd47c205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.974+0000 7efe33fff640 1 -- 172.21.15.66:0/2557207344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd47be1b90 con 0x55dd47bdf330 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe33fff640 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 0x55dd47c02b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009990 tx=0x7efe2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375333779163c317 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe21ffb640 1 -- 172.21.15.66:0/2557207344 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c04e070 con 0x55dd47bdf330 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe21ffb640 1 -- 172.21.15.66:0/2557207344 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c049660 con 0x55dd47bdf330 2024-05-10T11:13:29.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe21ffb640 1 -- 172.21.15.66:0/2557207344 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c037040 con 0x55dd47bdf330 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 -- 172.21.15.66:0/2557207344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 msgr2=0x55dd47c02b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 0x55dd47c02b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009990 tx=0x7efe2c02c000 comp rx=0 tx=0).stop 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 -- 172.21.15.66:0/2557207344 shutdown_connections 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47be30d0 0x55dd47c205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47bdf330 0x55dd47c02b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 --2- 172.21.15.66:0/2557207344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdef50 0x55dd47c01c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 -- 172.21.15.66:0/2557207344 >> 172.21.15.66:0/2557207344 conn(0x55dd47bb1bb0 msgr2=0x55dd47bb0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 -- 172.21.15.66:0/2557207344 shutdown_connections 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.975+0000 7efe459b9740 1 -- 172.21.15.66:0/2557207344 wait complete. 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.976+0000 7efe459b9740 1 -- start start 2024-05-10T11:13:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.976+0000 7efe459b9740 1 Processor -- start 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdef50 0x55dd47bb2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47bb25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 0x55dd47bfdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd47bff920 con 0x55dd47be30d0 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dd47bff170 con 0x55dd47bdef50 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dd47bfff10 con 0x55dd47bdf330 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe459b9740 10 client.0 _ll_register_callbacks cb 0x7efe34001830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:13:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 0x55dd47bfdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 0x55dd47bfdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47194/0 (socket says 172.21.15.66:47194) 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 -- 172.21.15.66:0/1703787576 learned_addr learned my addr 172.21.15.66:0/1703787576 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe33fff640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47bb25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe40a35640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdef50 0x55dd47bb2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 -- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 msgr2=0x55dd47bb25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47bb25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 -- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdef50 msgr2=0x55dd47bb2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdef50 0x55dd47bb2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.977+0000 7efe41236640 1 -- 172.21.15.66:0/1703787576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd47c038c0 con 0x55dd47be30d0 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe41236640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 0x55dd47bfdb70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c7a0 tx=0x7efe34060000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd089eff8ddecbb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:13:29.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe1b7fe640 1 -- 172.21.15.66:0/1703787576 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34079020 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe1b7fe640 1 -- 172.21.15.66:0/1703787576 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7efe34065b40 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe2c049660 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe1b7fe640 1 -- 172.21.15.66:0/1703787576 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efe340606b0 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 10 client.5106 fetch_fsmap learned FSMap version 17 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55dd47be4b70 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe1b7fe640 1 -- 172.21.15.66:0/1703787576 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c049660 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe1b7fe640 1 -- 172.21.15.66:0/1703787576 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7efe3405f910 con 0x55dd47be30d0 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 10 client.5106 fetch_fsmap finished waiting for FSMap version 17 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 10 client.5106 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 20 client.5106 populate_metadata read hostname 'smithi066' 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bb53c0 0x55dd47bb57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 4 client.5106 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:13:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 --> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] -- command(tid 0: {"prefix": "status"}) -- 0x55dd47b294e0 con 0x55dd47bb53c0 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.978+0000 7efe40a35640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bb53c0 0x55dd47bb57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe1b7fe640 10 client.5106 ms_handle_connect on v2:172.21.15.66:6834/967061575 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe40a35640 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bb53c0 0x55dd47bb57a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4984be04ad9c8ccf server_cookie=d64bed09cc420f32 in_seq=0 out_seq=0 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe1b7fe640 1 -- 172.21.15.66:0/1703787576 <== mds.0 v2:172.21.15.66:6834/967061575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55dd47b294e0 con 0x55dd47bb53c0 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe1b7fe640 10 client.5106 handle_command_reply: tid=0 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 client.5106 shutdown 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 msgr2=0x55dd47bfdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 0x55dd47bfdb70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c7a0 tx=0x7efe34060000 comp rx=0 tx=0).stop 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 shutdown_connections 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:6834/967061575,v1:172.21.15.66:6835/967061575] conn(0x55dd47bb53c0 0x55dd47bb57a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd47be30d0 0x55dd47bfdb70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd47bdf330 0x55dd47bb25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe1b7fe640 0 client.5106 ms_handle_reset on v2:172.21.15.66:6834/967061575 2024-05-10T11:13:29.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 --2- 172.21.15.66:0/1703787576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd47bdef50 0x55dd47bb2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 >> 172.21.15.66:0/1703787576 conn(0x55dd47bb1bb0 msgr2=0x55dd47c02c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 shutdown_connections 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 1 -- 172.21.15.66:0/1703787576 wait complete. 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.979+0000 7efe459b9740 20 client.5106 trim_cache size 0 max 16384 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4920, 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:13:29.985 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 10.256403599, 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 17, 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 37, 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 37, 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 17.150984809000001 2024-05-10T11:13:29.986 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe280762d0 msgr2=0x7efe28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe280762d0 0x7efe28078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe38009aa0 tx=0x7efe38009190 comp rx=0 tx=0).stop 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 msgr2=0x7efe3c0b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0b6770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c7d0 tx=0x7efe3400cc90 comp rx=0 tx=0).stop 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 shutdown_connections 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe280762d0 0x7efe28078790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0d0230 0x7efe3c0b6770 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c0cfbb0 0x7efe3c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 --2- 172.21.15.66:0/3498660362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c0b8860 0x7efe3c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 >> 172.21.15.66:0/3498660362 conn(0x7efe3c0d2df0 msgr2=0x7efe3c070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:29.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 shutdown_connections 2024-05-10T11:13:29.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:29.980+0000 7efe42c99640 1 -- 172.21.15.66:0/3498660362 wait complete. 2024-05-10T11:13:29.994 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:13:30.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.099+0000 7f17c14cc640 1 Processor -- start 2024-05-10T11:13:30.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.099+0000 7f17c14cc640 1 -- start start 2024-05-10T11:13:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17c14cc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17bc0c6c80 0x7f17bc0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17c14cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17c14cc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17bc06f1c0 con 0x7f17bc1598c0 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17c14cc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f17bc06f4a0 con 0x7f17bc0c6c80 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17c14cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17bc06f780 con 0x7f17bc0cee40 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17ba7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17bc0c6c80 0x7f17bc0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17baffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f17bc1598c0 0x7f17bc06e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49422/0 (socket says 172.21.15.66:49422) 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17baffd640 1 -- 172.21.15.66:0/1321446920 learned_addr learned my addr 172.21.15.66:0/1321446920 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17bb7fe640 1 --2- 172.21.15.66:0/1321446920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17ba7fc640 1 -- 172.21.15.66:0/1321446920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 msgr2=0x7f17bc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17ba7fc640 1 --2- 172.21.15.66:0/1321446920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc0cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17ba7fc640 1 -- 172.21.15.66:0/1321446920 >> v1:172.21.15.66:6789/0 conn(0x7f17bc1598c0 legacy=0x7f17bc06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17ba7fc640 1 -- 172.21.15.66:0/1321446920 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc06fa60 con 0x7f17bc0c6c80 2024-05-10T11:13:30.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.100+0000 7f17b9ffb640 1 -- 172.21.15.66:0/1321446920 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699086464 0 0) 0x7f17bc06f1c0 con 0x7f17bc1598c0 2024-05-10T11:13:30.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.101+0000 7f17ba7fc640 1 --2- 172.21.15.66:0/1321446920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0c7110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f17b000ba40 tx=0x7f17b002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6090725dd44892e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:30.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.101+0000 7f17b9ffb640 1 -- 172.21.15.66:0/1321446920 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0032750 con 0x7f17bc0c6c80 2024-05-10T11:13:30.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.101+0000 7f17b9ffb640 1 -- 172.21.15.66:0/1321446920 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b0030050 con 0x7f17bc0c6c80 2024-05-10T11:13:30.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.101+0000 7f17b9ffb640 1 -- 172.21.15.66:0/1321446920 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0032b10 con 0x7f17bc0c6c80 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 -- 172.21.15.66:0/1321446920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 msgr2=0x7f17bc0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1321446920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0c7110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f17b000ba40 tx=0x7f17b002c850 comp rx=0 tx=0).stop 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 -- 172.21.15.66:0/1321446920 shutdown_connections 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1321446920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc0cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1321446920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0c7110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 -- 172.21.15.66:0/1321446920 >> 172.21.15.66:0/1321446920 conn(0x7f17bc0b2900 msgr2=0x7f17bc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 -- 172.21.15.66:0/1321446920 shutdown_connections 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.102+0000 7f17c14cc640 1 -- 172.21.15.66:0/1321446920 wait complete. 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.103+0000 7f17c14cc640 1 Processor -- start 2024-05-10T11:13:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.103+0000 7f17c14cc640 1 -- start start 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17c14cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17c14cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17c14cc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17bc1598c0 0x7f17bc15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17c14cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc06ee10 con 0x7f17bc0c6c80 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17c14cc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc15c6e0 con 0x7f17bc1598c0 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17c14cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17bc0730a0 con 0x7f17bc0cee40 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47208/0 (socket says 172.21.15.66:47208) 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 -- 172.21.15.66:0/1991501408 learned_addr learned my addr 172.21.15.66:0/1991501408 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17ba7fc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17bb7fe640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17bc1598c0 0x7f17bc15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 -- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 msgr2=0x7f17bc1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 -- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17bc1598c0 msgr2=0x7f17bc15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17bc1598c0 0x7f17bc15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.104+0000 7f17baffd640 1 -- 172.21.15.66:0/1991501408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc15bbf0 con 0x7f17bc0c6c80 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.105+0000 7f17baffd640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0add50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c460 tx=0x7f17ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.105+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac018070 con 0x7f17bc0c6c80 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.105+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ac007500 con 0x7f17bc0c6c80 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.105+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc0ae330 con 0x7f17bc0c6c80 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.105+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac004a20 con 0x7f17bc0c6c80 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.105+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc072d30 con 0x7f17bc0c6c80 2024-05-10T11:13:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.106+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc068ca0 con 0x7f17bc0c6c80 2024-05-10T11:13:30.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.106+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17ac01b070 con 0x7f17bc0c6c80 2024-05-10T11:13:30.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.107+0000 7f17a37fe640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17a80762d0 0x7f17a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:30.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.107+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f17ac0969a0 con 0x7f17bc0c6c80 2024-05-10T11:13:30.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.107+0000 7f17ba7fc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17a80762d0 0x7f17a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:30.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.108+0000 7f17ba7fc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17a80762d0 0x7f17a8078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17b0037000 tx=0x7f17b0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:30.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.111+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f17bc068ca0 con 0x7f17bc0c6c80 2024-05-10T11:13:30.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.342+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17bc06a220 con 0x7f17bc0c6c80 2024-05-10T11:13:30.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.342+0000 7f17a37fe640 1 -- 172.21.15.66:0/1991501408 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f17ac060200 con 0x7f17bc0c6c80 2024-05-10T11:13:30.341 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:13:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17a80762d0 msgr2=0x7f17a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17a80762d0 0x7f17a8078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17b0037000 tx=0x7f17b0032000 comp rx=0 tx=0).stop 2024-05-10T11:13:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 msgr2=0x7f17bc0add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0add50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c460 tx=0x7f17ac00c920 comp rx=0 tx=0).stop 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 shutdown_connections 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17a80762d0 0x7f17a8078790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17bc1598c0 0x7f17bc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17bc0cee40 0x7f17bc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 --2- 172.21.15.66:0/1991501408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17bc0c6c80 0x7f17bc0add50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 >> 172.21.15.66:0/1991501408 conn(0x7f17bc0b2900 msgr2=0x7f17bc15f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 shutdown_connections 2024-05-10T11:13:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30.344+0000 7f17c14cc640 1 -- 172.21.15.66:0/1991501408 wait complete. 2024-05-10T11:13:30.354 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:13:30.354 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:13:30.354 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:13:30.354 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:13:30.354 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:13:30.355 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:13:30.355 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:13:30.355 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:13:30.355 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:13:30.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.355 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:13:30.371 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:13:30.372 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42683sec preferred_lft 42683sec 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:13:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:13:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:13:30.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.375 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:13:30.437 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:13:30.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.439 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:13:30.496 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:13:30.496 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:13:30.496 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:13:30.496 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:13:30.497 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:13:30.497 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:13:30.497 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:13:30.497 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:13:30.497 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:13:30.497 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:13:30.497 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:13:30.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:13:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:30.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.626 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:13:30.642 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:13:30.642 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:13:30.642 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:13:30.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.642 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:13:30.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:13:30.708 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:13:30.764 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:13:30.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:13:30.764 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:13:30.819 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:13:30.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.820 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:13:30.905 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:13:30.905 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:13:30.905 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:13:30.914 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:13:30.914 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:13:30.914 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:13:30.914 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:13:30.914 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:13:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:13:30.930 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:13:30.930 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:13:30.930 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:13:30.930 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:13:30.930 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:13:30.931 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:13:30.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:30.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:13:30.957 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:13:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:13:31.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:31.061 INFO:teuthology.orchestra.run.smithi066.stdout:client5118 2024-05-10T11:13:31.061 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:31.061 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:31.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:31.078 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-05-10T11:13:31.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:31.139 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-05-10T11:13:31.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:31.197 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-05-10T11:13:31.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:13:31.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:31.255 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-05-10T11:13:31.297 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:13:31.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:31.318 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-05-10T11:13:31.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:31.405 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T11:13:31.465 INFO:teuthology.orchestra.run.smithi066.stdout:./ 2024-05-10T11:13:31.465 INFO:teuthology.orchestra.run.smithi066.stdout:./rfile 2024-05-10T11:13:31.465 INFO:teuthology.orchestra.run.smithi066.stdout:./parentdir 2024-05-10T11:13:31.465 INFO:teuthology.orchestra.run.smithi066.stdout:./parentdir/pfile 2024-05-10T11:13:31.466 INFO:teuthology.orchestra.run.smithi066.stdout:./parentdir/childdir 2024-05-10T11:13:31.466 INFO:teuthology.orchestra.run.smithi066.stdout:./parentdir/childdir/cfile 2024-05-10T11:13:31.466 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:13:31.466 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:13:31.466 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:13:31.466 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:13:31.466 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T11:13:31.466 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:13:31.574 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:13:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:31.584 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:13:31.584 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:13:31.584 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:13:31.584 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:13:31.584 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-05-10T11:13:31.584 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:13:31.694 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627778 2024-05-10T11:13:31.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:31.704 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:13:31.704 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:13:31.704 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:13:31.704 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:13:31.704 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-05-10T11:13:31.704 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:13:31.813 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:13:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:31.823 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:13:31.823 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:13:31.823 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:13:31.823 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:13:31.823 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-05-10T11:13:31.823 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:13:31.931 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628279 2024-05-10T11:13:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:31.941 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:13:31.941 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:13:31.941 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:13:31.942 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:13:31.942 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-05-10T11:13:31.942 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:13:32.049 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:13:32.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:32.059 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:13:32.059 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:13:32.059 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:13:32.059 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:13:32.059 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-05-10T11:13:32.059 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:13:32.166 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628280 2024-05-10T11:13:32.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:13:32.176 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:32.176 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:32.232 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:32.233 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:32.289 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:13:32.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.435+0000 7fb4f5d22640 1 Processor -- start 2024-05-10T11:13:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.435+0000 7fb4f5d22640 1 -- start start 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4f5d22640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb4f015f3b0 0x7fb4f00d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4f5d22640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4f015f790 0x7fb4f00d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4f5d22640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f00d30b0 con 0x7fb4f00d5d30 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4f5d22640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f00d3390 con 0x7fb4f015f790 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4f5d22640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f00c8c80 con 0x7fb4f015f3b0 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4f015f790 0x7fb4f00d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4f015f790 0x7fb4f00d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47220/0 (socket says 172.21.15.66:47220) 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 -- 172.21.15.66:0/4234737556 learned_addr learned my addr 172.21.15.66:0/4234737556 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4ef7fe640 1 --2- 172.21.15.66:0/4234737556 >> v2:172.21.15.190:3300/0 conn(0x7fb4f015f3b0 0x7fb4f00d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 -- 172.21.15.66:0/4234737556 >> v2:172.21.15.190:3300/0 conn(0x7fb4f015f3b0 msgr2=0x7fb4f00d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 --2- 172.21.15.66:0/4234737556 >> v2:172.21.15.190:3300/0 conn(0x7fb4f015f3b0 0x7fb4f00d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 -- 172.21.15.66:0/4234737556 >> v1:172.21.15.190:6789/0 conn(0x7fb4f00d5d30 legacy=0x7fb4f00c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.436+0000 7fb4eeffd640 1 -- 172.21.15.66:0/4234737556 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00c8f60 con 0x7fb4f015f790 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.437+0000 7fb4eeffd640 1 --2- 172.21.15.66:0/4234737556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f015f790 0x7fb4f00d3c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb4f008e820 tx=0x7fb4e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982a2cb69114b7e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.437+0000 7fb4ee7fc640 1 -- 172.21.15.66:0/4234737556 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4037070 con 0x7fb4f015f790 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.437+0000 7fb4ee7fc640 1 -- 172.21.15.66:0/4234737556 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4032440 con 0x7fb4f015f790 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.437+0000 7fb4ee7fc640 1 -- 172.21.15.66:0/4234737556 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4032810 con 0x7fb4f015f790 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 -- 172.21.15.66:0/4234737556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f015f790 msgr2=0x7fb4f00d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/4234737556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f015f790 0x7fb4f00d3c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb4f008e820 tx=0x7fb4e402a270 comp rx=0 tx=0).stop 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 -- 172.21.15.66:0/4234737556 shutdown_connections 2024-05-10T11:13:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/4234737556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f015f790 0x7fb4f00d3c30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/4234737556 >> v2:172.21.15.190:3300/0 conn(0x7fb4f015f3b0 0x7fb4f00d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 -- 172.21.15.66:0/4234737556 >> 172.21.15.66:0/4234737556 conn(0x7fb4f00d5130 msgr2=0x7fb4f00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:32.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 -- 172.21.15.66:0/4234737556 shutdown_connections 2024-05-10T11:13:32.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.438+0000 7fb4f5d22640 1 -- 172.21.15.66:0/4234737556 wait complete. 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.439+0000 7fb4f5d22640 1 Processor -- start 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.439+0000 7fb4f5d22640 1 -- start start 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4f5d22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f00d5d30 0x7fb4f0154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4f5d22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f015f3b0 0x7fb4f0156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4f5d22640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 0x7fb4f00cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4f5d22640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f00d0e60 con 0x7fb4f0156cd0 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4f5d22640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f00d0ce0 con 0x7fb4f015f3b0 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4f5d22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f00d0fe0 con 0x7fb4f00d5d30 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4effff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 0x7fb4f00cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4effff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 0x7fb4f00cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47236/0 (socket says 172.21.15.66:47236) 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4effff640 1 -- 172.21.15.66:0/1534879620 learned_addr learned my addr 172.21.15.66:0/1534879620 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4ef7fe640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f00d5d30 0x7fb4f0154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.440+0000 7fb4eeffd640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f015f3b0 0x7fb4f0156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4effff640 1 -- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f00d5d30 msgr2=0x7fb4f0154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4effff640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f00d5d30 0x7fb4f0154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4effff640 1 -- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f015f3b0 msgr2=0x7fb4f0156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4effff640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f015f3b0 0x7fb4f0156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4effff640 1 -- 172.21.15.66:0/1534879620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00cd210 con 0x7fb4f0156cd0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4effff640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 0x7fb4f00cc4a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800c7d0 tx=0x7fb4e800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8003b70 con 0x7fb4f0156cd0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e8003d30 con 0x7fb4f0156cd0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800aa90 con 0x7fb4f0156cd0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f00cd4f0 con 0x7fb4f0156cd0 2024-05-10T11:13:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.441+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f00cdab0 con 0x7fb4f0156cd0 2024-05-10T11:13:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.442+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f0069460 con 0x7fb4f0156cd0 2024-05-10T11:13:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.443+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4e800ac30 con 0x7fb4f0156cd0 2024-05-10T11:13:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.443+0000 7fb4d7fff640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4dc0762d0 0x7fb4dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.443+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fb4e8097520 con 0x7fb4f0156cd0 2024-05-10T11:13:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.443+0000 7fb4ef7fe640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4dc0762d0 0x7fb4dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.444+0000 7fb4ef7fe640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4dc0762d0 0x7fb4dc078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4f01f8640 tx=0x7fb4e0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:32.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.448+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb4f0069460 con 0x7fb4f0156cd0 2024-05-10T11:13:32.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.654+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb4f006a220 con 0x7fb4f0156cd0 2024-05-10T11:13:32.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.655+0000 7fb4d7fff640 1 -- 172.21.15.66:0/1534879620 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7fb4e8060730 con 0x7fb4f0156cd0 2024-05-10T11:13:32.654 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:13:32.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4dc0762d0 msgr2=0x7fb4dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4dc0762d0 0x7fb4dc078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4f01f8640 tx=0x7fb4e0009190 comp rx=0 tx=0).stop 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 msgr2=0x7fb4f00cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 0x7fb4f00cc4a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800c7d0 tx=0x7fb4e800cc90 comp rx=0 tx=0).stop 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 shutdown_connections 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4dc0762d0 0x7fb4dc078790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4f0156cd0 0x7fb4f00cc4a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f015f3b0 0x7fb4f0156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 --2- 172.21.15.66:0/1534879620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f00d5d30 0x7fb4f0154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 >> 172.21.15.66:0/1534879620 conn(0x7fb4f00d5130 msgr2=0x7fb4f00d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 shutdown_connections 2024-05-10T11:13:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.657+0000 7fb4f5d22640 1 -- 172.21.15.66:0/1534879620 wait complete. 2024-05-10T11:13:32.667 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:13:32.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:32.667 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:13:32.730 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:13:32.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:13:32.730 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:13:32.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:32.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.895+0000 7fcc39946640 1 Processor -- start 2024-05-10T11:13:32.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.895+0000 7fcc39946640 1 -- start start 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc39946640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcc341608b0 0x7fcc340d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc39946640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc34160c90 con 0x7fcc340d03c0 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc39946640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340ce5f0 con 0x7fcc340d1230 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc39946640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fcc340ce8d0 con 0x7fcc341608b0 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc32ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcc341608b0 0x7fcc340d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc337fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fcc340d03c0 0x7fcc340b3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49428/0 (socket says 172.21.15.66:49428) 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc337fe640 1 -- 172.21.15.66:0/571716364 learned_addr learned my addr 172.21.15.66:0/571716364 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:32.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc32ffd640 1 -- 172.21.15.66:0/571716364 >> v1:172.21.15.190:6789/0 conn(0x7fcc340d1230 legacy=0x7fcc340b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc32ffd640 1 -- 172.21.15.66:0/571716364 >> v1:172.21.15.66:6789/0 conn(0x7fcc340d03c0 legacy=0x7fcc340b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc32ffd640 1 -- 172.21.15.66:0/571716364 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340cebb0 con 0x7fcc341608b0 2024-05-10T11:13:32.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.896+0000 7fcc31ffb640 1 -- 172.21.15.66:0/571716364 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606144178 0 0) 0x7fcc24001110 con 0x7fcc340d03c0 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.897+0000 7fcc32ffd640 1 --2- 172.21.15.66:0/571716364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc341608b0 0x7fcc340d0cf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009d90 tx=0x7fcc2c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fa889c5655060b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.897+0000 7fcc31ffb640 1 -- 172.21.15.66:0/571716364 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c007740 con 0x7fcc341608b0 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.897+0000 7fcc31ffb640 1 -- 172.21.15.66:0/571716364 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0078e0 con 0x7fcc341608b0 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.897+0000 7fcc31ffb640 1 -- 172.21.15.66:0/571716364 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c007cb0 con 0x7fcc341608b0 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 -- 172.21.15.66:0/571716364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc341608b0 msgr2=0x7fcc340d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 --2- 172.21.15.66:0/571716364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc341608b0 0x7fcc340d0cf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009d90 tx=0x7fcc2c02a6f0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 -- 172.21.15.66:0/571716364 shutdown_connections 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 --2- 172.21.15.66:0/571716364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc341608b0 0x7fcc340d0cf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 -- 172.21.15.66:0/571716364 >> 172.21.15.66:0/571716364 conn(0x7fcc340d2df0 msgr2=0x7fcc340d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 -- 172.21.15.66:0/571716364 shutdown_connections 2024-05-10T11:13:32.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.898+0000 7fcc39946640 1 -- 172.21.15.66:0/571716364 wait complete. 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.899+0000 7fcc39946640 1 Processor -- start 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.899+0000 7fcc39946640 1 -- start start 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc39946640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc340d03c0 0x7fcc341576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc39946640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 0x7fcc340711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc39946640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc341608b0 0x7fcc34071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc39946640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340d1f10 con 0x7fcc340d1230 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc39946640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340d1d90 con 0x7fcc341608b0 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc39946640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcc340d16e0 con 0x7fcc340d03c0 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc327fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 0x7fcc340711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc327fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 0x7fcc340711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47258/0 (socket says 172.21.15.66:47258) 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc327fc640 1 -- 172.21.15.66:0/1436210391 learned_addr learned my addr 172.21.15.66:0/1436210391 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc32ffd640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc340d03c0 0x7fcc341576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc337fe640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc341608b0 0x7fcc34071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.900+0000 7fcc327fc640 1 -- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc340d03c0 msgr2=0x7fcc341576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc327fc640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc340d03c0 0x7fcc341576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc327fc640 1 -- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc341608b0 msgr2=0x7fcc34071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc327fc640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc341608b0 0x7fcc34071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc327fc640 1 -- 172.21.15.66:0/1436210391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340c94a0 con 0x7fcc340d1230 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc337fe640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc341608b0 0x7fcc34071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc327fc640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 0x7fcc340711d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c450 tx=0x7fcc1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0052d0 con 0x7fcc340d1230 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c005470 con 0x7fcc340d1230 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3406d570 con 0x7fcc340d1230 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c012870 con 0x7fcc340d1230 2024-05-10T11:13:32.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.901+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3406db30 con 0x7fcc340d1230 2024-05-10T11:13:32.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.902+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3406dd30 con 0x7fcc340d1230 2024-05-10T11:13:32.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.903+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc1c012a10 con 0x7fcc340d1230 2024-05-10T11:13:32.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.903+0000 7fcc2bfff640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcc140762d0 0x7fcc14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:32.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.903+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fcc1c097200 con 0x7fcc340d1230 2024-05-10T11:13:32.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.903+0000 7fcc32ffd640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcc140762d0 0x7fcc14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:32.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.904+0000 7fcc32ffd640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcc140762d0 0x7fcc14078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c034000 tx=0x7fcc2c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:32.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:32.908+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcc3406dd30 con 0x7fcc340d1230 2024-05-10T11:13:33.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.136+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc3406a220 con 0x7fcc340d1230 2024-05-10T11:13:33.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.137+0000 7fcc2bfff640 1 -- 172.21.15.66:0/1436210391 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7fcc1c060380 con 0x7fcc340d1230 2024-05-10T11:13:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:33.137 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:33.137 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcc140762d0 msgr2=0x7fcc14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcc140762d0 0x7fcc14078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c034000 tx=0x7fcc2c02f000 comp rx=0 tx=0).stop 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 msgr2=0x7fcc340711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 0x7fcc340711d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c450 tx=0x7fcc1c00c910 comp rx=0 tx=0).stop 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 shutdown_connections 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcc140762d0 0x7fcc14078790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc341608b0 0x7fcc34071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc340d1230 0x7fcc340711d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 --2- 172.21.15.66:0/1436210391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc340d03c0 0x7fcc341576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 >> 172.21.15.66:0/1436210391 conn(0x7fcc340d2df0 msgr2=0x7fcc340afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:33.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 shutdown_connections 2024-05-10T11:13:33.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.139+0000 7fcc39946640 1 -- 172.21.15.66:0/1436210391 wait complete. 2024-05-10T11:13:33.150 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-10T11:13:33.283 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:13:33.284 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:13:33.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:33.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.388+0000 7f6f6edc8640 1 Processor -- start 2024-05-10T11:13:33.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.388+0000 7f6f6edc8640 1 -- start start 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6edc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f680c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6edc8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6f680cf170 0x7f6f6815f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6edc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f680c5d10 con 0x7f6f680cf5d0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6edc8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6f680cc380 con 0x7f6f680cf170 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6edc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6f680c5ff0 con 0x7f6f6815b6d0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6d365640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6f680cf5d0 0x7f6f6806dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49438/0 (socket says 172.21.15.66:49438) 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6d365640 1 -- 172.21.15.66:0/2230065727 learned_addr learned my addr 172.21.15.66:0/2230065727 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f680c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.389+0000 7f6f67fff640 1 --2- 172.21.15.66:0/2230065727 >> v2:172.21.15.190:3300/0 conn(0x7f6f680cf170 0x7f6f6815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369746169 0 0) 0x7f6f680c5d10 con 0x7f6f680cf5d0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f50003520 con 0x7f6f680cf5d0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1226814024 0 0) 0x7f6f50003520 con 0x7f6f680cf5d0 2024-05-10T11:13:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 msgr2=0x7f6f680c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f680c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 >> v2:172.21.15.190:3300/0 conn(0x7f6f680cf170 msgr2=0x7f6f6815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 --2- 172.21.15.66:0/2230065727 >> v2:172.21.15.190:3300/0 conn(0x7f6f680cf170 0x7f6f6815f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f680c62d0 con 0x7f6f680cf5d0 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f6f600019f0 con 0x7f6f680cf5d0 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 >> v1:172.21.15.66:6789/0 conn(0x7f6f680cf5d0 legacy=0x7f6f6806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50003ef0 0x7f6f50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f50004d40 0x7f6f500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f680c5ff0 con 0x7f6f50003ef0 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5000b9c0 con 0x7f6f50004d40 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5000bb40 con 0x7f6f6815b6d0 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f67fff640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50003ef0 0x7f6f50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f6d365640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f50004d40 0x7f6f500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f67fff640 1 -- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 msgr2=0x7f6f500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f67fff640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f67fff640 1 -- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f50004d40 msgr2=0x7f6f500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f67fff640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f50004d40 0x7f6f500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f67fff640 1 -- 172.21.15.66:0/2230065727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f50003520 con 0x7f6f50003ef0 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.390+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6815b6d0 0x7f6f500039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.391+0000 7f6f67fff640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50003ef0 0x7f6f50004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009ac0 tx=0x7f6f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd97c9c89a2550d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.391+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c036070 con 0x7f6f50003ef0 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.391+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c031400 con 0x7f6f50003ef0 2024-05-10T11:13:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.391+0000 7f6f677fe640 1 -- 172.21.15.66:0/2230065727 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c009690 con 0x7f6f50003ef0 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6edc8640 1 -- 172.21.15.66:0/2230065727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50003ef0 msgr2=0x7f6f50004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/2230065727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50003ef0 0x7f6f50004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009ac0 tx=0x7f6f50005830 comp rx=0 tx=0).stop 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6d365640 1 -- 172.21.15.66:0/2230065727 reap_dead start 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6edc8640 1 -- 172.21.15.66:0/2230065727 shutdown_connections 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6edc8640 1 -- 172.21.15.66:0/2230065727 >> 172.21.15.66:0/2230065727 conn(0x7f6f680b2900 msgr2=0x7f6f680b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6edc8640 1 -- 172.21.15.66:0/2230065727 shutdown_connections 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.392+0000 7f6f6edc8640 1 -- 172.21.15.66:0/2230065727 wait complete. 2024-05-10T11:13:33.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.393+0000 7f6f6edc8640 1 Processor -- start 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.393+0000 7f6f6edc8640 1 -- start start 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6edc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f50003ef0 0x7f6f68156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6edc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 0x7f6f6806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6edc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f680afa40 0x7f6f6806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6edc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f680cd170 con 0x7f6f680af5c0 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6edc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6f680c6890 con 0x7f6f680afa40 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6edc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6f680cd2f0 con 0x7f6f50003ef0 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 0x7f6f6806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 0x7f6f6806e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47276/0 (socket says 172.21.15.66:47276) 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 -- 172.21.15.66:0/3457196967 learned_addr learned my addr 172.21.15.66:0/3457196967 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f50003ef0 0x7f6f68156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6d365640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f680afa40 0x7f6f6806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 -- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f50003ef0 msgr2=0x7f6f68156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f50003ef0 0x7f6f68156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 -- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f680afa40 msgr2=0x7f6f6806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f680afa40 0x7f6f6806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f67fff640 1 -- 172.21.15.66:0/3457196967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f680c9430 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f50003ef0 0x7f6f68156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.394+0000 7f6f6d365640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f680afa40 0x7f6f6806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.395+0000 7f6f67fff640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 0x7f6f6806e440 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c000c00 tx=0x7f6f5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.395+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c040020 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.395+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c003c60 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.395+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f680c9710 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.395+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c036040 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.395+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f680c9cd0 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.396+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6806a220 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.396+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6f5c043020 con 0x7f6f680af5c0 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.397+0000 7f6f657fa640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f540762d0 0x7f6f54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.397+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f6f5c0b7920 con 0x7f6f680af5c0 2024-05-10T11:13:33.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.397+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f540762d0 0x7f6f54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:33.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.397+0000 7f6f6cb64640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f540762d0 0x7f6f54078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009c80 tx=0x7f6f58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:33.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.401+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6f5c04a070 con 0x7f6f680af5c0 2024-05-10T11:13:33.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.634+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f68159fb0 con 0x7f6f680af5c0 2024-05-10T11:13:33.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.634+0000 7f6f657fa640 1 -- 172.21.15.66:0/3457196967 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f6f5c0044e0 con 0x7f6f680af5c0 2024-05-10T11:13:33.634 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:33.634 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:33.634 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.636+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f540762d0 msgr2=0x7f6f54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.636+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f540762d0 0x7f6f54078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009c80 tx=0x7f6f58008040 comp rx=0 tx=0).stop 2024-05-10T11:13:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.636+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 msgr2=0x7f6f6806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.636+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 0x7f6f6806e440 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c000c00 tx=0x7f6f5c004730 comp rx=0 tx=0).stop 2024-05-10T11:13:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 shutdown_connections 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f540762d0 0x7f6f54078790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f680afa40 0x7f6f6806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f680af5c0 0x7f6f6806e440 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 --2- 172.21.15.66:0/3457196967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f50003ef0 0x7f6f68156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 >> 172.21.15.66:0/3457196967 conn(0x7f6f680b2900 msgr2=0x7f6f680b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 shutdown_connections 2024-05-10T11:13:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:33.637+0000 7f6f6edc8640 1 -- 172.21.15.66:0/3457196967 wait complete. 2024-05-10T11:13:33.647 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-05-10T11:13:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-05-10T11:13:33.773 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-05-10T11:13:43.773 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-05-10T11:13:43.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 Processor -- start 2024-05-10T11:13:43.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 -- start start 2024-05-10T11:13:43.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee4bfef0 0x5555ee5808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee50b270 0x5555ee59a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 0x5555ee599240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5555ee50b6e0 con 0x5555ee582440 2024-05-10T11:13:43.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5555ee4ef010 con 0x5555ee50b270 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.826+0000 7f0477337f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5555ee4ef2f0 con 0x5555ee4bfef0 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 0x5555ee599240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 0x5555ee599240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52088/0 (socket says 172.21.15.66:52088) 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 -- 172.21.15.66:0/2644280693 learned_addr learned my addr 172.21.15.66:0/2644280693 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0474630640 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee50b270 0x5555ee59a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0474e31640 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee4bfef0 0x5555ee5808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 -- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee4bfef0 msgr2=0x5555ee5808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee4bfef0 0x5555ee5808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 -- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee50b270 msgr2=0x5555ee59a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee50b270 0x5555ee59a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 -- 172.21.15.66:0/2644280693 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee42a350 con 0x5555ee582440 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f0475632640 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 0x5555ee599240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f046c025a20 tx=0x7f046c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de21b304745c8124 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f047362e640 1 -- 172.21.15.66:0/2644280693 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c055040 con 0x5555ee582440 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f047362e640 1 -- 172.21.15.66:0/2644280693 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c051ba0 con 0x5555ee582440 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.827+0000 7f047362e640 1 -- 172.21.15.66:0/2644280693 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c05c440 con 0x5555ee582440 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 -- 172.21.15.66:0/2644280693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 msgr2=0x5555ee599240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 0x5555ee599240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f046c025a20 tx=0x7f046c050000 comp rx=0 tx=0).stop 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 -- 172.21.15.66:0/2644280693 shutdown_connections 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee582440 0x5555ee599240 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee50b270 0x5555ee59a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 --2- 172.21.15.66:0/2644280693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee4bfef0 0x5555ee5808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 -- 172.21.15.66:0/2644280693 >> 172.21.15.66:0/2644280693 conn(0x5555ee4eb800 msgr2=0x5555ee4ec470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 -- 172.21.15.66:0/2644280693 shutdown_connections 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.828+0000 7f0477337f40 1 -- 172.21.15.66:0/2644280693 wait complete. 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 Processor -- start 2024-05-10T11:13:43.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 -- start start 2024-05-10T11:13:43.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee4bfef0 0x5555ee508360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee50b270 0x5555ee57d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee582440 0x5555ee578a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5555ee59cff0 con 0x5555ee4bfef0 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5555ee5814b0 con 0x5555ee582440 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0477337f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5555ee57c440 con 0x5555ee50b270 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0474e31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee4bfef0 0x5555ee508360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0474e31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee4bfef0 0x5555ee508360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52098/0 (socket says 172.21.15.66:52098) 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.829+0000 7f0474e31640 1 -- 172.21.15.66:0/3166977484 learned_addr learned my addr 172.21.15.66:0/3166977484 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0475632640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee582440 0x5555ee578a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474630640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee50b270 0x5555ee57d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474e31640 1 -- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee50b270 msgr2=0x5555ee57d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474e31640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5555ee50b270 0x5555ee57d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474e31640 1 -- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee582440 msgr2=0x5555ee578a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474e31640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5555ee582440 0x5555ee578a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474e31640 1 -- 172.21.15.66:0/3166977484 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee57dcc0 con 0x5555ee4bfef0 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0474e31640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee4bfef0 0x5555ee508360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0464009e50 tx=0x7f0464009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f047262c640 1 -- 172.21.15.66:0/3166977484 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046401b070 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f047262c640 1 -- 172.21.15.66:0/3166977484 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0464016480 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ee505290 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f047262c640 1 -- 172.21.15.66:0/3166977484 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464016870 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.830+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ee505850 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.832+0000 7f047262c640 1 -- 172.21.15.66:0/3166977484 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f046401e070 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.832+0000 7f047262c640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0460074ce0 0x7f04600771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.833+0000 7f047262c640 1 -- 172.21.15.66:0/3166977484 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f0464095b00 con 0x5555ee4bfef0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.833+0000 7f0474630640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0460074ce0 0x7f04600771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.833+0000 7f0477337f40 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x5555ee57bdc0 0x5555ee506330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.833+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5555ee506870 con 0x5555ee57bdc0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.833+0000 7f0475632640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x5555ee57bdc0 0x5555ee506330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.833+0000 7f0474630640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0460074ce0 0x7f04600771a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0468005fd0 tx=0x7f046800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0475632640 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x5555ee57bdc0 0x5555ee506330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0475632640 1 -- 172.21.15.66:0/3166977484 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f046c05c4c0 con 0x5555ee57bdc0 2024-05-10T11:13:43.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x5555ee57bdc0 msgr2=0x5555ee506330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x5555ee57bdc0 0x5555ee506330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0460074ce0 msgr2=0x7f04600771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0460074ce0 0x7f04600771a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0468005fd0 tx=0x7f046800d040 comp rx=0 tx=0).stop 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee4bfef0 msgr2=0x5555ee508360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 --2- 172.21.15.66:0/3166977484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5555ee4bfef0 0x5555ee508360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0464009e50 tx=0x7f0464009f40 comp rx=0 tx=0).stop 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0475632640 1 -- 172.21.15.66:0/3166977484 reap_dead start 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 shutdown_connections 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 >> 172.21.15.66:0/3166977484 conn(0x5555ee4eb800 msgr2=0x5555ee5808c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 shutdown_connections 2024-05-10T11:13:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.834+0000 7f0477337f40 1 -- 172.21.15.66:0/3166977484 wait complete. 2024-05-10T11:13:43.838 INFO:teuthology.orchestra.run.smithi066.stdout:mytag 2024-05-10T11:13:43.839 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-05-10T11:13:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.886+0000 7fdfb2320f40 1 Processor -- start 2024-05-10T11:13:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 -- start start 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd901dc60 0x559fd90ab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd90a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 0x559fd90aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559fd901e260 con 0x559fd90aca30 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559fd8f7df50 con 0x559fd901dc60 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfb2320f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559fd90abf50 con 0x559fd90a9180 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfafd00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 0x559fd90aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfaf4ff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd901dc60 0x559fd90ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfafd00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 0x559fd90aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52108/0 (socket says 172.21.15.66:52108) 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfafd00640 1 -- 172.21.15.66:0/3947124065 learned_addr learned my addr 172.21.15.66:0/3947124065 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.887+0000 7fdfaecfe640 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd90a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfafd00640 1 -- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 msgr2=0x559fd90a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfafd00640 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd90a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfafd00640 1 -- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd901dc60 msgr2=0x559fd90ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:43.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfafd00640 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd901dc60 0x559fd90ab030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfafd00640 1 -- 172.21.15.66:0/3947124065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fd9001680 con 0x559fd90aca30 2024-05-10T11:13:43.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfafd00640 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 0x559fd90aa250 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800a590 tx=0x7fdfa800a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894ff2f81a737c14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfadcfc640 1 -- 172.21.15.66:0/3947124065 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8018070 con 0x559fd90aca30 2024-05-10T11:13:43.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfadcfc640 1 -- 172.21.15.66:0/3947124065 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8007600 con 0x559fd90aca30 2024-05-10T11:13:43.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.888+0000 7fdfadcfc640 1 -- 172.21.15.66:0/3947124065 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80079d0 con 0x559fd90aca30 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 -- 172.21.15.66:0/3947124065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 msgr2=0x559fd90aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 0x559fd90aa250 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800a590 tx=0x7fdfa800a680 comp rx=0 tx=0).stop 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 -- 172.21.15.66:0/3947124065 shutdown_connections 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd90aca30 0x559fd90aa250 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd90a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/3947124065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd901dc60 0x559fd90ab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 -- 172.21.15.66:0/3947124065 >> 172.21.15.66:0/3947124065 conn(0x559fd9000800 msgr2=0x559fd9001a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 -- 172.21.15.66:0/3947124065 shutdown_connections 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 -- 172.21.15.66:0/3947124065 wait complete. 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 Processor -- start 2024-05-10T11:13:43.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.889+0000 7fdfb2320f40 1 -- start start 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfb2320f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd901dc60 0x559fd90057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfb2320f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd9003c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfb2320f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd90aca30 0x559fd909d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfb2320f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559fd90a9620 con 0x559fd901dc60 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfb2320f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559fd8fd7fb0 con 0x559fd90aca30 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfb2320f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559fd8fd8590 con 0x559fd90a9180 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd901dc60 0x559fd90057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd901dc60 0x559fd90057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52124/0 (socket says 172.21.15.66:52124) 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 -- 172.21.15.66:0/2088861303 learned_addr learned my addr 172.21.15.66:0/2088861303 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaecfe640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd9003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfafd00640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd90aca30 0x559fd909d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 -- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 msgr2=0x559fd9003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd9003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 -- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd90aca30 msgr2=0x559fd909d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fd90aca30 0x559fd909d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaf4ff640 1 -- 172.21.15.66:0/2088861303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fd8fd5000 con 0x559fd901dc60 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.890+0000 7fdfaecfe640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559fd90a9180 0x559fd9003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.891+0000 7fdfaf4ff640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd901dc60 0x559fd90057b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0000f80 tx=0x7fdfa0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.891+0000 7fdfaccfa640 1 -- 172.21.15.66:0/2088861303 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0055040 con 0x559fd901dc60 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.891+0000 7fdfaccfa640 1 -- 172.21.15.66:0/2088861303 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa0066640 con 0x559fd901dc60 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.891+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fd8fd52a0 con 0x559fd901dc60 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.891+0000 7fdfaccfa640 1 -- 172.21.15.66:0/2088861303 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00669f0 con 0x559fd901dc60 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.891+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fd901c8a0 con 0x559fd901dc60 2024-05-10T11:13:43.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.892+0000 7fdfaccfa640 1 -- 172.21.15.66:0/2088861303 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdfa0058020 con 0x559fd901dc60 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.893+0000 7fdfaccfa640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdf9c074cb0 0x7fdf9c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.893+0000 7fdfaccfa640 1 -- 172.21.15.66:0/2088861303 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fdfa00da9b0 con 0x559fd901dc60 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.893+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x559fd909dc40 0x559fd91396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.893+0000 7fdfaecfe640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdf9c074cb0 0x7fdf9c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.893+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559fd909d850 con 0x559fd909dc40 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfafd00640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x559fd909dc40 0x559fd91396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfaecfe640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdf9c074cb0 0x7fdf9c077170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x559fd901d560 tx=0x7fdfa4001780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfafd00640 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x559fd909dc40 0x559fd91396c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfafd00640 1 -- 172.21.15.66:0/2088861303 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fdfa8007830 con 0x559fd909dc40 2024-05-10T11:13:43.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x559fd909dc40 msgr2=0x559fd91396c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x559fd909dc40 0x559fd91396c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdf9c074cb0 msgr2=0x7fdf9c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.894+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdf9c074cb0 0x7fdf9c077170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x559fd901d560 tx=0x7fdfa4001780 comp rx=0 tx=0).stop 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd901dc60 msgr2=0x559fd90057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfb2320f40 1 --2- 172.21.15.66:0/2088861303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fd901dc60 0x559fd90057b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0000f80 tx=0x7fdfa0003330 comp rx=0 tx=0).stop 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfafd00640 1 -- 172.21.15.66:0/2088861303 reap_dead start 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 shutdown_connections 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 >> 172.21.15.66:0/2088861303 conn(0x559fd9000800 msgr2=0x559fd9001a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 shutdown_connections 2024-05-10T11:13:43.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.895+0000 7fdfb2320f40 1 -- 172.21.15.66:0/2088861303 wait complete. 2024-05-10T11:13:43.898 INFO:teuthology.orchestra.run.smithi066.stdout:mytag 2024-05-10T11:13:43.898 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-05-10T11:13:43.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.944+0000 7efe6d8f6f40 1 Processor -- start 2024-05-10T11:13:43.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 -- start start 2024-05-10T11:13:43.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 0x562c8aed5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8aece460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8aed33f0 0x562c8ae2b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c8aed60c0 con 0x562c8ae305b0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562c8ada7f50 con 0x562c8ae47b20 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6d8f6f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562c8aed63a0 con 0x562c8aed33f0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6b3f2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 0x562c8aed5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6b3f2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 0x562c8aed5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52150/0 (socket says 172.21.15.66:52150) 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6b3f2640 1 -- 172.21.15.66:0/1169117910 learned_addr learned my addr 172.21.15.66:0/1169117910 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe6bbf3640 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8aed33f0 0x562c8ae2b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.945+0000 7efe63fff640 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8aece460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6b3f2640 1 -- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8aed33f0 msgr2=0x562c8ae2b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6b3f2640 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8aed33f0 0x562c8ae2b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6b3f2640 1 -- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 msgr2=0x562c8aece460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6b3f2640 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8aece460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6b3f2640 1 -- 172.21.15.66:0/1169117910 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8ae2b830 con 0x562c8ae305b0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6b3f2640 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 0x562c8aed5290 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00a430 tx=0x7efe5c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155ad6cfa82e9e09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6a3f0640 1 -- 172.21.15.66:0/1169117910 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00b920 con 0x562c8ae305b0 2024-05-10T11:13:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6a3f0640 1 -- 172.21.15.66:0/1169117910 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5c00f030 con 0x562c8ae305b0 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6a3f0640 1 -- 172.21.15.66:0/1169117910 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00bd20 con 0x562c8ae305b0 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/1169117910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 msgr2=0x562c8aed5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 0x562c8aed5290 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00a430 tx=0x7efe5c00a8f0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/1169117910 shutdown_connections 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8aed33f0 0x562c8ae2b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8aece460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/1169117910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8ae305b0 0x562c8aed5290 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.946+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/1169117910 >> 172.21.15.66:0/1169117910 conn(0x562c8ae2a800 msgr2=0x562c8ae2abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.947+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/1169117910 shutdown_connections 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.947+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/1169117910 wait complete. 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.947+0000 7efe6d8f6f40 1 Processor -- start 2024-05-10T11:13:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.947+0000 7efe6d8f6f40 1 -- start start 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6d8f6f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8ae305b0 0x562c8adfe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6d8f6f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8ae45180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6d8f6f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8aed33f0 0x562c8aec7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6d8f6f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c8aec70f0 con 0x562c8aed33f0 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6d8f6f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562c8ae029b0 con 0x562c8ae47b20 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6d8f6f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562c8aec7340 con 0x562c8ae305b0 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8aed33f0 0x562c8aec7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8aed33f0 0x562c8aec7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52156/0 (socket says 172.21.15.66:52156) 2024-05-10T11:13:43.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 -- 172.21.15.66:0/3250174922 learned_addr learned my addr 172.21.15.66:0/3250174922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6b3f2640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8ae305b0 0x562c8adfe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe63fff640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8ae45180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 -- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8ae305b0 msgr2=0x562c8adfe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c8ae305b0 0x562c8adfe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 -- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 msgr2=0x562c8ae45180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c8ae47b20 0x562c8ae45180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.948+0000 7efe6bbf3640 1 -- 172.21.15.66:0/3250174922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8ae026a0 con 0x562c8aed33f0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.949+0000 7efe6bbf3640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8aed33f0 0x562c8aec7e20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b4b0 tx=0x7efe6400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.949+0000 7efe693ee640 1 -- 172.21.15.66:0/3250174922 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64016020 con 0x562c8aed33f0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.949+0000 7efe693ee640 1 -- 172.21.15.66:0/3250174922 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe64012660 con 0x562c8aed33f0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.949+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c8ae2b470 con 0x562c8aed33f0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.949+0000 7efe693ee640 1 -- 172.21.15.66:0/3250174922 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64012a30 con 0x562c8aed33f0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.949+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8aec6e10 con 0x562c8aed33f0 2024-05-10T11:13:43.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.950+0000 7efe693ee640 1 -- 172.21.15.66:0/3250174922 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe64019020 con 0x562c8aed33f0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.951+0000 7efe693ee640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe4c074ce0 0x7efe4c0771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.951+0000 7efe693ee640 1 -- 172.21.15.66:0/3250174922 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7efe64096810 con 0x562c8aed33f0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.951+0000 7efe6b3f2640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe4c074ce0 0x7efe4c0771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.951+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562c8adff1e0 0x562c8af79930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.951+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562c8af79e70 con 0x562c8adff1e0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.951+0000 7efe63fff640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562c8adff1e0 0x562c8af79930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6b3f2640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe4c074ce0 0x7efe4c0771a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00a430 tx=0x7efe5c008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe63fff640 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562c8adff1e0 0x562c8af79930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe63fff640 1 -- 172.21.15.66:0/3250174922 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7efe54062440 con 0x562c8adff1e0 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562c8adff1e0 msgr2=0x562c8af79930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562c8adff1e0 0x562c8af79930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe4c074ce0 msgr2=0x7efe4c0771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe4c074ce0 0x7efe4c0771a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00a430 tx=0x7efe5c008000 comp rx=0 tx=0).stop 2024-05-10T11:13:43.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8aed33f0 msgr2=0x562c8aec7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:43.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 --2- 172.21.15.66:0/3250174922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c8aed33f0 0x562c8aec7e20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b4b0 tx=0x7efe6400b970 comp rx=0 tx=0).stop 2024-05-10T11:13:43.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6bbf3640 1 -- 172.21.15.66:0/3250174922 reap_dead start 2024-05-10T11:13:43.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 shutdown_connections 2024-05-10T11:13:43.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 >> 172.21.15.66:0/3250174922 conn(0x562c8ae2a800 msgr2=0x562c8ae2abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:43.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 shutdown_connections 2024-05-10T11:13:43.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:43.952+0000 7efe6d8f6f40 1 -- 172.21.15.66:0/3250174922 wait complete. 2024-05-10T11:13:43.956 INFO:teuthology.orchestra.run.smithi066.stdout:mytag 2024-05-10T11:13:43.956 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-05-10T11:13:44.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 Processor -- start 2024-05-10T11:13:44.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 -- start start 2024-05-10T11:13:44.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 0x55a279a84070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279a845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2799e4ce0 0x55a2799e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a27995df50 con 0x55a279a82670 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a279961f90 con 0x55a2799b4b20 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c77fef40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a279a8c040 con 0x55a2799e4ce0 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c52f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 0x55a279a84070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c52f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 0x55a279a84070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52174/0 (socket says 172.21.15.66:52174) 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.002+0000 7f00c52f8640 1 -- 172.21.15.66:0/62679922 learned_addr learned my addr 172.21.15.66:0/62679922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c5af9640 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2799e4ce0 0x55a2799e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c4af7640 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279a845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c52f8640 1 -- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2799e4ce0 msgr2=0x55a2799e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c52f8640 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2799e4ce0 0x55a2799e5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c52f8640 1 -- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 msgr2=0x55a279a845b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:44.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c52f8640 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279a845b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c52f8640 1 -- 172.21.15.66:0/62679922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a279a82a50 con 0x55a279a82670 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c52f8640 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 0x55a279a84070 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f00b8006200 tx=0x7f00b8006c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5b002417617b50 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00b77fe640 1 -- 172.21.15.66:0/62679922 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b8018070 con 0x55a279a82670 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00b77fe640 1 -- 172.21.15.66:0/62679922 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b8003950 con 0x55a279a82670 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00b77fe640 1 -- 172.21.15.66:0/62679922 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b8003d40 con 0x55a279a82670 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 -- 172.21.15.66:0/62679922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 msgr2=0x55a279a84070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 0x55a279a84070 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f00b8006200 tx=0x7f00b8006c30 comp rx=0 tx=0).stop 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 -- 172.21.15.66:0/62679922 shutdown_connections 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2799e4ce0 0x55a2799e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279a845b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 --2- 172.21.15.66:0/62679922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a279a82670 0x55a279a84070 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 -- 172.21.15.66:0/62679922 >> 172.21.15.66:0/62679922 conn(0x55a2799b6040 msgr2=0x55a2799e5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.003+0000 7f00c77fef40 1 -- 172.21.15.66:0/62679922 shutdown_connections 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.004+0000 7f00c77fef40 1 -- 172.21.15.66:0/62679922 wait complete. 2024-05-10T11:13:44.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.004+0000 7f00c77fef40 1 Processor -- start 2024-05-10T11:13:44.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.004+0000 7f00c77fef40 1 -- start start 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c77fef40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279b27aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c77fef40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2799e4ce0 0x55a279a7ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c77fef40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a279a82670 0x55a279a7f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c77fef40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a2799e0340 con 0x55a2799e4ce0 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c77fef40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a2799b69c0 con 0x55a2799b4b20 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c77fef40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a2799e0060 con 0x55a279a82670 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2799e4ce0 0x55a279a7ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2799e4ce0 0x55a279a7ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52186/0 (socket says 172.21.15.66:52186) 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 -- 172.21.15.66:0/3907595133 learned_addr learned my addr 172.21.15.66:0/3907595133 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c52f8640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279b27aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c5af9640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a279a82670 0x55a279a7f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 -- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a279a82670 msgr2=0x55a279a7f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a279a82670 0x55a279a7f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 -- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 msgr2=0x55a279b27aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2799b4b20 0x55a279b27aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 -- 172.21.15.66:0/3907595133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2799f72b0 con 0x55a2799e4ce0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.005+0000 7f00c4af7640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2799e4ce0 0x55a279a7ef50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001c20 tx=0x7f00bc00f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.006+0000 7f00b67fc640 1 -- 172.21.15.66:0/3907595133 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc016020 con 0x55a2799e4ce0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.006+0000 7f00b67fc640 1 -- 172.21.15.66:0/3907595133 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc00fd40 con 0x55a2799e4ce0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.006+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2799f7590 con 0x55a2799e4ce0 2024-05-10T11:13:44.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.006+0000 7f00b67fc640 1 -- 172.21.15.66:0/3907595133 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc012680 con 0x55a2799e4ce0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.006+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2799f7b50 con 0x55a2799e4ce0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.007+0000 7f00b67fc640 1 -- 172.21.15.66:0/3907595133 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00bc019020 con 0x55a2799e4ce0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00b67fc640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00a8074ce0 0x7f00a80771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00b67fc640 1 -- 172.21.15.66:0/3907595133 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f00bc0966b0 con 0x55a2799e4ce0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00c52f8640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00a8074ce0 0x7f00a80771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00c77fef40 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55a2799f6db0 0x55a279a81090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a279a815d0 con 0x55a2799f6db0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00c5af9640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55a2799f6db0 0x55a279a81090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00c52f8640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00a8074ce0 0x7f00a80771a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00b80061a0 tx=0x7f00b8014040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.008+0000 7f00c5af9640 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55a2799f6db0 0x55a279a81090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c5af9640 1 -- 172.21.15.66:0/3907595133 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f00c004f860 con 0x55a2799f6db0 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55a2799f6db0 msgr2=0x55a279a81090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55a2799f6db0 0x55a279a81090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00a8074ce0 msgr2=0x7f00a80771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f00a8074ce0 0x7f00a80771a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00b80061a0 tx=0x7f00b8014040 comp rx=0 tx=0).stop 2024-05-10T11:13:44.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2799e4ce0 msgr2=0x55a279a7ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 --2- 172.21.15.66:0/3907595133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2799e4ce0 0x55a279a7ef50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001c20 tx=0x7f00bc00f6b0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c5af9640 1 -- 172.21.15.66:0/3907595133 reap_dead start 2024-05-10T11:13:44.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 shutdown_connections 2024-05-10T11:13:44.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 >> 172.21.15.66:0/3907595133 conn(0x55a2799b6040 msgr2=0x55a2799e5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 shutdown_connections 2024-05-10T11:13:44.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.009+0000 7f00c77fef40 1 -- 172.21.15.66:0/3907595133 wait complete. 2024-05-10T11:13:44.013 INFO:teuthology.orchestra.run.smithi066.stdout:mytag 2024-05-10T11:13:44.013 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-05-10T11:13:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.059+0000 7f50be7edf40 1 Processor -- start 2024-05-10T11:13:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.059+0000 7f50be7edf40 1 -- start start 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50be7edf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a06680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50be7edf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769496a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50be7edf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x55769496a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50be7edf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576948e2f50 con 0x557694985380 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50be7edf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5576948e6f90 con 0x557694a0f610 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50be7edf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557694968e80 con 0x557694a0f230 2024-05-10T11:13:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a06680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a06680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52198/0 (socket says 172.21.15.66:52198) 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 -- 172.21.15.66:0/336342654 learned_addr learned my addr 172.21.15.66:0/336342654 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bbae6640 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769496a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bcae8640 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x55769496a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 -- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 msgr2=0x55769496a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769496a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 -- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 msgr2=0x55769496a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x55769496a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.060+0000 7f50bc2e7640 1 -- 172.21.15.66:0/336342654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557694a0fbd0 con 0x557694985380 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50bc2e7640 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a06680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f50ac001eb0 tx=0x7f50ac00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced529d15e07afb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50baae4640 1 -- 172.21.15.66:0/336342654 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac012020 con 0x557694985380 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50baae4640 1 -- 172.21.15.66:0/336342654 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac00e670 con 0x557694985380 2024-05-10T11:13:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50baae4640 1 -- 172.21.15.66:0/336342654 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00ea80 con 0x557694985380 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 -- 172.21.15.66:0/336342654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 msgr2=0x557694a06680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a06680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f50ac001eb0 tx=0x7f50ac00b780 comp rx=0 tx=0).stop 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 -- 172.21.15.66:0/336342654 shutdown_connections 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x55769496a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769496a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 --2- 172.21.15.66:0/336342654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a06680 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 -- 172.21.15.66:0/336342654 >> 172.21.15.66:0/336342654 conn(0x55769493b040 msgr2=0x557694a13870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 -- 172.21.15.66:0/336342654 shutdown_connections 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.061+0000 7f50be7edf40 1 -- 172.21.15.66:0/336342654 wait complete. 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.062+0000 7f50be7edf40 1 Processor -- start 2024-05-10T11:13:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.062+0000 7f50be7edf40 1 -- start start 2024-05-10T11:13:44.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50be7edf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a11be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50be7edf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769497ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50be7edf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x557694a05bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50be7edf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557694965d00 con 0x557694985380 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50be7edf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557694965a20 con 0x557694a0f610 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50be7edf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557694a0e910 con 0x557694a0f230 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a11be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a11be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52200/0 (socket says 172.21.15.66:52200) 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 -- 172.21.15.66:0/3576797162 learned_addr learned my addr 172.21.15.66:0/3576797162 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bcae8640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x557694a05bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bbae6640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769497ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 -- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 msgr2=0x55769497ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557694a0f230 0x55769497ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 -- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 msgr2=0x557694a05bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557694a0f610 0x557694a05bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 -- 172.21.15.66:0/3576797162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769497b2b0 con 0x557694985380 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50bc2e7640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a11be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f50ac011040 tx=0x7f50ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.063+0000 7f50b9ae2640 1 -- 172.21.15.66:0/3576797162 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00e470 con 0x557694985380 2024-05-10T11:13:44.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.064+0000 7f50b9ae2640 1 -- 172.21.15.66:0/3576797162 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac0197d0 con 0x557694985380 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.064+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55769497b590 con 0x557694985380 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.064+0000 7f50b9ae2640 1 -- 172.21.15.66:0/3576797162 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac019bc0 con 0x557694985380 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.064+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769497bb50 con 0x557694985380 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.065+0000 7f50b9ae2640 1 -- 172.21.15.66:0/3576797162 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50ac029060 con 0x557694985380 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50b9ae2640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50a8074ce0 0x7f50a80771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50b9ae2640 1 -- 172.21.15.66:0/3576797162 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f50ac097880 con 0x557694985380 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50bbae6640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50a8074ce0 0x7f50a80771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50be7edf40 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55769497efd0 0x55769497f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55769497f970 con 0x55769497efd0 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50bcae8640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55769497efd0 0x55769497f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.066+0000 7f50bbae6640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50a8074ce0 0x7f50a80771a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50b0057000 tx=0x7f50b0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50bcae8640 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55769497efd0 0x55769497f430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50bcae8640 1 -- 172.21.15.66:0/3576797162 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f50b40038f0 con 0x55769497efd0 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-05-10T11:13:44.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55769497efd0 msgr2=0x55769497f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55769497efd0 0x55769497f430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50a8074ce0 msgr2=0x7f50a80771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50a8074ce0 0x7f50a80771a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50b0057000 tx=0x7f50b0052000 comp rx=0 tx=0).stop 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 msgr2=0x557694a11be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 --2- 172.21.15.66:0/3576797162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557694985380 0x557694a11be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f50ac011040 tx=0x7f50ac000ed0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50bcae8640 1 -- 172.21.15.66:0/3576797162 reap_dead start 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 shutdown_connections 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 >> 172.21.15.66:0/3576797162 conn(0x55769493b040 msgr2=0x55769496b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 shutdown_connections 2024-05-10T11:13:44.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.067+0000 7f50be7edf40 1 -- 172.21.15.66:0/3576797162 wait complete. 2024-05-10T11:13:44.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:13:44.071 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:13:44.071 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:13:44.106 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:13:44.152 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:13:44.152 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:13:44.152 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:44.152 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:44.169 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:13:44.169 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:13:44.169 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:44.169 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:44.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:13:44.186 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:13:44.186 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:44.186 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:44.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:13:44.225 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:13:44.225 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:44.225 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:44.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:13:44.243 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:44.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.369+0000 7f760c759640 1 Processor -- start 2024-05-10T11:13:44.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.369+0000 7f760c759640 1 -- start start 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760c759640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f76040d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760c759640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f760415f790 0x7f76040d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760c759640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76040d30b0 con 0x7f76040d5d30 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760c759640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f76040d3390 con 0x7f760415f790 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760c759640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76040c8c80 con 0x7f760415f3b0 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760a4f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f76040d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f7609cf4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f760415f790 0x7f76040d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760a4f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f76040d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:40320/0 (socket says 172.21.15.66:40320) 2024-05-10T11:13:44.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.370+0000 7f760a4f5640 1 -- 172.21.15.66:0/2190722353 learned_addr learned my addr 172.21.15.66:0/2190722353 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.371+0000 7f7609cf4640 1 -- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 msgr2=0x7f76040d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.371+0000 7f7609cf4640 1 --2- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f76040d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.371+0000 7f7609cf4640 1 -- 172.21.15.66:0/2190722353 >> v1:172.21.15.190:6789/0 conn(0x7f76040d5d30 legacy=0x7f76040c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.371+0000 7f7609cf4640 1 -- 172.21.15.66:0/2190722353 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040c8f60 con 0x7f760415f790 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.371+0000 7f76094f3640 1 -- 172.21.15.66:0/2190722353 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021068578 0 0) 0x7f76040d30b0 con 0x7f76040d5d30 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.371+0000 7f760a4f5640 1 --2- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f76040d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f7609cf4640 1 --2- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415f790 0x7f76040d3c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097a0 tx=0x7f75f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6adfe2d576090d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f76094f3640 1 -- 172.21.15.66:0/2190722353 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8037070 con 0x7f760415f790 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f76094f3640 1 -- 172.21.15.66:0/2190722353 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f8032440 con 0x7f760415f790 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f76094f3640 1 -- 172.21.15.66:0/2190722353 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8032810 con 0x7f760415f790 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 -- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415f790 msgr2=0x7f76040d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 --2- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415f790 0x7f76040d3c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097a0 tx=0x7f75f802a180 comp rx=0 tx=0).stop 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 -- 172.21.15.66:0/2190722353 shutdown_connections 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 --2- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415f790 0x7f76040d3c30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 --2- 172.21.15.66:0/2190722353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f76040d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 -- 172.21.15.66:0/2190722353 >> 172.21.15.66:0/2190722353 conn(0x7f76040d5130 msgr2=0x7f76040d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 -- 172.21.15.66:0/2190722353 shutdown_connections 2024-05-10T11:13:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.372+0000 7f760c759640 1 -- 172.21.15.66:0/2190722353 wait complete. 2024-05-10T11:13:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 Processor -- start 2024-05-10T11:13:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 -- start start 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 0x7f7604158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f7604154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415c950 0x7f760415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76040d0e60 con 0x7f76040d5d30 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76040d0ce0 con 0x7f760415c950 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.374+0000 7f760c759640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76040d0fe0 con 0x7f760415f3b0 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 0x7f7604158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 0x7f7604158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52202/0 (socket says 172.21.15.66:52202) 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 -- 172.21.15.66:0/191532060 learned_addr learned my addr 172.21.15.66:0/191532060 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f7609cf4640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f7604154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760acf6640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415c950 0x7f760415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 -- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 msgr2=0x7f7604154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f7604154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 -- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415c950 msgr2=0x7f760415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415c950 0x7f760415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 -- 172.21.15.66:0/191532060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040cd810 con 0x7f76040d5d30 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760a4f5640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 0x7f7604158380 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009f20 tx=0x7f75f400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4014480 con 0x7f76040d5d30 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f4019070 con 0x7f76040d5d30 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4014820 con 0x7f76040d5d30 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76040cdaf0 con 0x7f76040d5d30 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.375+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76040ce0b0 con 0x7f76040d5d30 2024-05-10T11:13:44.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.376+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760406a220 con 0x7f76040d5d30 2024-05-10T11:13:44.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.377+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75f4005d10 con 0x7f76040d5d30 2024-05-10T11:13:44.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.377+0000 7f7602ffd640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75f0076300 0x7f75f00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.378+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f75f4097b30 con 0x7f76040d5d30 2024-05-10T11:13:44.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.378+0000 7f7609cf4640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75f0076300 0x7f75f00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.378+0000 7f7609cf4640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75f0076300 0x7f75f00787c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75f8034000 tx=0x7f75f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.382+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f75f4010040 con 0x7f76040d5d30 2024-05-10T11:13:44.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.611+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76040d2780 con 0x7f76040d5d30 2024-05-10T11:13:44.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.612+0000 7f7602ffd640 1 -- 172.21.15.66:0/191532060 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f75f4060cb0 con 0x7f76040d5d30 2024-05-10T11:13:44.611 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:44.612 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:44.612 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:44.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75f0076300 msgr2=0x7f75f00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75f0076300 0x7f75f00787c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75f8034000 tx=0x7f75f802e000 comp rx=0 tx=0).stop 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 msgr2=0x7f7604158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 0x7f7604158380 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009f20 tx=0x7f75f400c550 comp rx=0 tx=0).stop 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 shutdown_connections 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75f0076300 0x7f75f00787c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f760415c950 0x7f760415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760415f3b0 0x7f7604154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 --2- 172.21.15.66:0/191532060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d5d30 0x7f7604158380 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 >> 172.21.15.66:0/191532060 conn(0x7f76040d5130 msgr2=0x7f76040d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 shutdown_connections 2024-05-10T11:13:44.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.614+0000 7f760c759640 1 -- 172.21.15.66:0/191532060 wait complete. 2024-05-10T11:13:44.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:44.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.729+0000 7f92e4675640 1 Processor -- start 2024-05-10T11:13:44.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.729+0000 7f92e4675640 1 -- start start 2024-05-10T11:13:44.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e4675640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0d0230 0x7f92dc0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e4675640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92dc15fc90 con 0x7f92dc0cfbb0 2024-05-10T11:13:44.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e4675640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92dc0b8c40 con 0x7f92dc0b8860 2024-05-10T11:13:44.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e4675640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f92dc06ec30 con 0x7f92dc0d0230 2024-05-10T11:13:44.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e2c12640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f92dc0cfbb0 0x7f92dc0ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48660/0 (socket says 172.21.15.66:48660) 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e2c12640 1 -- 172.21.15.66:0/816062922 learned_addr learned my addr 172.21.15.66:0/816062922 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e1c10640 1 --2- 172.21.15.66:0/816062922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0d0230 0x7f92dc0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099909802 0 0) 0x7f92dc15fc90 con 0x7f92dc0cfbb0 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c8003520 con 0x7f92dc0cfbb0 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344537771 0 0) 0x7f92dc0b8c40 con 0x7f92dc0b8860 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.730+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92dc15fc90 con 0x7f92dc0b8860 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.731+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1527890398 0 0) 0x7f92c8003520 con 0x7f92dc0cfbb0 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.731+0000 7f92e1c10640 1 -- 172.21.15.66:0/816062922 >> v1:172.21.15.190:6789/0 conn(0x7f92dc0b8860 legacy=0x7f92dc06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.731+0000 7f92e1c10640 1 -- 172.21.15.66:0/816062922 >> v1:172.21.15.66:6789/0 conn(0x7f92dc0cfbb0 legacy=0x7f92dc0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.731+0000 7f92e1c10640 1 -- 172.21.15.66:0/816062922 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc0cd570 con 0x7f92dc0d0230 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.731+0000 7f92e1c10640 1 --2- 172.21.15.66:0/816062922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0d0230 0x7f92dc0cf670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0097d0 tx=0x7f92cc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72ace783a0ad5f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc037070 con 0x7f92dc0d0230 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc02ab90 con 0x7f92dc0d0230 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e140f640 1 -- 172.21.15.66:0/816062922 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d40019f0 con 0x7f92dc0d0230 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 -- 172.21.15.66:0/816062922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0d0230 msgr2=0x7f92dc0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 --2- 172.21.15.66:0/816062922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0d0230 0x7f92dc0cf670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0097d0 tx=0x7f92cc02a100 comp rx=0 tx=0).stop 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 -- 172.21.15.66:0/816062922 shutdown_connections 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 --2- 172.21.15.66:0/816062922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0d0230 0x7f92dc0cf670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 -- 172.21.15.66:0/816062922 >> 172.21.15.66:0/816062922 conn(0x7f92dc0d2df0 msgr2=0x7f92dc0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 -- 172.21.15.66:0/816062922 shutdown_connections 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.732+0000 7f92e4675640 1 -- 172.21.15.66:0/816062922 wait complete. 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.733+0000 7f92e4675640 1 Processor -- start 2024-05-10T11:13:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.733+0000 7f92e4675640 1 -- start start 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e4675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 0x7f92dc1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e4675640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0cfbb0 0x7f92dc161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e4675640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92dc0d0230 0x7f92dc1f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e4675640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc0cdb30 con 0x7f92dc0b8860 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e4675640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc06ee50 con 0x7f92dc0d0230 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e4675640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f92dc0cde10 con 0x7f92dc0cfbb0 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e2411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 0x7f92dc1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e2411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 0x7f92dc1f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35920/0 (socket says 172.21.15.66:35920) 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.734+0000 7f92e2411640 1 -- 172.21.15.66:0/711254446 learned_addr learned my addr 172.21.15.66:0/711254446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2c12640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92dc0d0230 0x7f92dc1f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e1c10640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0cfbb0 0x7f92dc161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2411640 1 -- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0cfbb0 msgr2=0x7f92dc161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2411640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0cfbb0 0x7f92dc161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2411640 1 -- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92dc0d0230 msgr2=0x7f92dc1f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2411640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92dc0d0230 0x7f92dc1f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2411640 1 -- 172.21.15.66:0/711254446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc1f9100 con 0x7f92dc0b8860 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e1c10640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0cfbb0 0x7f92dc161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2c12640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92dc0d0230 0x7f92dc1f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e2411640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 0x7f92dc1f4920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f92d800c4c0 tx=0x7f92d800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80052d0 con 0x7f92dc0b8860 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8005470 con 0x7f92dc0b8860 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8012870 con 0x7f92dc0b8860 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc1f93e0 con 0x7f92dc0b8860 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.735+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc0c6e30 con 0x7f92dc0b8860 2024-05-10T11:13:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.736+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc06a220 con 0x7f92dc0b8860 2024-05-10T11:13:44.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.737+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92d8012a10 con 0x7f92dc0b8860 2024-05-10T11:13:44.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.737+0000 7f92d2ffd640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92c00762d0 0x7f92c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:44.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.737+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f92d8097420 con 0x7f92dc0b8860 2024-05-10T11:13:44.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.737+0000 7f92e1c10640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92c00762d0 0x7f92c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:44.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.738+0000 7f92e1c10640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92c00762d0 0x7f92c0078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92cc034000 tx=0x7f92cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.742+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f92d8060c00 con 0x7f92dc0b8860 2024-05-10T11:13:44.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.971+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92dc0d1e20 con 0x7f92dc0b8860 2024-05-10T11:13:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.972+0000 7f92d2ffd640 1 -- 172.21.15.66:0/711254446 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f92d8060500 con 0x7f92dc0b8860 2024-05-10T11:13:44.971 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:44.971 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:44.971 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.973+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92c00762d0 msgr2=0x7f92c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.973+0000 7f92e4675640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92c00762d0 0x7f92c0078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92cc034000 tx=0x7f92cc02e000 comp rx=0 tx=0).stop 2024-05-10T11:13:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.973+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 msgr2=0x7f92dc1f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.973+0000 7f92e4675640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 0x7f92dc1f4920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f92d800c4c0 tx=0x7f92d800c980 comp rx=0 tx=0).stop 2024-05-10T11:13:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 shutdown_connections 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92c00762d0 0x7f92c0078790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92dc0d0230 0x7f92dc1f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92dc0cfbb0 0x7f92dc161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 --2- 172.21.15.66:0/711254446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92dc0b8860 0x7f92dc1f4920 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 >> 172.21.15.66:0/711254446 conn(0x7f92dc0d2df0 msgr2=0x7f92dc0757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 shutdown_connections 2024-05-10T11:13:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:44.974+0000 7f92e4675640 1 -- 172.21.15.66:0/711254446 wait complete. 2024-05-10T11:13:44.984 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:45.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.089+0000 7fc31e5da640 1 Processor -- start 2024-05-10T11:13:45.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.089+0000 7fc31e5da640 1 -- start start 2024-05-10T11:13:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31e5da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc3181598c0 0x7fc31806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31e5da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc31806ec40 0x7fc3180c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31e5da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31806f1c0 con 0x7fc3180c71c0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31e5da640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc31806f4a0 con 0x7fc3181598c0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31e5da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc31806f780 con 0x7fc31806ec40 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31cb77640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc3180c71c0 0x7fc31815fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48662/0 (socket says 172.21.15.66:48662) 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc31cb77640 1 -- 172.21.15.66:0/2440676939 learned_addr learned my addr 172.21.15.66:0/2440676939 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc30ffff640 1 --2- 172.21.15.66:0/2440676939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc31806ec40 0x7fc3180c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc317fff640 1 --2- 172.21.15.66:0/2440676939 >> v2:172.21.15.190:3300/0 conn(0x7fc3181598c0 0x7fc31806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc3177fe640 1 -- 172.21.15.66:0/2440676939 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464196719 0 0) 0x7fc31806f1c0 con 0x7fc3180c71c0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.090+0000 7fc3177fe640 1 -- 172.21.15.66:0/2440676939 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc304005730 con 0x7fc3180c71c0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.091+0000 7fc30ffff640 1 -- 172.21.15.66:0/2440676939 >> v2:172.21.15.190:3300/0 conn(0x7fc3181598c0 msgr2=0x7fc31806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.091+0000 7fc3177fe640 1 -- 172.21.15.66:0/2440676939 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1563513268 0 0) 0x7fc304005730 con 0x7fc3180c71c0 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.091+0000 7fc30ffff640 1 --2- 172.21.15.66:0/2440676939 >> v2:172.21.15.190:3300/0 conn(0x7fc3181598c0 0x7fc31806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.091+0000 7fc30ffff640 1 -- 172.21.15.66:0/2440676939 >> v1:172.21.15.66:6789/0 conn(0x7fc3180c71c0 legacy=0x7fc31815fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.091+0000 7fc30ffff640 1 -- 172.21.15.66:0/2440676939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31806fa60 con 0x7fc31806ec40 2024-05-10T11:13:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.091+0000 7fc317fff640 1 --2- 172.21.15.66:0/2440676939 >> v2:172.21.15.190:3300/0 conn(0x7fc3181598c0 0x7fc31806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc30ffff640 1 --2- 172.21.15.66:0/2440676939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc31806ec40 0x7fc3180c6c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097a0 tx=0x7fc30002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ffbfc4d31201b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc3177fe640 1 -- 172.21.15.66:0/2440676939 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300037070 con 0x7fc31806ec40 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc3177fe640 1 -- 172.21.15.66:0/2440676939 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30002aba0 con 0x7fc31806ec40 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc3177fe640 1 -- 172.21.15.66:0/2440676939 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100019f0 con 0x7fc31806ec40 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 -- 172.21.15.66:0/2440676939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc31806ec40 msgr2=0x7fc3180c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2440676939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc31806ec40 0x7fc3180c6c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097a0 tx=0x7fc30002a110 comp rx=0 tx=0).stop 2024-05-10T11:13:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 -- 172.21.15.66:0/2440676939 shutdown_connections 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2440676939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc31806ec40 0x7fc3180c6c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2440676939 >> v2:172.21.15.190:3300/0 conn(0x7fc3181598c0 0x7fc31806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 -- 172.21.15.66:0/2440676939 >> 172.21.15.66:0/2440676939 conn(0x7fc3180b2900 msgr2=0x7fc3180b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 -- 172.21.15.66:0/2440676939 shutdown_connections 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.092+0000 7fc31e5da640 1 -- 172.21.15.66:0/2440676939 wait complete. 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 Processor -- start 2024-05-10T11:13:45.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 -- start start 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc31806ec40 0x7fc318149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3180c71c0 0x7fc31815e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 0x7fc31815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc318159ca0 con 0x7fc3181598c0 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc31815c6e0 con 0x7fc31806ec40 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.094+0000 7fc31e5da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc318159e20 con 0x7fc3180c71c0 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 0x7fc31815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 0x7fc31815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35926/0 (socket says 172.21.15.66:35926) 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 -- 172.21.15.66:0/2911712558 learned_addr learned my addr 172.21.15.66:0/2911712558 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc30ffff640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3180c71c0 0x7fc31815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc317fff640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc31806ec40 0x7fc318149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 -- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3180c71c0 msgr2=0x7fc31815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3180c71c0 0x7fc31815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 -- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc31806ec40 msgr2=0x7fc318149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc31806ec40 0x7fc318149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 -- 172.21.15.66:0/2911712558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31815af80 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31cb77640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 0x7fc31815ea90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc310001b60 tx=0x7fc31000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310017070 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc310012400 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3180cdee0 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100127b0 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.095+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3180ce4a0 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.096+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31806a220 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.097+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc31001a070 con 0x7fc3181598c0 2024-05-10T11:13:45.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.097+0000 7fc3157fa640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2f80762d0 0x7fc2f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.097+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fc310097540 con 0x7fc3181598c0 2024-05-10T11:13:45.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.098+0000 7fc317fff640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2f80762d0 0x7fc2f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.098+0000 7fc317fff640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2f80762d0 0x7fc2f8078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc308009560 tx=0x7fc308009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.102+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc310060750 con 0x7fc3181598c0 2024-05-10T11:13:45.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.293+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3180c7940 con 0x7fc3181598c0 2024-05-10T11:13:45.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.294+0000 7fc3157fa640 1 -- 172.21.15.66:0/2911712558 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16942 (secure 0 0 0) 0x7fc310064a50 con 0x7fc3181598c0 2024-05-10T11:13:45.294 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:45.294 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":37,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:20.718190+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:17.114677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:18.027556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2f80762d0 msgr2=0x7fc2f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2f80762d0 0x7fc2f8078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc308009560 tx=0x7fc308009190 comp rx=0 tx=0).stop 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 msgr2=0x7fc31815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 0x7fc31815ea90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc310001b60 tx=0x7fc31000a430 comp rx=0 tx=0).stop 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 shutdown_connections 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2f80762d0 0x7fc2f8078790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3181598c0 0x7fc31815ea90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3180c71c0 0x7fc31815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 --2- 172.21.15.66:0/2911712558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc31806ec40 0x7fc318149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 >> 172.21.15.66:0/2911712558 conn(0x7fc3180b2900 msgr2=0x7fc3180cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:45.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 shutdown_connections 2024-05-10T11:13:45.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.296+0000 7fc31e5da640 1 -- 172.21.15.66:0/2911712558 wait complete. 2024-05-10T11:13:45.307 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:13:45.307 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 Processor -- start 2024-05-10T11:13:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 -- start start 2024-05-10T11:13:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa0b80b5520 0x7fa0b80d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa0b80b9180 0x7fa0b80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b80d41f0 con 0x7fa0b80b5900 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b80d5c60 con 0x7fa0b80b5520 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.412+0000 7fa0bd9da640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b80d5eb0 con 0x7fa0b80b9180 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b6ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa0b80b5520 0x7fa0b80d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0affff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa0b80b5900 0x7fa0b80d2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48666/0 (socket says 172.21.15.66:48666) 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0affff640 1 -- 172.21.15.66:0/1918529753 learned_addr learned my addr 172.21.15.66:0/1918529753 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b77fe640 1 --2- 172.21.15.66:0/1918529753 >> v2:172.21.15.190:3300/0 conn(0x7fa0b80b9180 0x7fa0b80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b6ffd640 1 -- 172.21.15.66:0/1918529753 >> v2:172.21.15.190:3300/0 conn(0x7fa0b80b9180 msgr2=0x7fa0b80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b6ffd640 1 --2- 172.21.15.66:0/1918529753 >> v2:172.21.15.190:3300/0 conn(0x7fa0b80b9180 0x7fa0b80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b6ffd640 1 -- 172.21.15.66:0/1918529753 >> v1:172.21.15.66:6789/0 conn(0x7fa0b80b5900 legacy=0x7fa0b80d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b6ffd640 1 -- 172.21.15.66:0/1918529753 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b80d0a30 con 0x7fa0b80b5520 2024-05-10T11:13:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.413+0000 7fa0b67fc640 1 -- 172.21.15.66:0/1918529753 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989127292 0 0) 0x7fa0b80d41f0 con 0x7fa0b80b5900 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.414+0000 7fa0b6ffd640 1 --2- 172.21.15.66:0/1918529753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5520 0x7fa0b80d18a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80cc1d0 tx=0x7fa0a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925cfa52e2fb36ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.414+0000 7fa0b67fc640 1 -- 172.21.15.66:0/1918529753 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8037070 con 0x7fa0b80b5520 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.414+0000 7fa0b67fc640 1 -- 172.21.15.66:0/1918529753 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a8032440 con 0x7fa0b80b5520 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.414+0000 7fa0b67fc640 1 -- 172.21.15.66:0/1918529753 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8032810 con 0x7fa0b80b5520 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.414+0000 7fa0bd9da640 1 -- 172.21.15.66:0/1918529753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5520 msgr2=0x7fa0b80d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.414+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/1918529753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5520 0x7fa0b80d18a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80cc1d0 tx=0x7fa0a802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.415+0000 7fa0bd9da640 1 -- 172.21.15.66:0/1918529753 shutdown_connections 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.415+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/1918529753 >> v2:172.21.15.190:3300/0 conn(0x7fa0b80b9180 0x7fa0b80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.415+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/1918529753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5520 0x7fa0b80d18a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.415+0000 7fa0bd9da640 1 -- 172.21.15.66:0/1918529753 >> 172.21.15.66:0/1918529753 conn(0x7fa0b80d5170 msgr2=0x7fa0b80d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:45.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.415+0000 7fa0bd9da640 1 -- 172.21.15.66:0/1918529753 shutdown_connections 2024-05-10T11:13:45.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.415+0000 7fa0bd9da640 1 -- 172.21.15.66:0/1918529753 wait complete. 2024-05-10T11:13:45.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 Processor -- start 2024-05-10T11:13:45.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 -- start start 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0b80b5520 0x7fa0b81f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 0x7fa0b806d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0b80b9180 0x7fa0b806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b80b6460 con 0x7fa0b80b5900 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b80b62e0 con 0x7fa0b80b9180 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.416+0000 7fa0bd9da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b80b65e0 con 0x7fa0b80b5520 2024-05-10T11:13:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 0x7fa0b806d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 0x7fa0b806d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35940/0 (socket says 172.21.15.66:35940) 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 -- 172.21.15.66:0/4166376093 learned_addr learned my addr 172.21.15.66:0/4166376093 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 -- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0b80b5520 msgr2=0x7fa0b81f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0b6ffd640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0b80b5520 0x7fa0b81f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0b77fe640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0b80b9180 0x7fa0b806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0b80b5520 0x7fa0b81f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 -- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0b80b9180 msgr2=0x7fa0b806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0b80b9180 0x7fa0b806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 -- 172.21.15.66:0/4166376093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b81f8590 con 0x7fa0b80b5900 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0affff640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 0x7fa0b806d3a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000c500 tx=0x7fa0a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0018070 con 0x7fa0b80b5900 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a0007580 con 0x7fa0b80b5900 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b81f8870 con 0x7fa0b80b5900 2024-05-10T11:13:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0004a20 con 0x7fa0b80b5900 2024-05-10T11:13:45.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.417+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b81f8e30 con 0x7fa0b80b5900 2024-05-10T11:13:45.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.418+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b80693f0 con 0x7fa0b80b5900 2024-05-10T11:13:45.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.419+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa0a001b070 con 0x7fa0b80b5900 2024-05-10T11:13:45.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.419+0000 7fa0b4ff9640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0980762d0 0x7fa098078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.420+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fa0a0096a70 con 0x7fa0b80b5900 2024-05-10T11:13:45.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.420+0000 7fa0b6ffd640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0980762d0 0x7fa098078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.420+0000 7fa0b6ffd640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0980762d0 0x7fa098078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8034000 tx=0x7fa0a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.424+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa0a00602d0 con 0x7fa0b80b5900 2024-05-10T11:13:45.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.655+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0b80d3250 con 0x7fa0b80b5900 2024-05-10T11:13:45.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.656+0000 7fa0b4ff9640 1 -- 172.21.15.66:0/4166376093 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7fa0a00682c0 con 0x7fa0b80b5900 2024-05-10T11:13:45.655 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:45.655 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:45.656 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0980762d0 msgr2=0x7fa098078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0980762d0 0x7fa098078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8034000 tx=0x7fa0a802e000 comp rx=0 tx=0).stop 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 msgr2=0x7fa0b806d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 0x7fa0b806d3a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000c500 tx=0x7fa0a000c9c0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 shutdown_connections 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0980762d0 0x7fa098078790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0b80b9180 0x7fa0b806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0b80b5900 0x7fa0b806d3a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 --2- 172.21.15.66:0/4166376093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0b80b5520 0x7fa0b81f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 >> 172.21.15.66:0/4166376093 conn(0x7fa0b80d5170 msgr2=0x7fa0b8162750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:45.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 shutdown_connections 2024-05-10T11:13:45.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.658+0000 7fa0bd9da640 1 -- 172.21.15.66:0/4166376093 wait complete. 2024-05-10T11:13:45.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:45.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.774+0000 7f31d7c2a640 1 Processor -- start 2024-05-10T11:13:45.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.774+0000 7f31d7c2a640 1 -- start start 2024-05-10T11:13:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d7c2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d0162940 0x7f31d00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d7c2a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31d00d59d0 0x7f31d00d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d7c2a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f31d00b47a0 0x7f31d00d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d7c2a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f31d0162d20 con 0x7f31d00b47a0 2024-05-10T11:13:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d7c2a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f31d00d2d20 con 0x7f31d00d59d0 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d7c2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f31d00d3000 con 0x7f31d0162940 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f31d00b47a0 0x7f31d00d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f31d00b47a0 0x7f31d00d3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35956/0 (socket says 172.21.15.66:35956) 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 -- 172.21.15.66:0/3029962991 learned_addr learned my addr 172.21.15.66:0/3029962991 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d59c6640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d0162940 0x7f31d00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d51c5640 1 --2- 172.21.15.66:0/3029962991 >> v2:172.21.15.190:3300/0 conn(0x7f31d00d59d0 0x7f31d00d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 -- 172.21.15.66:0/3029962991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d0162940 msgr2=0x7f31d00b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d0162940 0x7f31d00b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 -- 172.21.15.66:0/3029962991 >> v2:172.21.15.190:3300/0 conn(0x7f31d00d59d0 msgr2=0x7f31d00d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 --2- 172.21.15.66:0/3029962991 >> v2:172.21.15.190:3300/0 conn(0x7f31d00d59d0 0x7f31d00d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d61c7640 1 -- 172.21.15.66:0/3029962991 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d00d32e0 con 0x7f31d00b47a0 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.775+0000 7f31d59c6640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d0162940 0x7f31d00b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.776+0000 7f31d61c7640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00b47a0 0x7f31d00d3bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f31d008f8a0 tx=0x7f31c802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5c4bc38b760423 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.776+0000 7f31d49c4640 1 -- 172.21.15.66:0/3029962991 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8036070 con 0x7f31d00b47a0 2024-05-10T11:13:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.776+0000 7f31d49c4640 1 -- 172.21.15.66:0/3029962991 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c8031600 con 0x7f31d00b47a0 2024-05-10T11:13:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.776+0000 7f31d49c4640 1 -- 172.21.15.66:0/3029962991 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c80319d0 con 0x7f31d00b47a0 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 -- 172.21.15.66:0/3029962991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00b47a0 msgr2=0x7f31d00d3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00b47a0 0x7f31d00d3bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f31d008f8a0 tx=0x7f31c802a570 comp rx=0 tx=0).stop 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 -- 172.21.15.66:0/3029962991 shutdown_connections 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00b47a0 0x7f31d00d3bb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/3029962991 >> v2:172.21.15.190:3300/0 conn(0x7f31d00d59d0 0x7f31d00d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/3029962991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d0162940 0x7f31d00b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 -- 172.21.15.66:0/3029962991 >> 172.21.15.66:0/3029962991 conn(0x7f31d009e380 msgr2=0x7f31d00d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 -- 172.21.15.66:0/3029962991 shutdown_connections 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.777+0000 7f31d7c2a640 1 -- 172.21.15.66:0/3029962991 wait complete. 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.778+0000 7f31d7c2a640 1 Processor -- start 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.778+0000 7f31d7c2a640 1 -- start start 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d00b47a0 0x7f31d0151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 0x7f31d00c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31d0162940 0x7f31d00c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31d00d2390 con 0x7f31d00d59d0 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f31d00cfc50 con 0x7f31d0162940 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f31d00d2510 con 0x7f31d00b47a0 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 0x7f31d00c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 0x7f31d00c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35968/0 (socket says 172.21.15.66:35968) 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 -- 172.21.15.66:0/1068433988 learned_addr learned my addr 172.21.15.66:0/1068433988 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d59c6640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d00b47a0 0x7f31d0151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d61c7640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31d0162940 0x7f31d00c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 -- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d00b47a0 msgr2=0x7f31d0151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d00b47a0 0x7f31d0151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 -- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31d0162940 msgr2=0x7f31d00c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31d0162940 0x7f31d00c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 -- 172.21.15.66:0/1068433988 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d00b2820 con 0x7f31d00d59d0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d59c6640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d00b47a0 0x7f31d0151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d61c7640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31d0162940 0x7f31d00c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d51c5640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 0x7f31d00c8b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f31c000d800 tx=0x7f31c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0018030 con 0x7f31d00d59d0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c00096a0 con 0x7f31d00d59d0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d00b2b00 con 0x7f31d00d59d0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.779+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0009870 con 0x7f31d00d59d0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.780+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d00b30c0 con 0x7f31d00d59d0 2024-05-10T11:13:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.781+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d006a220 con 0x7f31d00d59d0 2024-05-10T11:13:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.781+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f31c001b070 con 0x7f31d00d59d0 2024-05-10T11:13:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.782+0000 7f31c67fc640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31b4076300 0x7f31b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.782+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f31c0097a20 con 0x7f31d00d59d0 2024-05-10T11:13:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.782+0000 7f31d59c6640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31b4076300 0x7f31b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.782+0000 7f31d59c6640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31b4076300 0x7f31b40787c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31cc006fd0 tx=0x7f31cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:45.786+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f31c00611f0 con 0x7f31d00d59d0 2024-05-10T11:13:46.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.020+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31d00d2730 con 0x7f31d00d59d0 2024-05-10T11:13:46.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.021+0000 7f31c67fc640 1 -- 172.21.15.66:0/1068433988 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f31c0061e20 con 0x7f31d00d59d0 2024-05-10T11:13:46.020 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:19.073081+0000","modified":"2024-05-10T11:13:22.099813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/967061575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":967061575},{"type":"v1","addr":"172.21.15.66:6835","nonce":967061575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-10T11:13:46.020 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-05-10T11:13:46.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31b4076300 msgr2=0x7f31b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31b4076300 0x7f31b40787c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31cc006fd0 tx=0x7f31cc008040 comp rx=0 tx=0).stop 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 msgr2=0x7f31d00c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 0x7f31d00c8b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f31c000d800 tx=0x7f31c000dcc0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 shutdown_connections 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31b4076300 0x7f31b40787c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31d0162940 0x7f31d00c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d00d59d0 0x7f31d00c8b50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 --2- 172.21.15.66:0/1068433988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31d00b47a0 0x7f31d0151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 >> 172.21.15.66:0/1068433988 conn(0x7f31d009e380 msgr2=0x7f31d006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 shutdown_connections 2024-05-10T11:13:46.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.023+0000 7f31d7c2a640 1 -- 172.21.15.66:0/1068433988 wait complete. 2024-05-10T11:13:46.034 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:46.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.138+0000 7ff25e246640 1 Processor -- start 2024-05-10T11:13:46.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.138+0000 7ff25e246640 1 -- start start 2024-05-10T11:13:46.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff25e246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2580d59d0 0x7ff2580b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff25e246640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2580d2d20 con 0x7ff258162940 2024-05-10T11:13:46.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff25e246640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2580d3000 con 0x7ff2580d3d80 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff25e246640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff258162d20 con 0x7ff2580d59d0 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2577fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff258162940 0x7ff2580d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48670/0 (socket says 172.21.15.66:48670) 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2577fe640 1 -- 172.21.15.66:0/3241632417 learned_addr learned my addr 172.21.15.66:0/3241632417 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff257fff640 1 --2- 172.21.15.66:0/3241632417 >> v2:172.21.15.190:3300/0 conn(0x7ff2580d59d0 0x7ff2580b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848359117 0 0) 0x7ff2580d2d20 con 0x7ff258162940 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff240003520 con 0x7ff258162940 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 469632179 0 0) 0x7ff240003520 con 0x7ff258162940 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 >> v2:172.21.15.190:3300/0 conn(0x7ff2580d59d0 msgr2=0x7ff2580b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2567fc640 1 --2- 172.21.15.66:0/3241632417 >> v2:172.21.15.190:3300/0 conn(0x7ff2580d59d0 0x7ff2580b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.139+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 >> v1:172.21.15.190:6789/0 conn(0x7ff2580d3d80 legacy=0x7ff2580d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2580d32e0 con 0x7ff258162940 2024-05-10T11:13:46.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7ff248001670 con 0x7ff258162940 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 >> v1:172.21.15.66:6789/0 conn(0x7ff258162940 legacy=0x7ff2580d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2400039b0 0x7ff240003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff240004800 0x7ff240004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2400051c0 0x7ff24000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff24000c130 con 0x7ff240004800 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff24000c2e0 con 0x7ff2400051c0 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff24000c4e0 con 0x7ff2400039b0 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff256ffd640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff240004800 0x7ff240004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff2577fe640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2400039b0 0x7ff240003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff257fff640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2400051c0 0x7ff24000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff256ffd640 1 -- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2400039b0 msgr2=0x7ff240003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff256ffd640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2400039b0 0x7ff240003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff256ffd640 1 -- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2400051c0 msgr2=0x7ff24000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff256ffd640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2400051c0 0x7ff24000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff257fff640 1 -- 172.21.15.66:0/3241632417 reap_dead start 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.140+0000 7ff256ffd640 1 -- 172.21.15.66:0/3241632417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff240003520 con 0x7ff240004800 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.141+0000 7ff256ffd640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff240004800 0x7ff240004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff24c001720 tx=0x7ff240005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ba3892dcc7ec75 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.141+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c001370 con 0x7ff240004800 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.141+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c0052d0 con 0x7ff240004800 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.141+0000 7ff2567fc640 1 -- 172.21.15.66:0/3241632417 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02ab90 con 0x7ff240004800 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.141+0000 7ff25e246640 1 -- 172.21.15.66:0/3241632417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff240004800 msgr2=0x7ff240004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.141+0000 7ff25e246640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff240004800 0x7ff240004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff24c001720 tx=0x7ff240005830 comp rx=0 tx=0).stop 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.142+0000 7ff25e246640 1 -- 172.21.15.66:0/3241632417 shutdown_connections 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.142+0000 7ff25e246640 1 --2- 172.21.15.66:0/3241632417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff240004800 0x7ff240004c80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.142+0000 7ff25e246640 1 -- 172.21.15.66:0/3241632417 >> 172.21.15.66:0/3241632417 conn(0x7ff25809e380 msgr2=0x7ff2580d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.142+0000 7ff25e246640 1 -- 172.21.15.66:0/3241632417 shutdown_connections 2024-05-10T11:13:46.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.142+0000 7ff25e246640 1 -- 172.21.15.66:0/3241632417 wait complete. 2024-05-10T11:13:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.143+0000 7ff25e246640 1 Processor -- start 2024-05-10T11:13:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.143+0000 7ff25e246640 1 -- start start 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff25e246640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff240004800 0x7ff2581608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff25e246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2580b3600 0x7ff2580b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff25e246640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 0x7ff2580b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff25e246640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2580d2390 con 0x7ff2580b55f0 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff25e246640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2580cfc50 con 0x7ff240004800 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff25e246640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2580d2510 con 0x7ff2580b3600 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 0x7ff2580b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 0x7ff2580b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35998/0 (socket says 172.21.15.66:35998) 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 -- 172.21.15.66:0/3427195046 learned_addr learned my addr 172.21.15.66:0/3427195046 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff256ffd640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2580b3600 0x7ff2580b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff2577fe640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff240004800 0x7ff2581608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 -- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2580b3600 msgr2=0x7ff2580b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2580b3600 0x7ff2580b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 -- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff240004800 msgr2=0x7ff2581608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff240004800 0x7ff2581608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 -- 172.21.15.66:0/3427195046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2581f8f10 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff2577fe640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff240004800 0x7ff2581608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.144+0000 7ff257fff640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 0x7ff2580b5a70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff2580cf790 tx=0x7ff25000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.145+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25000fd80 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.145+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff250015430 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.145+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2580b1da0 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.145+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250015820 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.145+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2580b2360 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.146+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25806a220 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.146+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff2500159c0 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.147+0000 7ff23ffff640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff244076300 0x7ff2440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.147+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff250098670 con 0x7ff2580b55f0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.147+0000 7ff2577fe640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff244076300 0x7ff2440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.147+0000 7ff2577fe640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff244076300 0x7ff2440787c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff248001eb0 tx=0x7ff248009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.151+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff250019030 con 0x7ff2580b55f0 2024-05-10T11:13:46.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.343+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2580d2730 con 0x7ff2580b55f0 2024-05-10T11:13:46.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.344+0000 7ff23ffff640 1 -- 172.21.15.66:0/3427195046 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16942 (secure 0 0 0) 0x7ff250010040 con 0x7ff2580b55f0 2024-05-10T11:13:46.344 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:46.344 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":37,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:20.718190+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:17.114677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:18.027556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff244076300 msgr2=0x7ff2440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff244076300 0x7ff2440787c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff248001eb0 tx=0x7ff248009040 comp rx=0 tx=0).stop 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 msgr2=0x7ff2580b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 0x7ff2580b5a70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff2580cf790 tx=0x7ff25000f580 comp rx=0 tx=0).stop 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 shutdown_connections 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff244076300 0x7ff2440787c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2580b55f0 0x7ff2580b5a70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2580b3600 0x7ff2580b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 --2- 172.21.15.66:0/3427195046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff240004800 0x7ff2581608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 >> 172.21.15.66:0/3427195046 conn(0x7ff25809e380 msgr2=0x7ff25806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:46.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 shutdown_connections 2024-05-10T11:13:46.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.346+0000 7ff25e246640 1 -- 172.21.15.66:0/3427195046 wait complete. 2024-05-10T11:13:46.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:13:46.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.462+0000 7f4d4cdda640 1 Processor -- start 2024-05-10T11:13:46.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.462+0000 7f4d4cdda640 1 -- start start 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d4cdda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f790 0x7f4d480cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d4cdda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4d480d5d30 0x7f4d480d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d4cdda640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d480d30b0 con 0x7f4d4815f3b0 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d4cdda640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4d480d3390 con 0x7f4d480d5d30 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d4cdda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d480c8c80 con 0x7f4d4815f790 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d46d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4d480d5d30 0x7f4d480d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d46d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4d480d5d30 0x7f4d480d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36002/0 (socket says 172.21.15.66:36002) 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.463+0000 7f4d46d9d640 1 -- 172.21.15.66:0/2107606578 learned_addr learned my addr 172.21.15.66:0/2107606578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.464+0000 7f4d45d9b640 1 --2- 172.21.15.66:0/2107606578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f790 0x7f4d480cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.464+0000 7f4d46d9d640 1 -- 172.21.15.66:0/2107606578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f790 msgr2=0x7f4d480cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.464+0000 7f4d46d9d640 1 --2- 172.21.15.66:0/2107606578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f790 0x7f4d480cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.464+0000 7f4d46d9d640 1 -- 172.21.15.66:0/2107606578 >> v1:172.21.15.190:6789/0 conn(0x7f4d4815f3b0 legacy=0x7f4d480d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.464+0000 7f4d46d9d640 1 -- 172.21.15.66:0/2107606578 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d480c8f60 con 0x7f4d480d5d30 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.464+0000 7f4d46d9d640 1 --2- 172.21.15.66:0/2107606578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480d5d30 0x7f4d480d0210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009870 tx=0x7f4d4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5249865a690280aa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4559a640 1 -- 172.21.15.66:0/2107606578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40037070 con 0x7f4d480d5d30 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4559a640 1 -- 172.21.15.66:0/2107606578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d40032440 con 0x7f4d480d5d30 2024-05-10T11:13:46.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4559a640 1 -- 172.21.15.66:0/2107606578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40032810 con 0x7f4d480d5d30 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 -- 172.21.15.66:0/2107606578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480d5d30 msgr2=0x7f4d480d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/2107606578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480d5d30 0x7f4d480d0210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009870 tx=0x7f4d4002a270 comp rx=0 tx=0).stop 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 -- 172.21.15.66:0/2107606578 shutdown_connections 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/2107606578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480d5d30 0x7f4d480d0210 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/2107606578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f790 0x7f4d480cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 -- 172.21.15.66:0/2107606578 >> 172.21.15.66:0/2107606578 conn(0x7f4d480d5130 msgr2=0x7f4d480d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 -- 172.21.15.66:0/2107606578 shutdown_connections 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.465+0000 7f4d4cdda640 1 -- 172.21.15.66:0/2107606578 wait complete. 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 Processor -- start 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 -- start start 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d480d5d30 0x7f4d480cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f3b0 0x7f4d48157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 0x7f4d4814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480d3f80 con 0x7f4d480cd900 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480d3e00 con 0x7f4d480d5d30 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.467+0000 7f4d4cdda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d480ca770 con 0x7f4d4815f3b0 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 0x7f4d4814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 0x7f4d4814b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36014/0 (socket says 172.21.15.66:36014) 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 -- 172.21.15.66:0/1828768983 learned_addr learned my addr 172.21.15.66:0/1828768983 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d45d9b640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f3b0 0x7f4d48157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d4659c640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d480d5d30 0x7f4d480cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 -- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f3b0 msgr2=0x7f4d48157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f3b0 0x7f4d48157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 -- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d480d5d30 msgr2=0x7f4d480cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d480d5d30 0x7f4d480cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 -- 172.21.15.66:0/1828768983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d480cde70 con 0x7f4d480cd900 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d4659c640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d480d5d30 0x7f4d480cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d45d9b640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f3b0 0x7f4d48157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d46d9d640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 0x7f4d4814b400 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009870 tx=0x7f4d400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40041020 con 0x7f4d480cd900 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4003d640 con 0x7f4d480cd900 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d480ce150 con 0x7f4d480cd900 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40037040 con 0x7f4d480cd900 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.468+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d480ce710 con 0x7f4d480cd900 2024-05-10T11:13:46.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.469+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d480cec00 con 0x7f4d480cd900 2024-05-10T11:13:46.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.470+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d40044020 con 0x7f4d480cd900 2024-05-10T11:13:46.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.471+0000 7f4d3effd640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4d280762d0 0x7f4d28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.471+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f4d400b7eb0 con 0x7f4d480cd900 2024-05-10T11:13:46.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.471+0000 7f4d4659c640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4d280762d0 0x7f4d28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.471+0000 7f4d4659c640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4d280762d0 0x7f4d28078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d38001e00 tx=0x7f4d38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.475+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4d4004b030 con 0x7f4d480cd900 2024-05-10T11:13:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.703+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4d4806a220 con 0x7f4d480cd900 2024-05-10T11:13:46.703 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:13:46.704+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:13:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.705+0000 7f4d3effd640 1 -- 172.21.15.66:0/1828768983 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f4d40081690 con 0x7f4d480cd900 2024-05-10T11:13:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:13:46.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.707+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4d280762d0 msgr2=0x7f4d28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.707+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4d280762d0 0x7f4d28078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d38001e00 tx=0x7f4d38009040 comp rx=0 tx=0).stop 2024-05-10T11:13:46.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.707+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 msgr2=0x7f4d4814b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.707+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 0x7f4d4814b400 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009870 tx=0x7f4d400046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 shutdown_connections 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4d280762d0 0x7f4d28078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d480cd900 0x7f4d4814b400 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d4815f3b0 0x7f4d48157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 --2- 172.21.15.66:0/1828768983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d480d5d30 0x7f4d480cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 >> 172.21.15.66:0/1828768983 conn(0x7f4d480d5130 msgr2=0x7f4d480cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 shutdown_connections 2024-05-10T11:13:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.708+0000 7f4d4cdda640 1 -- 172.21.15.66:0/1828768983 wait complete. 2024-05-10T11:13:46.711 INFO:tasks.ceph.mds.a.smithi066.stderr: -6572> 2024-05-10T11:13:24.673+0000 7fbaa670d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:13:46.720 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:13:46.744 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:13:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.827+0000 7f69ab4bd640 1 Processor -- start 2024-05-10T11:13:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.828+0000 7f69ab4bd640 1 -- start start 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69ab4bd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f69a415d190 0x7f69a40b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69ab4bd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 0x7f69a40d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69ab4bd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a40cd9b0 con 0x7f69a40d19c0 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69ab4bd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f69a40afe60 con 0x7f69a415d190 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69ab4bd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69a40b0140 con 0x7f69a40b3a80 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69a9a5a640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f69a40d19c0 0x7f69a40d2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48686/0 (socket says 172.21.15.66:48686) 2024-05-10T11:13:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69a9a5a640 1 -- 172.21.15.66:0/675306453 learned_addr learned my addr 172.21.15.66:0/675306453 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370877749 0 0) 0x7f699c001490 con 0x7f69a40d19c0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69a8a58640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 0x7f69a40d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f69a9259640 1 --2- 172.21.15.66:0/675306453 >> v2:172.21.15.190:3300/0 conn(0x7f69a415d190 0x7f69a40b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6990003520 con 0x7f69a40d19c0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 270598480 0 0) 0x7f6990003520 con 0x7f69a40d19c0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 msgr2=0x7f69a40d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 0x7f69a40d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 >> v2:172.21.15.190:3300/0 conn(0x7f69a415d190 msgr2=0x7f69a40b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 --2- 172.21.15.66:0/675306453 >> v2:172.21.15.190:3300/0 conn(0x7f69a415d190 0x7f69a40b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a40b0420 con 0x7f69a40d19c0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f699c001bc0 con 0x7f69a40d19c0 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 >> v1:172.21.15.66:6789/0 conn(0x7f69a40d19c0 legacy=0x7f69a40d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 0x7f69900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f6990004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6990004d40 0x7f69900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40afe60 con 0x7f6990003f30 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40b0140 con 0x7f6990004d40 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.829+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f699000b9c0 con 0x7f69a40b3a80 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a8a58640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f6990004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a9259640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 0x7f69900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a9a5a640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6990004d40 0x7f69900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a8a58640 1 -- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 msgr2=0x7f69900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a8a58640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a40b3a80 0x7f69900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a8a58640 1 -- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6990004d40 msgr2=0x7f69900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a8a58640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6990004d40 0x7f69900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.830+0000 7f69a8a58640 1 -- 172.21.15.66:0/675306453 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6990003520 con 0x7f6990003f30 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69a8a58640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f6990004800 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6994009ac0 tx=0x7f6990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cfe01955c63d30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994036070 con 0x7f6990003f30 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6994031400 con 0x7f6990003f30 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f699bfff640 1 -- 172.21.15.66:0/675306453 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994009690 con 0x7f6990003f30 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69ab4bd640 1 -- 172.21.15.66:0/675306453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 msgr2=0x7f6990004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/675306453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f6990004800 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6994009ac0 tx=0x7f6990005830 comp rx=0 tx=0).stop 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69a9a5a640 1 -- 172.21.15.66:0/675306453 reap_dead start 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69ab4bd640 1 -- 172.21.15.66:0/675306453 shutdown_connections 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69ab4bd640 1 -- 172.21.15.66:0/675306453 >> 172.21.15.66:0/675306453 conn(0x7f69a409ba20 msgr2=0x7f69a409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69ab4bd640 1 -- 172.21.15.66:0/675306453 shutdown_connections 2024-05-10T11:13:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.831+0000 7f69ab4bd640 1 -- 172.21.15.66:0/675306453 wait complete. 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 Processor -- start 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 -- start start 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f69a415e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a415ffe0 0x7f69a4158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69a40c89c0 0x7f69a40c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40afaf0 con 0x7f6990003f30 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40b09e0 con 0x7f69a40c89c0 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69ab4bd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69a415d570 con 0x7f69a415ffe0 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69a9259640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f69a415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69a9259640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f69a415e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36052/0 (socket says 172.21.15.66:36052) 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.833+0000 7f69a9259640 1 -- 172.21.15.66:0/956589748 learned_addr learned my addr 172.21.15.66:0/956589748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a8a58640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a415ffe0 0x7f69a4158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9a5a640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69a40c89c0 0x7f69a40c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9259640 1 -- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a415ffe0 msgr2=0x7f69a4158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9259640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a415ffe0 0x7f69a4158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9259640 1 -- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69a40c89c0 msgr2=0x7f69a40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9259640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69a40c89c0 0x7f69a40c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9259640 1 -- 172.21.15.66:0/956589748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a415e7e0 con 0x7f6990003f30 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a8a58640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a415ffe0 0x7f69a4158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69a9259640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f69a415e200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f69a00119f0 tx=0x7f69a0011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a000fb50 con 0x7f6990003f30 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a000fcf0 con 0x7f6990003f30 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a000fea0 con 0x7f6990003f30 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a406e510 con 0x7f6990003f30 2024-05-10T11:13:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.834+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a415da80 con 0x7f6990003f30 2024-05-10T11:13:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.835+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a4069e60 con 0x7f6990003f30 2024-05-10T11:13:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.836+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69a0012040 con 0x7f6990003f30 2024-05-10T11:13:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.837+0000 7f6999ffb640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6988076300 0x7f69880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.837+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6187+0+0 (secure 0 0 0) 0x7f69a0097c10 con 0x7f6990003f30 2024-05-10T11:13:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.837+0000 7f69a8a58640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6988076300 0x7f69880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.837+0000 7f69a8a58640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6988076300 0x7f69880787c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6994033000 tx=0x7f6994008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:46.841+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f69a4069e60 con 0x7f6990003f30 2024-05-10T11:13:47.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.070+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f69a40693f0 con 0x7f6990003f30 2024-05-10T11:13:47.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.706+0000 7f6999ffb640 1 -- 172.21.15.66:0/956589748 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f69a0019030 con 0x7f6990003f30 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6988076300 msgr2=0x7f69880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6988076300 0x7f69880787c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6994033000 tx=0x7f6994008030 comp rx=0 tx=0).stop 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 msgr2=0x7f69a415e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f69a415e200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f69a00119f0 tx=0x7f69a0011eb0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 shutdown_connections 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6988076300 0x7f69880787c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69a40c89c0 0x7f69a40c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69a415ffe0 0x7f69a4158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 --2- 172.21.15.66:0/956589748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6990003f30 0x7f69a415e200 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 >> 172.21.15.66:0/956589748 conn(0x7f69a409ba20 msgr2=0x7f69a40757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.709+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 shutdown_connections 2024-05-10T11:13:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.710+0000 7f69ab4bd640 1 -- 172.21.15.66:0/956589748 wait complete. 2024-05-10T11:13:47.724 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:13:47.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.880+0000 7f3844d24640 1 Processor -- start 2024-05-10T11:13:47.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.880+0000 7f3844d24640 1 -- start start 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f3844d24640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f384015f490 0x7f38400d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f3844d24640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38400d1080 con 0x7f38400d3d50 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f3844d24640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38400b4820 con 0x7f38400d5ca0 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f3844d24640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f38400b4e70 con 0x7f384015f490 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f383ed9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f38400d3d50 0x7f38400b5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48702/0 (socket says 172.21.15.66:48702) 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f383ed9d640 1 -- 172.21.15.66:0/1055463362 learned_addr learned my addr 172.21.15.66:0/1055463362 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.881+0000 7f383e59c640 1 --2- 172.21.15.66:0/1055463362 >> v2:172.21.15.190:3300/0 conn(0x7f384015f490 0x7f38400d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:47.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.882+0000 7f383d59a640 1 -- 172.21.15.66:0/1055463362 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113499407 0 0) 0x7f38400d1080 con 0x7f38400d3d50 2024-05-10T11:13:47.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.882+0000 7f383d59a640 1 -- 172.21.15.66:0/1055463362 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3828003520 con 0x7f38400d3d50 2024-05-10T11:13:47.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.882+0000 7f383d59a640 1 -- 172.21.15.66:0/1055463362 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 288149065 0 0) 0x7f3828003520 con 0x7f38400d3d50 2024-05-10T11:13:47.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.882+0000 7f383e59c640 1 -- 172.21.15.66:0/1055463362 >> v1:172.21.15.190:6789/0 conn(0x7f38400d5ca0 legacy=0x7f38400d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.882+0000 7f383e59c640 1 -- 172.21.15.66:0/1055463362 >> v1:172.21.15.66:6789/0 conn(0x7f38400d3d50 legacy=0x7f38400b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.882+0000 7f383e59c640 1 -- 172.21.15.66:0/1055463362 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38400b4b00 con 0x7f384015f490 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f383e59c640 1 --2- 172.21.15.66:0/1055463362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f384015f490 0x7f38400d2f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38300097a0 tx=0x7f383002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f078d41b5ad431 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f383d59a640 1 -- 172.21.15.66:0/1055463362 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830037070 con 0x7f384015f490 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f383d59a640 1 -- 172.21.15.66:0/1055463362 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383002abc0 con 0x7f384015f490 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f383d59a640 1 -- 172.21.15.66:0/1055463362 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38380019f0 con 0x7f384015f490 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f3844d24640 1 -- 172.21.15.66:0/1055463362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f384015f490 msgr2=0x7f38400d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f3844d24640 1 --2- 172.21.15.66:0/1055463362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f384015f490 0x7f38400d2f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38300097a0 tx=0x7f383002a130 comp rx=0 tx=0).stop 2024-05-10T11:13:47.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f3844d24640 1 -- 172.21.15.66:0/1055463362 shutdown_connections 2024-05-10T11:13:47.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f3844d24640 1 --2- 172.21.15.66:0/1055463362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f384015f490 0x7f38400d2f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.883+0000 7f3844d24640 1 -- 172.21.15.66:0/1055463362 >> 172.21.15.66:0/1055463362 conn(0x7f38400d50f0 msgr2=0x7f38400d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:47.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.884+0000 7f3844d24640 1 -- 172.21.15.66:0/1055463362 shutdown_connections 2024-05-10T11:13:47.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.884+0000 7f3844d24640 1 -- 172.21.15.66:0/1055463362 wait complete. 2024-05-10T11:13:47.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.885+0000 7f3844d24640 1 Processor -- start 2024-05-10T11:13:47.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.885+0000 7f3844d24640 1 -- start start 2024-05-10T11:13:47.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f3844d24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 0x7f384014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:47.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f3844d24640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400d5ca0 0x7f38400cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:47.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f3844d24640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f384015f490 0x7f38400ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f3844d24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f384015f9f0 con 0x7f38400d3d50 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f3844d24640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f384015f870 con 0x7f38400d5ca0 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f3844d24640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f38400b5a10 con 0x7f384015f490 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 0x7f384014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 0x7f384014fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36056/0 (socket says 172.21.15.66:36056) 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 -- 172.21.15.66:0/3795881721 learned_addr learned my addr 172.21.15.66:0/3795881721 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383ed9d640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f384015f490 0x7f38400ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383dd9b640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400d5ca0 0x7f38400cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 -- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f384015f490 msgr2=0x7f38400ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f384015f490 0x7f38400ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 -- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400d5ca0 msgr2=0x7f38400cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400d5ca0 0x7f38400cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 -- 172.21.15.66:0/3795881721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3840150250 con 0x7f38400d3d50 2024-05-10T11:13:47.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383ed9d640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f384015f490 0x7f38400ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383dd9b640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400d5ca0 0x7f38400cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f383e59c640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 0x7f384014fd10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f38300097a0 tx=0x7f38300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830037040 con 0x7f38400d3d50 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.886+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3830004230 con 0x7f38400d3d50 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.887+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38400cc5a0 con 0x7f38400d3d50 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.887+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830003610 con 0x7f38400d3d50 2024-05-10T11:13:47.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.887+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38400cce40 con 0x7f38400d3d50 2024-05-10T11:13:47.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.888+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38400cc990 con 0x7f38400d3d50 2024-05-10T11:13:47.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.888+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38300037b0 con 0x7f38400d3d50 2024-05-10T11:13:47.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.889+0000 7f382effd640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f38200762d0 0x7f3820078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:47.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.889+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6187+0+0 (secure 0 0 0) 0x7f38300b8690 con 0x7f38400d3d50 2024-05-10T11:13:47.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.889+0000 7f383dd9b640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f38200762d0 0x7f3820078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:47.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.890+0000 7f383dd9b640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f38200762d0 0x7f3820078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3834007fd0 tx=0x7f3834009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:47.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:47.893+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3830081e10 con 0x7f38400d3d50 2024-05-10T11:13:48.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.088+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f38400b6360 con 0x7f38400d3d50 2024-05-10T11:13:48.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.708+0000 7f382effd640 1 -- 172.21.15.66:0/3795881721 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) ==== 181+0+0 (secure 0 0 0) 0x7f3830081710 con 0x7f38400d3d50 2024-05-10T11:13:48.707 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:13:48.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f38200762d0 msgr2=0x7f3820078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:48.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f38200762d0 0x7f3820078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3834007fd0 tx=0x7f3834009040 comp rx=0 tx=0).stop 2024-05-10T11:13:48.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 msgr2=0x7f384014fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:48.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 0x7f384014fd10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f38300097a0 tx=0x7f38300046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 shutdown_connections 2024-05-10T11:13:48.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f38200762d0 0x7f3820078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f384015f490 0x7f38400ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400d5ca0 0x7f38400cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 --2- 172.21.15.66:0/3795881721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38400d3d50 0x7f384014fd10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.711+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 >> 172.21.15.66:0/3795881721 conn(0x7f38400d50f0 msgr2=0x7f384006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:48.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.712+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 shutdown_connections 2024-05-10T11:13:48.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.712+0000 7f3844d24640 1 -- 172.21.15.66:0/3795881721 wait complete. 2024-05-10T11:13:48.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:13:48.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.838+0000 7f364d59e640 1 Processor -- start 2024-05-10T11:13:48.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.838+0000 7f364d59e640 1 -- start start 2024-05-10T11:13:48.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f364d59e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f364815f200 0x7f36480d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:48.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f364d59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36480d2060 0x7f3648162eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:48.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f364d59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36480d0240 con 0x7f36480cfda0 2024-05-10T11:13:48.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f364d59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f36480d0520 con 0x7f36480d2060 2024-05-10T11:13:48.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f364d59e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f36480d0800 con 0x7f364815f200 2024-05-10T11:13:48.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f364cd9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36480d2060 0x7f3648162eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f363ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f36480cfda0 0x7f36480d1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48708/0 (socket says 172.21.15.66:48708) 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.839+0000 7f363ffff640 1 -- 172.21.15.66:0/1651026383 learned_addr learned my addr 172.21.15.66:0/1651026383 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f364cd9d640 1 -- 172.21.15.66:0/1651026383 >> v2:172.21.15.190:3300/0 conn(0x7f364815f200 msgr2=0x7f36480d39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f3647fff640 1 --2- 172.21.15.66:0/1651026383 >> v2:172.21.15.190:3300/0 conn(0x7f364815f200 0x7f36480d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f364cd9d640 1 --2- 172.21.15.66:0/1651026383 >> v2:172.21.15.190:3300/0 conn(0x7f364815f200 0x7f36480d39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f364cd9d640 1 -- 172.21.15.66:0/1651026383 >> v1:172.21.15.66:6789/0 conn(0x7f36480cfda0 legacy=0x7f36480d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f364cd9d640 1 -- 172.21.15.66:0/1651026383 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480d0ae0 con 0x7f36480d2060 2024-05-10T11:13:48.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f36477fe640 1 -- 172.21.15.66:0/1651026383 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609489934 0 0) 0x7f36480d0240 con 0x7f36480cfda0 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f364cd9d640 1 --2- 172.21.15.66:0/1651026383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480d2060 0x7f3648162eb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f364808d3a0 tx=0x7f364002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d164a96289c9c53f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f36477fe640 1 -- 172.21.15.66:0/1651026383 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640007740 con 0x7f36480d2060 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.840+0000 7f36477fe640 1 -- 172.21.15.66:0/1651026383 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400078e0 con 0x7f36480d2060 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f36477fe640 1 -- 172.21.15.66:0/1651026383 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640007cb0 con 0x7f36480d2060 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 -- 172.21.15.66:0/1651026383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480d2060 msgr2=0x7f3648162eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 --2- 172.21.15.66:0/1651026383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480d2060 0x7f3648162eb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f364808d3a0 tx=0x7f364002a680 comp rx=0 tx=0).stop 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 -- 172.21.15.66:0/1651026383 shutdown_connections 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 --2- 172.21.15.66:0/1651026383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480d2060 0x7f3648162eb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 --2- 172.21.15.66:0/1651026383 >> v2:172.21.15.190:3300/0 conn(0x7f364815f200 0x7f36480d39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 -- 172.21.15.66:0/1651026383 >> 172.21.15.66:0/1651026383 conn(0x7f36480d4f60 msgr2=0x7f36480d5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 -- 172.21.15.66:0/1651026383 shutdown_connections 2024-05-10T11:13:48.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.841+0000 7f364d59e640 1 -- 172.21.15.66:0/1651026383 wait complete. 2024-05-10T11:13:48.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.842+0000 7f364d59e640 1 Processor -- start 2024-05-10T11:13:48.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 -- start start 2024-05-10T11:13:48.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 0x7f36480b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:48.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36480d2060 0x7f36480ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f364815f200 0x7f36480b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f364815f760 con 0x7f36480cfda0 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f364815f5e0 con 0x7f36480d2060 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f364d59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36480d12e0 con 0x7f364815f200 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f3647fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 0x7f36480b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f3647fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 0x7f36480b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36070/0 (socket says 172.21.15.66:36070) 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.843+0000 7f3647fff640 1 -- 172.21.15.66:0/1123482080 learned_addr learned my addr 172.21.15.66:0/1123482080 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f363ffff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36480d2060 0x7f36480ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f364cd9d640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f364815f200 0x7f36480b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f3647fff640 1 -- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f364815f200 msgr2=0x7f36480b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f3647fff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f364815f200 0x7f36480b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f3647fff640 1 -- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36480d2060 msgr2=0x7f36480ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f3647fff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36480d2060 0x7f36480ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:48.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f3647fff640 1 -- 172.21.15.66:0/1123482080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480b90f0 con 0x7f36480cfda0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f363ffff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36480d2060 0x7f36480ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f364cd9d640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f364815f200 0x7f36480b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f3647fff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 0x7f36480b9e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f363800c820 tx=0x7f363800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638015070 con 0x7f36480cfda0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638004020 con 0x7f36480cfda0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36480b93d0 con 0x7f36480cfda0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380043f0 con 0x7f36480cfda0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.844+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36480b9990 con 0x7f36480cfda0 2024-05-10T11:13:48.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.845+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364808d6d0 con 0x7f36480cfda0 2024-05-10T11:13:48.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.846+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36380077d0 con 0x7f36480cfda0 2024-05-10T11:13:48.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.846+0000 7f36457fa640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f36280762d0 0x7f3628078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:48.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.846+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5749+0+0 (secure 0 0 0) 0x7f36380972e0 con 0x7f36480cfda0 2024-05-10T11:13:48.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.847+0000 7f363ffff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f36280762d0 0x7f3628078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:48.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.847+0000 7f363ffff640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f36280762d0 0x7f3628078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3630000f60 tx=0x7f3630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:48.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:48.851+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f364808d6d0 con 0x7f36480cfda0 2024-05-10T11:13:49.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.044+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f364806a220 con 0x7f36480cfda0 2024-05-10T11:13:49.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.709+0000 7f36457fa640 1 -- 172.21.15.66:0/1123482080 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) ==== 169+0+0 (secure 0 0 0) 0x7f3638060ca0 con 0x7f36480cfda0 2024-05-10T11:13:49.709 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:13:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.713+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f36280762d0 msgr2=0x7f3628078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f36280762d0 0x7f3628078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3630000f60 tx=0x7f3630009040 comp rx=0 tx=0).stop 2024-05-10T11:13:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 msgr2=0x7f36480b9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 0x7f36480b9e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f363800c820 tx=0x7f363800cce0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 shutdown_connections 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f36280762d0 0x7f3628078790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f364815f200 0x7f36480b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36480d2060 0x7f36480ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 --2- 172.21.15.66:0/1123482080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36480cfda0 0x7f36480b9e90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 >> 172.21.15.66:0/1123482080 conn(0x7f36480d4f60 msgr2=0x7f36480d1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 shutdown_connections 2024-05-10T11:13:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.714+0000 7f364d59e640 1 -- 172.21.15.66:0/1123482080 wait complete. 2024-05-10T11:13:49.728 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:13:49.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.840+0000 7fb8b4693640 1 Processor -- start 2024-05-10T11:13:49.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.840+0000 7fb8b4693640 1 -- start start 2024-05-10T11:13:49.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b4693640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8ac162ce0 0x7fb8ac0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:49.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b4693640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb8ac0b4e20 0x7fb8ac0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:49.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b4693640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac0d4190 con 0x7fb8ac162900 2024-05-10T11:13:49.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b4693640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ac0cfc40 con 0x7fb8ac0b4e20 2024-05-10T11:13:49.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b4693640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ac0d3eb0 con 0x7fb8ac162ce0 2024-05-10T11:13:49.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b2c30640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb8ac0b4e20 0x7fb8ac0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b242f640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb8ac162900 0x7fb8ac0d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48724/0 (socket says 172.21.15.66:48724) 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.841+0000 7fb8b242f640 1 -- 172.21.15.66:0/1692655597 learned_addr learned my addr 172.21.15.66:0/1692655597 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b142d640 1 -- 172.21.15.66:0/1692655597 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145358310 0 0) 0x7fb8a4001490 con 0x7fb8ac162900 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b142d640 1 -- 172.21.15.66:0/1692655597 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb894003520 con 0x7fb8ac162900 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b2c30640 1 -- 172.21.15.66:0/1692655597 >> v2:172.21.15.190:3300/0 conn(0x7fb8ac162ce0 msgr2=0x7fb8ac0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b2c30640 1 --2- 172.21.15.66:0/1692655597 >> v2:172.21.15.190:3300/0 conn(0x7fb8ac162ce0 0x7fb8ac0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b2c30640 1 -- 172.21.15.66:0/1692655597 >> v1:172.21.15.66:6789/0 conn(0x7fb8ac162900 legacy=0x7fb8ac0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:49.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b2c30640 1 -- 172.21.15.66:0/1692655597 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac0cfee0 con 0x7fb8ac0b4e20 2024-05-10T11:13:49.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.842+0000 7fb8b2c30640 1 --2- 172.21.15.66:0/1692655597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0d09c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0c8bc0 tx=0x7fb89c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b820f0d014d6538 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:49.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b142d640 1 -- 172.21.15.66:0/1692655597 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c037070 con 0x7fb8ac0b4e20 2024-05-10T11:13:49.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b142d640 1 -- 172.21.15.66:0/1692655597 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c032440 con 0x7fb8ac0b4e20 2024-05-10T11:13:49.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b142d640 1 -- 172.21.15.66:0/1692655597 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c02ae60 con 0x7fb8ac0b4e20 2024-05-10T11:13:49.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 -- 172.21.15.66:0/1692655597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac0b4e20 msgr2=0x7fb8ac0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 --2- 172.21.15.66:0/1692655597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0d09c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0c8bc0 tx=0x7fb89c02a110 comp rx=0 tx=0).stop 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 -- 172.21.15.66:0/1692655597 shutdown_connections 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 --2- 172.21.15.66:0/1692655597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0d09c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 --2- 172.21.15.66:0/1692655597 >> v2:172.21.15.190:3300/0 conn(0x7fb8ac162ce0 0x7fb8ac0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 -- 172.21.15.66:0/1692655597 >> 172.21.15.66:0/1692655597 conn(0x7fb8ac09e430 msgr2=0x7fb8ac0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 -- 172.21.15.66:0/1692655597 shutdown_connections 2024-05-10T11:13:49.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.843+0000 7fb8b4693640 1 -- 172.21.15.66:0/1692655597 wait complete. 2024-05-10T11:13:49.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.844+0000 7fb8b4693640 1 Processor -- start 2024-05-10T11:13:49.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.844+0000 7fb8b4693640 1 -- start start 2024-05-10T11:13:49.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b4693640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:49.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b4693640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8ac162900 0x7fb8ac14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b4693640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 0x7fb8ac0b9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b4693640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac0b4180 con 0x7fb8ac162ce0 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b4693640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac0d3b20 con 0x7fb8ac0b4e20 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b4693640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ac0b4300 con 0x7fb8ac162900 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b2c30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 0x7fb8ac0b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b2c30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 0x7fb8ac0b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36096/0 (socket says 172.21.15.66:36096) 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b2c30640 1 -- 172.21.15.66:0/2861708542 learned_addr learned my addr 172.21.15.66:0/2861708542 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b242f640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.845+0000 7fb8b1c2e640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8ac162900 0x7fb8ac14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b2c30640 1 -- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8ac162900 msgr2=0x7fb8ac14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b2c30640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8ac162900 0x7fb8ac14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b2c30640 1 -- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ac0b4e20 msgr2=0x7fb8ac0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:49.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b2c30640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b2c30640 1 -- 172.21.15.66:0/2861708542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac0b9740 con 0x7fb8ac162ce0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b2c30640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 0x7fb8ac0b9200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb89c02a150 tx=0x7fb89c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c037040 con 0x7fb8ac162ce0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c042070 con 0x7fb8ac162ce0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c030880 con 0x7fb8ac162ce0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac1f95f0 con 0x7fb8ac162ce0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.846+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ac1f8d50 con 0x7fb8ac162ce0 2024-05-10T11:13:49.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.847+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ac06a220 con 0x7fb8ac162ce0 2024-05-10T11:13:49.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.848+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb89c030a20 con 0x7fb8ac162ce0 2024-05-10T11:13:49.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.848+0000 7fb8aaffd640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8980762d0 0x7fb898078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:49.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.848+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7fb89c0b7da0 con 0x7fb8ac162ce0 2024-05-10T11:13:49.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.848+0000 7fb8b242f640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8980762d0 0x7fb898078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:49.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.849+0000 7fb8b242f640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8980762d0 0x7fb898078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005c00 tx=0x7fb8a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:49.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:49.852+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb89c081870 con 0x7fb8ac162ce0 2024-05-10T11:13:50.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.042+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb8ac09e840 con 0x7fb8ac162ce0 2024-05-10T11:13:50.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.045+0000 7fb8aaffd640 1 -- 172.21.15.66:0/2861708542 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fb89c081170 con 0x7fb8ac162ce0 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8980762d0 msgr2=0x7fb898078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8980762d0 0x7fb898078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005c00 tx=0x7fb8a4009040 comp rx=0 tx=0).stop 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 msgr2=0x7fb8ac0b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 0x7fb8ac0b9200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb89c02a150 tx=0x7fb89c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 shutdown_connections 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8980762d0 0x7fb898078790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8ac162ce0 0x7fb8ac0b9200 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8ac162900 0x7fb8ac14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 --2- 172.21.15.66:0/2861708542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ac0b4e20 0x7fb8ac0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 >> 172.21.15.66:0/2861708542 conn(0x7fb8ac09e430 msgr2=0x7fb8ac0cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:50.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.047+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 shutdown_connections 2024-05-10T11:13:50.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.048+0000 7fb8b4693640 1 -- 172.21.15.66:0/2861708542 wait complete. 2024-05-10T11:13:50.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-05-10T11:13:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.163+0000 7f0fb061d640 1 Processor -- start 2024-05-10T11:13:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.163+0000 7f0fb061d640 1 -- start start 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fb061d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0fa80b8860 0x7f0fa806e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fb061d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0fa80cfd80 0x7f0fa80ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fb061d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa815fc90 con 0x7f0fa80d0230 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fb061d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa806ee50 con 0x7f0fa80cfd80 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fb061d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa80b8c40 con 0x7f0fa80b8860 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0faebba640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0fa80cfd80 0x7f0fa80ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fadbb8640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0fa80d0230 0x7f0fa80cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48732/0 (socket says 172.21.15.66:48732) 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fadbb8640 1 -- 172.21.15.66:0/1710970120 learned_addr learned my addr 172.21.15.66:0/1710970120 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fae3b9640 1 --2- 172.21.15.66:0/1710970120 >> v2:172.21.15.190:3300/0 conn(0x7f0fa80b8860 0x7f0fa806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0faebba640 1 -- 172.21.15.66:0/1710970120 >> v2:172.21.15.190:3300/0 conn(0x7f0fa80b8860 msgr2=0x7f0fa806e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0faebba640 1 --2- 172.21.15.66:0/1710970120 >> v2:172.21.15.190:3300/0 conn(0x7f0fa80b8860 0x7f0fa806e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fad3b7640 1 -- 172.21.15.66:0/1710970120 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056561490 0 0) 0x7f0fa815fc90 con 0x7f0fa80d0230 2024-05-10T11:13:50.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0faebba640 1 -- 172.21.15.66:0/1710970120 >> v1:172.21.15.66:6789/0 conn(0x7f0fa80d0230 legacy=0x7f0fa80cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0faebba640 1 -- 172.21.15.66:0/1710970120 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa80cd570 con 0x7f0fa80cfd80 2024-05-10T11:13:50.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.164+0000 7f0fae3b9640 1 --2- 172.21.15.66:0/1710970120 >> v2:172.21.15.190:3300/0 conn(0x7f0fa80b8860 0x7f0fa806e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.165+0000 7f0faebba640 1 --2- 172.21.15.66:0/1710970120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80ce330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80730a0 tx=0x7f0fa002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1234520f091db9a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.165+0000 7f0fad3b7640 1 -- 172.21.15.66:0/1710970120 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0007740 con 0x7f0fa80cfd80 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.165+0000 7f0fad3b7640 1 -- 172.21.15.66:0/1710970120 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa00078e0 con 0x7f0fa80cfd80 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.165+0000 7f0fad3b7640 1 -- 172.21.15.66:0/1710970120 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0007cb0 con 0x7f0fa80cfd80 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 -- 172.21.15.66:0/1710970120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 msgr2=0x7f0fa80ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 --2- 172.21.15.66:0/1710970120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80ce330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80730a0 tx=0x7f0fa002a5f0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 -- 172.21.15.66:0/1710970120 shutdown_connections 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 --2- 172.21.15.66:0/1710970120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80ce330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 --2- 172.21.15.66:0/1710970120 >> v2:172.21.15.190:3300/0 conn(0x7f0fa80b8860 0x7f0fa806e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 -- 172.21.15.66:0/1710970120 >> 172.21.15.66:0/1710970120 conn(0x7f0fa80d2df0 msgr2=0x7f0fa80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 -- 172.21.15.66:0/1710970120 shutdown_connections 2024-05-10T11:13:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.166+0000 7f0fb061d640 1 -- 172.21.15.66:0/1710970120 wait complete. 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.167+0000 7f0fb061d640 1 Processor -- start 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.167+0000 7f0fb061d640 1 -- start start 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80b8860 0x7f0fa80ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa80d0230 0x7f0fa80b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80cde10 con 0x7f0fa80cfd80 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80cdb30 con 0x7f0fa80d0230 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa806ea60 con 0x7f0fa80b8860 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36112/0 (socket says 172.21.15.66:36112) 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 -- 172.21.15.66:0/451401399 learned_addr learned my addr 172.21.15.66:0/451401399 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fae3b9640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80b8860 0x7f0fa80ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0faebba640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa80d0230 0x7f0fa80b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 -- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80b8860 msgr2=0x7f0fa80ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80b8860 0x7f0fa80ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 -- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa80d0230 msgr2=0x7f0fa80b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa80d0230 0x7f0fa80b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 -- 172.21.15.66:0/451401399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa8163090 con 0x7f0fa80cfd80 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0faebba640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa80d0230 0x7f0fa80b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fadbb8640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80cc530 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800c4d0 tx=0x7f0f9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98018070 con 0x7f0fa80cfd80 2024-05-10T11:13:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f98007500 con 0x7f0fa80cfd80 2024-05-10T11:13:50.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa8162db0 con 0x7f0fa80cfd80 2024-05-10T11:13:50.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004a20 con 0x7f0fa80cfd80 2024-05-10T11:13:50.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.168+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa8160380 con 0x7f0fa80cfd80 2024-05-10T11:13:50.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.169+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa806a220 con 0x7f0fa80cfd80 2024-05-10T11:13:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.170+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f9801b070 con 0x7f0fa80cfd80 2024-05-10T11:13:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.170+0000 7f0f9effd640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f8c0762d0 0x7f0f8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.171+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f0f98096640 con 0x7f0fa80cfd80 2024-05-10T11:13:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.171+0000 7f0fae3b9640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f8c0762d0 0x7f0f8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.171+0000 7f0fae3b9640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f8c0762d0 0x7f0f8c078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400aac0 tx=0x7f0fa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:50.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.175+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0f9805fb50 con 0x7f0fa80cfd80 2024-05-10T11:13:50.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.447+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f0fa80d1e20 con 0x7f0fa80cfd80 2024-05-10T11:13:50.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.711+0000 7f0f9effd640 1 -- 172.21.15.66:0/451401399 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v91) ==== 142+0+0 (secure 0 0 0) 0x7f0f98063e50 con 0x7f0fa80cfd80 2024-05-10T11:13:50.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f8c0762d0 msgr2=0x7f0f8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f8c0762d0 0x7f0f8c078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400aac0 tx=0x7f0fa4008040 comp rx=0 tx=0).stop 2024-05-10T11:13:50.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 msgr2=0x7f0fa80cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80cc530 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800c4d0 tx=0x7f0f9800c990 comp rx=0 tx=0).stop 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 shutdown_connections 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f8c0762d0 0x7f0f8c078790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa80d0230 0x7f0fa80b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa80cfd80 0x7f0fa80cc530 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 --2- 172.21.15.66:0/451401399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80b8860 0x7f0fa80ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 >> 172.21.15.66:0/451401399 conn(0x7f0fa80d2df0 msgr2=0x7f0fa80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 shutdown_connections 2024-05-10T11:13:50.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.714+0000 7f0fb061d640 1 -- 172.21.15.66:0/451401399 wait complete. 2024-05-10T11:13:50.724 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-05-10T11:13:50.725 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-05-10T11:13:50.725 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:13:50.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.830+0000 7f71587ef640 1 Processor -- start 2024-05-10T11:13:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.830+0000 7f71587ef640 1 -- start start 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f71587ef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162750 0x7f71500d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f71587ef640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7150162b30 0x7f71500b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f71587ef640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71500b45f0 con 0x7f71500d5cb0 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f71587ef640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f71500b4f20 con 0x7f7150162b30 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f71587ef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f71500d0fe0 con 0x7f7150162750 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7150162b30 0x7f71500b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7150162b30 0x7f71500b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36116/0 (socket says 172.21.15.66:36116) 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7155d8a640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f71500d5cb0 0x7f71500d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48742/0 (socket says 172.21.15.66:48742) 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 -- 172.21.15.66:0/3415858621 learned_addr learned my addr 172.21.15.66:0/3415858621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f715658b640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162750 0x7f71500d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 -- 172.21.15.66:0/3415858621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162750 msgr2=0x7f71500d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162750 0x7f71500d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 -- 172.21.15.66:0/3415858621 >> v1:172.21.15.66:6789/0 conn(0x7f71500d5cb0 legacy=0x7f71500d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7155589640 1 -- 172.21.15.66:0/3415858621 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304636910 0 0) 0x7f71500b45f0 con 0x7f71500d5cb0 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f7156d8c640 1 -- 172.21.15.66:0/3415858621 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71500b48d0 con 0x7f7150162b30 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.831+0000 7f715658b640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162750 0x7f71500d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.832+0000 7f7156d8c640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162b30 0x7f71500b53b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7148009870 tx=0x7f714802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491e6187aeb52ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.832+0000 7f7155589640 1 -- 172.21.15.66:0/3415858621 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148037070 con 0x7f7150162b30 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.832+0000 7f7155589640 1 -- 172.21.15.66:0/3415858621 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7148032440 con 0x7f7150162b30 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.832+0000 7f7155589640 1 -- 172.21.15.66:0/3415858621 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148032810 con 0x7f7150162b30 2024-05-10T11:13:50.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 -- 172.21.15.66:0/3415858621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162b30 msgr2=0x7f71500b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162b30 0x7f71500b53b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7148009870 tx=0x7f714802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 -- 172.21.15.66:0/3415858621 shutdown_connections 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162b30 0x7f71500b53b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 --2- 172.21.15.66:0/3415858621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162750 0x7f71500d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 -- 172.21.15.66:0/3415858621 >> 172.21.15.66:0/3415858621 conn(0x7f715009e3b0 msgr2=0x7f71500d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 -- 172.21.15.66:0/3415858621 shutdown_connections 2024-05-10T11:13:50.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.833+0000 7f71587ef640 1 -- 172.21.15.66:0/3415858621 wait complete. 2024-05-10T11:13:50.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.834+0000 7f71587ef640 1 Processor -- start 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.834+0000 7f71587ef640 1 -- start start 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 0x7f715015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162b30 0x7f71501f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71500b33c0 0x7f715015b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f71500d0d30 con 0x7f7150162750 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f71500d0bb0 con 0x7f71500b33c0 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f71500d3d40 con 0x7f7150162b30 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 0x7f715015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 0x7f715015d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36120/0 (socket says 172.21.15.66:36120) 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 -- 172.21.15.66:0/86484224 learned_addr learned my addr 172.21.15.66:0/86484224 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 -- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162b30 msgr2=0x7f71501f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f7155d8a640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162b30 0x7f71501f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f7156d8c640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71500b33c0 0x7f715015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162b30 0x7f71501f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 -- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71500b33c0 msgr2=0x7f715015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71500b33c0 0x7f715015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 -- 172.21.15.66:0/86484224 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715015e9d0 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f7155d8a640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162b30 0x7f71501f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f7156d8c640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71500b33c0 0x7f715015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f715658b640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 0x7f715015d840 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f714000cf60 tx=0x7f714000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714001a070 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714000d840 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71501f5970 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.835+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714000dc10 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.836+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715015e130 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.836+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715006a220 con 0x7f7150162750 2024-05-10T11:13:50.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.837+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f714001d070 con 0x7f7150162750 2024-05-10T11:13:50.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.838+0000 7f714effd640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f713c0762d0 0x7f713c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:50.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.838+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f7140097b30 con 0x7f7150162750 2024-05-10T11:13:50.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.838+0000 7f7155d8a640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f713c0762d0 0x7f713c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:50.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.838+0000 7f7155d8a640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f713c0762d0 0x7f713c078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f715015dd80 tx=0x7f7144009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:50.842+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7140061040 con 0x7f7150162750 2024-05-10T11:13:51.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.032+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7150161cb0 con 0x7f7150162750 2024-05-10T11:13:51.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.033+0000 7f714effd640 1 -- 172.21.15.66:0/86484224 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+13291 (secure 0 0 0) 0x7f7140065340 con 0x7f7150162750 2024-05-10T11:13:51.032 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:51.033 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":40,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:49.708463+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/967061575":"2024-05-11T11:13:46.704311+0000","172.21.15.66:6834/967061575":"2024-05-11T11:13:46.704311+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f713c0762d0 msgr2=0x7f713c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f713c0762d0 0x7f713c078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f715015dd80 tx=0x7f7144009040 comp rx=0 tx=0).stop 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 msgr2=0x7f715015d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 0x7f715015d840 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f714000cf60 tx=0x7f714000cf90 comp rx=0 tx=0).stop 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 shutdown_connections 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f713c0762d0 0x7f713c078790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71500b33c0 0x7f715015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7150162b30 0x7f71501f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 --2- 172.21.15.66:0/86484224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7150162750 0x7f715015d840 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 >> 172.21.15.66:0/86484224 conn(0x7f715009e3b0 msgr2=0x7f7150161060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:51.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 shutdown_connections 2024-05-10T11:13:51.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.035+0000 7f71587ef640 1 -- 172.21.15.66:0/86484224 wait complete. 2024-05-10T11:13:51.046 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:13:51.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:13:51.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.153+0000 7fed8194e640 1 Processor -- start 2024-05-10T11:13:51.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.153+0000 7fed8194e640 1 -- start start 2024-05-10T11:13:51.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.154+0000 7fed8194e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed7c15d600 0x7fed7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.154+0000 7fed8194e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed7c0b68c0 con 0x7fed7c0b52a0 2024-05-10T11:13:51.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.154+0000 7fed8194e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed7c0af980 con 0x7fed7c0730b0 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.154+0000 7fed8194e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fed7c06f650 con 0x7fed7c15d600 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.154+0000 7fed7affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed7c15d600 0x7fed7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.154+0000 7fed7a7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fed7c0b52a0 0x7fed7c0b61b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48756/0 (socket says 172.21.15.66:48756) 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.155+0000 7fed7a7fc640 1 -- 172.21.15.66:0/2726398210 learned_addr learned my addr 172.21.15.66:0/2726398210 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.155+0000 7fed7affd640 1 -- 172.21.15.66:0/2726398210 >> v1:172.21.15.190:6789/0 conn(0x7fed7c0730b0 legacy=0x7fed7c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.155+0000 7fed7affd640 1 -- 172.21.15.66:0/2726398210 >> v1:172.21.15.66:6789/0 conn(0x7fed7c0b52a0 legacy=0x7fed7c0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.155+0000 7fed7affd640 1 -- 172.21.15.66:0/2726398210 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c0afc20 con 0x7fed7c15d600 2024-05-10T11:13:51.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.155+0000 7fed79ffb640 1 -- 172.21.15.66:0/2726398210 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938785889 0 0) 0x7fed7c0b68c0 con 0x7fed7c0b52a0 2024-05-10T11:13:51.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed7affd640 1 --2- 172.21.15.66:0/2726398210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c15d600 0x7fed7c06f110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fed740097a0 tx=0x7fed7402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f571e1c3b9765c8f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:51.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed79ffb640 1 -- 172.21.15.66:0/2726398210 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74037070 con 0x7fed7c15d600 2024-05-10T11:13:51.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed79ffb640 1 -- 172.21.15.66:0/2726398210 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed74032440 con 0x7fed7c15d600 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed79ffb640 1 -- 172.21.15.66:0/2726398210 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74032810 con 0x7fed7c15d600 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 -- 172.21.15.66:0/2726398210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c15d600 msgr2=0x7fed7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 --2- 172.21.15.66:0/2726398210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c15d600 0x7fed7c06f110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fed740097a0 tx=0x7fed7402a1a0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 -- 172.21.15.66:0/2726398210 shutdown_connections 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 --2- 172.21.15.66:0/2726398210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c15d600 0x7fed7c06f110 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 -- 172.21.15.66:0/2726398210 >> 172.21.15.66:0/2726398210 conn(0x7fed7c0d1ed0 msgr2=0x7fed7c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 -- 172.21.15.66:0/2726398210 shutdown_connections 2024-05-10T11:13:51.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.156+0000 7fed8194e640 1 -- 172.21.15.66:0/2726398210 wait complete. 2024-05-10T11:13:51.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.158+0000 7fed8194e640 1 Processor -- start 2024-05-10T11:13:51.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.158+0000 7fed8194e640 1 -- start start 2024-05-10T11:13:51.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.158+0000 7fed8194e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 0x7fed7c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.158+0000 7fed8194e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7c0b52a0 0x7fed7c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.158+0000 7fed8194e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7c15d600 0x7fed7c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed8194e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c0b04c0 con 0x7fed7c0730b0 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed8194e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c0b01e0 con 0x7fed7c15d600 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed8194e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c073520 con 0x7fed7c0b52a0 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 0x7fed7c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 0x7fed7c15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36124/0 (socket says 172.21.15.66:36124) 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 -- 172.21.15.66:0/1213182303 learned_addr learned my addr 172.21.15.66:0/1213182303 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 -- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7c0b52a0 msgr2=0x7fed7c159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7c0b52a0 0x7fed7c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 -- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7c15d600 msgr2=0x7fed7c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7c15d600 0x7fed7c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 -- 172.21.15.66:0/1213182303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c15a280 con 0x7fed7c0730b0 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed7affd640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 0x7fed7c15c980 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed74000c00 tx=0x7fed740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74037040 con 0x7fed7c0730b0 2024-05-10T11:13:51.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed74042070 con 0x7fed7c0730b0 2024-05-10T11:13:51.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74030a70 con 0x7fed7c0730b0 2024-05-10T11:13:51.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c15e780 con 0x7fed7c0730b0 2024-05-10T11:13:51.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.159+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c15ed40 con 0x7fed7c0730b0 2024-05-10T11:13:51.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.160+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c0693f0 con 0x7fed7c0730b0 2024-05-10T11:13:51.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.161+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed74030c10 con 0x7fed7c0730b0 2024-05-10T11:13:51.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.161+0000 7fed73fff640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fed5c0762d0 0x7fed5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.161+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7fed740b7f10 con 0x7fed7c0730b0 2024-05-10T11:13:51.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.162+0000 7fed7a7fc640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fed5c0762d0 0x7fed5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.162+0000 7fed7a7fc640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fed5c0762d0 0x7fed5c078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed64007fd0 tx=0x7fed64007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:51.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.166+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fed740819e0 con 0x7fed7c0730b0 2024-05-10T11:13:51.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.356+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fed7c0d1c40 con 0x7fed7c0730b0 2024-05-10T11:13:51.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.356+0000 7fed73fff640 1 -- 172.21.15.66:0/1213182303 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7fed740812e0 con 0x7fed7c0730b0 2024-05-10T11:13:51.356 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fed5c0762d0 msgr2=0x7fed5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fed5c0762d0 0x7fed5c078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed64007fd0 tx=0x7fed64007900 comp rx=0 tx=0).stop 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 msgr2=0x7fed7c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 0x7fed7c15c980 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed74000c00 tx=0x7fed740046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 shutdown_connections 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fed5c0762d0 0x7fed5c078790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7c15d600 0x7fed7c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7c0b52a0 0x7fed7c159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 --2- 172.21.15.66:0/1213182303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed7c0730b0 0x7fed7c15c980 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 >> 172.21.15.66:0/1213182303 conn(0x7fed7c0d1ed0 msgr2=0x7fed7c06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:51.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 shutdown_connections 2024-05-10T11:13:51.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.358+0000 7fed8194e640 1 -- 172.21.15.66:0/1213182303 wait complete. 2024-05-10T11:13:51.369 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-05-10T11:13:51.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.473+0000 7fa48e3b6640 1 Processor -- start 2024-05-10T11:13:51.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.474+0000 7fa48e3b6640 1 -- start start 2024-05-10T11:13:51.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.474+0000 7fa48e3b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa4880d1aa0 0x7fa4880d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.474+0000 7fa48e3b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa4880d3340 0x7fa4880ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.474+0000 7fa48e3b6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa488072330 con 0x7fa48815d290 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.474+0000 7fa48e3b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa4880d37d0 con 0x7fa4880d1aa0 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.474+0000 7fa48e3b6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa488071d70 con 0x7fa4880d3340 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa4880d1aa0 0x7fa4880d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa4880d1aa0 0x7fa4880d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36132/0 (socket says 172.21.15.66:36132) 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 -- 172.21.15.66:0/1336810568 learned_addr learned my addr 172.21.15.66:0/1336810568 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa48c953640 1 --2- 172.21.15.66:0/1336810568 >> v2:172.21.15.190:3300/0 conn(0x7fa4880d3340 0x7fa4880ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 -- 172.21.15.66:0/1336810568 >> v2:172.21.15.190:3300/0 conn(0x7fa4880d3340 msgr2=0x7fa4880ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 --2- 172.21.15.66:0/1336810568 >> v2:172.21.15.190:3300/0 conn(0x7fa4880d3340 0x7fa4880ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 -- 172.21.15.66:0/1336810568 >> v1:172.21.15.190:6789/0 conn(0x7fa48815d290 legacy=0x7fa488071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:51.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.475+0000 7fa4877fe640 1 -- 172.21.15.66:0/1336810568 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa488072050 con 0x7fa4880d1aa0 2024-05-10T11:13:51.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa4877fe640 1 --2- 172.21.15.66:0/1336810568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa4880d2e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4880b2900 tx=0x7fa47c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b49f5a8dc172d8e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa486ffd640 1 -- 172.21.15.66:0/1336810568 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c037070 con 0x7fa4880d1aa0 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa486ffd640 1 -- 172.21.15.66:0/1336810568 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c032440 con 0x7fa4880d1aa0 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa486ffd640 1 -- 172.21.15.66:0/1336810568 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c032810 con 0x7fa4880d1aa0 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1336810568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 msgr2=0x7fa4880d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1336810568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa4880d2e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4880b2900 tx=0x7fa47c02a230 comp rx=0 tx=0).stop 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1336810568 shutdown_connections 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1336810568 >> v2:172.21.15.190:3300/0 conn(0x7fa4880d3340 0x7fa4880ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1336810568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa4880d2e00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1336810568 >> 172.21.15.66:0/1336810568 conn(0x7fa48809ba20 msgr2=0x7fa48809be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1336810568 shutdown_connections 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.476+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1336810568 wait complete. 2024-05-10T11:13:51.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.477+0000 7fa48e3b6640 1 Processor -- start 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 -- start start 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa48806da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4880d3340 0x7fa4881f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa48815d290 0x7fa4880cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa488071a50 con 0x7fa4880d1aa0 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880cdd50 con 0x7fa48815d290 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.478+0000 7fa48e3b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa4880ce7b0 con 0x7fa4880d3340 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa48806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa48806da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36138/0 (socket says 172.21.15.66:36138) 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 -- 172.21.15.66:0/1365170035 learned_addr learned my addr 172.21.15.66:0/1365170035 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa4877fe640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4880d3340 0x7fa4881f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa48c953640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa48815d290 0x7fa4880cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 -- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4880d3340 msgr2=0x7fa4881f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4880d3340 0x7fa4881f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 -- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa48815d290 msgr2=0x7fa4880cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa48815d290 0x7fa4880cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 -- 172.21.15.66:0/1365170035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4880ccec0 con 0x7fa4880d1aa0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa487fff640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa48806da30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b3f0 tx=0x7fa47800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478015020 con 0x7fa4880d1aa0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478011830 con 0x7fa4880d1aa0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48806e0f0 con 0x7fa4880d1aa0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478011c20 con 0x7fa4880d1aa0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.479+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48806e6b0 con 0x7fa4880d1aa0 2024-05-10T11:13:51.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.480+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4880693f0 con 0x7fa4880d1aa0 2024-05-10T11:13:51.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.481+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa478018020 con 0x7fa4880d1aa0 2024-05-10T11:13:51.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.481+0000 7fa484ff9640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4740762d0 0x7fa474078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:51.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.482+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7fa478097180 con 0x7fa4880d1aa0 2024-05-10T11:13:51.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.482+0000 7fa4877fe640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4740762d0 0x7fa474078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:51.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.482+0000 7fa4877fe640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4740762d0 0x7fa474078790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa47c034000 tx=0x7fa47c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:51.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.486+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa47801f020 con 0x7fa4880d1aa0 2024-05-10T11:13:51.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:51.751+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7fa4880b52f0 con 0x7fa4880d1aa0 2024-05-10T11:13:52.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.717+0000 7fa484ff9640 1 -- 172.21.15.66:0/1365170035 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v93) ==== 152+0+0 (secure 0 0 0) 0x7fa4880ccec0 con 0x7fa4880d1aa0 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4740762d0 msgr2=0x7fa474078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4740762d0 0x7fa474078790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa47c034000 tx=0x7fa47c02e000 comp rx=0 tx=0).stop 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 msgr2=0x7fa48806da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa48806da30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b3f0 tx=0x7fa47800b8b0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 shutdown_connections 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4740762d0 0x7fa474078790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa48815d290 0x7fa4880cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4880d3340 0x7fa4881f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 --2- 172.21.15.66:0/1365170035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4880d1aa0 0x7fa48806da30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 >> 172.21.15.66:0/1365170035 conn(0x7fa48809ba20 msgr2=0x7fa48809be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:52.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.720+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 shutdown_connections 2024-05-10T11:13:52.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.721+0000 7fa48e3b6640 1 -- 172.21.15.66:0/1365170035 wait complete. 2024-05-10T11:13:52.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:13:52.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.847+0000 7fd9c0d90640 1 Processor -- start 2024-05-10T11:13:52.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.847+0000 7fd9c0d90640 1 -- start start 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9c0d90640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd9bc0cffd0 0x7fd9bc0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9c0d90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cd500 0x7fd9bc0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9c0d90640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9bc06e720 con 0x7fd9bc0cf3e0 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9c0d90640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd9bc06de80 con 0x7fd9bc0cffd0 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9c0d90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd9bc06e160 con 0x7fd9bc0cd500 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9b9d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd9bc0cffd0 0x7fd9bc0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:52.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9ba59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd9bc0cf3e0 0x7fd9bc0cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48768/0 (socket says 172.21.15.66:48768) 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9ba59c640 1 -- 172.21.15.66:0/2848164572 learned_addr learned my addr 172.21.15.66:0/2848164572 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.848+0000 7fd9bad9d640 1 --2- 172.21.15.66:0/2848164572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cd500 0x7fd9bc0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b9d9b640 1 -- 172.21.15.66:0/2848164572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cd500 msgr2=0x7fd9bc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b9d9b640 1 --2- 172.21.15.66:0/2848164572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cd500 0x7fd9bc0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b9d9b640 1 -- 172.21.15.66:0/2848164572 >> v1:172.21.15.66:6789/0 conn(0x7fd9bc0cf3e0 legacy=0x7fd9bc0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b959a640 1 -- 172.21.15.66:0/2848164572 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491348480 0 0) 0x7fd9bc06e720 con 0x7fd9bc0cf3e0 2024-05-10T11:13:52.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b9d9b640 1 -- 172.21.15.66:0/2848164572 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9bc06e440 con 0x7fd9bc0cffd0 2024-05-10T11:13:52.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b9d9b640 1 --2- 172.21.15.66:0/2848164572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b3de0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40097a0 tx=0x7fd9a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f30e63109f04da5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:52.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b959a640 1 -- 172.21.15.66:0/2848164572 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4037070 con 0x7fd9bc0cffd0 2024-05-10T11:13:52.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b959a640 1 -- 172.21.15.66:0/2848164572 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a4032440 con 0x7fd9bc0cffd0 2024-05-10T11:13:52.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.849+0000 7fd9b959a640 1 -- 172.21.15.66:0/2848164572 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4032810 con 0x7fd9bc0cffd0 2024-05-10T11:13:52.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848164572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cffd0 msgr2=0x7fd9bc0b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848164572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b3de0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40097a0 tx=0x7fd9a402a180 comp rx=0 tx=0).stop 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848164572 shutdown_connections 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848164572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cd500 0x7fd9bc0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848164572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b3de0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848164572 >> 172.21.15.66:0/2848164572 conn(0x7fd9bc0d2eb0 msgr2=0x7fd9bc0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848164572 shutdown_connections 2024-05-10T11:13:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.850+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848164572 wait complete. 2024-05-10T11:13:52.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.851+0000 7fd9c0d90640 1 Processor -- start 2024-05-10T11:13:52.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 -- start start 2024-05-10T11:13:52.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 0x7fd9bc0a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cf3e0 0x7fd9bc09cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc0d16c0 con 0x7fd9bc0cd500 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc0b4510 con 0x7fd9bc0cffd0 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9c0d90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd9bc0d1840 con 0x7fd9bc0cf3e0 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9ba59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 0x7fd9bc0a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9ba59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 0x7fd9bc0a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36156/0 (socket says 172.21.15.66:36156) 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.852+0000 7fd9ba59c640 1 -- 172.21.15.66:0/2848522146 learned_addr learned my addr 172.21.15.66:0/2848522146 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9bad9d640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9b9d9b640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cf3e0 0x7fd9bc09cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9ba59c640 1 -- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cf3e0 msgr2=0x7fd9bc09cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9ba59c640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cf3e0 0x7fd9bc09cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9ba59c640 1 -- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9bc0cffd0 msgr2=0x7fd9bc0b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:52.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9ba59c640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9ba59c640 1 -- 172.21.15.66:0/2848522146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9bc153ca0 con 0x7fd9bc0cd500 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9b9d9b640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cf3e0 0x7fd9bc09cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9bad9d640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9ba59c640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 0x7fd9bc0a02a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c890 tx=0x7fd9ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac018070 con 0x7fd9bc0cd500 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00a640 con 0x7fd9bc0cd500 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9bc153f80 con 0x7fd9bc0cd500 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00aa30 con 0x7fd9bc0cd500 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.853+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9bc154540 con 0x7fd9bc0cd500 2024-05-10T11:13:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.854+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9bc06a220 con 0x7fd9bc0cd500 2024-05-10T11:13:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.855+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd9ac01b070 con 0x7fd9bc0cd500 2024-05-10T11:13:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.855+0000 7fd9b2ffd640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd99c076300 0x7fd99c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.855+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7fd9ac096b50 con 0x7fd9bc0cd500 2024-05-10T11:13:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.856+0000 7fd9b9d9b640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd99c076300 0x7fd99c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.856+0000 7fd9b9d9b640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd99c076300 0x7fd99c0787c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4034000 tx=0x7fd9a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:52.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:52.860+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd9ac060620 con 0x7fd9bc0cd500 2024-05-10T11:13:53.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.049+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd9bc0d05c0 con 0x7fd9bc0cd500 2024-05-10T11:13:53.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.052+0000 7fd9b2ffd640 1 -- 172.21.15.66:0/2848522146 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fd9ac05ff20 con 0x7fd9bc0cd500 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd99c076300 msgr2=0x7fd99c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd99c076300 0x7fd99c0787c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4034000 tx=0x7fd9a402e000 comp rx=0 tx=0).stop 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 msgr2=0x7fd9bc0a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 0x7fd9bc0a02a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c890 tx=0x7fd9ac00cd50 comp rx=0 tx=0).stop 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 shutdown_connections 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd99c076300 0x7fd99c0787c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9bc0cffd0 0x7fd9bc0b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9bc0cf3e0 0x7fd9bc09cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 --2- 172.21.15.66:0/2848522146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9bc0cd500 0x7fd9bc0a02a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 >> 172.21.15.66:0/2848522146 conn(0x7fd9bc0d2eb0 msgr2=0x7fd9bc0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:53.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 shutdown_connections 2024-05-10T11:13:53.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.054+0000 7fd9c0d90640 1 -- 172.21.15.66:0/2848522146 wait complete. 2024-05-10T11:13:53.065 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:13:53.065 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:13:53.112 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:13:53.162 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:13:53.162 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:53.162 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:53.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:13:53.179 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:53.179 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:53.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:13:53.197 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:13:53.197 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:53.235 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:13:53.235 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:13:53.235 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:13:53.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:13:53.254 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:13:53.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:13:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 Processor -- start 2024-05-10T11:13:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 -- start start 2024-05-10T11:13:53.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d0550 0x7f337c0d2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f337c0d2580 0x7f337c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c0d0a50 con 0x7f337c0d3780 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f337c0d0d30 con 0x7f337c0d2580 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.380+0000 7f3381800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f337c0d1560 con 0x7f337c0d0550 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f337c0d2580 0x7f337c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f337c0d2580 0x7f337c06ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36164/0 (socket says 172.21.15.66:36164) 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 -- 172.21.15.66:0/4262283223 learned_addr learned my addr 172.21.15.66:0/4262283223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337a7fc640 1 --2- 172.21.15.66:0/4262283223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d0550 0x7f337c0d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 -- 172.21.15.66:0/4262283223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d0550 msgr2=0x7f337c0d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 --2- 172.21.15.66:0/4262283223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d0550 0x7f337c0d2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 -- 172.21.15.66:0/4262283223 >> v1:172.21.15.190:6789/0 conn(0x7f337c0d3780 legacy=0x7f337c0d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:53.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.381+0000 7f337b7fe640 1 -- 172.21.15.66:0/4262283223 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c0d1840 con 0x7f337c0d2580 2024-05-10T11:13:53.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f337b7fe640 1 --2- 172.21.15.66:0/4262283223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d2580 0x7f337c06ccd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3374009e50 tx=0x7f337402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7517f0d6992b21db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:53.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3379ffb640 1 -- 172.21.15.66:0/4262283223 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374036070 con 0x7f337c0d2580 2024-05-10T11:13:53.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3379ffb640 1 -- 172.21.15.66:0/4262283223 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374031600 con 0x7f337c0d2580 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3379ffb640 1 -- 172.21.15.66:0/4262283223 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33740319d0 con 0x7f337c0d2580 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 -- 172.21.15.66:0/4262283223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d2580 msgr2=0x7f337c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 --2- 172.21.15.66:0/4262283223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d2580 0x7f337c06ccd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3374009e50 tx=0x7f337402a710 comp rx=0 tx=0).stop 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 -- 172.21.15.66:0/4262283223 shutdown_connections 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 --2- 172.21.15.66:0/4262283223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d2580 0x7f337c06ccd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 --2- 172.21.15.66:0/4262283223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d0550 0x7f337c0d2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 -- 172.21.15.66:0/4262283223 >> 172.21.15.66:0/4262283223 conn(0x7f337c0d4f30 msgr2=0x7f337c0d5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 -- 172.21.15.66:0/4262283223 shutdown_connections 2024-05-10T11:13:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.382+0000 7f3381800640 1 -- 172.21.15.66:0/4262283223 wait complete. 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.384+0000 7f3381800640 1 Processor -- start 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.384+0000 7f3381800640 1 -- start start 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f3381800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 0x7f337c0a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f3381800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d2580 0x7f337c0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f3381800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c0d3780 0x7f337c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f3381800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f337c06d210 con 0x7f337c0d0550 2024-05-10T11:13:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f3381800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f337c0d3df0 con 0x7f337c0d3780 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f3381800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f337c06d390 con 0x7f337c0d2580 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 0x7f337c0a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 0x7f337c0a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36178/0 (socket says 172.21.15.66:36178) 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 -- 172.21.15.66:0/4249823697 learned_addr learned my addr 172.21.15.66:0/4249823697 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337a7fc640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d2580 0x7f337c0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337b7fe640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c0d3780 0x7f337c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 -- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d2580 msgr2=0x7f337c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d2580 0x7f337c0ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 -- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c0d3780 msgr2=0x7f337c0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c0d3780 0x7f337c0cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 -- 172.21.15.66:0/4249823697 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c09efe0 con 0x7f337c0d0550 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f337affd640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 0x7f337c0a0080 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c3c0 tx=0x7f336c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0052d0 con 0x7f337c0d0550 2024-05-10T11:13:53.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.385+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c005490 con 0x7f337c0d0550 2024-05-10T11:13:53.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.386+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c09f2c0 con 0x7f337c0d0550 2024-05-10T11:13:53.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.386+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c007260 con 0x7f337c0d0550 2024-05-10T11:13:53.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.386+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c09f880 con 0x7f337c0d0550 2024-05-10T11:13:53.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.386+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c0693f0 con 0x7f337c0d0550 2024-05-10T11:13:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.387+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f336c007400 con 0x7f337c0d0550 2024-05-10T11:13:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.388+0000 7f33637fe640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33680762d0 0x7f3368078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.388+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f336c0967c0 con 0x7f337c0d0550 2024-05-10T11:13:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.388+0000 7f337a7fc640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33680762d0 0x7f3368078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.388+0000 7f337a7fc640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33680762d0 0x7f3368078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f337c0cfc70 tx=0x7f3370008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:53.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.392+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f336c05fcd0 con 0x7f337c0d0550 2024-05-10T11:13:53.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.621+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f337c074760 con 0x7f337c0d0550 2024-05-10T11:13:53.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.622+0000 7f33637fe640 1 -- 172.21.15.66:0/4249823697 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3869 (secure 0 0 0) 0x7f336c068310 con 0x7f337c0d0550 2024-05-10T11:13:53.621 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:53.621 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/796061292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":796061292},{"type":"v1","addr":"172.21.15.190:6836","nonce":796061292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2873406178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2873406178},{"type":"v1","addr":"172.21.15.190:6837","nonce":2873406178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/4006800179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4006800179},{"type":"v1","addr":"172.21.15.66:6833","nonce":4006800179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/689866645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":689866645},{"type":"v1","addr":"172.21.15.66:6835","nonce":689866645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-05-10T11:13:53.622 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 19 2024-05-10T11:13:53.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33680762d0 msgr2=0x7f3368078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33680762d0 0x7f3368078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f337c0cfc70 tx=0x7f3370008040 comp rx=0 tx=0).stop 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 msgr2=0x7f337c0a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 0x7f337c0a0080 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c3c0 tx=0x7f336c00c880 comp rx=0 tx=0).stop 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 shutdown_connections 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33680762d0 0x7f3368078790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c0d3780 0x7f337c0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f337c0d2580 0x7f337c0ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 --2- 172.21.15.66:0/4249823697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f337c0d0550 0x7f337c0a0080 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 >> 172.21.15.66:0/4249823697 conn(0x7f337c0d4f30 msgr2=0x7f337c0758f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 shutdown_connections 2024-05-10T11:13:53.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.624+0000 7f3381800640 1 -- 172.21.15.66:0/4249823697 wait complete. 2024-05-10T11:13:53.635 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:13:53.635 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:13:53.635 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:13:53.635 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:53.635 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:13:53.635 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:13:53.635 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:13:53.636 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:53.636 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:13:53.636 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:13:53.636 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:13:53.636 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:53.636 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:13:53.636 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:13:53.636 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:13:53.637 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:13:53.645 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:13:53.645 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:13:53.646 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:13:53.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:13:53.648 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:13:53.648 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:13:53.649 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:13:53.649 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:13:53.687 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:13:53.688 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:53.688 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:13:53.688 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:53.691 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:13:53.691 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:53.691 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:13:53.692 DEBUG:teuthology.parallel:result is None 2024-05-10T11:13:53.692 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:13:53.767 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:13:53.767 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:13:53.775 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:13:53.775 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:13:53.775 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-05-10T11:13:53.776+0000 7f2bb36e9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T11:13:53.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.801+0000 7f945416a640 1 Processor -- start 2024-05-10T11:13:53.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.802+0000 7f945416a640 1 -- start start 2024-05-10T11:13:53.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.802+0000 7f945416a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f944c15f790 0x7f944c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.802+0000 7f945416a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c0d5d30 0x7f944c0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.802+0000 7f945416a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c0d30b0 con 0x7f944c15f3b0 2024-05-10T11:13:53.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.802+0000 7f945416a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f944c0d3390 con 0x7f944c15f790 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.802+0000 7f945416a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0c8c80 con 0x7f944c0d5d30 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451f06640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f944c15f3b0 0x7f944c0d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:48774/0 (socket says 172.21.15.66:48774) 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451f06640 1 -- 172.21.15.66:0/812298352 learned_addr learned my addr 172.21.15.66:0/812298352 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451705640 1 --2- 172.21.15.66:0/812298352 >> v2:172.21.15.66:3300/0 conn(0x7f944c15f790 0x7f944c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9452707640 1 --2- 172.21.15.66:0/812298352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c0d5d30 0x7f944c0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9450f04640 1 -- 172.21.15.66:0/812298352 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127132605 0 0) 0x7f944c0d30b0 con 0x7f944c15f3b0 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9450f04640 1 -- 172.21.15.66:0/812298352 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9438003520 con 0x7f944c15f3b0 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451705640 1 -- 172.21.15.66:0/812298352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c0d5d30 msgr2=0x7f944c0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451705640 1 --2- 172.21.15.66:0/812298352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c0d5d30 0x7f944c0d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451705640 1 -- 172.21.15.66:0/812298352 >> v1:172.21.15.66:6789/0 conn(0x7f944c15f3b0 legacy=0x7f944c0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.803+0000 7f9451705640 1 -- 172.21.15.66:0/812298352 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c0c8f60 con 0x7f944c15f790 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f9451705640 1 --2- 172.21.15.66:0/812298352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c15f790 0x7f944c0cfcd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94400097a0 tx=0x7f944002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85a606969799b78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f9450f04640 1 -- 172.21.15.66:0/812298352 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440037070 con 0x7f944c15f790 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f9450f04640 1 -- 172.21.15.66:0/812298352 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9440032440 con 0x7f944c15f790 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f9450f04640 1 -- 172.21.15.66:0/812298352 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440032810 con 0x7f944c15f790 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 -- 172.21.15.66:0/812298352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c15f790 msgr2=0x7f944c0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 --2- 172.21.15.66:0/812298352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c15f790 0x7f944c0cfcd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94400097a0 tx=0x7f944002a180 comp rx=0 tx=0).stop 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 -- 172.21.15.66:0/812298352 shutdown_connections 2024-05-10T11:13:53.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 --2- 172.21.15.66:0/812298352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c0d5d30 0x7f944c0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 --2- 172.21.15.66:0/812298352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c15f790 0x7f944c0cfcd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 -- 172.21.15.66:0/812298352 >> 172.21.15.66:0/812298352 conn(0x7f944c0d5130 msgr2=0x7f944c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 -- 172.21.15.66:0/812298352 shutdown_connections 2024-05-10T11:13:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.804+0000 7f945416a640 1 -- 172.21.15.66:0/812298352 wait complete. 2024-05-10T11:13:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 Processor -- start 2024-05-10T11:13:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 -- start start 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f944c0d5d30 0x7f944c153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c15f3b0 0x7f944c0b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 0x7f944c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0d3f80 con 0x7f944c0b9680 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0d3e00 con 0x7f944c0d5d30 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f945416a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0ca770 con 0x7f944c15f3b0 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.806+0000 7f9452707640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 0x7f944c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 0x7f944c0cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36240/0 (socket says 172.21.15.66:36240) 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 -- 172.21.15.66:0/961691680 learned_addr learned my addr 172.21.15.66:0/961691680 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:53.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9451705640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c15f3b0 0x7f944c0b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9451f06640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f944c0d5d30 0x7f944c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 -- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c15f3b0 msgr2=0x7f944c0b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c15f3b0 0x7f944c0b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 -- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f944c0d5d30 msgr2=0x7f944c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f944c0d5d30 0x7f944c153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 -- 172.21.15.66:0/961691680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c0cd2f0 con 0x7f944c0b9680 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f9452707640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 0x7f944c0cb060 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9444007e40 tx=0x7f944400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444014620 con 0x7f944c0b9680 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9444019070 con 0x7f944c0b9680 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c0cd5d0 con 0x7f944c0b9680 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444014a20 con 0x7f944c0b9680 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.807+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c0cdb90 con 0x7f944c0b9680 2024-05-10T11:13:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.808+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c06a220 con 0x7f944c0b9680 2024-05-10T11:13:53.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.809+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9444014bc0 con 0x7f944c0b9680 2024-05-10T11:13:53.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.809+0000 7f943e7fc640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94300762d0 0x7f9430078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:53.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.810+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f9444097bb0 con 0x7f944c0b9680 2024-05-10T11:13:53.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.810+0000 7f9451f06640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94300762d0 0x7f9430078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:53.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.810+0000 7f9451f06640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94300762d0 0x7f9430078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9448005880 tx=0x7f9448009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:53.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:53.814+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f94440610c0 con 0x7f944c0b9680 2024-05-10T11:13:54.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:54.022+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f944c0cfd10 con 0x7f944c0b9680 2024-05-10T11:13:55.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.074+0000 7f943e7fc640 1 -- 172.21.15.66:0/961691680 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7f94440653c0 con 0x7f944c0b9680 2024-05-10T11:13:55.074 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:13:55.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94300762d0 msgr2=0x7f9430078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94300762d0 0x7f9430078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9448005880 tx=0x7f9448009040 comp rx=0 tx=0).stop 2024-05-10T11:13:55.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 msgr2=0x7f944c0cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 0x7f944c0cb060 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9444007e40 tx=0x7f944400e4b0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 shutdown_connections 2024-05-10T11:13:55.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94300762d0 0x7f9430078790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f944c0b9680 0x7f944c0cb060 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f944c15f3b0 0x7f944c0b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 --2- 172.21.15.66:0/961691680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f944c0d5d30 0x7f944c153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 >> 172.21.15.66:0/961691680 conn(0x7f944c0d5130 msgr2=0x7f944c06e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:55.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 shutdown_connections 2024-05-10T11:13:55.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.077+0000 7f945416a640 1 -- 172.21.15.66:0/961691680 wait complete. 2024-05-10T11:13:55.091 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:13:55.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.201+0000 7f55eff04640 1 Processor -- start 2024-05-10T11:13:55.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 -- start start 2024-05-10T11:13:55.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55e80b5900 0x7f55e80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f55e80b62e0 0x7f55e80d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f55e80d5c60 con 0x7f55e80b5900 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f55e80d41f0 con 0x7f55e80b62e0 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.202+0000 7f55eff04640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55e80d5eb0 con 0x7f55e80b5520 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55e80b5900 0x7f55e80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55e80b5900 0x7f55e80d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60746/0 (socket says 172.21.15.66:60746) 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 -- 172.21.15.66:0/3384846980 learned_addr learned my addr 172.21.15.66:0/3384846980 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ee4a1640 1 --2- 172.21.15.66:0/3384846980 >> v2:172.21.15.190:3300/0 conn(0x7f55e80b62e0 0x7f55e80d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55edca0640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 -- 172.21.15.66:0/3384846980 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 msgr2=0x7f55e80d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 -- 172.21.15.66:0/3384846980 >> v2:172.21.15.190:3300/0 conn(0x7f55e80b62e0 msgr2=0x7f55e80d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 --2- 172.21.15.66:0/3384846980 >> v2:172.21.15.190:3300/0 conn(0x7f55e80b62e0 0x7f55e80d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55ed49f640 1 -- 172.21.15.66:0/3384846980 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e80d0a30 con 0x7f55e80b5900 2024-05-10T11:13:55.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.203+0000 7f55edca0640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55ed49f640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b5900 0x7f55e80d1de0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f55e80cf850 tx=0x7f55dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c92408d9950b89a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55ecc9e640 1 -- 172.21.15.66:0/3384846980 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc037070 con 0x7f55e80b5900 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55ecc9e640 1 -- 172.21.15.66:0/3384846980 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc032440 con 0x7f55e80b5900 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55ecc9e640 1 -- 172.21.15.66:0/3384846980 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc032810 con 0x7f55e80b5900 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 -- 172.21.15.66:0/3384846980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b5900 msgr2=0x7f55e80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b5900 0x7f55e80d1de0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f55e80cf850 tx=0x7f55dc02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 -- 172.21.15.66:0/3384846980 shutdown_connections 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 --2- 172.21.15.66:0/3384846980 >> v2:172.21.15.190:3300/0 conn(0x7f55e80b62e0 0x7f55e80d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b5900 0x7f55e80d1de0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 --2- 172.21.15.66:0/3384846980 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.204+0000 7f55eff04640 1 -- 172.21.15.66:0/3384846980 >> 172.21.15.66:0/3384846980 conn(0x7f55e80d5170 msgr2=0x7f55e80d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.205+0000 7f55eff04640 1 -- 172.21.15.66:0/3384846980 shutdown_connections 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.205+0000 7f55eff04640 1 -- 172.21.15.66:0/3384846980 wait complete. 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.206+0000 7f55eff04640 1 Processor -- start 2024-05-10T11:13:55.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.206+0000 7f55eff04640 1 -- start start 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.206+0000 7f55eff04640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.206+0000 7f55eff04640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55e80b5900 0x7f55e80cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55eff04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 0x7f55e80cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55eff04640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80b5f10 con 0x7f55e80b62e0 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55eff04640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80b5d90 con 0x7f55e80b5900 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55eff04640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55e80b6090 con 0x7f55e80b5520 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 0x7f55e80cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 0x7f55e80cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60762/0 (socket says 172.21.15.66:60762) 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 -- 172.21.15.66:0/1367881001 learned_addr learned my addr 172.21.15.66:0/1367881001 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 -- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 msgr2=0x7f55e80a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55edca0640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ed49f640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55e80b5900 0x7f55e80cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 -- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55e80b5900 msgr2=0x7f55e80cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55e80b5900 0x7f55e80cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 -- 172.21.15.66:0/1367881001 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e81f53f0 con 0x7f55e80b62e0 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55ee4a1640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 0x7f55e80cd7d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f55d800efc0 tx=0x7f55d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8018020 con 0x7f55e80b62e0 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d8014480 con 0x7f55e80b62e0 2024-05-10T11:13:55.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e80a2ef0 con 0x7f55e80b62e0 2024-05-10T11:13:55.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8014870 con 0x7f55e80b62e0 2024-05-10T11:13:55.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.207+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e80ce0e0 con 0x7f55e80b62e0 2024-05-10T11:13:55.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.208+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e80bb040 con 0x7f55e80b62e0 2024-05-10T11:13:55.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.209+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55d8005d10 con 0x7f55e80b62e0 2024-05-10T11:13:55.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.209+0000 7f55e67fc640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55d40762d0 0x7f55d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.210+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5249+0+0 (secure 0 0 0) 0x7f55d8097e60 con 0x7f55e80b62e0 2024-05-10T11:13:55.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.210+0000 7f55edca0640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55d40762d0 0x7f55d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.210+0000 7f55edca0640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55d40762d0 0x7f55d4078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006fd0 tx=0x7f55e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.214+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f55e80bb040 con 0x7f55e80b62e0 2024-05-10T11:13:55.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.475+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f55e80693f0 con 0x7f55e80b62e0 2024-05-10T11:13:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.476+0000 7f55e67fc640 1 -- 172.21.15.66:0/1367881001 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f55d8022070 con 0x7f55e80b62e0 2024-05-10T11:13:55.476 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:55.476 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:13:55.476 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:13:55.476 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:55.478 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.481 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.484 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:13:55.485 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow r", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:55.486 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:13:55.487 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:13:55.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.489 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:13:55.490 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:13:55.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55d40762d0 msgr2=0x7f55d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55d40762d0 0x7f55d4078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006fd0 tx=0x7f55e0008040 comp rx=0 tx=0).stop 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 msgr2=0x7f55e80cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 0x7f55e80cd7d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f55d800efc0 tx=0x7f55d800c490 comp rx=0 tx=0).stop 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 shutdown_connections 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55d40762d0 0x7f55d4078790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55e80b62e0 0x7f55e80cd7d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55e80b5900 0x7f55e80cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 --2- 172.21.15.66:0/1367881001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55e80b5520 0x7f55e80a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 >> 172.21.15.66:0/1367881001 conn(0x7f55e80d5170 msgr2=0x7f55e806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 shutdown_connections 2024-05-10T11:13:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.478+0000 7f55eff04640 1 -- 172.21.15.66:0/1367881001 wait complete. 2024-05-10T11:13:55.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:13:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.597+0000 7f1235dd4640 1 Processor -- start 2024-05-10T11:13:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.597+0000 7f1235dd4640 1 -- start start 2024-05-10T11:13:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f1235dd4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f123015f4e0 0x7f123006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f1235dd4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f123006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f1235dd4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f123006e450 0x7f12300afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f1235dd4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f12300b23f0 con 0x7f123006e450 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f1235dd4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f12300b4150 con 0x7f123015f4e0 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f1235dd4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f123006e8c0 con 0x7f123015f8c0 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f123006e450 0x7f12300afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f123006e450 0x7f12300afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60778/0 (socket says 172.21.15.66:60778) 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 -- 172.21.15.66:0/1921218531 learned_addr learned my addr 172.21.15.66:0/1921218531 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122f7fe640 1 --2- 172.21.15.66:0/1921218531 >> v2:172.21.15.190:3300/0 conn(0x7f123015f4e0 0x7f123006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122effd640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f123006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 -- 172.21.15.66:0/1921218531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 msgr2=0x7f123006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f123006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 -- 172.21.15.66:0/1921218531 >> v2:172.21.15.190:3300/0 conn(0x7f123015f4e0 msgr2=0x7f123006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 --2- 172.21.15.66:0/1921218531 >> v2:172.21.15.190:3300/0 conn(0x7f123015f4e0 0x7f123006d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122ffff640 1 -- 172.21.15.66:0/1921218531 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12300b3540 con 0x7f123006e450 2024-05-10T11:13:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.598+0000 7f122effd640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f123006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.599+0000 7f122ffff640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123006e450 0x7f12300afa80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1230068c10 tx=0x7f122802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2774d2fc2fbe269 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.599+0000 7f122e7fc640 1 -- 172.21.15.66:0/1921218531 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228036070 con 0x7f123006e450 2024-05-10T11:13:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.599+0000 7f122e7fc640 1 -- 172.21.15.66:0/1921218531 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1228031600 con 0x7f123006e450 2024-05-10T11:13:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.599+0000 7f122e7fc640 1 -- 172.21.15.66:0/1921218531 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280319d0 con 0x7f123006e450 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.599+0000 7f1235dd4640 1 -- 172.21.15.66:0/1921218531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123006e450 msgr2=0x7f12300afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.599+0000 7f1235dd4640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123006e450 0x7f12300afa80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1230068c10 tx=0x7f122802a610 comp rx=0 tx=0).stop 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 -- 172.21.15.66:0/1921218531 shutdown_connections 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123006e450 0x7f12300afa80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 --2- 172.21.15.66:0/1921218531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f123006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 --2- 172.21.15.66:0/1921218531 >> v2:172.21.15.190:3300/0 conn(0x7f123015f4e0 0x7f123006d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 -- 172.21.15.66:0/1921218531 >> 172.21.15.66:0/1921218531 conn(0x7f12300d2df0 msgr2=0x7f12300d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 -- 172.21.15.66:0/1921218531 shutdown_connections 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.600+0000 7f1235dd4640 1 -- 172.21.15.66:0/1921218531 wait complete. 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.601+0000 7f1235dd4640 1 Processor -- start 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.601+0000 7f1235dd4640 1 -- start start 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1235dd4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f123006e450 0x7f1230156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1235dd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 0x7f1230161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1235dd4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f1230162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1235dd4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f12300b3de0 con 0x7f123015f4e0 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1235dd4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f12300b3b00 con 0x7f123006e450 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1235dd4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f12300b45e0 con 0x7f123015f8c0 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 0x7f1230161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 0x7f1230161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60790/0 (socket says 172.21.15.66:60790) 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 -- 172.21.15.66:0/3890520728 learned_addr learned my addr 172.21.15.66:0/3890520728 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 -- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 msgr2=0x7f1230162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122f7fe640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f123006e450 0x7f1230156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f1230162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 -- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f123006e450 msgr2=0x7f1230156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f123006e450 0x7f1230156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 -- 172.21.15.66:0/3890520728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12301551b0 con 0x7f123015f4e0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f122effd640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 0x7f1230161ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f122400c7c0 tx=0x7f122400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224015070 con 0x7f123015f4e0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.602+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224007820 con 0x7f123015f4e0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.603+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1230155490 con 0x7f123015f4e0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.603+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224007bf0 con 0x7f123015f4e0 2024-05-10T11:13:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.603+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1230155f70 con 0x7f123015f4e0 2024-05-10T11:13:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.604+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123006a220 con 0x7f123015f4e0 2024-05-10T11:13:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.604+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1224018070 con 0x7f123015f4e0 2024-05-10T11:13:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.605+0000 7f1217fff640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f121c0762d0 0x7f121c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.605+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5249+0+0 (secure 0 0 0) 0x7f1224097270 con 0x7f123015f4e0 2024-05-10T11:13:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.605+0000 7f122f7fe640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f121c0762d0 0x7f121c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.606+0000 7f122f7fe640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f121c0762d0 0x7f121c078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1220006fd0 tx=0x7f1220008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.609+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1224060e20 con 0x7f123015f4e0 2024-05-10T11:13:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.804+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1230162f40 con 0x7f123015f4e0 2024-05-10T11:13:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.804+0000 7f1217fff640 1 -- 172.21.15.66:0/3890520728 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) ==== 84+0+65 (secure 0 0 0) 0x7f1224060720 con 0x7f123015f4e0 2024-05-10T11:13:55.805 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:55.805 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:13:55.806 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:13:55.806 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:13:55.806 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:13:55.806 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:13:55.806 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:13:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f121c0762d0 msgr2=0x7f121c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f121c0762d0 0x7f121c078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1220006fd0 tx=0x7f1220008040 comp rx=0 tx=0).stop 2024-05-10T11:13:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 msgr2=0x7f1230161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 0x7f1230161ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f122400c7c0 tx=0x7f122400cc80 comp rx=0 tx=0).stop 2024-05-10T11:13:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 shutdown_connections 2024-05-10T11:13:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f121c0762d0 0x7f121c078790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f123015f8c0 0x7f1230162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f123015f4e0 0x7f1230161ec0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 --2- 172.21.15.66:0/3890520728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f123006e450 0x7f1230156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.806+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 >> 172.21.15.66:0/3890520728 conn(0x7f12300d2df0 msgr2=0x7f12300d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.807+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 shutdown_connections 2024-05-10T11:13:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.807+0000 7f1235dd4640 1 -- 172.21.15.66:0/3890520728 wait complete. 2024-05-10T11:13:55.818 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:13:55.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:13:55.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.927+0000 7fa914c93640 1 Processor -- start 2024-05-10T11:13:55.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.927+0000 7fa914c93640 1 -- start start 2024-05-10T11:13:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa914c93640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa9100d3610 0x7fa9100d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa914c93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9100b5750 0x7fa9100b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa914c93640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9100b46b0 con 0x7fa91015f600 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa914c93640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100b4990 con 0x7fa9100d3610 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa914c93640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100b4c70 con 0x7fa9100b5750 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa90ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9100b5750 0x7fa9100b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa90dd9b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa9100d3610 0x7fa9100d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa90e59c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa91015f600 0x7fa9100d0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:46414/0 (socket says 172.21.15.66:46414) 2024-05-10T11:13:55.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa90e59c640 1 -- 172.21.15.66:0/1567586229 learned_addr learned my addr 172.21.15.66:0/1567586229 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.928+0000 7fa90dd9b640 1 --2- 172.21.15.66:0/1567586229 >> v2:172.21.15.190:3300/0 conn(0x7fa9100d3610 0x7fa9100d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:51704/0 (socket says 172.21.15.66:51704) 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.929+0000 7fa90dd9b640 1 -- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9100b5750 msgr2=0x7fa9100b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.929+0000 7fa90dd9b640 1 --2- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9100b5750 0x7fa9100b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.929+0000 7fa90dd9b640 1 -- 172.21.15.66:0/1567586229 >> v1:172.21.15.190:6789/0 conn(0x7fa91015f600 legacy=0x7fa9100d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.929+0000 7fa90dd9b640 1 -- 172.21.15.66:0/1567586229 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9100b4f50 con 0x7fa9100d3610 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.929+0000 7fa90ed9d640 1 --2- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9100b5750 0x7fa9100b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa90dd9b640 1 --2- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa9100d3aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097a0 tx=0x7fa90402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df660d644c5dc231 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa90d59a640 1 -- 172.21.15.66:0/1567586229 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904037070 con 0x7fa9100d3610 2024-05-10T11:13:55.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa90d59a640 1 -- 172.21.15.66:0/1567586229 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90402ae50 con 0x7fa9100d3610 2024-05-10T11:13:55.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa90d59a640 1 -- 172.21.15.66:0/1567586229 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904032660 con 0x7fa9100d3610 2024-05-10T11:13:55.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa914c93640 1 -- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 msgr2=0x7fa9100d3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa914c93640 1 --2- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa9100d3aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097a0 tx=0x7fa90402a100 comp rx=0 tx=0).stop 2024-05-10T11:13:55.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa914c93640 1 -- 172.21.15.66:0/1567586229 shutdown_connections 2024-05-10T11:13:55.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa914c93640 1 --2- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9100b5750 0x7fa9100b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa914c93640 1 --2- 172.21.15.66:0/1567586229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa9100d3aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.930+0000 7fa914c93640 1 -- 172.21.15.66:0/1567586229 >> 172.21.15.66:0/1567586229 conn(0x7fa91009e390 msgr2=0x7fa9100d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:55.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.931+0000 7fa914c93640 1 -- 172.21.15.66:0/1567586229 shutdown_connections 2024-05-10T11:13:55.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.931+0000 7fa914c93640 1 -- 172.21.15.66:0/1567586229 wait complete. 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.932+0000 7fa914c93640 1 Processor -- start 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.932+0000 7fa914c93640 1 -- start start 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa914c93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 0x7fa9101576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa914c93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa910156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa914c93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa91015f600 0x7fa9100b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa914c93640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100d0ee0 con 0x7fa9100b5750 2024-05-10T11:13:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa914c93640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100d0d60 con 0x7fa9100d3610 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa914c93640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100b6120 con 0x7fa91015f600 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 0x7fa9101576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 0x7fa9101576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60802/0 (socket says 172.21.15.66:60802) 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 -- 172.21.15.66:0/2931800887 learned_addr learned my addr 172.21.15.66:0/2931800887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90ed9d640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa91015f600 0x7fa9100b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90dd9b640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa910156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 -- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa91015f600 msgr2=0x7fa9100b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa91015f600 0x7fa9100b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 -- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 msgr2=0x7fa910156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa910156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 -- 172.21.15.66:0/2931800887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9100b8910 con 0x7fa9100b5750 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90ed9d640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa91015f600 0x7fa9100b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa90e59c640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 0x7fa9101576a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c3c0 tx=0x7fa90000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900017070 con 0x7fa9100b5750 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.933+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900005ce0 con 0x7fa9100b5750 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.934+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9100b8630 con 0x7fa9100b5750 2024-05-10T11:13:55.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.934+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9000072f0 con 0x7fa9100b5750 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.934+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101e8080 con 0x7fa9100b5750 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.934+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91006a220 con 0x7fa9100b5750 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.935+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa90001a070 con 0x7fa9100b5750 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.936+0000 7fa8feffd640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8f00762d0 0x7fa8f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.936+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5249+0+0 (secure 0 0 0) 0x7fa900096790 con 0x7fa9100b5750 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.936+0000 7fa90dd9b640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8f00762d0 0x7fa8f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.936+0000 7fa90dd9b640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8f00762d0 0x7fa8f0078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa904034000 tx=0x7fa90402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:55.940+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa9000602b0 con 0x7fa9100b5750 2024-05-10T11:13:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:56.130+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa9100b43f0 con 0x7fa9100b5750 2024-05-10T11:13:57.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.077+0000 7fa8feffd640 1 -- 172.21.15.66:0/2931800887 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) ==== 138+0+0 (secure 0 0 0) 0x7fa90005fbb0 con 0x7fa9100b5750 2024-05-10T11:13:57.078 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:13:57.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8f00762d0 msgr2=0x7fa8f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:57.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8f00762d0 0x7fa8f0078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa904034000 tx=0x7fa90402e000 comp rx=0 tx=0).stop 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 msgr2=0x7fa9101576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 0x7fa9101576a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c3c0 tx=0x7fa90000c880 comp rx=0 tx=0).stop 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 shutdown_connections 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8f00762d0 0x7fa8f0078790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa91015f600 0x7fa9100b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9100d3610 0x7fa910156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 --2- 172.21.15.66:0/2931800887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9100b5750 0x7fa9101576a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 >> 172.21.15.66:0/2931800887 conn(0x7fa91009e390 msgr2=0x7fa9100b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.080+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 shutdown_connections 2024-05-10T11:13:57.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.081+0000 7fa914c93640 1 -- 172.21.15.66:0/2931800887 wait complete. 2024-05-10T11:13:57.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:13:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.215+0000 7f9bcd389640 1 Processor -- start 2024-05-10T11:13:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.215+0000 7f9bcd389640 1 -- start start 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bcd389640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162900 0x7f9bc80d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bcd389640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9bc80d3950 0x7f9bc80d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bcd389640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc80d4190 con 0x7f9bc8162ce0 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bcd389640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9bc80cfc40 con 0x7f9bc80d3950 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bcd389640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc80d3eb0 con 0x7f9bc8162900 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9bc80d3950 0x7f9bc80d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9bc80d3950 0x7f9bc80d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60818/0 (socket says 172.21.15.66:60818) 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 -- 172.21.15.66:0/2879673271 learned_addr learned my addr 172.21.15.66:0/2879673271 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc6ffd640 1 --2- 172.21.15.66:0/2879673271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162900 0x7f9bc80d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 -- 172.21.15.66:0/2879673271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162900 msgr2=0x7f9bc80d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 --2- 172.21.15.66:0/2879673271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162900 0x7f9bc80d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 -- 172.21.15.66:0/2879673271 >> v1:172.21.15.190:6789/0 conn(0x7f9bc8162ce0 legacy=0x7f9bc80b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.216+0000 7f9bc77fe640 1 -- 172.21.15.66:0/2879673271 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc80cfee0 con 0x7f9bc80d3950 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.217+0000 7f9bc77fe640 1 --2- 172.21.15.66:0/2879673271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc80d3950 0x7f9bc80d09c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009e50 tx=0x7f9bc002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26131b14c88f5f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.217+0000 7f9bc5ffb640 1 -- 172.21.15.66:0/2879673271 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0036070 con 0x7f9bc80d3950 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.217+0000 7f9bc5ffb640 1 -- 172.21.15.66:0/2879673271 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0031600 con 0x7f9bc80d3950 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.217+0000 7f9bc5ffb640 1 -- 172.21.15.66:0/2879673271 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00319d0 con 0x7f9bc80d3950 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 -- 172.21.15.66:0/2879673271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc80d3950 msgr2=0x7f9bc80d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2879673271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc80d3950 0x7f9bc80d09c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009e50 tx=0x7f9bc002a680 comp rx=0 tx=0).stop 2024-05-10T11:13:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 -- 172.21.15.66:0/2879673271 shutdown_connections 2024-05-10T11:13:57.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2879673271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc80d3950 0x7f9bc80d09c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2879673271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162900 0x7f9bc80d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 -- 172.21.15.66:0/2879673271 >> 172.21.15.66:0/2879673271 conn(0x7f9bc809e430 msgr2=0x7f9bc80d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:57.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 -- 172.21.15.66:0/2879673271 shutdown_connections 2024-05-10T11:13:57.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.218+0000 7f9bcd389640 1 -- 172.21.15.66:0/2879673271 wait complete. 2024-05-10T11:13:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.219+0000 7f9bcd389640 1 Processor -- start 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.219+0000 7f9bcd389640 1 -- start start 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bcd389640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bc80d3950 0x7f9bc815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bcd389640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 0x7f9bc80b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bcd389640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162ce0 0x7f9bc815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bcd389640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80b4300 con 0x7f9bc8162900 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bcd389640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80b4180 con 0x7f9bc80d3950 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bcd389640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc80b4ff0 con 0x7f9bc8162ce0 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 0x7f9bc80b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 0x7f9bc80b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60826/0 (socket says 172.21.15.66:60826) 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 -- 172.21.15.66:0/2612947081 learned_addr learned my addr 172.21.15.66:0/2612947081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc6ffd640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bc80d3950 0x7f9bc815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc77fe640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162ce0 0x7f9bc815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 -- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162ce0 msgr2=0x7f9bc815e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162ce0 0x7f9bc815e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 -- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bc80d3950 msgr2=0x7f9bc815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bc80d3950 0x7f9bc815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.220+0000 7f9bc67fc640 1 -- 172.21.15.66:0/2612947081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc80cca50 con 0x7f9bc8162900 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.221+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 0x7f9bc80b9830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00c400 tx=0x7f9bbc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.221+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0052d0 con 0x7f9bc8162900 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.221+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bbc005490 con 0x7f9bc8162900 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.221+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc80b8a30 con 0x7f9bc8162900 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.221+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc007260 con 0x7f9bc8162900 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.221+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc80b8ff0 con 0x7f9bc8162900 2024-05-10T11:13:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.222+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc806a220 con 0x7f9bc8162900 2024-05-10T11:13:57.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.223+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9bbc007400 con 0x7f9bc8162900 2024-05-10T11:13:57.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.223+0000 7f9baf7fe640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb40762d0 0x7f9bb4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:57.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.223+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5619+0+0 (secure 0 0 0) 0x7f9bbc096de0 con 0x7f9bc8162900 2024-05-10T11:13:57.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.224+0000 7f9bc6ffd640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb40762d0 0x7f9bb4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:57.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.224+0000 7f9bc6ffd640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb40762d0 0x7f9bb4078790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bc806dd00 tx=0x7f9bb8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:57.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.227+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9bc80cca50 con 0x7f9bc8162900 2024-05-10T11:13:57.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:57.418+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9bc815fd00 con 0x7f9bc8162900 2024-05-10T11:13:58.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.082+0000 7f9baf7fe640 1 -- 172.21.15.66:0/2612947081 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) ==== 170+0+0 (secure 0 0 0) 0x7f9bc80d4190 con 0x7f9bc8162900 2024-05-10T11:13:58.082 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb40762d0 msgr2=0x7f9bb4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb40762d0 0x7f9bb4078790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bc806dd00 tx=0x7f9bb8009190 comp rx=0 tx=0).stop 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 msgr2=0x7f9bc80b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 0x7f9bc80b9830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00c400 tx=0x7f9bbc00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 shutdown_connections 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb40762d0 0x7f9bb4078790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bc8162ce0 0x7f9bc815e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bc8162900 0x7f9bc80b9830 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 --2- 172.21.15.66:0/2612947081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bc80d3950 0x7f9bc815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.085+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 >> 172.21.15.66:0/2612947081 conn(0x7f9bc809e430 msgr2=0x7f9bc806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.086+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 shutdown_connections 2024-05-10T11:13:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.086+0000 7f9bcd389640 1 -- 172.21.15.66:0/2612947081 wait complete. 2024-05-10T11:13:58.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:13:58.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.226+0000 7f8430215640 1 Processor -- start 2024-05-10T11:13:58.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.226+0000 7f8430215640 1 -- start start 2024-05-10T11:13:58.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f8430215640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8428162900 0x7f84280d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f8430215640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84280d4190 con 0x7f84280d3950 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f8430215640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84280cfc40 con 0x7f8428162ce0 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f8430215640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f84280d3eb0 con 0x7f8428162900 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842dfb1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8428162900 0x7f84280d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842e7b2640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f84280d3950 0x7f84280d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34546/0 (socket says 172.21.15.66:34546) 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842dfb1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8428162900 0x7f84280d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60840/0 (socket says 172.21.15.66:60840) 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842e7b2640 1 -- 172.21.15.66:0/3799035286 learned_addr learned my addr 172.21.15.66:0/3799035286 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842dfb1640 1 -- 172.21.15.66:0/3799035286 >> v1:172.21.15.190:6789/0 conn(0x7f8428162ce0 legacy=0x7f84280b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842dfb1640 1 -- 172.21.15.66:0/3799035286 >> v1:172.21.15.66:6789/0 conn(0x7f84280d3950 legacy=0x7f84280d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.227+0000 7f842dfb1640 1 -- 172.21.15.66:0/3799035286 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84280cfee0 con 0x7f8428162900 2024-05-10T11:13:58.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.228+0000 7f842dfb1640 1 --2- 172.21.15.66:0/3799035286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162900 0x7f84280d3410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f84240097a0 tx=0x7f842402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4112a038d760832d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:58.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.228+0000 7f842cfaf640 1 -- 172.21.15.66:0/3799035286 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424037070 con 0x7f8428162900 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.228+0000 7f842cfaf640 1 -- 172.21.15.66:0/3799035286 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842402ad30 con 0x7f8428162900 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.228+0000 7f842cfaf640 1 -- 172.21.15.66:0/3799035286 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424032660 con 0x7f8428162900 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 -- 172.21.15.66:0/3799035286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162900 msgr2=0x7f84280d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 --2- 172.21.15.66:0/3799035286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162900 0x7f84280d3410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f84240097a0 tx=0x7f842402a0a0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 -- 172.21.15.66:0/3799035286 shutdown_connections 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 --2- 172.21.15.66:0/3799035286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162900 0x7f84280d3410 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 -- 172.21.15.66:0/3799035286 >> 172.21.15.66:0/3799035286 conn(0x7f842809e430 msgr2=0x7f84280d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 -- 172.21.15.66:0/3799035286 shutdown_connections 2024-05-10T11:13:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.229+0000 7f8430215640 1 -- 172.21.15.66:0/3799035286 wait complete. 2024-05-10T11:13:58.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.230+0000 7f8430215640 1 Processor -- start 2024-05-10T11:13:58.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.230+0000 7f8430215640 1 -- start start 2024-05-10T11:13:58.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84280d3950 0x7f84280b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8428162900 0x7f842814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 0x7f84280ba390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84280b4300 con 0x7f8428162ce0 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84280b4180 con 0x7f8428162900 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f84280b4ff0 con 0x7f84280d3950 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 0x7f84280ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 0x7f84280ba390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60856/0 (socket says 172.21.15.66:60856) 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 -- 172.21.15.66:0/3762986170 learned_addr learned my addr 172.21.15.66:0/3762986170 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842dfb1640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84280d3950 0x7f84280b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842d7b0640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8428162900 0x7f842814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 -- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84280d3950 msgr2=0x7f84280b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84280d3950 0x7f84280b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 -- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8428162900 msgr2=0x7f842814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8428162900 0x7f842814dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 -- 172.21.15.66:0/3762986170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842814e100 con 0x7f8428162ce0 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f842e7b2640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 0x7f84280ba390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f842000ca40 tx=0x7f842000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420018070 con 0x7f8428162ce0 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842000a7c0 con 0x7f8428162ce0 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000abf0 con 0x7f8428162ce0 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.231+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84280b2370 con 0x7f8428162ce0 2024-05-10T11:13:58.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.232+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84280b2c10 con 0x7f8428162ce0 2024-05-10T11:13:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.233+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842806a220 con 0x7f8428162ce0 2024-05-10T11:13:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.233+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f842001b070 con 0x7f8428162ce0 2024-05-10T11:13:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.234+0000 7f841e7fc640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f840c0762d0 0x7f840c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.234+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6001+0+0 (secure 0 0 0) 0x7f8420096fc0 con 0x7f8428162ce0 2024-05-10T11:13:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.234+0000 7f842dfb1640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f840c0762d0 0x7f840c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.234+0000 7f842dfb1640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f840c0762d0 0x7f840c078790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8424034000 tx=0x7f842402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:58.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.238+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f84280d4190 con 0x7f8428162ce0 2024-05-10T11:13:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:58.471+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f842809e840 con 0x7f8428162ce0 2024-05-10T11:13:59.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.083+0000 7f841e7fc640 1 -- 172.21.15.66:0/3762986170 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) ==== 172+0+0 (secure 0 0 0) 0x7f84200607f0 con 0x7f8428162ce0 2024-05-10T11:13:59.084 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 7 and data pool 8 2024-05-10T11:13:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.097+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f840c0762d0 msgr2=0x7f840c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.097+0000 7f8430215640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f840c0762d0 0x7f840c078790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8424034000 tx=0x7f842402e000 comp rx=0 tx=0).stop 2024-05-10T11:13:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.097+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 msgr2=0x7f84280ba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.097+0000 7f8430215640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 0x7f84280ba390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f842000ca40 tx=0x7f842000cf00 comp rx=0 tx=0).stop 2024-05-10T11:13:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.098+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 shutdown_connections 2024-05-10T11:13:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.098+0000 7f8430215640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f840c0762d0 0x7f840c078790 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8424034000 tx=0x7f842402e000 comp rx=0 tx=0).stop 2024-05-10T11:13:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.098+0000 7f8430215640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8428162ce0 0x7f84280ba390 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.098+0000 7f8430215640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8428162900 0x7f842814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.098+0000 7f8430215640 1 --2- 172.21.15.66:0/3762986170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84280d3950 0x7f84280b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.098+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 >> 172.21.15.66:0/3762986170 conn(0x7f842809e430 msgr2=0x7f842815eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.099+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 shutdown_connections 2024-05-10T11:13:59.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.099+0000 7f8430215640 1 -- 172.21.15.66:0/3762986170 wait complete. 2024-05-10T11:13:59.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:59.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.228+0000 7fc641a72640 1 Processor -- start 2024-05-10T11:13:59.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.228+0000 7fc641a72640 1 -- start start 2024-05-10T11:13:59.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc641a72640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc63c15ce60 0x7fc63c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc641a72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c0c65f0 0x7fc63c160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc641a72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c0c6a30 con 0x7fc63c161010 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc641a72640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc63c161480 con 0x7fc63c15ce60 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc641a72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c0cd090 con 0x7fc63c0c65f0 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc63b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc63c15ce60 0x7fc63c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc63b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc63c15ce60 0x7fc63c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60864/0 (socket says 172.21.15.66:60864) 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.229+0000 7fc63b7fe640 1 -- 172.21.15.66:0/3011266924 learned_addr learned my addr 172.21.15.66:0/3011266924 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.230+0000 7fc63affd640 1 --2- 172.21.15.66:0/3011266924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c0c65f0 0x7fc63c160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.230+0000 7fc63b7fe640 1 -- 172.21.15.66:0/3011266924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c0c65f0 msgr2=0x7fc63c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.230+0000 7fc63b7fe640 1 --2- 172.21.15.66:0/3011266924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c0c65f0 0x7fc63c160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.230+0000 7fc63b7fe640 1 -- 172.21.15.66:0/3011266924 >> v1:172.21.15.190:6789/0 conn(0x7fc63c161010 legacy=0x7fc63c0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.230+0000 7fc63b7fe640 1 -- 172.21.15.66:0/3011266924 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c0cd370 con 0x7fc63c15ce60 2024-05-10T11:13:59.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.230+0000 7fc63b7fe640 1 --2- 172.21.15.66:0/3011266924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c15ce60 0x7fc63c0cb300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1d5538431a0e84 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc63a7fc640 1 -- 172.21.15.66:0/3011266924 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c037070 con 0x7fc63c15ce60 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc63a7fc640 1 -- 172.21.15.66:0/3011266924 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c032440 con 0x7fc63c15ce60 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc63a7fc640 1 -- 172.21.15.66:0/3011266924 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c032810 con 0x7fc63c15ce60 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 -- 172.21.15.66:0/3011266924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c15ce60 msgr2=0x7fc63c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 --2- 172.21.15.66:0/3011266924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c15ce60 0x7fc63c0cb300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c02a180 comp rx=0 tx=0).stop 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 -- 172.21.15.66:0/3011266924 shutdown_connections 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 --2- 172.21.15.66:0/3011266924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c0c65f0 0x7fc63c160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 --2- 172.21.15.66:0/3011266924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c15ce60 0x7fc63c0cb300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 -- 172.21.15.66:0/3011266924 >> 172.21.15.66:0/3011266924 conn(0x7fc63c0b2900 msgr2=0x7fc63c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 -- 172.21.15.66:0/3011266924 shutdown_connections 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.231+0000 7fc641a72640 1 -- 172.21.15.66:0/3011266924 wait complete. 2024-05-10T11:13:59.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.233+0000 7fc641a72640 1 Processor -- start 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.233+0000 7fc641a72640 1 -- start start 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.233+0000 7fc641a72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 0x7fc63c1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.233+0000 7fc641a72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c15ce60 0x7fc63c09dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.233+0000 7fc641a72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc63c161010 0x7fc63c1e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.233+0000 7fc641a72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c0ccd60 con 0x7fc63c0c65f0 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc641a72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c0cd930 con 0x7fc63c161010 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc641a72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c15e250 con 0x7fc63c15ce60 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 0x7fc63c1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 0x7fc63c1f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60878/0 (socket says 172.21.15.66:60878) 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 -- 172.21.15.66:0/1746024447 learned_addr learned my addr 172.21.15.66:0/1746024447 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:59.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63affd640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c15ce60 0x7fc63c09dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63bfff640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc63c161010 0x7fc63c1e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 -- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c15ce60 msgr2=0x7fc63c09dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c15ce60 0x7fc63c09dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 -- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc63c161010 msgr2=0x7fc63c1e7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc63c161010 0x7fc63c1e7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 -- 172.21.15.66:0/1746024447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c1f4440 con 0x7fc63c0c65f0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc63b7fe640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 0x7fc63c1f3f00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c041020 con 0x7fc63c0c65f0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c0306c0 con 0x7fc63c0c65f0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c09e4f0 con 0x7fc63c0c65f0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c037040 con 0x7fc63c0c65f0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.234+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c09d4d0 con 0x7fc63c0c65f0 2024-05-10T11:13:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.235+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc63c0cde50 con 0x7fc63c0c65f0 2024-05-10T11:13:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.236+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc62c044020 con 0x7fc63c0c65f0 2024-05-10T11:13:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.236+0000 7fc623fff640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc6280762d0 0x7fc628078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.237+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6101+0+0 (secure 0 0 0) 0x7fc62c0b7f50 con 0x7fc63c0c65f0 2024-05-10T11:13:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.237+0000 7fc63affd640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc6280762d0 0x7fc628078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.237+0000 7fc63affd640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc6280762d0 0x7fc628078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc63c09e7c0 tx=0x7fc630008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.241+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc63c0cde50 con 0x7fc63c0c65f0 2024-05-10T11:13:59.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.437+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc63c06a220 con 0x7fc63c0c65f0 2024-05-10T11:13:59.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.438+0000 7fc623fff640 1 -- 172.21.15.66:0/1746024447 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16955 (secure 0 0 0) 0x7fc62c04b030 con 0x7fc63c0c65f0 2024-05-10T11:13:59.439 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:59.439 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":48,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:58.473632+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:56.135076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:57.422869+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc6280762d0 msgr2=0x7fc628078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc6280762d0 0x7fc628078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc63c09e7c0 tx=0x7fc630008040 comp rx=0 tx=0).stop 2024-05-10T11:13:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 msgr2=0x7fc63c1f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 0x7fc63c1f3f00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 shutdown_connections 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc6280762d0 0x7fc628078790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc63c161010 0x7fc63c1e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc63c15ce60 0x7fc63c09dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 --2- 172.21.15.66:0/1746024447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc63c0c65f0 0x7fc63c1f3f00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.440+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 >> 172.21.15.66:0/1746024447 conn(0x7fc63c0b2900 msgr2=0x7fc63c0cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.441+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 shutdown_connections 2024-05-10T11:13:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.441+0000 7fc641a72640 1 -- 172.21.15.66:0/1746024447 wait complete. 2024-05-10T11:13:59.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:13:59.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.556+0000 7f4af086d640 1 Processor -- start 2024-05-10T11:13:59.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.556+0000 7f4af086d640 1 -- start start 2024-05-10T11:13:59.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4af086d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4aec162b30 0x7f4aec169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4af086d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec0b45f0 con 0x7f4aec162750 2024-05-10T11:13:59.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4af086d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec0b48d0 con 0x7f4aec0d5cb0 2024-05-10T11:13:59.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4af086d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4aec0b4f20 con 0x7f4aec162b30 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4aea59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4aec162750 0x7f4aec0d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34558/0 (socket says 172.21.15.66:34558) 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4aea59c640 1 -- 172.21.15.66:0/3311267606 learned_addr learned my addr 172.21.15.66:0/3311267606 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4aead9d640 1 --2- 172.21.15.66:0/3311267606 >> v2:172.21.15.190:3300/0 conn(0x7f4aec162b30 0x7f4aec169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999072279 0 0) 0x7f4aec0b45f0 con 0x7f4aec162750 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.557+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ad4003520 con 0x7f4aec162750 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2695794940 0 0) 0x7f4ad4003520 con 0x7f4aec162750 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 >> v2:172.21.15.190:3300/0 conn(0x7f4aec162b30 msgr2=0x7f4aec169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 --2- 172.21.15.66:0/3311267606 >> v2:172.21.15.190:3300/0 conn(0x7f4aec162b30 0x7f4aec169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 >> v1:172.21.15.190:6789/0 conn(0x7f4aec0d5cb0 legacy=0x7f4aec0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec0b4bb0 con 0x7f4aec162750 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f4adc001670 con 0x7f4aec162750 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 >> v1:172.21.15.66:6789/0 conn(0x7f4aec162750 legacy=0x7f4aec0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad40039b0 0x7f4ad4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad4004800 0x7f4ad4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40051c0 0x7f4ad400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec0b4f20 con 0x7f4ad40039b0 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad400c160 con 0x7f4ad40051c0 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad400c360 con 0x7f4ad4004800 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad40039b0 0x7f4ad4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4ae9d9b640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad4004800 0x7f4ad4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aead9d640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40051c0 0x7f4ad400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aea59c640 1 -- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad4004800 msgr2=0x7f4ad4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad4004800 0x7f4ad4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aea59c640 1 -- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40051c0 msgr2=0x7f4ad400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40051c0 0x7f4ad400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aead9d640 1 -- 172.21.15.66:0/3311267606 reap_dead start 2024-05-10T11:13:59.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.558+0000 7f4aea59c640 1 -- 172.21.15.66:0/3311267606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad4003520 con 0x7f4ad40039b0 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.559+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad40039b0 0x7f4ad4003dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c210 tx=0x7f4ad4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be8fd6bcb07e380 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.559+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc007d30 con 0x7f4ad40039b0 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.559+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc0058d0 con 0x7f4ad40039b0 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.559+0000 7f4ae959a640 1 -- 172.21.15.66:0/3311267606 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc005d20 con 0x7f4ad40039b0 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.559+0000 7f4af086d640 1 -- 172.21.15.66:0/3311267606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad40039b0 msgr2=0x7f4ad4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.559+0000 7f4af086d640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad40039b0 0x7f4ad4003dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c210 tx=0x7f4ad4005830 comp rx=0 tx=0).stop 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.560+0000 7f4af086d640 1 -- 172.21.15.66:0/3311267606 shutdown_connections 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.560+0000 7f4af086d640 1 --2- 172.21.15.66:0/3311267606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad40039b0 0x7f4ad4003dd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.560+0000 7f4af086d640 1 -- 172.21.15.66:0/3311267606 >> 172.21.15.66:0/3311267606 conn(0x7f4aec09e3b0 msgr2=0x7f4aec0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.560+0000 7f4af086d640 1 -- 172.21.15.66:0/3311267606 shutdown_connections 2024-05-10T11:13:59.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.560+0000 7f4af086d640 1 -- 172.21.15.66:0/3311267606 wait complete. 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.561+0000 7f4af086d640 1 Processor -- start 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.561+0000 7f4af086d640 1 -- start start 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4af086d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40039b0 0x7f4aec0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4af086d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 0x7f4aec14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4af086d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec14d750 0x7f4aec14dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4af086d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec0d0a00 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4af086d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec0d0880 con 0x7f4ad40039b0 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4af086d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec0d0b80 con 0x7f4aec14d750 2024-05-10T11:13:59.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 0x7f4aec14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 0x7f4aec14b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60892/0 (socket says 172.21.15.66:60892) 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 -- 172.21.15.66:0/3805286068 learned_addr learned my addr 172.21.15.66:0/3805286068 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40039b0 0x7f4aec0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4aead9d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec14d750 0x7f4aec14dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 -- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec14d750 msgr2=0x7f4aec14dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec14d750 0x7f4aec14dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 -- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40039b0 msgr2=0x7f4aec0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40039b0 0x7f4aec0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 -- 172.21.15.66:0/3805286068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec15aa70 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40039b0 0x7f4aec0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4aead9d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec14d750 0x7f4aec14dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.562+0000 7f4ae9d9b640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 0x7f4aec14b000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000c00 tx=0x7f4ae000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.563+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0019070 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.563+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae00052e0 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.563+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec0ca0d0 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.563+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00037f0 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.563+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec0ca690 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.564+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec068c40 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.564+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4ae001c070 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.565+0000 7f4adaffd640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4acc076300 0x7f4acc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.565+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6101+0+0 (secure 0 0 0) 0x7f4ae0096bb0 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.565+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4acc076300 0x7f4acc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.566+0000 7f4aea59c640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4acc076300 0x7f4acc0787c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4adc033000 tx=0x7f4adc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.569+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4aec068c40 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.760+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4aec06a220 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.761+0000 7f4adaffd640 1 -- 172.21.15.66:0/3805286068 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16955 (secure 0 0 0) 0x7f4ae005fd30 con 0x7f4aec0c9bd0 2024-05-10T11:13:59.762 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:13:59.762 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":48,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:13:58.473632+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:56.135076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:57.422869+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4acc076300 msgr2=0x7f4acc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4acc076300 0x7f4acc0787c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4adc033000 tx=0x7f4adc02e000 comp rx=0 tx=0).stop 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 msgr2=0x7f4aec14b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 0x7f4aec14b000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000c00 tx=0x7f4ae000e8a0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 shutdown_connections 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4acc076300 0x7f4acc0787c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec14d750 0x7f4aec14dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aec0c9bd0 0x7f4aec14b000 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 --2- 172.21.15.66:0/3805286068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad40039b0 0x7f4aec0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 >> 172.21.15.66:0/3805286068 conn(0x7f4aec09e3b0 msgr2=0x7f4aec0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 shutdown_connections 2024-05-10T11:13:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.763+0000 7f4af086d640 1 -- 172.21.15.66:0/3805286068 wait complete. 2024-05-10T11:13:59.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:13:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.881+0000 7f7d0f6fc640 1 Processor -- start 2024-05-10T11:13:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.882+0000 7f7d0f6fc640 1 -- start start 2024-05-10T11:13:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.882+0000 7f7d0f6fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d0815f410 0x7f7d080d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.882+0000 7f7d0f6fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d080b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.882+0000 7f7d0f6fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d080d2800 con 0x7f7d080b54d0 2024-05-10T11:13:59.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.882+0000 7f7d0f6fc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7d080d2ae0 con 0x7f7d0815f410 2024-05-10T11:13:59.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.882+0000 7f7d0f6fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d080d01d0 con 0x7f7d080d0f10 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0d498640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d0815f410 0x7f7d080d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0dc99640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7d080b54d0 0x7f7d080d36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:46454/0 (socket says 172.21.15.66:46454) 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0cc97640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d080b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0dc99640 1 -- 172.21.15.66:0/2224511459 learned_addr learned my addr 172.21.15.66:0/2224511459 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d07fff640 1 -- 172.21.15.66:0/2224511459 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218541433 0 0) 0x7f7d080d2800 con 0x7f7d080b54d0 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d07fff640 1 -- 172.21.15.66:0/2224511459 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf0003520 con 0x7f7d080b54d0 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0cc97640 1 -- 172.21.15.66:0/2224511459 >> v2:172.21.15.190:3300/0 conn(0x7f7d0815f410 msgr2=0x7f7d080d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:13:59.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0cc97640 1 --2- 172.21.15.66:0/2224511459 >> v2:172.21.15.190:3300/0 conn(0x7f7d0815f410 0x7f7d080d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0cc97640 1 -- 172.21.15.66:0/2224511459 >> v1:172.21.15.190:6789/0 conn(0x7f7d080b54d0 legacy=0x7f7d080d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0cc97640 1 -- 172.21.15.66:0/2224511459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d080d04b0 con 0x7f7d080d0f10 2024-05-10T11:13:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.883+0000 7f7d0d498640 1 --2- 172.21.15.66:0/2224511459 >> v2:172.21.15.190:3300/0 conn(0x7f7d0815f410 0x7f7d080d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:13:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.884+0000 7f7d0cc97640 1 --2- 172.21.15.66:0/2224511459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d080b4f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0097a0 tx=0x7f7cfc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4332b2e460fd9b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.884+0000 7f7d07fff640 1 -- 172.21.15.66:0/2224511459 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc037070 con 0x7f7d080d0f10 2024-05-10T11:13:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.884+0000 7f7d07fff640 1 -- 172.21.15.66:0/2224511459 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc02ae50 con 0x7f7d080d0f10 2024-05-10T11:13:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.884+0000 7f7d07fff640 1 -- 172.21.15.66:0/2224511459 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc032640 con 0x7f7d080d0f10 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2224511459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 msgr2=0x7f7d080b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2224511459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d080b4f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0097a0 tx=0x7f7cfc02a100 comp rx=0 tx=0).stop 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2224511459 shutdown_connections 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2224511459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d080b4f90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2224511459 >> v2:172.21.15.190:3300/0 conn(0x7f7d0815f410 0x7f7d080d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2224511459 >> 172.21.15.66:0/2224511459 conn(0x7f7d0808ed30 msgr2=0x7f7d0809e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2224511459 shutdown_connections 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.885+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2224511459 wait complete. 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.886+0000 7f7d0f6fc640 1 Processor -- start 2024-05-10T11:13:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.886+0000 7f7d0f6fc640 1 -- start start 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0f6fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 0x7f7d0814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0f6fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d081f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0f6fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d0815f410 0x7f7d0815d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0f6fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d080cffb0 con 0x7f7d080b54d0 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0f6fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7d080cfe30 con 0x7f7d0815f410 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0f6fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d080d3de0 con 0x7f7d080d0f10 2024-05-10T11:13:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 0x7f7d0814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 0x7f7d0814fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60894/0 (socket says 172.21.15.66:60894) 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 -- 172.21.15.66:0/2513858352 learned_addr learned my addr 172.21.15.66:0/2513858352 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0dc99640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d0815f410 0x7f7d0815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0cc97640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d081f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 -- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 msgr2=0x7f7d081f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d081f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 -- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d0815f410 msgr2=0x7f7d0815d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d0815f410 0x7f7d0815d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 -- 172.21.15.66:0/2513858352 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d080cc3f0 con 0x7f7d080b54d0 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0dc99640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d0815f410 0x7f7d0815d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.887+0000 7f7d0d498640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 0x7f7d0814fe80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e990 tx=0x7f7d0000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.888+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00017070 con 0x7f7d080b54d0 2024-05-10T11:13:59.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.888+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0000c9e0 con 0x7f7d080b54d0 2024-05-10T11:13:59.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.888+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d081f8f90 con 0x7f7d080b54d0 2024-05-10T11:13:59.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.888+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000cdb0 con 0x7f7d080b54d0 2024-05-10T11:13:59.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.888+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d080ca3c0 con 0x7f7d080b54d0 2024-05-10T11:13:59.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.889+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d080ca1d0 con 0x7f7d080b54d0 2024-05-10T11:13:59.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.890+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d0001a070 con 0x7f7d080b54d0 2024-05-10T11:13:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.890+0000 7f7d05ffb640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf40762d0 0x7f7cf4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:13:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.890+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6101+0+0 (secure 0 0 0) 0x7f7d00097970 con 0x7f7d080b54d0 2024-05-10T11:13:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.890+0000 7f7d0cc97640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf40762d0 0x7f7cf4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:13:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.891+0000 7f7d0cc97640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf40762d0 0x7f7cf4078790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc034000 tx=0x7f7cfc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:13:59.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:13:59.894+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7d000611d0 con 0x7f7d080b54d0 2024-05-10T11:14:00.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:00.127+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7d080d6090 con 0x7f7d080b54d0 2024-05-10T11:14:01.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.111+0000 7f7d05ffb640 1 -- 172.21.15.66:0/2513858352 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f7d00060ad0 con 0x7f7d080b54d0 2024-05-10T11:14:01.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.114+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf40762d0 msgr2=0x7f7cf4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:01.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.114+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf40762d0 0x7f7cf4078790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc034000 tx=0x7f7cfc02e000 comp rx=0 tx=0).stop 2024-05-10T11:14:01.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.114+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 msgr2=0x7f7d0814fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:01.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.114+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 0x7f7d0814fe80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e990 tx=0x7f7d0000ee50 comp rx=0 tx=0).stop 2024-05-10T11:14:01.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 shutdown_connections 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf40762d0 0x7f7cf4078790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d0815f410 0x7f7d0815d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d080d0f10 0x7f7d081f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 --2- 172.21.15.66:0/2513858352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d080b54d0 0x7f7d0814fe80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 >> 172.21.15.66:0/2513858352 conn(0x7f7d0808ed30 msgr2=0x7f7d0806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 shutdown_connections 2024-05-10T11:14:01.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.115+0000 7f7d0f6fc640 1 -- 172.21.15.66:0/2513858352 wait complete. 2024-05-10T11:14:01.129 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:14:01.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:14:01.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.242+0000 7f18791b6640 1 Processor -- start 2024-05-10T11:14:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.242+0000 7f18791b6640 1 -- start start 2024-05-10T11:14:01.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f18791b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f187415d310 0x7f18740cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:01.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f18791b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f18740cc4d0 0x7f18740b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f18791b6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18740b43a0 con 0x7f18740b2c80 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f18791b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f18740b4fb0 con 0x7f187415d310 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f18791b6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f18740b4680 con 0x7f18740cc4d0 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f1872d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f187415d310 0x7f18740cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f187359e640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f18740b2c80 0x7f187406e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34562/0 (socket says 172.21.15.66:34562) 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f187359e640 1 -- 172.21.15.66:0/1552968728 learned_addr learned my addr 172.21.15.66:0/1552968728 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f187259c640 1 --2- 172.21.15.66:0/1552968728 >> v2:172.21.15.190:3300/0 conn(0x7f18740cc4d0 0x7f18740b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f1872d9d640 1 -- 172.21.15.66:0/1552968728 >> v2:172.21.15.190:3300/0 conn(0x7f18740cc4d0 msgr2=0x7f18740b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f1872d9d640 1 --2- 172.21.15.66:0/1552968728 >> v2:172.21.15.190:3300/0 conn(0x7f18740cc4d0 0x7f18740b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f1872d9d640 1 -- 172.21.15.66:0/1552968728 >> v1:172.21.15.66:6789/0 conn(0x7f18740b2c80 legacy=0x7f187406e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f1872d9d640 1 -- 172.21.15.66:0/1552968728 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18740b4960 con 0x7f187415d310 2024-05-10T11:14:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.243+0000 7f1871d9b640 1 -- 172.21.15.66:0/1552968728 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868282448 0 0) 0x7f18740b43a0 con 0x7f18740b2c80 2024-05-10T11:14:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.244+0000 7f1872d9d640 1 --2- 172.21.15.66:0/1552968728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f187415d310 0x7f18740cd350 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1874064080 tx=0x7f186402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9283900b2cbfa602 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.244+0000 7f1871d9b640 1 -- 172.21.15.66:0/1552968728 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864037070 con 0x7f187415d310 2024-05-10T11:14:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.244+0000 7f1871d9b640 1 -- 172.21.15.66:0/1552968728 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1864032440 con 0x7f187415d310 2024-05-10T11:14:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.244+0000 7f1871d9b640 1 -- 172.21.15.66:0/1552968728 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186402ae60 con 0x7f187415d310 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 -- 172.21.15.66:0/1552968728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f187415d310 msgr2=0x7f18740cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 --2- 172.21.15.66:0/1552968728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f187415d310 0x7f18740cd350 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1874064080 tx=0x7f186402a110 comp rx=0 tx=0).stop 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 -- 172.21.15.66:0/1552968728 shutdown_connections 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 --2- 172.21.15.66:0/1552968728 >> v2:172.21.15.190:3300/0 conn(0x7f18740cc4d0 0x7f18740b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 --2- 172.21.15.66:0/1552968728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f187415d310 0x7f18740cd350 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 -- 172.21.15.66:0/1552968728 >> 172.21.15.66:0/1552968728 conn(0x7f18740cdc80 msgr2=0x7f18740ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 -- 172.21.15.66:0/1552968728 shutdown_connections 2024-05-10T11:14:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.245+0000 7f18791b6640 1 -- 172.21.15.66:0/1552968728 wait complete. 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.246+0000 7f18791b6640 1 Processor -- start 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.246+0000 7f18791b6640 1 -- start start 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f18791b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18740b2c80 0x7f1874155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f18791b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 0x7f18740c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f18791b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f187415d310 0x7f1874151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f18791b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f187415d6f0 con 0x7f18740cc4d0 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f18791b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18740b4050 con 0x7f18740b2c80 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f18791b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f187415d870 con 0x7f187415d310 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f187259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 0x7f18740c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f187259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 0x7f18740c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60910/0 (socket says 172.21.15.66:60910) 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f187259c640 1 -- 172.21.15.66:0/1733979282 learned_addr learned my addr 172.21.15.66:0/1733979282 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f1872d9d640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18740b2c80 0x7f1874155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.247+0000 7f187359e640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f187415d310 0x7f1874151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f187259c640 1 -- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f187415d310 msgr2=0x7f1874151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f187259c640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f187415d310 0x7f1874151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f187259c640 1 -- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18740b2c80 msgr2=0x7f1874155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f187259c640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18740b2c80 0x7f1874155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f187259c640 1 -- 172.21.15.66:0/1733979282 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18740c7760 con 0x7f18740cc4d0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f1872d9d640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18740b2c80 0x7f1874155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f187259c640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 0x7f18740c4c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f186800d7d0 tx=0x7f186800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186800b6c0 con 0x7f18740cc4d0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868019070 con 0x7f18740cc4d0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186800bac0 con 0x7f18740cc4d0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18740c7a40 con 0x7f18740cc4d0 2024-05-10T11:14:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.248+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187414fdc0 con 0x7f18740cc4d0 2024-05-10T11:14:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.249+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f187406a220 con 0x7f18740cc4d0 2024-05-10T11:14:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.250+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f186800bc60 con 0x7f18740cc4d0 2024-05-10T11:14:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.250+0000 7f185b7fe640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18600762d0 0x7f1860078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.251+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f1868097bc0 con 0x7f18740cc4d0 2024-05-10T11:14:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.251+0000 7f1872d9d640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18600762d0 0x7f1860078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.251+0000 7f1872d9d640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18600762d0 0x7f1860078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1864034000 tx=0x7f186402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:01.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.255+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f18680613a0 con 0x7f18740cc4d0 2024-05-10T11:14:01.408 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:14:01.411 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:14:01.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:01.484+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f18740c7c10 con 0x7f18740cc4d0 2024-05-10T11:14:02.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.116+0000 7f185b7fe640 1 -- 172.21.15.66:0/1733979282 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f1868060ca0 con 0x7f18740cc4d0 2024-05-10T11:14:02.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18600762d0 msgr2=0x7f1860078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18600762d0 0x7f1860078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1864034000 tx=0x7f186402e000 comp rx=0 tx=0).stop 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 msgr2=0x7f18740c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 0x7f18740c4c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f186800d7d0 tx=0x7f186800dc90 comp rx=0 tx=0).stop 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 shutdown_connections 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18600762d0 0x7f1860078790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f187415d310 0x7f1874151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18740cc4d0 0x7f18740c4c40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 --2- 172.21.15.66:0/1733979282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18740b2c80 0x7f1874155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 >> 172.21.15.66:0/1733979282 conn(0x7f18740cdc80 msgr2=0x7f18740ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 shutdown_connections 2024-05-10T11:14:02.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.119+0000 7f18791b6640 1 -- 172.21.15.66:0/1733979282 wait complete. 2024-05-10T11:14:02.133 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:14:02.133 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:02.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.283+0000 7f9464e59640 1 Processor -- start 2024-05-10T11:14:02.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.283+0000 7f9464e59640 1 -- start start 2024-05-10T11:14:02.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f9464e59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94600d5cb0 0x7f94600d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f9464e59640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600b45f0 con 0x7f9460162b30 2024-05-10T11:14:02.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f9464e59640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600b48d0 con 0x7f9460162750 2024-05-10T11:14:02.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f9464e59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f94600b4f20 con 0x7f94600d5cb0 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945ed9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9460162b30 0x7f94600b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34576/0 (socket says 172.21.15.66:34576) 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945ed9d640 1 -- 172.21.15.66:0/238524484 learned_addr learned my addr 172.21.15.66:0/238524484 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945dd9b640 1 --2- 172.21.15.66:0/238524484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94600d5cb0 0x7f94600d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100040202 0 0) 0x7f94600b45f0 con 0x7f9460162b30 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9448003520 con 0x7f9460162b30 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588134765 0 0) 0x7f94600b48d0 con 0x7f9460162750 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94600b45f0 con 0x7f9460162750 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945dd9b640 1 -- 172.21.15.66:0/238524484 >> v1:172.21.15.190:6789/0 conn(0x7f9460162750 legacy=0x7f94600d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945dd9b640 1 -- 172.21.15.66:0/238524484 >> v1:172.21.15.66:6789/0 conn(0x7f9460162b30 legacy=0x7f94600b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.284+0000 7f945dd9b640 1 -- 172.21.15.66:0/238524484 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94600b4bb0 con 0x7f94600d5cb0 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.285+0000 7f945dd9b640 1 --2- 172.21.15.66:0/238524484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94600d5cb0 0x7f94600d3630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94540097d0 tx=0x7f945402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284af73d02305b43 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.285+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454037070 con 0x7f94600d5cb0 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.285+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9454032440 con 0x7f94600d5cb0 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.285+0000 7f945d59a640 1 -- 172.21.15.66:0/238524484 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454032810 con 0x7f94600d5cb0 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 -- 172.21.15.66:0/238524484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94600d5cb0 msgr2=0x7f94600d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 --2- 172.21.15.66:0/238524484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94600d5cb0 0x7f94600d3630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94540097d0 tx=0x7f945402a180 comp rx=0 tx=0).stop 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 -- 172.21.15.66:0/238524484 shutdown_connections 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 --2- 172.21.15.66:0/238524484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94600d5cb0 0x7f94600d3630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 -- 172.21.15.66:0/238524484 >> 172.21.15.66:0/238524484 conn(0x7f946009e3b0 msgr2=0x7f94600d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 -- 172.21.15.66:0/238524484 shutdown_connections 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.286+0000 7f9464e59640 1 -- 172.21.15.66:0/238524484 wait complete. 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.287+0000 7f9464e59640 1 Processor -- start 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 -- start start 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9460162750 0x7f94600cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 0x7f94600cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94600cede0 0x7f94600c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f94600d3f80 con 0x7f9460162b30 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f94600d3e00 con 0x7f94600cede0 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f9464e59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f94600d0fe0 con 0x7f9460162750 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f945dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 0x7f94600cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f945dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 0x7f94600cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60924/0 (socket says 172.21.15.66:60924) 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.288+0000 7f945dd9b640 1 -- 172.21.15.66:0/2293879302 learned_addr learned my addr 172.21.15.66:0/2293879302 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945e59c640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9460162750 0x7f94600cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945ed9d640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94600cede0 0x7f94600c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945dd9b640 1 -- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9460162750 msgr2=0x7f94600cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945dd9b640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9460162750 0x7f94600cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945dd9b640 1 -- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94600cede0 msgr2=0x7f94600c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945dd9b640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94600cede0 0x7f94600c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945dd9b640 1 -- 172.21.15.66:0/2293879302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94600cdd40 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945e59c640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9460162750 0x7f94600cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f945dd9b640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 0x7f94600cd630 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94540098f0 tx=0x7f94540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454041020 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f945403d6e0 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94600ce020 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454037040 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.289+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94600ce5e0 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.290+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9460151d40 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.291+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9454044020 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.291+0000 7f944effd640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94400762d0 0x7f9440078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.291+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f94540b7e50 con 0x7f9460162b30 2024-05-10T11:14:02.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.292+0000 7f945e59c640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94400762d0 0x7f9440078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.292+0000 7f945e59c640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94400762d0 0x7f9440078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f94500011e0 tx=0x7f9450009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.296+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9460151d40 con 0x7f9460162b30 2024-05-10T11:14:02.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.525+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f946006e630 con 0x7f9460162b30 2024-05-10T11:14:02.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.525+0000 7f944effd640 1 -- 172.21.15.66:0/2293879302 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7f945404b030 con 0x7f9460162b30 2024-05-10T11:14:02.526 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:02.526 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:02.527 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:02.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94400762d0 msgr2=0x7f9440078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94400762d0 0x7f9440078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f94500011e0 tx=0x7f9450009040 comp rx=0 tx=0).stop 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 msgr2=0x7f94600cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 0x7f94600cd630 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94540098f0 tx=0x7f94540046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 shutdown_connections 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94400762d0 0x7f9440078790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94600cede0 0x7f94600c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460162b30 0x7f94600cd630 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 --2- 172.21.15.66:0/2293879302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9460162750 0x7f94600cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 >> 172.21.15.66:0/2293879302 conn(0x7f946009e3b0 msgr2=0x7f94600d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 shutdown_connections 2024-05-10T11:14:02.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.528+0000 7f9464e59640 1 -- 172.21.15.66:0/2293879302 wait complete. 2024-05-10T11:14:02.539 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:14:02.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.642+0000 7f8c304e1640 1 Processor -- start 2024-05-10T11:14:02.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.642+0000 7f8c304e1640 1 -- start start 2024-05-10T11:14:02.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c304e1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c28162750 0x7f8c280d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c304e1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8c280d5cb0 0x7f8c280d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c304e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c280b45f0 con 0x7f8c28162b30 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c304e1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8c280b4f20 con 0x7f8c28162750 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c304e1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8c280d0fe0 con 0x7f8c280d5cb0 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c28162750 0x7f8c280d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c28162750 0x7f8c280d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60936/0 (socket says 172.21.15.66:60936) 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3006208950 learned_addr learned my addr 172.21.15.66:0/3006208950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3006208950 >> v2:172.21.15.190:3300/0 conn(0x7f8c280d5cb0 msgr2=0x7f8c280d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 --2- 172.21.15.66:0/3006208950 >> v2:172.21.15.190:3300/0 conn(0x7f8c280d5cb0 0x7f8c280d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3006208950 >> v1:172.21.15.190:6789/0 conn(0x7f8c28162b30 legacy=0x7f8c280d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:02.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.643+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3006208950 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c280b48d0 con 0x7f8c28162750 2024-05-10T11:14:02.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.644+0000 7f8c2e27d640 1 --2- 172.21.15.66:0/3006208950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280d0670 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c280b4e90 tx=0x7f8c2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887a9db432270991 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.644+0000 7f8c2d27b640 1 -- 172.21.15.66:0/3006208950 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24036070 con 0x7f8c28162750 2024-05-10T11:14:02.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.644+0000 7f8c2d27b640 1 -- 172.21.15.66:0/3006208950 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24031600 con 0x7f8c28162750 2024-05-10T11:14:02.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.644+0000 7f8c2d27b640 1 -- 172.21.15.66:0/3006208950 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2402ae60 con 0x7f8c28162750 2024-05-10T11:14:02.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 -- 172.21.15.66:0/3006208950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 msgr2=0x7f8c280d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3006208950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280d0670 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c280b4e90 tx=0x7f8c2402a680 comp rx=0 tx=0).stop 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 -- 172.21.15.66:0/3006208950 shutdown_connections 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3006208950 >> v2:172.21.15.190:3300/0 conn(0x7f8c280d5cb0 0x7f8c280d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3006208950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280d0670 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 -- 172.21.15.66:0/3006208950 >> 172.21.15.66:0/3006208950 conn(0x7f8c2809e3b0 msgr2=0x7f8c280d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 -- 172.21.15.66:0/3006208950 shutdown_connections 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.645+0000 7f8c304e1640 1 -- 172.21.15.66:0/3006208950 wait complete. 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.646+0000 7f8c304e1640 1 Processor -- start 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.646+0000 7f8c304e1640 1 -- start start 2024-05-10T11:14:02.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c304e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c304e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c28162b30 0x7f8c2814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c304e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c2815afb0 0x7f8c2814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c304e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c280d0d30 con 0x7f8c28162750 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c304e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8c280d0bb0 con 0x7f8c28162b30 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c304e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8c280b63c0 con 0x7f8c2815afb0 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280b8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60938/0 (socket says 172.21.15.66:60938) 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3638458600 learned_addr learned my addr 172.21.15.66:0/3638458600 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:02.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2ea7e640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c2815afb0 0x7f8c2814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2da7c640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c28162b30 0x7f8c2814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c2815afb0 msgr2=0x7f8c2814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c2815afb0 0x7f8c2814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c28162b30 msgr2=0x7f8c2814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c28162b30 0x7f8c2814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 -- 172.21.15.66:0/3638458600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c280b7ce0 con 0x7f8c28162750 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.647+0000 7f8c2e27d640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280b8d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8c24034040 tx=0x7f8c24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.648+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24041020 con 0x7f8c28162750 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.648+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2402ae60 con 0x7f8c28162750 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.648+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c280b7fc0 con 0x7f8c28162750 2024-05-10T11:14:02.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.648+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24036040 con 0x7f8c28162750 2024-05-10T11:14:02.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.648+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c280b8580 con 0x7f8c28162750 2024-05-10T11:14:02.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.649+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2806a220 con 0x7f8c28162750 2024-05-10T11:14:02.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.649+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c24044020 con 0x7f8c28162750 2024-05-10T11:14:02.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.650+0000 7f8c1effd640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c0c0762d0 0x7f8c0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.650+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f8c240b8430 con 0x7f8c28162750 2024-05-10T11:14:02.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.650+0000 7f8c2da7c640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c0c0762d0 0x7f8c0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.651+0000 7f8c2da7c640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c0c0762d0 0x7f8c0c078790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c280b9510 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.654+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8c2404b030 con 0x7f8c28162750 2024-05-10T11:14:02.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.844+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c280d1750 con 0x7f8c28162750 2024-05-10T11:14:02.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.846+0000 7f8c1effd640 1 -- 172.21.15.66:0/3638458600 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16942 (secure 0 0 0) 0x7f8c24081c00 con 0x7f8c28162750 2024-05-10T11:14:02.846 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:02.847 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:00.097102+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:56.135076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:57.422869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:14:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c0c0762d0 msgr2=0x7f8c0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c0c0762d0 0x7f8c0c078790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c280b9510 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 msgr2=0x7f8c280b8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280b8d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8c24034040 tx=0x7f8c24004a40 comp rx=0 tx=0).stop 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 shutdown_connections 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c0c0762d0 0x7f8c0c078790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c2815afb0 0x7f8c2814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c28162b30 0x7f8c2814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 --2- 172.21.15.66:0/3638458600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c28162750 0x7f8c280b8d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 >> 172.21.15.66:0/3638458600 conn(0x7f8c2809e3b0 msgr2=0x7f8c2806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 shutdown_connections 2024-05-10T11:14:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.848+0000 7f8c304e1640 1 -- 172.21.15.66:0/3638458600 wait complete. 2024-05-10T11:14:02.860 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:14:02.860 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:14:02.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.963+0000 7f4ec342a640 1 Processor -- start 2024-05-10T11:14:02.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.963+0000 7f4ec342a640 1 -- start start 2024-05-10T11:14:02.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.964+0000 7f4ec342a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ebc162750 0x7f4ebc0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.964+0000 7f4ec342a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc0b45f0 con 0x7f4ebc0d5cb0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.964+0000 7f4ec342a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc0b48d0 con 0x7f4ebc162b30 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.964+0000 7f4ec342a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4ebc0b4f20 con 0x7f4ebc162750 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.964+0000 7f4ec09c5640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4ebc0d5cb0 0x7f4ebc0d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34582/0 (socket says 172.21.15.66:34582) 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.964+0000 7f4ec09c5640 1 -- 172.21.15.66:0/688747250 learned_addr learned my addr 172.21.15.66:0/688747250 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/688747250 >> v2:172.21.15.190:3300/0 conn(0x7f4ebc162750 0x7f4ebc0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489658533 0 0) 0x7f4ebc0b45f0 con 0x7f4ebc0d5cb0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea8003520 con 0x7f4ebc0d5cb0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3373261950 0 0) 0x7f4ea8003520 con 0x7f4ebc0d5cb0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 >> v2:172.21.15.190:3300/0 conn(0x7f4ebc162750 msgr2=0x7f4ebc0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 --2- 172.21.15.66:0/688747250 >> v2:172.21.15.190:3300/0 conn(0x7f4ebc162750 0x7f4ebc0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 >> v1:172.21.15.190:6789/0 conn(0x7f4ebc162b30 legacy=0x7f4ebc0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc0b4bb0 con 0x7f4ebc0d5cb0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f4eac001670 con 0x7f4ebc0d5cb0 2024-05-10T11:14:02.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 >> v1:172.21.15.66:6789/0 conn(0x7f4ebc0d5cb0 legacy=0x7f4ebc0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ea80039b0 0x7f4ea8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea80052e0 0x7f4ea800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc0b4f20 con 0x7f4ea80039b0 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea800c1b0 con 0x7f4ea80052e0 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea800c3b0 con 0x7f4ea8004800 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ea80039b0 0x7f4ea8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec19c7640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea80052e0 0x7f4ea800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec09c5640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 -- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8004800 msgr2=0x7f4ea8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 -- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea80052e0 msgr2=0x7f4ea800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea80052e0 0x7f4ea800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec11c6640 1 -- 172.21.15.66:0/688747250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea8003520 con 0x7f4ea80039b0 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec09c5640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec19c7640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea80052e0 0x7f4ea800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.965+0000 7f4ec19c7640 1 -- 172.21.15.66:0/688747250 reap_dead start 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.966+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ea80039b0 0x7f4ea8003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800ba00 tx=0x7f4ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191f6902d5d13f4a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.966+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8030070 con 0x7f4ea80039b0 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.966+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb802adb0 con 0x7f4ea80039b0 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.966+0000 7f4eb3fff640 1 -- 172.21.15.66:0/688747250 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800b600 con 0x7f4ea80039b0 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 -- 172.21.15.66:0/688747250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ea80039b0 msgr2=0x7f4ea8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ea80039b0 0x7f4ea8003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800ba00 tx=0x7f4ea8005830 comp rx=0 tx=0).stop 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 -- 172.21.15.66:0/688747250 shutdown_connections 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 --2- 172.21.15.66:0/688747250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ea80039b0 0x7f4ea8003dd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 -- 172.21.15.66:0/688747250 >> 172.21.15.66:0/688747250 conn(0x7f4ebc09e3b0 msgr2=0x7f4ebc0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:02.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 -- 172.21.15.66:0/688747250 shutdown_connections 2024-05-10T11:14:02.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.967+0000 7f4ec342a640 1 -- 172.21.15.66:0/688747250 wait complete. 2024-05-10T11:14:02.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.968+0000 7f4ec342a640 1 Processor -- start 2024-05-10T11:14:02.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.968+0000 7f4ec342a640 1 -- start start 2024-05-10T11:14:02.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec342a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea80039b0 0x7f4ebc0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec342a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ebc14eb70 0x7f4ebc1f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec342a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 0x7f4ebc0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec342a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc0d0a00 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec342a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc0d0880 con 0x7f4ebc14eb70 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec342a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4ebc0d0b80 con 0x7f4ea80039b0 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 0x7f4ebc0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 0x7f4ebc0caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60966/0 (socket says 172.21.15.66:60966) 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 -- 172.21.15.66:0/2654252125 learned_addr learned my addr 172.21.15.66:0/2654252125 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea80039b0 0x7f4ebc0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec09c5640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ebc14eb70 0x7f4ebc1f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 -- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea80039b0 msgr2=0x7f4ebc0b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea80039b0 0x7f4ebc0b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 -- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ebc14eb70 msgr2=0x7f4ebc1f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ebc14eb70 0x7f4ebc1f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:02.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 -- 172.21.15.66:0/2654252125 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc1f8930 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.969+0000 7f4ec19c7640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 0x7f4ebc0caf70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc08d9a0 tx=0x7f4eb400e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.970+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4003b80 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.970+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb4018070 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.970+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc0ba100 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.970+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40050d0 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.970+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc0ba6c0 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.971+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ebc06a220 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.971+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4eb4005270 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.972+0000 7f4eb1ffb640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4ea0076300 0x7f4ea00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.972+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f4eb4097150 con 0x7f4ebc1f84b0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.972+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4ea0076300 0x7f4ea00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:02.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.973+0000 7f4ec11c6640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4ea0076300 0x7f4ea00787c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8004780 tx=0x7f4eb8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:02.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:02.977+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4eb40602d0 con 0x7f4ebc1f84b0 2024-05-10T11:14:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.168+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ebc0b5f60 con 0x7f4ea0076300 2024-05-10T11:14:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.174+0000 7f4eb1ffb640 1 -- 172.21.15.66:0/2654252125 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242130 (secure 0 0 0) 0x7f4ebc0b5f60 con 0x7f4ea0076300 2024-05-10T11:14:03.177 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:03.178 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4ea0076300 msgr2=0x7f4ea00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4ea0076300 0x7f4ea00787c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8004780 tx=0x7f4eb8030000 comp rx=0 tx=0).stop 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 msgr2=0x7f4ebc0caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 0x7f4ebc0caf70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc08d9a0 tx=0x7f4eb400e980 comp rx=0 tx=0).stop 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 shutdown_connections 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4ea0076300 0x7f4ea00787c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ebc1f84b0 0x7f4ebc0caf70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ebc14eb70 0x7f4ebc1f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 --2- 172.21.15.66:0/2654252125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea80039b0 0x7f4ebc0b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 >> 172.21.15.66:0/2654252125 conn(0x7f4ebc09e3b0 msgr2=0x7f4ebc161a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 shutdown_connections 2024-05-10T11:14:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.177+0000 7f4ec342a640 1 -- 172.21.15.66:0/2654252125 wait complete. 2024-05-10T11:14:03.188 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-05-10T11:14:01.704564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221528,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5480448,"data_stored":3026902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.625048"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.087095+0000","last_change":"2024-05-10T11:13:58.087095+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.087095+0000","last_undegraded":"2024-05-10T11:13:58.087095+0000","last_fullsized":"2024-05-10T11:13:58.087095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086382+0000","last_change":"2024-05-10T11:13:58.086382+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086382+0000","last_undegraded":"2024-05-10T11:13:58.086382+0000","last_fullsized":"2024-05-10T11:13:58.086382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091231+0000","last_change":"2024-05-10T11:13:58.091231+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091231+0000","last_undegraded":"2024-05-10T11:13:58.091231+0000","last_fullsized":"2024-05-10T11:13:58.091231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086453+0000","last_change":"2024-05-10T11:13:58.086453+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086453+0000","last_undegraded":"2024-05-10T11:13:58.086453+0000","last_fullsized":"2024-05-10T11:13:58.086453+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086266+0000","last_change":"2024-05-10T11:13:58.086266+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086266+0000","last_undegraded":"2024-05-10T11:13:58.086266+0000","last_fullsized":"2024-05-10T11:13:58.086266+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093694+0000","last_change":"2024-05-10T11:13:58.093694+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093694+0000","last_undegraded":"2024-05-10T11:13:58.093694+0000","last_fullsized":"2024-05-10T11:13:58.093694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091100+0000","last_change":"2024-05-10T11:13:58.091100+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091100+0000","last_undegraded":"2024-05-10T11:13:58.091100+0000","last_fullsized":"2024-05-10T11:13:58.091100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093237+0000","last_change":"2024-05-10T11:13:58.093237+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093237+0000","last_undegraded":"2024-05-10T11:13:58.093237+0000","last_fullsized":"2024-05-10T11:13:58.093237+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086302+0000","last_change":"2024-05-10T11:13:58.086302+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086302+0000","last_undegraded":"2024-05-10T11:13:58.086302+0000","last_fullsized":"2024-05-10T11:13:58.086302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086586+0000","last_change":"2024-05-10T11:13:58.086586+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086586+0000","last_undegraded":"2024-05-10T11:13:58.086586+0000","last_fullsized":"2024-05-10T11:13:58.086586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098266+0000","last_change":"2024-05-10T11:13:58.096652+0000","last_active":"2024-05-10T11:13:58.098266+0000","last_peered":"2024-05-10T11:13:58.098266+0000","last_clean":"2024-05-10T11:13:58.098266+0000","last_became_active":"2024-05-10T11:13:58.096366+0000","last_became_peered":"2024-05-10T11:13:58.096366+0000","last_unstale":"2024-05-10T11:13:58.098266+0000","last_undegraded":"2024-05-10T11:13:58.098266+0000","last_fullsized":"2024-05-10T11:13:58.098266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:09.362328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.084069+0000","last_change":"2024-05-10T11:13:57.084069+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.084069+0000","last_undegraded":"2024-05-10T11:13:57.084069+0000","last_fullsized":"2024-05-10T11:13:57.084069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092969+0000","last_change":"2024-05-10T11:13:58.092969+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092969+0000","last_undegraded":"2024-05-10T11:13:58.092969+0000","last_fullsized":"2024-05-10T11:13:58.092969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.083912+0000","last_change":"2024-05-10T11:13:57.083912+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.083912+0000","last_undegraded":"2024-05-10T11:13:57.083912+0000","last_fullsized":"2024-05-10T11:13:57.083912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:57.076581+0000","last_change":"2024-05-10T11:13:57.076581+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.076581+0000","last_undegraded":"2024-05-10T11:13:57.076581+0000","last_fullsized":"2024-05-10T11:13:57.076581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091795+0000","last_change":"2024-05-10T11:13:58.091795+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091795+0000","last_undegraded":"2024-05-10T11:13:58.091795+0000","last_fullsized":"2024-05-10T11:13:58.091795+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086535+0000","last_change":"2024-05-10T11:13:57.086535+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086535+0000","last_undegraded":"2024-05-10T11:13:57.086535+0000","last_fullsized":"2024-05-10T11:13:57.086535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086342+0000","last_change":"2024-05-10T11:13:58.086342+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086342+0000","last_undegraded":"2024-05-10T11:13:58.086342+0000","last_fullsized":"2024-05-10T11:13:58.086342+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100981+0000","last_change":"2024-05-10T11:13:58.098405+0000","last_active":"2024-05-10T11:13:58.100981+0000","last_peered":"2024-05-10T11:13:58.100981+0000","last_clean":"2024-05-10T11:13:58.100981+0000","last_became_active":"2024-05-10T11:13:58.098115+0000","last_became_peered":"2024-05-10T11:13:58.098115+0000","last_unstale":"2024-05-10T11:13:58.100981+0000","last_undegraded":"2024-05-10T11:13:58.100981+0000","last_fullsized":"2024-05-10T11:13:58.100981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:17.632714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098757+0000","last_change":"2024-05-10T11:13:58.097819+0000","last_active":"2024-05-10T11:13:58.098757+0000","last_peered":"2024-05-10T11:13:58.098757+0000","last_clean":"2024-05-10T11:13:58.098757+0000","last_became_active":"2024-05-10T11:13:58.097490+0000","last_became_peered":"2024-05-10T11:13:58.097490+0000","last_unstale":"2024-05-10T11:13:58.098757+0000","last_undegraded":"2024-05-10T11:13:58.098757+0000","last_fullsized":"2024-05-10T11:13:58.098757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:42.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086281+0000","last_change":"2024-05-10T11:13:58.086281+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086281+0000","last_undegraded":"2024-05-10T11:13:58.086281+0000","last_fullsized":"2024-05-10T11:13:58.086281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085282+0000","last_change":"2024-05-10T11:13:57.085282+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085282+0000","last_undegraded":"2024-05-10T11:13:57.085282+0000","last_fullsized":"2024-05-10T11:13:57.085282+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090158+0000","last_change":"2024-05-10T11:13:58.090158+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090158+0000","last_undegraded":"2024-05-10T11:13:58.090158+0000","last_fullsized":"2024-05-10T11:13:58.090158+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102466+0000","last_change":"2024-05-10T11:13:58.098731+0000","last_active":"2024-05-10T11:13:58.102466+0000","last_peered":"2024-05-10T11:13:58.102466+0000","last_clean":"2024-05-10T11:13:58.102466+0000","last_became_active":"2024-05-10T11:13:58.098187+0000","last_became_peered":"2024-05-10T11:13:58.098187+0000","last_unstale":"2024-05-10T11:13:58.102466+0000","last_undegraded":"2024-05-10T11:13:58.102466+0000","last_fullsized":"2024-05-10T11:13:58.102466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:19.909231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098452+0000","last_change":"2024-05-10T11:13:58.097328+0000","last_active":"2024-05-10T11:13:58.098452+0000","last_peered":"2024-05-10T11:13:58.098452+0000","last_clean":"2024-05-10T11:13:58.098452+0000","last_became_active":"2024-05-10T11:13:58.097031+0000","last_became_peered":"2024-05-10T11:13:58.097031+0000","last_unstale":"2024-05-10T11:13:58.098452+0000","last_undegraded":"2024-05-10T11:13:58.098452+0000","last_fullsized":"2024-05-10T11:13:58.098452+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:27.401728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102538+0000","last_change":"2024-05-10T11:13:58.100457+0000","last_active":"2024-05-10T11:13:58.102538+0000","last_peered":"2024-05-10T11:13:58.102538+0000","last_clean":"2024-05-10T11:13:58.102538+0000","last_became_active":"2024-05-10T11:13:58.100133+0000","last_became_peered":"2024-05-10T11:13:58.100133+0000","last_unstale":"2024-05-10T11:13:58.102538+0000","last_undegraded":"2024-05-10T11:13:58.102538+0000","last_fullsized":"2024-05-10T11:13:58.102538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:43.772326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090165+0000","last_change":"2024-05-10T11:13:58.090165+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090165+0000","last_undegraded":"2024-05-10T11:13:58.090165+0000","last_fullsized":"2024-05-10T11:13:58.090165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086185+0000","last_change":"2024-05-10T11:13:57.086185+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086185+0000","last_undegraded":"2024-05-10T11:13:57.086185+0000","last_fullsized":"2024-05-10T11:13:57.086185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086096+0000","last_change":"2024-05-10T11:13:57.086096+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086096+0000","last_undegraded":"2024-05-10T11:13:57.086096+0000","last_fullsized":"2024-05-10T11:13:57.086096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102410+0000","last_change":"2024-05-10T11:13:58.100301+0000","last_active":"2024-05-10T11:13:58.102410+0000","last_peered":"2024-05-10T11:13:58.102410+0000","last_clean":"2024-05-10T11:13:58.102410+0000","last_became_active":"2024-05-10T11:13:58.100038+0000","last_became_peered":"2024-05-10T11:13:58.100038+0000","last_unstale":"2024-05-10T11:13:58.102410+0000","last_undegraded":"2024-05-10T11:13:58.102410+0000","last_fullsized":"2024-05-10T11:13:58.102410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:02.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100879+0000","last_change":"2024-05-10T11:13:58.098650+0000","last_active":"2024-05-10T11:13:58.100879+0000","last_peered":"2024-05-10T11:13:58.100879+0000","last_clean":"2024-05-10T11:13:58.100879+0000","last_became_active":"2024-05-10T11:13:58.098172+0000","last_became_peered":"2024-05-10T11:13:58.098172+0000","last_unstale":"2024-05-10T11:13:58.100879+0000","last_undegraded":"2024-05-10T11:13:58.100879+0000","last_fullsized":"2024-05-10T11:13:58.100879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:48.647647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.083930+0000","last_change":"2024-05-10T11:13:57.083930+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.083930+0000","last_undegraded":"2024-05-10T11:13:57.083930+0000","last_fullsized":"2024-05-10T11:13:57.083930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085763+0000","last_change":"2024-05-10T11:13:57.085763+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085763+0000","last_undegraded":"2024-05-10T11:13:57.085763+0000","last_fullsized":"2024-05-10T11:13:57.085763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.088850+0000","last_change":"2024-05-10T11:13:57.088850+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.088850+0000","last_undegraded":"2024-05-10T11:13:57.088850+0000","last_fullsized":"2024-05-10T11:13:57.088850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091815+0000","last_change":"2024-05-10T11:13:58.091815+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091815+0000","last_undegraded":"2024-05-10T11:13:58.091815+0000","last_fullsized":"2024-05-10T11:13:58.091815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105138+0000","last_change":"2024-05-10T11:13:58.101899+0000","last_active":"2024-05-10T11:13:58.105138+0000","last_peered":"2024-05-10T11:13:58.105138+0000","last_clean":"2024-05-10T11:13:58.105138+0000","last_became_active":"2024-05-10T11:13:58.101701+0000","last_became_peered":"2024-05-10T11:13:58.101701+0000","last_unstale":"2024-05-10T11:13:58.105138+0000","last_undegraded":"2024-05-10T11:13:58.105138+0000","last_fullsized":"2024-05-10T11:13:58.105138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:15:08.136167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.109666+0000","last_change":"2024-05-10T11:13:58.108564+0000","last_active":"2024-05-10T11:13:58.109666+0000","last_peered":"2024-05-10T11:13:58.109666+0000","last_clean":"2024-05-10T11:13:58.109666+0000","last_became_active":"2024-05-10T11:13:58.108327+0000","last_became_peered":"2024-05-10T11:13:58.108327+0000","last_unstale":"2024-05-10T11:13:58.109666+0000","last_undegraded":"2024-05-10T11:13:58.109666+0000","last_fullsized":"2024-05-10T11:13:58.109666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:16.753692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.084006+0000","last_change":"2024-05-10T11:13:57.084006+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.084006+0000","last_undegraded":"2024-05-10T11:13:57.084006+0000","last_fullsized":"2024-05-10T11:13:57.084006+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092920+0000","last_change":"2024-05-10T11:13:58.092920+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092920+0000","last_undegraded":"2024-05-10T11:13:58.092920+0000","last_fullsized":"2024-05-10T11:13:58.092920+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086340+0000","last_change":"2024-05-10T11:13:57.086340+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086340+0000","last_undegraded":"2024-05-10T11:13:57.086340+0000","last_fullsized":"2024-05-10T11:13:57.086340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085275+0000","last_change":"2024-05-10T11:13:57.085275+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085275+0000","last_undegraded":"2024-05-10T11:13:57.085275+0000","last_fullsized":"2024-05-10T11:13:57.085275+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.087707+0000","last_change":"2024-05-10T11:13:57.087707+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.087707+0000","last_undegraded":"2024-05-10T11:13:57.087707+0000","last_fullsized":"2024-05-10T11:13:57.087707+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105119+0000","last_change":"2024-05-10T11:13:58.101299+0000","last_active":"2024-05-10T11:13:58.105119+0000","last_peered":"2024-05-10T11:13:58.105119+0000","last_clean":"2024-05-10T11:13:58.105119+0000","last_became_active":"2024-05-10T11:13:58.101054+0000","last_became_peered":"2024-05-10T11:13:58.101054+0000","last_unstale":"2024-05-10T11:13:58.105119+0000","last_undegraded":"2024-05-10T11:13:58.105119+0000","last_fullsized":"2024-05-10T11:13:58.105119+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:05.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100937+0000","last_change":"2024-05-10T11:13:58.098786+0000","last_active":"2024-05-10T11:13:58.100937+0000","last_peered":"2024-05-10T11:13:58.100937+0000","last_clean":"2024-05-10T11:13:58.100937+0000","last_became_active":"2024-05-10T11:13:58.098493+0000","last_became_peered":"2024-05-10T11:13:58.098493+0000","last_unstale":"2024-05-10T11:13:58.100937+0000","last_undegraded":"2024-05-10T11:13:58.100937+0000","last_fullsized":"2024-05-10T11:13:58.100937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:41.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085291+0000","last_change":"2024-05-10T11:13:57.085291+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085291+0000","last_undegraded":"2024-05-10T11:13:57.085291+0000","last_fullsized":"2024-05-10T11:13:57.085291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085180+0000","last_change":"2024-05-10T11:13:57.085180+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085180+0000","last_undegraded":"2024-05-10T11:13:57.085180+0000","last_fullsized":"2024-05-10T11:13:57.085180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085910+0000","last_change":"2024-05-10T11:13:57.085910+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085910+0000","last_undegraded":"2024-05-10T11:13:57.085910+0000","last_fullsized":"2024-05-10T11:13:57.085910+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100846+0000","last_change":"2024-05-10T11:13:58.099189+0000","last_active":"2024-05-10T11:13:58.100846+0000","last_peered":"2024-05-10T11:13:58.100846+0000","last_clean":"2024-05-10T11:13:58.100846+0000","last_became_active":"2024-05-10T11:13:58.098921+0000","last_became_peered":"2024-05-10T11:13:58.098921+0000","last_unstale":"2024-05-10T11:13:58.100846+0000","last_undegraded":"2024-05-10T11:13:58.100846+0000","last_fullsized":"2024-05-10T11:13:58.100846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:12.255023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:57.076581+0000","last_change":"2024-05-10T11:13:57.076581+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.076581+0000","last_undegraded":"2024-05-10T11:13:57.076581+0000","last_fullsized":"2024-05-10T11:13:57.076581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093068+0000","last_change":"2024-05-10T11:13:58.093068+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093068+0000","last_undegraded":"2024-05-10T11:13:58.093068+0000","last_fullsized":"2024-05-10T11:13:58.093068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085772+0000","last_change":"2024-05-10T11:13:57.085772+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085772+0000","last_undegraded":"2024-05-10T11:13:57.085772+0000","last_fullsized":"2024-05-10T11:13:57.085772+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":157,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.087640+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:58.087640+0000","last_peered":"2024-05-10T11:13:58.087640+0000","last_clean":"2024-05-10T11:13:58.087640+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:58.087640+0000","last_undegraded":"2024-05-10T11:13:58.087640+0000","last_fullsized":"2024-05-10T11:13:58.087640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":827634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":230599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":224390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":224390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1130496,"data_stored":820967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":224390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:14:03.193 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:14:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.333+0000 7fee4b8a7640 1 Processor -- start 2024-05-10T11:14:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.333+0000 7fee4b8a7640 1 -- start start 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee4b8a7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fee4415f4e0 0x7fee4406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee4b8a7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fee4406e620 0x7fee440d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee4b8a7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee440b0a90 con 0x7fee4415f8c0 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee4b8a7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fee440b23f0 con 0x7fee4406e620 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee4b8a7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fee440b4150 con 0x7fee4415f4e0 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fee4406e620 0x7fee440d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fee4406e620 0x7fee440d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60978/0 (socket says 172.21.15.66:60978) 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee48e42640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fee4415f8c0 0x7fee4406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34598/0 (socket says 172.21.15.66:34598) 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 -- 172.21.15.66:0/1590205235 learned_addr learned my addr 172.21.15.66:0/1590205235 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49643640 1 --2- 172.21.15.66:0/1590205235 >> v2:172.21.15.190:3300/0 conn(0x7fee4415f4e0 0x7fee4406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 -- 172.21.15.66:0/1590205235 >> v2:172.21.15.190:3300/0 conn(0x7fee4415f4e0 msgr2=0x7fee4406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 --2- 172.21.15.66:0/1590205235 >> v2:172.21.15.190:3300/0 conn(0x7fee4415f4e0 0x7fee4406d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 -- 172.21.15.66:0/1590205235 >> v1:172.21.15.66:6789/0 conn(0x7fee4415f8c0 legacy=0x7fee4406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.334+0000 7fee49e44640 1 -- 172.21.15.66:0/1590205235 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee440b3540 con 0x7fee4406e620 2024-05-10T11:14:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.335+0000 7fee49e44640 1 --2- 172.21.15.66:0/1590205235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee440d0cf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee44068c10 tx=0x7fee3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6ed6c123f29d7f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.335+0000 7fee37fff640 1 -- 172.21.15.66:0/1590205235 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c036070 con 0x7fee4406e620 2024-05-10T11:14:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.335+0000 7fee37fff640 1 -- 172.21.15.66:0/1590205235 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3c031600 con 0x7fee4406e620 2024-05-10T11:14:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.335+0000 7fee37fff640 1 -- 172.21.15.66:0/1590205235 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0319d0 con 0x7fee4406e620 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1590205235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 msgr2=0x7fee440d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1590205235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee440d0cf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee44068c10 tx=0x7fee3c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1590205235 shutdown_connections 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1590205235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee440d0cf0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1590205235 >> v2:172.21.15.190:3300/0 conn(0x7fee4415f4e0 0x7fee4406d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1590205235 >> 172.21.15.66:0/1590205235 conn(0x7fee440d2df0 msgr2=0x7fee440d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1590205235 shutdown_connections 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.336+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1590205235 wait complete. 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.337+0000 7fee4b8a7640 1 Processor -- start 2024-05-10T11:14:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.337+0000 7fee4b8a7640 1 -- start start 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee4b8a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee441565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee4b8a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee4415f4e0 0x7fee44157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee4b8a7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee4415f8c0 0x7fee441f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee4b8a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fee440b3de0 con 0x7fee4406e620 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee4b8a7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fee440b3b00 con 0x7fee4415f8c0 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee4b8a7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fee440b45e0 con 0x7fee4415f4e0 2024-05-10T11:14:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee441565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee441565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60988/0 (socket says 172.21.15.66:60988) 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 -- 172.21.15.66:0/1463698155 learned_addr learned my addr 172.21.15.66:0/1463698155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 -- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee4415f4e0 msgr2=0x7fee44157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee4415f4e0 0x7fee44157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 -- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee4415f8c0 msgr2=0x7fee441f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee4415f8c0 0x7fee441f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 -- 172.21.15.66:0/1463698155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee44158480 con 0x7fee4406e620 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.338+0000 7fee49643640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee441565e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fee4000d830 tx=0x7fee4000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.339+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4000b6c0 con 0x7fee4406e620 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.339+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40019070 con 0x7fee4406e620 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.339+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4000ba80 con 0x7fee4406e620 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.339+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee44161500 con 0x7fee4406e620 2024-05-10T11:14:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.339+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee44161ac0 con 0x7fee4406e620 2024-05-10T11:14:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.340+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee440b8b00 con 0x7fee4406e620 2024-05-10T11:14:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.340+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee4001e460 con 0x7fee4406e620 2024-05-10T11:14:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.341+0000 7fee35ffb640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fee280762d0 0x7fee28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.341+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fee40097e20 con 0x7fee4406e620 2024-05-10T11:14:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.341+0000 7fee48e42640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fee280762d0 0x7fee28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.342+0000 7fee48e42640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fee280762d0 0x7fee28078790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee38000f60 tx=0x7fee38007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.345+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fee440b8b00 con 0x7fee4406e620 2024-05-10T11:14:03.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.537+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee44161f40 con 0x7fee280762d0 2024-05-10T11:14:03.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.543+0000 7fee35ffb640 1 -- 172.21.15.66:0/1463698155 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242130 (secure 0 0 0) 0x7fee44161f40 con 0x7fee280762d0 2024-05-10T11:14:03.546 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:03.547 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:14:03.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fee280762d0 msgr2=0x7fee28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fee280762d0 0x7fee28078790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee38000f60 tx=0x7fee38007a00 comp rx=0 tx=0).stop 2024-05-10T11:14:03.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 msgr2=0x7fee441565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee441565e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fee4000d830 tx=0x7fee4000dcf0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 shutdown_connections 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fee280762d0 0x7fee28078790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee4415f8c0 0x7fee441f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee4415f4e0 0x7fee44157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 --2- 172.21.15.66:0/1463698155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee4406e620 0x7fee441565e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 >> 172.21.15.66:0/1463698155 conn(0x7fee440d2df0 msgr2=0x7fee4406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 shutdown_connections 2024-05-10T11:14:03.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.546+0000 7fee4b8a7640 1 -- 172.21.15.66:0/1463698155 wait complete. 2024-05-10T11:14:03.557 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-05-10T11:14:01.704564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221528,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5480448,"data_stored":3026902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.625048"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.087095+0000","last_change":"2024-05-10T11:13:58.087095+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.087095+0000","last_undegraded":"2024-05-10T11:13:58.087095+0000","last_fullsized":"2024-05-10T11:13:58.087095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086382+0000","last_change":"2024-05-10T11:13:58.086382+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086382+0000","last_undegraded":"2024-05-10T11:13:58.086382+0000","last_fullsized":"2024-05-10T11:13:58.086382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091231+0000","last_change":"2024-05-10T11:13:58.091231+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091231+0000","last_undegraded":"2024-05-10T11:13:58.091231+0000","last_fullsized":"2024-05-10T11:13:58.091231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086453+0000","last_change":"2024-05-10T11:13:58.086453+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086453+0000","last_undegraded":"2024-05-10T11:13:58.086453+0000","last_fullsized":"2024-05-10T11:13:58.086453+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086266+0000","last_change":"2024-05-10T11:13:58.086266+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086266+0000","last_undegraded":"2024-05-10T11:13:58.086266+0000","last_fullsized":"2024-05-10T11:13:58.086266+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093694+0000","last_change":"2024-05-10T11:13:58.093694+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093694+0000","last_undegraded":"2024-05-10T11:13:58.093694+0000","last_fullsized":"2024-05-10T11:13:58.093694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091100+0000","last_change":"2024-05-10T11:13:58.091100+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091100+0000","last_undegraded":"2024-05-10T11:13:58.091100+0000","last_fullsized":"2024-05-10T11:13:58.091100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093237+0000","last_change":"2024-05-10T11:13:58.093237+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093237+0000","last_undegraded":"2024-05-10T11:13:58.093237+0000","last_fullsized":"2024-05-10T11:13:58.093237+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086302+0000","last_change":"2024-05-10T11:13:58.086302+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086302+0000","last_undegraded":"2024-05-10T11:13:58.086302+0000","last_fullsized":"2024-05-10T11:13:58.086302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086586+0000","last_change":"2024-05-10T11:13:58.086586+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086586+0000","last_undegraded":"2024-05-10T11:13:58.086586+0000","last_fullsized":"2024-05-10T11:13:58.086586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098266+0000","last_change":"2024-05-10T11:13:58.096652+0000","last_active":"2024-05-10T11:13:58.098266+0000","last_peered":"2024-05-10T11:13:58.098266+0000","last_clean":"2024-05-10T11:13:58.098266+0000","last_became_active":"2024-05-10T11:13:58.096366+0000","last_became_peered":"2024-05-10T11:13:58.096366+0000","last_unstale":"2024-05-10T11:13:58.098266+0000","last_undegraded":"2024-05-10T11:13:58.098266+0000","last_fullsized":"2024-05-10T11:13:58.098266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:09.362328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.084069+0000","last_change":"2024-05-10T11:13:57.084069+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.084069+0000","last_undegraded":"2024-05-10T11:13:57.084069+0000","last_fullsized":"2024-05-10T11:13:57.084069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092969+0000","last_change":"2024-05-10T11:13:58.092969+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092969+0000","last_undegraded":"2024-05-10T11:13:58.092969+0000","last_fullsized":"2024-05-10T11:13:58.092969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.083912+0000","last_change":"2024-05-10T11:13:57.083912+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.083912+0000","last_undegraded":"2024-05-10T11:13:57.083912+0000","last_fullsized":"2024-05-10T11:13:57.083912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:57.076581+0000","last_change":"2024-05-10T11:13:57.076581+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.076581+0000","last_undegraded":"2024-05-10T11:13:57.076581+0000","last_fullsized":"2024-05-10T11:13:57.076581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091795+0000","last_change":"2024-05-10T11:13:58.091795+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091795+0000","last_undegraded":"2024-05-10T11:13:58.091795+0000","last_fullsized":"2024-05-10T11:13:58.091795+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086535+0000","last_change":"2024-05-10T11:13:57.086535+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086535+0000","last_undegraded":"2024-05-10T11:13:57.086535+0000","last_fullsized":"2024-05-10T11:13:57.086535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086342+0000","last_change":"2024-05-10T11:13:58.086342+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086342+0000","last_undegraded":"2024-05-10T11:13:58.086342+0000","last_fullsized":"2024-05-10T11:13:58.086342+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100981+0000","last_change":"2024-05-10T11:13:58.098405+0000","last_active":"2024-05-10T11:13:58.100981+0000","last_peered":"2024-05-10T11:13:58.100981+0000","last_clean":"2024-05-10T11:13:58.100981+0000","last_became_active":"2024-05-10T11:13:58.098115+0000","last_became_peered":"2024-05-10T11:13:58.098115+0000","last_unstale":"2024-05-10T11:13:58.100981+0000","last_undegraded":"2024-05-10T11:13:58.100981+0000","last_fullsized":"2024-05-10T11:13:58.100981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:17.632714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098757+0000","last_change":"2024-05-10T11:13:58.097819+0000","last_active":"2024-05-10T11:13:58.098757+0000","last_peered":"2024-05-10T11:13:58.098757+0000","last_clean":"2024-05-10T11:13:58.098757+0000","last_became_active":"2024-05-10T11:13:58.097490+0000","last_became_peered":"2024-05-10T11:13:58.097490+0000","last_unstale":"2024-05-10T11:13:58.098757+0000","last_undegraded":"2024-05-10T11:13:58.098757+0000","last_fullsized":"2024-05-10T11:13:58.098757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:42.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086281+0000","last_change":"2024-05-10T11:13:58.086281+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086281+0000","last_undegraded":"2024-05-10T11:13:58.086281+0000","last_fullsized":"2024-05-10T11:13:58.086281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085282+0000","last_change":"2024-05-10T11:13:57.085282+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085282+0000","last_undegraded":"2024-05-10T11:13:57.085282+0000","last_fullsized":"2024-05-10T11:13:57.085282+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090158+0000","last_change":"2024-05-10T11:13:58.090158+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090158+0000","last_undegraded":"2024-05-10T11:13:58.090158+0000","last_fullsized":"2024-05-10T11:13:58.090158+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102466+0000","last_change":"2024-05-10T11:13:58.098731+0000","last_active":"2024-05-10T11:13:58.102466+0000","last_peered":"2024-05-10T11:13:58.102466+0000","last_clean":"2024-05-10T11:13:58.102466+0000","last_became_active":"2024-05-10T11:13:58.098187+0000","last_became_peered":"2024-05-10T11:13:58.098187+0000","last_unstale":"2024-05-10T11:13:58.102466+0000","last_undegraded":"2024-05-10T11:13:58.102466+0000","last_fullsized":"2024-05-10T11:13:58.102466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:19.909231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098452+0000","last_change":"2024-05-10T11:13:58.097328+0000","last_active":"2024-05-10T11:13:58.098452+0000","last_peered":"2024-05-10T11:13:58.098452+0000","last_clean":"2024-05-10T11:13:58.098452+0000","last_became_active":"2024-05-10T11:13:58.097031+0000","last_became_peered":"2024-05-10T11:13:58.097031+0000","last_unstale":"2024-05-10T11:13:58.098452+0000","last_undegraded":"2024-05-10T11:13:58.098452+0000","last_fullsized":"2024-05-10T11:13:58.098452+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:27.401728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102538+0000","last_change":"2024-05-10T11:13:58.100457+0000","last_active":"2024-05-10T11:13:58.102538+0000","last_peered":"2024-05-10T11:13:58.102538+0000","last_clean":"2024-05-10T11:13:58.102538+0000","last_became_active":"2024-05-10T11:13:58.100133+0000","last_became_peered":"2024-05-10T11:13:58.100133+0000","last_unstale":"2024-05-10T11:13:58.102538+0000","last_undegraded":"2024-05-10T11:13:58.102538+0000","last_fullsized":"2024-05-10T11:13:58.102538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:43.772326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090165+0000","last_change":"2024-05-10T11:13:58.090165+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090165+0000","last_undegraded":"2024-05-10T11:13:58.090165+0000","last_fullsized":"2024-05-10T11:13:58.090165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086185+0000","last_change":"2024-05-10T11:13:57.086185+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086185+0000","last_undegraded":"2024-05-10T11:13:57.086185+0000","last_fullsized":"2024-05-10T11:13:57.086185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086096+0000","last_change":"2024-05-10T11:13:57.086096+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086096+0000","last_undegraded":"2024-05-10T11:13:57.086096+0000","last_fullsized":"2024-05-10T11:13:57.086096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102410+0000","last_change":"2024-05-10T11:13:58.100301+0000","last_active":"2024-05-10T11:13:58.102410+0000","last_peered":"2024-05-10T11:13:58.102410+0000","last_clean":"2024-05-10T11:13:58.102410+0000","last_became_active":"2024-05-10T11:13:58.100038+0000","last_became_peered":"2024-05-10T11:13:58.100038+0000","last_unstale":"2024-05-10T11:13:58.102410+0000","last_undegraded":"2024-05-10T11:13:58.102410+0000","last_fullsized":"2024-05-10T11:13:58.102410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:02.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100879+0000","last_change":"2024-05-10T11:13:58.098650+0000","last_active":"2024-05-10T11:13:58.100879+0000","last_peered":"2024-05-10T11:13:58.100879+0000","last_clean":"2024-05-10T11:13:58.100879+0000","last_became_active":"2024-05-10T11:13:58.098172+0000","last_became_peered":"2024-05-10T11:13:58.098172+0000","last_unstale":"2024-05-10T11:13:58.100879+0000","last_undegraded":"2024-05-10T11:13:58.100879+0000","last_fullsized":"2024-05-10T11:13:58.100879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:48.647647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.083930+0000","last_change":"2024-05-10T11:13:57.083930+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.083930+0000","last_undegraded":"2024-05-10T11:13:57.083930+0000","last_fullsized":"2024-05-10T11:13:57.083930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085763+0000","last_change":"2024-05-10T11:13:57.085763+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085763+0000","last_undegraded":"2024-05-10T11:13:57.085763+0000","last_fullsized":"2024-05-10T11:13:57.085763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.088850+0000","last_change":"2024-05-10T11:13:57.088850+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.088850+0000","last_undegraded":"2024-05-10T11:13:57.088850+0000","last_fullsized":"2024-05-10T11:13:57.088850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091815+0000","last_change":"2024-05-10T11:13:58.091815+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091815+0000","last_undegraded":"2024-05-10T11:13:58.091815+0000","last_fullsized":"2024-05-10T11:13:58.091815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105138+0000","last_change":"2024-05-10T11:13:58.101899+0000","last_active":"2024-05-10T11:13:58.105138+0000","last_peered":"2024-05-10T11:13:58.105138+0000","last_clean":"2024-05-10T11:13:58.105138+0000","last_became_active":"2024-05-10T11:13:58.101701+0000","last_became_peered":"2024-05-10T11:13:58.101701+0000","last_unstale":"2024-05-10T11:13:58.105138+0000","last_undegraded":"2024-05-10T11:13:58.105138+0000","last_fullsized":"2024-05-10T11:13:58.105138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:15:08.136167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.109666+0000","last_change":"2024-05-10T11:13:58.108564+0000","last_active":"2024-05-10T11:13:58.109666+0000","last_peered":"2024-05-10T11:13:58.109666+0000","last_clean":"2024-05-10T11:13:58.109666+0000","last_became_active":"2024-05-10T11:13:58.108327+0000","last_became_peered":"2024-05-10T11:13:58.108327+0000","last_unstale":"2024-05-10T11:13:58.109666+0000","last_undegraded":"2024-05-10T11:13:58.109666+0000","last_fullsized":"2024-05-10T11:13:58.109666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:16.753692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.084006+0000","last_change":"2024-05-10T11:13:57.084006+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.084006+0000","last_undegraded":"2024-05-10T11:13:57.084006+0000","last_fullsized":"2024-05-10T11:13:57.084006+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092920+0000","last_change":"2024-05-10T11:13:58.092920+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092920+0000","last_undegraded":"2024-05-10T11:13:58.092920+0000","last_fullsized":"2024-05-10T11:13:58.092920+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.086340+0000","last_change":"2024-05-10T11:13:57.086340+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.086340+0000","last_undegraded":"2024-05-10T11:13:57.086340+0000","last_fullsized":"2024-05-10T11:13:57.086340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085275+0000","last_change":"2024-05-10T11:13:57.085275+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085275+0000","last_undegraded":"2024-05-10T11:13:57.085275+0000","last_fullsized":"2024-05-10T11:13:57.085275+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.087707+0000","last_change":"2024-05-10T11:13:57.087707+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.087707+0000","last_undegraded":"2024-05-10T11:13:57.087707+0000","last_fullsized":"2024-05-10T11:13:57.087707+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105119+0000","last_change":"2024-05-10T11:13:58.101299+0000","last_active":"2024-05-10T11:13:58.105119+0000","last_peered":"2024-05-10T11:13:58.105119+0000","last_clean":"2024-05-10T11:13:58.105119+0000","last_became_active":"2024-05-10T11:13:58.101054+0000","last_became_peered":"2024-05-10T11:13:58.101054+0000","last_unstale":"2024-05-10T11:13:58.105119+0000","last_undegraded":"2024-05-10T11:13:58.105119+0000","last_fullsized":"2024-05-10T11:13:58.105119+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:05.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100937+0000","last_change":"2024-05-10T11:13:58.098786+0000","last_active":"2024-05-10T11:13:58.100937+0000","last_peered":"2024-05-10T11:13:58.100937+0000","last_clean":"2024-05-10T11:13:58.100937+0000","last_became_active":"2024-05-10T11:13:58.098493+0000","last_became_peered":"2024-05-10T11:13:58.098493+0000","last_unstale":"2024-05-10T11:13:58.100937+0000","last_undegraded":"2024-05-10T11:13:58.100937+0000","last_fullsized":"2024-05-10T11:13:58.100937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:41.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085291+0000","last_change":"2024-05-10T11:13:57.085291+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085291+0000","last_undegraded":"2024-05-10T11:13:57.085291+0000","last_fullsized":"2024-05-10T11:13:57.085291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085180+0000","last_change":"2024-05-10T11:13:57.085180+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085180+0000","last_undegraded":"2024-05-10T11:13:57.085180+0000","last_fullsized":"2024-05-10T11:13:57.085180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085910+0000","last_change":"2024-05-10T11:13:57.085910+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085910+0000","last_undegraded":"2024-05-10T11:13:57.085910+0000","last_fullsized":"2024-05-10T11:13:57.085910+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100846+0000","last_change":"2024-05-10T11:13:58.099189+0000","last_active":"2024-05-10T11:13:58.100846+0000","last_peered":"2024-05-10T11:13:58.100846+0000","last_clean":"2024-05-10T11:13:58.100846+0000","last_became_active":"2024-05-10T11:13:58.098921+0000","last_became_peered":"2024-05-10T11:13:58.098921+0000","last_unstale":"2024-05-10T11:13:58.100846+0000","last_undegraded":"2024-05-10T11:13:58.100846+0000","last_fullsized":"2024-05-10T11:13:58.100846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:12.255023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:58.078933+0000","last_change":"2024-05-10T11:13:58.078933+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.078933+0000","last_undegraded":"2024-05-10T11:13:58.078933+0000","last_fullsized":"2024-05-10T11:13:58.078933+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:13:57.076581+0000","last_change":"2024-05-10T11:13:57.076581+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.076581+0000","last_undegraded":"2024-05-10T11:13:57.076581+0000","last_fullsized":"2024-05-10T11:13:57.076581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093068+0000","last_change":"2024-05-10T11:13:58.093068+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093068+0000","last_undegraded":"2024-05-10T11:13:58.093068+0000","last_fullsized":"2024-05-10T11:13:58.093068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-05-10T11:13:57.085772+0000","last_change":"2024-05-10T11:13:57.085772+0000","last_active":"2024-05-10T11:13:57.076581+0000","last_peered":"2024-05-10T11:13:57.076581+0000","last_clean":"2024-05-10T11:13:57.076581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:57.085772+0000","last_undegraded":"2024-05-10T11:13:57.085772+0000","last_fullsized":"2024-05-10T11:13:57.085772+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":157,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.087640+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:58.087640+0000","last_peered":"2024-05-10T11:13:58.087640+0000","last_clean":"2024-05-10T11:13:58.087640+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:58.087640+0000","last_undegraded":"2024-05-10T11:13:58.087640+0000","last_fullsized":"2024-05-10T11:13:58.087640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":827634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":230599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":224390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":224390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1130496,"data_stored":820967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":224390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:14:03.561 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:14:03.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.702+0000 7f0d636e8640 1 Processor -- start 2024-05-10T11:14:03.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.702+0000 7f0d636e8640 1 -- start start 2024-05-10T11:14:03.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d636e8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d5c070820 0x7f0d5c1611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d636e8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c0ce8e0 con 0x7f0d5c0703c0 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d636e8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c0cebc0 con 0x7f0d5c06c2c0 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d636e8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c0ceea0 con 0x7f0d5c070820 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d61c85640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d5c070820 0x7f0d5c1611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d60c83640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0d5c0703c0 0x7f0d5c160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34606/0 (socket says 172.21.15.66:34606) 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d60c83640 1 -- 172.21.15.66:0/1327022196 learned_addr learned my addr 172.21.15.66:0/1327022196 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d61c85640 1 --2- 172.21.15.66:0/1327022196 >> v2:172.21.15.66:3300/0 conn(0x7f0d5c070820 0x7f0d5c1611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60998/0 (socket says 172.21.15.66:60998) 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d61c85640 1 -- 172.21.15.66:0/1327022196 >> v1:172.21.15.190:6789/0 conn(0x7f0d5c06c2c0 legacy=0x7f0d5c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d61c85640 1 -- 172.21.15.66:0/1327022196 >> v1:172.21.15.66:6789/0 conn(0x7f0d5c0703c0 legacy=0x7f0d5c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.703+0000 7f0d61c85640 1 -- 172.21.15.66:0/1327022196 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0cf180 con 0x7f0d5c070820 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.704+0000 7f0d61c85640 1 --2- 172.21.15.66:0/1327022196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c1611d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae74267f5d491f7e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.704+0000 7f0d4ffff640 1 -- 172.21.15.66:0/1327022196 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54007740 con 0x7f0d5c070820 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.704+0000 7f0d4ffff640 1 -- 172.21.15.66:0/1327022196 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d540078e0 con 0x7f0d5c070820 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.704+0000 7f0d4ffff640 1 -- 172.21.15.66:0/1327022196 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54007cb0 con 0x7f0d5c070820 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 -- 172.21.15.66:0/1327022196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 msgr2=0x7f0d5c1611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 --2- 172.21.15.66:0/1327022196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c1611d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5402a6f0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 -- 172.21.15.66:0/1327022196 shutdown_connections 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 --2- 172.21.15.66:0/1327022196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c1611d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 -- 172.21.15.66:0/1327022196 >> 172.21.15.66:0/1327022196 conn(0x7f0d5c0b3980 msgr2=0x7f0d5c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:03.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 -- 172.21.15.66:0/1327022196 shutdown_connections 2024-05-10T11:14:03.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.705+0000 7f0d636e8640 1 -- 172.21.15.66:0/1327022196 wait complete. 2024-05-10T11:14:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.706+0000 7f0d636e8640 1 Processor -- start 2024-05-10T11:14:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.706+0000 7f0d636e8640 1 -- start start 2024-05-10T11:14:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d636e8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c06c2c0 0x7f0d5c0b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d636e8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c0703c0 0x7f0d5c151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d636e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d636e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c15d2a0 con 0x7f0d5c070820 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d636e8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0cfc70 con 0x7f0d5c06c2c0 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d636e8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0cc3a0 con 0x7f0d5c0703c0 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c0cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32774/0 (socket says 172.21.15.66:32774) 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 -- 172.21.15.66:0/605624066 learned_addr learned my addr 172.21.15.66:0/605624066 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61484640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c06c2c0 0x7f0d5c0b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d60c83640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c0703c0 0x7f0d5c151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 -- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c0703c0 msgr2=0x7f0d5c151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c0703c0 0x7f0d5c151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 -- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c06c2c0 msgr2=0x7f0d5c0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c06c2c0 0x7f0d5c0b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d61c85640 1 -- 172.21.15.66:0/605624066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0caa80 con 0x7f0d5c070820 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.707+0000 7f0d60c83640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c0703c0 0x7f0d5c151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.708+0000 7f0d61c85640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c0cae70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d5402ace0 tx=0x7f0d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.708+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5403f070 con 0x7f0d5c070820 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.708+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54031c90 con 0x7f0d5c070820 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.708+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c0b61f0 con 0x7f0d5c070820 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.708+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54044680 con 0x7f0d5c070820 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.708+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c0b67b0 con 0x7f0d5c070820 2024-05-10T11:14:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.709+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c06a220 con 0x7f0d5c070820 2024-05-10T11:14:03.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.710+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d5403b410 con 0x7f0d5c070820 2024-05-10T11:14:03.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.710+0000 7f0d4dffb640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d400762d0 0x7f0d40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:03.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.710+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f0d540b9040 con 0x7f0d5c070820 2024-05-10T11:14:03.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.710+0000 7f0d61484640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d400762d0 0x7f0d40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:03.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.711+0000 7f0d61484640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d400762d0 0x7f0d40078790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d58001780 tx=0x7f0d58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:03.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.714+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0d540828d0 con 0x7f0d5c070820 2024-05-10T11:14:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.903+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d5c0b36f0 con 0x7f0d400762d0 2024-05-10T11:14:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.910+0000 7f0d4dffb640 1 -- 172.21.15.66:0/605624066 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250365 (secure 0 0 0) 0x7f0d5c0b36f0 con 0x7f0d400762d0 2024-05-10T11:14:03.913 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:03.914 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:14:03.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d400762d0 msgr2=0x7f0d40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d400762d0 0x7f0d40078790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d58001780 tx=0x7f0d58009040 comp rx=0 tx=0).stop 2024-05-10T11:14:03.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 msgr2=0x7f0d5c0cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:03.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c0cae70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d5402ace0 tx=0x7f0d54004a40 comp rx=0 tx=0).stop 2024-05-10T11:14:03.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 shutdown_connections 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d400762d0 0x7f0d40078790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d5c070820 0x7f0d5c0cae70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c0703c0 0x7f0d5c151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 --2- 172.21.15.66:0/605624066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c06c2c0 0x7f0d5c0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 >> 172.21.15.66:0/605624066 conn(0x7f0d5c0b3980 msgr2=0x7f0d5c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 shutdown_connections 2024-05-10T11:14:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:03.913+0000 7f0d636e8640 1 -- 172.21.15.66:0/605624066 wait complete. 2024-05-10T11:14:03.925 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-05-10T11:14:03.704905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221792,"kb_used_data":5600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752928,"statfs":{"total":773094113280,"available":772866998272,"internally_reserved":0,"allocated":5734400,"data_stored":3144929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105697+0000","last_change":"2024-05-10T11:13:59.106675+0000","last_active":"2024-05-10T11:14:00.105697+0000","last_peered":"2024-05-10T11:14:00.105697+0000","last_clean":"2024-05-10T11:14:00.105697+0000","last_became_active":"2024-05-10T11:13:59.104906+0000","last_became_peered":"2024-05-10T11:13:59.104906+0000","last_unstale":"2024-05-10T11:14:00.105697+0000","last_undegraded":"2024-05-10T11:14:00.105697+0000","last_fullsized":"2024-05-10T11:14:00.105697+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:39.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.087095+0000","last_change":"2024-05-10T11:13:58.087095+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.087095+0000","last_undegraded":"2024-05-10T11:13:58.087095+0000","last_fullsized":"2024-05-10T11:13:58.087095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092955+0000","last_change":"2024-05-10T11:13:59.101893+0000","last_active":"2024-05-10T11:14:01.092955+0000","last_peered":"2024-05-10T11:14:01.092955+0000","last_clean":"2024-05-10T11:14:01.092955+0000","last_became_active":"2024-05-10T11:13:59.101342+0000","last_became_peered":"2024-05-10T11:13:59.101342+0000","last_unstale":"2024-05-10T11:14:01.092955+0000","last_undegraded":"2024-05-10T11:14:01.092955+0000","last_fullsized":"2024-05-10T11:14:01.092955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:24.662230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086382+0000","last_change":"2024-05-10T11:13:58.086382+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086382+0000","last_undegraded":"2024-05-10T11:13:58.086382+0000","last_fullsized":"2024-05-10T11:13:58.086382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091231+0000","last_change":"2024-05-10T11:13:58.091231+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091231+0000","last_undegraded":"2024-05-10T11:13:58.091231+0000","last_fullsized":"2024-05-10T11:13:58.091231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105517+0000","last_change":"2024-05-10T11:13:59.106716+0000","last_active":"2024-05-10T11:14:00.105517+0000","last_peered":"2024-05-10T11:14:00.105517+0000","last_clean":"2024-05-10T11:14:00.105517+0000","last_became_active":"2024-05-10T11:13:59.106391+0000","last_became_peered":"2024-05-10T11:13:59.106391+0000","last_unstale":"2024-05-10T11:14:00.105517+0000","last_undegraded":"2024-05-10T11:14:00.105517+0000","last_fullsized":"2024-05-10T11:14:00.105517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:50.602243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092487+0000","last_change":"2024-05-10T11:13:59.105753+0000","last_active":"2024-05-10T11:14:01.092487+0000","last_peered":"2024-05-10T11:14:01.092487+0000","last_clean":"2024-05-10T11:14:01.092487+0000","last_became_active":"2024-05-10T11:13:59.105261+0000","last_became_peered":"2024-05-10T11:13:59.105261+0000","last_unstale":"2024-05-10T11:14:01.092487+0000","last_undegraded":"2024-05-10T11:14:01.092487+0000","last_fullsized":"2024-05-10T11:14:01.092487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:08.244589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753009+0000","last_change":"2024-05-10T11:13:59.097811+0000","last_active":"2024-05-10T11:14:01.753009+0000","last_peered":"2024-05-10T11:14:01.753009+0000","last_clean":"2024-05-10T11:14:01.753009+0000","last_became_active":"2024-05-10T11:13:59.095867+0000","last_became_peered":"2024-05-10T11:13:59.095867+0000","last_unstale":"2024-05-10T11:14:01.753009+0000","last_undegraded":"2024-05-10T11:14:01.753009+0000","last_fullsized":"2024-05-10T11:14:01.753009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:09.356540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753144+0000","last_change":"2024-05-10T11:13:59.112824+0000","last_active":"2024-05-10T11:14:01.753144+0000","last_peered":"2024-05-10T11:14:01.753144+0000","last_clean":"2024-05-10T11:14:01.753144+0000","last_became_active":"2024-05-10T11:13:59.112454+0000","last_became_peered":"2024-05-10T11:13:59.112454+0000","last_unstale":"2024-05-10T11:14:01.753144+0000","last_undegraded":"2024-05-10T11:14:01.753144+0000","last_fullsized":"2024-05-10T11:14:01.753144+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:40.838654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105686+0000","last_change":"2024-05-10T11:13:59.106359+0000","last_active":"2024-05-10T11:14:00.105686+0000","last_peered":"2024-05-10T11:14:00.105686+0000","last_clean":"2024-05-10T11:14:00.105686+0000","last_became_active":"2024-05-10T11:13:59.106080+0000","last_became_peered":"2024-05-10T11:13:59.106080+0000","last_unstale":"2024-05-10T11:14:00.105686+0000","last_undegraded":"2024-05-10T11:14:00.105686+0000","last_fullsized":"2024-05-10T11:14:00.105686+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:34.496936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106716+0000","last_change":"2024-05-10T11:13:59.107658+0000","last_active":"2024-05-10T11:14:00.106716+0000","last_peered":"2024-05-10T11:14:00.106716+0000","last_clean":"2024-05-10T11:14:00.106716+0000","last_became_active":"2024-05-10T11:13:59.107365+0000","last_became_peered":"2024-05-10T11:13:59.107365+0000","last_unstale":"2024-05-10T11:14:00.106716+0000","last_undegraded":"2024-05-10T11:14:00.106716+0000","last_fullsized":"2024-05-10T11:14:00.106716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:46.403463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753234+0000","last_change":"2024-05-10T11:13:59.112511+0000","last_active":"2024-05-10T11:14:01.753234+0000","last_peered":"2024-05-10T11:14:01.753234+0000","last_clean":"2024-05-10T11:14:01.753234+0000","last_became_active":"2024-05-10T11:13:59.111334+0000","last_became_peered":"2024-05-10T11:13:59.111334+0000","last_unstale":"2024-05-10T11:14:01.753234+0000","last_undegraded":"2024-05-10T11:14:01.753234+0000","last_fullsized":"2024-05-10T11:14:01.753234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:12:33.307214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105549+0000","last_change":"2024-05-10T11:13:59.108117+0000","last_active":"2024-05-10T11:14:00.105549+0000","last_peered":"2024-05-10T11:14:00.105549+0000","last_clean":"2024-05-10T11:14:00.105549+0000","last_became_active":"2024-05-10T11:13:59.107823+0000","last_became_peered":"2024-05-10T11:13:59.107823+0000","last_unstale":"2024-05-10T11:14:00.105549+0000","last_undegraded":"2024-05-10T11:14:00.105549+0000","last_fullsized":"2024-05-10T11:14:00.105549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:53.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092761+0000","last_change":"2024-05-10T11:13:59.101712+0000","last_active":"2024-05-10T11:14:01.092761+0000","last_peered":"2024-05-10T11:14:01.092761+0000","last_clean":"2024-05-10T11:14:01.092761+0000","last_became_active":"2024-05-10T11:13:59.101392+0000","last_became_peered":"2024-05-10T11:13:59.101392+0000","last_unstale":"2024-05-10T11:14:01.092761+0000","last_undegraded":"2024-05-10T11:14:01.092761+0000","last_fullsized":"2024-05-10T11:14:01.092761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:27.980151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086453+0000","last_change":"2024-05-10T11:13:58.086453+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086453+0000","last_undegraded":"2024-05-10T11:13:58.086453+0000","last_fullsized":"2024-05-10T11:13:58.086453+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105170+0000","last_change":"2024-05-10T11:13:59.105113+0000","last_active":"2024-05-10T11:14:00.105170+0000","last_peered":"2024-05-10T11:14:00.105170+0000","last_clean":"2024-05-10T11:14:00.105170+0000","last_became_active":"2024-05-10T11:13:59.104839+0000","last_became_peered":"2024-05-10T11:13:59.104839+0000","last_unstale":"2024-05-10T11:14:00.105170+0000","last_undegraded":"2024-05-10T11:14:00.105170+0000","last_fullsized":"2024-05-10T11:14:00.105170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:17.038077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093234+0000","last_change":"2024-05-10T11:13:59.104711+0000","last_active":"2024-05-10T11:14:01.093234+0000","last_peered":"2024-05-10T11:14:01.093234+0000","last_clean":"2024-05-10T11:14:01.093234+0000","last_became_active":"2024-05-10T11:13:59.104165+0000","last_became_peered":"2024-05-10T11:13:59.104165+0000","last_unstale":"2024-05-10T11:14:01.093234+0000","last_undegraded":"2024-05-10T11:14:01.093234+0000","last_fullsized":"2024-05-10T11:14:01.093234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:08.120414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086266+0000","last_change":"2024-05-10T11:13:58.086266+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086266+0000","last_undegraded":"2024-05-10T11:13:58.086266+0000","last_fullsized":"2024-05-10T11:13:58.086266+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092822+0000","last_change":"2024-05-10T11:13:59.098424+0000","last_active":"2024-05-10T11:14:01.092822+0000","last_peered":"2024-05-10T11:14:01.092822+0000","last_clean":"2024-05-10T11:14:01.092822+0000","last_became_active":"2024-05-10T11:13:59.098148+0000","last_became_peered":"2024-05-10T11:13:59.098148+0000","last_unstale":"2024-05-10T11:14:01.092822+0000","last_undegraded":"2024-05-10T11:14:01.092822+0000","last_fullsized":"2024-05-10T11:14:01.092822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:54.088353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093694+0000","last_change":"2024-05-10T11:13:58.093694+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093694+0000","last_undegraded":"2024-05-10T11:13:58.093694+0000","last_fullsized":"2024-05-10T11:13:58.093694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091100+0000","last_change":"2024-05-10T11:13:58.091100+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091100+0000","last_undegraded":"2024-05-10T11:13:58.091100+0000","last_fullsized":"2024-05-10T11:13:58.091100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752888+0000","last_change":"2024-05-10T11:13:59.111979+0000","last_active":"2024-05-10T11:14:01.752888+0000","last_peered":"2024-05-10T11:14:01.752888+0000","last_clean":"2024-05-10T11:14:01.752888+0000","last_became_active":"2024-05-10T11:13:59.111660+0000","last_became_peered":"2024-05-10T11:13:59.111660+0000","last_unstale":"2024-05-10T11:14:01.752888+0000","last_undegraded":"2024-05-10T11:14:01.752888+0000","last_fullsized":"2024-05-10T11:14:01.752888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:25.490896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106555+0000","last_change":"2024-05-10T11:13:59.108589+0000","last_active":"2024-05-10T11:14:00.106555+0000","last_peered":"2024-05-10T11:14:00.106555+0000","last_clean":"2024-05-10T11:14:00.106555+0000","last_became_active":"2024-05-10T11:13:59.107803+0000","last_became_peered":"2024-05-10T11:13:59.107803+0000","last_unstale":"2024-05-10T11:14:00.106555+0000","last_undegraded":"2024-05-10T11:14:00.106555+0000","last_fullsized":"2024-05-10T11:14:00.106555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:20.477990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092426+0000","last_change":"2024-05-10T11:13:59.103151+0000","last_active":"2024-05-10T11:14:01.092426+0000","last_peered":"2024-05-10T11:14:01.092426+0000","last_clean":"2024-05-10T11:14:01.092426+0000","last_became_active":"2024-05-10T11:13:59.102660+0000","last_became_peered":"2024-05-10T11:13:59.102660+0000","last_unstale":"2024-05-10T11:14:01.092426+0000","last_undegraded":"2024-05-10T11:14:01.092426+0000","last_fullsized":"2024-05-10T11:14:01.092426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:29.283615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093329+0000","last_change":"2024-05-10T11:13:59.111970+0000","last_active":"2024-05-10T11:14:01.093329+0000","last_peered":"2024-05-10T11:14:01.093329+0000","last_clean":"2024-05-10T11:14:01.093329+0000","last_became_active":"2024-05-10T11:13:59.111705+0000","last_became_peered":"2024-05-10T11:13:59.111705+0000","last_unstale":"2024-05-10T11:14:01.093329+0000","last_undegraded":"2024-05-10T11:14:01.093329+0000","last_fullsized":"2024-05-10T11:14:01.093329+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:01.471427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753136+0000","last_change":"2024-05-10T11:13:59.099016+0000","last_active":"2024-05-10T11:14:01.753136+0000","last_peered":"2024-05-10T11:14:01.753136+0000","last_clean":"2024-05-10T11:14:01.753136+0000","last_became_active":"2024-05-10T11:13:59.098758+0000","last_became_peered":"2024-05-10T11:13:59.098758+0000","last_unstale":"2024-05-10T11:14:01.753136+0000","last_undegraded":"2024-05-10T11:14:01.753136+0000","last_fullsized":"2024-05-10T11:14:01.753136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:49.161270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105821+0000","last_change":"2024-05-10T11:13:59.115611+0000","last_active":"2024-05-10T11:14:00.105821+0000","last_peered":"2024-05-10T11:14:00.105821+0000","last_clean":"2024-05-10T11:14:00.105821+0000","last_became_active":"2024-05-10T11:13:59.115320+0000","last_became_peered":"2024-05-10T11:13:59.115320+0000","last_unstale":"2024-05-10T11:14:00.105821+0000","last_undegraded":"2024-05-10T11:14:00.105821+0000","last_fullsized":"2024-05-10T11:14:00.105821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:37.989192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093237+0000","last_change":"2024-05-10T11:13:58.093237+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093237+0000","last_undegraded":"2024-05-10T11:13:58.093237+0000","last_fullsized":"2024-05-10T11:13:58.093237+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092693+0000","last_change":"2024-05-10T11:13:59.104155+0000","last_active":"2024-05-10T11:14:01.092693+0000","last_peered":"2024-05-10T11:14:01.092693+0000","last_clean":"2024-05-10T11:14:01.092693+0000","last_became_active":"2024-05-10T11:13:59.103871+0000","last_became_peered":"2024-05-10T11:13:59.103871+0000","last_unstale":"2024-05-10T11:14:01.092693+0000","last_undegraded":"2024-05-10T11:14:01.092693+0000","last_fullsized":"2024-05-10T11:14:01.092693+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:48.864661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086302+0000","last_change":"2024-05-10T11:13:58.086302+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086302+0000","last_undegraded":"2024-05-10T11:13:58.086302+0000","last_fullsized":"2024-05-10T11:13:58.086302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092784+0000","last_change":"2024-05-10T11:13:59.105522+0000","last_active":"2024-05-10T11:14:01.092784+0000","last_peered":"2024-05-10T11:14:01.092784+0000","last_clean":"2024-05-10T11:14:01.092784+0000","last_became_active":"2024-05-10T11:13:59.103573+0000","last_became_peered":"2024-05-10T11:13:59.103573+0000","last_unstale":"2024-05-10T11:14:01.092784+0000","last_undegraded":"2024-05-10T11:14:01.092784+0000","last_fullsized":"2024-05-10T11:14:01.092784+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:29.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628880+0000","last_change":"2024-05-10T11:13:59.113306+0000","last_active":"2024-05-10T11:14:01.628880+0000","last_peered":"2024-05-10T11:14:01.628880+0000","last_clean":"2024-05-10T11:14:01.628880+0000","last_became_active":"2024-05-10T11:13:59.112891+0000","last_became_peered":"2024-05-10T11:13:59.112891+0000","last_unstale":"2024-05-10T11:14:01.628880+0000","last_undegraded":"2024-05-10T11:14:01.628880+0000","last_fullsized":"2024-05-10T11:14:01.628880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086586+0000","last_change":"2024-05-10T11:13:58.086586+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086586+0000","last_undegraded":"2024-05-10T11:13:58.086586+0000","last_fullsized":"2024-05-10T11:13:58.086586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098266+0000","last_change":"2024-05-10T11:13:58.096652+0000","last_active":"2024-05-10T11:13:58.098266+0000","last_peered":"2024-05-10T11:13:58.098266+0000","last_clean":"2024-05-10T11:13:58.098266+0000","last_became_active":"2024-05-10T11:13:58.096366+0000","last_became_peered":"2024-05-10T11:13:58.096366+0000","last_unstale":"2024-05-10T11:13:58.098266+0000","last_undegraded":"2024-05-10T11:13:58.098266+0000","last_fullsized":"2024-05-10T11:13:58.098266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:09.362328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.629059+0000","last_change":"2024-05-10T11:13:59.104836+0000","last_active":"2024-05-10T11:14:01.629059+0000","last_peered":"2024-05-10T11:14:01.629059+0000","last_clean":"2024-05-10T11:14:01.629059+0000","last_became_active":"2024-05-10T11:13:59.104557+0000","last_became_peered":"2024-05-10T11:13:59.104557+0000","last_unstale":"2024-05-10T11:14:01.629059+0000","last_undegraded":"2024-05-10T11:14:01.629059+0000","last_fullsized":"2024-05-10T11:14:01.629059+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:27.980151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105581+0000","last_change":"2024-05-10T11:13:58.108775+0000","last_active":"2024-05-10T11:14:00.105581+0000","last_peered":"2024-05-10T11:14:00.105581+0000","last_clean":"2024-05-10T11:14:00.105581+0000","last_became_active":"2024-05-10T11:13:58.108468+0000","last_became_peered":"2024-05-10T11:13:58.108468+0000","last_unstale":"2024-05-10T11:14:00.105581+0000","last_undegraded":"2024-05-10T11:14:00.105581+0000","last_fullsized":"2024-05-10T11:14:00.105581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:50.052578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092969+0000","last_change":"2024-05-10T11:13:58.092969+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092969+0000","last_undegraded":"2024-05-10T11:13:58.092969+0000","last_fullsized":"2024-05-10T11:13:58.092969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105837+0000","last_change":"2024-05-10T11:13:58.098703+0000","last_active":"2024-05-10T11:14:00.105837+0000","last_peered":"2024-05-10T11:14:00.105837+0000","last_clean":"2024-05-10T11:14:00.105837+0000","last_became_active":"2024-05-10T11:13:58.098374+0000","last_became_peered":"2024-05-10T11:13:58.098374+0000","last_unstale":"2024-05-10T11:14:00.105837+0000","last_undegraded":"2024-05-10T11:14:00.105837+0000","last_fullsized":"2024-05-10T11:14:00.105837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:15.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753261+0000","last_change":"2024-05-10T11:13:59.096735+0000","last_active":"2024-05-10T11:14:01.753261+0000","last_peered":"2024-05-10T11:14:01.753261+0000","last_clean":"2024-05-10T11:14:01.753261+0000","last_became_active":"2024-05-10T11:13:59.096493+0000","last_became_peered":"2024-05-10T11:13:59.096493+0000","last_unstale":"2024-05-10T11:14:01.753261+0000","last_undegraded":"2024-05-10T11:14:01.753261+0000","last_fullsized":"2024-05-10T11:14:01.753261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:00.643704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.629014+0000","last_change":"2024-05-10T11:13:58.107382+0000","last_active":"2024-05-10T11:14:01.629014+0000","last_peered":"2024-05-10T11:14:01.629014+0000","last_clean":"2024-05-10T11:14:01.629014+0000","last_became_active":"2024-05-10T11:13:58.107139+0000","last_became_peered":"2024-05-10T11:13:58.107139+0000","last_unstale":"2024-05-10T11:14:01.629014+0000","last_undegraded":"2024-05-10T11:14:01.629014+0000","last_fullsized":"2024-05-10T11:14:01.629014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:52.409007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091795+0000","last_change":"2024-05-10T11:13:58.091795+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091795+0000","last_undegraded":"2024-05-10T11:13:58.091795+0000","last_fullsized":"2024-05-10T11:13:58.091795+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092699+0000","last_change":"2024-05-10T11:13:58.106550+0000","last_active":"2024-05-10T11:14:01.092699+0000","last_peered":"2024-05-10T11:14:01.092699+0000","last_clean":"2024-05-10T11:14:01.092699+0000","last_became_active":"2024-05-10T11:13:58.106238+0000","last_became_peered":"2024-05-10T11:13:58.106238+0000","last_unstale":"2024-05-10T11:14:01.092699+0000","last_undegraded":"2024-05-10T11:14:01.092699+0000","last_fullsized":"2024-05-10T11:14:01.092699+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:16.035725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086342+0000","last_change":"2024-05-10T11:13:58.086342+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086342+0000","last_undegraded":"2024-05-10T11:13:58.086342+0000","last_fullsized":"2024-05-10T11:13:58.086342+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100981+0000","last_change":"2024-05-10T11:13:58.098405+0000","last_active":"2024-05-10T11:13:58.100981+0000","last_peered":"2024-05-10T11:13:58.100981+0000","last_clean":"2024-05-10T11:13:58.100981+0000","last_became_active":"2024-05-10T11:13:58.098115+0000","last_became_peered":"2024-05-10T11:13:58.098115+0000","last_unstale":"2024-05-10T11:13:58.100981+0000","last_undegraded":"2024-05-10T11:13:58.100981+0000","last_fullsized":"2024-05-10T11:13:58.100981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:17.632714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753282+0000","last_change":"2024-05-10T11:13:59.115658+0000","last_active":"2024-05-10T11:14:01.753282+0000","last_peered":"2024-05-10T11:14:01.753282+0000","last_clean":"2024-05-10T11:14:01.753282+0000","last_became_active":"2024-05-10T11:13:59.115392+0000","last_became_peered":"2024-05-10T11:13:59.115392+0000","last_unstale":"2024-05-10T11:14:01.753282+0000","last_undegraded":"2024-05-10T11:14:01.753282+0000","last_fullsized":"2024-05-10T11:14:01.753282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:56.803833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098757+0000","last_change":"2024-05-10T11:13:58.097819+0000","last_active":"2024-05-10T11:13:58.098757+0000","last_peered":"2024-05-10T11:13:58.098757+0000","last_clean":"2024-05-10T11:13:58.098757+0000","last_became_active":"2024-05-10T11:13:58.097490+0000","last_became_peered":"2024-05-10T11:13:58.097490+0000","last_unstale":"2024-05-10T11:13:58.098757+0000","last_undegraded":"2024-05-10T11:13:58.098757+0000","last_fullsized":"2024-05-10T11:13:58.098757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:42.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086281+0000","last_change":"2024-05-10T11:13:58.086281+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086281+0000","last_undegraded":"2024-05-10T11:13:58.086281+0000","last_fullsized":"2024-05-10T11:13:58.086281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092310+0000","last_change":"2024-05-10T11:13:58.100789+0000","last_active":"2024-05-10T11:14:01.092310+0000","last_peered":"2024-05-10T11:14:01.092310+0000","last_clean":"2024-05-10T11:14:01.092310+0000","last_became_active":"2024-05-10T11:13:58.100512+0000","last_became_peered":"2024-05-10T11:13:58.100512+0000","last_unstale":"2024-05-10T11:14:01.092310+0000","last_undegraded":"2024-05-10T11:14:01.092310+0000","last_fullsized":"2024-05-10T11:14:01.092310+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:25.264746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090158+0000","last_change":"2024-05-10T11:13:58.090158+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090158+0000","last_undegraded":"2024-05-10T11:13:58.090158+0000","last_fullsized":"2024-05-10T11:13:58.090158+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102466+0000","last_change":"2024-05-10T11:13:58.098731+0000","last_active":"2024-05-10T11:13:58.102466+0000","last_peered":"2024-05-10T11:13:58.102466+0000","last_clean":"2024-05-10T11:13:58.102466+0000","last_became_active":"2024-05-10T11:13:58.098187+0000","last_became_peered":"2024-05-10T11:13:58.098187+0000","last_unstale":"2024-05-10T11:13:58.102466+0000","last_undegraded":"2024-05-10T11:13:58.102466+0000","last_fullsized":"2024-05-10T11:13:58.102466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:19.909231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628867+0000","last_change":"2024-05-10T11:13:59.104673+0000","last_active":"2024-05-10T11:14:01.628867+0000","last_peered":"2024-05-10T11:14:01.628867+0000","last_clean":"2024-05-10T11:14:01.628867+0000","last_became_active":"2024-05-10T11:13:59.104092+0000","last_became_peered":"2024-05-10T11:13:59.104092+0000","last_unstale":"2024-05-10T11:14:01.628867+0000","last_undegraded":"2024-05-10T11:14:01.628867+0000","last_fullsized":"2024-05-10T11:14:01.628867+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:30.339111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098452+0000","last_change":"2024-05-10T11:13:58.097328+0000","last_active":"2024-05-10T11:13:58.098452+0000","last_peered":"2024-05-10T11:13:58.098452+0000","last_clean":"2024-05-10T11:13:58.098452+0000","last_became_active":"2024-05-10T11:13:58.097031+0000","last_became_peered":"2024-05-10T11:13:58.097031+0000","last_unstale":"2024-05-10T11:13:58.098452+0000","last_undegraded":"2024-05-10T11:13:58.098452+0000","last_fullsized":"2024-05-10T11:13:58.098452+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:27.401728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093064+0000","last_change":"2024-05-10T11:13:59.103181+0000","last_active":"2024-05-10T11:14:01.093064+0000","last_peered":"2024-05-10T11:14:01.093064+0000","last_clean":"2024-05-10T11:14:01.093064+0000","last_became_active":"2024-05-10T11:13:59.102892+0000","last_became_peered":"2024-05-10T11:13:59.102892+0000","last_unstale":"2024-05-10T11:14:01.093064+0000","last_undegraded":"2024-05-10T11:14:01.093064+0000","last_fullsized":"2024-05-10T11:14:01.093064+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:09.356540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102538+0000","last_change":"2024-05-10T11:13:58.100457+0000","last_active":"2024-05-10T11:13:58.102538+0000","last_peered":"2024-05-10T11:13:58.102538+0000","last_clean":"2024-05-10T11:13:58.102538+0000","last_became_active":"2024-05-10T11:13:58.100133+0000","last_became_peered":"2024-05-10T11:13:58.100133+0000","last_unstale":"2024-05-10T11:13:58.102538+0000","last_undegraded":"2024-05-10T11:13:58.102538+0000","last_fullsized":"2024-05-10T11:13:58.102538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:43.772326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090165+0000","last_change":"2024-05-10T11:13:58.090165+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090165+0000","last_undegraded":"2024-05-10T11:13:58.090165+0000","last_fullsized":"2024-05-10T11:13:58.090165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753188+0000","last_change":"2024-05-10T11:13:58.103129+0000","last_active":"2024-05-10T11:14:01.753188+0000","last_peered":"2024-05-10T11:14:01.753188+0000","last_clean":"2024-05-10T11:14:01.753188+0000","last_became_active":"2024-05-10T11:13:58.102831+0000","last_became_peered":"2024-05-10T11:13:58.102831+0000","last_unstale":"2024-05-10T11:14:01.753188+0000","last_undegraded":"2024-05-10T11:14:01.753188+0000","last_fullsized":"2024-05-10T11:14:01.753188+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:14.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628866+0000","last_change":"2024-05-10T11:13:59.107364+0000","last_active":"2024-05-10T11:14:01.628866+0000","last_peered":"2024-05-10T11:14:01.628866+0000","last_clean":"2024-05-10T11:14:01.628866+0000","last_became_active":"2024-05-10T11:13:59.107094+0000","last_became_peered":"2024-05-10T11:13:59.107094+0000","last_unstale":"2024-05-10T11:14:01.628866+0000","last_undegraded":"2024-05-10T11:14:01.628866+0000","last_fullsized":"2024-05-10T11:14:01.628866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:15.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092820+0000","last_change":"2024-05-10T11:13:58.104807+0000","last_active":"2024-05-10T11:14:01.092820+0000","last_peered":"2024-05-10T11:14:01.092820+0000","last_clean":"2024-05-10T11:14:01.092820+0000","last_became_active":"2024-05-10T11:13:58.104538+0000","last_became_peered":"2024-05-10T11:13:58.104538+0000","last_unstale":"2024-05-10T11:14:01.092820+0000","last_undegraded":"2024-05-10T11:14:01.092820+0000","last_fullsized":"2024-05-10T11:14:01.092820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:20.746955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093122+0000","last_change":"2024-05-10T11:13:59.110605+0000","last_active":"2024-05-10T11:14:01.093122+0000","last_peered":"2024-05-10T11:14:01.093122+0000","last_clean":"2024-05-10T11:14:01.093122+0000","last_became_active":"2024-05-10T11:13:59.110274+0000","last_became_peered":"2024-05-10T11:13:59.110274+0000","last_unstale":"2024-05-10T11:14:01.093122+0000","last_undegraded":"2024-05-10T11:14:01.093122+0000","last_fullsized":"2024-05-10T11:14:01.093122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:49.161270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102410+0000","last_change":"2024-05-10T11:13:58.100301+0000","last_active":"2024-05-10T11:13:58.102410+0000","last_peered":"2024-05-10T11:13:58.102410+0000","last_clean":"2024-05-10T11:13:58.102410+0000","last_became_active":"2024-05-10T11:13:58.100038+0000","last_became_peered":"2024-05-10T11:13:58.100038+0000","last_unstale":"2024-05-10T11:13:58.102410+0000","last_undegraded":"2024-05-10T11:13:58.102410+0000","last_fullsized":"2024-05-10T11:13:58.102410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:02.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753171+0000","last_change":"2024-05-10T11:13:59.111998+0000","last_active":"2024-05-10T11:14:01.753171+0000","last_peered":"2024-05-10T11:14:01.753171+0000","last_clean":"2024-05-10T11:14:01.753171+0000","last_became_active":"2024-05-10T11:13:59.111688+0000","last_became_peered":"2024-05-10T11:13:59.111688+0000","last_unstale":"2024-05-10T11:14:01.753171+0000","last_undegraded":"2024-05-10T11:14:01.753171+0000","last_fullsized":"2024-05-10T11:14:01.753171+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:08.120414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100879+0000","last_change":"2024-05-10T11:13:58.098650+0000","last_active":"2024-05-10T11:13:58.100879+0000","last_peered":"2024-05-10T11:13:58.100879+0000","last_clean":"2024-05-10T11:13:58.100879+0000","last_became_active":"2024-05-10T11:13:58.098172+0000","last_became_peered":"2024-05-10T11:13:58.098172+0000","last_unstale":"2024-05-10T11:13:58.100879+0000","last_undegraded":"2024-05-10T11:13:58.100879+0000","last_fullsized":"2024-05-10T11:13:58.100879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:48.647647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093223+0000","last_change":"2024-05-10T11:13:59.106640+0000","last_active":"2024-05-10T11:14:01.093223+0000","last_peered":"2024-05-10T11:14:01.093223+0000","last_clean":"2024-05-10T11:14:01.093223+0000","last_became_active":"2024-05-10T11:13:59.106381+0000","last_became_peered":"2024-05-10T11:13:59.106381+0000","last_unstale":"2024-05-10T11:14:01.093223+0000","last_undegraded":"2024-05-10T11:14:01.093223+0000","last_fullsized":"2024-05-10T11:14:01.093223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:40.838654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753068+0000","last_change":"2024-05-10T11:13:58.104546+0000","last_active":"2024-05-10T11:14:01.753068+0000","last_peered":"2024-05-10T11:14:01.753068+0000","last_clean":"2024-05-10T11:14:01.753068+0000","last_became_active":"2024-05-10T11:13:58.104248+0000","last_became_peered":"2024-05-10T11:13:58.104248+0000","last_unstale":"2024-05-10T11:14:01.753068+0000","last_undegraded":"2024-05-10T11:14:01.753068+0000","last_fullsized":"2024-05-10T11:14:01.753068+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:00.411668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753130+0000","last_change":"2024-05-10T11:13:59.100823+0000","last_active":"2024-05-10T11:14:01.753130+0000","last_peered":"2024-05-10T11:14:01.753130+0000","last_clean":"2024-05-10T11:14:01.753130+0000","last_became_active":"2024-05-10T11:13:59.100521+0000","last_became_peered":"2024-05-10T11:13:59.100521+0000","last_unstale":"2024-05-10T11:14:01.753130+0000","last_undegraded":"2024-05-10T11:14:01.753130+0000","last_fullsized":"2024-05-10T11:14:01.753130+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:52.850375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093284+0000","last_change":"2024-05-10T11:13:58.096733+0000","last_active":"2024-05-10T11:14:01.093284+0000","last_peered":"2024-05-10T11:14:01.093284+0000","last_clean":"2024-05-10T11:14:01.093284+0000","last_became_active":"2024-05-10T11:13:58.094522+0000","last_became_peered":"2024-05-10T11:13:58.094522+0000","last_unstale":"2024-05-10T11:14:01.093284+0000","last_undegraded":"2024-05-10T11:14:01.093284+0000","last_fullsized":"2024-05-10T11:14:01.093284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:49.545141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105288+0000","last_change":"2024-05-10T11:13:59.116492+0000","last_active":"2024-05-10T11:14:00.105288+0000","last_peered":"2024-05-10T11:14:00.105288+0000","last_clean":"2024-05-10T11:14:00.105288+0000","last_became_active":"2024-05-10T11:13:59.116207+0000","last_became_peered":"2024-05-10T11:13:59.116207+0000","last_unstale":"2024-05-10T11:14:00.105288+0000","last_undegraded":"2024-05-10T11:14:00.105288+0000","last_fullsized":"2024-05-10T11:14:00.105288+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:06.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106744+0000","last_change":"2024-05-10T11:13:58.098164+0000","last_active":"2024-05-10T11:14:00.106744+0000","last_peered":"2024-05-10T11:14:00.106744+0000","last_clean":"2024-05-10T11:14:00.106744+0000","last_became_active":"2024-05-10T11:13:58.097916+0000","last_became_peered":"2024-05-10T11:13:58.097916+0000","last_unstale":"2024-05-10T11:14:00.106744+0000","last_undegraded":"2024-05-10T11:14:00.106744+0000","last_fullsized":"2024-05-10T11:14:00.106744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:40.971274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091815+0000","last_change":"2024-05-10T11:13:58.091815+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091815+0000","last_undegraded":"2024-05-10T11:13:58.091815+0000","last_fullsized":"2024-05-10T11:13:58.091815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105138+0000","last_change":"2024-05-10T11:13:58.101899+0000","last_active":"2024-05-10T11:13:58.105138+0000","last_peered":"2024-05-10T11:13:58.105138+0000","last_clean":"2024-05-10T11:13:58.105138+0000","last_became_active":"2024-05-10T11:13:58.101701+0000","last_became_peered":"2024-05-10T11:13:58.101701+0000","last_unstale":"2024-05-10T11:13:58.105138+0000","last_undegraded":"2024-05-10T11:13:58.105138+0000","last_fullsized":"2024-05-10T11:13:58.105138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:15:08.136167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105638+0000","last_change":"2024-05-10T11:13:59.107449+0000","last_active":"2024-05-10T11:14:00.105638+0000","last_peered":"2024-05-10T11:14:00.105638+0000","last_clean":"2024-05-10T11:14:00.105638+0000","last_became_active":"2024-05-10T11:13:59.106820+0000","last_became_peered":"2024-05-10T11:13:59.106820+0000","last_unstale":"2024-05-10T11:14:00.105638+0000","last_undegraded":"2024-05-10T11:14:00.105638+0000","last_fullsized":"2024-05-10T11:14:00.105638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:28.570313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.109666+0000","last_change":"2024-05-10T11:13:58.108564+0000","last_active":"2024-05-10T11:13:58.109666+0000","last_peered":"2024-05-10T11:13:58.109666+0000","last_clean":"2024-05-10T11:13:58.109666+0000","last_became_active":"2024-05-10T11:13:58.108327+0000","last_became_peered":"2024-05-10T11:13:58.108327+0000","last_unstale":"2024-05-10T11:13:58.109666+0000","last_undegraded":"2024-05-10T11:13:58.109666+0000","last_fullsized":"2024-05-10T11:13:58.109666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:16.753692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628908+0000","last_change":"2024-05-10T11:13:59.097564+0000","last_active":"2024-05-10T11:14:01.628908+0000","last_peered":"2024-05-10T11:14:01.628908+0000","last_clean":"2024-05-10T11:14:01.628908+0000","last_became_active":"2024-05-10T11:13:59.097201+0000","last_became_peered":"2024-05-10T11:13:59.097201+0000","last_unstale":"2024-05-10T11:14:01.628908+0000","last_undegraded":"2024-05-10T11:14:01.628908+0000","last_fullsized":"2024-05-10T11:14:01.628908+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:29.283615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105605+0000","last_change":"2024-05-10T11:13:58.099890+0000","last_active":"2024-05-10T11:14:00.105605+0000","last_peered":"2024-05-10T11:14:00.105605+0000","last_clean":"2024-05-10T11:14:00.105605+0000","last_became_active":"2024-05-10T11:13:58.099642+0000","last_became_peered":"2024-05-10T11:13:58.099642+0000","last_unstale":"2024-05-10T11:14:00.105605+0000","last_undegraded":"2024-05-10T11:14:00.105605+0000","last_fullsized":"2024-05-10T11:14:00.105605+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:24.898322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092920+0000","last_change":"2024-05-10T11:13:58.092920+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092920+0000","last_undegraded":"2024-05-10T11:13:58.092920+0000","last_fullsized":"2024-05-10T11:13:58.092920+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752729+0000","last_change":"2024-05-10T11:13:58.104514+0000","last_active":"2024-05-10T11:14:01.752729+0000","last_peered":"2024-05-10T11:14:01.752729+0000","last_clean":"2024-05-10T11:14:01.752729+0000","last_became_active":"2024-05-10T11:13:58.104215+0000","last_became_peered":"2024-05-10T11:13:58.104215+0000","last_unstale":"2024-05-10T11:14:01.752729+0000","last_undegraded":"2024-05-10T11:14:01.752729+0000","last_fullsized":"2024-05-10T11:14:01.752729+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:20.840800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093135+0000","last_change":"2024-05-10T11:13:59.106152+0000","last_active":"2024-05-10T11:14:01.093135+0000","last_peered":"2024-05-10T11:14:01.093135+0000","last_clean":"2024-05-10T11:14:01.093135+0000","last_became_active":"2024-05-10T11:13:59.105900+0000","last_became_peered":"2024-05-10T11:13:59.105900+0000","last_unstale":"2024-05-10T11:14:01.093135+0000","last_undegraded":"2024-05-10T11:14:01.093135+0000","last_fullsized":"2024-05-10T11:14:01.093135+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:52.850375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092579+0000","last_change":"2024-05-10T11:13:58.104683+0000","last_active":"2024-05-10T11:14:01.092579+0000","last_peered":"2024-05-10T11:14:01.092579+0000","last_clean":"2024-05-10T11:14:01.092579+0000","last_became_active":"2024-05-10T11:13:58.104419+0000","last_became_peered":"2024-05-10T11:13:58.104419+0000","last_unstale":"2024-05-10T11:14:01.092579+0000","last_undegraded":"2024-05-10T11:14:01.092579+0000","last_fullsized":"2024-05-10T11:14:01.092579+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:20.844144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105828+0000","last_change":"2024-05-10T11:13:59.117498+0000","last_active":"2024-05-10T11:14:00.105828+0000","last_peered":"2024-05-10T11:14:00.105828+0000","last_clean":"2024-05-10T11:14:00.105828+0000","last_became_active":"2024-05-10T11:13:59.117219+0000","last_became_peered":"2024-05-10T11:13:59.117219+0000","last_unstale":"2024-05-10T11:14:00.105828+0000","last_undegraded":"2024-05-10T11:14:00.105828+0000","last_fullsized":"2024-05-10T11:14:00.105828+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:21.843152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106420+0000","last_change":"2024-05-10T11:13:58.099732+0000","last_active":"2024-05-10T11:14:00.106420+0000","last_peered":"2024-05-10T11:14:00.106420+0000","last_clean":"2024-05-10T11:14:00.106420+0000","last_became_active":"2024-05-10T11:13:58.099477+0000","last_became_peered":"2024-05-10T11:13:58.099477+0000","last_unstale":"2024-05-10T11:14:00.106420+0000","last_undegraded":"2024-05-10T11:14:00.106420+0000","last_fullsized":"2024-05-10T11:14:00.106420+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:42.680206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628907+0000","last_change":"2024-05-10T11:13:59.113538+0000","last_active":"2024-05-10T11:14:01.628907+0000","last_peered":"2024-05-10T11:14:01.628907+0000","last_clean":"2024-05-10T11:14:01.628907+0000","last_became_active":"2024-05-10T11:13:59.113273+0000","last_became_peered":"2024-05-10T11:13:59.113273+0000","last_unstale":"2024-05-10T11:14:01.628907+0000","last_undegraded":"2024-05-10T11:14:01.628907+0000","last_fullsized":"2024-05-10T11:14:01.628907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:08.244589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105119+0000","last_change":"2024-05-10T11:13:58.101299+0000","last_active":"2024-05-10T11:13:58.105119+0000","last_peered":"2024-05-10T11:13:58.105119+0000","last_clean":"2024-05-10T11:13:58.105119+0000","last_became_active":"2024-05-10T11:13:58.101054+0000","last_became_peered":"2024-05-10T11:13:58.101054+0000","last_unstale":"2024-05-10T11:13:58.105119+0000","last_undegraded":"2024-05-10T11:13:58.105119+0000","last_fullsized":"2024-05-10T11:13:58.105119+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:05.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105509+0000","last_change":"2024-05-10T11:13:59.108481+0000","last_active":"2024-05-10T11:14:00.105509+0000","last_peered":"2024-05-10T11:14:00.105509+0000","last_clean":"2024-05-10T11:14:00.105509+0000","last_became_active":"2024-05-10T11:13:59.107666+0000","last_became_peered":"2024-05-10T11:13:59.107666+0000","last_unstale":"2024-05-10T11:14:00.105509+0000","last_undegraded":"2024-05-10T11:14:00.105509+0000","last_fullsized":"2024-05-10T11:14:00.105509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:50.547493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100937+0000","last_change":"2024-05-10T11:13:58.098786+0000","last_active":"2024-05-10T11:13:58.100937+0000","last_peered":"2024-05-10T11:13:58.100937+0000","last_clean":"2024-05-10T11:13:58.100937+0000","last_became_active":"2024-05-10T11:13:58.098493+0000","last_became_peered":"2024-05-10T11:13:58.098493+0000","last_unstale":"2024-05-10T11:13:58.100937+0000","last_undegraded":"2024-05-10T11:13:58.100937+0000","last_fullsized":"2024-05-10T11:13:58.100937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:41.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752916+0000","last_change":"2024-05-10T11:13:59.094660+0000","last_active":"2024-05-10T11:14:01.752916+0000","last_peered":"2024-05-10T11:14:01.752916+0000","last_clean":"2024-05-10T11:14:01.752916+0000","last_became_active":"2024-05-10T11:13:59.094387+0000","last_became_peered":"2024-05-10T11:13:59.094387+0000","last_unstale":"2024-05-10T11:14:01.752916+0000","last_undegraded":"2024-05-10T11:14:01.752916+0000","last_fullsized":"2024-05-10T11:14:01.752916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:24.662230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092780+0000","last_change":"2024-05-10T11:13:58.099005+0000","last_active":"2024-05-10T11:14:01.092780+0000","last_peered":"2024-05-10T11:14:01.092780+0000","last_clean":"2024-05-10T11:14:01.092780+0000","last_became_active":"2024-05-10T11:13:58.098706+0000","last_became_peered":"2024-05-10T11:13:58.098706+0000","last_unstale":"2024-05-10T11:14:01.092780+0000","last_undegraded":"2024-05-10T11:14:01.092780+0000","last_fullsized":"2024-05-10T11:14:01.092780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:28.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092864+0000","last_change":"2024-05-10T11:13:59.117376+0000","last_active":"2024-05-10T11:14:01.092864+0000","last_peered":"2024-05-10T11:14:01.092864+0000","last_clean":"2024-05-10T11:14:01.092864+0000","last_became_active":"2024-05-10T11:13:59.117021+0000","last_became_peered":"2024-05-10T11:13:59.117021+0000","last_unstale":"2024-05-10T11:14:01.092864+0000","last_undegraded":"2024-05-10T11:14:01.092864+0000","last_fullsized":"2024-05-10T11:14:01.092864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:45.588977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752969+0000","last_change":"2024-05-10T11:13:58.104838+0000","last_active":"2024-05-10T11:14:01.752969+0000","last_peered":"2024-05-10T11:14:01.752969+0000","last_clean":"2024-05-10T11:14:01.752969+0000","last_became_active":"2024-05-10T11:13:58.104561+0000","last_became_peered":"2024-05-10T11:13:58.104561+0000","last_unstale":"2024-05-10T11:14:01.752969+0000","last_undegraded":"2024-05-10T11:14:01.752969+0000","last_fullsized":"2024-05-10T11:14:01.752969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:03.246429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628929+0000","last_change":"2024-05-10T11:13:59.102183+0000","last_active":"2024-05-10T11:14:01.628929+0000","last_peered":"2024-05-10T11:14:01.628929+0000","last_clean":"2024-05-10T11:14:01.628929+0000","last_became_active":"2024-05-10T11:13:59.101909+0000","last_became_peered":"2024-05-10T11:13:59.101909+0000","last_unstale":"2024-05-10T11:14:01.628929+0000","last_undegraded":"2024-05-10T11:14:01.628929+0000","last_fullsized":"2024-05-10T11:14:01.628929+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:48.864661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752866+0000","last_change":"2024-05-10T11:13:58.103130+0000","last_active":"2024-05-10T11:14:01.752866+0000","last_peered":"2024-05-10T11:14:01.752866+0000","last_clean":"2024-05-10T11:14:01.752866+0000","last_became_active":"2024-05-10T11:13:58.102847+0000","last_became_peered":"2024-05-10T11:13:58.102847+0000","last_unstale":"2024-05-10T11:14:01.752866+0000","last_undegraded":"2024-05-10T11:14:01.752866+0000","last_fullsized":"2024-05-10T11:14:01.752866+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:25.311350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092935+0000","last_change":"2024-05-10T11:13:59.102043+0000","last_active":"2024-05-10T11:14:01.092935+0000","last_peered":"2024-05-10T11:14:01.092935+0000","last_clean":"2024-05-10T11:14:01.092935+0000","last_became_active":"2024-05-10T11:13:59.101792+0000","last_became_peered":"2024-05-10T11:13:59.101792+0000","last_unstale":"2024-05-10T11:14:01.092935+0000","last_undegraded":"2024-05-10T11:14:01.092935+0000","last_fullsized":"2024-05-10T11:14:01.092935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:25.490896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100846+0000","last_change":"2024-05-10T11:13:58.099189+0000","last_active":"2024-05-10T11:13:58.100846+0000","last_peered":"2024-05-10T11:13:58.100846+0000","last_clean":"2024-05-10T11:13:58.100846+0000","last_became_active":"2024-05-10T11:13:58.098921+0000","last_became_peered":"2024-05-10T11:13:58.098921+0000","last_unstale":"2024-05-10T11:13:58.100846+0000","last_undegraded":"2024-05-10T11:13:58.100846+0000","last_fullsized":"2024-05-10T11:13:58.100846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:12.255023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753202+0000","last_change":"2024-05-10T11:13:59.110257+0000","last_active":"2024-05-10T11:14:01.753202+0000","last_peered":"2024-05-10T11:14:01.753202+0000","last_clean":"2024-05-10T11:14:01.753202+0000","last_became_active":"2024-05-10T11:13:59.109985+0000","last_became_peered":"2024-05-10T11:13:59.109985+0000","last_unstale":"2024-05-10T11:14:01.753202+0000","last_undegraded":"2024-05-10T11:14:01.753202+0000","last_fullsized":"2024-05-10T11:14:01.753202+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:01.471427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628998+0000","last_change":"2024-05-10T11:13:58.099908+0000","last_active":"2024-05-10T11:14:01.628998+0000","last_peered":"2024-05-10T11:14:01.628998+0000","last_clean":"2024-05-10T11:14:01.628998+0000","last_became_active":"2024-05-10T11:13:58.099636+0000","last_became_peered":"2024-05-10T11:13:58.099636+0000","last_unstale":"2024-05-10T11:14:01.628998+0000","last_undegraded":"2024-05-10T11:14:01.628998+0000","last_fullsized":"2024-05-10T11:14:01.628998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:27.567961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093068+0000","last_change":"2024-05-10T11:13:58.093068+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093068+0000","last_undegraded":"2024-05-10T11:13:58.093068+0000","last_fullsized":"2024-05-10T11:13:58.093068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093151+0000","last_change":"2024-05-10T11:13:58.105492+0000","last_active":"2024-05-10T11:14:01.093151+0000","last_peered":"2024-05-10T11:14:01.093151+0000","last_clean":"2024-05-10T11:14:01.093151+0000","last_became_active":"2024-05-10T11:13:58.105077+0000","last_became_peered":"2024-05-10T11:13:58.105077+0000","last_unstale":"2024-05-10T11:14:01.093151+0000","last_undegraded":"2024-05-10T11:14:01.093151+0000","last_fullsized":"2024-05-10T11:14:01.093151+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:05.697634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":157,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.087640+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:58.087640+0000","last_peered":"2024-05-10T11:13:58.087640+0000","last_clean":"2024-05-10T11:13:58.087640+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:58.087640+0000","last_undegraded":"2024-05-10T11:13:58.087640+0000","last_fullsized":"2024-05-10T11:13:58.087640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":827634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":252759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":252737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":581632,"data_stored":251285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":841549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":244433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.087095+0000', 'last_change': '2024-05-10T11:13:58.087095+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.087095+0000', 'last_undegraded': '2024-05-10T11:13:58.087095+0000', 'last_fullsized': '2024-05-10T11:13:58.087095+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086382+0000', 'last_change': '2024-05-10T11:13:58.086382+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086382+0000', 'last_undegraded': '2024-05-10T11:13:58.086382+0000', 'last_fullsized': '2024-05-10T11:13:58.086382+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.091231+0000', 'last_change': '2024-05-10T11:13:58.091231+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.091231+0000', 'last_undegraded': '2024-05-10T11:13:58.091231+0000', 'last_fullsized': '2024-05-10T11:13:58.091231+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086453+0000', 'last_change': '2024-05-10T11:13:58.086453+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086453+0000', 'last_undegraded': '2024-05-10T11:13:58.086453+0000', 'last_fullsized': '2024-05-10T11:13:58.086453+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.929 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086266+0000', 'last_change': '2024-05-10T11:13:58.086266+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086266+0000', 'last_undegraded': '2024-05-10T11:13:58.086266+0000', 'last_fullsized': '2024-05-10T11:13:58.086266+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.093694+0000', 'last_change': '2024-05-10T11:13:58.093694+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.093694+0000', 'last_undegraded': '2024-05-10T11:13:58.093694+0000', 'last_fullsized': '2024-05-10T11:13:58.093694+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.091100+0000', 'last_change': '2024-05-10T11:13:58.091100+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.091100+0000', 'last_undegraded': '2024-05-10T11:13:58.091100+0000', 'last_fullsized': '2024-05-10T11:13:58.091100+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.093237+0000', 'last_change': '2024-05-10T11:13:58.093237+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.093237+0000', 'last_undegraded': '2024-05-10T11:13:58.093237+0000', 'last_fullsized': '2024-05-10T11:13:58.093237+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086302+0000', 'last_change': '2024-05-10T11:13:58.086302+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086302+0000', 'last_undegraded': '2024-05-10T11:13:58.086302+0000', 'last_fullsized': '2024-05-10T11:13:58.086302+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.930 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086586+0000', 'last_change': '2024-05-10T11:13:58.086586+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086586+0000', 'last_undegraded': '2024-05-10T11:13:58.086586+0000', 'last_fullsized': '2024-05-10T11:13:58.086586+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.092969+0000', 'last_change': '2024-05-10T11:13:58.092969+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.092969+0000', 'last_undegraded': '2024-05-10T11:13:58.092969+0000', 'last_fullsized': '2024-05-10T11:13:58.092969+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.091795+0000', 'last_change': '2024-05-10T11:13:58.091795+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.091795+0000', 'last_undegraded': '2024-05-10T11:13:58.091795+0000', 'last_fullsized': '2024-05-10T11:13:58.091795+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086342+0000', 'last_change': '2024-05-10T11:13:58.086342+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086342+0000', 'last_undegraded': '2024-05-10T11:13:58.086342+0000', 'last_fullsized': '2024-05-10T11:13:58.086342+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.086281+0000', 'last_change': '2024-05-10T11:13:58.086281+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.086281+0000', 'last_undegraded': '2024-05-10T11:13:58.086281+0000', 'last_fullsized': '2024-05-10T11:13:58.086281+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:14:03.931 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.090158+0000', 'last_change': '2024-05-10T11:13:58.090158+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.090158+0000', 'last_undegraded': '2024-05-10T11:13:58.090158+0000', 'last_fullsized': '2024-05-10T11:13:58.090158+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.090165+0000', 'last_change': '2024-05-10T11:13:58.090165+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.090165+0000', 'last_undegraded': '2024-05-10T11:13:58.090165+0000', 'last_fullsized': '2024-05-10T11:13:58.090165+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.091815+0000', 'last_change': '2024-05-10T11:13:58.091815+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.091815+0000', 'last_undegraded': '2024-05-10T11:13:58.091815+0000', 'last_fullsized': '2024-05-10T11:13:58.091815+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.092920+0000', 'last_change': '2024-05-10T11:13:58.092920+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.092920+0000', 'last_undegraded': '2024-05-10T11:13:58.092920+0000', 'last_fullsized': '2024-05-10T11:13:58.092920+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-05-10T11:14:03.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:13:58.093068+0000', 'last_change': '2024-05-10T11:13:58.093068+0000', 'last_active': '2024-05-10T11:13:58.078933+0000', 'last_peered': '2024-05-10T11:13:58.078933+0000', 'last_clean': '2024-05-10T11:13:58.078933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:13:58.093068+0000', 'last_undegraded': '2024-05-10T11:13:58.093068+0000', 'last_fullsized': '2024-05-10T11:13:58.093068+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'last_clean_scrub_stamp': '2024-05-10T11:13:58.078933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:14:03.933 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T11:14:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.067+0000 7ff31ff5f640 1 Processor -- start 2024-05-10T11:14:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.068+0000 7ff31ff5f640 1 -- start start 2024-05-10T11:14:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.068+0000 7ff31ff5f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff31815f4e0 0x7ff31806d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.068+0000 7ff31ff5f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff31815f8c0 0x7ff31806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.068+0000 7ff31ff5f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3180b3540 con 0x7ff31806e450 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.068+0000 7ff31ff5f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff3180b23f0 con 0x7ff31815f4e0 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.068+0000 7ff31ff5f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff3180b4150 con 0x7ff31815f8c0 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff31815f4e0 0x7ff31806d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff31815f4e0 0x7ff31806d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32788/0 (socket says 172.21.15.66:32788) 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 -- 172.21.15.66:0/4277870820 learned_addr learned my addr 172.21.15.66:0/4277870820 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31d4fa640 1 --2- 172.21.15.66:0/4277870820 >> v2:172.21.15.190:3300/0 conn(0x7ff31815f8c0 0x7ff31806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 -- 172.21.15.66:0/4277870820 >> v2:172.21.15.190:3300/0 conn(0x7ff31815f8c0 msgr2=0x7ff31806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 --2- 172.21.15.66:0/4277870820 >> v2:172.21.15.190:3300/0 conn(0x7ff31815f8c0 0x7ff31806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 -- 172.21.15.66:0/4277870820 >> v1:172.21.15.190:6789/0 conn(0x7ff31806e450 legacy=0x7ff3180afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.069+0000 7ff31dcfb640 1 -- 172.21.15.66:0/4277870820 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3180b3820 con 0x7ff31815f4e0 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31dcfb640 1 --2- 172.21.15.66:0/4277870820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f4e0 0x7ff31806d9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff318069930 tx=0x7ff31002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dee3fd4d18a3bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ccf9640 1 -- 172.21.15.66:0/4277870820 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310036070 con 0x7ff31815f4e0 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ccf9640 1 -- 172.21.15.66:0/4277870820 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310031600 con 0x7ff31815f4e0 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ccf9640 1 -- 172.21.15.66:0/4277870820 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3100319d0 con 0x7ff31815f4e0 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 -- 172.21.15.66:0/4277870820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f4e0 msgr2=0x7ff31806d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/4277870820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f4e0 0x7ff31806d9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff318069930 tx=0x7ff31002a660 comp rx=0 tx=0).stop 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 -- 172.21.15.66:0/4277870820 shutdown_connections 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/4277870820 >> v2:172.21.15.190:3300/0 conn(0x7ff31815f8c0 0x7ff31806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/4277870820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f4e0 0x7ff31806d9d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 -- 172.21.15.66:0/4277870820 >> 172.21.15.66:0/4277870820 conn(0x7ff3180d2df0 msgr2=0x7ff3180d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 -- 172.21.15.66:0/4277870820 shutdown_connections 2024-05-10T11:14:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.070+0000 7ff31ff5f640 1 -- 172.21.15.66:0/4277870820 wait complete. 2024-05-10T11:14:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 Processor -- start 2024-05-10T11:14:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 -- start start 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff31806e450 0x7ff31814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff31815f4e0 0x7ff31815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 0x7ff31815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff31806e870 con 0x7ff31815f8c0 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180b3de0 con 0x7ff31806e450 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.072+0000 7ff31ff5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff3180b45e0 con 0x7ff31815f4e0 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 0x7ff31815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 0x7ff31815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32794/0 (socket says 172.21.15.66:32794) 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 -- 172.21.15.66:0/1687970390 learned_addr learned my addr 172.21.15.66:0/1687970390 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31dcfb640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff31806e450 0x7ff31814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31d4fa640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff31815f4e0 0x7ff31815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 -- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff31815f4e0 msgr2=0x7ff31815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff31815f4e0 0x7ff31815fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 -- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff31806e450 msgr2=0x7ff31814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff31806e450 0x7ff31814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 -- 172.21.15.66:0/1687970390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff318160620 con 0x7ff31815f8c0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31dcfb640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff31806e450 0x7ff31814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31e4fc640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 0x7ff31815a870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff30800b410 tx=0x7ff30800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308015030 con 0x7ff31815f8c0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff308004020 con 0x7ff31815f8c0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff318160900 con 0x7ff31815f8c0 2024-05-10T11:14:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308004410 con 0x7ff31815f8c0 2024-05-10T11:14:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.073+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff318160ec0 con 0x7ff31815f8c0 2024-05-10T11:14:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.074+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31806a220 con 0x7ff31815f8c0 2024-05-10T11:14:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.075+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff308018070 con 0x7ff31815f8c0 2024-05-10T11:14:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.075+0000 7ff3167fc640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff3040762d0 0x7ff304078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.075+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7ff308097230 con 0x7ff31815f8c0 2024-05-10T11:14:04.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.076+0000 7ff31dcfb640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff3040762d0 0x7ff304078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.076+0000 7ff31dcfb640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff3040762d0 0x7ff304078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff310033000 tx=0x7ff310009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:04.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.080+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff308060a90 con 0x7ff31815f8c0 2024-05-10T11:14:04.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.349+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff3180713e0 con 0x7ff31815f8c0 2024-05-10T11:14:04.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.350+0000 7ff3167fc640 1 -- 172.21.15.66:0/1687970390 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1518 (secure 0 0 0) 0x7ff308060390 con 0x7ff31815f8c0 2024-05-10T11:14:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:04.350 INFO:teuthology.orchestra.run.smithi066.stdout:{"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":117,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1715339538,"num_in_osds":8,"osd_in_since":1715339529,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"creating+peering","count":19}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592036,"bytes_used":227115008,"bytes_avail":772866998272,"bytes_total":773094113280,"inactive_pgs_ratio":0.19587628543376923,"write_bytes_sec":1877,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5322}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-05-10T11:13:47.702277+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T11:14:04.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff3040762d0 msgr2=0x7ff304078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff3040762d0 0x7ff304078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff310033000 tx=0x7ff310009000 comp rx=0 tx=0).stop 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 msgr2=0x7ff31815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 0x7ff31815a870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff30800b410 tx=0x7ff30800b8d0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 shutdown_connections 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff3040762d0 0x7ff304078790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff31815f8c0 0x7ff31815a870 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff31815f4e0 0x7ff31815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 --2- 172.21.15.66:0/1687970390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff31806e450 0x7ff31814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 >> 172.21.15.66:0/1687970390 conn(0x7ff3180d2df0 msgr2=0x7ff318071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 shutdown_connections 2024-05-10T11:14:04.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.352+0000 7ff31ff5f640 1 -- 172.21.15.66:0/1687970390 wait complete. 2024-05-10T11:14:04.363 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T11:14:04.363 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:14:04.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.466+0000 7f8899f96640 1 Processor -- start 2024-05-10T11:14:04.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.467+0000 7f8899f96640 1 -- start start 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.467+0000 7f8899f96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.467+0000 7f8899f96640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f88940cfbb0 0x7f88940ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.467+0000 7f8899f96640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889415fc90 con 0x7f88940b8860 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.467+0000 7f8899f96640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f889406ec30 con 0x7f88940cfbb0 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.467+0000 7f8899f96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f889406ee50 con 0x7f88940d0230 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f8893fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f88940cfbb0 0x7f88940ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f88937fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f88940b8860 0x7f889406e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34608/0 (socket says 172.21.15.66:34608) 2024-05-10T11:14:04.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f88937fe640 1 -- 172.21.15.66:0/524726204 learned_addr learned my addr 172.21.15.66:0/524726204 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f8892ffd640 1 --2- 172.21.15.66:0/524726204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f8893fff640 1 -- 172.21.15.66:0/524726204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 msgr2=0x7f88940cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f8893fff640 1 --2- 172.21.15.66:0/524726204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f8893fff640 1 -- 172.21.15.66:0/524726204 >> v1:172.21.15.66:6789/0 conn(0x7f88940b8860 legacy=0x7f889406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f88927fc640 1 -- 172.21.15.66:0/524726204 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431751142 0 0) 0x7f889415fc90 con 0x7f88940b8860 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.468+0000 7f8893fff640 1 -- 172.21.15.66:0/524726204 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88940b8c40 con 0x7f88940cfbb0 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8893fff640 1 --2- 172.21.15.66:0/524726204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940ce330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f888c009dc0 tx=0x7f888c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a09effadcae94fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f88927fc640 1 -- 172.21.15.66:0/524726204 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c007740 con 0x7f88940cfbb0 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f88927fc640 1 -- 172.21.15.66:0/524726204 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c0078e0 con 0x7f88940cfbb0 2024-05-10T11:14:04.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f88927fc640 1 -- 172.21.15.66:0/524726204 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c007cb0 con 0x7f88940cfbb0 2024-05-10T11:14:04.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 -- 172.21.15.66:0/524726204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 msgr2=0x7f88940ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 --2- 172.21.15.66:0/524726204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940ce330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f888c009dc0 tx=0x7f888c02a5f0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 -- 172.21.15.66:0/524726204 shutdown_connections 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 --2- 172.21.15.66:0/524726204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940ce330 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 --2- 172.21.15.66:0/524726204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 -- 172.21.15.66:0/524726204 >> 172.21.15.66:0/524726204 conn(0x7f88940d2df0 msgr2=0x7f88940d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 -- 172.21.15.66:0/524726204 shutdown_connections 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.469+0000 7f8899f96640 1 -- 172.21.15.66:0/524726204 wait complete. 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.470+0000 7f8899f96640 1 Processor -- start 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 -- start start 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88940b8860 0x7f88940a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88940cdb30 con 0x7f88940cfbb0 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f88940cd850 con 0x7f88940b8860 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.471+0000 7f8899f96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f88940cde10 con 0x7f88940d0230 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32814/0 (socket says 172.21.15.66:32814) 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 -- 172.21.15.66:0/1464565416 learned_addr learned my addr 172.21.15.66:0/1464565416 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8893fff640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f88937fe640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88940b8860 0x7f88940a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 -- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 msgr2=0x7f88940b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 -- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88940b8860 msgr2=0x7f88940a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88940b8860 0x7f88940a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 -- 172.21.15.66:0/1464565416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941f5450 con 0x7f88940cfbb0 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f88937fe640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88940b8860 0x7f88940a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:04.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8892ffd640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940cb040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f888800d620 tx=0x7f888800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:04.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888800b620 con 0x7f88940cfbb0 2024-05-10T11:14:04.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888019070 con 0x7f88940cfbb0 2024-05-10T11:14:04.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88941f5730 con 0x7f88940cfbb0 2024-05-10T11:14:04.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888800ba00 con 0x7f88940cfbb0 2024-05-10T11:14:04.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.472+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941f5cf0 con 0x7f88940cfbb0 2024-05-10T11:14:04.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.473+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889406a220 con 0x7f88940cfbb0 2024-05-10T11:14:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.474+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f888800bba0 con 0x7f88940cfbb0 2024-05-10T11:14:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.474+0000 7f887bfff640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88800762d0 0x7f8880078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.474+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f8888097b70 con 0x7f88940cfbb0 2024-05-10T11:14:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.474+0000 7f88937fe640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88800762d0 0x7f8880078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.475+0000 7f88937fe640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88800762d0 0x7f8880078790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.479+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8888061340 con 0x7f88940cfbb0 2024-05-10T11:14:04.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.671+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88940d1e20 con 0x7f88800762d0 2024-05-10T11:14:04.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.678+0000 7f887bfff640 1 -- 172.21.15.66:0/1464565416 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250365 (secure 0 0 0) 0x7f88940d1e20 con 0x7f88800762d0 2024-05-10T11:14:04.681 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:04.682 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88800762d0 msgr2=0x7f8880078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88800762d0 0x7f8880078790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884009040 comp rx=0 tx=0).stop 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 msgr2=0x7f88940cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940cb040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f888800d620 tx=0x7f888800dae0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 shutdown_connections 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88800762d0 0x7f8880078790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88940d0230 0x7f88940b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88940cfbb0 0x7f88940cb040 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 --2- 172.21.15.66:0/1464565416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88940b8860 0x7f88940a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 >> 172.21.15.66:0/1464565416 conn(0x7f88940d2df0 msgr2=0x7f889406e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:04.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 shutdown_connections 2024-05-10T11:14:04.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:04.681+0000 7f8899f96640 1 -- 172.21.15.66:0/1464565416 wait complete. 2024-05-10T11:14:04.693 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-05-10T11:14:03.704905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221792,"kb_used_data":5600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752928,"statfs":{"total":773094113280,"available":772866998272,"internally_reserved":0,"allocated":5734400,"data_stored":3144929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105697+0000","last_change":"2024-05-10T11:13:59.106675+0000","last_active":"2024-05-10T11:14:00.105697+0000","last_peered":"2024-05-10T11:14:00.105697+0000","last_clean":"2024-05-10T11:14:00.105697+0000","last_became_active":"2024-05-10T11:13:59.104906+0000","last_became_peered":"2024-05-10T11:13:59.104906+0000","last_unstale":"2024-05-10T11:14:00.105697+0000","last_undegraded":"2024-05-10T11:14:00.105697+0000","last_fullsized":"2024-05-10T11:14:00.105697+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:39.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.087095+0000","last_change":"2024-05-10T11:13:58.087095+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.087095+0000","last_undegraded":"2024-05-10T11:13:58.087095+0000","last_fullsized":"2024-05-10T11:13:58.087095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092955+0000","last_change":"2024-05-10T11:13:59.101893+0000","last_active":"2024-05-10T11:14:01.092955+0000","last_peered":"2024-05-10T11:14:01.092955+0000","last_clean":"2024-05-10T11:14:01.092955+0000","last_became_active":"2024-05-10T11:13:59.101342+0000","last_became_peered":"2024-05-10T11:13:59.101342+0000","last_unstale":"2024-05-10T11:14:01.092955+0000","last_undegraded":"2024-05-10T11:14:01.092955+0000","last_fullsized":"2024-05-10T11:14:01.092955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:24.662230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086382+0000","last_change":"2024-05-10T11:13:58.086382+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086382+0000","last_undegraded":"2024-05-10T11:13:58.086382+0000","last_fullsized":"2024-05-10T11:13:58.086382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091231+0000","last_change":"2024-05-10T11:13:58.091231+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091231+0000","last_undegraded":"2024-05-10T11:13:58.091231+0000","last_fullsized":"2024-05-10T11:13:58.091231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105517+0000","last_change":"2024-05-10T11:13:59.106716+0000","last_active":"2024-05-10T11:14:00.105517+0000","last_peered":"2024-05-10T11:14:00.105517+0000","last_clean":"2024-05-10T11:14:00.105517+0000","last_became_active":"2024-05-10T11:13:59.106391+0000","last_became_peered":"2024-05-10T11:13:59.106391+0000","last_unstale":"2024-05-10T11:14:00.105517+0000","last_undegraded":"2024-05-10T11:14:00.105517+0000","last_fullsized":"2024-05-10T11:14:00.105517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:50.602243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092487+0000","last_change":"2024-05-10T11:13:59.105753+0000","last_active":"2024-05-10T11:14:01.092487+0000","last_peered":"2024-05-10T11:14:01.092487+0000","last_clean":"2024-05-10T11:14:01.092487+0000","last_became_active":"2024-05-10T11:13:59.105261+0000","last_became_peered":"2024-05-10T11:13:59.105261+0000","last_unstale":"2024-05-10T11:14:01.092487+0000","last_undegraded":"2024-05-10T11:14:01.092487+0000","last_fullsized":"2024-05-10T11:14:01.092487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:08.244589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753009+0000","last_change":"2024-05-10T11:13:59.097811+0000","last_active":"2024-05-10T11:14:01.753009+0000","last_peered":"2024-05-10T11:14:01.753009+0000","last_clean":"2024-05-10T11:14:01.753009+0000","last_became_active":"2024-05-10T11:13:59.095867+0000","last_became_peered":"2024-05-10T11:13:59.095867+0000","last_unstale":"2024-05-10T11:14:01.753009+0000","last_undegraded":"2024-05-10T11:14:01.753009+0000","last_fullsized":"2024-05-10T11:14:01.753009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:09.356540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753144+0000","last_change":"2024-05-10T11:13:59.112824+0000","last_active":"2024-05-10T11:14:01.753144+0000","last_peered":"2024-05-10T11:14:01.753144+0000","last_clean":"2024-05-10T11:14:01.753144+0000","last_became_active":"2024-05-10T11:13:59.112454+0000","last_became_peered":"2024-05-10T11:13:59.112454+0000","last_unstale":"2024-05-10T11:14:01.753144+0000","last_undegraded":"2024-05-10T11:14:01.753144+0000","last_fullsized":"2024-05-10T11:14:01.753144+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:40.838654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105686+0000","last_change":"2024-05-10T11:13:59.106359+0000","last_active":"2024-05-10T11:14:00.105686+0000","last_peered":"2024-05-10T11:14:00.105686+0000","last_clean":"2024-05-10T11:14:00.105686+0000","last_became_active":"2024-05-10T11:13:59.106080+0000","last_became_peered":"2024-05-10T11:13:59.106080+0000","last_unstale":"2024-05-10T11:14:00.105686+0000","last_undegraded":"2024-05-10T11:14:00.105686+0000","last_fullsized":"2024-05-10T11:14:00.105686+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:34.496936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106716+0000","last_change":"2024-05-10T11:13:59.107658+0000","last_active":"2024-05-10T11:14:00.106716+0000","last_peered":"2024-05-10T11:14:00.106716+0000","last_clean":"2024-05-10T11:14:00.106716+0000","last_became_active":"2024-05-10T11:13:59.107365+0000","last_became_peered":"2024-05-10T11:13:59.107365+0000","last_unstale":"2024-05-10T11:14:00.106716+0000","last_undegraded":"2024-05-10T11:14:00.106716+0000","last_fullsized":"2024-05-10T11:14:00.106716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:46.403463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753234+0000","last_change":"2024-05-10T11:13:59.112511+0000","last_active":"2024-05-10T11:14:01.753234+0000","last_peered":"2024-05-10T11:14:01.753234+0000","last_clean":"2024-05-10T11:14:01.753234+0000","last_became_active":"2024-05-10T11:13:59.111334+0000","last_became_peered":"2024-05-10T11:13:59.111334+0000","last_unstale":"2024-05-10T11:14:01.753234+0000","last_undegraded":"2024-05-10T11:14:01.753234+0000","last_fullsized":"2024-05-10T11:14:01.753234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:12:33.307214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105549+0000","last_change":"2024-05-10T11:13:59.108117+0000","last_active":"2024-05-10T11:14:00.105549+0000","last_peered":"2024-05-10T11:14:00.105549+0000","last_clean":"2024-05-10T11:14:00.105549+0000","last_became_active":"2024-05-10T11:13:59.107823+0000","last_became_peered":"2024-05-10T11:13:59.107823+0000","last_unstale":"2024-05-10T11:14:00.105549+0000","last_undegraded":"2024-05-10T11:14:00.105549+0000","last_fullsized":"2024-05-10T11:14:00.105549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:53.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092761+0000","last_change":"2024-05-10T11:13:59.101712+0000","last_active":"2024-05-10T11:14:01.092761+0000","last_peered":"2024-05-10T11:14:01.092761+0000","last_clean":"2024-05-10T11:14:01.092761+0000","last_became_active":"2024-05-10T11:13:59.101392+0000","last_became_peered":"2024-05-10T11:13:59.101392+0000","last_unstale":"2024-05-10T11:14:01.092761+0000","last_undegraded":"2024-05-10T11:14:01.092761+0000","last_fullsized":"2024-05-10T11:14:01.092761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:27.980151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086453+0000","last_change":"2024-05-10T11:13:58.086453+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086453+0000","last_undegraded":"2024-05-10T11:13:58.086453+0000","last_fullsized":"2024-05-10T11:13:58.086453+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105170+0000","last_change":"2024-05-10T11:13:59.105113+0000","last_active":"2024-05-10T11:14:00.105170+0000","last_peered":"2024-05-10T11:14:00.105170+0000","last_clean":"2024-05-10T11:14:00.105170+0000","last_became_active":"2024-05-10T11:13:59.104839+0000","last_became_peered":"2024-05-10T11:13:59.104839+0000","last_unstale":"2024-05-10T11:14:00.105170+0000","last_undegraded":"2024-05-10T11:14:00.105170+0000","last_fullsized":"2024-05-10T11:14:00.105170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:17.038077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093234+0000","last_change":"2024-05-10T11:13:59.104711+0000","last_active":"2024-05-10T11:14:01.093234+0000","last_peered":"2024-05-10T11:14:01.093234+0000","last_clean":"2024-05-10T11:14:01.093234+0000","last_became_active":"2024-05-10T11:13:59.104165+0000","last_became_peered":"2024-05-10T11:13:59.104165+0000","last_unstale":"2024-05-10T11:14:01.093234+0000","last_undegraded":"2024-05-10T11:14:01.093234+0000","last_fullsized":"2024-05-10T11:14:01.093234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:08.120414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086266+0000","last_change":"2024-05-10T11:13:58.086266+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086266+0000","last_undegraded":"2024-05-10T11:13:58.086266+0000","last_fullsized":"2024-05-10T11:13:58.086266+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092822+0000","last_change":"2024-05-10T11:13:59.098424+0000","last_active":"2024-05-10T11:14:01.092822+0000","last_peered":"2024-05-10T11:14:01.092822+0000","last_clean":"2024-05-10T11:14:01.092822+0000","last_became_active":"2024-05-10T11:13:59.098148+0000","last_became_peered":"2024-05-10T11:13:59.098148+0000","last_unstale":"2024-05-10T11:14:01.092822+0000","last_undegraded":"2024-05-10T11:14:01.092822+0000","last_fullsized":"2024-05-10T11:14:01.092822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:54.088353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093694+0000","last_change":"2024-05-10T11:13:58.093694+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093694+0000","last_undegraded":"2024-05-10T11:13:58.093694+0000","last_fullsized":"2024-05-10T11:13:58.093694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091100+0000","last_change":"2024-05-10T11:13:58.091100+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091100+0000","last_undegraded":"2024-05-10T11:13:58.091100+0000","last_fullsized":"2024-05-10T11:13:58.091100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752888+0000","last_change":"2024-05-10T11:13:59.111979+0000","last_active":"2024-05-10T11:14:01.752888+0000","last_peered":"2024-05-10T11:14:01.752888+0000","last_clean":"2024-05-10T11:14:01.752888+0000","last_became_active":"2024-05-10T11:13:59.111660+0000","last_became_peered":"2024-05-10T11:13:59.111660+0000","last_unstale":"2024-05-10T11:14:01.752888+0000","last_undegraded":"2024-05-10T11:14:01.752888+0000","last_fullsized":"2024-05-10T11:14:01.752888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:25.490896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106555+0000","last_change":"2024-05-10T11:13:59.108589+0000","last_active":"2024-05-10T11:14:00.106555+0000","last_peered":"2024-05-10T11:14:00.106555+0000","last_clean":"2024-05-10T11:14:00.106555+0000","last_became_active":"2024-05-10T11:13:59.107803+0000","last_became_peered":"2024-05-10T11:13:59.107803+0000","last_unstale":"2024-05-10T11:14:00.106555+0000","last_undegraded":"2024-05-10T11:14:00.106555+0000","last_fullsized":"2024-05-10T11:14:00.106555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:20.477990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092426+0000","last_change":"2024-05-10T11:13:59.103151+0000","last_active":"2024-05-10T11:14:01.092426+0000","last_peered":"2024-05-10T11:14:01.092426+0000","last_clean":"2024-05-10T11:14:01.092426+0000","last_became_active":"2024-05-10T11:13:59.102660+0000","last_became_peered":"2024-05-10T11:13:59.102660+0000","last_unstale":"2024-05-10T11:14:01.092426+0000","last_undegraded":"2024-05-10T11:14:01.092426+0000","last_fullsized":"2024-05-10T11:14:01.092426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:29.283615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093329+0000","last_change":"2024-05-10T11:13:59.111970+0000","last_active":"2024-05-10T11:14:01.093329+0000","last_peered":"2024-05-10T11:14:01.093329+0000","last_clean":"2024-05-10T11:14:01.093329+0000","last_became_active":"2024-05-10T11:13:59.111705+0000","last_became_peered":"2024-05-10T11:13:59.111705+0000","last_unstale":"2024-05-10T11:14:01.093329+0000","last_undegraded":"2024-05-10T11:14:01.093329+0000","last_fullsized":"2024-05-10T11:14:01.093329+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:01.471427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753136+0000","last_change":"2024-05-10T11:13:59.099016+0000","last_active":"2024-05-10T11:14:01.753136+0000","last_peered":"2024-05-10T11:14:01.753136+0000","last_clean":"2024-05-10T11:14:01.753136+0000","last_became_active":"2024-05-10T11:13:59.098758+0000","last_became_peered":"2024-05-10T11:13:59.098758+0000","last_unstale":"2024-05-10T11:14:01.753136+0000","last_undegraded":"2024-05-10T11:14:01.753136+0000","last_fullsized":"2024-05-10T11:14:01.753136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:49.161270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105821+0000","last_change":"2024-05-10T11:13:59.115611+0000","last_active":"2024-05-10T11:14:00.105821+0000","last_peered":"2024-05-10T11:14:00.105821+0000","last_clean":"2024-05-10T11:14:00.105821+0000","last_became_active":"2024-05-10T11:13:59.115320+0000","last_became_peered":"2024-05-10T11:13:59.115320+0000","last_unstale":"2024-05-10T11:14:00.105821+0000","last_undegraded":"2024-05-10T11:14:00.105821+0000","last_fullsized":"2024-05-10T11:14:00.105821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:37.989192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093237+0000","last_change":"2024-05-10T11:13:58.093237+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093237+0000","last_undegraded":"2024-05-10T11:13:58.093237+0000","last_fullsized":"2024-05-10T11:13:58.093237+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092693+0000","last_change":"2024-05-10T11:13:59.104155+0000","last_active":"2024-05-10T11:14:01.092693+0000","last_peered":"2024-05-10T11:14:01.092693+0000","last_clean":"2024-05-10T11:14:01.092693+0000","last_became_active":"2024-05-10T11:13:59.103871+0000","last_became_peered":"2024-05-10T11:13:59.103871+0000","last_unstale":"2024-05-10T11:14:01.092693+0000","last_undegraded":"2024-05-10T11:14:01.092693+0000","last_fullsized":"2024-05-10T11:14:01.092693+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:48.864661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086302+0000","last_change":"2024-05-10T11:13:58.086302+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086302+0000","last_undegraded":"2024-05-10T11:13:58.086302+0000","last_fullsized":"2024-05-10T11:13:58.086302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092784+0000","last_change":"2024-05-10T11:13:59.105522+0000","last_active":"2024-05-10T11:14:01.092784+0000","last_peered":"2024-05-10T11:14:01.092784+0000","last_clean":"2024-05-10T11:14:01.092784+0000","last_became_active":"2024-05-10T11:13:59.103573+0000","last_became_peered":"2024-05-10T11:13:59.103573+0000","last_unstale":"2024-05-10T11:14:01.092784+0000","last_undegraded":"2024-05-10T11:14:01.092784+0000","last_fullsized":"2024-05-10T11:14:01.092784+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:29.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628880+0000","last_change":"2024-05-10T11:13:59.113306+0000","last_active":"2024-05-10T11:14:01.628880+0000","last_peered":"2024-05-10T11:14:01.628880+0000","last_clean":"2024-05-10T11:14:01.628880+0000","last_became_active":"2024-05-10T11:13:59.112891+0000","last_became_peered":"2024-05-10T11:13:59.112891+0000","last_unstale":"2024-05-10T11:14:01.628880+0000","last_undegraded":"2024-05-10T11:14:01.628880+0000","last_fullsized":"2024-05-10T11:14:01.628880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086586+0000","last_change":"2024-05-10T11:13:58.086586+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086586+0000","last_undegraded":"2024-05-10T11:13:58.086586+0000","last_fullsized":"2024-05-10T11:13:58.086586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098266+0000","last_change":"2024-05-10T11:13:58.096652+0000","last_active":"2024-05-10T11:13:58.098266+0000","last_peered":"2024-05-10T11:13:58.098266+0000","last_clean":"2024-05-10T11:13:58.098266+0000","last_became_active":"2024-05-10T11:13:58.096366+0000","last_became_peered":"2024-05-10T11:13:58.096366+0000","last_unstale":"2024-05-10T11:13:58.098266+0000","last_undegraded":"2024-05-10T11:13:58.098266+0000","last_fullsized":"2024-05-10T11:13:58.098266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:09.362328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.629059+0000","last_change":"2024-05-10T11:13:59.104836+0000","last_active":"2024-05-10T11:14:01.629059+0000","last_peered":"2024-05-10T11:14:01.629059+0000","last_clean":"2024-05-10T11:14:01.629059+0000","last_became_active":"2024-05-10T11:13:59.104557+0000","last_became_peered":"2024-05-10T11:13:59.104557+0000","last_unstale":"2024-05-10T11:14:01.629059+0000","last_undegraded":"2024-05-10T11:14:01.629059+0000","last_fullsized":"2024-05-10T11:14:01.629059+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:27.980151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105581+0000","last_change":"2024-05-10T11:13:58.108775+0000","last_active":"2024-05-10T11:14:00.105581+0000","last_peered":"2024-05-10T11:14:00.105581+0000","last_clean":"2024-05-10T11:14:00.105581+0000","last_became_active":"2024-05-10T11:13:58.108468+0000","last_became_peered":"2024-05-10T11:13:58.108468+0000","last_unstale":"2024-05-10T11:14:00.105581+0000","last_undegraded":"2024-05-10T11:14:00.105581+0000","last_fullsized":"2024-05-10T11:14:00.105581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:50.052578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092969+0000","last_change":"2024-05-10T11:13:58.092969+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092969+0000","last_undegraded":"2024-05-10T11:13:58.092969+0000","last_fullsized":"2024-05-10T11:13:58.092969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105837+0000","last_change":"2024-05-10T11:13:58.098703+0000","last_active":"2024-05-10T11:14:00.105837+0000","last_peered":"2024-05-10T11:14:00.105837+0000","last_clean":"2024-05-10T11:14:00.105837+0000","last_became_active":"2024-05-10T11:13:58.098374+0000","last_became_peered":"2024-05-10T11:13:58.098374+0000","last_unstale":"2024-05-10T11:14:00.105837+0000","last_undegraded":"2024-05-10T11:14:00.105837+0000","last_fullsized":"2024-05-10T11:14:00.105837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:15.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753261+0000","last_change":"2024-05-10T11:13:59.096735+0000","last_active":"2024-05-10T11:14:01.753261+0000","last_peered":"2024-05-10T11:14:01.753261+0000","last_clean":"2024-05-10T11:14:01.753261+0000","last_became_active":"2024-05-10T11:13:59.096493+0000","last_became_peered":"2024-05-10T11:13:59.096493+0000","last_unstale":"2024-05-10T11:14:01.753261+0000","last_undegraded":"2024-05-10T11:14:01.753261+0000","last_fullsized":"2024-05-10T11:14:01.753261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:00.643704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.629014+0000","last_change":"2024-05-10T11:13:58.107382+0000","last_active":"2024-05-10T11:14:01.629014+0000","last_peered":"2024-05-10T11:14:01.629014+0000","last_clean":"2024-05-10T11:14:01.629014+0000","last_became_active":"2024-05-10T11:13:58.107139+0000","last_became_peered":"2024-05-10T11:13:58.107139+0000","last_unstale":"2024-05-10T11:14:01.629014+0000","last_undegraded":"2024-05-10T11:14:01.629014+0000","last_fullsized":"2024-05-10T11:14:01.629014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:52.409007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091795+0000","last_change":"2024-05-10T11:13:58.091795+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091795+0000","last_undegraded":"2024-05-10T11:13:58.091795+0000","last_fullsized":"2024-05-10T11:13:58.091795+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092699+0000","last_change":"2024-05-10T11:13:58.106550+0000","last_active":"2024-05-10T11:14:01.092699+0000","last_peered":"2024-05-10T11:14:01.092699+0000","last_clean":"2024-05-10T11:14:01.092699+0000","last_became_active":"2024-05-10T11:13:58.106238+0000","last_became_peered":"2024-05-10T11:13:58.106238+0000","last_unstale":"2024-05-10T11:14:01.092699+0000","last_undegraded":"2024-05-10T11:14:01.092699+0000","last_fullsized":"2024-05-10T11:14:01.092699+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:16.035725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086342+0000","last_change":"2024-05-10T11:13:58.086342+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086342+0000","last_undegraded":"2024-05-10T11:13:58.086342+0000","last_fullsized":"2024-05-10T11:13:58.086342+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100981+0000","last_change":"2024-05-10T11:13:58.098405+0000","last_active":"2024-05-10T11:13:58.100981+0000","last_peered":"2024-05-10T11:13:58.100981+0000","last_clean":"2024-05-10T11:13:58.100981+0000","last_became_active":"2024-05-10T11:13:58.098115+0000","last_became_peered":"2024-05-10T11:13:58.098115+0000","last_unstale":"2024-05-10T11:13:58.100981+0000","last_undegraded":"2024-05-10T11:13:58.100981+0000","last_fullsized":"2024-05-10T11:13:58.100981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:17.632714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753282+0000","last_change":"2024-05-10T11:13:59.115658+0000","last_active":"2024-05-10T11:14:01.753282+0000","last_peered":"2024-05-10T11:14:01.753282+0000","last_clean":"2024-05-10T11:14:01.753282+0000","last_became_active":"2024-05-10T11:13:59.115392+0000","last_became_peered":"2024-05-10T11:13:59.115392+0000","last_unstale":"2024-05-10T11:14:01.753282+0000","last_undegraded":"2024-05-10T11:14:01.753282+0000","last_fullsized":"2024-05-10T11:14:01.753282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:56.803833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098757+0000","last_change":"2024-05-10T11:13:58.097819+0000","last_active":"2024-05-10T11:13:58.098757+0000","last_peered":"2024-05-10T11:13:58.098757+0000","last_clean":"2024-05-10T11:13:58.098757+0000","last_became_active":"2024-05-10T11:13:58.097490+0000","last_became_peered":"2024-05-10T11:13:58.097490+0000","last_unstale":"2024-05-10T11:13:58.098757+0000","last_undegraded":"2024-05-10T11:13:58.098757+0000","last_fullsized":"2024-05-10T11:13:58.098757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:42.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.086281+0000","last_change":"2024-05-10T11:13:58.086281+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.086281+0000","last_undegraded":"2024-05-10T11:13:58.086281+0000","last_fullsized":"2024-05-10T11:13:58.086281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092310+0000","last_change":"2024-05-10T11:13:58.100789+0000","last_active":"2024-05-10T11:14:01.092310+0000","last_peered":"2024-05-10T11:14:01.092310+0000","last_clean":"2024-05-10T11:14:01.092310+0000","last_became_active":"2024-05-10T11:13:58.100512+0000","last_became_peered":"2024-05-10T11:13:58.100512+0000","last_unstale":"2024-05-10T11:14:01.092310+0000","last_undegraded":"2024-05-10T11:14:01.092310+0000","last_fullsized":"2024-05-10T11:14:01.092310+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:25.264746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090158+0000","last_change":"2024-05-10T11:13:58.090158+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090158+0000","last_undegraded":"2024-05-10T11:13:58.090158+0000","last_fullsized":"2024-05-10T11:13:58.090158+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102466+0000","last_change":"2024-05-10T11:13:58.098731+0000","last_active":"2024-05-10T11:13:58.102466+0000","last_peered":"2024-05-10T11:13:58.102466+0000","last_clean":"2024-05-10T11:13:58.102466+0000","last_became_active":"2024-05-10T11:13:58.098187+0000","last_became_peered":"2024-05-10T11:13:58.098187+0000","last_unstale":"2024-05-10T11:13:58.102466+0000","last_undegraded":"2024-05-10T11:13:58.102466+0000","last_fullsized":"2024-05-10T11:13:58.102466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:19.909231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628867+0000","last_change":"2024-05-10T11:13:59.104673+0000","last_active":"2024-05-10T11:14:01.628867+0000","last_peered":"2024-05-10T11:14:01.628867+0000","last_clean":"2024-05-10T11:14:01.628867+0000","last_became_active":"2024-05-10T11:13:59.104092+0000","last_became_peered":"2024-05-10T11:13:59.104092+0000","last_unstale":"2024-05-10T11:14:01.628867+0000","last_undegraded":"2024-05-10T11:14:01.628867+0000","last_fullsized":"2024-05-10T11:14:01.628867+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:30.339111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.098452+0000","last_change":"2024-05-10T11:13:58.097328+0000","last_active":"2024-05-10T11:13:58.098452+0000","last_peered":"2024-05-10T11:13:58.098452+0000","last_clean":"2024-05-10T11:13:58.098452+0000","last_became_active":"2024-05-10T11:13:58.097031+0000","last_became_peered":"2024-05-10T11:13:58.097031+0000","last_unstale":"2024-05-10T11:13:58.098452+0000","last_undegraded":"2024-05-10T11:13:58.098452+0000","last_fullsized":"2024-05-10T11:13:58.098452+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:27.401728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093064+0000","last_change":"2024-05-10T11:13:59.103181+0000","last_active":"2024-05-10T11:14:01.093064+0000","last_peered":"2024-05-10T11:14:01.093064+0000","last_clean":"2024-05-10T11:14:01.093064+0000","last_became_active":"2024-05-10T11:13:59.102892+0000","last_became_peered":"2024-05-10T11:13:59.102892+0000","last_unstale":"2024-05-10T11:14:01.093064+0000","last_undegraded":"2024-05-10T11:14:01.093064+0000","last_fullsized":"2024-05-10T11:14:01.093064+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:09.356540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102538+0000","last_change":"2024-05-10T11:13:58.100457+0000","last_active":"2024-05-10T11:13:58.102538+0000","last_peered":"2024-05-10T11:13:58.102538+0000","last_clean":"2024-05-10T11:13:58.102538+0000","last_became_active":"2024-05-10T11:13:58.100133+0000","last_became_peered":"2024-05-10T11:13:58.100133+0000","last_unstale":"2024-05-10T11:13:58.102538+0000","last_undegraded":"2024-05-10T11:13:58.102538+0000","last_fullsized":"2024-05-10T11:13:58.102538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:43.772326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.090165+0000","last_change":"2024-05-10T11:13:58.090165+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.090165+0000","last_undegraded":"2024-05-10T11:13:58.090165+0000","last_fullsized":"2024-05-10T11:13:58.090165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753188+0000","last_change":"2024-05-10T11:13:58.103129+0000","last_active":"2024-05-10T11:14:01.753188+0000","last_peered":"2024-05-10T11:14:01.753188+0000","last_clean":"2024-05-10T11:14:01.753188+0000","last_became_active":"2024-05-10T11:13:58.102831+0000","last_became_peered":"2024-05-10T11:13:58.102831+0000","last_unstale":"2024-05-10T11:14:01.753188+0000","last_undegraded":"2024-05-10T11:14:01.753188+0000","last_fullsized":"2024-05-10T11:14:01.753188+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:14.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628866+0000","last_change":"2024-05-10T11:13:59.107364+0000","last_active":"2024-05-10T11:14:01.628866+0000","last_peered":"2024-05-10T11:14:01.628866+0000","last_clean":"2024-05-10T11:14:01.628866+0000","last_became_active":"2024-05-10T11:13:59.107094+0000","last_became_peered":"2024-05-10T11:13:59.107094+0000","last_unstale":"2024-05-10T11:14:01.628866+0000","last_undegraded":"2024-05-10T11:14:01.628866+0000","last_fullsized":"2024-05-10T11:14:01.628866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:15.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092820+0000","last_change":"2024-05-10T11:13:58.104807+0000","last_active":"2024-05-10T11:14:01.092820+0000","last_peered":"2024-05-10T11:14:01.092820+0000","last_clean":"2024-05-10T11:14:01.092820+0000","last_became_active":"2024-05-10T11:13:58.104538+0000","last_became_peered":"2024-05-10T11:13:58.104538+0000","last_unstale":"2024-05-10T11:14:01.092820+0000","last_undegraded":"2024-05-10T11:14:01.092820+0000","last_fullsized":"2024-05-10T11:14:01.092820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:20.746955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093122+0000","last_change":"2024-05-10T11:13:59.110605+0000","last_active":"2024-05-10T11:14:01.093122+0000","last_peered":"2024-05-10T11:14:01.093122+0000","last_clean":"2024-05-10T11:14:01.093122+0000","last_became_active":"2024-05-10T11:13:59.110274+0000","last_became_peered":"2024-05-10T11:13:59.110274+0000","last_unstale":"2024-05-10T11:14:01.093122+0000","last_undegraded":"2024-05-10T11:14:01.093122+0000","last_fullsized":"2024-05-10T11:14:01.093122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:49.161270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.102410+0000","last_change":"2024-05-10T11:13:58.100301+0000","last_active":"2024-05-10T11:13:58.102410+0000","last_peered":"2024-05-10T11:13:58.102410+0000","last_clean":"2024-05-10T11:13:58.102410+0000","last_became_active":"2024-05-10T11:13:58.100038+0000","last_became_peered":"2024-05-10T11:13:58.100038+0000","last_unstale":"2024-05-10T11:13:58.102410+0000","last_undegraded":"2024-05-10T11:13:58.102410+0000","last_fullsized":"2024-05-10T11:13:58.102410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:02.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753171+0000","last_change":"2024-05-10T11:13:59.111998+0000","last_active":"2024-05-10T11:14:01.753171+0000","last_peered":"2024-05-10T11:14:01.753171+0000","last_clean":"2024-05-10T11:14:01.753171+0000","last_became_active":"2024-05-10T11:13:59.111688+0000","last_became_peered":"2024-05-10T11:13:59.111688+0000","last_unstale":"2024-05-10T11:14:01.753171+0000","last_undegraded":"2024-05-10T11:14:01.753171+0000","last_fullsized":"2024-05-10T11:14:01.753171+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:08.120414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100879+0000","last_change":"2024-05-10T11:13:58.098650+0000","last_active":"2024-05-10T11:13:58.100879+0000","last_peered":"2024-05-10T11:13:58.100879+0000","last_clean":"2024-05-10T11:13:58.100879+0000","last_became_active":"2024-05-10T11:13:58.098172+0000","last_became_peered":"2024-05-10T11:13:58.098172+0000","last_unstale":"2024-05-10T11:13:58.100879+0000","last_undegraded":"2024-05-10T11:13:58.100879+0000","last_fullsized":"2024-05-10T11:13:58.100879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:48.647647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093223+0000","last_change":"2024-05-10T11:13:59.106640+0000","last_active":"2024-05-10T11:14:01.093223+0000","last_peered":"2024-05-10T11:14:01.093223+0000","last_clean":"2024-05-10T11:14:01.093223+0000","last_became_active":"2024-05-10T11:13:59.106381+0000","last_became_peered":"2024-05-10T11:13:59.106381+0000","last_unstale":"2024-05-10T11:14:01.093223+0000","last_undegraded":"2024-05-10T11:14:01.093223+0000","last_fullsized":"2024-05-10T11:14:01.093223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:40.838654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753068+0000","last_change":"2024-05-10T11:13:58.104546+0000","last_active":"2024-05-10T11:14:01.753068+0000","last_peered":"2024-05-10T11:14:01.753068+0000","last_clean":"2024-05-10T11:14:01.753068+0000","last_became_active":"2024-05-10T11:13:58.104248+0000","last_became_peered":"2024-05-10T11:13:58.104248+0000","last_unstale":"2024-05-10T11:14:01.753068+0000","last_undegraded":"2024-05-10T11:14:01.753068+0000","last_fullsized":"2024-05-10T11:14:01.753068+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:00.411668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753130+0000","last_change":"2024-05-10T11:13:59.100823+0000","last_active":"2024-05-10T11:14:01.753130+0000","last_peered":"2024-05-10T11:14:01.753130+0000","last_clean":"2024-05-10T11:14:01.753130+0000","last_became_active":"2024-05-10T11:13:59.100521+0000","last_became_peered":"2024-05-10T11:13:59.100521+0000","last_unstale":"2024-05-10T11:14:01.753130+0000","last_undegraded":"2024-05-10T11:14:01.753130+0000","last_fullsized":"2024-05-10T11:14:01.753130+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:52.850375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093284+0000","last_change":"2024-05-10T11:13:58.096733+0000","last_active":"2024-05-10T11:14:01.093284+0000","last_peered":"2024-05-10T11:14:01.093284+0000","last_clean":"2024-05-10T11:14:01.093284+0000","last_became_active":"2024-05-10T11:13:58.094522+0000","last_became_peered":"2024-05-10T11:13:58.094522+0000","last_unstale":"2024-05-10T11:14:01.093284+0000","last_undegraded":"2024-05-10T11:14:01.093284+0000","last_fullsized":"2024-05-10T11:14:01.093284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:49.545141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105288+0000","last_change":"2024-05-10T11:13:59.116492+0000","last_active":"2024-05-10T11:14:00.105288+0000","last_peered":"2024-05-10T11:14:00.105288+0000","last_clean":"2024-05-10T11:14:00.105288+0000","last_became_active":"2024-05-10T11:13:59.116207+0000","last_became_peered":"2024-05-10T11:13:59.116207+0000","last_unstale":"2024-05-10T11:14:00.105288+0000","last_undegraded":"2024-05-10T11:14:00.105288+0000","last_fullsized":"2024-05-10T11:14:00.105288+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:06.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106744+0000","last_change":"2024-05-10T11:13:58.098164+0000","last_active":"2024-05-10T11:14:00.106744+0000","last_peered":"2024-05-10T11:14:00.106744+0000","last_clean":"2024-05-10T11:14:00.106744+0000","last_became_active":"2024-05-10T11:13:58.097916+0000","last_became_peered":"2024-05-10T11:13:58.097916+0000","last_unstale":"2024-05-10T11:14:00.106744+0000","last_undegraded":"2024-05-10T11:14:00.106744+0000","last_fullsized":"2024-05-10T11:14:00.106744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:40.971274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.091815+0000","last_change":"2024-05-10T11:13:58.091815+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.091815+0000","last_undegraded":"2024-05-10T11:13:58.091815+0000","last_fullsized":"2024-05-10T11:13:58.091815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105138+0000","last_change":"2024-05-10T11:13:58.101899+0000","last_active":"2024-05-10T11:13:58.105138+0000","last_peered":"2024-05-10T11:13:58.105138+0000","last_clean":"2024-05-10T11:13:58.105138+0000","last_became_active":"2024-05-10T11:13:58.101701+0000","last_became_peered":"2024-05-10T11:13:58.101701+0000","last_unstale":"2024-05-10T11:13:58.105138+0000","last_undegraded":"2024-05-10T11:13:58.105138+0000","last_fullsized":"2024-05-10T11:13:58.105138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:15:08.136167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105638+0000","last_change":"2024-05-10T11:13:59.107449+0000","last_active":"2024-05-10T11:14:00.105638+0000","last_peered":"2024-05-10T11:14:00.105638+0000","last_clean":"2024-05-10T11:14:00.105638+0000","last_became_active":"2024-05-10T11:13:59.106820+0000","last_became_peered":"2024-05-10T11:13:59.106820+0000","last_unstale":"2024-05-10T11:14:00.105638+0000","last_undegraded":"2024-05-10T11:14:00.105638+0000","last_fullsized":"2024-05-10T11:14:00.105638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:28.570313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.109666+0000","last_change":"2024-05-10T11:13:58.108564+0000","last_active":"2024-05-10T11:13:58.109666+0000","last_peered":"2024-05-10T11:13:58.109666+0000","last_clean":"2024-05-10T11:13:58.109666+0000","last_became_active":"2024-05-10T11:13:58.108327+0000","last_became_peered":"2024-05-10T11:13:58.108327+0000","last_unstale":"2024-05-10T11:13:58.109666+0000","last_undegraded":"2024-05-10T11:13:58.109666+0000","last_fullsized":"2024-05-10T11:13:58.109666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:16.753692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628908+0000","last_change":"2024-05-10T11:13:59.097564+0000","last_active":"2024-05-10T11:14:01.628908+0000","last_peered":"2024-05-10T11:14:01.628908+0000","last_clean":"2024-05-10T11:14:01.628908+0000","last_became_active":"2024-05-10T11:13:59.097201+0000","last_became_peered":"2024-05-10T11:13:59.097201+0000","last_unstale":"2024-05-10T11:14:01.628908+0000","last_undegraded":"2024-05-10T11:14:01.628908+0000","last_fullsized":"2024-05-10T11:14:01.628908+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:29.283615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105605+0000","last_change":"2024-05-10T11:13:58.099890+0000","last_active":"2024-05-10T11:14:00.105605+0000","last_peered":"2024-05-10T11:14:00.105605+0000","last_clean":"2024-05-10T11:14:00.105605+0000","last_became_active":"2024-05-10T11:13:58.099642+0000","last_became_peered":"2024-05-10T11:13:58.099642+0000","last_unstale":"2024-05-10T11:14:00.105605+0000","last_undegraded":"2024-05-10T11:14:00.105605+0000","last_fullsized":"2024-05-10T11:14:00.105605+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:24.898322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.092920+0000","last_change":"2024-05-10T11:13:58.092920+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.092920+0000","last_undegraded":"2024-05-10T11:13:58.092920+0000","last_fullsized":"2024-05-10T11:13:58.092920+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752729+0000","last_change":"2024-05-10T11:13:58.104514+0000","last_active":"2024-05-10T11:14:01.752729+0000","last_peered":"2024-05-10T11:14:01.752729+0000","last_clean":"2024-05-10T11:14:01.752729+0000","last_became_active":"2024-05-10T11:13:58.104215+0000","last_became_peered":"2024-05-10T11:13:58.104215+0000","last_unstale":"2024-05-10T11:14:01.752729+0000","last_undegraded":"2024-05-10T11:14:01.752729+0000","last_fullsized":"2024-05-10T11:14:01.752729+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:20.840800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093135+0000","last_change":"2024-05-10T11:13:59.106152+0000","last_active":"2024-05-10T11:14:01.093135+0000","last_peered":"2024-05-10T11:14:01.093135+0000","last_clean":"2024-05-10T11:14:01.093135+0000","last_became_active":"2024-05-10T11:13:59.105900+0000","last_became_peered":"2024-05-10T11:13:59.105900+0000","last_unstale":"2024-05-10T11:14:01.093135+0000","last_undegraded":"2024-05-10T11:14:01.093135+0000","last_fullsized":"2024-05-10T11:14:01.093135+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:52.850375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092579+0000","last_change":"2024-05-10T11:13:58.104683+0000","last_active":"2024-05-10T11:14:01.092579+0000","last_peered":"2024-05-10T11:14:01.092579+0000","last_clean":"2024-05-10T11:14:01.092579+0000","last_became_active":"2024-05-10T11:13:58.104419+0000","last_became_peered":"2024-05-10T11:13:58.104419+0000","last_unstale":"2024-05-10T11:14:01.092579+0000","last_undegraded":"2024-05-10T11:14:01.092579+0000","last_fullsized":"2024-05-10T11:14:01.092579+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:20.844144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105828+0000","last_change":"2024-05-10T11:13:59.117498+0000","last_active":"2024-05-10T11:14:00.105828+0000","last_peered":"2024-05-10T11:14:00.105828+0000","last_clean":"2024-05-10T11:14:00.105828+0000","last_became_active":"2024-05-10T11:13:59.117219+0000","last_became_peered":"2024-05-10T11:13:59.117219+0000","last_unstale":"2024-05-10T11:14:00.105828+0000","last_undegraded":"2024-05-10T11:14:00.105828+0000","last_fullsized":"2024-05-10T11:14:00.105828+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:21.843152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106420+0000","last_change":"2024-05-10T11:13:58.099732+0000","last_active":"2024-05-10T11:14:00.106420+0000","last_peered":"2024-05-10T11:14:00.106420+0000","last_clean":"2024-05-10T11:14:00.106420+0000","last_became_active":"2024-05-10T11:13:58.099477+0000","last_became_peered":"2024-05-10T11:13:58.099477+0000","last_unstale":"2024-05-10T11:14:00.106420+0000","last_undegraded":"2024-05-10T11:14:00.106420+0000","last_fullsized":"2024-05-10T11:14:00.106420+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:42.680206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628907+0000","last_change":"2024-05-10T11:13:59.113538+0000","last_active":"2024-05-10T11:14:01.628907+0000","last_peered":"2024-05-10T11:14:01.628907+0000","last_clean":"2024-05-10T11:14:01.628907+0000","last_became_active":"2024-05-10T11:13:59.113273+0000","last_became_peered":"2024-05-10T11:13:59.113273+0000","last_unstale":"2024-05-10T11:14:01.628907+0000","last_undegraded":"2024-05-10T11:14:01.628907+0000","last_fullsized":"2024-05-10T11:14:01.628907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:08.244589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.105119+0000","last_change":"2024-05-10T11:13:58.101299+0000","last_active":"2024-05-10T11:13:58.105119+0000","last_peered":"2024-05-10T11:13:58.105119+0000","last_clean":"2024-05-10T11:13:58.105119+0000","last_became_active":"2024-05-10T11:13:58.101054+0000","last_became_peered":"2024-05-10T11:13:58.101054+0000","last_unstale":"2024-05-10T11:13:58.105119+0000","last_undegraded":"2024-05-10T11:13:58.105119+0000","last_fullsized":"2024-05-10T11:13:58.105119+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:05.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105509+0000","last_change":"2024-05-10T11:13:59.108481+0000","last_active":"2024-05-10T11:14:00.105509+0000","last_peered":"2024-05-10T11:14:00.105509+0000","last_clean":"2024-05-10T11:14:00.105509+0000","last_became_active":"2024-05-10T11:13:59.107666+0000","last_became_peered":"2024-05-10T11:13:59.107666+0000","last_unstale":"2024-05-10T11:14:00.105509+0000","last_undegraded":"2024-05-10T11:14:00.105509+0000","last_fullsized":"2024-05-10T11:14:00.105509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:50.547493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100937+0000","last_change":"2024-05-10T11:13:58.098786+0000","last_active":"2024-05-10T11:13:58.100937+0000","last_peered":"2024-05-10T11:13:58.100937+0000","last_clean":"2024-05-10T11:13:58.100937+0000","last_became_active":"2024-05-10T11:13:58.098493+0000","last_became_peered":"2024-05-10T11:13:58.098493+0000","last_unstale":"2024-05-10T11:13:58.100937+0000","last_undegraded":"2024-05-10T11:13:58.100937+0000","last_fullsized":"2024-05-10T11:13:58.100937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:41.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752916+0000","last_change":"2024-05-10T11:13:59.094660+0000","last_active":"2024-05-10T11:14:01.752916+0000","last_peered":"2024-05-10T11:14:01.752916+0000","last_clean":"2024-05-10T11:14:01.752916+0000","last_became_active":"2024-05-10T11:13:59.094387+0000","last_became_peered":"2024-05-10T11:13:59.094387+0000","last_unstale":"2024-05-10T11:14:01.752916+0000","last_undegraded":"2024-05-10T11:14:01.752916+0000","last_fullsized":"2024-05-10T11:14:01.752916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:24.662230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092780+0000","last_change":"2024-05-10T11:13:58.099005+0000","last_active":"2024-05-10T11:14:01.092780+0000","last_peered":"2024-05-10T11:14:01.092780+0000","last_clean":"2024-05-10T11:14:01.092780+0000","last_became_active":"2024-05-10T11:13:58.098706+0000","last_became_peered":"2024-05-10T11:13:58.098706+0000","last_unstale":"2024-05-10T11:14:01.092780+0000","last_undegraded":"2024-05-10T11:14:01.092780+0000","last_fullsized":"2024-05-10T11:14:01.092780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:28.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092864+0000","last_change":"2024-05-10T11:13:59.117376+0000","last_active":"2024-05-10T11:14:01.092864+0000","last_peered":"2024-05-10T11:14:01.092864+0000","last_clean":"2024-05-10T11:14:01.092864+0000","last_became_active":"2024-05-10T11:13:59.117021+0000","last_became_peered":"2024-05-10T11:13:59.117021+0000","last_unstale":"2024-05-10T11:14:01.092864+0000","last_undegraded":"2024-05-10T11:14:01.092864+0000","last_fullsized":"2024-05-10T11:14:01.092864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:45.588977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752969+0000","last_change":"2024-05-10T11:13:58.104838+0000","last_active":"2024-05-10T11:14:01.752969+0000","last_peered":"2024-05-10T11:14:01.752969+0000","last_clean":"2024-05-10T11:14:01.752969+0000","last_became_active":"2024-05-10T11:13:58.104561+0000","last_became_peered":"2024-05-10T11:13:58.104561+0000","last_unstale":"2024-05-10T11:14:01.752969+0000","last_undegraded":"2024-05-10T11:14:01.752969+0000","last_fullsized":"2024-05-10T11:14:01.752969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:03.246429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628929+0000","last_change":"2024-05-10T11:13:59.102183+0000","last_active":"2024-05-10T11:14:01.628929+0000","last_peered":"2024-05-10T11:14:01.628929+0000","last_clean":"2024-05-10T11:14:01.628929+0000","last_became_active":"2024-05-10T11:13:59.101909+0000","last_became_peered":"2024-05-10T11:13:59.101909+0000","last_unstale":"2024-05-10T11:14:01.628929+0000","last_undegraded":"2024-05-10T11:14:01.628929+0000","last_fullsized":"2024-05-10T11:14:01.628929+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:48.864661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752866+0000","last_change":"2024-05-10T11:13:58.103130+0000","last_active":"2024-05-10T11:14:01.752866+0000","last_peered":"2024-05-10T11:14:01.752866+0000","last_clean":"2024-05-10T11:14:01.752866+0000","last_became_active":"2024-05-10T11:13:58.102847+0000","last_became_peered":"2024-05-10T11:13:58.102847+0000","last_unstale":"2024-05-10T11:14:01.752866+0000","last_undegraded":"2024-05-10T11:14:01.752866+0000","last_fullsized":"2024-05-10T11:14:01.752866+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:25.311350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092935+0000","last_change":"2024-05-10T11:13:59.102043+0000","last_active":"2024-05-10T11:14:01.092935+0000","last_peered":"2024-05-10T11:14:01.092935+0000","last_clean":"2024-05-10T11:14:01.092935+0000","last_became_active":"2024-05-10T11:13:59.101792+0000","last_became_peered":"2024-05-10T11:13:59.101792+0000","last_unstale":"2024-05-10T11:14:01.092935+0000","last_undegraded":"2024-05-10T11:14:01.092935+0000","last_fullsized":"2024-05-10T11:14:01.092935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:25.490896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.100846+0000","last_change":"2024-05-10T11:13:58.099189+0000","last_active":"2024-05-10T11:13:58.100846+0000","last_peered":"2024-05-10T11:13:58.100846+0000","last_clean":"2024-05-10T11:13:58.100846+0000","last_became_active":"2024-05-10T11:13:58.098921+0000","last_became_peered":"2024-05-10T11:13:58.098921+0000","last_unstale":"2024-05-10T11:13:58.100846+0000","last_undegraded":"2024-05-10T11:13:58.100846+0000","last_fullsized":"2024-05-10T11:13:58.100846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:12.255023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753202+0000","last_change":"2024-05-10T11:13:59.110257+0000","last_active":"2024-05-10T11:14:01.753202+0000","last_peered":"2024-05-10T11:14:01.753202+0000","last_clean":"2024-05-10T11:14:01.753202+0000","last_became_active":"2024-05-10T11:13:59.109985+0000","last_became_peered":"2024-05-10T11:13:59.109985+0000","last_unstale":"2024-05-10T11:14:01.753202+0000","last_undegraded":"2024-05-10T11:14:01.753202+0000","last_fullsized":"2024-05-10T11:14:01.753202+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:01.471427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628998+0000","last_change":"2024-05-10T11:13:58.099908+0000","last_active":"2024-05-10T11:14:01.628998+0000","last_peered":"2024-05-10T11:14:01.628998+0000","last_clean":"2024-05-10T11:14:01.628998+0000","last_became_active":"2024-05-10T11:13:58.099636+0000","last_became_peered":"2024-05-10T11:13:58.099636+0000","last_unstale":"2024-05-10T11:14:01.628998+0000","last_undegraded":"2024-05-10T11:14:01.628998+0000","last_fullsized":"2024-05-10T11:14:01.628998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:27.567961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-05-10T11:13:58.093068+0000","last_change":"2024-05-10T11:13:58.093068+0000","last_active":"2024-05-10T11:13:58.078933+0000","last_peered":"2024-05-10T11:13:58.078933+0000","last_clean":"2024-05-10T11:13:58.078933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:13:58.093068+0000","last_undegraded":"2024-05-10T11:13:58.093068+0000","last_fullsized":"2024-05-10T11:13:58.093068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093151+0000","last_change":"2024-05-10T11:13:58.105492+0000","last_active":"2024-05-10T11:14:01.093151+0000","last_peered":"2024-05-10T11:14:01.093151+0000","last_clean":"2024-05-10T11:14:01.093151+0000","last_became_active":"2024-05-10T11:13:58.105077+0000","last_became_peered":"2024-05-10T11:13:58.105077+0000","last_unstale":"2024-05-10T11:14:01.093151+0000","last_undegraded":"2024-05-10T11:14:01.093151+0000","last_fullsized":"2024-05-10T11:14:01.093151+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:05.697634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":157,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-10T11:13:58.087640+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:13:58.087640+0000","last_peered":"2024-05-10T11:13:58.087640+0000","last_clean":"2024-05-10T11:13:58.087640+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:13:58.087640+0000","last_undegraded":"2024-05-10T11:13:58.087640+0000","last_fullsized":"2024-05-10T11:13:58.087640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":827634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":237266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":252759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":252737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":581632,"data_stored":251285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":841549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":244433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:14:04.729 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:14:04.729+0000 7f7f07851640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:14:07.698 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:14:07.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.815+0000 7f22184a0640 1 Processor -- start 2024-05-10T11:14:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.815+0000 7f22184a0640 1 -- start start 2024-05-10T11:14:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f22184a0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22100b8860 0x7f221006e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f22184a0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221015fc90 con 0x7f22100d0230 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f22184a0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22100b8c40 con 0x7f22100cfd80 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f22184a0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f221006ee50 con 0x7f22100b8860 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221623c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22100b8860 0x7f221006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221623c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22100b8860 0x7f221006e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34496/0 (socket says 172.21.15.66:34496) 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221623c640 1 -- 172.21.15.66:0/884126830 learned_addr learned my addr 172.21.15.66:0/884126830 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221623c640 1 -- 172.21.15.66:0/884126830 >> v1:172.21.15.190:6789/0 conn(0x7f22100cfd80 legacy=0x7f22100ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221623c640 1 -- 172.21.15.66:0/884126830 >> v1:172.21.15.66:6789/0 conn(0x7f22100d0230 legacy=0x7f22100cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221623c640 1 -- 172.21.15.66:0/884126830 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22100cd570 con 0x7f22100b8860 2024-05-10T11:14:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.816+0000 7f221523a640 1 -- 172.21.15.66:0/884126830 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218439254 0 0) 0x7f221015fc90 con 0x7f22100d0230 2024-05-10T11:14:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.817+0000 7f221623c640 1 --2- 172.21.15.66:0/884126830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f221006e520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f220c009870 tx=0x7f220c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0ade7d0b01a8eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.817+0000 7f221523a640 1 -- 172.21.15.66:0/884126830 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c037070 con 0x7f22100b8860 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.817+0000 7f221523a640 1 -- 172.21.15.66:0/884126830 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220c032440 con 0x7f22100b8860 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.817+0000 7f221523a640 1 -- 172.21.15.66:0/884126830 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c032810 con 0x7f22100b8860 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 -- 172.21.15.66:0/884126830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 msgr2=0x7f221006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 --2- 172.21.15.66:0/884126830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f221006e520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f220c009870 tx=0x7f220c02a210 comp rx=0 tx=0).stop 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 -- 172.21.15.66:0/884126830 shutdown_connections 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 --2- 172.21.15.66:0/884126830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f221006e520 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 -- 172.21.15.66:0/884126830 >> 172.21.15.66:0/884126830 conn(0x7f22100d2df0 msgr2=0x7f22100d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 -- 172.21.15.66:0/884126830 shutdown_connections 2024-05-10T11:14:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.818+0000 7f22184a0640 1 -- 172.21.15.66:0/884126830 wait complete. 2024-05-10T11:14:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.819+0000 7f22184a0640 1 Processor -- start 2024-05-10T11:14:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.819+0000 7f22184a0640 1 -- start start 2024-05-10T11:14:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f22184a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f22100cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f22184a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22100cfd80 0x7f2210158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f22184a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22100d0230 0x7f22100ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f22184a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22100cde10 con 0x7f22100b8860 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f22184a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f22100cdb30 con 0x7f22100d0230 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f22184a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f221006ea60 con 0x7f22100cfd80 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f22100cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f22100cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34504/0 (socket says 172.21.15.66:34504) 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 -- 172.21.15.66:0/4148433387 learned_addr learned my addr 172.21.15.66:0/4148433387 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f2215a3b640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22100cfd80 0x7f2210158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f2216a3d640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22100d0230 0x7f22100ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 -- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22100cfd80 msgr2=0x7f2210158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22100cfd80 0x7f2210158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 -- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22100d0230 msgr2=0x7f22100ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22100d0230 0x7f22100ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.820+0000 7f221623c640 1 -- 172.21.15.66:0/4148433387 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22100caec0 con 0x7f22100b8860 2024-05-10T11:14:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.821+0000 7f221623c640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f22100cb300 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f220c000c00 tx=0x7f220c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:07.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.821+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c041070 con 0x7f22100b8860 2024-05-10T11:14:07.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.821+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220c03c870 con 0x7f22100b8860 2024-05-10T11:14:07.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.821+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c037040 con 0x7f22100b8860 2024-05-10T11:14:07.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.821+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22100cb920 con 0x7f22100b8860 2024-05-10T11:14:07.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.821+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22100cbee0 con 0x7f22100b8860 2024-05-10T11:14:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.822+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221006a220 con 0x7f22100b8860 2024-05-10T11:14:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.823+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f220c044070 con 0x7f22100b8860 2024-05-10T11:14:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.823+0000 7f2206ffd640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f21f40762d0 0x7f21f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.823+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f220c0b8260 con 0x7f22100b8860 2024-05-10T11:14:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.823+0000 7f2215a3b640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f21f40762d0 0x7f21f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.824+0000 7f2215a3b640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f21f40762d0 0x7f21f4078790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2200007fd0 tx=0x7f2200009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:07.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:07.828+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f220c081a30 con 0x7f22100b8860 2024-05-10T11:14:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.016+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22100d1e20 con 0x7f21f40762d0 2024-05-10T11:14:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.023+0000 7f2206ffd640 1 -- 172.21.15.66:0/4148433387 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251909 (secure 0 0 0) 0x7f22100d1e20 con 0x7f21f40762d0 2024-05-10T11:14:08.025 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:14:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f21f40762d0 msgr2=0x7f21f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f21f40762d0 0x7f21f4078790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2200007fd0 tx=0x7f2200009040 comp rx=0 tx=0).stop 2024-05-10T11:14:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 msgr2=0x7f22100cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f22100cb300 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f220c000c00 tx=0x7f220c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 shutdown_connections 2024-05-10T11:14:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f21f40762d0 0x7f21f4078790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22100d0230 0x7f22100ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22100cfd80 0x7f2210158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 --2- 172.21.15.66:0/4148433387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22100b8860 0x7f22100cb300 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 >> 172.21.15.66:0/4148433387 conn(0x7f22100d2df0 msgr2=0x7f22100d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 shutdown_connections 2024-05-10T11:14:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.026+0000 7f22184a0640 1 -- 172.21.15.66:0/4148433387 wait complete. 2024-05-10T11:14:08.037 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-05-10T11:14:07.706018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221888,"kb_used_data":5704,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752832,"statfs":{"total":773094113280,"available":772866899968,"internally_reserved":0,"allocated":5840896,"data_stored":3194556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.618320"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105697+0000","last_change":"2024-05-10T11:13:59.106675+0000","last_active":"2024-05-10T11:14:00.105697+0000","last_peered":"2024-05-10T11:14:00.105697+0000","last_clean":"2024-05-10T11:14:00.105697+0000","last_became_active":"2024-05-10T11:13:59.104906+0000","last_became_peered":"2024-05-10T11:13:59.104906+0000","last_unstale":"2024-05-10T11:14:00.105697+0000","last_undegraded":"2024-05-10T11:14:00.105697+0000","last_fullsized":"2024-05-10T11:14:00.105697+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:39.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095655+0000","last_change":"2024-05-10T11:13:59.106668+0000","last_active":"2024-05-10T11:14:01.095655+0000","last_peered":"2024-05-10T11:14:01.095655+0000","last_clean":"2024-05-10T11:14:01.095655+0000","last_became_active":"2024-05-10T11:13:59.105386+0000","last_became_peered":"2024-05-10T11:13:59.105386+0000","last_unstale":"2024-05-10T11:14:01.095655+0000","last_undegraded":"2024-05-10T11:14:01.095655+0000","last_fullsized":"2024-05-10T11:14:01.095655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:44.759486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092955+0000","last_change":"2024-05-10T11:13:59.101893+0000","last_active":"2024-05-10T11:14:01.092955+0000","last_peered":"2024-05-10T11:14:01.092955+0000","last_clean":"2024-05-10T11:14:01.092955+0000","last_became_active":"2024-05-10T11:13:59.101342+0000","last_became_peered":"2024-05-10T11:13:59.101342+0000","last_unstale":"2024-05-10T11:14:01.092955+0000","last_undegraded":"2024-05-10T11:14:01.092955+0000","last_fullsized":"2024-05-10T11:14:01.092955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:24.662230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095439+0000","last_change":"2024-05-10T11:13:59.119170+0000","last_active":"2024-05-10T11:14:01.095439+0000","last_peered":"2024-05-10T11:14:01.095439+0000","last_clean":"2024-05-10T11:14:01.095439+0000","last_became_active":"2024-05-10T11:13:59.118931+0000","last_became_peered":"2024-05-10T11:13:59.118931+0000","last_unstale":"2024-05-10T11:14:01.095439+0000","last_undegraded":"2024-05-10T11:14:01.095439+0000","last_fullsized":"2024-05-10T11:14:01.095439+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:15.632461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798757+0000","last_change":"2024-05-10T11:13:59.106586+0000","last_active":"2024-05-10T11:14:00.798757+0000","last_peered":"2024-05-10T11:14:00.798757+0000","last_clean":"2024-05-10T11:14:00.798757+0000","last_became_active":"2024-05-10T11:13:59.105891+0000","last_became_peered":"2024-05-10T11:13:59.105891+0000","last_unstale":"2024-05-10T11:14:00.798757+0000","last_undegraded":"2024-05-10T11:14:00.798757+0000","last_fullsized":"2024-05-10T11:14:00.798757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:01.669852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105517+0000","last_change":"2024-05-10T11:13:59.106716+0000","last_active":"2024-05-10T11:14:00.105517+0000","last_peered":"2024-05-10T11:14:00.105517+0000","last_clean":"2024-05-10T11:14:00.105517+0000","last_became_active":"2024-05-10T11:13:59.106391+0000","last_became_peered":"2024-05-10T11:13:59.106391+0000","last_unstale":"2024-05-10T11:14:00.105517+0000","last_undegraded":"2024-05-10T11:14:00.105517+0000","last_fullsized":"2024-05-10T11:14:00.105517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:50.602243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092487+0000","last_change":"2024-05-10T11:13:59.105753+0000","last_active":"2024-05-10T11:14:01.092487+0000","last_peered":"2024-05-10T11:14:01.092487+0000","last_clean":"2024-05-10T11:14:01.092487+0000","last_became_active":"2024-05-10T11:13:59.105261+0000","last_became_peered":"2024-05-10T11:13:59.105261+0000","last_unstale":"2024-05-10T11:14:01.092487+0000","last_undegraded":"2024-05-10T11:14:01.092487+0000","last_fullsized":"2024-05-10T11:14:01.092487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:08.244589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753009+0000","last_change":"2024-05-10T11:13:59.097811+0000","last_active":"2024-05-10T11:14:01.753009+0000","last_peered":"2024-05-10T11:14:01.753009+0000","last_clean":"2024-05-10T11:14:01.753009+0000","last_became_active":"2024-05-10T11:13:59.095867+0000","last_became_peered":"2024-05-10T11:13:59.095867+0000","last_unstale":"2024-05-10T11:14:01.753009+0000","last_undegraded":"2024-05-10T11:14:01.753009+0000","last_fullsized":"2024-05-10T11:14:01.753009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:09.356540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753144+0000","last_change":"2024-05-10T11:13:59.112824+0000","last_active":"2024-05-10T11:14:01.753144+0000","last_peered":"2024-05-10T11:14:01.753144+0000","last_clean":"2024-05-10T11:14:01.753144+0000","last_became_active":"2024-05-10T11:13:59.112454+0000","last_became_peered":"2024-05-10T11:13:59.112454+0000","last_unstale":"2024-05-10T11:14:01.753144+0000","last_undegraded":"2024-05-10T11:14:01.753144+0000","last_fullsized":"2024-05-10T11:14:01.753144+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:40.838654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105686+0000","last_change":"2024-05-10T11:13:59.106359+0000","last_active":"2024-05-10T11:14:00.105686+0000","last_peered":"2024-05-10T11:14:00.105686+0000","last_clean":"2024-05-10T11:14:00.105686+0000","last_became_active":"2024-05-10T11:13:59.106080+0000","last_became_peered":"2024-05-10T11:13:59.106080+0000","last_unstale":"2024-05-10T11:14:00.105686+0000","last_undegraded":"2024-05-10T11:14:00.105686+0000","last_fullsized":"2024-05-10T11:14:00.105686+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:34.496936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106716+0000","last_change":"2024-05-10T11:13:59.107658+0000","last_active":"2024-05-10T11:14:00.106716+0000","last_peered":"2024-05-10T11:14:00.106716+0000","last_clean":"2024-05-10T11:14:00.106716+0000","last_became_active":"2024-05-10T11:13:59.107365+0000","last_became_peered":"2024-05-10T11:13:59.107365+0000","last_unstale":"2024-05-10T11:14:00.106716+0000","last_undegraded":"2024-05-10T11:14:00.106716+0000","last_fullsized":"2024-05-10T11:14:00.106716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:46.403463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753234+0000","last_change":"2024-05-10T11:13:59.112511+0000","last_active":"2024-05-10T11:14:01.753234+0000","last_peered":"2024-05-10T11:14:01.753234+0000","last_clean":"2024-05-10T11:14:01.753234+0000","last_became_active":"2024-05-10T11:13:59.111334+0000","last_became_peered":"2024-05-10T11:13:59.111334+0000","last_unstale":"2024-05-10T11:14:01.753234+0000","last_undegraded":"2024-05-10T11:14:01.753234+0000","last_fullsized":"2024-05-10T11:14:01.753234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:12:33.307214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105549+0000","last_change":"2024-05-10T11:13:59.108117+0000","last_active":"2024-05-10T11:14:00.105549+0000","last_peered":"2024-05-10T11:14:00.105549+0000","last_clean":"2024-05-10T11:14:00.105549+0000","last_became_active":"2024-05-10T11:13:59.107823+0000","last_became_peered":"2024-05-10T11:13:59.107823+0000","last_unstale":"2024-05-10T11:14:00.105549+0000","last_undegraded":"2024-05-10T11:14:00.105549+0000","last_fullsized":"2024-05-10T11:14:00.105549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:53.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092761+0000","last_change":"2024-05-10T11:13:59.101712+0000","last_active":"2024-05-10T11:14:01.092761+0000","last_peered":"2024-05-10T11:14:01.092761+0000","last_clean":"2024-05-10T11:14:01.092761+0000","last_became_active":"2024-05-10T11:13:59.101392+0000","last_became_peered":"2024-05-10T11:13:59.101392+0000","last_unstale":"2024-05-10T11:14:01.092761+0000","last_undegraded":"2024-05-10T11:14:01.092761+0000","last_fullsized":"2024-05-10T11:14:01.092761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:27.980151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095326+0000","last_change":"2024-05-10T11:13:59.104090+0000","last_active":"2024-05-10T11:14:01.095326+0000","last_peered":"2024-05-10T11:14:01.095326+0000","last_clean":"2024-05-10T11:14:01.095326+0000","last_became_active":"2024-05-10T11:13:59.103724+0000","last_became_peered":"2024-05-10T11:13:59.103724+0000","last_unstale":"2024-05-10T11:14:01.095326+0000","last_undegraded":"2024-05-10T11:14:01.095326+0000","last_fullsized":"2024-05-10T11:14:01.095326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:03.115597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105170+0000","last_change":"2024-05-10T11:13:59.105113+0000","last_active":"2024-05-10T11:14:00.105170+0000","last_peered":"2024-05-10T11:14:00.105170+0000","last_clean":"2024-05-10T11:14:00.105170+0000","last_became_active":"2024-05-10T11:13:59.104839+0000","last_became_peered":"2024-05-10T11:13:59.104839+0000","last_unstale":"2024-05-10T11:14:00.105170+0000","last_undegraded":"2024-05-10T11:14:00.105170+0000","last_fullsized":"2024-05-10T11:14:00.105170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:17.038077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093234+0000","last_change":"2024-05-10T11:13:59.104711+0000","last_active":"2024-05-10T11:14:01.093234+0000","last_peered":"2024-05-10T11:14:01.093234+0000","last_clean":"2024-05-10T11:14:01.093234+0000","last_became_active":"2024-05-10T11:13:59.104165+0000","last_became_peered":"2024-05-10T11:13:59.104165+0000","last_unstale":"2024-05-10T11:14:01.093234+0000","last_undegraded":"2024-05-10T11:14:01.093234+0000","last_fullsized":"2024-05-10T11:14:01.093234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:08.120414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095691+0000","last_change":"2024-05-10T11:13:59.108912+0000","last_active":"2024-05-10T11:14:01.095691+0000","last_peered":"2024-05-10T11:14:01.095691+0000","last_clean":"2024-05-10T11:14:01.095691+0000","last_became_active":"2024-05-10T11:13:59.105790+0000","last_became_peered":"2024-05-10T11:13:59.105790+0000","last_unstale":"2024-05-10T11:14:01.095691+0000","last_undegraded":"2024-05-10T11:14:01.095691+0000","last_fullsized":"2024-05-10T11:14:01.095691+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:43.348820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092822+0000","last_change":"2024-05-10T11:13:59.098424+0000","last_active":"2024-05-10T11:14:01.092822+0000","last_peered":"2024-05-10T11:14:01.092822+0000","last_clean":"2024-05-10T11:14:01.092822+0000","last_became_active":"2024-05-10T11:13:59.098148+0000","last_became_peered":"2024-05-10T11:13:59.098148+0000","last_unstale":"2024-05-10T11:14:01.092822+0000","last_undegraded":"2024-05-10T11:14:01.092822+0000","last_fullsized":"2024-05-10T11:14:01.092822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:54.088353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197176+0000","last_change":"2024-05-10T11:13:59.100302+0000","last_active":"2024-05-10T11:14:01.197176+0000","last_peered":"2024-05-10T11:14:01.197176+0000","last_clean":"2024-05-10T11:14:01.197176+0000","last_became_active":"2024-05-10T11:13:59.100057+0000","last_became_peered":"2024-05-10T11:13:59.100057+0000","last_unstale":"2024-05-10T11:14:01.197176+0000","last_undegraded":"2024-05-10T11:14:01.197176+0000","last_fullsized":"2024-05-10T11:14:01.197176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:25.808129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197176+0000","last_change":"2024-05-10T11:13:59.111347+0000","last_active":"2024-05-10T11:14:01.197176+0000","last_peered":"2024-05-10T11:14:01.197176+0000","last_clean":"2024-05-10T11:14:01.197176+0000","last_became_active":"2024-05-10T11:13:59.111068+0000","last_became_peered":"2024-05-10T11:13:59.111068+0000","last_unstale":"2024-05-10T11:14:01.197176+0000","last_undegraded":"2024-05-10T11:14:01.197176+0000","last_fullsized":"2024-05-10T11:14:01.197176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:17.807954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752888+0000","last_change":"2024-05-10T11:13:59.111979+0000","last_active":"2024-05-10T11:14:01.752888+0000","last_peered":"2024-05-10T11:14:01.752888+0000","last_clean":"2024-05-10T11:14:01.752888+0000","last_became_active":"2024-05-10T11:13:59.111660+0000","last_became_peered":"2024-05-10T11:13:59.111660+0000","last_unstale":"2024-05-10T11:14:01.752888+0000","last_undegraded":"2024-05-10T11:14:01.752888+0000","last_fullsized":"2024-05-10T11:14:01.752888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:25.490896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106555+0000","last_change":"2024-05-10T11:13:59.108589+0000","last_active":"2024-05-10T11:14:00.106555+0000","last_peered":"2024-05-10T11:14:00.106555+0000","last_clean":"2024-05-10T11:14:00.106555+0000","last_became_active":"2024-05-10T11:13:59.107803+0000","last_became_peered":"2024-05-10T11:13:59.107803+0000","last_unstale":"2024-05-10T11:14:00.106555+0000","last_undegraded":"2024-05-10T11:14:00.106555+0000","last_fullsized":"2024-05-10T11:14:00.106555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:20.477990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092426+0000","last_change":"2024-05-10T11:13:59.103151+0000","last_active":"2024-05-10T11:14:01.092426+0000","last_peered":"2024-05-10T11:14:01.092426+0000","last_clean":"2024-05-10T11:14:01.092426+0000","last_became_active":"2024-05-10T11:13:59.102660+0000","last_became_peered":"2024-05-10T11:13:59.102660+0000","last_unstale":"2024-05-10T11:14:01.092426+0000","last_undegraded":"2024-05-10T11:14:01.092426+0000","last_fullsized":"2024-05-10T11:14:01.092426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:29.283615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093329+0000","last_change":"2024-05-10T11:13:59.111970+0000","last_active":"2024-05-10T11:14:01.093329+0000","last_peered":"2024-05-10T11:14:01.093329+0000","last_clean":"2024-05-10T11:14:01.093329+0000","last_became_active":"2024-05-10T11:13:59.111705+0000","last_became_peered":"2024-05-10T11:13:59.111705+0000","last_unstale":"2024-05-10T11:14:01.093329+0000","last_undegraded":"2024-05-10T11:14:01.093329+0000","last_fullsized":"2024-05-10T11:14:01.093329+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:01.471427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753136+0000","last_change":"2024-05-10T11:13:59.099016+0000","last_active":"2024-05-10T11:14:01.753136+0000","last_peered":"2024-05-10T11:14:01.753136+0000","last_clean":"2024-05-10T11:14:01.753136+0000","last_became_active":"2024-05-10T11:13:59.098758+0000","last_became_peered":"2024-05-10T11:13:59.098758+0000","last_unstale":"2024-05-10T11:14:01.753136+0000","last_undegraded":"2024-05-10T11:14:01.753136+0000","last_fullsized":"2024-05-10T11:14:01.753136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:49.161270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105821+0000","last_change":"2024-05-10T11:13:59.115611+0000","last_active":"2024-05-10T11:14:00.105821+0000","last_peered":"2024-05-10T11:14:00.105821+0000","last_clean":"2024-05-10T11:14:00.105821+0000","last_became_active":"2024-05-10T11:13:59.115320+0000","last_became_peered":"2024-05-10T11:13:59.115320+0000","last_unstale":"2024-05-10T11:14:00.105821+0000","last_undegraded":"2024-05-10T11:14:00.105821+0000","last_fullsized":"2024-05-10T11:14:00.105821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:37.989192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197315+0000","last_change":"2024-05-10T11:13:59.104194+0000","last_active":"2024-05-10T11:14:01.197315+0000","last_peered":"2024-05-10T11:14:01.197315+0000","last_clean":"2024-05-10T11:14:01.197315+0000","last_became_active":"2024-05-10T11:13:59.103892+0000","last_became_peered":"2024-05-10T11:13:59.103892+0000","last_unstale":"2024-05-10T11:14:01.197315+0000","last_undegraded":"2024-05-10T11:14:01.197315+0000","last_fullsized":"2024-05-10T11:14:01.197315+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:39.721836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092693+0000","last_change":"2024-05-10T11:13:59.104155+0000","last_active":"2024-05-10T11:14:01.092693+0000","last_peered":"2024-05-10T11:14:01.092693+0000","last_clean":"2024-05-10T11:14:01.092693+0000","last_became_active":"2024-05-10T11:13:59.103871+0000","last_became_peered":"2024-05-10T11:13:59.103871+0000","last_unstale":"2024-05-10T11:14:01.092693+0000","last_undegraded":"2024-05-10T11:14:01.092693+0000","last_fullsized":"2024-05-10T11:14:01.092693+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:48.864661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095586+0000","last_change":"2024-05-10T11:13:59.108592+0000","last_active":"2024-05-10T11:14:01.095586+0000","last_peered":"2024-05-10T11:14:01.095586+0000","last_clean":"2024-05-10T11:14:01.095586+0000","last_became_active":"2024-05-10T11:13:59.107393+0000","last_became_peered":"2024-05-10T11:13:59.107393+0000","last_unstale":"2024-05-10T11:14:01.095586+0000","last_undegraded":"2024-05-10T11:14:01.095586+0000","last_fullsized":"2024-05-10T11:14:01.095586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:22.792708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092784+0000","last_change":"2024-05-10T11:13:59.105522+0000","last_active":"2024-05-10T11:14:01.092784+0000","last_peered":"2024-05-10T11:14:01.092784+0000","last_clean":"2024-05-10T11:14:01.092784+0000","last_became_active":"2024-05-10T11:13:59.103573+0000","last_became_peered":"2024-05-10T11:13:59.103573+0000","last_unstale":"2024-05-10T11:14:01.092784+0000","last_undegraded":"2024-05-10T11:14:01.092784+0000","last_fullsized":"2024-05-10T11:14:01.092784+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:29.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628880+0000","last_change":"2024-05-10T11:13:59.113306+0000","last_active":"2024-05-10T11:14:01.628880+0000","last_peered":"2024-05-10T11:14:01.628880+0000","last_clean":"2024-05-10T11:14:01.628880+0000","last_became_active":"2024-05-10T11:13:59.112891+0000","last_became_peered":"2024-05-10T11:13:59.112891+0000","last_unstale":"2024-05-10T11:14:01.628880+0000","last_undegraded":"2024-05-10T11:14:01.628880+0000","last_fullsized":"2024-05-10T11:14:01.628880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095193+0000","last_change":"2024-05-10T11:13:59.109363+0000","last_active":"2024-05-10T11:14:01.095193+0000","last_peered":"2024-05-10T11:14:01.095193+0000","last_clean":"2024-05-10T11:14:01.095193+0000","last_became_active":"2024-05-10T11:13:59.107160+0000","last_became_peered":"2024-05-10T11:13:59.107160+0000","last_unstale":"2024-05-10T11:14:01.095193+0000","last_undegraded":"2024-05-10T11:14:01.095193+0000","last_fullsized":"2024-05-10T11:14:01.095193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:03.374774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197179+0000","last_change":"2024-05-10T11:13:58.096652+0000","last_active":"2024-05-10T11:14:01.197179+0000","last_peered":"2024-05-10T11:14:01.197179+0000","last_clean":"2024-05-10T11:14:01.197179+0000","last_became_active":"2024-05-10T11:13:58.096366+0000","last_became_peered":"2024-05-10T11:13:58.096366+0000","last_unstale":"2024-05-10T11:14:01.197179+0000","last_undegraded":"2024-05-10T11:14:01.197179+0000","last_fullsized":"2024-05-10T11:14:01.197179+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:10:31.878108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.629059+0000","last_change":"2024-05-10T11:13:59.104836+0000","last_active":"2024-05-10T11:14:01.629059+0000","last_peered":"2024-05-10T11:14:01.629059+0000","last_clean":"2024-05-10T11:14:01.629059+0000","last_became_active":"2024-05-10T11:13:59.104557+0000","last_became_peered":"2024-05-10T11:13:59.104557+0000","last_unstale":"2024-05-10T11:14:01.629059+0000","last_undegraded":"2024-05-10T11:14:01.629059+0000","last_fullsized":"2024-05-10T11:14:01.629059+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:27.980151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105581+0000","last_change":"2024-05-10T11:13:58.108775+0000","last_active":"2024-05-10T11:14:00.105581+0000","last_peered":"2024-05-10T11:14:00.105581+0000","last_clean":"2024-05-10T11:14:00.105581+0000","last_became_active":"2024-05-10T11:13:58.108468+0000","last_became_peered":"2024-05-10T11:13:58.108468+0000","last_unstale":"2024-05-10T11:14:00.105581+0000","last_undegraded":"2024-05-10T11:14:00.105581+0000","last_fullsized":"2024-05-10T11:14:00.105581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:50.052578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197090+0000","last_change":"2024-05-10T11:13:59.111269+0000","last_active":"2024-05-10T11:14:01.197090+0000","last_peered":"2024-05-10T11:14:01.197090+0000","last_clean":"2024-05-10T11:14:01.197090+0000","last_became_active":"2024-05-10T11:13:59.110513+0000","last_became_peered":"2024-05-10T11:13:59.110513+0000","last_unstale":"2024-05-10T11:14:01.197090+0000","last_undegraded":"2024-05-10T11:14:01.197090+0000","last_fullsized":"2024-05-10T11:14:01.197090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:01.669852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105837+0000","last_change":"2024-05-10T11:13:58.098703+0000","last_active":"2024-05-10T11:14:00.105837+0000","last_peered":"2024-05-10T11:14:00.105837+0000","last_clean":"2024-05-10T11:14:00.105837+0000","last_became_active":"2024-05-10T11:13:58.098374+0000","last_became_peered":"2024-05-10T11:13:58.098374+0000","last_unstale":"2024-05-10T11:14:00.105837+0000","last_undegraded":"2024-05-10T11:14:00.105837+0000","last_fullsized":"2024-05-10T11:14:00.105837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:15.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753261+0000","last_change":"2024-05-10T11:13:59.096735+0000","last_active":"2024-05-10T11:14:01.753261+0000","last_peered":"2024-05-10T11:14:01.753261+0000","last_clean":"2024-05-10T11:14:01.753261+0000","last_became_active":"2024-05-10T11:13:59.096493+0000","last_became_peered":"2024-05-10T11:13:59.096493+0000","last_unstale":"2024-05-10T11:14:01.753261+0000","last_undegraded":"2024-05-10T11:14:01.753261+0000","last_fullsized":"2024-05-10T11:14:01.753261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:00.643704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.629014+0000","last_change":"2024-05-10T11:13:58.107382+0000","last_active":"2024-05-10T11:14:01.629014+0000","last_peered":"2024-05-10T11:14:01.629014+0000","last_clean":"2024-05-10T11:14:01.629014+0000","last_became_active":"2024-05-10T11:13:58.107139+0000","last_became_peered":"2024-05-10T11:13:58.107139+0000","last_unstale":"2024-05-10T11:14:01.629014+0000","last_undegraded":"2024-05-10T11:14:01.629014+0000","last_fullsized":"2024-05-10T11:14:01.629014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:52.409007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798786+0000","last_change":"2024-05-10T11:13:59.103397+0000","last_active":"2024-05-10T11:14:00.798786+0000","last_peered":"2024-05-10T11:14:00.798786+0000","last_clean":"2024-05-10T11:14:00.798786+0000","last_became_active":"2024-05-10T11:13:59.103096+0000","last_became_peered":"2024-05-10T11:13:59.103096+0000","last_unstale":"2024-05-10T11:14:00.798786+0000","last_undegraded":"2024-05-10T11:14:00.798786+0000","last_fullsized":"2024-05-10T11:14:00.798786+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:25.808129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092699+0000","last_change":"2024-05-10T11:13:58.106550+0000","last_active":"2024-05-10T11:14:01.092699+0000","last_peered":"2024-05-10T11:14:01.092699+0000","last_clean":"2024-05-10T11:14:01.092699+0000","last_became_active":"2024-05-10T11:13:58.106238+0000","last_became_peered":"2024-05-10T11:13:58.106238+0000","last_unstale":"2024-05-10T11:14:01.092699+0000","last_undegraded":"2024-05-10T11:14:01.092699+0000","last_fullsized":"2024-05-10T11:14:01.092699+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:16.035725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095518+0000","last_change":"2024-05-10T11:13:59.111590+0000","last_active":"2024-05-10T11:14:01.095518+0000","last_peered":"2024-05-10T11:14:01.095518+0000","last_clean":"2024-05-10T11:14:01.095518+0000","last_became_active":"2024-05-10T11:13:59.109246+0000","last_became_peered":"2024-05-10T11:13:59.109246+0000","last_unstale":"2024-05-10T11:14:01.095518+0000","last_undegraded":"2024-05-10T11:14:01.095518+0000","last_fullsized":"2024-05-10T11:14:01.095518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:14.434360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798471+0000","last_change":"2024-05-10T11:13:58.098405+0000","last_active":"2024-05-10T11:14:00.798471+0000","last_peered":"2024-05-10T11:14:00.798471+0000","last_clean":"2024-05-10T11:14:00.798471+0000","last_became_active":"2024-05-10T11:13:58.098115+0000","last_became_peered":"2024-05-10T11:13:58.098115+0000","last_unstale":"2024-05-10T11:14:00.798471+0000","last_undegraded":"2024-05-10T11:14:00.798471+0000","last_fullsized":"2024-05-10T11:14:00.798471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:44.967428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753282+0000","last_change":"2024-05-10T11:13:59.115658+0000","last_active":"2024-05-10T11:14:01.753282+0000","last_peered":"2024-05-10T11:14:01.753282+0000","last_clean":"2024-05-10T11:14:01.753282+0000","last_became_active":"2024-05-10T11:13:59.115392+0000","last_became_peered":"2024-05-10T11:13:59.115392+0000","last_unstale":"2024-05-10T11:14:01.753282+0000","last_undegraded":"2024-05-10T11:14:01.753282+0000","last_fullsized":"2024-05-10T11:14:01.753282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:56.803833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197025+0000","last_change":"2024-05-10T11:13:58.097819+0000","last_active":"2024-05-10T11:14:01.197025+0000","last_peered":"2024-05-10T11:14:01.197025+0000","last_clean":"2024-05-10T11:14:01.197025+0000","last_became_active":"2024-05-10T11:13:58.097490+0000","last_became_peered":"2024-05-10T11:13:58.097490+0000","last_unstale":"2024-05-10T11:14:01.197025+0000","last_undegraded":"2024-05-10T11:14:01.197025+0000","last_fullsized":"2024-05-10T11:14:01.197025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:12.255023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095640+0000","last_change":"2024-05-10T11:13:59.113261+0000","last_active":"2024-05-10T11:14:01.095640+0000","last_peered":"2024-05-10T11:14:01.095640+0000","last_clean":"2024-05-10T11:14:01.095640+0000","last_became_active":"2024-05-10T11:13:59.112988+0000","last_became_peered":"2024-05-10T11:13:59.112988+0000","last_unstale":"2024-05-10T11:14:01.095640+0000","last_undegraded":"2024-05-10T11:14:01.095640+0000","last_fullsized":"2024-05-10T11:14:01.095640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:50.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092310+0000","last_change":"2024-05-10T11:13:58.100789+0000","last_active":"2024-05-10T11:14:01.092310+0000","last_peered":"2024-05-10T11:14:01.092310+0000","last_clean":"2024-05-10T11:14:01.092310+0000","last_became_active":"2024-05-10T11:13:58.100512+0000","last_became_peered":"2024-05-10T11:13:58.100512+0000","last_unstale":"2024-05-10T11:14:01.092310+0000","last_undegraded":"2024-05-10T11:14:01.092310+0000","last_fullsized":"2024-05-10T11:14:01.092310+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:25.264746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798581+0000","last_change":"2024-05-10T11:13:59.105084+0000","last_active":"2024-05-10T11:14:00.798581+0000","last_peered":"2024-05-10T11:14:00.798581+0000","last_clean":"2024-05-10T11:14:00.798581+0000","last_became_active":"2024-05-10T11:13:59.104830+0000","last_became_peered":"2024-05-10T11:13:59.104830+0000","last_unstale":"2024-05-10T11:14:00.798581+0000","last_undegraded":"2024-05-10T11:14:00.798581+0000","last_fullsized":"2024-05-10T11:14:00.798581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:41.183350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095654+0000","last_change":"2024-05-10T11:13:58.098731+0000","last_active":"2024-05-10T11:14:01.095654+0000","last_peered":"2024-05-10T11:14:01.095654+0000","last_clean":"2024-05-10T11:14:01.095654+0000","last_became_active":"2024-05-10T11:13:58.098187+0000","last_became_peered":"2024-05-10T11:13:58.098187+0000","last_unstale":"2024-05-10T11:14:01.095654+0000","last_undegraded":"2024-05-10T11:14:01.095654+0000","last_fullsized":"2024-05-10T11:14:01.095654+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:24.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628867+0000","last_change":"2024-05-10T11:13:59.104673+0000","last_active":"2024-05-10T11:14:01.628867+0000","last_peered":"2024-05-10T11:14:01.628867+0000","last_clean":"2024-05-10T11:14:01.628867+0000","last_became_active":"2024-05-10T11:13:59.104092+0000","last_became_peered":"2024-05-10T11:13:59.104092+0000","last_unstale":"2024-05-10T11:14:01.628867+0000","last_undegraded":"2024-05-10T11:14:01.628867+0000","last_fullsized":"2024-05-10T11:14:01.628867+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:30.339111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798771+0000","last_change":"2024-05-10T11:13:58.097328+0000","last_active":"2024-05-10T11:14:00.798771+0000","last_peered":"2024-05-10T11:14:00.798771+0000","last_clean":"2024-05-10T11:14:00.798771+0000","last_became_active":"2024-05-10T11:13:58.097031+0000","last_became_peered":"2024-05-10T11:13:58.097031+0000","last_unstale":"2024-05-10T11:14:00.798771+0000","last_undegraded":"2024-05-10T11:14:00.798771+0000","last_fullsized":"2024-05-10T11:14:00.798771+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:01.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093064+0000","last_change":"2024-05-10T11:13:59.103181+0000","last_active":"2024-05-10T11:14:01.093064+0000","last_peered":"2024-05-10T11:14:01.093064+0000","last_clean":"2024-05-10T11:14:01.093064+0000","last_became_active":"2024-05-10T11:13:59.102892+0000","last_became_peered":"2024-05-10T11:13:59.102892+0000","last_unstale":"2024-05-10T11:14:01.093064+0000","last_undegraded":"2024-05-10T11:14:01.093064+0000","last_fullsized":"2024-05-10T11:14:01.093064+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:09.356540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095677+0000","last_change":"2024-05-10T11:13:58.100457+0000","last_active":"2024-05-10T11:14:01.095677+0000","last_peered":"2024-05-10T11:14:01.095677+0000","last_clean":"2024-05-10T11:14:01.095677+0000","last_became_active":"2024-05-10T11:13:58.100133+0000","last_became_peered":"2024-05-10T11:13:58.100133+0000","last_unstale":"2024-05-10T11:14:01.095677+0000","last_undegraded":"2024-05-10T11:14:01.095677+0000","last_fullsized":"2024-05-10T11:14:01.095677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:16.805602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798818+0000","last_change":"2024-05-10T11:13:59.100351+0000","last_active":"2024-05-10T11:14:00.798818+0000","last_peered":"2024-05-10T11:14:00.798818+0000","last_clean":"2024-05-10T11:14:00.798818+0000","last_became_active":"2024-05-10T11:13:59.096884+0000","last_became_peered":"2024-05-10T11:13:59.096884+0000","last_unstale":"2024-05-10T11:14:00.798818+0000","last_undegraded":"2024-05-10T11:14:00.798818+0000","last_fullsized":"2024-05-10T11:14:00.798818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:39.721836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753188+0000","last_change":"2024-05-10T11:13:58.103129+0000","last_active":"2024-05-10T11:14:01.753188+0000","last_peered":"2024-05-10T11:14:01.753188+0000","last_clean":"2024-05-10T11:14:01.753188+0000","last_became_active":"2024-05-10T11:13:58.102831+0000","last_became_peered":"2024-05-10T11:13:58.102831+0000","last_unstale":"2024-05-10T11:14:01.753188+0000","last_undegraded":"2024-05-10T11:14:01.753188+0000","last_fullsized":"2024-05-10T11:14:01.753188+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:14.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628866+0000","last_change":"2024-05-10T11:13:59.107364+0000","last_active":"2024-05-10T11:14:01.628866+0000","last_peered":"2024-05-10T11:14:01.628866+0000","last_clean":"2024-05-10T11:14:01.628866+0000","last_became_active":"2024-05-10T11:13:59.107094+0000","last_became_peered":"2024-05-10T11:13:59.107094+0000","last_unstale":"2024-05-10T11:14:01.628866+0000","last_undegraded":"2024-05-10T11:14:01.628866+0000","last_fullsized":"2024-05-10T11:14:01.628866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:15.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092820+0000","last_change":"2024-05-10T11:13:58.104807+0000","last_active":"2024-05-10T11:14:01.092820+0000","last_peered":"2024-05-10T11:14:01.092820+0000","last_clean":"2024-05-10T11:14:01.092820+0000","last_became_active":"2024-05-10T11:13:58.104538+0000","last_became_peered":"2024-05-10T11:13:58.104538+0000","last_unstale":"2024-05-10T11:14:01.092820+0000","last_undegraded":"2024-05-10T11:14:01.092820+0000","last_fullsized":"2024-05-10T11:14:01.092820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:20.746955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093122+0000","last_change":"2024-05-10T11:13:59.110605+0000","last_active":"2024-05-10T11:14:01.093122+0000","last_peered":"2024-05-10T11:14:01.093122+0000","last_clean":"2024-05-10T11:14:01.093122+0000","last_became_active":"2024-05-10T11:13:59.110274+0000","last_became_peered":"2024-05-10T11:13:59.110274+0000","last_unstale":"2024-05-10T11:14:01.093122+0000","last_undegraded":"2024-05-10T11:14:01.093122+0000","last_fullsized":"2024-05-10T11:14:01.093122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:49.161270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197042+0000","last_change":"2024-05-10T11:13:58.100301+0000","last_active":"2024-05-10T11:14:01.197042+0000","last_peered":"2024-05-10T11:14:01.197042+0000","last_clean":"2024-05-10T11:14:01.197042+0000","last_became_active":"2024-05-10T11:13:58.100038+0000","last_became_peered":"2024-05-10T11:13:58.100038+0000","last_unstale":"2024-05-10T11:14:01.197042+0000","last_undegraded":"2024-05-10T11:14:01.197042+0000","last_fullsized":"2024-05-10T11:14:01.197042+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:17.632714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753171+0000","last_change":"2024-05-10T11:13:59.111998+0000","last_active":"2024-05-10T11:14:01.753171+0000","last_peered":"2024-05-10T11:14:01.753171+0000","last_clean":"2024-05-10T11:14:01.753171+0000","last_became_active":"2024-05-10T11:13:59.111688+0000","last_became_peered":"2024-05-10T11:13:59.111688+0000","last_unstale":"2024-05-10T11:14:01.753171+0000","last_undegraded":"2024-05-10T11:14:01.753171+0000","last_fullsized":"2024-05-10T11:14:01.753171+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:08.120414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095451+0000","last_change":"2024-05-10T11:13:58.098650+0000","last_active":"2024-05-10T11:14:01.095451+0000","last_peered":"2024-05-10T11:14:01.095451+0000","last_clean":"2024-05-10T11:14:01.095451+0000","last_became_active":"2024-05-10T11:13:58.098172+0000","last_became_peered":"2024-05-10T11:13:58.098172+0000","last_unstale":"2024-05-10T11:14:01.095451+0000","last_undegraded":"2024-05-10T11:14:01.095451+0000","last_fullsized":"2024-05-10T11:14:01.095451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:40.180999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093223+0000","last_change":"2024-05-10T11:13:59.106640+0000","last_active":"2024-05-10T11:14:01.093223+0000","last_peered":"2024-05-10T11:14:01.093223+0000","last_clean":"2024-05-10T11:14:01.093223+0000","last_became_active":"2024-05-10T11:13:59.106381+0000","last_became_peered":"2024-05-10T11:13:59.106381+0000","last_unstale":"2024-05-10T11:14:01.093223+0000","last_undegraded":"2024-05-10T11:14:01.093223+0000","last_fullsized":"2024-05-10T11:14:01.093223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:40.838654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753068+0000","last_change":"2024-05-10T11:13:58.104546+0000","last_active":"2024-05-10T11:14:01.753068+0000","last_peered":"2024-05-10T11:14:01.753068+0000","last_clean":"2024-05-10T11:14:01.753068+0000","last_became_active":"2024-05-10T11:13:58.104248+0000","last_became_peered":"2024-05-10T11:13:58.104248+0000","last_unstale":"2024-05-10T11:14:01.753068+0000","last_undegraded":"2024-05-10T11:14:01.753068+0000","last_fullsized":"2024-05-10T11:14:01.753068+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:00.411668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753130+0000","last_change":"2024-05-10T11:13:59.100823+0000","last_active":"2024-05-10T11:14:01.753130+0000","last_peered":"2024-05-10T11:14:01.753130+0000","last_clean":"2024-05-10T11:14:01.753130+0000","last_became_active":"2024-05-10T11:13:59.100521+0000","last_became_peered":"2024-05-10T11:13:59.100521+0000","last_unstale":"2024-05-10T11:14:01.753130+0000","last_undegraded":"2024-05-10T11:14:01.753130+0000","last_fullsized":"2024-05-10T11:14:01.753130+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:52.850375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093284+0000","last_change":"2024-05-10T11:13:58.096733+0000","last_active":"2024-05-10T11:14:01.093284+0000","last_peered":"2024-05-10T11:14:01.093284+0000","last_clean":"2024-05-10T11:14:01.093284+0000","last_became_active":"2024-05-10T11:13:58.094522+0000","last_became_peered":"2024-05-10T11:13:58.094522+0000","last_unstale":"2024-05-10T11:14:01.093284+0000","last_undegraded":"2024-05-10T11:14:01.093284+0000","last_fullsized":"2024-05-10T11:14:01.093284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:49.545141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105288+0000","last_change":"2024-05-10T11:13:59.116492+0000","last_active":"2024-05-10T11:14:00.105288+0000","last_peered":"2024-05-10T11:14:00.105288+0000","last_clean":"2024-05-10T11:14:00.105288+0000","last_became_active":"2024-05-10T11:13:59.116207+0000","last_became_peered":"2024-05-10T11:13:59.116207+0000","last_unstale":"2024-05-10T11:14:00.105288+0000","last_undegraded":"2024-05-10T11:14:00.105288+0000","last_fullsized":"2024-05-10T11:14:00.105288+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:06.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106744+0000","last_change":"2024-05-10T11:13:58.098164+0000","last_active":"2024-05-10T11:14:00.106744+0000","last_peered":"2024-05-10T11:14:00.106744+0000","last_clean":"2024-05-10T11:14:00.106744+0000","last_became_active":"2024-05-10T11:13:58.097916+0000","last_became_peered":"2024-05-10T11:13:58.097916+0000","last_unstale":"2024-05-10T11:14:00.106744+0000","last_undegraded":"2024-05-10T11:14:00.106744+0000","last_fullsized":"2024-05-10T11:14:00.106744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:40.971274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798604+0000","last_change":"2024-05-10T11:13:59.101768+0000","last_active":"2024-05-10T11:14:00.798604+0000","last_peered":"2024-05-10T11:14:00.798604+0000","last_clean":"2024-05-10T11:14:00.798604+0000","last_became_active":"2024-05-10T11:13:59.101527+0000","last_became_peered":"2024-05-10T11:13:59.101527+0000","last_unstale":"2024-05-10T11:14:00.798604+0000","last_undegraded":"2024-05-10T11:14:00.798604+0000","last_fullsized":"2024-05-10T11:14:00.798604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:17.807954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197344+0000","last_change":"2024-05-10T11:13:58.101899+0000","last_active":"2024-05-10T11:14:01.197344+0000","last_peered":"2024-05-10T11:14:01.197344+0000","last_clean":"2024-05-10T11:14:01.197344+0000","last_became_active":"2024-05-10T11:13:58.101701+0000","last_became_peered":"2024-05-10T11:13:58.101701+0000","last_unstale":"2024-05-10T11:14:01.197344+0000","last_undegraded":"2024-05-10T11:14:01.197344+0000","last_fullsized":"2024-05-10T11:14:01.197344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:50:44.967428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105638+0000","last_change":"2024-05-10T11:13:59.107449+0000","last_active":"2024-05-10T11:14:00.105638+0000","last_peered":"2024-05-10T11:14:00.105638+0000","last_clean":"2024-05-10T11:14:00.105638+0000","last_became_active":"2024-05-10T11:13:59.106820+0000","last_became_peered":"2024-05-10T11:13:59.106820+0000","last_unstale":"2024-05-10T11:14:00.105638+0000","last_undegraded":"2024-05-10T11:14:00.105638+0000","last_fullsized":"2024-05-10T11:14:00.105638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:28.570313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197341+0000","last_change":"2024-05-10T11:13:58.108564+0000","last_active":"2024-05-10T11:14:01.197341+0000","last_peered":"2024-05-10T11:14:01.197341+0000","last_clean":"2024-05-10T11:14:01.197341+0000","last_became_active":"2024-05-10T11:13:58.108327+0000","last_became_peered":"2024-05-10T11:13:58.108327+0000","last_unstale":"2024-05-10T11:14:01.197341+0000","last_undegraded":"2024-05-10T11:14:01.197341+0000","last_fullsized":"2024-05-10T11:14:01.197341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:07.612909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628908+0000","last_change":"2024-05-10T11:13:59.097564+0000","last_active":"2024-05-10T11:14:01.628908+0000","last_peered":"2024-05-10T11:14:01.628908+0000","last_clean":"2024-05-10T11:14:01.628908+0000","last_became_active":"2024-05-10T11:13:59.097201+0000","last_became_peered":"2024-05-10T11:13:59.097201+0000","last_unstale":"2024-05-10T11:14:01.628908+0000","last_undegraded":"2024-05-10T11:14:01.628908+0000","last_fullsized":"2024-05-10T11:14:01.628908+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:29.283615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105605+0000","last_change":"2024-05-10T11:13:58.099890+0000","last_active":"2024-05-10T11:14:00.105605+0000","last_peered":"2024-05-10T11:14:00.105605+0000","last_clean":"2024-05-10T11:14:00.105605+0000","last_became_active":"2024-05-10T11:13:58.099642+0000","last_became_peered":"2024-05-10T11:13:58.099642+0000","last_unstale":"2024-05-10T11:14:00.105605+0000","last_undegraded":"2024-05-10T11:14:00.105605+0000","last_fullsized":"2024-05-10T11:14:00.105605+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:24.898322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197350+0000","last_change":"2024-05-10T11:13:59.110583+0000","last_active":"2024-05-10T11:14:01.197350+0000","last_peered":"2024-05-10T11:14:01.197350+0000","last_clean":"2024-05-10T11:14:01.197350+0000","last_became_active":"2024-05-10T11:13:59.110231+0000","last_became_peered":"2024-05-10T11:13:59.110231+0000","last_unstale":"2024-05-10T11:14:01.197350+0000","last_undegraded":"2024-05-10T11:14:01.197350+0000","last_fullsized":"2024-05-10T11:14:01.197350+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:32.806537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752729+0000","last_change":"2024-05-10T11:13:58.104514+0000","last_active":"2024-05-10T11:14:01.752729+0000","last_peered":"2024-05-10T11:14:01.752729+0000","last_clean":"2024-05-10T11:14:01.752729+0000","last_became_active":"2024-05-10T11:13:58.104215+0000","last_became_peered":"2024-05-10T11:13:58.104215+0000","last_unstale":"2024-05-10T11:14:01.752729+0000","last_undegraded":"2024-05-10T11:14:01.752729+0000","last_fullsized":"2024-05-10T11:14:01.752729+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:20.840800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093135+0000","last_change":"2024-05-10T11:13:59.106152+0000","last_active":"2024-05-10T11:14:01.093135+0000","last_peered":"2024-05-10T11:14:01.093135+0000","last_clean":"2024-05-10T11:14:01.093135+0000","last_became_active":"2024-05-10T11:13:59.105900+0000","last_became_peered":"2024-05-10T11:13:59.105900+0000","last_unstale":"2024-05-10T11:14:01.093135+0000","last_undegraded":"2024-05-10T11:14:01.093135+0000","last_fullsized":"2024-05-10T11:14:01.093135+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:52.850375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092579+0000","last_change":"2024-05-10T11:13:58.104683+0000","last_active":"2024-05-10T11:14:01.092579+0000","last_peered":"2024-05-10T11:14:01.092579+0000","last_clean":"2024-05-10T11:14:01.092579+0000","last_became_active":"2024-05-10T11:13:58.104419+0000","last_became_peered":"2024-05-10T11:13:58.104419+0000","last_unstale":"2024-05-10T11:14:01.092579+0000","last_undegraded":"2024-05-10T11:14:01.092579+0000","last_fullsized":"2024-05-10T11:14:01.092579+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:20.844144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105828+0000","last_change":"2024-05-10T11:13:59.117498+0000","last_active":"2024-05-10T11:14:00.105828+0000","last_peered":"2024-05-10T11:14:00.105828+0000","last_clean":"2024-05-10T11:14:00.105828+0000","last_became_active":"2024-05-10T11:13:59.117219+0000","last_became_peered":"2024-05-10T11:13:59.117219+0000","last_unstale":"2024-05-10T11:14:00.105828+0000","last_undegraded":"2024-05-10T11:14:00.105828+0000","last_fullsized":"2024-05-10T11:14:00.105828+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:21.843152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.106420+0000","last_change":"2024-05-10T11:13:58.099732+0000","last_active":"2024-05-10T11:14:00.106420+0000","last_peered":"2024-05-10T11:14:00.106420+0000","last_clean":"2024-05-10T11:14:00.106420+0000","last_became_active":"2024-05-10T11:13:58.099477+0000","last_became_peered":"2024-05-10T11:13:58.099477+0000","last_unstale":"2024-05-10T11:14:00.106420+0000","last_undegraded":"2024-05-10T11:14:00.106420+0000","last_fullsized":"2024-05-10T11:14:00.106420+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:42.680206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628907+0000","last_change":"2024-05-10T11:13:59.113538+0000","last_active":"2024-05-10T11:14:01.628907+0000","last_peered":"2024-05-10T11:14:01.628907+0000","last_clean":"2024-05-10T11:14:01.628907+0000","last_became_active":"2024-05-10T11:13:59.113273+0000","last_became_peered":"2024-05-10T11:13:59.113273+0000","last_unstale":"2024-05-10T11:14:01.628907+0000","last_undegraded":"2024-05-10T11:14:01.628907+0000","last_fullsized":"2024-05-10T11:14:01.628907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:08.244589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.197276+0000","last_change":"2024-05-10T11:13:58.101299+0000","last_active":"2024-05-10T11:14:01.197276+0000","last_peered":"2024-05-10T11:14:01.197276+0000","last_clean":"2024-05-10T11:14:01.197276+0000","last_became_active":"2024-05-10T11:13:58.101054+0000","last_became_peered":"2024-05-10T11:13:58.101054+0000","last_unstale":"2024-05-10T11:14:01.197276+0000","last_undegraded":"2024-05-10T11:14:01.197276+0000","last_fullsized":"2024-05-10T11:14:01.197276+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:27.401728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.105509+0000","last_change":"2024-05-10T11:13:59.108481+0000","last_active":"2024-05-10T11:14:00.105509+0000","last_peered":"2024-05-10T11:14:00.105509+0000","last_clean":"2024-05-10T11:14:00.105509+0000","last_became_active":"2024-05-10T11:13:59.107666+0000","last_became_peered":"2024-05-10T11:13:59.107666+0000","last_unstale":"2024-05-10T11:14:00.105509+0000","last_undegraded":"2024-05-10T11:14:00.105509+0000","last_fullsized":"2024-05-10T11:14:00.105509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:50.547493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095680+0000","last_change":"2024-05-10T11:13:58.098786+0000","last_active":"2024-05-10T11:14:01.095680+0000","last_peered":"2024-05-10T11:14:01.095680+0000","last_clean":"2024-05-10T11:14:01.095680+0000","last_became_active":"2024-05-10T11:13:58.098493+0000","last_became_peered":"2024-05-10T11:13:58.098493+0000","last_unstale":"2024-05-10T11:14:01.095680+0000","last_undegraded":"2024-05-10T11:14:01.095680+0000","last_fullsized":"2024-05-10T11:14:01.095680+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:00.667501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752916+0000","last_change":"2024-05-10T11:13:59.094660+0000","last_active":"2024-05-10T11:14:01.752916+0000","last_peered":"2024-05-10T11:14:01.752916+0000","last_clean":"2024-05-10T11:14:01.752916+0000","last_became_active":"2024-05-10T11:13:59.094387+0000","last_became_peered":"2024-05-10T11:13:59.094387+0000","last_unstale":"2024-05-10T11:14:01.752916+0000","last_undegraded":"2024-05-10T11:14:01.752916+0000","last_fullsized":"2024-05-10T11:14:01.752916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:24.662230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092780+0000","last_change":"2024-05-10T11:13:58.099005+0000","last_active":"2024-05-10T11:14:01.092780+0000","last_peered":"2024-05-10T11:14:01.092780+0000","last_clean":"2024-05-10T11:14:01.092780+0000","last_became_active":"2024-05-10T11:13:58.098706+0000","last_became_peered":"2024-05-10T11:13:58.098706+0000","last_unstale":"2024-05-10T11:14:01.092780+0000","last_undegraded":"2024-05-10T11:14:01.092780+0000","last_fullsized":"2024-05-10T11:14:01.092780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:28.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092864+0000","last_change":"2024-05-10T11:13:59.117376+0000","last_active":"2024-05-10T11:14:01.092864+0000","last_peered":"2024-05-10T11:14:01.092864+0000","last_clean":"2024-05-10T11:14:01.092864+0000","last_became_active":"2024-05-10T11:13:59.117021+0000","last_became_peered":"2024-05-10T11:13:59.117021+0000","last_unstale":"2024-05-10T11:14:01.092864+0000","last_undegraded":"2024-05-10T11:14:01.092864+0000","last_fullsized":"2024-05-10T11:14:01.092864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:45.588977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752969+0000","last_change":"2024-05-10T11:13:58.104838+0000","last_active":"2024-05-10T11:14:01.752969+0000","last_peered":"2024-05-10T11:14:01.752969+0000","last_clean":"2024-05-10T11:14:01.752969+0000","last_became_active":"2024-05-10T11:13:58.104561+0000","last_became_peered":"2024-05-10T11:13:58.104561+0000","last_unstale":"2024-05-10T11:14:01.752969+0000","last_undegraded":"2024-05-10T11:14:01.752969+0000","last_fullsized":"2024-05-10T11:14:01.752969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:03.246429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628929+0000","last_change":"2024-05-10T11:13:59.102183+0000","last_active":"2024-05-10T11:14:01.628929+0000","last_peered":"2024-05-10T11:14:01.628929+0000","last_clean":"2024-05-10T11:14:01.628929+0000","last_became_active":"2024-05-10T11:13:59.101909+0000","last_became_peered":"2024-05-10T11:13:59.101909+0000","last_unstale":"2024-05-10T11:14:01.628929+0000","last_undegraded":"2024-05-10T11:14:01.628929+0000","last_fullsized":"2024-05-10T11:14:01.628929+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:48.864661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.752866+0000","last_change":"2024-05-10T11:13:58.103130+0000","last_active":"2024-05-10T11:14:01.752866+0000","last_peered":"2024-05-10T11:14:01.752866+0000","last_clean":"2024-05-10T11:14:01.752866+0000","last_became_active":"2024-05-10T11:13:58.102847+0000","last_became_peered":"2024-05-10T11:13:58.102847+0000","last_unstale":"2024-05-10T11:14:01.752866+0000","last_undegraded":"2024-05-10T11:14:01.752866+0000","last_fullsized":"2024-05-10T11:14:01.752866+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:25.311350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.092935+0000","last_change":"2024-05-10T11:13:59.102043+0000","last_active":"2024-05-10T11:14:01.092935+0000","last_peered":"2024-05-10T11:14:01.092935+0000","last_clean":"2024-05-10T11:14:01.092935+0000","last_became_active":"2024-05-10T11:13:59.101792+0000","last_became_peered":"2024-05-10T11:13:59.101792+0000","last_unstale":"2024-05-10T11:14:01.092935+0000","last_undegraded":"2024-05-10T11:14:01.092935+0000","last_fullsized":"2024-05-10T11:14:01.092935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:25.490896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:00.798439+0000","last_change":"2024-05-10T11:13:58.099189+0000","last_active":"2024-05-10T11:14:00.798439+0000","last_peered":"2024-05-10T11:14:00.798439+0000","last_clean":"2024-05-10T11:14:00.798439+0000","last_became_active":"2024-05-10T11:13:58.098921+0000","last_became_peered":"2024-05-10T11:13:58.098921+0000","last_unstale":"2024-05-10T11:14:00.798439+0000","last_undegraded":"2024-05-10T11:14:00.798439+0000","last_fullsized":"2024-05-10T11:14:00.798439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:36:07.612909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.753202+0000","last_change":"2024-05-10T11:13:59.110257+0000","last_active":"2024-05-10T11:14:01.753202+0000","last_peered":"2024-05-10T11:14:01.753202+0000","last_clean":"2024-05-10T11:14:01.753202+0000","last_became_active":"2024-05-10T11:13:59.109985+0000","last_became_peered":"2024-05-10T11:13:59.109985+0000","last_unstale":"2024-05-10T11:14:01.753202+0000","last_undegraded":"2024-05-10T11:14:01.753202+0000","last_fullsized":"2024-05-10T11:14:01.753202+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:01.471427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.628998+0000","last_change":"2024-05-10T11:13:58.099908+0000","last_active":"2024-05-10T11:14:01.628998+0000","last_peered":"2024-05-10T11:14:01.628998+0000","last_clean":"2024-05-10T11:14:01.628998+0000","last_became_active":"2024-05-10T11:13:58.099636+0000","last_became_peered":"2024-05-10T11:13:58.099636+0000","last_unstale":"2024-05-10T11:14:01.628998+0000","last_undegraded":"2024-05-10T11:14:01.628998+0000","last_fullsized":"2024-05-10T11:14:01.628998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:27.567961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.196972+0000","last_change":"2024-05-10T11:13:59.103344+0000","last_active":"2024-05-10T11:14:01.196972+0000","last_peered":"2024-05-10T11:14:01.196972+0000","last_clean":"2024-05-10T11:14:01.196972+0000","last_became_active":"2024-05-10T11:13:59.103079+0000","last_became_peered":"2024-05-10T11:13:59.103079+0000","last_unstale":"2024-05-10T11:14:01.196972+0000","last_undegraded":"2024-05-10T11:14:01.196972+0000","last_fullsized":"2024-05-10T11:14:01.196972+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:58.078933+0000","last_clean_scrub_stamp":"2024-05-10T11:13:58.078933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:41.183350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.093151+0000","last_change":"2024-05-10T11:13:58.105492+0000","last_active":"2024-05-10T11:14:01.093151+0000","last_peered":"2024-05-10T11:14:01.093151+0000","last_clean":"2024-05-10T11:14:01.093151+0000","last_became_active":"2024-05-10T11:13:58.105077+0000","last_became_peered":"2024-05-10T11:13:58.105077+0000","last_unstale":"2024-05-10T11:14:01.093151+0000","last_undegraded":"2024-05-10T11:14:01.093151+0000","last_fullsized":"2024-05-10T11:14:01.093151+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:13:57.076581+0000","last_clean_scrub_stamp":"2024-05-10T11:13:57.076581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:05.697634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":161,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T11:14:01.095161+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:14:01.095161+0000","last_peered":"2024-05-10T11:14:01.095161+0000","last_clean":"2024-05-10T11:14:01.095161+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:14:01.095161+0000","last_undegraded":"2024-05-10T11:14:01.095161+0000","last_fullsized":"2024-05-10T11:14:01.095161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":841617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":251777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":251707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":252759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":252737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":581632,"data_stored":251285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":841549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":251125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:14:08.041 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:14:08.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:14:08.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.188+0000 7f9dd9371640 1 Processor -- start 2024-05-10T11:14:08.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.188+0000 7f9dd9371640 1 -- start start 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd9371640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9dd4162bc0 0x7f9dd40d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd9371640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd4162fa0 con 0x7f9dd40b3500 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd9371640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd40d2f70 con 0x7f9dd40d2230 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd9371640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd40d1170 con 0x7f9dd4162bc0 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd2ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9dd4162bc0 0x7f9dd40d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd37fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9dd40b3500 0x7f9dd40d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34418/0 (socket says 172.21.15.66:34418) 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd37fe640 1 -- 172.21.15.66:0/1631317061 learned_addr learned my addr 172.21.15.66:0/1631317061 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd2ffd640 1 -- 172.21.15.66:0/1631317061 >> v1:172.21.15.190:6789/0 conn(0x7f9dd40d2230 legacy=0x7f9dd40cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd2ffd640 1 -- 172.21.15.66:0/1631317061 >> v1:172.21.15.66:6789/0 conn(0x7f9dd40b3500 legacy=0x7f9dd40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.189+0000 7f9dd2ffd640 1 -- 172.21.15.66:0/1631317061 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd40d3250 con 0x7f9dd4162bc0 2024-05-10T11:14:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.190+0000 7f9dd2ffd640 1 --2- 172.21.15.66:0/1631317061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd4162bc0 0x7f9dd40d3770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40097a0 tx=0x7f9dc402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df1fd6c7ca2273b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.190+0000 7f9dd1ffb640 1 -- 172.21.15.66:0/1631317061 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4037070 con 0x7f9dd4162bc0 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.190+0000 7f9dd1ffb640 1 -- 172.21.15.66:0/1631317061 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc402ae50 con 0x7f9dd4162bc0 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.190+0000 7f9dd1ffb640 1 -- 172.21.15.66:0/1631317061 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4032660 con 0x7f9dd4162bc0 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 -- 172.21.15.66:0/1631317061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd4162bc0 msgr2=0x7f9dd40d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 --2- 172.21.15.66:0/1631317061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd4162bc0 0x7f9dd40d3770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40097a0 tx=0x7f9dc402a140 comp rx=0 tx=0).stop 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 -- 172.21.15.66:0/1631317061 shutdown_connections 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 --2- 172.21.15.66:0/1631317061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd4162bc0 0x7f9dd40d3770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 -- 172.21.15.66:0/1631317061 >> 172.21.15.66:0/1631317061 conn(0x7f9dd40d5190 msgr2=0x7f9dd40d55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 -- 172.21.15.66:0/1631317061 shutdown_connections 2024-05-10T11:14:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.191+0000 7f9dd9371640 1 -- 172.21.15.66:0/1631317061 wait complete. 2024-05-10T11:14:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.192+0000 7f9dd9371640 1 Processor -- start 2024-05-10T11:14:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.192+0000 7f9dd9371640 1 -- start start 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd9371640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd40b3500 0x7f9dd4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd9371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 0x7f9dd415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd9371640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd4162bc0 0x7f9dd415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd9371640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40b1cf0 con 0x7f9dd40d2230 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd9371640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40d5f90 con 0x7f9dd4162bc0 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd9371640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd40d0b50 con 0x7f9dd40b3500 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 0x7f9dd415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 0x7f9dd415e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34512/0 (socket says 172.21.15.66:34512) 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 -- 172.21.15.66:0/3727399648 learned_addr learned my addr 172.21.15.66:0/3727399648 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd2ffd640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd40b3500 0x7f9dd4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd37fe640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd4162bc0 0x7f9dd415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 -- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd40b3500 msgr2=0x7f9dd4152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd40b3500 0x7f9dd4152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 -- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd4162bc0 msgr2=0x7f9dd415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd4162bc0 0x7f9dd415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd27fc640 1 -- 172.21.15.66:0/3727399648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd409ef10 con 0x7f9dd40d2230 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.193+0000 7f9dd37fe640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd4162bc0 0x7f9dd415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.194+0000 7f9dd27fc640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 0x7f9dd415e4b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b3e0 tx=0x7f9dc800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.194+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8015020 con 0x7f9dd40d2230 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.194+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc8011850 con 0x7f9dd40d2230 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.194+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd409fc90 con 0x7f9dd40d2230 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.194+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8011c40 con 0x7f9dd40d2230 2024-05-10T11:14:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.194+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd409f1b0 con 0x7f9dd40d2230 2024-05-10T11:14:08.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.195+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd406a220 con 0x7f9dd40d2230 2024-05-10T11:14:08.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.196+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9dc8018020 con 0x7f9dd40d2230 2024-05-10T11:14:08.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.196+0000 7f9dbb7fe640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9dc00762d0 0x7f9dc0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.196+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f9dc80975e0 con 0x7f9dd40d2230 2024-05-10T11:14:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.196+0000 7f9dd2ffd640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9dc00762d0 0x7f9dc0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.197+0000 7f9dd2ffd640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9dc00762d0 0x7f9dc0078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4034000 tx=0x7f9dc402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:08.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.201+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9dc801f020 con 0x7f9dd40d2230 2024-05-10T11:14:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.468+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9dd4161a20 con 0x7f9dd40d2230 2024-05-10T11:14:08.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.470+0000 7f9dbb7fe640 1 -- 172.21.15.66:0/3727399648 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f9dc8060db0 con 0x7f9dd40d2230 2024-05-10T11:14:08.470 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:14:08.471 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:14:08.471 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:14:08.471 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:14:08.471 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:14:08.471 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9dc00762d0 msgr2=0x7f9dc0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9dc00762d0 0x7f9dc0078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4034000 tx=0x7f9dc402e000 comp rx=0 tx=0).stop 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 msgr2=0x7f9dd415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 0x7f9dd415e4b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b3e0 tx=0x7f9dc800b8a0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 shutdown_connections 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9dc00762d0 0x7f9dc0078790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd4162bc0 0x7f9dd415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dd40d2230 0x7f9dd415e4b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 --2- 172.21.15.66:0/3727399648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd40b3500 0x7f9dd4152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 >> 172.21.15.66:0/3727399648 conn(0x7f9dd40d5190 msgr2=0x7f9dd40c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 shutdown_connections 2024-05-10T11:14:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.472+0000 7f9dd9371640 1 -- 172.21.15.66:0/3727399648 wait complete. 2024-05-10T11:14:08.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.587+0000 7f944b314640 1 Processor -- start 2024-05-10T11:14:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.588+0000 7f944b314640 1 -- start start 2024-05-10T11:14:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.588+0000 7f944b314640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f94440b5520 0x7f94440d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.588+0000 7f944b314640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 0x7f94440d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.588+0000 7f944b314640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94440d41f0 con 0x7f94440b5900 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.588+0000 7f944b314640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f94440d5c60 con 0x7f94440b5520 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.588+0000 7f944b314640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f94440d5eb0 con 0x7f94440b9180 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94490b0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f94440b5520 0x7f94440d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94498b1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 0x7f94440d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94488af640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f94440b5900 0x7f94440d2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43334/0 (socket says 172.21.15.66:43334) 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94498b1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 0x7f94440d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:59080/0 (socket says 172.21.15.66:59080) 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94498b1640 1 -- 172.21.15.66:0/214652289 learned_addr learned my addr 172.21.15.66:0/214652289 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94490b0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f94440b5520 0x7f94440d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:57630/0 (socket says 172.21.15.66:57630) 2024-05-10T11:14:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94490b0640 1 -- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 msgr2=0x7f94440d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94490b0640 1 --2- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 0x7f94440d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94490b0640 1 -- 172.21.15.66:0/214652289 >> v1:172.21.15.190:6789/0 conn(0x7f94440b5900 legacy=0x7f94440d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94490b0640 1 -- 172.21.15.66:0/214652289 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440d0a30 con 0x7f94440b5520 2024-05-10T11:14:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f943bfff640 1 -- 172.21.15.66:0/214652289 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770425211 0 0) 0x7f94440d41f0 con 0x7f94440b5900 2024-05-10T11:14:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.589+0000 7f94498b1640 1 --2- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 0x7f94440d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.590+0000 7f94490b0640 1 --2- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b5520 0x7f94440d18a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94400097a0 tx=0x7f944002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2092c44c8765fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.590+0000 7f943bfff640 1 -- 172.21.15.66:0/214652289 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440037070 con 0x7f94440b5520 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.590+0000 7f943bfff640 1 -- 172.21.15.66:0/214652289 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944002ae50 con 0x7f94440b5520 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.590+0000 7f943bfff640 1 -- 172.21.15.66:0/214652289 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440032660 con 0x7f94440b5520 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 -- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b5520 msgr2=0x7f94440d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 --2- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b5520 0x7f94440d18a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94400097a0 tx=0x7f944002a100 comp rx=0 tx=0).stop 2024-05-10T11:14:08.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 -- 172.21.15.66:0/214652289 shutdown_connections 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 --2- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b9180 0x7f94440d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 --2- 172.21.15.66:0/214652289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b5520 0x7f94440d18a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 -- 172.21.15.66:0/214652289 >> 172.21.15.66:0/214652289 conn(0x7f94440d5170 msgr2=0x7f94440d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 -- 172.21.15.66:0/214652289 shutdown_connections 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.591+0000 7f944b314640 1 -- 172.21.15.66:0/214652289 wait complete. 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.592+0000 7f944b314640 1 Processor -- start 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.592+0000 7f944b314640 1 -- start start 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f944b314640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b5520 0x7f9444162820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f944b314640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 0x7f944415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f944b314640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b9180 0x7f94441f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f944b314640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b6460 con 0x7f94440b5900 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f944b314640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b62e0 con 0x7f94440b9180 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f944b314640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f94440b65e0 con 0x7f94440b5520 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 0x7f944415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 0x7f944415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34514/0 (socket says 172.21.15.66:34514) 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 -- 172.21.15.66:0/3078832633 learned_addr learned my addr 172.21.15.66:0/3078832633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94498b1640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b9180 0x7f94441f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94490b0640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b5520 0x7f9444162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 -- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b5520 msgr2=0x7f9444162820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b5520 0x7f9444162820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 -- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b9180 msgr2=0x7f94441f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b9180 0x7f94441f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 -- 172.21.15.66:0/3078832633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94441601e0 con 0x7f94440b5900 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94490b0640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b5520 0x7f9444162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f94488af640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 0x7f944415dd70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f943400c4d0 tx=0x7f943400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.593+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434018070 con 0x7f94440b5900 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.594+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9434007500 con 0x7f94440b5900 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.594+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94441604c0 con 0x7f94440b5900 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.594+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434004a20 con 0x7f94440b5900 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.594+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9444160a80 con 0x7f94440b5900 2024-05-10T11:14:08.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.595+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94440bb070 con 0x7f94440b5900 2024-05-10T11:14:08.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.595+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f943401b070 con 0x7f94440b5900 2024-05-10T11:14:08.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.596+0000 7f9439ffb640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94280762d0 0x7f9428078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:08.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.596+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f9434096a70 con 0x7f94440b5900 2024-05-10T11:14:08.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.596+0000 7f94490b0640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94280762d0 0x7f9428078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:08.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.597+0000 7f94490b0640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94280762d0 0x7f9428078790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9440034000 tx=0x7f944002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:08.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.600+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f94440bb070 con 0x7f94440b5900 2024-05-10T11:14:08.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.827+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94440693f0 con 0x7f94440b5900 2024-05-10T11:14:08.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.828+0000 7f9439ffb640 1 -- 172.21.15.66:0/3078832633 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7f943405fbf0 con 0x7f94440b5900 2024-05-10T11:14:08.830 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:08.830 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94280762d0 msgr2=0x7f9428078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94280762d0 0x7f9428078790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9440034000 tx=0x7f944002e000 comp rx=0 tx=0).stop 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 msgr2=0x7f944415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 0x7f944415dd70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f943400c4d0 tx=0x7f943400c990 comp rx=0 tx=0).stop 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 shutdown_connections 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94280762d0 0x7f9428078790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94440b9180 0x7f94441f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94440b5900 0x7f944415dd70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 --2- 172.21.15.66:0/3078832633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94440b5520 0x7f9444162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:08.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 >> 172.21.15.66:0/3078832633 conn(0x7f94440d5170 msgr2=0x7f94440cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:08.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 shutdown_connections 2024-05-10T11:14:08.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:08.830+0000 7f944b314640 1 -- 172.21.15.66:0/3078832633 wait complete. 2024-05-10T11:14:09.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:13:58.473598+0000', 'modified': '2024-05-10T11:14:01.486573+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6835/433642873', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6833', 'nonce': 433642873}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 433642873}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5322, 'qdb_cluster': [5322]} 2024-05-10T11:14:09.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:14:09.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T11:14:09.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.349+0000 7f5d0b61d640 1 Processor -- start 2024-05-10T11:14:09.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.350+0000 7f5d0b61d640 1 -- start start 2024-05-10T11:14:09.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.350+0000 7f5d0b61d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d040d5cb0 0x7f5d040d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.350+0000 7f5d0b61d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d04162b30 0x7f5d040d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.350+0000 7f5d0b61d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d040b45f0 con 0x7f5d04162750 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.350+0000 7f5d0b61d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5d040b4f20 con 0x7f5d040d5cb0 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.350+0000 7f5d0b61d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5d040d0fe0 con 0x7f5d04162b30 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d040d5cb0 0x7f5d040d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d040d5cb0 0x7f5d040d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34524/0 (socket says 172.21.15.66:34524) 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 -- 172.21.15.66:0/932501931 learned_addr learned my addr 172.21.15.66:0/932501931 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d09bba640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d04162b30 0x7f5d040d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 -- 172.21.15.66:0/932501931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d04162b30 msgr2=0x7f5d040d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d04162b30 0x7f5d040d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 -- 172.21.15.66:0/932501931 >> v1:172.21.15.190:6789/0 conn(0x7f5d04162750 legacy=0x7f5d040d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d08bb8640 1 -- 172.21.15.66:0/932501931 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040b48d0 con 0x7f5d040d5cb0 2024-05-10T11:14:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.351+0000 7f5d09bba640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d04162b30 0x7f5d040d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d040d5cb0 0x7f5d040d3630 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009870 tx=0x7f5cf402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad93ee2bdfa61bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5cfbfff640 1 -- 172.21.15.66:0/932501931 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4037070 con 0x7f5d040d5cb0 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5cfbfff640 1 -- 172.21.15.66:0/932501931 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4032440 con 0x7f5d040d5cb0 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5cfbfff640 1 -- 172.21.15.66:0/932501931 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4032810 con 0x7f5d040d5cb0 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d0b61d640 1 -- 172.21.15.66:0/932501931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d040d5cb0 msgr2=0x7f5d040d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d040d5cb0 0x7f5d040d3630 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009870 tx=0x7f5cf402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d0b61d640 1 -- 172.21.15.66:0/932501931 shutdown_connections 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d04162b30 0x7f5d040d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/932501931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d040d5cb0 0x7f5d040d3630 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.352+0000 7f5d0b61d640 1 -- 172.21.15.66:0/932501931 >> 172.21.15.66:0/932501931 conn(0x7f5d0409e3b0 msgr2=0x7f5d040d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.353+0000 7f5d0b61d640 1 -- 172.21.15.66:0/932501931 shutdown_connections 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.353+0000 7f5d0b61d640 1 -- 172.21.15.66:0/932501931 wait complete. 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.354+0000 7f5d0b61d640 1 Processor -- start 2024-05-10T11:14:09.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.354+0000 7f5d0b61d640 1 -- start start 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.354+0000 7f5d0b61d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d04162750 0x7f5d041f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.354+0000 7f5d0b61d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 0x7f5d041f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d0b61d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d041f7cd0 0x7f5d041f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d0b61d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040b53b0 con 0x7f5d04162b30 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d0b61d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040d0d80 con 0x7f5d04162750 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d0b61d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5d040b5530 con 0x7f5d041f7cd0 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 0x7f5d041f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 0x7f5d041f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34532/0 (socket says 172.21.15.66:34532) 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 -- 172.21.15.66:0/473085807 learned_addr learned my addr 172.21.15.66:0/473085807 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d093b9640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d04162750 0x7f5d041f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d09bba640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d041f7cd0 0x7f5d041f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 -- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d041f7cd0 msgr2=0x7f5d041f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d041f7cd0 0x7f5d041f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 -- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d04162750 msgr2=0x7f5d041f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d04162750 0x7f5d041f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 -- 172.21.15.66:0/473085807 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d041f8160 con 0x7f5d04162b30 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 0x7f5d041f5f70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5cf402a200 tx=0x7f5cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5cf9ffb640 1 -- 172.21.15.66:0/473085807 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4037040 con 0x7f5d04162b30 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5cf9ffb640 1 -- 172.21.15.66:0/473085807 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4042070 con 0x7f5d04162b30 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d041f8980 con 0x7f5d04162b30 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.355+0000 7f5cf9ffb640 1 -- 172.21.15.66:0/473085807 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4030bb0 con 0x7f5d04162b30 2024-05-10T11:14:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.356+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d041f8f40 con 0x7f5d04162b30 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.357+0000 7f5cf9ffb640 1 -- 172.21.15.66:0/473085807 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5cf402ad10 con 0x7f5d04162b30 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.358+0000 7f5cf9ffb640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5ce80762d0 0x7f5ce8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.358+0000 7f5cf9ffb640 1 -- 172.21.15.66:0/473085807 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f5cf40b80e0 con 0x7f5d04162b30 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.358+0000 7f5d093b9640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5ce80762d0 0x7f5ce8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.358+0000 7f5d093b9640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5ce80762d0 0x7f5ce8078790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5d00001640 tx=0x7f5d00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.358+0000 7f5d0e40b740 1 Processor -- start 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.358+0000 7f5d0e40b740 1 -- start start 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5bbf50 0x564b5f5be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 0x564b5f5923c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b5f4f88d0 con 0x564b5f58ebb0 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b5f4b1c10 con 0x564b5f5bc330 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564b5f4f4890 con 0x564b5f5bbf50 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d09bba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 0x564b5f5923c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d09bba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 0x564b5f5923c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34538/0 (socket says 172.21.15.66:34538) 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d09bba640 1 -- 172.21.15.66:0/672706239 learned_addr learned my addr 172.21.15.66:0/672706239 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.359+0000 7f5d093b9640 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5bbf50 0x564b5f5be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d09bba640 1 -- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5bbf50 msgr2=0x564b5f5be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d09bba640 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5bbf50 0x564b5f5be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d09bba640 1 -- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 msgr2=0x564b5f5beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d09bba640 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5beca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d09bba640 1 -- 172.21.15.66:0/672706239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f4b95d0 con 0x564b5f58ebb0 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d093b9640 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5bbf50 0x564b5f5be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5d09bba640 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 0x564b5f5923c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00e3b0 tx=0x7f5cfc00e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51a3995a50fe2da server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5ceeffd640 1 -- 172.21.15.66:0/672706239 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00f6b0 con 0x564b5f58ebb0 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5ceeffd640 1 -- 172.21.15.66:0/672706239 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00f850 con 0x564b5f58ebb0 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.360+0000 7f5ceeffd640 1 -- 172.21.15.66:0/672706239 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00fc00 con 0x564b5f58ebb0 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 -- 172.21.15.66:0/672706239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 msgr2=0x564b5f5923c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 0x564b5f5923c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00e3b0 tx=0x7f5cfc00e870 comp rx=0 tx=0).stop 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 -- 172.21.15.66:0/672706239 shutdown_connections 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f58ebb0 0x564b5f5923c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/672706239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5bbf50 0x564b5f5be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 -- 172.21.15.66:0/672706239 >> 172.21.15.66:0/672706239 conn(0x564b5f590e20 msgr2=0x564b5f5d9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 -- 172.21.15.66:0/672706239 shutdown_connections 2024-05-10T11:14:09.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 -- 172.21.15.66:0/672706239 wait complete. 2024-05-10T11:14:09.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 -- start start 2024-05-10T11:14:09.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.361+0000 7f5d0e40b740 1 Processor -- start 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f5e9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5dcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b5f593fd0 con 0x564b5f5bc330 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b5f4b5760 con 0x564b5f5bbf50 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564b5f5942b0 con 0x564b5f5b1e30 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d0e40b740 10 client.0 _ll_register_callbacks cb 0x564b5f4eecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f5e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f5e9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34542/0 (socket says 172.21.15.66:34542) 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 -- 172.21.15.66:0/1994093397 learned_addr learned my addr 172.21.15.66:0/1994093397 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 -- 172.21.15.66:0/1994093397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 msgr2=0x564b5f5dcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5dcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 -- 172.21.15.66:0/1994093397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 msgr2=0x564b5f5b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.362+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d08bb8640 1 -- 172.21.15.66:0/1994093397 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5f20a2d0 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f5e9690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4081140 tx=0x7f5cf4080e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675a15dd793c5cc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5ce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5ce3fff640 1 -- 172.21.15.66:0/1994093397 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4085360 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5ce3fff640 1 -- 172.21.15.66:0/1994093397 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f5cf4097db0 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cfc00f850 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5ce3fff640 1 -- 172.21.15.66:0/1994093397 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5cf40b4050 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 10 client.5481 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564b5f2d46b0 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5ce3fff640 1 -- 172.21.15.66:0/1994093397 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00f850 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5ce3fff640 1 -- 172.21.15.66:0/1994093397 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f5cf403a030 con 0x564b5f5bc330 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 10 client.5481 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:09.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 10 client.5481 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 20 client.5481 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5ed150 0x564b5f5db010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 4 client.5481 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b5f47c760 con 0x564b5f5ed150 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.363+0000 7f5d093b9640 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5ed150 0x564b5f5db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.364+0000 7f5d093b9640 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5ed150 0x564b5f5db010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672bddb9c525b631 server_cookie=60a1697d07a5207f in_seq=0 out_seq=0 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.364+0000 7f5ce3fff640 10 client.5481 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.364+0000 7f5ce3fff640 1 -- 172.21.15.66:0/1994093397 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564b5f47c760 con 0x564b5f5ed150 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.364+0000 7f5ce3fff640 10 client.5481 handle_command_reply: tid=0 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.364+0000 7f5d0e40b740 1 client.5481 shutdown 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.364+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 msgr2=0x564b5f5e9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f5e9690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4081140 tx=0x7f5cf4080e00 comp rx=0 tx=0).stop 2024-05-10T11:14:09.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 shutdown_connections 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5ed150 0x564b5f5db010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5dcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5ce3fff640 0 client.5481 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f5e9690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/1994093397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 >> 172.21.15.66:0/1994093397 conn(0x564b5f58ebb0 msgr2=0x564b5f58f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 shutdown_connections 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 1 -- 172.21.15.66:0/1994093397 wait complete. 2024-05-10T11:14:09.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.365+0000 7f5d0e40b740 20 client.5481 trim_cache size 0 max 16384 2024-05-10T11:14:09.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.383+0000 7f5d0e40b740 1 Processor -- start 2024-05-10T11:14:09.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.383+0000 7f5d0e40b740 1 -- start start 2024-05-10T11:14:09.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f58da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d04200ef0 con 0x564b5f5bc330 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040cac40 con 0x564b5f5bbf50 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5d042008a0 con 0x564b5f5b1e30 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d09bba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f58da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d09bba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f58da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34556/0 (socket says 172.21.15.66:34556) 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d09bba640 1 -- 172.21.15.66:0/892311167 learned_addr learned my addr 172.21.15.66:0/892311167 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d093b9640 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.384+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d09bba640 1 -- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 msgr2=0x564b5f5bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d09bba640 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d09bba640 1 -- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 msgr2=0x564b5f5bacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d09bba640 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5bacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d09bba640 1 -- 172.21.15.66:0/892311167 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f5d9800 con 0x564b5f5bc330 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d09bba640 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f58da40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc007cb0 tx=0x7f5cfc011070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115700830869824e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5cee7fc640 1 -- 172.21.15.66:0/892311167 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc01d040 con 0x564b5f5bc330 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5cee7fc640 1 -- 172.21.15.66:0/892311167 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc026070 con 0x564b5f5bc330 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5cee7fc640 1 -- 172.21.15.66:0/892311167 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc003dd0 con 0x564b5f5bc330 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d0e40b740 1 -- 172.21.15.66:0/892311167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 msgr2=0x564b5f58da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.385+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f58da40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc007cb0 tx=0x7f5cfc011070 comp rx=0 tx=0).stop 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 -- 172.21.15.66:0/892311167 shutdown_connections 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bc330 0x564b5f58da40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bbf50 0x564b5f5bacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/892311167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f5bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 -- 172.21.15.66:0/892311167 >> 172.21.15.66:0/892311167 conn(0x564b5f58ebb0 msgr2=0x564b5f5be720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 -- 172.21.15.66:0/892311167 shutdown_connections 2024-05-10T11:14:09.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 -- 172.21.15.66:0/892311167 wait complete. 2024-05-10T11:14:09.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 -- start start 2024-05-10T11:14:09.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.386+0000 7f5d0e40b740 1 Processor -- start 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f58da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 0x564b5f58df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b5f5dd9b0 con 0x564b5f5bbf50 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b5f5b2fa0 con 0x564b5f5bc330 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564b5f5ed580 con 0x564b5f5b1e30 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d0e40b740 10 client.0 _ll_register_callbacks cb 0x7f5cf4080f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 0x564b5f58df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 0x564b5f58df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34562/0 (socket says 172.21.15.66:34562) 2024-05-10T11:14:09.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 -- 172.21.15.66:0/2707518599 learned_addr learned my addr 172.21.15.66:0/2707518599 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d09bba640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d093b9640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f58da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 -- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 msgr2=0x564b5f58da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f58da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 -- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 msgr2=0x564b5f5daf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5daf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d08bb8640 1 -- 172.21.15.66:0/2707518599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5f5c24a0 con 0x564b5f5bbf50 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d093b9640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f58da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.387+0000 7f5d09bba640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5daf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d08bb8640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 0x564b5f58df80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5cf402a7b0 tx=0x7f5cf407d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee314a881368321 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5ce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5ce3fff640 1 -- 172.21.15.66:0/2707518599 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4080920 con 0x564b5f5bbf50 2024-05-10T11:14:09.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5ce3fff640 1 -- 172.21.15.66:0/2707518599 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f5cf409f020 con 0x564b5f5bbf50 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cfc026070 con 0x564b5f5bbf50 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5ce3fff640 1 -- 172.21.15.66:0/2707518599 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5cf4089f80 con 0x564b5f5bbf50 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 10 client.5487 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564b5f5e98f0 con 0x564b5f5bbf50 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5ce3fff640 1 -- 172.21.15.66:0/2707518599 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc026070 con 0x564b5f5bbf50 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5ce3fff640 1 -- 172.21.15.66:0/2707518599 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f5cf4080410 con 0x564b5f5bbf50 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 10 client.5487 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 10 client.5487 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 20 client.5487 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5db4b0 0x564b5f5923c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 4 client.5487 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "status"}) -- 0x564b5f5064e0 con 0x564b5f5db4b0 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.388+0000 7f5d093b9640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5db4b0 0x564b5f5923c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5ce3fff640 10 client.5487 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d093b9640 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5db4b0 0x564b5f5923c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17bb5df7bd3f6baf server_cookie=77447f9b071af663 in_seq=0 out_seq=0 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5ce3fff640 1 -- 172.21.15.66:0/2707518599 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x564b5f5064e0 con 0x564b5f5db4b0 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5ce3fff640 10 client.5487 handle_command_reply: tid=0 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 client.5487 shutdown 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 msgr2=0x564b5f58df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 0x564b5f58df80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5cf402a7b0 tx=0x7f5cf407d880 comp rx=0 tx=0).stop 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 shutdown_connections 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b5f5db4b0 0x564b5f5923c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b5f5bc330 0x564b5f5daf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b5f5bbf50 0x564b5f58df80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5ce3fff640 0 client.5487 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 --2- 172.21.15.66:0/2707518599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b5f5b1e30 0x564b5f58da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 >> 172.21.15.66:0/2707518599 conn(0x564b5f58ebb0 msgr2=0x564b5f5d64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 shutdown_connections 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 1 -- 172.21.15.66:0/2707518599 wait complete. 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.389+0000 7f5d0e40b740 20 client.5487 trim_cache size 0 max 16384 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 5322, 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:14:09.397 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:14:09.398 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 10.305007453, 2024-05-10T11:14:09.398 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 25, 2024-05-10T11:14:09.398 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 49, 2024-05-10T11:14:09.398 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 49, 2024-05-10T11:14:09.398 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 15.620565300999999 2024-05-10T11:14:09.398 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5ce80762d0 msgr2=0x7f5ce8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5ce80762d0 0x7f5ce8078790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5d00001640 tx=0x7f5d00009040 comp rx=0 tx=0).stop 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 msgr2=0x7f5d041f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 0x7f5d041f5f70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5cf402a200 tx=0x7f5cf40046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 shutdown_connections 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5ce80762d0 0x7f5ce8078790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d041f7cd0 0x7f5d041f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d04162b30 0x7f5d041f5f70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 --2- 172.21.15.66:0/473085807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d04162750 0x7f5d041f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 >> 172.21.15.66:0/473085807 conn(0x7f5d0409e3b0 msgr2=0x7f5d0406de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 shutdown_connections 2024-05-10T11:14:09.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.390+0000 7f5d0b61d640 1 -- 172.21.15.66:0/473085807 wait complete. 2024-05-10T11:14:09.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:14:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.504+0000 7f7608d2b640 1 Processor -- start 2024-05-10T11:14:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.504+0000 7f7608d2b640 1 -- start start 2024-05-10T11:14:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7608d2b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040b8860 0x7f760406e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7608d2b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f76040d0230 0x7f76040cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7608d2b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760415fc90 con 0x7f76040cfbb0 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7608d2b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f760406ee50 con 0x7f76040d0230 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7608d2b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76040b8c40 con 0x7f76040b8860 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7601d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f76040d0230 0x7f76040cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7602d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f76040cfbb0 0x7f76040d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34426/0 (socket says 172.21.15.66:34426) 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7602d9d640 1 -- 172.21.15.66:0/884900688 learned_addr learned my addr 172.21.15.66:0/884900688 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7601d9b640 1 --2- 172.21.15.66:0/884900688 >> v2:172.21.15.66:3300/0 conn(0x7f76040d0230 0x7f76040cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34566/0 (socket says 172.21.15.66:34566) 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f760259c640 1 --2- 172.21.15.66:0/884900688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040b8860 0x7f760406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7601d9b640 1 -- 172.21.15.66:0/884900688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040b8860 msgr2=0x7f760406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7601d9b640 1 --2- 172.21.15.66:0/884900688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040b8860 0x7f760406e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7601d9b640 1 -- 172.21.15.66:0/884900688 >> v1:172.21.15.66:6789/0 conn(0x7f76040cfbb0 legacy=0x7f76040d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f7601d9b640 1 -- 172.21.15.66:0/884900688 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040cd570 con 0x7f76040d0230 2024-05-10T11:14:09.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.505+0000 7f760159a640 1 -- 172.21.15.66:0/884900688 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401671602 0 0) 0x7f760415fc90 con 0x7f76040cfbb0 2024-05-10T11:14:09.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.506+0000 7f7601d9b640 1 --2- 172.21.15.66:0/884900688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f76040cf670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097a0 tx=0x7f75f802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90430204fd6983f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.506+0000 7f760159a640 1 -- 172.21.15.66:0/884900688 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8037070 con 0x7f76040d0230 2024-05-10T11:14:09.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.506+0000 7f760159a640 1 -- 172.21.15.66:0/884900688 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f802ae50 con 0x7f76040d0230 2024-05-10T11:14:09.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.506+0000 7f760159a640 1 -- 172.21.15.66:0/884900688 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8032660 con 0x7f76040d0230 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 -- 172.21.15.66:0/884900688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 msgr2=0x7f76040cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 --2- 172.21.15.66:0/884900688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f76040cf670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097a0 tx=0x7f75f802a100 comp rx=0 tx=0).stop 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 -- 172.21.15.66:0/884900688 shutdown_connections 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 --2- 172.21.15.66:0/884900688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f76040cf670 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 --2- 172.21.15.66:0/884900688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040b8860 0x7f760406e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 -- 172.21.15.66:0/884900688 >> 172.21.15.66:0/884900688 conn(0x7f76040d2df0 msgr2=0x7f76040d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 -- 172.21.15.66:0/884900688 shutdown_connections 2024-05-10T11:14:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.507+0000 7f7608d2b640 1 -- 172.21.15.66:0/884900688 wait complete. 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.508+0000 7f7608d2b640 1 Processor -- start 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.508+0000 7f7608d2b640 1 -- start start 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7608d2b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76040b8860 0x7f7604151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7608d2b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040cfbb0 0x7f76040ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7608d2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f7604151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7608d2b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76040cde10 con 0x7f76040d0230 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7608d2b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76040cdb30 con 0x7f76040b8860 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7608d2b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f760406ea60 con 0x7f76040cfbb0 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7602d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f7604151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7602d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f7604151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34580/0 (socket says 172.21.15.66:34580) 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7602d9d640 1 -- 172.21.15.66:0/3530414553 learned_addr learned my addr 172.21.15.66:0/3530414553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f760259c640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76040b8860 0x7f7604151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.509+0000 7f7601d9b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040cfbb0 0x7f76040ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7602d9d640 1 -- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040cfbb0 msgr2=0x7f76040ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7602d9d640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040cfbb0 0x7f76040ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7602d9d640 1 -- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76040b8860 msgr2=0x7f7604151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7602d9d640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76040b8860 0x7f7604151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7602d9d640 1 -- 172.21.15.66:0/3530414553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76041520e0 con 0x7f76040d0230 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7602d9d640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f7604151170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c7d0 tx=0x7f75fc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc018070 con 0x7f76040d0230 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc00a640 con 0x7f76040d0230 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76040c9ec0 con 0x7f76040d0230 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00aa70 con 0x7f76040d0230 2024-05-10T11:14:09.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.510+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76040ca180 con 0x7f76040d0230 2024-05-10T11:14:09.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.511+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760406a220 con 0x7f76040d0230 2024-05-10T11:14:09.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.512+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75fc01b070 con 0x7f76040d0230 2024-05-10T11:14:09.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.512+0000 7f75f2ffd640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75e40762d0 0x7f75e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:09.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.512+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f75fc096cd0 con 0x7f76040d0230 2024-05-10T11:14:09.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.512+0000 7f760259c640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75e40762d0 0x7f75e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:09.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.513+0000 7f760259c640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75e40762d0 0x7f75e4078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009aa0 tx=0x7f75f4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:09.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.516+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f75fc05fe50 con 0x7f76040d0230 2024-05-10T11:14:09.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.747+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7604163080 con 0x7f76040d0230 2024-05-10T11:14:09.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.747+0000 7f75f2ffd640 1 -- 172.21.15.66:0/3530414553 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f75fc064150 con 0x7f76040d0230 2024-05-10T11:14:09.748 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75e40762d0 msgr2=0x7f75e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75e40762d0 0x7f75e4078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009aa0 tx=0x7f75f4009190 comp rx=0 tx=0).stop 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 msgr2=0x7f7604151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f7604151170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c7d0 tx=0x7f75fc00cc90 comp rx=0 tx=0).stop 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 shutdown_connections 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f75e40762d0 0x7f75e4078790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76040d0230 0x7f7604151170 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76040cfbb0 0x7f76040ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 --2- 172.21.15.66:0/3530414553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76040b8860 0x7f7604151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:09.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 >> 172.21.15.66:0/3530414553 conn(0x7f76040d2df0 msgr2=0x7f7604070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:09.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 shutdown_connections 2024-05-10T11:14:09.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09.749+0000 7f7608d2b640 1 -- 172.21.15.66:0/3530414553 wait complete. 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:14:09.761 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:14:09.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:09.762 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:14:09.778 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:14:09.778 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:14:09.778 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:14:09.778 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.778 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:14:09.779 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42644sec preferred_lft 42644sec 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:14:09.780 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:14:09.781 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:14:09.781 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:14:09.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:09.781 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:14:09.842 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:14:09.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:09.844 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:14:09.901 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:14:09.901 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:14:09.901 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:14:09.901 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:14:09.901 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:14:09.901 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:14:09.902 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:14:09.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:14:09.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:14:09.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:14:09.902 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:14:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:14:10.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:14:10.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:10.031 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:14:10.047 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:14:10.047 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:14:10.047 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:14:10.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:10.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:14:10.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:14:10.113 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:14:10.169 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:14:10.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:14:10.169 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:14:10.224 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:14:10.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:10.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:14:10.309 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:14:10.309 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:14:10.309 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:14:10.318 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:14:10.318 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:14:10.318 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:14:10.318 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:14:10.318 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:14:10.323 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:14:10.323 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:14:10.323 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:14:10.323 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:14:10.323 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:14:10.323 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:14:10.324 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:14:10.326 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:14:10.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:10.326 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:14:10.352 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:14:10.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:14:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:14:10.454 INFO:teuthology.orchestra.run.smithi066.stdout:client5194 2024-05-10T11:14:10.454 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:14:10.454 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:10.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:10.471 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-05-10T11:14:10.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:10.533 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-05-10T11:14:10.591 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:14:10.592 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:14:10.592 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:14:10.592 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:14:10.592 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-05-10T11:14:10.592 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:14:10.700 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:14:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:14:10.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:10.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.853+0000 7f20a2899640 1 Processor -- start 2024-05-10T11:14:10.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.853+0000 7f20a2899640 1 -- start start 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a2899640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 0x7f209c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a2899640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f209c0cfbb0 0x7f209c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a2899640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c15fc90 con 0x7f209c0b8860 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a2899640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f209c06ec30 con 0x7f209c0cfbb0 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a2899640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f209c06ee50 con 0x7f209c0d0230 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f209c0b8860 0x7f209c06e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34438/0 (socket says 172.21.15.66:34438) 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209bfff640 1 -- 172.21.15.66:0/3073597838 learned_addr learned my addr 172.21.15.66:0/3073597838 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a0e36640 1 --2- 172.21.15.66:0/3073597838 >> v2:172.21.15.190:3300/0 conn(0x7f209c0cfbb0 0x7f209c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209b7fe640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 0x7f209c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882822578 0 0) 0x7f209c15fc90 con 0x7f209c0b8860 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2084003520 con 0x7f209c0b8860 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2535144066 0 0) 0x7f2084003520 con 0x7f209c0b8860 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 msgr2=0x7f209c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 0x7f209c0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 >> v2:172.21.15.190:3300/0 conn(0x7f209c0cfbb0 msgr2=0x7f209c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 --2- 172.21.15.66:0/3073597838 >> v2:172.21.15.190:3300/0 conn(0x7f209c0cfbb0 0x7f209c0ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c0b8c40 con 0x7f209c0b8860 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f20a0e36640 1 --2- 172.21.15.66:0/3073597838 >> v2:172.21.15.190:3300/0 conn(0x7f209c0cfbb0 0x7f209c0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f208c001670 con 0x7f209c0b8860 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 >> v1:172.21.15.66:6789/0 conn(0x7f209c0b8860 legacy=0x7f209c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 0x7f20840039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2084003f60 0x7f2084004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084004d40 0x7f20840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f209c06ec30 con 0x7f2084003f60 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f209c06ee50 con 0x7f2084004d40 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.854+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f208400ba40 con 0x7f209c0d0230 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209b7fe640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2084003f60 0x7f2084004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209bfff640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 0x7f20840039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f20a0e36640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084004d40 0x7f20840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209b7fe640 1 -- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 msgr2=0x7f20840039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209b7fe640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0d0230 0x7f20840039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209b7fe640 1 -- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084004d40 msgr2=0x7f20840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209b7fe640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084004d40 0x7f20840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.855+0000 7f209b7fe640 1 -- 172.21.15.66:0/3073597838 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2084003520 con 0x7f2084003f60 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f209b7fe640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2084003f60 0x7f2084004800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2090009ac0 tx=0x7f2084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1650360c7ed85da7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090036070 con 0x7f2084003f60 2024-05-10T11:14:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2090031400 con 0x7f2084003f60 2024-05-10T11:14:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f209affd640 1 -- 172.21.15.66:0/3073597838 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090009690 con 0x7f2084003f60 2024-05-10T11:14:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a2899640 1 -- 172.21.15.66:0/3073597838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2084003f60 msgr2=0x7f2084004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a2899640 1 --2- 172.21.15.66:0/3073597838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2084003f60 0x7f2084004800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2090009ac0 tx=0x7f2084005830 comp rx=0 tx=0).stop 2024-05-10T11:14:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a0e36640 1 -- 172.21.15.66:0/3073597838 reap_dead start 2024-05-10T11:14:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a2899640 1 -- 172.21.15.66:0/3073597838 shutdown_connections 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a2899640 1 -- 172.21.15.66:0/3073597838 >> 172.21.15.66:0/3073597838 conn(0x7f209c0d2df0 msgr2=0x7f209c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a2899640 1 -- 172.21.15.66:0/3073597838 shutdown_connections 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.856+0000 7f20a2899640 1 -- 172.21.15.66:0/3073597838 wait complete. 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.858+0000 7f20a2899640 1 Processor -- start 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.858+0000 7f20a2899640 1 -- start start 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084003f60 0x7f209c1f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 0x7f209c1f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0caf10 0x7f209c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0cdb30 con 0x7f209c15c180 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0cd850 con 0x7f2084003f60 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f209c0cde10 con 0x7f209c0caf10 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 0x7f209c1f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 0x7f209c1f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34598/0 (socket says 172.21.15.66:34598) 2024-05-10T11:14:10.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 -- 172.21.15.66:0/742745250 learned_addr learned my addr 172.21.15.66:0/742745250 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a0e36640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0caf10 0x7f209c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209bfff640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084003f60 0x7f209c1f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 -- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0caf10 msgr2=0x7f209c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0caf10 0x7f209c0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 -- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084003f60 msgr2=0x7f209c1f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084003f60 0x7f209c1f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 -- 172.21.15.66:0/742745250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1f8fd0 con 0x7f209c15c180 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a0e36640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0caf10 0x7f209c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209bfff640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084003f60 0x7f209c1f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f209b7fe640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 0x7f209c1f4db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f2090004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090040020 con 0x7f209c15c180 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2090003c40 con 0x7f209c15c180 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c15b0e0 con 0x7f209c15c180 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.859+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090036040 con 0x7f209c15c180 2024-05-10T11:14:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.860+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c15b6a0 con 0x7f209c15c180 2024-05-10T11:14:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.860+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c06a220 con 0x7f209c15c180 2024-05-10T11:14:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.861+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2090043020 con 0x7f209c15c180 2024-05-10T11:14:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.862+0000 7f2098ff9640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2088076300 0x7f20880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.862+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f20900b7790 con 0x7f209c15c180 2024-05-10T11:14:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.862+0000 7f209bfff640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2088076300 0x7f20880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.862+0000 7f209bfff640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2088076300 0x7f20880787c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f208c001eb0 tx=0x7f208c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:10.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:10.866+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f209004a070 con 0x7f209c15c180 2024-05-10T11:14:11.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.094+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f209c075140 con 0x7f209c15c180 2024-05-10T11:14:11.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.094+0000 7f2098ff9640 1 -- 172.21.15.66:0/742745250 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7f209c1f8fd0 con 0x7f209c15c180 2024-05-10T11:14:11.095 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:11.095 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:11.095 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.096+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2088076300 msgr2=0x7f20880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2088076300 0x7f20880787c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f208c001eb0 tx=0x7f208c009040 comp rx=0 tx=0).stop 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 msgr2=0x7f209c1f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 0x7f209c1f4db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f2090004730 comp rx=0 tx=0).stop 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 shutdown_connections 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2088076300 0x7f20880787c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f209c0caf10 0x7f209c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f209c15c180 0x7f209c1f4db0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 --2- 172.21.15.66:0/742745250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2084003f60 0x7f209c1f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 >> 172.21.15.66:0/742745250 conn(0x7f209c0d2df0 msgr2=0x7f209c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 shutdown_connections 2024-05-10T11:14:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.097+0000 7f20a2899640 1 -- 172.21.15.66:0/742745250 wait complete. 2024-05-10T11:14:11.108 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T11:14:11.238 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:14:11.239 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:14:11.239 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T11:14:11.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.284+0000 7f9d81823f40 1 Processor -- start 2024-05-10T11:14:11.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.284+0000 7f9d81823f40 1 -- start start 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d81823f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d68002850 0x559c835ec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d81823f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c835ec9d0 0x559c836920b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d81823f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83692a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d81823f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559c83564f50 con 0x559c836925f0 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d81823f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559c83568f90 con 0x559c835ec9d0 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d81823f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559c835eae80 con 0x7f9d68002850 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83692a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83692a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34624/0 (socket says 172.21.15.66:34624) 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 -- 172.21.15.66:0/2637672843 learned_addr learned my addr 172.21.15.66:0/2637672843 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7f31d640 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d68002850 0x559c835ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7eb1c640 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c835ec9d0 0x559c836920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 -- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d68002850 msgr2=0x559c835ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d68002850 0x559c835ec490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 -- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c835ec9d0 msgr2=0x559c836920b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c835ec9d0 0x559c836920b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 -- 172.21.15.66:0/2637672843 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c83686cf0 con 0x559c836925f0 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7fb1e640 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83692a70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006d50 tx=0x7f9d780029f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a76b38b64395db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7db1a640 1 -- 172.21.15.66:0/2637672843 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78006020 con 0x559c836925f0 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7db1a640 1 -- 172.21.15.66:0/2637672843 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d780061c0 con 0x559c836925f0 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.285+0000 7f9d7db1a640 1 -- 172.21.15.66:0/2637672843 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780106f0 con 0x559c836925f0 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 -- 172.21.15.66:0/2637672843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 msgr2=0x559c83692a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83692a70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006d50 tx=0x7f9d780029f0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 -- 172.21.15.66:0/2637672843 shutdown_connections 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83692a70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c835ec9d0 0x559c836920b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 --2- 172.21.15.66:0/2637672843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d68002850 0x559c835ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 -- 172.21.15.66:0/2637672843 >> 172.21.15.66:0/2637672843 conn(0x559c835bd040 msgr2=0x559c836908a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 -- 172.21.15.66:0/2637672843 shutdown_connections 2024-05-10T11:14:11.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.286+0000 7f9d81823f40 1 -- 172.21.15.66:0/2637672843 wait complete. 2024-05-10T11:14:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 Processor -- start 2024-05-10T11:14:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 -- start start 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559c835ec9d0 0x559c836814f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83682a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d68002850 0x559c8368cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559c836947a0 con 0x559c836925f0 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559c83694550 con 0x7f9d68002850 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d81823f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559c835ed2e0 con 0x559c835ec9d0 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d7eb1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83682a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d7eb1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83682a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34634/0 (socket says 172.21.15.66:34634) 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d7eb1c640 1 -- 172.21.15.66:0/3965269212 learned_addr learned my addr 172.21.15.66:0/3965269212 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.287+0000 7f9d7f31d640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559c835ec9d0 0x559c836814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7fb1e640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d68002850 0x559c8368cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7eb1c640 1 -- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559c835ec9d0 msgr2=0x559c836814f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7eb1c640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559c835ec9d0 0x559c836814f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7eb1c640 1 -- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d68002850 msgr2=0x559c8368cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7eb1c640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d68002850 0x559c8368cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7eb1c640 1 -- 172.21.15.66:0/3965269212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8371d2b0 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7eb1c640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83682a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9d74046b40 tx=0x7f9d74001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7cb18640 1 -- 172.21.15.66:0/3965269212 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74066070 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7cb18640 1 -- 172.21.15.66:0/3965269212 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74062630 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8371d590 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d7cb18640 1 -- 172.21.15.66:0/3965269212 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d740629e0 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.288+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8371db50 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.290+0000 7f9d7cb18640 1 -- 172.21.15.66:0/3965269212 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d74069070 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.290+0000 7f9d7cb18640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d6c074ce0 0x7f9d6c0771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.290+0000 7f9d7cb18640 1 -- 172.21.15.66:0/3965269212 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f9d740db340 con 0x559c836925f0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.290+0000 7f9d81823f40 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x559c8371cdf0 0x559c8371e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.290+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) -- 0x559c8368d460 con 0x559c8371cdf0 2024-05-10T11:14:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.290+0000 7f9d7f31d640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d6c074ce0 0x7f9d6c0771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d7fb1e640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x559c8371cdf0 0x559c8371e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d7fb1e640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x559c8371cdf0 0x559c8371e350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d7f31d640 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d6c074ce0 0x7f9d6c0771a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559c836057b0 tx=0x7f9d7000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d7fb1e640 1 -- 172.21.15.66:0/3965269212 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f9d78010770 con 0x559c8371cdf0 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x559c8371cdf0 msgr2=0x559c8371e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x559c8371cdf0 0x559c8371e350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d6c074ce0 msgr2=0x7f9d6c0771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d6c074ce0 0x7f9d6c0771a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559c836057b0 tx=0x7f9d7000c040 comp rx=0 tx=0).stop 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 msgr2=0x559c83682a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 --2- 172.21.15.66:0/3965269212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c836925f0 0x559c83682a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9d74046b40 tx=0x7f9d74001a40 comp rx=0 tx=0).stop 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d7fb1e640 1 -- 172.21.15.66:0/3965269212 reap_dead start 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 shutdown_connections 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 >> 172.21.15.66:0/3965269212 conn(0x559c835bd040 msgr2=0x559c83691610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 shutdown_connections 2024-05-10T11:14:11.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.291+0000 7f9d81823f40 1 -- 172.21.15.66:0/3965269212 wait complete. 2024-05-10T11:14:11.295 INFO:teuthology.orchestra.run.smithi066.stdout:Yalphaparent_a 2024-05-10T11:14:11.296 DEBUG:teuthology.orchestra.run.smithi066:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627777, 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "ancestors": [ 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "dirino": 1099511627776, 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "alpha", 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 2 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "dirino": 1, 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "parent_a", 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 4 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 8, 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "old_pools": [] 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:11.452 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-05-10T11:14:11.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.497+0000 7f14953d6f40 1 Processor -- start 2024-05-10T11:14:11.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.497+0000 7f14953d6f40 1 -- start start 2024-05-10T11:14:11.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f14953d6f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d433b80 0x56505d4b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f14953d6f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 0x56505d4bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f14953d6f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f14953d6f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56505d44b2f0 con 0x56505d44c5f0 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f14953d6f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56505d433ff0 con 0x56505d4c2c10 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f14953d6f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56505d44b5d0 con 0x56505d433b80 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f148bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 0x56505d4bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f148bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 0x56505d4bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34652/0 (socket says 172.21.15.66:34652) 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f148bfff640 1 -- 172.21.15.66:0/2846000226 learned_addr learned my addr 172.21.15.66:0/2846000226 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f148bfff640 1 -- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d433b80 msgr2=0x56505d4b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.498+0000 7f148bfff640 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d433b80 0x56505d4b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f148bfff640 1 -- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 msgr2=0x56505d4d7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14936d1640 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f148bfff640 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f148bfff640 1 -- 172.21.15.66:0/2846000226 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505d36d350 con 0x56505d44c5f0 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f148bfff640 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 0x56505d4bf0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f147c0097c0 tx=0x7f147c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789f1de0ca4a8a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f1491ece640 1 -- 172.21.15.66:0/2846000226 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c017070 con 0x56505d44c5f0 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f1491ece640 1 -- 172.21.15.66:0/2846000226 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c0090d0 con 0x56505d44c5f0 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f1491ece640 1 -- 172.21.15.66:0/2846000226 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c006b00 con 0x56505d44c5f0 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 -- 172.21.15.66:0/2846000226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 msgr2=0x56505d4bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 0x56505d4bf0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f147c0097c0 tx=0x7f147c009c80 comp rx=0 tx=0).stop 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 -- 172.21.15.66:0/2846000226 shutdown_connections 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d44c5f0 0x56505d4bf0c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 --2- 172.21.15.66:0/2846000226 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d433b80 0x56505d4b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 -- 172.21.15.66:0/2846000226 >> 172.21.15.66:0/2846000226 conn(0x56505d4037d0 msgr2=0x56505d4d9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 -- 172.21.15.66:0/2846000226 shutdown_connections 2024-05-10T11:14:11.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.499+0000 7f14953d6f40 1 -- 172.21.15.66:0/2846000226 wait complete. 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.500+0000 7f14953d6f40 1 Processor -- start 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.500+0000 7f14953d6f40 1 -- start start 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14953d6f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d433b80 0x56505d4d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14953d6f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d44c5f0 0x56505d4d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14953d6f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14953d6f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56505d4c2280 con 0x56505d433b80 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14953d6f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56505d4d8c10 con 0x56505d4c2c10 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14953d6f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56505d4d8930 con 0x56505d44c5f0 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d433b80 0x56505d4d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d433b80 0x56505d4d6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34662/0 (socket says 172.21.15.66:34662) 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 -- 172.21.15.66:0/430002358 learned_addr learned my addr 172.21.15.66:0/430002358 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f148bfff640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d44c5f0 0x56505d4d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14936d1640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 -- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d44c5f0 msgr2=0x56505d4d7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56505d44c5f0 0x56505d4d7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 -- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 msgr2=0x56505d4d81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 -- 172.21.15.66:0/430002358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505d4be9c0 con 0x56505d433b80 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f14936d1640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56505d4c2c10 0x56505d4d81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.501+0000 7f1492ed0640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d433b80 0x56505d4d6ee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1484055040 tx=0x7f1484045f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.502+0000 7f1490ecc640 1 -- 172.21.15.66:0/430002358 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484069070 con 0x56505d433b80 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.502+0000 7f1490ecc640 1 -- 172.21.15.66:0/430002358 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1484052ab0 con 0x56505d433b80 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.502+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56505d4bdc00 con 0x56505d433b80 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.502+0000 7f1490ecc640 1 -- 172.21.15.66:0/430002358 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484056070 con 0x56505d433b80 2024-05-10T11:14:11.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.502+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505d4be1c0 con 0x56505d433b80 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.503+0000 7f1490ecc640 1 -- 172.21.15.66:0/430002358 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f148406c070 con 0x56505d433b80 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f1490ecc640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1474074cb0 0x7f1474077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f1490ecc640 1 -- 172.21.15.66:0/430002358 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f14840d9ce0 con 0x56505d433b80 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f14953d6f40 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56505d4db8a0 0x56505d57e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) -- 0x56505d566920 con 0x56505d4db8a0 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f148bfff640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1474074cb0 0x7f1474077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f14936d1640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56505d4db8a0 0x56505d57e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f14936d1640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56505d4db8a0 0x56505d57e920 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.504+0000 7f148bfff640 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1474074cb0 0x7f1474077170 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56505d4c1020 tx=0x7f147c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.505+0000 7f14936d1640 1 -- 172.21.15.66:0/430002358 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v49'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f148c00c760 con 0x56505d4db8a0 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.505+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56505d4db8a0 msgr2=0x56505d57e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.505+0000 7f14953d6f40 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56505d4db8a0 0x56505d57e920 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1474074cb0 msgr2=0x7f1474077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1474074cb0 0x7f1474077170 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56505d4c1020 tx=0x7f147c00f000 comp rx=0 tx=0).stop 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d433b80 msgr2=0x56505d4d6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 --2- 172.21.15.66:0/430002358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56505d433b80 0x56505d4d6ee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1484055040 tx=0x7f1484045f00 comp rx=0 tx=0).stop 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14936d1640 1 -- 172.21.15.66:0/430002358 reap_dead start 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 shutdown_connections 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 >> 172.21.15.66:0/430002358 conn(0x56505d4037d0 msgr2=0x56505d4dd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 shutdown_connections 2024-05-10T11:14:11.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.506+0000 7f14953d6f40 1 -- 172.21.15.66:0/430002358 wait complete. 2024-05-10T11:14:11.511 DEBUG:teuthology.orchestra.run.smithi066:> sudo daemon-helper kill ceph --cluster ceph -w 2024-05-10T11:14:11.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:11.513 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-05-10T11:14:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 Processor -- start 2024-05-10T11:14:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 -- start start 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc0162990 0x7f3bc00b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3bc00b5f30 0x7f3bc00d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3bc00d1aa0 0x7f3bc00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc00d10d0 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc00d0830 con 0x7f3bc00b5f30 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.620+0000 7f3bc5a20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc00d0b10 con 0x7f3bc0162990 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3bc00d1aa0 0x7f3bc00d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3bc00d1aa0 0x7f3bc00d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34670/0 (socket says 172.21.15.66:34670) 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/3985417432 learned_addr learned my addr 172.21.15.66:0/3985417432 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3985417432 >> v2:172.21.15.190:3300/0 conn(0x7f3bc00b5f30 0x7f3bc00d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc0162990 0x7f3bc00b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/3985417432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc0162990 msgr2=0x7f3bc00b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc0162990 0x7f3bc00b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/3985417432 >> v2:172.21.15.190:3300/0 conn(0x7f3bc00b5f30 msgr2=0x7f3bc00d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3985417432 >> v2:172.21.15.190:3300/0 conn(0x7f3bc00b5f30 0x7f3bc00d59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/3985417432 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc00d0df0 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.621+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc0162990 0x7f3bc00b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.622+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00d1f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009e50 tx=0x7f3bb802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f6fa64998629cf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.622+0000 7f3bbdffb640 1 -- 172.21.15.66:0/3985417432 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8036070 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.622+0000 7f3bbdffb640 1 -- 172.21.15.66:0/3985417432 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb8031600 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.622+0000 7f3bbdffb640 1 -- 172.21.15.66:0/3985417432 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80319d0 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.622+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3985417432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 msgr2=0x7f3bc00d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.622+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00d1f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009e50 tx=0x7f3bb802a6c0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3985417432 shutdown_connections 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00d1f30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3985417432 >> v2:172.21.15.190:3300/0 conn(0x7f3bc00b5f30 0x7f3bc00d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3985417432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc0162990 0x7f3bc00b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3985417432 >> 172.21.15.66:0/3985417432 conn(0x7f3bc009e3f0 msgr2=0x7f3bc00d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3985417432 shutdown_connections 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.623+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3985417432 wait complete. 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.624+0000 7f3bc5a20640 1 Processor -- start 2024-05-10T11:14:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.624+0000 7f3bc5a20640 1 -- start start 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bc5a20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc00b5f30 0x7f3bc00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bc5a20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bc5a20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc0162990 0x7f3bc00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bc5a20640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc00d5ef0 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bc5a20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0162d70 con 0x7f3bc0162990 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bc5a20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc01630a0 con 0x7f3bc00b5f30 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34684/0 (socket says 172.21.15.66:34684) 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3695385707 learned_addr learned my addr 172.21.15.66:0/3695385707 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc0162990 0x7f3bc00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc00b5f30 msgr2=0x7f3bc00b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc00b5f30 0x7f3bc00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc0162990 msgr2=0x7f3bc00caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc0162990 0x7f3bc00caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3695385707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc00ce7c0 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.625+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00ccb20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400e8c0 tx=0x7f3bb400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.626+0000 7f3ba7fff640 1 -- 172.21.15.66:0/3695385707 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4017070 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.626+0000 7f3ba7fff640 1 -- 172.21.15.66:0/3695385707 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb400c940 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.626+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc00cea60 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.626+0000 7f3ba7fff640 1 -- 172.21.15.66:0/3695385707 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400cd10 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.626+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc00cf020 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.627+0000 7f3ba7fff640 1 -- 172.21.15.66:0/3695385707 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3bb401a070 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.628+0000 7f3ba7fff640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3bac076300 0x7f3bac0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.628+0000 7f3ba7fff640 1 -- 172.21.15.66:0/3695385707 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f3bb4097780 con 0x7f3bc00d1aa0 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.628+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3bac076300 0x7f3bac0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.629+0000 7f3bc8814740 1 Processor -- start 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.629+0000 7f3bc8814740 1 -- start start 2024-05-10T11:14:11.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.629+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3bac076300 0x7f3bac0787c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.629+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.629+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.629+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e6c00 0x564b7c6bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bc8814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b7c61fcf0 con 0x564b7c6e7340 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b7c5d8e10 con 0x564b7c704220 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564b7c61bcb0 con 0x564b7c6e6c00 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6e66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34692/0 (socket says 172.21.15.66:34692) 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e6c00 0x564b7c6bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3973066290 learned_addr learned my addr 172.21.15.66:0/3973066290 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e6c00 msgr2=0x564b7c6bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e6c00 0x564b7c6bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 msgr2=0x564b7c6b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3973066290 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7c3f97e0 con 0x564b7c6e7340 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6e66c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4095a80 tx=0x7f3bb4060210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f8efc3f0a84d8d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3ba57fa640 1 -- 172.21.15.66:0/3973066290 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4021070 con 0x564b7c6e7340 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3ba57fa640 1 -- 172.21.15.66:0/3973066290 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb40607c0 con 0x564b7c6e7340 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.630+0000 7f3ba57fa640 1 -- 172.21.15.66:0/3973066290 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4067e60 con 0x564b7c6e7340 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 -- 172.21.15.66:0/3973066290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 msgr2=0x564b7c6e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6e66c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4095a80 tx=0x7f3bb4060210 comp rx=0 tx=0).stop 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 -- 172.21.15.66:0/3973066290 shutdown_connections 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e6c00 0x564b7c6bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6e66c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3973066290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 -- 172.21.15.66:0/3973066290 >> 172.21.15.66:0/3973066290 conn(0x564b7c6b8e20 msgr2=0x564b7c7016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 -- 172.21.15.66:0/3973066290 shutdown_connections 2024-05-10T11:14:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.631+0000 7f3bc8814740 1 -- 172.21.15.66:0/3973066290 wait complete. 2024-05-10T11:14:11.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.632+0000 7f3bc8814740 1 -- start start 2024-05-10T11:14:11.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.632+0000 7f3bc8814740 1 Processor -- start 2024-05-10T11:14:11.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.632+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c6e7340 0x564b7c6e8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.632+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c704220 0x564b7c712380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c7128c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bc8814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b7c6bafd0 con 0x564b7c6ea650 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b7c5dc940 con 0x564b7c6e7340 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564b7c6ba3c0 con 0x564b7c704220 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bc8814740 10 client.0 _ll_register_callbacks cb 0x564b7c5df440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c7128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c7128c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34702/0 (socket says 172.21.15.66:34702) 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/2341640781 learned_addr learned my addr 172.21.15.66:0/2341640781 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c6e7340 0x564b7c6e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c704220 0x564b7c712380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c704220 msgr2=0x564b7c712380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c704220 0x564b7c712380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c6e7340 msgr2=0x564b7c6e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c6e7340 0x564b7c6e8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 -- 172.21.15.66:0/2341640781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7c459f70 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c7128c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3bb802acb0 tx=0x7f3bb8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7071bb6cb735eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3b9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/2341640781 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8043070 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/2341640781 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f3bb803d870 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.633+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb40607c0 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/2341640781 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bb804d050 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 10 client.5532 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564b7c2f1170 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/2341640781 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb40607c0 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/2341640781 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f3bb8050020 con 0x564b7c6ea650 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 10 client.5532 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 10 client.5532 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 20 client.5532 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c7131c0 0x564b7c6e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 4 client.5532 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b7c62d900 con 0x564b7c7131c0 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c7131c0 0x564b7c6e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c7131c0 0x564b7c6e5800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f9e639fb100936 server_cookie=1decb58d475443c0 in_seq=0 out_seq=0 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.634+0000 7f3b9e7fc640 10 client.5532 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/2341640781 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564b7c62d900 con 0x564b7c7131c0 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3b9e7fc640 10 client.5532 handle_command_reply: tid=0 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 client.5532 shutdown 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 msgr2=0x564b7c7128c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c7128c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3bb802acb0 tx=0x7f3bb8004ab0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 shutdown_connections 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c7131c0 0x564b7c6e5800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3b9e7fc640 0 client.5532 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c7128c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c704220 0x564b7c712380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 --2- 172.21.15.66:0/2341640781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c6e7340 0x564b7c6e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 >> 172.21.15.66:0/2341640781 conn(0x564b7c6e6c00 msgr2=0x564b7c6b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 shutdown_connections 2024-05-10T11:14:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 1 -- 172.21.15.66:0/2341640781 wait complete. 2024-05-10T11:14:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.635+0000 7f3bc8814740 20 client.5532 trim_cache size 0 max 16384 2024-05-10T11:14:11.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.640+0000 7f7b618c8640 1 Processor -- start 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.640+0000 7f7b618c8640 1 -- start start 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b618c8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7b5c0d2110 0x7f7b5c0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b618c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c0d35d0 0x7f7b5c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b618c8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5c0d3e00 con 0x7f7b5c15f530 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b618c8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5c0d40e0 con 0x7f7b5c0d2110 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b618c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5c0b4600 con 0x7f7b5c0d35d0 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b5affd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7b5c15f530 0x7f7b5c0d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34456/0 (socket says 172.21.15.66:34456) 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.641+0000 7f7b5affd640 1 -- 172.21.15.66:0/3286303074 learned_addr learned my addr 172.21.15.66:0/3286303074 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b5b7fe640 1 --2- 172.21.15.66:0/3286303074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c0d35d0 0x7f7b5c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b5a7fc640 1 --2- 172.21.15.66:0/3286303074 >> v2:172.21.15.190:3300/0 conn(0x7f7b5c0d2110 0x7f7b5c0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b59ffb640 1 -- 172.21.15.66:0/3286303074 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128121997 0 0) 0x7f7b5c0d3e00 con 0x7f7b5c15f530 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b59ffb640 1 -- 172.21.15.66:0/3286303074 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b48003520 con 0x7f7b5c15f530 2024-05-10T11:14:11.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b5b7fe640 1 -- 172.21.15.66:0/3286303074 >> v2:172.21.15.190:3300/0 conn(0x7f7b5c0d2110 msgr2=0x7f7b5c0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b5b7fe640 1 --2- 172.21.15.66:0/3286303074 >> v2:172.21.15.190:3300/0 conn(0x7f7b5c0d2110 0x7f7b5c0d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b5b7fe640 1 -- 172.21.15.66:0/3286303074 >> v1:172.21.15.66:6789/0 conn(0x7f7b5c15f530 legacy=0x7f7b5c0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b59ffb640 1 -- 172.21.15.66:0/3286303074 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 787003071 0 0) 0x7f7b48003520 con 0x7f7b5c15f530 2024-05-10T11:14:11.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.642+0000 7f7b5b7fe640 1 -- 172.21.15.66:0/3286303074 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c0b48e0 con 0x7f7b5c0d35d0 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b5b7fe640 1 --2- 172.21.15.66:0/3286303074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c0d35d0 0x7f7b5c0b50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009d90 tx=0x7f7b5402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224dab17a93638 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b59ffb640 1 -- 172.21.15.66:0/3286303074 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44001670 con 0x7f7b5c0d35d0 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b59ffb640 1 -- 172.21.15.66:0/3286303074 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b54007540 con 0x7f7b5c0d35d0 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b59ffb640 1 -- 172.21.15.66:0/3286303074 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54007910 con 0x7f7b5c0d35d0 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b618c8640 1 -- 172.21.15.66:0/3286303074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c0d35d0 msgr2=0x7f7b5c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b618c8640 1 --2- 172.21.15.66:0/3286303074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c0d35d0 0x7f7b5c0b50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009d90 tx=0x7f7b5402a5f0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b618c8640 1 -- 172.21.15.66:0/3286303074 shutdown_connections 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b618c8640 1 --2- 172.21.15.66:0/3286303074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c0d35d0 0x7f7b5c0b50e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b618c8640 1 --2- 172.21.15.66:0/3286303074 >> v2:172.21.15.190:3300/0 conn(0x7f7b5c0d2110 0x7f7b5c0d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.643+0000 7f7b618c8640 1 -- 172.21.15.66:0/3286303074 >> 172.21.15.66:0/3286303074 conn(0x7f7b5c0d5060 msgr2=0x7f7b5c0d5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.644+0000 7f7b618c8640 1 -- 172.21.15.66:0/3286303074 shutdown_connections 2024-05-10T11:14:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.644+0000 7f7b618c8640 1 -- 172.21.15.66:0/3286303074 wait complete. 2024-05-10T11:14:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.645+0000 7f7b618c8640 1 Processor -- start 2024-05-10T11:14:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.645+0000 7f7b618c8640 1 -- start start 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b618c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b5c0d2110 0x7f7b5c1e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b618c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b5c0d35d0 0x7f7b5c157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b618c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c15f530 0x7f7b5c15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b618c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c15f910 con 0x7f7b5c0d2110 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b618c8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c0b4bc0 con 0x7f7b5c0d35d0 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b618c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5c0d3a00 con 0x7f7b5c15f530 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b5c0d2110 0x7f7b5c1e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b5c0d2110 0x7f7b5c1e9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34704/0 (socket says 172.21.15.66:34704) 2024-05-10T11:14:11.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 -- 172.21.15.66:0/2520415465 learned_addr learned my addr 172.21.15.66:0/2520415465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5a7fc640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b5c0d35d0 0x7f7b5c157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5b7fe640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c15f530 0x7f7b5c15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 -- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c15f530 msgr2=0x7f7b5c15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b5c15f530 0x7f7b5c15c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 -- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b5c0d35d0 msgr2=0x7f7b5c157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b5c0d35d0 0x7f7b5c157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 -- 172.21.15.66:0/2520415465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c1e7f00 con 0x7f7b5c0d2110 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.646+0000 7f7b5affd640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b5c0d2110 0x7f7b5c1e9c00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c780 tx=0x7f7b4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.647+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44017070 con 0x7f7b5c0d2110 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.647+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b44005ad0 con 0x7f7b5c0d2110 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.647+0000 7f7b618c8640 1 -- 172.21.15.66:0/2520415465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c1e81e0 con 0x7f7b5c0d2110 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.647+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44007070 con 0x7f7b5c0d2110 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.647+0000 7f7b618c8640 1 -- 172.21.15.66:0/2520415465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c1e87a0 con 0x7f7b5c0d2110 2024-05-10T11:14:11.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.648+0000 7f7b618c8640 1 -- 172.21.15.66:0/2520415465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f7b5c0693f0 con 0x7f7b5c0d2110 2024-05-10T11:14:11.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.648+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b4401a070 con 0x7f7b5c0d2110 2024-05-10T11:14:11.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.649+0000 7f7b53fff640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.649+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f7b44096c60 con 0x7f7b5c0d2110 2024-05-10T11:14:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.649+0000 7f7b5a7fc640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.649+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+505 (secure 0 0 0) 0x7f7b440992e0 con 0x7f7b5c0d2110 2024-05-10T11:14:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.649+0000 7f7b618c8640 1 -- 172.21.15.66:0/2520415465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f7b5c0d5690 con 0x7f7b5c0d2110 2024-05-10T11:14:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.650+0000 7f7b5a7fc640 1 --2- 172.21.15.66:0/2520415465 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c1eaac0 tx=0x7f7b4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.655+0000 7f3bc8814740 1 Processor -- start 2024-05-10T11:14:11.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.655+0000 7f3bc8814740 1 -- start start 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e7340 0x564b7c6e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c712330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c776a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bc8814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0201ec0 con 0x564b7c6ea650 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0161680 con 0x564b7c704220 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc015e750 con 0x564b7c6e7340 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c712330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c712330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34714/0 (socket says 172.21.15.66:34714) 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3132006997 learned_addr learned my addr 172.21.15.66:0/3132006997 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e7340 0x564b7c6e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e7340 msgr2=0x564b7c6e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c776a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e7340 0x564b7c6e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 msgr2=0x564b7c776a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c776a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.656+0000 7f3bbe7fc640 1 -- 172.21.15.66:0/3132006997 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7c724d10 con 0x564b7c6ea650 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.657+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c712330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bb405cf80 tx=0x7f3bb4067070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9387c82f20dd20c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.657+0000 7f3ba4ff9640 1 -- 172.21.15.66:0/3132006997 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4021040 con 0x564b7c6ea650 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.657+0000 7f3ba4ff9640 1 -- 172.21.15.66:0/3132006997 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4064b70 con 0x564b7c6ea650 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.657+0000 7f3ba4ff9640 1 -- 172.21.15.66:0/3132006997 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4067e60 con 0x564b7c6ea650 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.657+0000 7f3bc8814740 1 -- 172.21.15.66:0/3132006997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 msgr2=0x564b7c712330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.657+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c712330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bb405cf80 tx=0x7f3bb4067070 comp rx=0 tx=0).stop 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 -- 172.21.15.66:0/3132006997 shutdown_connections 2024-05-10T11:14:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c776a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6ea650 0x564b7c712330 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3132006997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6e7340 0x564b7c6e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 -- 172.21.15.66:0/3132006997 >> 172.21.15.66:0/3132006997 conn(0x564b7c6e6c00 msgr2=0x564b7c6e7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 -- 172.21.15.66:0/3132006997 shutdown_connections 2024-05-10T11:14:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 -- 172.21.15.66:0/3132006997 wait complete. 2024-05-10T11:14:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 -- start start 2024-05-10T11:14:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.658+0000 7f3bc8814740 1 Processor -- start 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6ea650 0x564b7c6b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0160fd0 con 0x564b7c6e7340 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b7c62d900 con 0x564b7c704220 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564b7c781a90 con 0x564b7c6ea650 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bc8814740 10 client.0 _ll_register_callbacks cb 0x7f3bb4009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34728/0 (socket says 172.21.15.66:34728) 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 -- 172.21.15.66:0/3920527513 learned_addr learned my addr 172.21.15.66:0/3920527513 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6ea650 0x564b7c6b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbf7fe640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 -- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6ea650 msgr2=0x564b7c6b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6ea650 0x564b7c6b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 -- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 msgr2=0x564b7c6e05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6e05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 -- 172.21.15.66:0/3920527513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7c7796d0 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3bbeffd640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6b5a60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00044e0 tx=0x7f3bb0006df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d43977f0c46434 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.659+0000 7f3b9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/3920527513 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0005ba0 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/3920527513 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f3bb001d040 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb4064b70 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/3920527513 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bb0005d40 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 10 client.5544 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564b7c783260 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/3920527513 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4064b70 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/3920527513 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f3bb0029ce0 con 0x564b7c6e7340 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 10 client.5544 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 10 client.5544 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 20 client.5544 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c6e3410 0x564b7c6e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 4 client.5544 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x564b7c627770 con 0x564b7c6e3410 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.660+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c6e3410 0x564b7c6e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3b9e7fc640 10 client.5544 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3bbe7fc640 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c6e3410 0x564b7c6e0ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=250168b46afd0949 server_cookie=701c14104663f983 in_seq=0 out_seq=0 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3b9e7fc640 1 -- 172.21.15.66:0/3920527513 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b7c627770 con 0x564b7c6e3410 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3b9e7fc640 10 client.5544 handle_command_reply: tid=0 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3bc8814740 1 client.5544 shutdown 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 msgr2=0x564b7c6b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.661+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6b5a60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00044e0 tx=0x7f3bb0006df0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 shutdown_connections 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x564b7c6e3410 0x564b7c6e0ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b7c704220 0x564b7c6e05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564b7c6ea650 0x564b7c6b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 --2- 172.21.15.66:0/3920527513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b7c6e7340 0x564b7c6b5a60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 >> 172.21.15.66:0/3920527513 conn(0x564b7c6e6c00 msgr2=0x564b7c712330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3b9e7fc640 0 client.5544 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.667 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f7f03849640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5194=0-4194304@1} caps={5194=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5194 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55b32d93ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:14:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 shutdown_connections 2024-05-10T11:14:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 1 -- 172.21.15.66:0/3920527513 wait complete. 2024-05-10T11:14:11.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc8814740 20 client.5544 trim_cache size 0 max 16384 2024-05-10T11:14:11.668 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:11.668 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:14:11.668 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "38de6018-9de0-47ea-8ad8-6188d25cd174", 2024-05-10T11:14:11.668 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:14:11.668 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3bac076300 msgr2=0x7f3bac0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3bac076300 0x7f3bac0787c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0008040 comp rx=0 tx=0).stop 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 msgr2=0x7f3bc00ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00ccb20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400e8c0 tx=0x7f3bb400ed80 comp rx=0 tx=0).stop 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 shutdown_connections 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3bac076300 0x7f3bac0787c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc0162990 0x7f3bc00caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bc00d1aa0 0x7f3bc00ccb20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 --2- 172.21.15.66:0/3695385707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3bc00b5f30 0x7f3bc00b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.662+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 >> 172.21.15.66:0/3695385707 conn(0x7f3bc009e3f0 msgr2=0x7f3bc00b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.663+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 shutdown_connections 2024-05-10T11:14:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.663+0000 7f3bc5a20640 1 -- 172.21.15.66:0/3695385707 wait complete. 2024-05-10T11:14:11.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:11.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-05-10T11:14:11.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.779+0000 7fab45245640 1 Processor -- start 2024-05-10T11:14:11.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.779+0000 7fab45245640 1 -- start start 2024-05-10T11:14:11.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.779+0000 7fab45245640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab400cf3e0 0x7fab400cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.779+0000 7fab45245640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400cd500 0x7fab400cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab45245640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4006e720 con 0x7fab400b2dd0 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab45245640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fab4006de80 con 0x7fab400cf3e0 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab45245640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab4006e160 con 0x7fab400cd500 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab400cf3e0 0x7fab400cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab400cf3e0 0x7fab400cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34742/0 (socket says 172.21.15.66:34742) 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 -- 172.21.15.66:0/3563174641 learned_addr learned my addr 172.21.15.66:0/3563174641 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 -- 172.21.15.66:0/3563174641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400cd500 msgr2=0x7fab400cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/3563174641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400cd500 0x7fab400cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 -- 172.21.15.66:0/3563174641 >> v1:172.21.15.190:6789/0 conn(0x7fab400b2dd0 legacy=0x7fab400b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.780+0000 7fab3ed9d640 1 -- 172.21.15.66:0/3563174641 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4006e440 con 0x7fab400cf3e0 2024-05-10T11:14:11.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/3563174641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cf3e0 0x7fab400cf8c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab30009870 tx=0x7fab3002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b523ea65bd59ce5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab3dd9b640 1 -- 172.21.15.66:0/3563174641 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30037070 con 0x7fab400cf3e0 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab3dd9b640 1 -- 172.21.15.66:0/3563174641 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab30032440 con 0x7fab400cf3e0 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab3dd9b640 1 -- 172.21.15.66:0/3563174641 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30032810 con 0x7fab400cf3e0 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 -- 172.21.15.66:0/3563174641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cf3e0 msgr2=0x7fab400cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 --2- 172.21.15.66:0/3563174641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cf3e0 0x7fab400cf8c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab30009870 tx=0x7fab3002a210 comp rx=0 tx=0).stop 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 -- 172.21.15.66:0/3563174641 shutdown_connections 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 --2- 172.21.15.66:0/3563174641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400cd500 0x7fab400cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 --2- 172.21.15.66:0/3563174641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cf3e0 0x7fab400cf8c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 -- 172.21.15.66:0/3563174641 >> 172.21.15.66:0/3563174641 conn(0x7fab400d2eb0 msgr2=0x7fab400d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 -- 172.21.15.66:0/3563174641 shutdown_connections 2024-05-10T11:14:11.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.781+0000 7fab45245640 1 -- 172.21.15.66:0/3563174641 wait complete. 2024-05-10T11:14:11.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.783+0000 7fab45245640 1 Processor -- start 2024-05-10T11:14:11.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.783+0000 7fab45245640 1 -- start start 2024-05-10T11:14:11.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab45245640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400b2dd0 0x7fab400c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab45245640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 0x7fab4015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab45245640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab400cf3e0 0x7fab40153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab45245640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab400d2190 con 0x7fab400cd500 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab45245640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab400b4510 con 0x7fab400cf3e0 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab45245640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab400d2310 con 0x7fab400b2dd0 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 0x7fab4015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 0x7fab4015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34758/0 (socket says 172.21.15.66:34758) 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 -- 172.21.15.66:0/822831749 learned_addr learned my addr 172.21.15.66:0/822831749 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400b2dd0 0x7fab400c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3f59e640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab400cf3e0 0x7fab40153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 -- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400b2dd0 msgr2=0x7fab400c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400b2dd0 0x7fab400c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 -- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab400cf3e0 msgr2=0x7fab40153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab400cf3e0 0x7fab40153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 -- 172.21.15.66:0/822831749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4015f6f0 con 0x7fab400cd500 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.784+0000 7fab3e59c640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 0x7fab4015cfc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fab3400b450 tx=0x7fab3400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.785+0000 7fab277fe640 1 -- 172.21.15.66:0/822831749 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34015020 con 0x7fab400cd500 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.785+0000 7fab277fe640 1 -- 172.21.15.66:0/822831749 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab34011890 con 0x7fab400cd500 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.785+0000 7fab277fe640 1 -- 172.21.15.66:0/822831749 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34011c80 con 0x7fab400cd500 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.785+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4015f9c0 con 0x7fab400cd500 2024-05-10T11:14:11.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.785+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab40160200 con 0x7fab400cd500 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.786+0000 7fab277fe640 1 -- 172.21.15.66:0/822831749 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab34018020 con 0x7fab400cd500 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.787+0000 7fab277fe640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fab2c0762d0 0x7fab2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.787+0000 7fab277fe640 1 -- 172.21.15.66:0/822831749 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fab34097740 con 0x7fab400cd500 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.787+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fab2c0762d0 0x7fab2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fab2c0762d0 0x7fab2c078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fab30034000 tx=0x7fab3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 Processor -- start 2024-05-10T11:14:11.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 -- start start 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5de70af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 0x55ba5dea0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea0b40 0x55ba5de75950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ba5de3d690 con 0x55ba5dea1280 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ba5dddaf30 con 0x55ba5dea0b40 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.788+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ba5dd93b20 con 0x55ba5debe160 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 0x55ba5dea0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 0x55ba5dea0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34772/0 (socket says 172.21.15.66:34772) 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 -- 172.21.15.66:0/3949599382 learned_addr learned my addr 172.21.15.66:0/3949599382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5de70af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3f59e640 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea0b40 0x55ba5de75950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 -- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 msgr2=0x55ba5de70af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5de70af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 -- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea0b40 msgr2=0x55ba5de75950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea0b40 0x55ba5de75950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 -- 172.21.15.66:0/3949599382 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5dd8be60 con 0x55ba5dea1280 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5de70af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab3e59c640 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 0x55ba5dea0600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fab34095a50 tx=0x7fab34011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdaa8f3f1aa10c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab257fa640 1 -- 172.21.15.66:0/3949599382 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340670e0 con 0x55ba5dea1280 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab257fa640 1 -- 172.21.15.66:0/3949599382 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab340695e0 con 0x55ba5dea1280 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.789+0000 7fab257fa640 1 -- 172.21.15.66:0/3949599382 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34075dd0 con 0x55ba5dea1280 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 -- 172.21.15.66:0/3949599382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 msgr2=0x55ba5dea0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 0x55ba5dea0600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fab34095a50 tx=0x7fab34011ee0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 -- 172.21.15.66:0/3949599382 shutdown_connections 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea0b40 0x55ba5de75950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1280 0x55ba5dea0600 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 --2- 172.21.15.66:0/3949599382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5de70af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 -- 172.21.15.66:0/3949599382 >> 172.21.15.66:0/3949599382 conn(0x55ba5de72d60 msgr2=0x55ba5debb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 -- 172.21.15.66:0/3949599382 shutdown_connections 2024-05-10T11:14:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 -- 172.21.15.66:0/3949599382 wait complete. 2024-05-10T11:14:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 -- start start 2024-05-10T11:14:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.790+0000 7fab4803a740 1 Processor -- start 2024-05-10T11:14:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5dea2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 0x55ba5de8de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1770 0x55ba5debd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ba5dd975e0 con 0x55ba5debe160 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ba5ddd6ef0 con 0x55ba5dea1770 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ba5de74f10 con 0x55ba5dea1280 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab4803a740 10 client.0 _ll_register_callbacks cb 0x55ba5dd92320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 0x55ba5de8de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 0x55ba5de8de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34782/0 (socket says 172.21.15.66:34782) 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab3e59c640 1 -- 172.21.15.66:0/1077783143 learned_addr learned my addr 172.21.15.66:0/1077783143 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5dea2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.791+0000 7fab3f59e640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1770 0x55ba5debd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3e59c640 1 -- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 msgr2=0x55ba5dea2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3e59c640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5dea2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3e59c640 1 -- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1770 msgr2=0x55ba5debd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3e59c640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1770 0x55ba5debd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3e59c640 1 -- 172.21.15.66:0/1077783143 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5dbb67d0 con 0x55ba5debe160 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3f59e640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1770 0x55ba5debd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab3e59c640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 0x55ba5de8de70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fab34060a80 tx=0x7fab340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308886d3e4762a5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab1dffb640 1 -- 172.21.15.66:0/1077783143 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3405cf10 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab1dffb640 1 -- 172.21.15.66:0/1077783143 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fab3405fb20 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab340695e0 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab1dffb640 1 -- 172.21.15.66:0/1077783143 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fab340670e0 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 10 client.5556 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55ba5daec3f0 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab1dffb640 1 -- 172.21.15.66:0/1077783143 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab340695e0 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab1dffb640 1 -- 172.21.15.66:0/1077783143 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fab3405c230 con 0x55ba5debe160 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 10 client.5556 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 10 client.5556 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 20 client.5556 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5de8ec10 0x55ba5de9fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 4 client.5556 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.792+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba5dde8b40 con 0x55ba5de8ec10 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.793+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5de8ec10 0x55ba5de9fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.793+0000 7fab1dffb640 10 client.5556 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.793+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5de8ec10 0x55ba5de9fad0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a3cd31b559d8c05 server_cookie=f394b6ab027a1a6b in_seq=0 out_seq=0 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.793+0000 7fab1dffb640 1 -- 172.21.15.66:0/1077783143 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ba5dde8b40 con 0x55ba5de8ec10 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.793+0000 7fab1dffb640 10 client.5556 handle_command_reply: tid=0 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.793+0000 7fab4803a740 1 client.5556 shutdown 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 msgr2=0x55ba5de8de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 0x55ba5de8de70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fab34060a80 tx=0x7fab340046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 shutdown_connections 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5de8ec10 0x55ba5de9fad0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1770 0x55ba5debd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5debe160 0x55ba5de8de70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab1dffb640 0 client.5556 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 --2- 172.21.15.66:0/1077783143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5dea2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 >> 172.21.15.66:0/1077783143 conn(0x55ba5dea0b40 msgr2=0x55ba5de70230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 shutdown_connections 2024-05-10T11:14:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 1 -- 172.21.15.66:0/1077783143 wait complete. 2024-05-10T11:14:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.794+0000 7fab4803a740 20 client.5556 trim_cache size 0 max 16384 2024-05-10T11:14:11.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.812+0000 7fab4803a740 1 Processor -- start 2024-05-10T11:14:11.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.812+0000 7fab4803a740 1 -- start start 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5de8d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab4803a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5de8c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5debe160 0x55ba5de9b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab4803a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab40201fb0 con 0x55ba5dea1770 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab40200fd0 con 0x55ba5debe160 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab400c80f0 con 0x55ba5dea1280 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5de8c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5de8c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34796/0 (socket says 172.21.15.66:34796) 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 -- 172.21.15.66:0/3198158584 learned_addr learned my addr 172.21.15.66:0/3198158584 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3f59e640 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5debe160 0x55ba5de9b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5de8d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 -- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 msgr2=0x55ba5de8d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5de8d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 -- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5debe160 msgr2=0x55ba5de9b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5debe160 0x55ba5de9b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 -- 172.21.15.66:0/3198158584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5daac0f0 con 0x55ba5dea1770 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5de8d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab3e59c640 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5de8c610 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab3405ceb0 tx=0x7fab3408f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faed6f4e08b4d09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab24ff9640 1 -- 172.21.15.66:0/3198158584 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340695e0 con 0x55ba5dea1770 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab24ff9640 1 -- 172.21.15.66:0/3198158584 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3405fb20 con 0x55ba5dea1770 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.813+0000 7fab24ff9640 1 -- 172.21.15.66:0/3198158584 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3405f590 con 0x55ba5dea1770 2024-05-10T11:14:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 -- 172.21.15.66:0/3198158584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 msgr2=0x55ba5de8c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5de8c610 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab3405ceb0 tx=0x7fab3408f000 comp rx=0 tx=0).stop 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 -- 172.21.15.66:0/3198158584 shutdown_connections 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5debe160 0x55ba5de9b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5de8c610 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 --2- 172.21.15.66:0/3198158584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5dea1280 0x55ba5de8d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 -- 172.21.15.66:0/3198158584 >> 172.21.15.66:0/3198158584 conn(0x55ba5dea0b40 msgr2=0x55ba5deb21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 -- 172.21.15.66:0/3198158584 shutdown_connections 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 -- 172.21.15.66:0/3198158584 wait complete. 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.814+0000 7fab4803a740 1 -- start start 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 Processor -- start 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1280 0x55ba5decd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5deb7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5debbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ba5decb410 con 0x55ba5dea1770 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab40200980 con 0x55ba5dea1280 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ba5debf2c0 con 0x55ba5debe160 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab4803a740 10 client.0 _ll_register_callbacks cb 0x7fab38005010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5deb7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5deb7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34800/0 (socket says 172.21.15.66:34800) 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab3e59c640 1 -- 172.21.15.66:0/2458769177 learned_addr learned my addr 172.21.15.66:0/2458769177 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1280 0x55ba5decd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.815+0000 7fab3f59e640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5debbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3e59c640 1 -- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 msgr2=0x55ba5debbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3e59c640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5debbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3e59c640 1 -- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1280 msgr2=0x55ba5decd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3e59c640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1280 0x55ba5decd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3e59c640 1 -- 172.21.15.66:0/2458769177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5deb78c0 con 0x55ba5dea1770 2024-05-10T11:14:11.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3f59e640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5debbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab3e59c640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5deb7380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab3405c940 tx=0x7fab340047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d58ae975cfb64a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab1dffb640 1 -- 172.21.15.66:0/2458769177 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3405f790 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab1dffb640 1 -- 172.21.15.66:0/2458769177 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fab340970b0 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab3405fb20 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab1dffb640 1 -- 172.21.15.66:0/2458769177 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fab3405f930 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 10 client.5562 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55ba5deb78c0 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab1dffb640 1 -- 172.21.15.66:0/2458769177 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3406e070 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab1dffb640 1 -- 172.21.15.66:0/2458769177 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fab340972b0 con 0x55ba5dea1770 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 10 client.5562 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 10 client.5562 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 20 client.5562 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5debc410 0x55ba5de9b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 4 client.5562 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.816+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba5dde29b0 con 0x55ba5debc410 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5debc410 0x55ba5de9b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab3ed9d640 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5debc410 0x55ba5de9b730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f400ca5aefeb6d2 server_cookie=a4060226fcd949b6 in_seq=0 out_seq=0 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab1dffb640 10 client.5562 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab1dffb640 1 -- 172.21.15.66:0/2458769177 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55ba5dde29b0 con 0x55ba5debc410 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab1dffb640 10 client.5562 handle_command_reply: tid=0 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 client.5562 shutdown 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 msgr2=0x55ba5deb7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5deb7380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab3405c940 tx=0x7fab340047d0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 shutdown_connections 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55ba5debc410 0x55ba5de9b730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ba5debe160 0x55ba5debbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab1dffb640 0 client.5562 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ba5dea1770 0x55ba5deb7380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 --2- 172.21.15.66:0/2458769177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba5dea1280 0x55ba5decd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 >> 172.21.15.66:0/2458769177 conn(0x55ba5dea0b40 msgr2=0x55ba5de8d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 shutdown_connections 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 1 -- 172.21.15.66:0/2458769177 wait complete. 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.817+0000 7fab4803a740 20 client.5562 trim_cache size 0 max 16384 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:14:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "38de6018-9de0-47ea-8ad8-6188d25cd174": { 2024-05-10T11:14:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-05-10T11:14:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "38de6018-9de0-47ea-8ad8-6188d25cd174", 2024-05-10T11:14:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair" 2024-05-10T11:14:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:11.826 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fab2c0762d0 msgr2=0x7fab2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fab2c0762d0 0x7fab2c078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fab30034000 tx=0x7fab3002e000 comp rx=0 tx=0).stop 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 msgr2=0x7fab4015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 0x7fab4015cfc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fab3400b450 tx=0x7fab3400b910 comp rx=0 tx=0).stop 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 shutdown_connections 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fab2c0762d0 0x7fab2c078790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab400cf3e0 0x7fab40153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab400cd500 0x7fab4015cfc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 --2- 172.21.15.66:0/822831749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab400b2dd0 0x7fab400c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 >> 172.21.15.66:0/822831749 conn(0x7fab400d2eb0 msgr2=0x7fab4006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 shutdown_connections 2024-05-10T11:14:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:11.818+0000 7fab45245640 1 -- 172.21.15.66:0/822831749 wait complete. 2024-05-10T11:14:11.829 INFO:tasks.cephfs.filesystem:scrub status for tag:38de6018-9de0-47ea-8ad8-6188d25cd174 - {'path': '/', 'tag': '38de6018-9de0-47ea-8ad8-6188d25cd174', 'options': 'recursive,repair'} 2024-05-10T11:14:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:12.144+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 7 ==== log(6 entries from seq 1 at 2024-05-10T11:14:11.662677+0000) ==== 1078+0+0 (secure 0 0 0) 0x7f7b44095110 con 0x7f7b5c0d2110 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: cluster: 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: id: 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: health: HEALTH_OK 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: services: 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: mgr: x(active, since 119s), standbys: y 2024-05-10T11:14:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: mds: 1/1 daemons up, 3 standby 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: osd: 8 osds: 8 up (since 113s), 8 in (since 2m) 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: data: 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: volumes: 1/1 healthy 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: pools: 3 pools, 97 pgs 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: objects: 24 objects, 579 KiB 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: usage: 217 MiB used, 720 GiB / 720 GiB avail 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: pgs: 97 active+clean 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: io: 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: client: 1.4 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:12.147 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:11.662677+0000 mds.c [INF] scrub queued for path: / 2024-05-10T11:14:12.147 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:11.662679+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-05-10T11:14:12.147 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:11.662684+0000 mds.c [INF] scrub summary: active paths [/] 2024-05-10T11:14:12.147 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:11.663460+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-05-10T11:14:12.147 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:11.663471+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-05-10T11:14:12.147 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:11.663927+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-05-10T11:14:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:13.150+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 8 ==== log(4 entries from seq 115 at 2024-05-10T11:14:12.670985+0000) ==== 1122+0+0 (secure 0 0 0) 0x7f7b4405c050 con 0x7f7b5c0d2110 2024-05-10T11:14:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:14.151+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 9 ==== log(2 entries from seq 407 at 2024-05-10T11:14:13.146832+0000) ==== 558+0+0 (secure 0 0 0) 0x7f7b44060020 con 0x7f7b5c0d2110 2024-05-10T11:14:15.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:15.158+0000 7f7b53fff640 1 -- 172.21.15.66:0/2520415465 <== mon.0 v2:172.21.15.66:3300/0 10 ==== log(1 entries from seq 7 at 2024-05-10T11:14:13.772516+0000) ==== 189+0+0 (secure 0 0 0) 0x7f7b44068700 con 0x7f7b5c0d2110 2024-05-10T11:14:15.158 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:14:13.772516+0000 mds.c [INF] scrub summary: idle 2024-05-10T11:14:31.538 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:14:31.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:14:41.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:41.830 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-05-10T11:14:41.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.950+0000 7fed1d72b640 1 Processor -- start 2024-05-10T11:14:41.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.950+0000 7fed1d72b640 1 -- start start 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed1d72b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed1815f190 0x7fed180cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed1d72b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fed1806d3e0 0x7fed180cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed1d72b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed1806d920 con 0x7fed1806e920 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed1d72b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fed1806dc00 con 0x7fed1815f190 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed1d72b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fed180c6b80 con 0x7fed1806d3e0 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed16ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed1815f190 0x7fed180cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed0ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fed1806e920 0x7fed1806ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54614/0 (socket says 172.21.15.66:54614) 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed0ffff640 1 -- 172.21.15.66:0/1762923454 learned_addr learned my addr 172.21.15.66:0/1762923454 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed177fe640 1 --2- 172.21.15.66:0/1762923454 >> v2:172.21.15.190:3300/0 conn(0x7fed1806d3e0 0x7fed180cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed16ffd640 1 -- 172.21.15.66:0/1762923454 >> v2:172.21.15.190:3300/0 conn(0x7fed1806d3e0 msgr2=0x7fed180cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed16ffd640 1 --2- 172.21.15.66:0/1762923454 >> v2:172.21.15.190:3300/0 conn(0x7fed1806d3e0 0x7fed180cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed16ffd640 1 -- 172.21.15.66:0/1762923454 >> v1:172.21.15.66:6789/0 conn(0x7fed1806e920 legacy=0x7fed1806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.951+0000 7fed16ffd640 1 -- 172.21.15.66:0/1762923454 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed180c6e60 con 0x7fed1815f190 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.952+0000 7fed16ffd640 1 --2- 172.21.15.66:0/1762923454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed180cf970 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fed18073a50 tx=0x7fed0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a97b4a0f14a4f1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.952+0000 7fed167fc640 1 -- 172.21.15.66:0/1762923454 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08037070 con 0x7fed1815f190 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.952+0000 7fed167fc640 1 -- 172.21.15.66:0/1762923454 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed08032440 con 0x7fed1815f190 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.952+0000 7fed167fc640 1 -- 172.21.15.66:0/1762923454 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08032810 con 0x7fed1815f190 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 -- 172.21.15.66:0/1762923454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 msgr2=0x7fed180cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 --2- 172.21.15.66:0/1762923454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed180cf970 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fed18073a50 tx=0x7fed0802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 -- 172.21.15.66:0/1762923454 shutdown_connections 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 --2- 172.21.15.66:0/1762923454 >> v2:172.21.15.190:3300/0 conn(0x7fed1806d3e0 0x7fed180cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 --2- 172.21.15.66:0/1762923454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed180cf970 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 -- 172.21.15.66:0/1762923454 >> 172.21.15.66:0/1762923454 conn(0x7fed180ce0a0 msgr2=0x7fed180ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 -- 172.21.15.66:0/1762923454 shutdown_connections 2024-05-10T11:14:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.953+0000 7fed1d72b640 1 -- 172.21.15.66:0/1762923454 wait complete. 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.954+0000 7fed1d72b640 1 Processor -- start 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.954+0000 7fed1d72b640 1 -- start start 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed1d72b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed1806d3e0 0x7fed18141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed1d72b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1806e920 0x7fed181561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed1d72b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed181566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed1d72b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed18168df0 con 0x7fed1815f190 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed1d72b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fed1815f570 con 0x7fed1806d3e0 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed1d72b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fed18168f70 con 0x7fed1806e920 2024-05-10T11:14:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed181566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed181566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53816/0 (socket says 172.21.15.66:53816) 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 -- 172.21.15.66:0/3526128745 learned_addr learned my addr 172.21.15.66:0/3526128745 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed1806d3e0 0x7fed18141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed0ffff640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1806e920 0x7fed181561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 -- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1806e920 msgr2=0x7fed181561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1806e920 0x7fed181561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 -- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed1806d3e0 msgr2=0x7fed18141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed1806d3e0 0x7fed18141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed177fe640 1 -- 172.21.15.66:0/3526128745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed180b67c0 con 0x7fed1815f190 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed1806d3e0 0x7fed18141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.955+0000 7fed0ffff640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1806e920 0x7fed181561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.956+0000 7fed177fe640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed181566e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fed10009d30 tx=0x7fed1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.956+0000 7fed0f7fe640 1 -- 172.21.15.66:0/3526128745 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10018020 con 0x7fed1815f190 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.956+0000 7fed0f7fe640 1 -- 172.21.15.66:0/3526128745 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10014480 con 0x7fed1815f190 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.956+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed180b6a30 con 0x7fed1815f190 2024-05-10T11:14:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.956+0000 7fed0f7fe640 1 -- 172.21.15.66:0/3526128745 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10014870 con 0x7fed1815f190 2024-05-10T11:14:41.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.956+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed180b6ff0 con 0x7fed1815f190 2024-05-10T11:14:41.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.958+0000 7fed0f7fe640 1 -- 172.21.15.66:0/3526128745 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed10005d10 con 0x7fed1815f190 2024-05-10T11:14:41.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.958+0000 7fed0f7fe640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fecf80762d0 0x7fecf8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.958+0000 7fed0f7fe640 1 -- 172.21.15.66:0/3526128745 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fed10098150 con 0x7fed1815f190 2024-05-10T11:14:41.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.958+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fecf80762d0 0x7fecf8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.959+0000 7fed2044a740 1 Processor -- start 2024-05-10T11:14:41.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.959+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fecf80762d0 0x7fecf8078790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed08034000 tx=0x7fed0802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.959+0000 7fed2044a740 1 -- start start 2024-05-10T11:14:41.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d35baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed2044a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 0x55c21d360950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed2044a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c21d328690 con 0x55c21d38bb40 2024-05-10T11:14:41.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c21d2c5f30 con 0x55c21d38c280 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55c21d27eb20 con 0x55c21d3a9160 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 0x55c21d360950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 0x55c21d360950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53826/0 (socket says 172.21.15.66:53826) 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 -- 172.21.15.66:0/648750901 learned_addr learned my addr 172.21.15.66:0/648750901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d35baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed0ffff640 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 -- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 msgr2=0x55c21d35baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d35baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 -- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 msgr2=0x55c21d38b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.960+0000 7fed177fe640 1 -- 172.21.15.66:0/648750901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21d276e60 con 0x55c21d38bb40 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed177fe640 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 0x55c21d360950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fed1005d300 tx=0x7fed10060d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a6db01e24ea5b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed0cff9640 1 -- 172.21.15.66:0/648750901 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1007a020 con 0x55c21d38bb40 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed0cff9640 1 -- 172.21.15.66:0/648750901 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10061280 con 0x55c21d38bb40 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed0cff9640 1 -- 172.21.15.66:0/648750901 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10065370 con 0x55c21d38bb40 2024-05-10T11:14:41.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 -- 172.21.15.66:0/648750901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 msgr2=0x55c21d360950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 0x55c21d360950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fed1005d300 tx=0x7fed10060d00 comp rx=0 tx=0).stop 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 -- 172.21.15.66:0/648750901 shutdown_connections 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d38bb40 0x55c21d360950 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 --2- 172.21.15.66:0/648750901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d35baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.961+0000 7fed2044a740 1 -- 172.21.15.66:0/648750901 >> 172.21.15.66:0/648750901 conn(0x55c21d35dd60 msgr2=0x55c21d3a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.962+0000 7fed2044a740 1 -- 172.21.15.66:0/648750901 shutdown_connections 2024-05-10T11:14:41.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.962+0000 7fed2044a740 1 -- 172.21.15.66:0/648750901 wait complete. 2024-05-10T11:14:41.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.962+0000 7fed2044a740 1 -- start start 2024-05-10T11:14:41.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.962+0000 7fed2044a740 1 Processor -- start 2024-05-10T11:14:41.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d3b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 0x55c21d39eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c21d2825e0 con 0x55c21d387180 2024-05-10T11:14:41.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c21d2c1ef0 con 0x55c21d38c280 2024-05-10T11:14:41.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55c21d35ff10 con 0x55c21d3a9160 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed2044a740 10 client.0 _ll_register_callbacks cb 0x55c21d27d320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 0x55c21d39eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 0x55c21d39eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53840/0 (socket says 172.21.15.66:53840) 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 -- 172.21.15.66:0/3905881450 learned_addr learned my addr 172.21.15.66:0/3905881450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed0ffff640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d3b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 -- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 msgr2=0x55c21d3b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d3b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 -- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 msgr2=0x55c21d38efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.963+0000 7fed177fe640 1 -- 172.21.15.66:0/3905881450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21d0a17d0 con 0x55c21d387180 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed177fe640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 0x55c21d39eb60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fed10060f80 tx=0x7fed10063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adce7058e145e5c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fecf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fecf5ffb640 1 -- 172.21.15.66:0/3905881450 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1007a040 con 0x55c21d387180 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fecf5ffb640 1 -- 172.21.15.66:0/3905881450 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fed100604e0 con 0x55c21d387180 2024-05-10T11:14:41.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed10061280 con 0x55c21d387180 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fecf5ffb640 1 -- 172.21.15.66:0/3905881450 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed1006a050 con 0x55c21d387180 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 10 client.5577 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55c21cfd73f0 con 0x55c21d387180 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fecf5ffb640 1 -- 172.21.15.66:0/3905881450 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10061280 con 0x55c21d387180 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fecf5ffb640 1 -- 172.21.15.66:0/3905881450 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fed1005cbf0 con 0x55c21d387180 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 10 client.5577 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 10 client.5577 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 20 client.5577 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d3b6ef0 0x55c21d388150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 4 client.5577 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c21d2d3b40 con 0x55c21d3b6ef0 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.964+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d3b6ef0 0x55c21d388150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.965+0000 7fecf5ffb640 10 client.5577 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.965+0000 7fed16ffd640 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d3b6ef0 0x55c21d388150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60a2ebaa4db1c882 server_cookie=bb399a239889c7a5 in_seq=0 out_seq=0 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.965+0000 7fecf5ffb640 1 -- 172.21.15.66:0/3905881450 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c21d2d3b40 con 0x55c21d3b6ef0 2024-05-10T11:14:41.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.965+0000 7fecf5ffb640 10 client.5577 handle_command_reply: tid=0 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.965+0000 7fed2044a740 1 client.5577 shutdown 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 msgr2=0x55c21d39eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 0x55c21d39eb60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fed10060f80 tx=0x7fed10063000 comp rx=0 tx=0).stop 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 shutdown_connections 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d3b6ef0 0x55c21d388150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d387180 0x55c21d39eb60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fecf5ffb640 0 client.5577 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d3a9160 0x55c21d3b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 --2- 172.21.15.66:0/3905881450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 >> 172.21.15.66:0/3905881450 conn(0x55c21d38bb40 msgr2=0x55c21d35b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 shutdown_connections 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 1 -- 172.21.15.66:0/3905881450 wait complete. 2024-05-10T11:14:41.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.966+0000 7fed2044a740 20 client.5577 trim_cache size 0 max 16384 2024-05-10T11:14:41.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.984+0000 7fed2044a740 1 Processor -- start 2024-05-10T11:14:41.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.984+0000 7fed2044a740 1 -- start start 2024-05-10T11:14:41.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d38df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed2044a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed2044a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed18201ed0 con 0x55c21d3a9160 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fed18200f30 con 0x55c21d38c280 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fed1815d1c0 con 0x55c21d387180 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53844/0 (socket says 172.21.15.66:53844) 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 -- 172.21.15.66:0/2563271508 learned_addr learned my addr 172.21.15.66:0/2563271508 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 -- 172.21.15.66:0/2563271508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 msgr2=0x55c21d38df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d38df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 -- 172.21.15.66:0/2563271508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 msgr2=0x55c21d38e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 -- 172.21.15.66:0/2563271508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21d3884c0 con 0x55c21d3a9160 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fed177fe640 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3ca340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fed10061210 tx=0x7fed10077000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe68351d5d514a1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fecf7fff640 1 -- 172.21.15.66:0/2563271508 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1007a070 con 0x55c21d3a9160 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.985+0000 7fecf7fff640 1 -- 172.21.15.66:0/2563271508 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10065630 con 0x55c21d3a9160 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fecf7fff640 1 -- 172.21.15.66:0/2563271508 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed100604e0 con 0x55c21d3a9160 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 -- 172.21.15.66:0/2563271508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 msgr2=0x55c21d3ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3ca340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fed10061210 tx=0x7fed10077000 comp rx=0 tx=0).stop 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 -- 172.21.15.66:0/2563271508 shutdown_connections 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3ca340 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d38e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 --2- 172.21.15.66:0/2563271508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d38df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 -- 172.21.15.66:0/2563271508 >> 172.21.15.66:0/2563271508 conn(0x55c21d38bb40 msgr2=0x55c21d38b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 -- 172.21.15.66:0/2563271508 shutdown_connections 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.986+0000 7fed2044a740 1 -- 172.21.15.66:0/2563271508 wait complete. 2024-05-10T11:14:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 -- start start 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 Processor -- start 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d385b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d386060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c21d361990 con 0x55c21d3a9160 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fed182009b0 con 0x55c21d38c280 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.987+0000 7fed2044a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55c21d2db850 con 0x55c21d387180 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed2044a740 10 client.0 _ll_register_callbacks cb 0x7fed00007e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:14:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53846/0 (socket says 172.21.15.66:53846) 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 -- 172.21.15.66:0/1402881064 learned_addr learned my addr 172.21.15.66:0/1402881064 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed16ffd640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d385b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed0ffff640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d386060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 -- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 msgr2=0x55c21d385b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d385b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 -- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 msgr2=0x55c21d386060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d386060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 -- 172.21.15.66:0/1402881064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21cf970f0 con 0x55c21d3a9160 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed0ffff640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d386060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed177fe640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3c02a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fed1005d820 tx=0x7fed1001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92fbcab155b6949 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fecf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fecf5ffb640 1 -- 172.21.15.66:0/1402881064 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10073060 con 0x55c21d3a9160 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fecf5ffb640 1 -- 172.21.15.66:0/1402881064 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fed1005ff50 con 0x55c21d3a9160 2024-05-10T11:14:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed10065630 con 0x55c21d3a9160 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fecf5ffb640 1 -- 172.21.15.66:0/1402881064 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed1007a050 con 0x55c21d3a9160 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed2044a740 10 client.5583 fetch_fsmap learned FSMap version 25 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.988+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55c21cf970f0 con 0x55c21d3a9160 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fecf5ffb640 1 -- 172.21.15.66:0/1402881064 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10065630 con 0x55c21d3a9160 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fecf5ffb640 1 -- 172.21.15.66:0/1402881064 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fed10060150 con 0x55c21d3a9160 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 10 client.5583 fetch_fsmap finished waiting for FSMap version 25 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 10 client.5583 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 20 client.5583 populate_metadata read hostname 'smithi066' 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d40afd0 0x55c21d3c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 4 client.5583 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 --> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c21d2cd9b0 con 0x55c21d40afd0 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed16ffd640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d40afd0 0x55c21d3c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:41.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fecf5ffb640 10 client.5583 ms_handle_connect on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed16ffd640 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d40afd0 0x55c21d3c07e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61d7c7013336b5e5 server_cookie=277668b2ffce8885 in_seq=0 out_seq=0 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fecf5ffb640 1 -- 172.21.15.66:0/1402881064 <== mds.0 v2:172.21.15.66:6833/433642873 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c21d2cd9b0 con 0x55c21d40afd0 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fecf5ffb640 10 client.5583 handle_command_reply: tid=0 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 client.5583 shutdown 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 msgr2=0x55c21d3c02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3c02a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fed1005d820 tx=0x7fed1001f040 comp rx=0 tx=0).stop 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 shutdown_connections 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:6833/433642873,v1:172.21.15.66:6835/433642873] conn(0x55c21d40afd0 0x55c21d3c07e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c21d3a9160 0x55c21d3c02a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c21d38c280 0x55c21d386060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fecf5ffb640 0 client.5583 ms_handle_reset on v2:172.21.15.66:6833/433642873 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 --2- 172.21.15.66:0/1402881064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c21d387180 0x55c21d385b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.989+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 >> 172.21.15.66:0/1402881064 conn(0x55c21d38bb40 msgr2=0x55c21d39e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 shutdown_connections 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed2044a740 1 -- 172.21.15.66:0/1402881064 wait complete. 2024-05-10T11:14:41.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed2044a740 20 client.5583 trim_cache size 0 max 16384 2024-05-10T11:14:41.996 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:41.996 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:14:41.996 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:14:41.996 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fecf80762d0 msgr2=0x7fecf8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fecf80762d0 0x7fecf8078790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed08034000 tx=0x7fed0802e000 comp rx=0 tx=0).stop 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 msgr2=0x7fed181566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed181566e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fed10009d30 tx=0x7fed1000c490 comp rx=0 tx=0).stop 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 shutdown_connections 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fecf80762d0 0x7fecf8078790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1815f190 0x7fed181566e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1806e920 0x7fed181561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 --2- 172.21.15.66:0/3526128745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed1806d3e0 0x7fed18141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 >> 172.21.15.66:0/3526128745 conn(0x7fed180ce0a0 msgr2=0x7fed180b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 shutdown_connections 2024-05-10T11:14:41.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:41.990+0000 7fed1d72b640 1 -- 172.21.15.66:0/3526128745 wait complete. 2024-05-10T11:14:42.001 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:14:42.102 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:42.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.206+0000 7fdeee1b6640 1 Processor -- start 2024-05-10T11:14:42.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.206+0000 7fdeee1b6640 1 -- start start 2024-05-10T11:14:42.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdeee1b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdeee1b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdee80d5cb0 0x7fdee80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdeee1b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdee8162b30 0x7fdee80d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdeee1b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fdee80b4f20 con 0x7fdee80d5cb0 2024-05-10T11:14:42.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdeee1b6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fdee80d0fe0 con 0x7fdee8162b30 2024-05-10T11:14:42.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdeee1b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80b45f0 con 0x7fdee8162750 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdee6ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdee80d5cb0 0x7fdee80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdee6ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdee80d5cb0 0x7fdee80d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53862/0 (socket says 172.21.15.66:53862) 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdee6ffd640 1 -- 172.21.15.66:0/5565879 learned_addr learned my addr 172.21.15.66:0/5565879 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdee77fe640 1 --2- 172.21.15.66:0/5565879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.207+0000 7fdee7fff640 1 --2- 172.21.15.66:0/5565879 >> v2:172.21.15.190:3300/0 conn(0x7fdee8162b30 0x7fdee80d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.208+0000 7fdee6ffd640 1 -- 172.21.15.66:0/5565879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 msgr2=0x7fdee80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.208+0000 7fdee6ffd640 1 --2- 172.21.15.66:0/5565879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.208+0000 7fdee6ffd640 1 -- 172.21.15.66:0/5565879 >> v2:172.21.15.190:3300/0 conn(0x7fdee8162b30 msgr2=0x7fdee80d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.208+0000 7fdee6ffd640 1 --2- 172.21.15.66:0/5565879 >> v2:172.21.15.190:3300/0 conn(0x7fdee8162b30 0x7fdee80d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.208+0000 7fdee6ffd640 1 -- 172.21.15.66:0/5565879 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee80b48d0 con 0x7fdee80d5cb0 2024-05-10T11:14:42.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.208+0000 7fdee6ffd640 1 --2- 172.21.15.66:0/5565879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80d5cb0 0x7fdee80d3630 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdee80cc0d0 tx=0x7fdedc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21b6bed642b3392 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.210+0000 7fdee67fc640 1 -- 172.21.15.66:0/5565879 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc037070 con 0x7fdee80d5cb0 2024-05-10T11:14:42.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.210+0000 7fdee67fc640 1 -- 172.21.15.66:0/5565879 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc032440 con 0x7fdee80d5cb0 2024-05-10T11:14:42.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.210+0000 7fdee67fc640 1 -- 172.21.15.66:0/5565879 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc032810 con 0x7fdee80d5cb0 2024-05-10T11:14:42.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 -- 172.21.15.66:0/5565879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80d5cb0 msgr2=0x7fdee80d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/5565879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80d5cb0 0x7fdee80d3630 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdee80cc0d0 tx=0x7fdedc02a140 comp rx=0 tx=0).stop 2024-05-10T11:14:42.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 -- 172.21.15.66:0/5565879 shutdown_connections 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/5565879 >> v2:172.21.15.190:3300/0 conn(0x7fdee8162b30 0x7fdee80d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/5565879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80d5cb0 0x7fdee80d3630 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/5565879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 -- 172.21.15.66:0/5565879 >> 172.21.15.66:0/5565879 conn(0x7fdee809e3b0 msgr2=0x7fdee80d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 -- 172.21.15.66:0/5565879 shutdown_connections 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.211+0000 7fdeee1b6640 1 -- 172.21.15.66:0/5565879 wait complete. 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.212+0000 7fdeee1b6640 1 Processor -- start 2024-05-10T11:14:42.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.212+0000 7fdeee1b6640 1 -- start start 2024-05-10T11:14:42.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdeee1b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdeee1b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8162b30 0x7fdee80ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdeee1b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 0x7fdee80b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdeee1b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80d0d30 con 0x7fdee80ce2c0 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdeee1b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80d0bb0 con 0x7fdee8162b30 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdeee1b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80d1660 con 0x7fdee8162750 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 0x7fdee80b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 0x7fdee80b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53876/0 (socket says 172.21.15.66:53876) 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 -- 172.21.15.66:0/2232284019 learned_addr learned my addr 172.21.15.66:0/2232284019 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee77fe640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee6ffd640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8162b30 0x7fdee80ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 -- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 msgr2=0x7fdee80cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 -- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8162b30 msgr2=0x7fdee80ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8162b30 0x7fdee80ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.213+0000 7fdee7fff640 1 -- 172.21.15.66:0/2232284019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee80cd260 con 0x7fdee80ce2c0 2024-05-10T11:14:42.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.214+0000 7fdee7fff640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 0x7fdee80b3730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdee0007e60 tx=0x7fdee000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.214+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0014420 con 0x7fdee80ce2c0 2024-05-10T11:14:42.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.214+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0019070 con 0x7fdee80ce2c0 2024-05-10T11:14:42.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.214+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee80ce750 con 0x7fdee80ce2c0 2024-05-10T11:14:42.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.214+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0014820 con 0x7fdee80ce2c0 2024-05-10T11:14:42.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.214+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee80cd7e0 con 0x7fdee80ce2c0 2024-05-10T11:14:42.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.215+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee806a220 con 0x7fdee80ce2c0 2024-05-10T11:14:42.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.215+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdee00149c0 con 0x7fdee80ce2c0 2024-05-10T11:14:42.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.216+0000 7fdecffff640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fded4076300 0x7fded40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.216+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fdee0097e90 con 0x7fdee80ce2c0 2024-05-10T11:14:42.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.216+0000 7fdee77fe640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fded4076300 0x7fded40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.217+0000 7fdee77fe640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fded4076300 0x7fded40787c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.220+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdee0060fe0 con 0x7fdee80ce2c0 2024-05-10T11:14:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.452+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdee8161580 con 0x7fdee80ce2c0 2024-05-10T11:14:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.453+0000 7fdecffff640 1 -- 172.21.15.66:0/2232284019 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7fdee00652e0 con 0x7fdee80ce2c0 2024-05-10T11:14:42.453 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:42.454 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:42.454 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fded4076300 msgr2=0x7fded40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fded4076300 0x7fded40787c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8008040 comp rx=0 tx=0).stop 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 msgr2=0x7fdee80b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 0x7fdee80b3730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdee0007e60 tx=0x7fdee000e4b0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 shutdown_connections 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fded4076300 0x7fded40787c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee80ce2c0 0x7fdee80b3730 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8162b30 0x7fdee80ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 --2- 172.21.15.66:0/2232284019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdee8162750 0x7fdee80cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 >> 172.21.15.66:0/2232284019 conn(0x7fdee809e3b0 msgr2=0x7fdee80d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:42.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.455+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 shutdown_connections 2024-05-10T11:14:42.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.456+0000 7fdeee1b6640 1 -- 172.21.15.66:0/2232284019 wait complete. 2024-05-10T11:14:42.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T11:14:42.593 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:14:42.593 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:14:42.594 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T11:14:42.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.638+0000 7f3e60a0ff40 1 Processor -- start 2024-05-10T11:14:42.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.638+0000 7f3e60a0ff40 1 -- start start 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e60a0ff40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f58a6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e60a0ff40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5811f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e60a0ff40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f58a5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e60a0ff40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5611f5773f50 con 0x5611f5816270 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e60a0ff40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5611f58166e0 con 0x5611f588d440 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e60a0ff40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5611f5813650 con 0x5611f57caef0 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5811f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5811f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53878/0 (socket says 172.21.15.66:53878) 2024-05-10T11:14:42.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 -- 172.21.15.66:0/2382237445 learned_addr learned my addr 172.21.15.66:0/2382237445 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5e099640 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f58a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d898640 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f58a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 -- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 msgr2=0x5611f58a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f58a6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 -- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 msgr2=0x5611f58a5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f58a5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 -- 172.21.15.66:0/2382237445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f5813390 con 0x5611f5816270 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5e099640 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f58a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.639+0000 7f3e5d097640 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5811f20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e54058040 tx=0x7f3e5404f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f5c3854a193f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e4ffff640 1 -- 172.21.15.66:0/2382237445 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5405a070 con 0x5611f5816270 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e4ffff640 1 -- 172.21.15.66:0/2382237445 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e54064070 con 0x5611f5816270 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e4ffff640 1 -- 172.21.15.66:0/2382237445 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54055440 con 0x5611f5816270 2024-05-10T11:14:42.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/2382237445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 msgr2=0x5611f5811f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5811f20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e54058040 tx=0x7f3e5404f000 comp rx=0 tx=0).stop 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/2382237445 shutdown_connections 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f58a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5811f20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/2382237445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f58a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/2382237445 >> 172.21.15.66:0/2382237445 conn(0x5611f57f6800 msgr2=0x5611f57ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/2382237445 shutdown_connections 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.640+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/2382237445 wait complete. 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 Processor -- start 2024-05-10T11:14:42.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 -- start start 2024-05-10T11:14:42.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f588a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5939930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f5888df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5611f588c550 con 0x5611f5816270 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5611f588c120 con 0x5611f588d440 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.641+0000 7f3e60a0ff40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5611f588cb10 con 0x5611f57caef0 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5939930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5939930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53888/0 (socket says 172.21.15.66:53888) 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 -- 172.21.15.66:0/3571452359 learned_addr learned my addr 172.21.15.66:0/3571452359 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d898640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f588a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5e099640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f5888df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 -- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 msgr2=0x5611f588a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5611f57caef0 0x5611f588a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 -- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 msgr2=0x5611f5888df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f5888df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 -- 172.21.15.66:0/3571452359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f5889740 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5e099640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611f588d440 0x5611f5888df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e5d097640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5939930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e54046650 tx=0x7f3e54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e4effd640 1 -- 172.21.15.66:0/3571452359 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5405a050 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e4effd640 1 -- 172.21.15.66:0/3571452359 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5405b040 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611f5889a20 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e4effd640 1 -- 172.21.15.66:0/3571452359 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54055a20 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.642+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f5889fe0 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.644+0000 7f3e4effd640 1 -- 172.21.15.66:0/3571452359 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e54055bc0 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.644+0000 7f3e4effd640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3e40074cb0 0x7f3e40077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.644+0000 7f3e4effd640 1 -- 172.21.15.66:0/3571452359 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f3e540dbf00 con 0x5611f5816270 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.644+0000 7f3e5d898640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3e40074cb0 0x7f3e40077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5611f57fb9e0 0x5611f5896e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5611f5897340 con 0x5611f57fb9e0 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e5e099640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5611f57fb9e0 0x5611f5896e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e5d898640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3e40074cb0 0x7f3e40077170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e50005fd0 tx=0x7f3e50005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e5e099640 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5611f57fb9e0 0x5611f5896e00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e5e099640 1 -- 172.21.15.66:0/3571452359 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f3e58003040 con 0x5611f57fb9e0 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5611f57fb9e0 msgr2=0x5611f5896e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5611f57fb9e0 0x5611f5896e00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3e40074cb0 msgr2=0x7f3e40077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3e40074cb0 0x7f3e40077170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e50005fd0 tx=0x7f3e50005a00 comp rx=0 tx=0).stop 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 msgr2=0x5611f5939930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 --2- 172.21.15.66:0/3571452359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611f5816270 0x5611f5939930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e54046650 tx=0x7f3e54002fb0 comp rx=0 tx=0).stop 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e5e099640 1 -- 172.21.15.66:0/3571452359 reap_dead start 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 shutdown_connections 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 >> 172.21.15.66:0/3571452359 conn(0x5611f57f6800 msgr2=0x5611f58a45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 shutdown_connections 2024-05-10T11:14:42.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:42.645+0000 7f3e60a0ff40 1 -- 172.21.15.66:0/3571452359 wait complete. 2024-05-10T11:14:42.650 INFO:teuthology.orchestra.run.smithi066.stdout:Yalphaparent_a 2024-05-10T11:14:42.651 DEBUG:teuthology.orchestra.run.smithi066:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T11:14:42.698 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627777, 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "ancestors": [ 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "dirino": 1099511627776, 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "alpha", 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 2 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "dirino": 1, 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "parent_a", 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 4 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-05-10T11:14:42.699 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 8, 2024-05-10T11:14:42.700 INFO:teuthology.orchestra.run.smithi066.stdout: "old_pools": [] 2024-05-10T11:14:42.700 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:42.700 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:42.701 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:14:42.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:14:42.779 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:14:42.822 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:14:42.823 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:14:42.823 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:14:42.823 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:42.839 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:14:42.839 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:42.895 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:14:43.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.039+0000 7f1db2e69640 1 Processor -- start 2024-05-10T11:14:43.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.040+0000 7f1db2e69640 1 -- start start 2024-05-10T11:14:43.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.040+0000 7f1db2e69640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1dac0d1fb0 0x7f1dac0b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.040+0000 7f1db2e69640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dac0d41f0 con 0x7f1dac0b5520 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.040+0000 7f1db2e69640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dac0d5eb0 con 0x7f1dac0b5900 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.040+0000 7f1db2e69640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac0d5c60 con 0x7f1dac0d1fb0 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.040+0000 7f1db0c05640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1dac0b5520 0x7f1dac0d18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54622/0 (socket says 172.21.15.66:54622) 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1db0c05640 1 -- 172.21.15.66:0/3702913385 learned_addr learned my addr 172.21.15.66:0/3702913385 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dabfff640 1 --2- 172.21.15.66:0/3702913385 >> v2:172.21.15.190:3300/0 conn(0x7f1dac0d1fb0 0x7f1dac0b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547415638 0 0) 0x7f1dac0d41f0 con 0x7f1dac0b5520 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d94003520 con 0x7f1dac0b5520 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948174899 0 0) 0x7f1d94003520 con 0x7f1dac0b5520 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 >> v2:172.21.15.190:3300/0 conn(0x7f1dac0d1fb0 msgr2=0x7f1dac0b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 --2- 172.21.15.66:0/3702913385 >> v2:172.21.15.190:3300/0 conn(0x7f1dac0d1fb0 0x7f1dac0b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 >> v1:172.21.15.190:6789/0 conn(0x7f1dac0b5900 legacy=0x7f1dac0b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac0d0a30 con 0x7f1dac0b5520 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f1da40019f0 con 0x7f1dac0b5520 2024-05-10T11:14:43.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 >> v1:172.21.15.66:6789/0 conn(0x7f1dac0b5520 legacy=0x7f1dac0d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d940039b0 0x7f1d94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1d94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d940051c0 0x7f1d9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0d5c60 con 0x7f1d94004800 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400c060 con 0x7f1d940039b0 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d9400c260 con 0x7f1d940051c0 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1dabfff640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1d94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1db0c05640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d940039b0 0x7f1d94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.041+0000 7f1db1406640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d940051c0 0x7f1d9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dabfff640 1 -- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d940051c0 msgr2=0x7f1d9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dabfff640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d940051c0 0x7f1d9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dabfff640 1 -- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d940039b0 msgr2=0x7f1d94003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dabfff640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d940039b0 0x7f1d94003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dabfff640 1 -- 172.21.15.66:0/3702913385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d94003520 con 0x7f1d94004800 2024-05-10T11:14:43.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1db1406640 1 -- 172.21.15.66:0/3702913385 reap_dead start 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dabfff640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1d94004c80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009ac0 tx=0x7f1d94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788b27b60d8d6080 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0036070 con 0x7f1d94004800 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da0031400 con 0x7f1d94004800 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.042+0000 7f1dab7fe640 1 -- 172.21.15.66:0/3702913385 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0009690 con 0x7f1d94004800 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 -- 172.21.15.66:0/3702913385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 msgr2=0x7f1d94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1d94004c80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009ac0 tx=0x7f1d94005830 comp rx=0 tx=0).stop 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 -- 172.21.15.66:0/3702913385 shutdown_connections 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 --2- 172.21.15.66:0/3702913385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1d94004c80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 -- 172.21.15.66:0/3702913385 >> 172.21.15.66:0/3702913385 conn(0x7f1dac0d5170 msgr2=0x7f1dac0d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 -- 172.21.15.66:0/3702913385 shutdown_connections 2024-05-10T11:14:43.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.043+0000 7f1db2e69640 1 -- 172.21.15.66:0/3702913385 wait complete. 2024-05-10T11:14:43.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.044+0000 7f1db2e69640 1 Processor -- start 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.044+0000 7f1db2e69640 1 -- start start 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db2e69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1dac155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db2e69640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dac0cb740 0x7f1dac0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db2e69640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac0ce820 0x7f1dac0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db2e69640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0b6460 con 0x7f1d94004800 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db2e69640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0b62e0 con 0x7f1dac0ce820 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db2e69640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac0b65e0 con 0x7f1dac0cb740 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db0c05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1dac155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db0c05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1dac155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53916/0 (socket says 172.21.15.66:53916) 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1db0c05640 1 -- 172.21.15.66:0/1668966086 learned_addr learned my addr 172.21.15.66:0/1668966086 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.045+0000 7f1dabfff640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dac0cb740 0x7f1dac0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db1406640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac0ce820 0x7f1dac0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db0c05640 1 -- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dac0cb740 msgr2=0x7f1dac0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db0c05640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dac0cb740 0x7f1dac0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db0c05640 1 -- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac0ce820 msgr2=0x7f1dac0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db0c05640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac0ce820 0x7f1dac0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db0c05640 1 -- 172.21.15.66:0/1668966086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac1618c0 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1dabfff640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dac0cb740 0x7f1dac0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db0c05640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1dac155a00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1da4007970 tx=0x7f1da400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4017020 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da40133f0 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac161b60 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40137c0 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.046+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac162120 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.047+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac0693f0 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.048+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1da401a020 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.048+0000 7f1da97fa640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d98076300 0x7f1d980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.048+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f1da40982d0 con 0x7f1d94004800 2024-05-10T11:14:43.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.048+0000 7f1dabfff640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d98076300 0x7f1d980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.049+0000 7f1dabfff640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d98076300 0x7f1d980787c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1da0033000 tx=0x7f1da0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.052+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1da4021020 con 0x7f1d94004800 2024-05-10T11:14:43.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.258+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1dac0cbdb0 con 0x7f1d94004800 2024-05-10T11:14:43.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.258+0000 7f1da97fa640 1 -- 172.21.15.66:0/1668966086 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f1da4061a70 con 0x7f1d94004800 2024-05-10T11:14:43.258 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:14:43.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d98076300 msgr2=0x7f1d980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d98076300 0x7f1d980787c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1da0033000 tx=0x7f1da0008030 comp rx=0 tx=0).stop 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 msgr2=0x7f1dac155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1dac155a00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1da4007970 tx=0x7f1da400a730 comp rx=0 tx=0).stop 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 shutdown_connections 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1d98076300 0x7f1d980787c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac0ce820 0x7f1dac0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dac0cb740 0x7f1dac0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 --2- 172.21.15.66:0/1668966086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d94004800 0x7f1dac155a00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 >> 172.21.15.66:0/1668966086 conn(0x7f1dac0d5170 msgr2=0x7f1dac0b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 shutdown_connections 2024-05-10T11:14:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.260+0000 7f1db2e69640 1 -- 172.21.15.66:0/1668966086 wait complete. 2024-05-10T11:14:43.271 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:14:43.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:43.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:14:43.315 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:14:43.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:14:43.316 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:14:43.351 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:14:43.351 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:14:43.351 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:43.368 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:14:43.368 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:14:43.368 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:14:43.369 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:43.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:14:43.408 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:14:43.408 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:14:43.408 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:43.425 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:14:43.425 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:43.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.551+0000 7fbda54dc640 1 Processor -- start 2024-05-10T11:14:43.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.551+0000 7fbda54dc640 1 -- start start 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbda54dc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbda015f390 0x7fbda00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbda54dc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda00b4c00 0x7fbda00b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbda54dc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda00cfd10 con 0x7fbda00d5190 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbda54dc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbda00cff90 con 0x7fbda015f390 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbda54dc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbda0163d00 con 0x7fbda00b4c00 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9effd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbda015f390 0x7fbda00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9e7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbda00d5190 0x7fbda00d55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54626/0 (socket says 172.21.15.66:54626) 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9e7fc640 1 -- 172.21.15.66:0/1594173 learned_addr learned my addr 172.21.15.66:0/1594173 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9effd640 1 -- 172.21.15.66:0/1594173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda00b4c00 msgr2=0x7fbda00b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9effd640 1 --2- 172.21.15.66:0/1594173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda00b4c00 0x7fbda00b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9effd640 1 -- 172.21.15.66:0/1594173 >> v1:172.21.15.66:6789/0 conn(0x7fbda00d5190 legacy=0x7fbda00d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9effd640 1 -- 172.21.15.66:0/1594173 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda00d0250 con 0x7fbda015f390 2024-05-10T11:14:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.552+0000 7fbd9dffb640 1 -- 172.21.15.66:0/1594173 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688460762 0 0) 0x7fbd94001110 con 0x7fbda00d5190 2024-05-10T11:14:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.553+0000 7fbd9effd640 1 --2- 172.21.15.66:0/1594173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda015f390 0x7fbda00d0a50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbd900097a0 tx=0x7fbd9002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a93b03fa1e3ca8b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.553+0000 7fbd9dffb640 1 -- 172.21.15.66:0/1594173 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90037070 con 0x7fbda015f390 2024-05-10T11:14:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.553+0000 7fbd9dffb640 1 -- 172.21.15.66:0/1594173 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd90032440 con 0x7fbda015f390 2024-05-10T11:14:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.553+0000 7fbd9dffb640 1 -- 172.21.15.66:0/1594173 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90032810 con 0x7fbda015f390 2024-05-10T11:14:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 -- 172.21.15.66:0/1594173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda015f390 msgr2=0x7fbda00d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 --2- 172.21.15.66:0/1594173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda015f390 0x7fbda00d0a50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbd900097a0 tx=0x7fbd9002a180 comp rx=0 tx=0).stop 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 -- 172.21.15.66:0/1594173 shutdown_connections 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 --2- 172.21.15.66:0/1594173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda00b4c00 0x7fbda00b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 --2- 172.21.15.66:0/1594173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda015f390 0x7fbda00d0a50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 -- 172.21.15.66:0/1594173 >> 172.21.15.66:0/1594173 conn(0x7fbda008ecb0 msgr2=0x7fbda009e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 -- 172.21.15.66:0/1594173 shutdown_connections 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.554+0000 7fbda54dc640 1 -- 172.21.15.66:0/1594173 wait complete. 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.555+0000 7fbda54dc640 1 Processor -- start 2024-05-10T11:14:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.555+0000 7fbda54dc640 1 -- start start 2024-05-10T11:14:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbda54dc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda00b4c00 0x7fbda015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbda54dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 0x7fbda0160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbda54dc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda015f390 0x7fbda00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbda54dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbda00d0f90 con 0x7fbda00d5190 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbda54dc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbda00b55b0 con 0x7fbda00b4c00 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbda54dc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbda00d1110 con 0x7fbda015f390 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 0x7fbda0160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 0x7fbda0160180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53938/0 (socket says 172.21.15.66:53938) 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 -- 172.21.15.66:0/197759590 learned_addr learned my addr 172.21.15.66:0/197759590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9f7fe640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda015f390 0x7fbda00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9effd640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda00b4c00 0x7fbda015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 -- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda015f390 msgr2=0x7fbda00b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda015f390 0x7fbda00b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 -- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda00b4c00 msgr2=0x7fbda015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda00b4c00 0x7fbda015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 -- 172.21.15.66:0/197759590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda0160ad0 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd9e7fc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 0x7fbda0160180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c7b0 tx=0x7fbd9400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94018070 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.556+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd940072d0 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.557+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda0160db0 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.557+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd940047e0 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.557+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda0161370 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.558+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda00757b0 con 0x7fbda00d5190 2024-05-10T11:14:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.558+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd9401b070 con 0x7fbda00d5190 2024-05-10T11:14:43.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.559+0000 7fbd877fe640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd8c0762d0 0x7fbd8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.559+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fbd94096a90 con 0x7fbda00d5190 2024-05-10T11:14:43.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.559+0000 7fbd9effd640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd8c0762d0 0x7fbd8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.560+0000 7fbd9effd640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd8c0762d0 0x7fbd8c078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd9002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.563+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbda00757b0 con 0x7fbda00d5190 2024-05-10T11:14:43.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.792+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbda0068c40 con 0x7fbda00d5190 2024-05-10T11:14:43.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.793+0000 7fbd877fe640 1 -- 172.21.15.66:0/197759590 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7fbda0068c40 con 0x7fbda00d5190 2024-05-10T11:14:43.794 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:43.794 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:43.794 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd8c0762d0 msgr2=0x7fbd8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd8c0762d0 0x7fbd8c078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd9002e000 comp rx=0 tx=0).stop 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 msgr2=0x7fbda0160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 0x7fbda0160180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c7b0 tx=0x7fbd9400cc70 comp rx=0 tx=0).stop 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 shutdown_connections 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd8c0762d0 0x7fbd8c078790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda015f390 0x7fbda00b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda00d5190 0x7fbda0160180 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 --2- 172.21.15.66:0/197759590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda00b4c00 0x7fbda015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 >> 172.21.15.66:0/197759590 conn(0x7fbda008ecb0 msgr2=0x7fbda0162d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:43.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 shutdown_connections 2024-05-10T11:14:43.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.795+0000 7fbda54dc640 1 -- 172.21.15.66:0/197759590 wait complete. 2024-05-10T11:14:43.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 Processor -- start 2024-05-10T11:14:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 -- start start 2024-05-10T11:14:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3b0c15f790 0x7f3b0c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3b0c0d5d30 0x7f3b0c0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0c0d30b0 con 0x7f3b0c15f3b0 2024-05-10T11:14:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c0d3390 con 0x7f3b0c15f790 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.913+0000 7f3b11d90640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c0c8c80 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3b0c15f790 0x7f3b0c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0b7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3b0c15f3b0 0x7f3b0c0d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54638/0 (socket says 172.21.15.66:54638) 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3b0c15f790 0x7f3b0c0cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53940/0 (socket says 172.21.15.66:53940) 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0b7fe640 1 -- 172.21.15.66:0/3172564309 learned_addr learned my addr 172.21.15.66:0/3172564309 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0affd640 1 -- 172.21.15.66:0/3172564309 >> v2:172.21.15.190:3300/0 conn(0x7f3b0c0d5d30 msgr2=0x7f3b0c0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0bfff640 1 --2- 172.21.15.66:0/3172564309 >> v2:172.21.15.190:3300/0 conn(0x7f3b0c0d5d30 0x7f3b0c0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0a7fc640 1 -- 172.21.15.66:0/3172564309 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782664180 0 0) 0x7f3b0c0d30b0 con 0x7f3b0c15f3b0 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0affd640 1 --2- 172.21.15.66:0/3172564309 >> v2:172.21.15.190:3300/0 conn(0x7f3b0c0d5d30 0x7f3b0c0d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0affd640 1 -- 172.21.15.66:0/3172564309 >> v1:172.21.15.66:6789/0 conn(0x7f3b0c15f3b0 legacy=0x7f3b0c0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0affd640 1 -- 172.21.15.66:0/3172564309 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c0c8f60 con 0x7f3b0c15f790 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.914+0000 7f3b0bfff640 1 --2- 172.21.15.66:0/3172564309 >> v2:172.21.15.190:3300/0 conn(0x7f3b0c0d5d30 0x7f3b0c0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b0affd640 1 --2- 172.21.15.66:0/3172564309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c15f790 0x7f3b0c0cfcd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c08d220 tx=0x7f3af402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ddefb099cff82b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b0a7fc640 1 -- 172.21.15.66:0/3172564309 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4037070 con 0x7f3b0c15f790 2024-05-10T11:14:43.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b0a7fc640 1 -- 172.21.15.66:0/3172564309 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4032440 con 0x7f3b0c15f790 2024-05-10T11:14:43.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b0a7fc640 1 -- 172.21.15.66:0/3172564309 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4032810 con 0x7f3b0c15f790 2024-05-10T11:14:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 -- 172.21.15.66:0/3172564309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c15f790 msgr2=0x7f3b0c0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 --2- 172.21.15.66:0/3172564309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c15f790 0x7f3b0c0cfcd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c08d220 tx=0x7f3af402a1a0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 -- 172.21.15.66:0/3172564309 shutdown_connections 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 --2- 172.21.15.66:0/3172564309 >> v2:172.21.15.190:3300/0 conn(0x7f3b0c0d5d30 0x7f3b0c0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 --2- 172.21.15.66:0/3172564309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c15f790 0x7f3b0c0cfcd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 -- 172.21.15.66:0/3172564309 >> 172.21.15.66:0/3172564309 conn(0x7f3b0c0d5130 msgr2=0x7f3b0c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.915+0000 7f3b11d90640 1 -- 172.21.15.66:0/3172564309 shutdown_connections 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.916+0000 7f3b11d90640 1 -- 172.21.15.66:0/3172564309 wait complete. 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.917+0000 7f3b11d90640 1 Processor -- start 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.917+0000 7f3b11d90640 1 -- start start 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 0x7f3b0c14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0c15f3b0 0x7f3b0c15a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0d3f80 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0d3e00 con 0x7f3b0c14ea30 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c0ca770 con 0x7f3b0c15f3b0 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 0x7f3b0c14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 0x7f3b0c14cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53952/0 (socket says 172.21.15.66:53952) 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 -- 172.21.15.66:0/1479631124 learned_addr learned my addr 172.21.15.66:0/1479631124 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 -- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0c15f3b0 msgr2=0x7f3b0c15a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0c15f3b0 0x7f3b0c15a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 -- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c14ea30 msgr2=0x7f3b0c14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 -- 172.21.15.66:0/1479631124 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c14d610 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b0b7fe640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 0x7f3b0c14cde0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c4d0 tx=0x7f3afc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc018070 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc0074e0 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c14d8f0 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc004a20 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.918+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c14deb0 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.919+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c06a220 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.920+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3afc01b070 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.920+0000 7f3b03fff640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3aec0762d0 0x7f3aec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:43.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.921+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f3afc096a90 con 0x7f3b0c0d5d30 2024-05-10T11:14:43.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.921+0000 7f3b0affd640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3aec0762d0 0x7f3aec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:43.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.921+0000 7f3b0affd640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3aec0762d0 0x7f3aec078790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3af4034000 tx=0x7f3af402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:43.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:43.925+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3afc0602c0 con 0x7f3b0c0d5d30 2024-05-10T11:14:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.155+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b0c14d320 con 0x7f3b0c0d5d30 2024-05-10T11:14:44.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.156+0000 7f3b03fff640 1 -- 172.21.15.66:0/1479631124 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7f3afc05fbc0 con 0x7f3b0c0d5d30 2024-05-10T11:14:44.156 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:44.156 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:44.157 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3aec0762d0 msgr2=0x7f3aec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3aec0762d0 0x7f3aec078790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3af4034000 tx=0x7f3af402c000 comp rx=0 tx=0).stop 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 msgr2=0x7f3b0c14cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 0x7f3b0c14cde0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c4d0 tx=0x7f3afc00c990 comp rx=0 tx=0).stop 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 shutdown_connections 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3aec0762d0 0x7f3aec078790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b0c15f3b0 0x7f3b0c15a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 --2- 172.21.15.66:0/1479631124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b0c0d5d30 0x7f3b0c14cde0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 >> 172.21.15.66:0/1479631124 conn(0x7f3b0c0d5130 msgr2=0x7f3b0c0d36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 shutdown_connections 2024-05-10T11:14:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.158+0000 7f3b11d90640 1 -- 172.21.15.66:0/1479631124 wait complete. 2024-05-10T11:14:44.170 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:14:44.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 Processor -- start 2024-05-10T11:14:44.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 -- start start 2024-05-10T11:14:44.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f360415f3b0 0x7f36040d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f360415f790 0x7f36040d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36040d30b0 con 0x7f36040d5d30 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f36040d3390 con 0x7f360415f790 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.274+0000 7f360a047640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f36040c8c80 con 0x7f360415f3b0 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f360415f790 0x7f36040d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f360415f790 0x7f36040d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53964/0 (socket says 172.21.15.66:53964) 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 -- 172.21.15.66:0/483340236 learned_addr learned my addr 172.21.15.66:0/483340236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 -- 172.21.15.66:0/483340236 >> v2:172.21.15.190:3300/0 conn(0x7f360415f3b0 msgr2=0x7f36040d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f36037fe640 1 --2- 172.21.15.66:0/483340236 >> v2:172.21.15.190:3300/0 conn(0x7f360415f3b0 0x7f36040d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 --2- 172.21.15.66:0/483340236 >> v2:172.21.15.190:3300/0 conn(0x7f360415f3b0 0x7f36040d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 -- 172.21.15.66:0/483340236 >> v1:172.21.15.190:6789/0 conn(0x7f36040d5d30 legacy=0x7f36040c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:44.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.275+0000 7f3602ffd640 1 -- 172.21.15.66:0/483340236 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36040c8f60 con 0x7f360415f790 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.276+0000 7f3602ffd640 1 --2- 172.21.15.66:0/483340236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f790 0x7f36040d3c30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f360408e820 tx=0x7f35f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7420829db43e5b09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.276+0000 7f36027fc640 1 -- 172.21.15.66:0/483340236 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4037070 con 0x7f360415f790 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.276+0000 7f36027fc640 1 -- 172.21.15.66:0/483340236 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f4032440 con 0x7f360415f790 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.276+0000 7f36027fc640 1 -- 172.21.15.66:0/483340236 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4032810 con 0x7f360415f790 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.276+0000 7f360a047640 1 -- 172.21.15.66:0/483340236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f790 msgr2=0x7f36040d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.276+0000 7f360a047640 1 --2- 172.21.15.66:0/483340236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f790 0x7f36040d3c30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f360408e820 tx=0x7f35f402a230 comp rx=0 tx=0).stop 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.277+0000 7f360a047640 1 -- 172.21.15.66:0/483340236 shutdown_connections 2024-05-10T11:14:44.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.277+0000 7f360a047640 1 --2- 172.21.15.66:0/483340236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f790 0x7f36040d3c30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.277+0000 7f360a047640 1 --2- 172.21.15.66:0/483340236 >> v2:172.21.15.190:3300/0 conn(0x7f360415f3b0 0x7f36040d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.277+0000 7f360a047640 1 -- 172.21.15.66:0/483340236 >> 172.21.15.66:0/483340236 conn(0x7f36040d5130 msgr2=0x7f36040d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.277+0000 7f360a047640 1 -- 172.21.15.66:0/483340236 shutdown_connections 2024-05-10T11:14:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.277+0000 7f360a047640 1 -- 172.21.15.66:0/483340236 wait complete. 2024-05-10T11:14:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.278+0000 7f360a047640 1 Processor -- start 2024-05-10T11:14:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.278+0000 7f360a047640 1 -- start start 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36040d5d30 0x7f36041547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 0x7f3604156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36041572c0 0x7f3604155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36040d0e60 con 0x7f360415f3b0 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f36040d0ce0 con 0x7f36041572c0 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36040d0fe0 con 0x7f36040d5d30 2024-05-10T11:14:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 0x7f3604156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 0x7f3604156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53980/0 (socket says 172.21.15.66:53980) 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 -- 172.21.15.66:0/2665870641 learned_addr learned my addr 172.21.15.66:0/2665870641 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3603fff640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36041572c0 0x7f3604155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f36037fe640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36040d5d30 0x7f36041547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 -- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36040d5d30 msgr2=0x7f36041547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36040d5d30 0x7f36041547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 -- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36041572c0 msgr2=0x7f3604155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36041572c0 0x7f3604155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 -- 172.21.15.66:0/2665870641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3604155e10 con 0x7f360415f3b0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f3602ffd640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 0x7f3604156d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f35f402a270 tx=0x7f35f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4037040 con 0x7f360415f3b0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f4042070 con 0x7f360415f3b0 2024-05-10T11:14:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36041560f0 con 0x7f360415f3b0 2024-05-10T11:14:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.279+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4030bb0 con 0x7f360415f3b0 2024-05-10T11:14:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.280+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36040cc4e0 con 0x7f360415f3b0 2024-05-10T11:14:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.280+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36041576d0 con 0x7f360415f3b0 2024-05-10T11:14:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.281+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35f4047460 con 0x7f360415f3b0 2024-05-10T11:14:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.282+0000 7f35fbfff640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35e40762d0 0x7f35e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.282+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f35f40b8420 con 0x7f360415f3b0 2024-05-10T11:14:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.282+0000 7f36037fe640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35e40762d0 0x7f35e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.282+0000 7f36037fe640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35e40762d0 0x7f35e4078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00a970 tx=0x7f35ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.286+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f36041576d0 con 0x7f360415f3b0 2024-05-10T11:14:44.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.477+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f360406a220 con 0x7f360415f3b0 2024-05-10T11:14:44.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.478+0000 7f35fbfff640 1 -- 172.21.15.66:0/2665870641 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17038 (secure 0 0 0) 0x7f35f4081bc0 con 0x7f360415f3b0 2024-05-10T11:14:44.479 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:44.479 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":51,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:15.157971+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:56.135076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:57.422869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35e40762d0 msgr2=0x7f35e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35e40762d0 0x7f35e4078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00a970 tx=0x7f35ec008040 comp rx=0 tx=0).stop 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 msgr2=0x7f3604156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 0x7f3604156d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f35f402a270 tx=0x7f35f40046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 shutdown_connections 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f35e40762d0 0x7f35e4078790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36041572c0 0x7f3604155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f360415f3b0 0x7f3604156d80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 --2- 172.21.15.66:0/2665870641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36040d5d30 0x7f36041547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.480+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 >> 172.21.15.66:0/2665870641 conn(0x7f36040d5130 msgr2=0x7f36040d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:44.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.481+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 shutdown_connections 2024-05-10T11:14:44.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.481+0000 7f360a047640 1 -- 172.21.15.66:0/2665870641 wait complete. 2024-05-10T11:14:44.492 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:14:44.492 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:44.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.594+0000 7f27c3338640 1 Processor -- start 2024-05-10T11:14:44.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.595+0000 7f27c3338640 1 -- start start 2024-05-10T11:14:44.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.595+0000 7f27c3338640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf170 0x7f27bc15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.595+0000 7f27c3338640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27bc0cf5d0 0x7f27bc15f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.595+0000 7f27c3338640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc0c74c0 con 0x7f27bc15b6d0 2024-05-10T11:14:44.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.595+0000 7f27c3338640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f27bc0cc380 con 0x7f27bc0cf5d0 2024-05-10T11:14:44.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.595+0000 7f27c3338640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc0c5d10 con 0x7f27bc0cf170 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c18d5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27bc0cf5d0 0x7f27bc15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c08d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf170 0x7f27bc15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c10d4640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f27bc15b6d0 0x7f27bc0c6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:46994/0 (socket says 172.21.15.66:46994) 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c18d5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27bc0cf5d0 0x7f27bc15f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:47238/0 (socket says 172.21.15.66:47238) 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c10d4640 1 -- 172.21.15.66:0/3265146483 learned_addr learned my addr 172.21.15.66:0/3265146483 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c18d5640 1 -- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf170 msgr2=0x7f27bc15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c18d5640 1 --2- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf170 0x7f27bc15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c18d5640 1 -- 172.21.15.66:0/3265146483 >> v1:172.21.15.190:6789/0 conn(0x7f27bc15b6d0 legacy=0x7f27bc0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.596+0000 7f27c18d5640 1 -- 172.21.15.66:0/3265146483 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc0c5ff0 con 0x7f27bc0cf5d0 2024-05-10T11:14:44.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.597+0000 7f27c18d5640 1 --2- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc0cf5d0 0x7f27bc15f660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27b400ced0 tx=0x7f27b402c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c2930cbb7f3544 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.597+0000 7f27b3fff640 1 -- 172.21.15.66:0/3265146483 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b400a530 con 0x7f27bc0cf5d0 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.597+0000 7f27b3fff640 1 -- 172.21.15.66:0/3265146483 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b4037070 con 0x7f27bc0cf5d0 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.597+0000 7f27b3fff640 1 -- 172.21.15.66:0/3265146483 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b400a8f0 con 0x7f27bc0cf5d0 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 -- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc0cf5d0 msgr2=0x7f27bc15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 --2- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc0cf5d0 0x7f27bc15f660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27b400ced0 tx=0x7f27b402c940 comp rx=0 tx=0).stop 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 -- 172.21.15.66:0/3265146483 shutdown_connections 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 --2- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc0cf5d0 0x7f27bc15f660 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 --2- 172.21.15.66:0/3265146483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf170 0x7f27bc15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 -- 172.21.15.66:0/3265146483 >> 172.21.15.66:0/3265146483 conn(0x7f27bc0b2900 msgr2=0x7f27bc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 -- 172.21.15.66:0/3265146483 shutdown_connections 2024-05-10T11:14:44.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.598+0000 7f27c3338640 1 -- 172.21.15.66:0/3265146483 wait complete. 2024-05-10T11:14:44.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.599+0000 7f27c3338640 1 Processor -- start 2024-05-10T11:14:44.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.599+0000 7f27c3338640 1 -- start start 2024-05-10T11:14:44.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c3338640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 0x7f27bc1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c3338640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf5d0 0x7f27bc155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c3338640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc15b6d0 0x7f27bc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c3338640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc0c6890 con 0x7f27bc0cf170 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c3338640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc0c65b0 con 0x7f27bc15b6d0 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c3338640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc0cd170 con 0x7f27bc0cf5d0 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 0x7f27bc1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 0x7f27bc1548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53996/0 (socket says 172.21.15.66:53996) 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 -- 172.21.15.66:0/454213045 learned_addr learned my addr 172.21.15.66:0/454213045 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c08d3640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf5d0 0x7f27bc155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c18d5640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc15b6d0 0x7f27bc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 -- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf5d0 msgr2=0x7f27bc155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf5d0 0x7f27bc155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 -- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc15b6d0 msgr2=0x7f27bc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc15b6d0 0x7f27bc072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 -- 172.21.15.66:0/454213045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc0c96c0 con 0x7f27bc0cf170 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.600+0000 7f27c10d4640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 0x7f27bc1548e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c3c0 tx=0x7f27b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.601+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8017070 con 0x7f27bc0cf170 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.601+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b8005ce0 con 0x7f27bc0cf170 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.601+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc06f700 con 0x7f27bc0cf170 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.601+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80072f0 con 0x7f27bc0cf170 2024-05-10T11:14:44.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.601+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc157130 con 0x7f27bc0cf170 2024-05-10T11:14:44.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.602+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27bc06a220 con 0x7f27bc0cf170 2024-05-10T11:14:44.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.603+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f27b801a070 con 0x7f27bc0cf170 2024-05-10T11:14:44.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.603+0000 7f27b1ffb640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f27a0076300 0x7f27a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.603+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f27b8096a80 con 0x7f27bc0cf170 2024-05-10T11:14:44.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.604+0000 7f27c08d3640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f27a0076300 0x7f27a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.604+0000 7f27c08d3640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f27a0076300 0x7f27a00787c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ce580 tx=0x7f27ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.608+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f27b80602b0 con 0x7f27bc0cf170 2024-05-10T11:14:44.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.838+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27bc0b0110 con 0x7f27bc0cf170 2024-05-10T11:14:44.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.838+0000 7f27b1ffb640 1 -- 172.21.15.66:0/454213045 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7f27b805fbb0 con 0x7f27bc0cf170 2024-05-10T11:14:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:44.839 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:44.839 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:44.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f27a0076300 msgr2=0x7f27a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f27a0076300 0x7f27a00787c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ce580 tx=0x7f27ac008040 comp rx=0 tx=0).stop 2024-05-10T11:14:44.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 msgr2=0x7f27bc1548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 0x7f27bc1548e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c3c0 tx=0x7f27b800c880 comp rx=0 tx=0).stop 2024-05-10T11:14:44.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 shutdown_connections 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f27a0076300 0x7f27a00787c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27bc15b6d0 0x7f27bc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27bc0cf5d0 0x7f27bc155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 --2- 172.21.15.66:0/454213045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27bc0cf170 0x7f27bc1548e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 >> 172.21.15.66:0/454213045 conn(0x7f27bc0b2900 msgr2=0x7f27bc15a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 shutdown_connections 2024-05-10T11:14:44.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.841+0000 7f27c3338640 1 -- 172.21.15.66:0/454213045 wait complete. 2024-05-10T11:14:44.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:44.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.955+0000 7f7dc821c640 1 Processor -- start 2024-05-10T11:14:44.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.955+0000 7f7dc821c640 1 -- start start 2024-05-10T11:14:44.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc821c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc00cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc821c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc00c6a30 con 0x7f7dc01611e0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc821c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc00cd090 con 0x7f7dc00c65f0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc821c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc00cd370 con 0x7f7dc015ce60 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc67b9640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7dc01611e0 0x7f7dc015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49678/0 (socket says 172.21.15.66:49678) 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc67b9640 1 -- 172.21.15.66:0/3251191373 learned_addr learned my addr 172.21.15.66:0/3251191373 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.956+0000 7f7dc5fb8640 1 --2- 172.21.15.66:0/3251191373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc00cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392650805 0 0) 0x7f7dc00c6a30 con 0x7f7dc01611e0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dac003520 con 0x7f7dc01611e0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423142585 0 0) 0x7f7dc00cd090 con 0x7f7dc00c65f0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc00c6a30 con 0x7f7dc00c65f0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1181348648 0 0) 0x7f7dac003520 con 0x7f7dc01611e0 2024-05-10T11:14:44.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc5fb8640 1 -- 172.21.15.66:0/3251191373 >> v1:172.21.15.190:6789/0 conn(0x7f7dc00c65f0 legacy=0x7f7dc0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc5fb8640 1 -- 172.21.15.66:0/3251191373 >> v1:172.21.15.66:6789/0 conn(0x7f7dc01611e0 legacy=0x7f7dc015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.957+0000 7f7dc5fb8640 1 -- 172.21.15.66:0/3251191373 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00cd650 con 0x7f7dc015ce60 2024-05-10T11:14:44.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc5fb8640 1 --2- 172.21.15.66:0/3251191373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc00cb300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097d0 tx=0x7f7dbc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911eb18aa7bb91ef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc037070 con 0x7f7dc015ce60 2024-05-10T11:14:44.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dbc02ab90 con 0x7f7dc015ce60 2024-05-10T11:14:44.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc4fb6640 1 -- 172.21.15.66:0/3251191373 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db80019f0 con 0x7f7dc015ce60 2024-05-10T11:14:44.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc821c640 1 -- 172.21.15.66:0/3251191373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 msgr2=0x7f7dc00cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc821c640 1 --2- 172.21.15.66:0/3251191373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc00cb300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097d0 tx=0x7f7dbc02a100 comp rx=0 tx=0).stop 2024-05-10T11:14:44.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc821c640 1 -- 172.21.15.66:0/3251191373 shutdown_connections 2024-05-10T11:14:44.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc821c640 1 --2- 172.21.15.66:0/3251191373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc00cb300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc821c640 1 -- 172.21.15.66:0/3251191373 >> 172.21.15.66:0/3251191373 conn(0x7f7dc00b2900 msgr2=0x7f7dc00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:44.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.958+0000 7f7dc821c640 1 -- 172.21.15.66:0/3251191373 shutdown_connections 2024-05-10T11:14:44.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.959+0000 7f7dc821c640 1 -- 172.21.15.66:0/3251191373 wait complete. 2024-05-10T11:14:44.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 Processor -- start 2024-05-10T11:14:44.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 -- start start 2024-05-10T11:14:44.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc00c65f0 0x7f7dc00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc009e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 0x7f7dc00b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc00cde50 con 0x7f7dc01611e0 2024-05-10T11:14:44.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc00ccd60 con 0x7f7dc00c65f0 2024-05-10T11:14:44.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.960+0000 7f7dc821c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc00cdfd0 con 0x7f7dc015ce60 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 0x7f7dc00b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 0x7f7dc00b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50654/0 (socket says 172.21.15.66:50654) 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 -- 172.21.15.66:0/1340330872 learned_addr learned my addr 172.21.15.66:0/1340330872 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc57b7640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc5fb8640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc00c65f0 0x7f7dc00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 -- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 msgr2=0x7f7dc009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 -- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc00c65f0 msgr2=0x7f7dc00b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc00c65f0 0x7f7dc00b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 -- 172.21.15.66:0/1340330872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00c9b50 con 0x7f7dc01611e0 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc5fb8640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc00c65f0 0x7f7dc00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc67b9640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 0x7f7dc00b5e60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7db8001f60 tx=0x7f7db800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8017070 con 0x7f7dc01611e0 2024-05-10T11:14:44.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db8012400 con 0x7f7dc01611e0 2024-05-10T11:14:44.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc00c9e30 con 0x7f7dc01611e0 2024-05-10T11:14:44.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db80127f0 con 0x7f7dc01611e0 2024-05-10T11:14:44.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.961+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc00ca3f0 con 0x7f7dc01611e0 2024-05-10T11:14:44.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.962+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc006a220 con 0x7f7dc01611e0 2024-05-10T11:14:44.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.963+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7db801a070 con 0x7f7dc01611e0 2024-05-10T11:14:44.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.963+0000 7f7db67fc640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7da40762d0 0x7f7da4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:44.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.963+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f7db8097650 con 0x7f7dc01611e0 2024-05-10T11:14:44.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.964+0000 7f7dc5fb8640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7da40762d0 0x7f7da4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:44.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.964+0000 7f7dc5fb8640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7da40762d0 0x7f7da4078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc034000 tx=0x7f7dbc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:44.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:44.968+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7db80607a0 con 0x7f7dc01611e0 2024-05-10T11:14:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.195+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dc015de10 con 0x7f7dc01611e0 2024-05-10T11:14:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.196+0000 7f7db67fc640 1 -- 172.21.15.66:0/1340330872 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5178 (secure 0 0 0) 0x7f7db8064aa0 con 0x7f7dc01611e0 2024-05-10T11:14:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:45.196 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:13:58.473598+0000","modified":"2024-05-10T11:14:01.486573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/433642873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":433642873},{"type":"v1","addr":"172.21.15.66:6835","nonce":433642873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":3}]} 2024-05-10T11:14:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-05-10T11:14:45.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7da40762d0 msgr2=0x7f7da4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7da40762d0 0x7f7da4078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc034000 tx=0x7f7dbc02e000 comp rx=0 tx=0).stop 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 msgr2=0x7f7dc00b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 0x7f7dc00b5e60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7db8001f60 tx=0x7f7db800cf90 comp rx=0 tx=0).stop 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 shutdown_connections 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7da40762d0 0x7f7da4078790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc01611e0 0x7f7dc00b5e60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc015ce60 0x7f7dc009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 --2- 172.21.15.66:0/1340330872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc00c65f0 0x7f7dc00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 >> 172.21.15.66:0/1340330872 conn(0x7f7dc00b2900 msgr2=0x7f7dc015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 shutdown_connections 2024-05-10T11:14:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.198+0000 7f7dc821c640 1 -- 172.21.15.66:0/1340330872 wait complete. 2024-05-10T11:14:45.209 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:14:45.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.314+0000 7f261f2cc640 1 Processor -- start 2024-05-10T11:14:45.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261f2cc640 1 -- start start 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261f2cc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f261815f3b0 0x7f26180d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261f2cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180d5d30 0x7f26180d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261f2cc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26180d30b0 con 0x7f261815f790 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261f2cc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f26180d3390 con 0x7f261815f3b0 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261f2cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f26180c8c80 con 0x7f26180d5d30 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261d068640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f261815f3b0 0x7f26180d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261c867640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f261815f790 0x7f26180c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49692/0 (socket says 172.21.15.66:49692) 2024-05-10T11:14:45.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.315+0000 7f261c867640 1 -- 172.21.15.66:0/2585365130 learned_addr learned my addr 172.21.15.66:0/2585365130 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.316+0000 7f261d068640 1 -- 172.21.15.66:0/2585365130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180d5d30 msgr2=0x7f26180d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.316+0000 7f261d869640 1 --2- 172.21.15.66:0/2585365130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180d5d30 0x7f26180d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.316+0000 7f2617fff640 1 -- 172.21.15.66:0/2585365130 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487185622 0 0) 0x7f26180d30b0 con 0x7f261815f790 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.316+0000 7f261d068640 1 --2- 172.21.15.66:0/2585365130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180d5d30 0x7f26180d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.316+0000 7f261d068640 1 -- 172.21.15.66:0/2585365130 >> v1:172.21.15.66:6789/0 conn(0x7f261815f790 legacy=0x7f26180c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.316+0000 7f261d068640 1 -- 172.21.15.66:0/2585365130 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26180c8f60 con 0x7f261815f3b0 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261d068640 1 --2- 172.21.15.66:0/2585365130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f261815f3b0 0x7f26180d36f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f26100097a0 tx=0x7f261002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a58154e909aea7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f2617fff640 1 -- 172.21.15.66:0/2585365130 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610037070 con 0x7f261815f3b0 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f2617fff640 1 -- 172.21.15.66:0/2585365130 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610032440 con 0x7f261815f3b0 2024-05-10T11:14:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f2617fff640 1 -- 172.21.15.66:0/2585365130 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610032810 con 0x7f261815f3b0 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 -- 172.21.15.66:0/2585365130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f261815f3b0 msgr2=0x7f26180d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 --2- 172.21.15.66:0/2585365130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f261815f3b0 0x7f26180d36f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f26100097a0 tx=0x7f261002a180 comp rx=0 tx=0).stop 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 -- 172.21.15.66:0/2585365130 shutdown_connections 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 --2- 172.21.15.66:0/2585365130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180d5d30 0x7f26180d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 --2- 172.21.15.66:0/2585365130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f261815f3b0 0x7f26180d36f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 -- 172.21.15.66:0/2585365130 >> 172.21.15.66:0/2585365130 conn(0x7f26180d5130 msgr2=0x7f26180d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 -- 172.21.15.66:0/2585365130 shutdown_connections 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.317+0000 7f261f2cc640 1 -- 172.21.15.66:0/2585365130 wait complete. 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 Processor -- start 2024-05-10T11:14:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 -- start start 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 0x7f2618154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f261815f3b0 0x7f26180ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180cd0d0 0x7f26180ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26180d0e60 con 0x7f26180d5d30 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f26180d0ce0 con 0x7f261815f3b0 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261f2cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f26180d0fe0 con 0x7f26180cd0d0 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261d068640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 0x7f2618154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261d068640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 0x7f2618154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50674/0 (socket says 172.21.15.66:50674) 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.319+0000 7f261d068640 1 -- 172.21.15.66:0/1750736736 learned_addr learned my addr 172.21.15.66:0/1750736736 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261c867640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f261815f3b0 0x7f26180ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d869640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180cd0d0 0x7f26180ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d068640 1 -- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180cd0d0 msgr2=0x7f26180ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d068640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180cd0d0 0x7f26180ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d068640 1 -- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f261815f3b0 msgr2=0x7f26180ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d068640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f261815f3b0 0x7f26180ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d068640 1 -- 172.21.15.66:0/1750736736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181585b0 con 0x7f26180d5d30 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261c867640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f261815f3b0 0x7f26180ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261d068640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 0x7f2618154630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2610000c00 tx=0x7f26100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610037040 con 0x7f26180d5d30 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610042070 con 0x7f26180d5d30 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2618158890 con 0x7f26180d5d30 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610030a30 con 0x7f26180d5d30 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.320+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2618158e50 con 0x7f26180d5d30 2024-05-10T11:14:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.321+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261806a220 con 0x7f26180d5d30 2024-05-10T11:14:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.322+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2610030bd0 con 0x7f26180d5d30 2024-05-10T11:14:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.322+0000 7f2615ffb640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f26040762d0 0x7f2604078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.322+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f26100b81a0 con 0x7f26180d5d30 2024-05-10T11:14:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.323+0000 7f261c867640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f26040762d0 0x7f2604078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.323+0000 7f261c867640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f26040762d0 0x7f2604078790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f26180cabd0 tx=0x7f260c007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.327+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2610081940 con 0x7f26180d5d30 2024-05-10T11:14:45.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.519+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f261815daa0 con 0x7f26180d5d30 2024-05-10T11:14:45.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.520+0000 7f2615ffb640 1 -- 172.21.15.66:0/1750736736 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17038 (secure 0 0 0) 0x7f2610081240 con 0x7f26180d5d30 2024-05-10T11:14:45.521 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:45.521 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":51,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:15.157971+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:13:56.135076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T11:13:57.422869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f26040762d0 msgr2=0x7f2604078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f26040762d0 0x7f2604078790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f26180cabd0 tx=0x7f260c007ca0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 msgr2=0x7f2618154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 0x7f2618154630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2610000c00 tx=0x7f26100046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 shutdown_connections 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f26040762d0 0x7f2604078790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26180cd0d0 0x7f26180ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f261815f3b0 0x7f26180ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 --2- 172.21.15.66:0/1750736736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26180d5d30 0x7f2618154630 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 >> 172.21.15.66:0/1750736736 conn(0x7f26180d5130 msgr2=0x7f26180d36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 shutdown_connections 2024-05-10T11:14:45.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.522+0000 7f261f2cc640 1 -- 172.21.15.66:0/1750736736 wait complete. 2024-05-10T11:14:45.534 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:14:45.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.638+0000 7f16c2c08640 1 Processor -- start 2024-05-10T11:14:45.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.638+0000 7f16c2c08640 1 -- start start 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c2c08640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16bc06c990 0x7f16bc163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c2c08640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16bc15f620 0x7f16bc15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c2c08640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc163ba0 con 0x7f16bc0704c0 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c2c08640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc06cd70 con 0x7f16bc06c990 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c2c08640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc160190 con 0x7f16bc15f620 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16bc06c990 0x7f16bc163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16bc06c990 0x7f16bc163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50686/0 (socket says 172.21.15.66:50686) 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 -- 172.21.15.66:0/3389135198 learned_addr learned my addr 172.21.15.66:0/3389135198 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16b3fff640 1 --2- 172.21.15.66:0/3389135198 >> v2:172.21.15.190:3300/0 conn(0x7f16bc15f620 0x7f16bc15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 -- 172.21.15.66:0/3389135198 >> v2:172.21.15.190:3300/0 conn(0x7f16bc15f620 msgr2=0x7f16bc15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:45.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 --2- 172.21.15.66:0/3389135198 >> v2:172.21.15.190:3300/0 conn(0x7f16bc15f620 0x7f16bc15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 -- 172.21.15.66:0/3389135198 >> v1:172.21.15.190:6789/0 conn(0x7f16bc0704c0 legacy=0x7f16bc070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:45.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.639+0000 7f16c09a4640 1 -- 172.21.15.66:0/3389135198 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc160470 con 0x7f16bc06c990 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.640+0000 7f16c09a4640 1 --2- 172.21.15.66:0/3389135198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc06c990 0x7f16bc163660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f16bc06cf10 tx=0x7f16b802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe10f1ce1cdab84 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.640+0000 7f16b37fe640 1 -- 172.21.15.66:0/3389135198 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8036070 con 0x7f16bc06c990 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.640+0000 7f16b37fe640 1 -- 172.21.15.66:0/3389135198 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8031600 con 0x7f16bc06c990 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.640+0000 7f16b37fe640 1 -- 172.21.15.66:0/3389135198 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b80319d0 con 0x7f16bc06c990 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 -- 172.21.15.66:0/3389135198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc06c990 msgr2=0x7f16bc163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 --2- 172.21.15.66:0/3389135198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc06c990 0x7f16bc163660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f16bc06cf10 tx=0x7f16b802a6c0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 -- 172.21.15.66:0/3389135198 shutdown_connections 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 --2- 172.21.15.66:0/3389135198 >> v2:172.21.15.190:3300/0 conn(0x7f16bc15f620 0x7f16bc15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 --2- 172.21.15.66:0/3389135198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc06c990 0x7f16bc163660 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 -- 172.21.15.66:0/3389135198 >> 172.21.15.66:0/3389135198 conn(0x7f16bc0b3980 msgr2=0x7f16bc0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 -- 172.21.15.66:0/3389135198 shutdown_connections 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.641+0000 7f16c2c08640 1 -- 172.21.15.66:0/3389135198 wait complete. 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.642+0000 7f16c2c08640 1 Processor -- start 2024-05-10T11:14:45.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.642+0000 7f16c2c08640 1 -- start start 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c2c08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16bc06c990 0x7f16bc0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c2c08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 0x7f16bc1f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c2c08640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16bc15f620 0x7f16bc0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c2c08640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc073e70 con 0x7f16bc0704c0 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c2c08640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc163140 con 0x7f16bc15f620 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c2c08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc0cf920 con 0x7f16bc06c990 2024-05-10T11:14:45.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 0x7f16bc1f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 0x7f16bc1f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50702/0 (socket says 172.21.15.66:50702) 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 -- 172.21.15.66:0/2630445089 learned_addr learned my addr 172.21.15.66:0/2630445089 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c11a5640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16bc15f620 0x7f16bc0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16c09a4640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16bc06c990 0x7f16bc0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 -- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16bc06c990 msgr2=0x7f16bc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16bc06c990 0x7f16bc0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 -- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16bc15f620 msgr2=0x7f16bc0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16bc15f620 0x7f16bc0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 -- 172.21.15.66:0/2630445089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc1f52c0 con 0x7f16bc0704c0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.643+0000 7f16b3fff640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 0x7f16bc1f9210 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00d620 tx=0x7f16ac00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.644+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00b620 con 0x7f16bc0704c0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.644+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac019070 con 0x7f16bc0704c0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.644+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc0b4de0 con 0x7f16bc0704c0 2024-05-10T11:14:45.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.644+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00ba00 con 0x7f16bc0704c0 2024-05-10T11:14:45.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.644+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc15ecd0 con 0x7f16bc0704c0 2024-05-10T11:14:45.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.645+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16bc06a220 con 0x7f16bc0704c0 2024-05-10T11:14:45.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.645+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16ac00bba0 con 0x7f16bc0704c0 2024-05-10T11:14:45.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.646+0000 7f16b17fa640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16a8076300 0x7f16a80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:45.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.646+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f16ac0979a0 con 0x7f16bc0704c0 2024-05-10T11:14:45.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.646+0000 7f16c09a4640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16a8076300 0x7f16a80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:45.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.646+0000 7f16c09a4640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16a8076300 0x7f16a80787c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033000 tx=0x7f16b8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:45.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.650+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f16ac060b80 con 0x7f16bc0704c0 2024-05-10T11:14:45.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.880+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f16bc073540 con 0x7f16bc0704c0 2024-05-10T11:14:45.881 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:14:45.881+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:14:45.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.882+0000 7f16b17fa640 1 -- 172.21.15.66:0/2630445089 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f16ac064e80 con 0x7f16bc0704c0 2024-05-10T11:14:45.882 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:14:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16a8076300 msgr2=0x7f16a80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16a8076300 0x7f16a80787c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033000 tx=0x7f16b8009000 comp rx=0 tx=0).stop 2024-05-10T11:14:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 msgr2=0x7f16bc1f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 0x7f16bc1f9210 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00d620 tx=0x7f16ac00dae0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 shutdown_connections 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16a8076300 0x7f16a80787c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16bc15f620 0x7f16bc0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16bc0704c0 0x7f16bc1f9210 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 --2- 172.21.15.66:0/2630445089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16bc06c990 0x7f16bc0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.884+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 >> 172.21.15.66:0/2630445089 conn(0x7f16bc0b3980 msgr2=0x7f16bc0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.885+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 shutdown_connections 2024-05-10T11:14:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:45.885+0000 7f16c2c08640 1 -- 172.21.15.66:0/2630445089 wait complete. 2024-05-10T11:14:45.888 INFO:tasks.ceph.mds.c.smithi066.stderr: -5939> 2024-05-10T11:14:04.729+0000 7f7f07851640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:14:45.891 INFO:tasks.ceph.mds.c.smithi066.stderr: -3040> 2024-05-10T11:14:11.662+0000 7f7f03849640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5194=0-4194304@1} caps={5194=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5194 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55b32d93ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:14:45.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:14:45.920 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:14:46.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 Processor -- start 2024-05-10T11:14:46.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 -- start start 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe21415f410 0x7fe2140d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2140d0f10 0x7fe2140b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2140d2800 con 0x7fe2140b54d0 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe2140d2ae0 con 0x7fe21415f410 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.004+0000 7fe21a872640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2140d01d0 con 0x7fe2140d0f10 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe21415f410 0x7fe2140d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:46.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe21415f410 0x7fe2140d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50710/0 (socket says 172.21.15.66:50710) 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 -- 172.21.15.66:0/1141074214 learned_addr learned my addr 172.21.15.66:0/1141074214 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe20bfff640 1 --2- 172.21.15.66:0/1141074214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2140d0f10 0x7fe2140b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 -- 172.21.15.66:0/1141074214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2140d0f10 msgr2=0x7fe2140b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 --2- 172.21.15.66:0/1141074214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2140d0f10 0x7fe2140b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 -- 172.21.15.66:0/1141074214 >> v1:172.21.15.190:6789/0 conn(0x7fe2140b54d0 legacy=0x7fe2140d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.005+0000 7fe213fff640 1 -- 172.21.15.66:0/1141074214 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2140d04b0 con 0x7fe21415f410 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe213fff640 1 --2- 172.21.15.66:0/1141074214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe21415f410 0x7fe2140d09d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe20402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8660e7d6718baf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe2137fe640 1 -- 172.21.15.66:0/1141074214 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204037070 con 0x7fe21415f410 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe2137fe640 1 -- 172.21.15.66:0/1141074214 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe204032440 con 0x7fe21415f410 2024-05-10T11:14:46.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe2137fe640 1 -- 172.21.15.66:0/1141074214 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204032810 con 0x7fe21415f410 2024-05-10T11:14:46.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 -- 172.21.15.66:0/1141074214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe21415f410 msgr2=0x7fe2140d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:46.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 --2- 172.21.15.66:0/1141074214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe21415f410 0x7fe2140d09d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe20402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 -- 172.21.15.66:0/1141074214 shutdown_connections 2024-05-10T11:14:46.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 --2- 172.21.15.66:0/1141074214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2140d0f10 0x7fe2140b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 --2- 172.21.15.66:0/1141074214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe21415f410 0x7fe2140d09d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 -- 172.21.15.66:0/1141074214 >> 172.21.15.66:0/1141074214 conn(0x7fe21408ed30 msgr2=0x7fe21409e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:46.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.006+0000 7fe21a872640 1 -- 172.21.15.66:0/1141074214 shutdown_connections 2024-05-10T11:14:46.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.007+0000 7fe21a872640 1 -- 172.21.15.66:0/1141074214 wait complete. 2024-05-10T11:14:46.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.008+0000 7fe21a872640 1 Processor -- start 2024-05-10T11:14:46.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.008+0000 7fe21a872640 1 -- start start 2024-05-10T11:14:46.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.008+0000 7fe21a872640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 0x7fe214158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:46.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2140d0f10 0x7fe2140b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:46.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe21415f410 0x7fe21415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:46.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2140cffb0 con 0x7fe2140b54d0 2024-05-10T11:14:46.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2140cfe30 con 0x7fe2140d0f10 2024-05-10T11:14:46.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2140d3de0 con 0x7fe21415f410 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 0x7fe214158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 0x7fe214158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50716/0 (socket says 172.21.15.66:50716) 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 -- 172.21.15.66:0/1254736819 learned_addr learned my addr 172.21.15.66:0/1254736819 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe218e0f640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe21415f410 0x7fe21415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe20bfff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2140d0f10 0x7fe2140b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 -- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe21415f410 msgr2=0x7fe21415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe21415f410 0x7fe21415bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 -- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2140d0f10 msgr2=0x7fe2140b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2140d0f10 0x7fe2140b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 -- 172.21.15.66:0/1254736819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2140cd850 con 0x7fe2140b54d0 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe20bfff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2140d0f10 0x7fe2140b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe218e0f640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe21415f410 0x7fe21415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:46.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe213fff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 0x7fe214158170 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe20402a200 tx=0x7fe2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204041020 con 0x7fe2140b54d0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2040306c0 con 0x7fe2140b54d0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21415c530 con 0x7fe2140b54d0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204037040 con 0x7fe2140b54d0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.009+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2140cde00 con 0x7fe2140b54d0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.010+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21406ec90 con 0x7fe2140b54d0 2024-05-10T11:14:46.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.011+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe204044020 con 0x7fe2140b54d0 2024-05-10T11:14:46.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.012+0000 7fe2117fa640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1f4076300 0x7fe1f40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:46.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.012+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6245+0+0 (secure 0 0 0) 0x7fe2040b7fe0 con 0x7fe2140b54d0 2024-05-10T11:14:46.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.012+0000 7fe20bfff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1f4076300 0x7fe1f40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:46.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.012+0000 7fe20bfff640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1f4076300 0x7fe1f40787c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc006fd0 tx=0x7fe1fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:46.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.016+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe21406ec90 con 0x7fe2140b54d0 2024-05-10T11:14:46.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.248+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe21406a220 con 0x7fe2140b54d0 2024-05-10T11:14:46.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.883+0000 7fe2117fa640 1 -- 172.21.15.66:0/1254736819 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7fe20404b030 con 0x7fe2140b54d0 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1f4076300 msgr2=0x7fe1f40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1f4076300 0x7fe1f40787c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc006fd0 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 msgr2=0x7fe214158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 0x7fe214158170 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe20402a200 tx=0x7fe2040046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 shutdown_connections 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1f4076300 0x7fe1f40787c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe21415f410 0x7fe21415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2140d0f10 0x7fe2140b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 --2- 172.21.15.66:0/1254736819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2140b54d0 0x7fe214158170 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 >> 172.21.15.66:0/1254736819 conn(0x7fe21408ed30 msgr2=0x7fe21406e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 shutdown_connections 2024-05-10T11:14:46.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:46.886+0000 7fe21a872640 1 -- 172.21.15.66:0/1254736819 wait complete. 2024-05-10T11:14:46.899 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:14:47.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 Processor -- start 2024-05-10T11:14:47.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 -- start start 2024-05-10T11:14:47.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f618c15f370 0x7f618c0d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f618c071520 0x7f618c162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f618c0d2510 con 0x7f618c071520 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f618c070220 con 0x7f618c15f370 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.051+0000 7f6192946640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f618c070500 con 0x7f618c1639a0 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f618c071520 0x7f618c162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f618c071520 0x7f618c162e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50722/0 (socket says 172.21.15.66:50722) 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 -- 172.21.15.66:0/2261300712 learned_addr learned my addr 172.21.15.66:0/2261300712 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 -- 172.21.15.66:0/2261300712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 msgr2=0x7f618c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 --2- 172.21.15.66:0/2261300712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 -- 172.21.15.66:0/2261300712 >> v2:172.21.15.190:3300/0 conn(0x7f618c15f370 msgr2=0x7f618c0d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 --2- 172.21.15.66:0/2261300712 >> v2:172.21.15.190:3300/0 conn(0x7f618c15f370 0x7f618c0d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.052+0000 7f6190ee3640 1 -- 172.21.15.66:0/2261300712 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0707e0 con 0x7f618c071520 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6190ee3640 1 --2- 172.21.15.66:0/2261300712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c071520 0x7f618c162e00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f618c072db0 tx=0x7f618402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5538a9b42139880b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f618affd640 1 -- 172.21.15.66:0/2261300712 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184036070 con 0x7f618c071520 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f618affd640 1 -- 172.21.15.66:0/2261300712 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6184031600 con 0x7f618c071520 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f618affd640 1 -- 172.21.15.66:0/2261300712 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61840319d0 con 0x7f618c071520 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 -- 172.21.15.66:0/2261300712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c071520 msgr2=0x7f618c162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 --2- 172.21.15.66:0/2261300712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c071520 0x7f618c162e00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f618c072db0 tx=0x7f618402a730 comp rx=0 tx=0).stop 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 -- 172.21.15.66:0/2261300712 shutdown_connections 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 --2- 172.21.15.66:0/2261300712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c071520 0x7f618c162e00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 --2- 172.21.15.66:0/2261300712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 --2- 172.21.15.66:0/2261300712 >> v2:172.21.15.190:3300/0 conn(0x7f618c15f370 0x7f618c0d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.053+0000 7f6192946640 1 -- 172.21.15.66:0/2261300712 >> 172.21.15.66:0/2261300712 conn(0x7f618c0d2e10 msgr2=0x7f618c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:47.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.054+0000 7f6192946640 1 -- 172.21.15.66:0/2261300712 shutdown_connections 2024-05-10T11:14:47.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.054+0000 7f6192946640 1 -- 172.21.15.66:0/2261300712 wait complete. 2024-05-10T11:14:47.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.055+0000 7f6192946640 1 Processor -- start 2024-05-10T11:14:47.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.055+0000 7f6192946640 1 -- start start 2024-05-10T11:14:47.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6192946640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f618c15f370 0x7f618c0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6192946640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6192946640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 0x7f618c161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6192946640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f618c163340 con 0x7f618c14b2d0 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6192946640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0d2200 con 0x7f618c15f370 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6192946640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f618c1634c0 con 0x7f618c1639a0 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 0x7f618c161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 0x7f618c161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50738/0 (socket says 172.21.15.66:50738) 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 -- 172.21.15.66:0/3070840815 learned_addr learned my addr 172.21.15.66:0/3070840815 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f618bfff640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f618c15f370 0x7f618c0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f618b7fe640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 -- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 msgr2=0x7f618c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 -- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f618c15f370 msgr2=0x7f618c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f618c15f370 0x7f618c0d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:47.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 -- 172.21.15.66:0/3070840815 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c14b730 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f618bfff640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f618c15f370 0x7f618c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6190ee3640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 0x7f618c161f40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6184034040 tx=0x7f6184004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.056+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184041020 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.057+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6184007720 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.057+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184036040 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.057+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c162cb0 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.057+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c15a0b0 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.058+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c159ea0 con 0x7f618c14b2d0 2024-05-10T11:14:47.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.058+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6184044020 con 0x7f618c14b2d0 2024-05-10T11:14:47.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.059+0000 7f6188ff9640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61780762d0 0x7f6178078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:47.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.059+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6245+0+0 (secure 0 0 0) 0x7f61840b8620 con 0x7f618c14b2d0 2024-05-10T11:14:47.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.059+0000 7f618bfff640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61780762d0 0x7f6178078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:47.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.060+0000 7f618bfff640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61780762d0 0x7f6178078790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f618c0d0630 tx=0x7f617c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:47.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.063+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f618404b030 con 0x7f618c14b2d0 2024-05-10T11:14:47.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:47.256+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f618c0b8d90 con 0x7f618c14b2d0 2024-05-10T11:14:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.230+0000 7f6188ff9640 1 -- 172.21.15.66:0/3070840815 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7f6184081ce0 con 0x7f618c14b2d0 2024-05-10T11:14:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.232+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61780762d0 msgr2=0x7f6178078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.232+0000 7f6192946640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61780762d0 0x7f6178078790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f618c0d0630 tx=0x7f617c008040 comp rx=0 tx=0).stop 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.232+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 msgr2=0x7f618c161f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.232+0000 7f6192946640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 0x7f618c161f40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6184034040 tx=0x7f6184004a40 comp rx=0 tx=0).stop 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 shutdown_connections 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f61780762d0 0x7f6178078790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f618c14b2d0 0x7f618c161f40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f618c1639a0 0x7f618c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 --2- 172.21.15.66:0/3070840815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f618c15f370 0x7f618c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 >> 172.21.15.66:0/3070840815 conn(0x7f618c0d2e10 msgr2=0x7f618c06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:48.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 shutdown_connections 2024-05-10T11:14:48.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.233+0000 7f6192946640 1 -- 172.21.15.66:0/3070840815 wait complete. 2024-05-10T11:14:48.249 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:14:48.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.363+0000 7f5e395dd640 1 Processor -- start 2024-05-10T11:14:48.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.363+0000 7f5e395dd640 1 -- start start 2024-05-10T11:14:48.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e395dd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e3406f310 0x7f5e3406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:48.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e395dd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e340c6680 con 0x7f5e3406e820 2024-05-10T11:14:48.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e395dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e340c6960 con 0x7f5e34068110 2024-05-10T11:14:48.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e395dd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3406dc20 con 0x7f5e3406f310 2024-05-10T11:14:48.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e337fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e3406f310 0x7f5e3406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:48.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e32ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5e3406e820 0x7f5e3406ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49700/0 (socket says 172.21.15.66:49700) 2024-05-10T11:14:48.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e32ffd640 1 -- 172.21.15.66:0/3992637570 learned_addr learned my addr 172.21.15.66:0/3992637570 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:48.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e337fe640 1 -- 172.21.15.66:0/3992637570 >> v1:172.21.15.190:6789/0 conn(0x7f5e34068110 legacy=0x7f5e340cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e337fe640 1 -- 172.21.15.66:0/3992637570 >> v1:172.21.15.66:6789/0 conn(0x7f5e3406e820 legacy=0x7f5e3406ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.364+0000 7f5e337fe640 1 -- 172.21.15.66:0/3992637570 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3406cee0 con 0x7f5e3406f310 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.365+0000 7f5e337fe640 1 --2- 172.21.15.66:0/3992637570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e3406d6e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009d90 tx=0x7f5e2c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100ae2b135266c45 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.365+0000 7f5e327fc640 1 -- 172.21.15.66:0/3992637570 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c007740 con 0x7f5e3406f310 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.365+0000 7f5e327fc640 1 -- 172.21.15.66:0/3992637570 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c0078e0 con 0x7f5e3406f310 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.365+0000 7f5e327fc640 1 -- 172.21.15.66:0/3992637570 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c007cb0 con 0x7f5e3406f310 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 -- 172.21.15.66:0/3992637570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 msgr2=0x7f5e3406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 --2- 172.21.15.66:0/3992637570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e3406d6e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009d90 tx=0x7f5e2c02a660 comp rx=0 tx=0).stop 2024-05-10T11:14:48.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 -- 172.21.15.66:0/3992637570 shutdown_connections 2024-05-10T11:14:48.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 --2- 172.21.15.66:0/3992637570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e3406d6e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 -- 172.21.15.66:0/3992637570 >> 172.21.15.66:0/3992637570 conn(0x7f5e340cdf30 msgr2=0x7f5e340ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:48.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 -- 172.21.15.66:0/3992637570 shutdown_connections 2024-05-10T11:14:48.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.366+0000 7f5e395dd640 1 -- 172.21.15.66:0/3992637570 wait complete. 2024-05-10T11:14:48.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.367+0000 7f5e395dd640 1 Processor -- start 2024-05-10T11:14:48.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.367+0000 7f5e395dd640 1 -- start start 2024-05-10T11:14:48.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e395dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e34068110 0x7f5e34153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:48.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e395dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e3406e820 0x7f5e340c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e395dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e340afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e395dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3415f590 con 0x7f5e3406f310 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e395dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3406cca0 con 0x7f5e3406e820 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e395dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5e340c6350 con 0x7f5e34068110 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e340afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e340afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50756/0 (socket says 172.21.15.66:50756) 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 -- 172.21.15.66:0/1921565170 learned_addr learned my addr 172.21.15.66:0/1921565170 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e2a7fc640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e3406e820 0x7f5e340c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e32ffd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e34068110 0x7f5e34153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 -- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e34068110 msgr2=0x7f5e34153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e34068110 0x7f5e34153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 -- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e3406e820 msgr2=0x7f5e340c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:48.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e3406e820 0x7f5e340c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.368+0000 7f5e337fe640 1 -- 172.21.15.66:0/1921565170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e340b4420 con 0x7f5e3406f310 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.369+0000 7f5e337fe640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e340afb80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c02ac50 tx=0x7f5e2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.369+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c03f070 con 0x7f5e3406f310 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.369+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c031c40 con 0x7f5e3406f310 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.369+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e340b4700 con 0x7f5e3406f310 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.369+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c043410 con 0x7f5e3406f310 2024-05-10T11:14:48.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.369+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e340b4cc0 con 0x7f5e3406f310 2024-05-10T11:14:48.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.370+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e340b4ec0 con 0x7f5e3406f310 2024-05-10T11:14:48.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.370+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e2c03b410 con 0x7f5e3406f310 2024-05-10T11:14:48.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.371+0000 7f5e2bfff640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e140762d0 0x7f5e14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:48.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.371+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5807+0+0 (secure 0 0 0) 0x7f5e2c0b8b20 con 0x7f5e3406f310 2024-05-10T11:14:48.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.371+0000 7f5e32ffd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e140762d0 0x7f5e14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:48.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.372+0000 7f5e32ffd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e140762d0 0x7f5e14078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005880 tx=0x7f5e24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:48.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.375+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5e340b4ec0 con 0x7f5e3406f310 2024-05-10T11:14:48.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:48.565+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e3406a220 con 0x7f5e3406f310 2024-05-10T11:14:49.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.231+0000 7f5e2bfff640 1 -- 172.21.15.66:0/1921565170 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7f5e2c0824b0 con 0x7f5e3406f310 2024-05-10T11:14:49.232 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e140762d0 msgr2=0x7f5e14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e140762d0 0x7f5e14078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005880 tx=0x7f5e24009040 comp rx=0 tx=0).stop 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 msgr2=0x7f5e340afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e340afb80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c02ac50 tx=0x7f5e2c004a40 comp rx=0 tx=0).stop 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 shutdown_connections 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5e140762d0 0x7f5e14078790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e3406f310 0x7f5e340afb80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e3406e820 0x7f5e340c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 --2- 172.21.15.66:0/1921565170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e34068110 0x7f5e34153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.234+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 >> 172.21.15.66:0/1921565170 conn(0x7f5e340cdf30 msgr2=0x7f5e340726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:49.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.235+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 shutdown_connections 2024-05-10T11:14:49.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.235+0000 7f5e395dd640 1 -- 172.21.15.66:0/1921565170 wait complete. 2024-05-10T11:14:49.252 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:14:49.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.363+0000 7f5506cc8640 1 Processor -- start 2024-05-10T11:14:49.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.363+0000 7f5506cc8640 1 -- start start 2024-05-10T11:14:49.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5506cc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5500162900 0x7f55000d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5506cc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55000d4190 con 0x7f55000d3950 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5506cc8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55000cfc40 con 0x7f5500162ce0 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5506cc8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f55000d3eb0 con 0x7f5500162900 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5504a64640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5500162900 0x7f55000d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5505265640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f55000d3950 0x7f55000d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49706/0 (socket says 172.21.15.66:49706) 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5505265640 1 -- 172.21.15.66:0/1274254447 learned_addr learned my addr 172.21.15.66:0/1274254447 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5504a64640 1 -- 172.21.15.66:0/1274254447 >> v1:172.21.15.190:6789/0 conn(0x7f5500162ce0 legacy=0x7f55000b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5504a64640 1 -- 172.21.15.66:0/1274254447 >> v1:172.21.15.66:6789/0 conn(0x7f55000d3950 legacy=0x7f55000d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f54ff7fe640 1 -- 172.21.15.66:0/1274254447 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492869199 0 0) 0x7f54f8001490 con 0x7f55000d3950 2024-05-10T11:14:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.364+0000 7f5504a64640 1 -- 172.21.15.66:0/1274254447 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55000cfee0 con 0x7f5500162900 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.365+0000 7f5504a64640 1 --2- 172.21.15.66:0/1274254447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5500162900 0x7f55000d3410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b810f5c9e2b03463 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.365+0000 7f54ff7fe640 1 -- 172.21.15.66:0/1274254447 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037070 con 0x7f5500162900 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.365+0000 7f54ff7fe640 1 -- 172.21.15.66:0/1274254447 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f402ae50 con 0x7f5500162900 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.365+0000 7f54ff7fe640 1 -- 172.21.15.66:0/1274254447 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4032660 con 0x7f5500162900 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 -- 172.21.15.66:0/1274254447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5500162900 msgr2=0x7f55000d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 --2- 172.21.15.66:0/1274254447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5500162900 0x7f55000d3410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f402a140 comp rx=0 tx=0).stop 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 -- 172.21.15.66:0/1274254447 shutdown_connections 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 --2- 172.21.15.66:0/1274254447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5500162900 0x7f55000d3410 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 -- 172.21.15.66:0/1274254447 >> 172.21.15.66:0/1274254447 conn(0x7f550009e430 msgr2=0x7f55000d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 -- 172.21.15.66:0/1274254447 shutdown_connections 2024-05-10T11:14:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.366+0000 7f5506cc8640 1 -- 172.21.15.66:0/1274254447 wait complete. 2024-05-10T11:14:49.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.367+0000 7f5506cc8640 1 Processor -- start 2024-05-10T11:14:49.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.367+0000 7f5506cc8640 1 -- start start 2024-05-10T11:14:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5506cc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 0x7f55001513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5506cc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5500162900 0x7f5500160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5506cc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5500162ce0 0x7f55001612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5506cc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55000b4300 con 0x7f55000d3950 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5506cc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55000b4180 con 0x7f5500162900 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5506cc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55000b4ff0 con 0x7f5500162ce0 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 0x7f55001513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 0x7f55001513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50772/0 (socket says 172.21.15.66:50772) 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 -- 172.21.15.66:0/2492560711 learned_addr learned my addr 172.21.15.66:0/2492560711 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f54fffff640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5500162900 0x7f5500160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5505265640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5500162ce0 0x7f55001612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 -- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5500162ce0 msgr2=0x7f55001612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5500162ce0 0x7f55001612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 -- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5500162900 msgr2=0x7f5500160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5500162900 0x7f5500160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5504a64640 1 -- 172.21.15.66:0/2492560711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55001518e0 con 0x7f55000d3950 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.368+0000 7f5505265640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5500162ce0 0x7f55001612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.369+0000 7f5504a64640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 0x7f55001513a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.369+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4042070 con 0x7f55000d3950 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.369+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f403e670 con 0x7f55000d3950 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.369+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037040 con 0x7f55000d3950 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.369+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550015c1a0 con 0x7f55000d3950 2024-05-10T11:14:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.369+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550015c760 con 0x7f55000d3950 2024-05-10T11:14:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.370+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55000b3da0 con 0x7f55000d3950 2024-05-10T11:14:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.370+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f54f4045070 con 0x7f55000d3950 2024-05-10T11:14:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.371+0000 7f54fd7fa640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f54e40762d0 0x7f54e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.371+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f54f40b7b60 con 0x7f55000d3950 2024-05-10T11:14:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.371+0000 7f54fffff640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f54e40762d0 0x7f54e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.372+0000 7f54fffff640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f54e40762d0 0x7f54e4078790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f54ec004f60 tx=0x7f54ec007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:49.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.375+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f55000b3da0 con 0x7f55000d3950 2024-05-10T11:14:49.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.565+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f550009e840 con 0x7f55000d3950 2024-05-10T11:14:49.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.568+0000 7f54fd7fa640 1 -- 172.21.15.66:0/2492560711 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f54f4081070 con 0x7f55000d3950 2024-05-10T11:14:49.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f54e40762d0 msgr2=0x7f54e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f54e40762d0 0x7f54e4078790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f54ec004f60 tx=0x7f54ec007e30 comp rx=0 tx=0).stop 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 msgr2=0x7f55001513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 0x7f55001513a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f40046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 shutdown_connections 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f54e40762d0 0x7f54e4078790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5500162ce0 0x7f55001612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5500162900 0x7f5500160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 --2- 172.21.15.66:0/2492560711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000d3950 0x7f55001513a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 >> 172.21.15.66:0/2492560711 conn(0x7f550009e430 msgr2=0x7f5500163120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 shutdown_connections 2024-05-10T11:14:49.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.571+0000 7f5506cc8640 1 -- 172.21.15.66:0/2492560711 wait complete. 2024-05-10T11:14:49.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-05-10T11:14:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.686+0000 7f3ca4c37640 1 Processor -- start 2024-05-10T11:14:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.686+0000 7f3ca4c37640 1 -- start start 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3ca4c37640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ca00d5cb0 0x7f3ca00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3ca4c37640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3ca0162b30 0x7f3ca00d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3ca4c37640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca00b45f0 con 0x7f3ca0162750 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3ca4c37640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca00b4f20 con 0x7f3ca00d5cb0 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3ca4c37640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca00d0fe0 con 0x7f3ca0162b30 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9e59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3ca0162750 0x7f3ca00d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49722/0 (socket says 172.21.15.66:49722) 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9e59c640 1 -- 172.21.15.66:0/2106666520 learned_addr learned my addr 172.21.15.66:0/2106666520 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9dd9b640 1 --2- 172.21.15.66:0/2106666520 >> v2:172.21.15.66:3300/0 conn(0x7f3ca00d5cb0 0x7f3ca00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9ed9d640 1 --2- 172.21.15.66:0/2106666520 >> v2:172.21.15.190:3300/0 conn(0x7f3ca0162b30 0x7f3ca00d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9d59a640 1 -- 172.21.15.66:0/2106666520 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375426004 0 0) 0x7f3ca00b45f0 con 0x7f3ca0162750 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9d59a640 1 -- 172.21.15.66:0/2106666520 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c88003520 con 0x7f3ca0162750 2024-05-10T11:14:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/2106666520 >> v2:172.21.15.190:3300/0 conn(0x7f3ca0162b30 msgr2=0x7f3ca00d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9dd9b640 1 --2- 172.21.15.66:0/2106666520 >> v2:172.21.15.190:3300/0 conn(0x7f3ca0162b30 0x7f3ca00d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/2106666520 >> v1:172.21.15.66:6789/0 conn(0x7f3ca0162750 legacy=0x7f3ca00d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.687+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/2106666520 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca00b48d0 con 0x7f3ca00d5cb0 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.688+0000 7f3c9dd9b640 1 --2- 172.21.15.66:0/2106666520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca00d5cb0 0x7f3ca00d3630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00d32c0 tx=0x7f3c9402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f12cf8c1ba64c3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.688+0000 7f3c9d59a640 1 -- 172.21.15.66:0/2106666520 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94037070 con 0x7f3ca00d5cb0 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.688+0000 7f3c9d59a640 1 -- 172.21.15.66:0/2106666520 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c94032440 con 0x7f3ca00d5cb0 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.688+0000 7f3c9d59a640 1 -- 172.21.15.66:0/2106666520 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9402ae60 con 0x7f3ca00d5cb0 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 -- 172.21.15.66:0/2106666520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca00d5cb0 msgr2=0x7f3ca00d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/2106666520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca00d5cb0 0x7f3ca00d3630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00d32c0 tx=0x7f3c9402a110 comp rx=0 tx=0).stop 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 -- 172.21.15.66:0/2106666520 shutdown_connections 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/2106666520 >> v2:172.21.15.190:3300/0 conn(0x7f3ca0162b30 0x7f3ca00d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/2106666520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca00d5cb0 0x7f3ca00d3630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 -- 172.21.15.66:0/2106666520 >> 172.21.15.66:0/2106666520 conn(0x7f3ca009e3b0 msgr2=0x7f3ca00d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 -- 172.21.15.66:0/2106666520 shutdown_connections 2024-05-10T11:14:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.689+0000 7f3ca4c37640 1 -- 172.21.15.66:0/2106666520 wait complete. 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.690+0000 7f3ca4c37640 1 Processor -- start 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.690+0000 7f3ca4c37640 1 -- start start 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3ca4c37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ca0162750 0x7f3ca00cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3ca4c37640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 0x7f3ca00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3ca4c37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ca01555e0 0x7f3ca015ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3ca4c37640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca00b53b0 con 0x7f3ca0162b30 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3ca4c37640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca00d0d80 con 0x7f3ca01555e0 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3ca4c37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca00b5530 con 0x7f3ca0162750 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 0x7f3ca00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 0x7f3ca00cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50786/0 (socket says 172.21.15.66:50786) 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/1785026704 learned_addr learned my addr 172.21.15.66:0/1785026704 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9e59c640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ca0162750 0x7f3ca00cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9ed9d640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ca01555e0 0x7f3ca015ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ca0162750 msgr2=0x7f3ca00cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ca0162750 0x7f3ca00cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ca01555e0 msgr2=0x7f3ca015ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ca01555e0 0x7f3ca015ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9dd9b640 1 -- 172.21.15.66:0/1785026704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca0155a70 con 0x7f3ca0162b30 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.691+0000 7f3c9e59c640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ca0162750 0x7f3ca00cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3c9ed9d640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ca01555e0 0x7f3ca015ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3c9dd9b640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 0x7f3ca00cee80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009890 tx=0x7f3c940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94037040 con 0x7f3ca0162b30 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c94042070 con 0x7f3ca0162b30 2024-05-10T11:14:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca00b7c70 con 0x7f3ca0162b30 2024-05-10T11:14:49.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94030960 con 0x7f3ca0162b30 2024-05-10T11:14:49.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.692+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca00cda30 con 0x7f3ca0162b30 2024-05-10T11:14:49.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.693+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca006a220 con 0x7f3ca0162b30 2024-05-10T11:14:49.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.693+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3c94030b00 con 0x7f3ca0162b30 2024-05-10T11:14:49.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.694+0000 7f3c8effd640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3c800762d0 0x7f3c80078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:49.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.694+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f3c940b7de0 con 0x7f3ca0162b30 2024-05-10T11:14:49.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.694+0000 7f3c9e59c640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3c800762d0 0x7f3c80078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:49.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.695+0000 7f3c9e59c640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3c800762d0 0x7f3c80078790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c90005880 tx=0x7f3c90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.698+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3c940818b0 con 0x7f3ca0162b30 2024-05-10T11:14:49.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:49.968+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f3ca00d1620 con 0x7f3ca0162b30 2024-05-10T11:14:50.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.238+0000 7f3c8effd640 1 -- 172.21.15.66:0/1785026704 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v136) ==== 149+0+0 (secure 0 0 0) 0x7f3c940811b0 con 0x7f3ca0162b30 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3c800762d0 msgr2=0x7f3c80078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3c800762d0 0x7f3c80078790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c90005880 tx=0x7f3c90009040 comp rx=0 tx=0).stop 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 msgr2=0x7f3ca00cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 0x7f3ca00cee80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009890 tx=0x7f3c940046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 shutdown_connections 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3c800762d0 0x7f3c80078790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ca01555e0 0x7f3ca015ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ca0162b30 0x7f3ca00cee80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 --2- 172.21.15.66:0/1785026704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ca0162750 0x7f3ca00cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.240+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 >> 172.21.15.66:0/1785026704 conn(0x7f3ca009e3b0 msgr2=0x7f3ca00b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:50.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.241+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 shutdown_connections 2024-05-10T11:14:50.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.241+0000 7f3ca4c37640 1 -- 172.21.15.66:0/1785026704 wait complete. 2024-05-10T11:14:50.252 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-05-10T11:14:50.252 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-05-10T11:14:50.252 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:14:50.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:14:50.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.356+0000 7f33b2662640 1 Processor -- start 2024-05-10T11:14:50.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.356+0000 7f33b2662640 1 -- start start 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b2662640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f33ac15ce60 0x7f33ac0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b2662640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac0c65f0 0x7f33ac160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b2662640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ac0c6a30 con 0x7f33ac161010 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b2662640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f33ac161480 con 0x7f33ac15ce60 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b2662640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f33ac0cd090 con 0x7f33ac0c65f0 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33abfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f33ac15ce60 0x7f33ac0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b0bff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f33ac161010 0x7f33ac0add50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49730/0 (socket says 172.21.15.66:49730) 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33b0bff640 1 -- 172.21.15.66:0/3981297171 learned_addr learned my addr 172.21.15.66:0/3981297171 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:50.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33ab7fe640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac0c65f0 0x7f33ac160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.357+0000 7f33abfff640 1 -- 172.21.15.66:0/3981297171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac0c65f0 msgr2=0x7f33ac160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:50.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33aaffd640 1 -- 172.21.15.66:0/3981297171 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 300169489 0 0) 0x7f33ac0c6a30 con 0x7f33ac161010 2024-05-10T11:14:50.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33abfff640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac0c65f0 0x7f33ac160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33abfff640 1 -- 172.21.15.66:0/3981297171 >> v1:172.21.15.66:6789/0 conn(0x7f33ac161010 legacy=0x7f33ac0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33abfff640 1 -- 172.21.15.66:0/3981297171 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ac0cd370 con 0x7f33ac15ce60 2024-05-10T11:14:50.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33ab7fe640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac0c65f0 0x7f33ac160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33abfff640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac15ce60 0x7f33ac0cb300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f339c0097a0 tx=0x7f339c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eb80da2506a9d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33aaffd640 1 -- 172.21.15.66:0/3981297171 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c037070 con 0x7f33ac15ce60 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33aaffd640 1 -- 172.21.15.66:0/3981297171 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c02ae50 con 0x7f33ac15ce60 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.358+0000 7f33aaffd640 1 -- 172.21.15.66:0/3981297171 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c032660 con 0x7f33ac15ce60 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 -- 172.21.15.66:0/3981297171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac15ce60 msgr2=0x7f33ac0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac15ce60 0x7f33ac0cb300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f339c0097a0 tx=0x7f339c02a100 comp rx=0 tx=0).stop 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 -- 172.21.15.66:0/3981297171 shutdown_connections 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac0c65f0 0x7f33ac160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 --2- 172.21.15.66:0/3981297171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac15ce60 0x7f33ac0cb300 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 -- 172.21.15.66:0/3981297171 >> 172.21.15.66:0/3981297171 conn(0x7f33ac0b2900 msgr2=0x7f33ac0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:50.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 -- 172.21.15.66:0/3981297171 shutdown_connections 2024-05-10T11:14:50.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.359+0000 7f33b2662640 1 -- 172.21.15.66:0/3981297171 wait complete. 2024-05-10T11:14:50.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.360+0000 7f33b2662640 1 Processor -- start 2024-05-10T11:14:50.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 -- start start 2024-05-10T11:14:50.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac15ce60 0x7f33ac0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 0x7f33ac154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac0ccd60 con 0x7f33ac161010 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac0cd930 con 0x7f33ac0c65f0 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b2662640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f33ac15e250 con 0x7f33ac15ce60 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b0bff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 0x7f33ac154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b0bff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 0x7f33ac154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50810/0 (socket says 172.21.15.66:50810) 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.361+0000 7f33b0bff640 1 -- 172.21.15.66:0/769641051 learned_addr learned my addr 172.21.15.66:0/769641051 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33abfff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33ab7fe640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac15ce60 0x7f33ac0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b0bff640 1 -- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac15ce60 msgr2=0x7f33ac0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b0bff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac15ce60 0x7f33ac0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b0bff640 1 -- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33ac0c65f0 msgr2=0x7f33ac1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b0bff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b0bff640 1 -- 172.21.15.66:0/769641051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ac0b3f10 con 0x7f33ac161010 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33abfff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33ab7fe640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac15ce60 0x7f33ac0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:50.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b0bff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 0x7f33ac154800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c7a0 tx=0x7f33a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4018070 con 0x7f33ac161010 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a400a5e0 con 0x7f33ac161010 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a400aa50 con 0x7f33ac161010 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ac0b41e0 con 0x7f33ac161010 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.362+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ac0b47a0 con 0x7f33ac161010 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.363+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ac06a220 con 0x7f33ac161010 2024-05-10T11:14:50.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.364+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f33a401b070 con 0x7f33ac161010 2024-05-10T11:14:50.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.364+0000 7f33a8ff9640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3398076300 0x7f33980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.364+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f33a4096a50 con 0x7f33ac161010 2024-05-10T11:14:50.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.365+0000 7f33abfff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3398076300 0x7f33980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.365+0000 7f33abfff640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3398076300 0x7f33980787c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f339c034000 tx=0x7f339c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:50.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.369+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f33a4060490 con 0x7f33ac161010 2024-05-10T11:14:50.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.563+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33ac09ebe0 con 0x7f33ac161010 2024-05-10T11:14:50.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.564+0000 7f33a8ff9640 1 -- 172.21.15.66:0/769641051 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13291 (secure 0 0 0) 0x7f33a405fd90 con 0x7f33ac161010 2024-05-10T11:14:50.564 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:50.564 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:49.231215+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/433642873":"2024-05-11T11:14:45.882104+0000","172.21.15.66:6833/433642873":"2024-05-11T11:14:45.882104+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:14:50.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3398076300 msgr2=0x7f33980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3398076300 0x7f33980787c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f339c034000 tx=0x7f339c02e000 comp rx=0 tx=0).stop 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 msgr2=0x7f33ac154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 0x7f33ac154800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c7a0 tx=0x7f33a400cc60 comp rx=0 tx=0).stop 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 shutdown_connections 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3398076300 0x7f33980787c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33ac161010 0x7f33ac154800 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33ac15ce60 0x7f33ac0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 --2- 172.21.15.66:0/769641051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 >> 172.21.15.66:0/769641051 conn(0x7f33ac0b2900 msgr2=0x7f33ac0d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 shutdown_connections 2024-05-10T11:14:50.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.566+0000 7f33b2662640 1 -- 172.21.15.66:0/769641051 wait complete. 2024-05-10T11:14:50.578 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:14:50.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:14:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.685+0000 7f2d68d59640 1 Processor -- start 2024-05-10T11:14:50.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.685+0000 7f2d68d59640 1 -- start start 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.685+0000 7f2d68d59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 0x7f2d640d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.685+0000 7f2d68d59640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2d64162ce0 0x7f2d640b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d68d59640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d640d4190 con 0x7f2d640d3950 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d68d59640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2d640cfc40 con 0x7f2d64162ce0 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d68d59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2d640d3eb0 con 0x7f2d64162900 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d62d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2d640d3950 0x7f2d640d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49734/0 (socket says 172.21.15.66:49734) 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d62d9d640 1 -- 172.21.15.66:0/1033176737 learned_addr learned my addr 172.21.15.66:0/1033176737 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125623102 0 0) 0x7f2d5c001490 con 0x7f2d640d3950 2024-05-10T11:14:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d50003520 con 0x7f2d640d3950 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6259c640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 0x7f2d640d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d61d9b640 1 --2- 172.21.15.66:0/1033176737 >> v2:172.21.15.190:3300/0 conn(0x7f2d64162ce0 0x7f2d640b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4143429287 0 0) 0x7f2d50003520 con 0x7f2d640d3950 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 msgr2=0x7f2d640d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 0x7f2d640d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 >> v2:172.21.15.190:3300/0 conn(0x7f2d64162ce0 msgr2=0x7f2d640b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 --2- 172.21.15.66:0/1033176737 >> v2:172.21.15.190:3300/0 conn(0x7f2d64162ce0 0x7f2d640b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d640cfee0 con 0x7f2d640d3950 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f2d5c001bc0 con 0x7f2d640d3950 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 >> v1:172.21.15.66:6789/0 conn(0x7f2d640d3950 legacy=0x7f2d640d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d500039b0 0x7f2d50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 0x7f2d50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d640cfc40 con 0x7f2d50004d40 2024-05-10T11:14:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2d640d3eb0 con 0x7f2d500039b0 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.686+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5000b9c0 con 0x7f2d64162900 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d6259c640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d500039b0 0x7f2d50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d61d9b640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 0x7f2d50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 -- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 msgr2=0x7f2d50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d64162900 0x7f2d50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 -- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d500039b0 msgr2=0x7f2d50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d500039b0 0x7f2d50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 -- 172.21.15.66:0/1033176737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d50003520 con 0x7f2d50004d40 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.687+0000 7f2d62d9d640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d500051c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00aa40 tx=0x7f2d50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf92db8226ca5efc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00a690 con 0x7f2d50004d40 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d5c02f070 con 0x7f2d50004d40 2024-05-10T11:14:50.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d6159a640 1 -- 172.21.15.66:0/1033176737 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c034470 con 0x7f2d50004d40 2024-05-10T11:14:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d68d59640 1 -- 172.21.15.66:0/1033176737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 msgr2=0x7f2d500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d68d59640 1 --2- 172.21.15.66:0/1033176737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d500051c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00aa40 tx=0x7f2d50005830 comp rx=0 tx=0).stop 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d62d9d640 1 -- 172.21.15.66:0/1033176737 reap_dead start 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d68d59640 1 -- 172.21.15.66:0/1033176737 shutdown_connections 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d68d59640 1 -- 172.21.15.66:0/1033176737 >> 172.21.15.66:0/1033176737 conn(0x7f2d6409e430 msgr2=0x7f2d640d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d68d59640 1 -- 172.21.15.66:0/1033176737 shutdown_connections 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.688+0000 7f2d68d59640 1 -- 172.21.15.66:0/1033176737 wait complete. 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.690+0000 7f2d68d59640 1 Processor -- start 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.690+0000 7f2d68d59640 1 -- start start 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d640b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d6415e640 0x7f2d640b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d640ce7e0 0x7f2d641f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d640b4300 con 0x7f2d50004d40 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2d640b4180 con 0x7f2d6415e640 2024-05-10T11:14:50.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2d640d10d0 con 0x7f2d640ce7e0 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d640b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d640b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50824/0 (socket says 172.21.15.66:50824) 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 -- 172.21.15.66:0/4200608707 learned_addr learned my addr 172.21.15.66:0/4200608707 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d61d9b640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d6415e640 0x7f2d640b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d62d9d640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d640ce7e0 0x7f2d641f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 -- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d640ce7e0 msgr2=0x7f2d641f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d640ce7e0 0x7f2d641f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 -- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d6415e640 msgr2=0x7f2d640b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d6415e640 0x7f2d640b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 -- 172.21.15.66:0/4200608707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d640cecc0 con 0x7f2d50004d40 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d62d9d640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d640ce7e0 0x7f2d641f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d61d9b640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d6415e640 0x7f2d640b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d6259c640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d640b58b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2d540118e0 tx=0x7f2d54011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400faf0 con 0x7f2d50004d40 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d5400fc90 con 0x7f2d50004d40 2024-05-10T11:14:50.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54014440 con 0x7f2d50004d40 2024-05-10T11:14:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d640cd2a0 con 0x7f2d50004d40 2024-05-10T11:14:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.691+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d640cd860 con 0x7f2d50004d40 2024-05-10T11:14:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.692+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6406a220 con 0x7f2d50004d40 2024-05-10T11:14:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.693+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d54012040 con 0x7f2d50004d40 2024-05-10T11:14:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.694+0000 7f2d5affd640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2d440762d0 0x7f2d44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:50.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.694+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f2d54097bc0 con 0x7f2d50004d40 2024-05-10T11:14:50.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.694+0000 7f2d61d9b640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2d440762d0 0x7f2d44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:50.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.694+0000 7f2d61d9b640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2d440762d0 0x7f2d44078790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d640d51a0 tx=0x7f2d4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:50.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.698+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2d54019030 con 0x7f2d50004d40 2024-05-10T11:14:50.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.887+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d6409e840 con 0x7f2d50004d40 2024-05-10T11:14:50.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.887+0000 7f2d5affd640 1 -- 172.21.15.66:0/4200608707 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f2d54061690 con 0x7f2d50004d40 2024-05-10T11:14:50.888 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2d440762d0 msgr2=0x7f2d44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2d440762d0 0x7f2d44078790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d640d51a0 tx=0x7f2d4c008040 comp rx=0 tx=0).stop 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 msgr2=0x7f2d640b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d640b58b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2d540118e0 tx=0x7f2d54011da0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 shutdown_connections 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2d440762d0 0x7f2d44078790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d640ce7e0 0x7f2d641f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d6415e640 0x7f2d640b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 --2- 172.21.15.66:0/4200608707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d50004d40 0x7f2d640b58b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:50.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 >> 172.21.15.66:0/4200608707 conn(0x7f2d6409e430 msgr2=0x7f2d640d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:50.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 shutdown_connections 2024-05-10T11:14:50.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:50.889+0000 7f2d68d59640 1 -- 172.21.15.66:0/4200608707 wait complete. 2024-05-10T11:14:50.901 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-05-10T11:14:51.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.004+0000 7f7daccc8640 1 Processor -- start 2024-05-10T11:14:51.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.004+0000 7f7daccc8640 1 -- start start 2024-05-10T11:14:51.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.005+0000 7f7daccc8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7da815f3b0 0x7f7da80d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:51.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.005+0000 7f7daccc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da815f790 0x7f7da80d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.005+0000 7f7daccc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7da80d30b0 con 0x7f7da80d5d30 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.005+0000 7f7daccc8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7da80d3390 con 0x7f7da815f3b0 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.005+0000 7f7daccc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7da80c8c80 con 0x7f7da815f790 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da6d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7da80d5d30 0x7f7da80c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49742/0 (socket says 172.21.15.66:49742) 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da6d9d640 1 -- 172.21.15.66:0/2026092362 learned_addr learned my addr 172.21.15.66:0/2026092362 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da659c640 1 --2- 172.21.15.66:0/2026092362 >> v2:172.21.15.190:3300/0 conn(0x7f7da815f3b0 0x7f7da80d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da5d9b640 1 --2- 172.21.15.66:0/2026092362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da815f790 0x7f7da80d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da559a640 1 -- 172.21.15.66:0/2026092362 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344976514 0 0) 0x7f7da80d30b0 con 0x7f7da80d5d30 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da559a640 1 -- 172.21.15.66:0/2026092362 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d94003520 con 0x7f7da80d5d30 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da5d9b640 1 -- 172.21.15.66:0/2026092362 >> v2:172.21.15.190:3300/0 conn(0x7f7da815f3b0 msgr2=0x7f7da80d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da5d9b640 1 --2- 172.21.15.66:0/2026092362 >> v2:172.21.15.190:3300/0 conn(0x7f7da815f3b0 0x7f7da80d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da5d9b640 1 -- 172.21.15.66:0/2026092362 >> v1:172.21.15.66:6789/0 conn(0x7f7da80d5d30 legacy=0x7f7da80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da5d9b640 1 -- 172.21.15.66:0/2026092362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da80c8f60 con 0x7f7da815f790 2024-05-10T11:14:51.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.006+0000 7f7da659c640 1 --2- 172.21.15.66:0/2026092362 >> v2:172.21.15.190:3300/0 conn(0x7f7da815f3b0 0x7f7da80d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.007+0000 7f7da5d9b640 1 --2- 172.21.15.66:0/2026092362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da815f790 0x7f7da80d3c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d900097a0 tx=0x7f7d9002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b818ce8a68df5d90 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.007+0000 7f7da559a640 1 -- 172.21.15.66:0/2026092362 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90037070 con 0x7f7da815f790 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.007+0000 7f7da559a640 1 -- 172.21.15.66:0/2026092362 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90032440 con 0x7f7da815f790 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.007+0000 7f7da559a640 1 -- 172.21.15.66:0/2026092362 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90032810 con 0x7f7da815f790 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 -- 172.21.15.66:0/2026092362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da815f790 msgr2=0x7f7da80d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 --2- 172.21.15.66:0/2026092362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da815f790 0x7f7da80d3c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d900097a0 tx=0x7f7d9002a180 comp rx=0 tx=0).stop 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 -- 172.21.15.66:0/2026092362 shutdown_connections 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 --2- 172.21.15.66:0/2026092362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da815f790 0x7f7da80d3c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 --2- 172.21.15.66:0/2026092362 >> v2:172.21.15.190:3300/0 conn(0x7f7da815f3b0 0x7f7da80d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 -- 172.21.15.66:0/2026092362 >> 172.21.15.66:0/2026092362 conn(0x7f7da80d5130 msgr2=0x7f7da80d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 -- 172.21.15.66:0/2026092362 shutdown_connections 2024-05-10T11:14:51.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.008+0000 7f7daccc8640 1 -- 172.21.15.66:0/2026092362 wait complete. 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.009+0000 7f7daccc8640 1 Processor -- start 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.009+0000 7f7daccc8640 1 -- start start 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7daccc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da80d5d30 0x7f7da8156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7daccc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 0x7f7da81550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7daccc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7da81555e0 0x7f7da8146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7daccc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7da80d0e60 con 0x7f7da815f3b0 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7daccc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7da80d0ce0 con 0x7f7da81555e0 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7daccc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7da80d0fe0 con 0x7f7da80d5d30 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 0x7f7da81550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 0x7f7da81550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50840/0 (socket says 172.21.15.66:50840) 2024-05-10T11:14:51.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 -- 172.21.15.66:0/3691717522 learned_addr learned my addr 172.21.15.66:0/3691717522 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da6d9d640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7da81555e0 0x7f7da8146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da659c640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da80d5d30 0x7f7da8156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 -- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da80d5d30 msgr2=0x7f7da8156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da80d5d30 0x7f7da8156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 -- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7da81555e0 msgr2=0x7f7da8146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7da81555e0 0x7f7da8146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 -- 172.21.15.66:0/3691717522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da8158370 con 0x7f7da815f3b0 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da659c640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da80d5d30 0x7f7da8156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.010+0000 7f7da5d9b640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 0x7f7da81550a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7d9002a1c0 tx=0x7f7d900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.011+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90037040 con 0x7f7da815f3b0 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.011+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90042070 con 0x7f7da815f3b0 2024-05-10T11:14:51.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.011+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da81577f0 con 0x7f7da815f3b0 2024-05-10T11:14:51.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.011+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9003b950 con 0x7f7da815f3b0 2024-05-10T11:14:51.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.011+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da8157db0 con 0x7f7da815f3b0 2024-05-10T11:14:51.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.012+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da80d4c20 con 0x7f7da815f3b0 2024-05-10T11:14:51.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.012+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d9003baf0 con 0x7f7da815f3b0 2024-05-10T11:14:51.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.013+0000 7f7d9effd640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d880762d0 0x7f7d88078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:51.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.013+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f7d900b7bb0 con 0x7f7da815f3b0 2024-05-10T11:14:51.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.013+0000 7f7da659c640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d880762d0 0x7f7d88078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:51.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.013+0000 7f7da659c640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d880762d0 0x7f7d88078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d98007520 tx=0x7f7d9800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:51.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.017+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7da80d4c20 con 0x7f7da815f3b0 2024-05-10T11:14:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:51.281+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f7da806a220 con 0x7f7da815f3b0 2024-05-10T11:14:52.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.244+0000 7f7d9effd640 1 -- 172.21.15.66:0/3691717522 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v138) ==== 172+0+0 (secure 0 0 0) 0x7f7d90081710 con 0x7f7da815f3b0 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d880762d0 msgr2=0x7f7d88078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d880762d0 0x7f7d88078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d98007520 tx=0x7f7d9800b040 comp rx=0 tx=0).stop 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 msgr2=0x7f7da81550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 0x7f7da81550a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7d9002a1c0 tx=0x7f7d900046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 shutdown_connections 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d880762d0 0x7f7d88078790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7da81555e0 0x7f7da8146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7da815f3b0 0x7f7da81550a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 --2- 172.21.15.66:0/3691717522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7da80d5d30 0x7f7da8156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 >> 172.21.15.66:0/3691717522 conn(0x7f7da80d5130 msgr2=0x7f7da815e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:52.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 shutdown_connections 2024-05-10T11:14:52.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.247+0000 7f7daccc8640 1 -- 172.21.15.66:0/3691717522 wait complete. 2024-05-10T11:14:52.261 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:14:52.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.374+0000 7f0401015640 1 Processor -- start 2024-05-10T11:14:52.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.374+0000 7f0401015640 1 -- start start 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f0401015640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f03fc15f410 0x7f03fc0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f0401015640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f03fc0b56a0 0x7f03fc0d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f0401015640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03fc0d2800 con 0x7f03fc0d0f10 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f0401015640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f03fc0d2ae0 con 0x7f03fc15f410 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f0401015640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f03fc0d01d0 con 0x7f03fc0b56a0 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f03fc15f410 0x7f03fc0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fa59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f03fc0d0f10 0x7f03fc0b4f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49746/0 (socket says 172.21.15.66:49746) 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fa59c640 1 -- 172.21.15.66:0/3693250008 learned_addr learned my addr 172.21.15.66:0/3693250008 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fb59e640 1 --2- 172.21.15.66:0/3693250008 >> v2:172.21.15.190:3300/0 conn(0x7f03fc0b56a0 0x7f03fc0d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fad9d640 1 -- 172.21.15.66:0/3693250008 >> v2:172.21.15.190:3300/0 conn(0x7f03fc0b56a0 msgr2=0x7f03fc0d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fad9d640 1 --2- 172.21.15.66:0/3693250008 >> v2:172.21.15.190:3300/0 conn(0x7f03fc0b56a0 0x7f03fc0d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fad9d640 1 -- 172.21.15.66:0/3693250008 >> v1:172.21.15.66:6789/0 conn(0x7f03fc0d0f10 legacy=0x7f03fc0b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fad9d640 1 -- 172.21.15.66:0/3693250008 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc0d04b0 con 0x7f03fc15f410 2024-05-10T11:14:52.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03f9d9b640 1 -- 172.21.15.66:0/3693250008 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561554386 0 0) 0x7f03fc0d2800 con 0x7f03fc0d0f10 2024-05-10T11:14:52.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.375+0000 7f03fb59e640 1 --2- 172.21.15.66:0/3693250008 >> v2:172.21.15.190:3300/0 conn(0x7f03fc0b56a0 0x7f03fc0d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:52.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.376+0000 7f03fad9d640 1 --2- 172.21.15.66:0/3693250008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0d09d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0c8d10 tx=0x7f03ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32260063f12fffa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:52.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.376+0000 7f03f9d9b640 1 -- 172.21.15.66:0/3693250008 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec037070 con 0x7f03fc15f410 2024-05-10T11:14:52.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.376+0000 7f03f9d9b640 1 -- 172.21.15.66:0/3693250008 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec032440 con 0x7f03fc15f410 2024-05-10T11:14:52.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.376+0000 7f03f9d9b640 1 -- 172.21.15.66:0/3693250008 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec02ae60 con 0x7f03fc15f410 2024-05-10T11:14:52.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.376+0000 7f0401015640 1 -- 172.21.15.66:0/3693250008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 msgr2=0x7f03fc0d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.376+0000 7f0401015640 1 --2- 172.21.15.66:0/3693250008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0d09d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0c8d10 tx=0x7f03ec02a110 comp rx=0 tx=0).stop 2024-05-10T11:14:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.377+0000 7f0401015640 1 -- 172.21.15.66:0/3693250008 shutdown_connections 2024-05-10T11:14:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.377+0000 7f0401015640 1 --2- 172.21.15.66:0/3693250008 >> v2:172.21.15.190:3300/0 conn(0x7f03fc0b56a0 0x7f03fc0d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.377+0000 7f0401015640 1 --2- 172.21.15.66:0/3693250008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0d09d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.377+0000 7f0401015640 1 -- 172.21.15.66:0/3693250008 >> 172.21.15.66:0/3693250008 conn(0x7f03fc08ed30 msgr2=0x7f03fc09e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.377+0000 7f0401015640 1 -- 172.21.15.66:0/3693250008 shutdown_connections 2024-05-10T11:14:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.377+0000 7f0401015640 1 -- 172.21.15.66:0/3693250008 wait complete. 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.378+0000 7f0401015640 1 Processor -- start 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.378+0000 7f0401015640 1 -- start start 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f0401015640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03fc0d0f10 0x7f03fc0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f0401015640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f0401015640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03fc15c140 0x7f03fc15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f0401015640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0cffb0 con 0x7f03fc15f410 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f0401015640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0cfe30 con 0x7f03fc15c140 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f0401015640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f03fc0d3c10 con 0x7f03fc0d0f10 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50866/0 (socket says 172.21.15.66:50866) 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 -- 172.21.15.66:0/2618271677 learned_addr learned my addr 172.21.15.66:0/2618271677 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fb59e640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03fc15c140 0x7f03fc15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fad9d640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03fc0d0f10 0x7f03fc0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 -- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03fc0d0f10 msgr2=0x7f03fc0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03fc0d0f10 0x7f03fc0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 -- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03fc15c140 msgr2=0x7f03fc15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03fc15c140 0x7f03fc15c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.379+0000 7f03fa59c640 1 -- 172.21.15.66:0/2618271677 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc0cf350 con 0x7f03fc15f410 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.380+0000 7f03fa59c640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0ceb70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c4d0 tx=0x7f03f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.380+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0018070 con 0x7f03fc15f410 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.380+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f0007500 con 0x7f03fc15f410 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.380+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc1f47f0 con 0x7f03fc15f410 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.380+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0004a20 con 0x7f03fc15f410 2024-05-10T11:14:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.380+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03fc0cf0b0 con 0x7f03fc15f410 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.381+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03fc06a220 con 0x7f03fc15f410 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.382+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f03f0004bc0 con 0x7f03fc15f410 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.382+0000 7f03e37fe640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f03e80762d0 0x7f03e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.382+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f03f0096660 con 0x7f03fc15f410 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.382+0000 7f03fad9d640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f03e80762d0 0x7f03e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.383+0000 7f03fad9d640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f03e80762d0 0x7f03e8078790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f03ec034000 tx=0x7f03ec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.387+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f03fc1f47f0 con 0x7f03fc15f410 2024-05-10T11:14:52.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.577+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f03fc0d6090 con 0x7f03fc15f410 2024-05-10T11:14:52.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.580+0000 7f03e37fe640 1 -- 172.21.15.66:0/2618271677 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f03f005faf0 con 0x7f03fc15f410 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f03e80762d0 msgr2=0x7f03e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f03e80762d0 0x7f03e8078790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f03ec034000 tx=0x7f03ec02e000 comp rx=0 tx=0).stop 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 msgr2=0x7f03fc0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0ceb70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c4d0 tx=0x7f03f000c990 comp rx=0 tx=0).stop 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 shutdown_connections 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f03e80762d0 0x7f03e8078790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03fc15c140 0x7f03fc15c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03fc15f410 0x7f03fc0ceb70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 --2- 172.21.15.66:0/2618271677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03fc0d0f10 0x7f03fc0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 >> 172.21.15.66:0/2618271677 conn(0x7f03fc08ed30 msgr2=0x7f03fc06e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:52.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 shutdown_connections 2024-05-10T11:14:52.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.582+0000 7f0401015640 1 -- 172.21.15.66:0/2618271677 wait complete. 2024-05-10T11:14:52.594 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:14:52.594 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:14:52.645 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:14:52.695 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:14:52.695 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:14:52.695 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:52.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:14:52.712 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:14:52.713 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:52.731 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:14:52.731 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:14:52.731 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:52.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:14:52.769 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:14:52.769 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:14:52.791 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:14:52.791 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:14:52.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:14:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.912+0000 7ff06894e640 1 Processor -- start 2024-05-10T11:14:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.912+0000 7ff06894e640 1 -- start start 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff06894e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 0x7ff0640b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff06894e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0640d59d0 0x7ff0640d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff06894e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0640d2d20 con 0x7ff0640b47a0 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff06894e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff064162d20 con 0x7ff0640d59d0 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff06894e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff0640d3000 con 0x7ff064162940 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff062d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff0640b47a0 0x7ff064162f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49752/0 (socket says 172.21.15.66:49752) 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.913+0000 7ff062d9d640 1 -- 172.21.15.66:0/3507386859 learned_addr learned my addr 172.21.15.66:0/3507386859 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06259c640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 0x7ff0640b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff061d9b640 1 --2- 172.21.15.66:0/3507386859 >> v2:172.21.15.190:3300/0 conn(0x7ff0640d59d0 0x7ff0640d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693549048 0 0) 0x7ff0640d2d20 con 0x7ff0640b47a0 2024-05-10T11:14:52.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04c003520 con 0x7ff0640b47a0 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2897101877 0 0) 0x7ff04c003520 con 0x7ff0640b47a0 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 msgr2=0x7ff0640b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 0x7ff0640b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 >> v2:172.21.15.190:3300/0 conn(0x7ff0640d59d0 msgr2=0x7ff0640d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 --2- 172.21.15.66:0/3507386859 >> v2:172.21.15.190:3300/0 conn(0x7ff0640d59d0 0x7ff0640d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0640d32e0 con 0x7ff0640b47a0 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7ff05c001670 con 0x7ff0640b47a0 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 >> v1:172.21.15.66:6789/0 conn(0x7ff0640b47a0 legacy=0x7ff064162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 0x7ff04c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c003f30 0x7ff04c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04c004d40 0x7ff04c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0640d3000 con 0x7ff04c004d40 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c00ba20 con 0x7ff04c003f30 2024-05-10T11:14:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c00bc20 con 0x7ff064162940 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff062d9d640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04c004d40 0x7ff04c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff06259c640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 0x7ff04c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.914+0000 7ff061d9b640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c003f30 0x7ff04c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff062d9d640 1 -- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 msgr2=0x7ff04c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff062d9d640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff064162940 0x7ff04c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff062d9d640 1 -- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c003f30 msgr2=0x7ff04c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff062d9d640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c003f30 0x7ff04c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff062d9d640 1 -- 172.21.15.66:0/3507386859 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c003520 con 0x7ff04c004d40 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff062d9d640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04c004d40 0x7ff04c0051c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff05c001050 tx=0x7ff04c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723c90cd039c7fae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c02e070 con 0x7ff04c004d40 2024-05-10T11:14:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c005af0 con 0x7ff04c004d40 2024-05-10T11:14:52.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.915+0000 7ff06159a640 1 -- 172.21.15.66:0/3507386859 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c007d70 con 0x7ff04c004d40 2024-05-10T11:14:52.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff06894e640 1 -- 172.21.15.66:0/3507386859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04c004d40 msgr2=0x7ff04c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff06894e640 1 --2- 172.21.15.66:0/3507386859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04c004d40 0x7ff04c0051c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff05c001050 tx=0x7ff04c005830 comp rx=0 tx=0).stop 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff062d9d640 1 -- 172.21.15.66:0/3507386859 reap_dead start 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff06894e640 1 -- 172.21.15.66:0/3507386859 shutdown_connections 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff06894e640 1 -- 172.21.15.66:0/3507386859 >> 172.21.15.66:0/3507386859 conn(0x7ff06409e380 msgr2=0x7ff0640d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff06894e640 1 -- 172.21.15.66:0/3507386859 shutdown_connections 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.916+0000 7ff06894e640 1 -- 172.21.15.66:0/3507386859 wait complete. 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.917+0000 7ff06894e640 1 Processor -- start 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.917+0000 7ff06894e640 1 -- start start 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06894e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c004d40 0x7ff0640cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06894e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 0x7ff0640b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06894e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0640b2de0 0x7ff0640b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06894e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0640d2390 con 0x7ff0640b2960 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06894e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff0640cfc50 con 0x7ff04c004d40 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06894e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff0640d2510 con 0x7ff0640b2de0 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff061d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 0x7ff0640b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff061d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 0x7ff0640b8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50876/0 (socket says 172.21.15.66:50876) 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff061d9b640 1 -- 172.21.15.66:0/888342968 learned_addr learned my addr 172.21.15.66:0/888342968 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff062d9d640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0640b2de0 0x7ff0640b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.918+0000 7ff06259c640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c004d40 0x7ff0640cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff061d9b640 1 -- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0640b2de0 msgr2=0x7ff0640b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff061d9b640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0640b2de0 0x7ff0640b91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff061d9b640 1 -- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c004d40 msgr2=0x7ff0640cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff061d9b640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c004d40 0x7ff0640cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff061d9b640 1 -- 172.21.15.66:0/888342968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0640cd980 con 0x7ff0640b2960 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff062d9d640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0640b2de0 0x7ff0640b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff061d9b640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 0x7ff0640b8c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff058011940 tx=0x7ff058011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:52.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05800faf0 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05800fcb0 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0640cdc60 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058014680 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.919+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0640ce220 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.920+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06406a220 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.921+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff058012040 con 0x7ff0640b2960 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.921+0000 7ff052ffd640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0440762d0 0x7ff044078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:52.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.922+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7ff058097be0 con 0x7ff0640b2960 2024-05-10T11:14:52.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.922+0000 7ff06259c640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0440762d0 0x7ff044078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:52.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.922+0000 7ff06259c640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0440762d0 0x7ff044078790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff054007520 tx=0x7ff05400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:52.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:52.926+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff058019030 con 0x7ff0640b2960 2024-05-10T11:14:53.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.156+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0640cbd20 con 0x7ff0640b2960 2024-05-10T11:14:53.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.156+0000 7ff052ffd640 1 -- 172.21.15.66:0/888342968 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3869 (secure 0 0 0) 0x7ff05800fe60 con 0x7ff0640b2960 2024-05-10T11:14:53.157 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:53.157 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/771911726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":771911726},{"type":"v1","addr":"172.21.15.66:6834","nonce":771911726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2101462065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2101462065},{"type":"v1","addr":"172.21.15.190:6836","nonce":2101462065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/119045276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":119045276},{"type":"v1","addr":"172.21.15.190:6837","nonce":119045276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3480940934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3480940934},{"type":"v1","addr":"172.21.15.66:6835","nonce":3480940934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-05-10T11:14:53.157 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0440762d0 msgr2=0x7ff044078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0440762d0 0x7ff044078790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff054007520 tx=0x7ff05400b040 comp rx=0 tx=0).stop 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 msgr2=0x7ff0640b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 0x7ff0640b8c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff058011940 tx=0x7ff058011e00 comp rx=0 tx=0).stop 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 shutdown_connections 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0440762d0 0x7ff044078790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0640b2de0 0x7ff0640b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0640b2960 0x7ff0640b8c90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 --2- 172.21.15.66:0/888342968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c004d40 0x7ff0640cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 >> 172.21.15.66:0/888342968 conn(0x7ff06409e380 msgr2=0x7ff0640b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:53.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 shutdown_connections 2024-05-10T11:14:53.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.158+0000 7ff06894e640 1 -- 172.21.15.66:0/888342968 wait complete. 2024-05-10T11:14:53.170 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:14:53.170 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:14:53.171 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:14:53.171 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:14:53.171 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:14:53.171 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:14:53.171 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:14:53.171 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:14:53.171 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:14:53.172 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:14:53.172 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:14:53.172 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:14:53.172 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:14:53.172 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:14:53.172 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:14:53.172 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:14:53.180 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:14:53.180 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:14:53.181 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:14:53.181 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:14:53.185 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:14:53.185 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:14:53.185 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:14:53.186 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:14:53.223 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:14:53.223 DEBUG:teuthology.parallel:result is None 2024-05-10T11:14:53.223 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:14:53.223 DEBUG:teuthology.parallel:result is None 2024-05-10T11:14:53.228 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:14:53.228 DEBUG:teuthology.parallel:result is None 2024-05-10T11:14:53.229 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:14:53.229 DEBUG:teuthology.parallel:result is None 2024-05-10T11:14:53.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:14:53.302 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:14:53.302 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:14:53.314 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:14:53.314 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:14:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.338+0000 7f1032d14640 1 Processor -- start 2024-05-10T11:14:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.338+0000 7f1032d14640 1 -- start start 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1032d14640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c15d290 0x7f102c071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1032d14640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f102c071880 0x7f102c0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1032d14640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102c072330 con 0x7f102c0d1aa0 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1032d14640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f102c071d70 con 0x7f102c071880 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1032d14640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f102c072050 con 0x7f102c15d290 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f10312b1640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f102c0d1aa0 0x7f102c0cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49758/0 (socket says 172.21.15.66:49758) 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f10312b1640 1 -- 172.21.15.66:0/1844148009 learned_addr learned my addr 172.21.15.66:0/1844148009 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1030ab0640 1 --2- 172.21.15.66:0/1844148009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c15d290 0x7f102c071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f102bfff640 1 --2- 172.21.15.66:0/1844148009 >> v2:172.21.15.190:3300/0 conn(0x7f102c071880 0x7f102c0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f102b7fe640 1 -- 172.21.15.66:0/1844148009 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885184898 0 0) 0x7f102c072330 con 0x7f102c0d1aa0 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f102b7fe640 1 -- 172.21.15.66:0/1844148009 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101c003520 con 0x7f102c0d1aa0 2024-05-10T11:14:53.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1030ab0640 1 -- 172.21.15.66:0/1844148009 >> v2:172.21.15.190:3300/0 conn(0x7f102c071880 msgr2=0x7f102c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:53.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1030ab0640 1 --2- 172.21.15.66:0/1844148009 >> v2:172.21.15.190:3300/0 conn(0x7f102c071880 0x7f102c0d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1030ab0640 1 -- 172.21.15.66:0/1844148009 >> v1:172.21.15.66:6789/0 conn(0x7f102c0d1aa0 legacy=0x7f102c0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:53.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f1030ab0640 1 -- 172.21.15.66:0/1844148009 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0cda70 con 0x7f102c15d290 2024-05-10T11:14:53.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.339+0000 7f102bfff640 1 --2- 172.21.15.66:0/1844148009 >> v2:172.21.15.190:3300/0 conn(0x7f102c071880 0x7f102c0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.340+0000 7f1030ab0640 1 --2- 172.21.15.66:0/1844148009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c15d290 0x7f102c071340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10200097a0 tx=0x7f102002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a8e6726ec085ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.340+0000 7f102b7fe640 1 -- 172.21.15.66:0/1844148009 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020037070 con 0x7f102c15d290 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.340+0000 7f102b7fe640 1 -- 172.21.15.66:0/1844148009 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1020032440 con 0x7f102c15d290 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.340+0000 7f102b7fe640 1 -- 172.21.15.66:0/1844148009 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020032810 con 0x7f102c15d290 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 -- 172.21.15.66:0/1844148009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c15d290 msgr2=0x7f102c071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 --2- 172.21.15.66:0/1844148009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c15d290 0x7f102c071340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10200097a0 tx=0x7f102002a180 comp rx=0 tx=0).stop 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 -- 172.21.15.66:0/1844148009 shutdown_connections 2024-05-10T11:14:53.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 --2- 172.21.15.66:0/1844148009 >> v2:172.21.15.190:3300/0 conn(0x7f102c071880 0x7f102c0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 --2- 172.21.15.66:0/1844148009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c15d290 0x7f102c071340 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 -- 172.21.15.66:0/1844148009 >> 172.21.15.66:0/1844148009 conn(0x7f102c09ba20 msgr2=0x7f102c09be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:53.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 -- 172.21.15.66:0/1844148009 shutdown_connections 2024-05-10T11:14:53.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.341+0000 7f1032d14640 1 -- 172.21.15.66:0/1844148009 wait complete. 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.342+0000 7f1032d14640 1 Processor -- start 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.342+0000 7f1032d14640 1 -- start start 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1032d14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 0x7f102c1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1032d14640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0d1aa0 0x7f102c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1032d14640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c15d290 0x7f102c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1032d14640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0cf400 con 0x7f102c071880 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1032d14640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0cf280 con 0x7f102c15d290 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1032d14640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f102c0cf580 con 0x7f102c0d1aa0 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1030ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 0x7f102c1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1030ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 0x7f102c1493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50914/0 (socket says 172.21.15.66:50914) 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f1030ab0640 1 -- 172.21.15.66:0/2682117032 learned_addr learned my addr 172.21.15.66:0/2682117032 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:53.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f10312b1640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c15d290 0x7f102c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.343+0000 7f102bfff640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0d1aa0 0x7f102c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1030ab0640 1 -- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0d1aa0 msgr2=0x7f102c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1030ab0640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0d1aa0 0x7f102c0c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1030ab0640 1 -- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c15d290 msgr2=0x7f102c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1030ab0640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c15d290 0x7f102c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1030ab0640 1 -- 172.21.15.66:0/2682117032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0c8210 con 0x7f102c071880 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1030ab0640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 0x7f102c1493f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1020035040 tx=0x7f10200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020041030 con 0x7f102c071880 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102003d4e0 con 0x7f102c071880 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020037040 con 0x7f102c071880 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102c0c84f0 con 0x7f102c071880 2024-05-10T11:14:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.344+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f102c0c8ab0 con 0x7f102c071880 2024-05-10T11:14:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.345+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102c0c8ef0 con 0x7f102c071880 2024-05-10T11:14:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.346+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1020044070 con 0x7f102c071880 2024-05-10T11:14:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.346+0000 7f10297fa640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f10100762d0 0x7f1010078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.346+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f10200b79d0 con 0x7f102c071880 2024-05-10T11:14:53.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.346+0000 7f102bfff640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f10100762d0 0x7f1010078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:53.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.347+0000 7f102bfff640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f10100762d0 0x7f1010078790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1018009560 tx=0x7f1018009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:53.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.351+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1020080e60 con 0x7f102c071880 2024-05-10T11:14:53.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:53.555+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f102c0c8ef0 con 0x7f102c071880 2024-05-10T11:14:54.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.256+0000 7f10297fa640 1 -- 172.21.15.66:0/2682117032 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f1020085160 con 0x7f102c071880 2024-05-10T11:14:54.257 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:14:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f10100762d0 msgr2=0x7f1010078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f10100762d0 0x7f1010078790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1018009560 tx=0x7f1018009190 comp rx=0 tx=0).stop 2024-05-10T11:14:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 msgr2=0x7f102c1493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 0x7f102c1493f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1020035040 tx=0x7f10200046c0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 shutdown_connections 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f10100762d0 0x7f1010078790 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c15d290 0x7f102c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0d1aa0 0x7f102c0c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 --2- 172.21.15.66:0/2682117032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f102c071880 0x7f102c1493f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 >> 172.21.15.66:0/2682117032 conn(0x7f102c09ba20 msgr2=0x7f102c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 shutdown_connections 2024-05-10T11:14:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.260+0000 7f1032d14640 1 -- 172.21.15.66:0/2682117032 wait complete. 2024-05-10T11:14:54.275 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:14:54.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.385+0000 7f8000951640 1 Processor -- start 2024-05-10T11:14:54.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.385+0000 7f8000951640 1 -- start start 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f8000951640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7ffc0cb300 0x7f7ffc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f8000951640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ffc0cd090 con 0x7f7ffc1611e0 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f8000951640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ffc0cd370 con 0x7f7ffc15ce60 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f8000951640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7ffc0cb790 con 0x7f7ffc0cb300 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ff9d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7ffc1611e0 0x7f7ffc15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49760/0 (socket says 172.21.15.66:49760) 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ffad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7ffc0cb300 0x7f7ffc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ff9d9b640 1 -- 172.21.15.66:0/3560846864 learned_addr learned my addr 172.21.15.66:0/3560846864 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ff959a640 1 -- 172.21.15.66:0/3560846864 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208283969 0 0) 0x7f7ffc0cd090 con 0x7f7ffc1611e0 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ff959a640 1 -- 172.21.15.66:0/3560846864 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe4003520 con 0x7f7ffc1611e0 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ffad9d640 1 -- 172.21.15.66:0/3560846864 >> v1:172.21.15.190:6789/0 conn(0x7f7ffc15ce60 legacy=0x7f7ffc160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ffad9d640 1 -- 172.21.15.66:0/3560846864 >> v1:172.21.15.66:6789/0 conn(0x7f7ffc1611e0 legacy=0x7f7ffc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.386+0000 7f7ffad9d640 1 -- 172.21.15.66:0/3560846864 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc0cd650 con 0x7f7ffc0cb300 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.387+0000 7f7ffad9d640 1 --2- 172.21.15.66:0/3560846864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0c65f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b04b21fd68623d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.387+0000 7f7ff959a640 1 -- 172.21.15.66:0/3560846864 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4007740 con 0x7f7ffc0cb300 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.387+0000 7f7ff959a640 1 -- 172.21.15.66:0/3560846864 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff40078e0 con 0x7f7ffc0cb300 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.387+0000 7f7ff959a640 1 -- 172.21.15.66:0/3560846864 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4007cb0 con 0x7f7ffc0cb300 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 -- 172.21.15.66:0/3560846864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 msgr2=0x7f7ffc0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 --2- 172.21.15.66:0/3560846864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0c65f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff402a660 comp rx=0 tx=0).stop 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 -- 172.21.15.66:0/3560846864 shutdown_connections 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 --2- 172.21.15.66:0/3560846864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0c65f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 -- 172.21.15.66:0/3560846864 >> 172.21.15.66:0/3560846864 conn(0x7f7ffc0b2900 msgr2=0x7f7ffc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 -- 172.21.15.66:0/3560846864 shutdown_connections 2024-05-10T11:14:54.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.388+0000 7f8000951640 1 -- 172.21.15.66:0/3560846864 wait complete. 2024-05-10T11:14:54.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.389+0000 7f8000951640 1 Processor -- start 2024-05-10T11:14:54.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.389+0000 7f8000951640 1 -- start start 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f8000951640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f8000951640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ffc15ce60 0x7f7ffc0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f8000951640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ffc1611e0 0x7f7ffc09e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f8000951640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0cde50 con 0x7f7ffc0cb300 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f8000951640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0ccd60 con 0x7f7ffc15ce60 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f8000951640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc0cdfd0 con 0x7f7ffc1611e0 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f7ffa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f7ffa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50932/0 (socket says 172.21.15.66:50932) 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f7ffa59c640 1 -- 172.21.15.66:0/819091398 learned_addr learned my addr 172.21.15.66:0/819091398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f7ff9d9b640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ffc15ce60 0x7f7ffc0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.390+0000 7f7ffad9d640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ffc1611e0 0x7f7ffc09e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7ffa59c640 1 -- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ffc1611e0 msgr2=0x7f7ffc09e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7ffa59c640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ffc1611e0 0x7f7ffc09e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7ffa59c640 1 -- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ffc15ce60 msgr2=0x7f7ffc0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7ffa59c640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ffc15ce60 0x7f7ffc0cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7ffa59c640 1 -- 172.21.15.66:0/819091398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc0b0080 con 0x7f7ffc0cb300 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7ffa59c640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0b53d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c400 tx=0x7f7fec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0052d0 con 0x7f7ffc0cb300 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fec005490 con 0x7f7ffc0cb300 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc0b0360 con 0x7f7ffc0cb300 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec007260 con 0x7f7ffc0cb300 2024-05-10T11:14:54.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.391+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc0b0920 con 0x7f7ffc0cb300 2024-05-10T11:14:54.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.392+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc06a220 con 0x7f7ffc0cb300 2024-05-10T11:14:54.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.393+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fec007400 con 0x7f7ffc0cb300 2024-05-10T11:14:54.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.393+0000 7f7feaffd640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fdc0762d0 0x7f7fdc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.393+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f7fec096830 con 0x7f7ffc0cb300 2024-05-10T11:14:54.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.394+0000 7f7ff9d9b640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fdc0762d0 0x7f7fdc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.394+0000 7f7ff9d9b640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fdc0762d0 0x7f7fdc078790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0b64c0 tx=0x7f7ff0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:54.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.398+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7fec05fd90 con 0x7f7ffc0cb300 2024-05-10T11:14:54.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.660+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7ffc0ce8d0 con 0x7f7ffc0cb300 2024-05-10T11:14:54.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.661+0000 7f7feaffd640 1 -- 172.21.15.66:0/819091398 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f7fec0683d0 con 0x7f7ffc0cb300 2024-05-10T11:14:54.712 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.713 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.714 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.715 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.716 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.717 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.718 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.719 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.720 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.721 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow r", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:14:54.722 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:14:54.723 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:14:54.724 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:14:54.725 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:14:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:14:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:14:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:14:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:14:54.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fdc0762d0 msgr2=0x7f7fdc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fdc0762d0 0x7f7fdc078790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0b64c0 tx=0x7f7ff0007d30 comp rx=0 tx=0).stop 2024-05-10T11:14:54.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 msgr2=0x7f7ffc0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0b53d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c400 tx=0x7f7fec00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 shutdown_connections 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7fdc0762d0 0x7f7fdc078790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ffc1611e0 0x7f7ffc09e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ffc15ce60 0x7f7ffc0cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 --2- 172.21.15.66:0/819091398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ffc0cb300 0x7f7ffc0b53d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 >> 172.21.15.66:0/819091398 conn(0x7f7ffc0b2900 msgr2=0x7f7ffc15fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 shutdown_connections 2024-05-10T11:14:54.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.663+0000 7f8000951640 1 -- 172.21.15.66:0/819091398 wait complete. 2024-05-10T11:14:54.729 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:14:54.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.832+0000 7f3ae63c8640 1 Processor -- start 2024-05-10T11:14:54.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.832+0000 7f3ae63c8640 1 -- start start 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae63c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00c6c80 0x7f3ae00c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae63c8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ae00cee40 0x7f3ae00cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae63c8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae006f1c0 con 0x7f3ae01598c0 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae63c8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae00c7620 con 0x7f3ae00cee40 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae63c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae006f4a0 con 0x7f3ae00c6c80 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae4965640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ae00cee40 0x7f3ae00cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae4965640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ae00cee40 0x7f3ae00cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42656/0 (socket says 172.21.15.66:42656) 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.833+0000 7f3ae4965640 1 -- 172.21.15.66:0/1417815798 learned_addr learned my addr 172.21.15.66:0/1417815798 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3adf7fe640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00c6c80 0x7f3ae00c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3ae4965640 1 -- 172.21.15.66:0/1417815798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00c6c80 msgr2=0x7f3ae00c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:54.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3ae4965640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00c6c80 0x7f3ae00c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3ae4965640 1 -- 172.21.15.66:0/1417815798 >> v1:172.21.15.190:6789/0 conn(0x7f3ae01598c0 legacy=0x7f3ae006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3ae4965640 1 -- 172.21.15.66:0/1417815798 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae006f780 con 0x7f3ae00cee40 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3adf7fe640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00c6c80 0x7f3ae00c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.834+0000 7f3ae4965640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae00cee40 0x7f3ae00cf2d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800d150 tx=0x7f3ad802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671009c6ffa55a7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3adeffd640 1 -- 172.21.15.66:0/1417815798 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800b2e0 con 0x7f3ae00cee40 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3adeffd640 1 -- 172.21.15.66:0/1417815798 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad8009600 con 0x7f3ae00cee40 2024-05-10T11:14:54.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3adeffd640 1 -- 172.21.15.66:0/1417815798 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800b480 con 0x7f3ae00cee40 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 -- 172.21.15.66:0/1417815798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae00cee40 msgr2=0x7f3ae00cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae00cee40 0x7f3ae00cf2d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800d150 tx=0x7f3ad802c8e0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 -- 172.21.15.66:0/1417815798 shutdown_connections 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae00cee40 0x7f3ae00cf2d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/1417815798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00c6c80 0x7f3ae00c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 -- 172.21.15.66:0/1417815798 >> 172.21.15.66:0/1417815798 conn(0x7f3ae00b2900 msgr2=0x7f3ae00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 -- 172.21.15.66:0/1417815798 shutdown_connections 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.835+0000 7f3ae63c8640 1 -- 172.21.15.66:0/1417815798 wait complete. 2024-05-10T11:14:54.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.836+0000 7f3ae63c8640 1 Processor -- start 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 -- start start 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ae00c6c80 0x7f3ae015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00cee40 0x7f3ae01f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 0x7f3ae01f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae015c6e0 con 0x7f3ae01598c0 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae00ce920 con 0x7f3ae00c6c80 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae63c8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae006ee10 con 0x7f3ae00cee40 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae4965640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 0x7f3ae01f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae4965640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 0x7f3ae01f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42670/0 (socket says 172.21.15.66:42670) 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.837+0000 7f3ae4965640 1 -- 172.21.15.66:0/751162954 learned_addr learned my addr 172.21.15.66:0/751162954 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3adffff640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ae00c6c80 0x7f3ae015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3adf7fe640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00cee40 0x7f3ae01f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae4965640 1 -- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00cee40 msgr2=0x7f3ae01f85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae4965640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00cee40 0x7f3ae01f85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae4965640 1 -- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ae00c6c80 msgr2=0x7f3ae015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae4965640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ae00c6c80 0x7f3ae015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae4965640 1 -- 172.21.15.66:0/751162954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae015bb30 con 0x7f3ae01598c0 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3adf7fe640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00cee40 0x7f3ae01f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae4965640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 0x7f3ae01f8b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800d270 tx=0x7f3ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8042070 con 0x7f3ae01598c0 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad803c860 con 0x7f3ae01598c0 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae015be10 con 0x7f3ae01598c0 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad803cc50 con 0x7f3ae01598c0 2024-05-10T11:14:54.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.838+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae0073e70 con 0x7f3ae01598c0 2024-05-10T11:14:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.839+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae006a220 con 0x7f3ae01598c0 2024-05-10T11:14:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.840+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ad8045070 con 0x7f3ae01598c0 2024-05-10T11:14:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.840+0000 7f3adcff9640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3acc0762d0 0x7f3acc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:54.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.841+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f3ad8030020 con 0x7f3ae01598c0 2024-05-10T11:14:54.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.841+0000 7f3adffff640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3acc0762d0 0x7f3acc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:54.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.841+0000 7f3adffff640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3acc0762d0 0x7f3acc078790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000a750 tx=0x7f3ad0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:54.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:54.845+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3ad804c030 con 0x7f3ae01598c0 2024-05-10T11:14:55.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.041+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ae006e4e0 con 0x7f3ae01598c0 2024-05-10T11:14:55.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.041+0000 7f3adcff9640 1 -- 172.21.15.66:0/751162954 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f3ad8081750 con 0x7f3ae01598c0 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:14:55.042 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:14:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.043+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3acc0762d0 msgr2=0x7f3acc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.043+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3acc0762d0 0x7f3acc078790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000a750 tx=0x7f3ad0008040 comp rx=0 tx=0).stop 2024-05-10T11:14:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.043+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 msgr2=0x7f3ae01f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.043+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 0x7f3ae01f8b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800d270 tx=0x7f3ad8004a40 comp rx=0 tx=0).stop 2024-05-10T11:14:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 shutdown_connections 2024-05-10T11:14:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3acc0762d0 0x7f3acc078790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae01598c0 0x7f3ae01f8b00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ae00cee40 0x7f3ae01f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 --2- 172.21.15.66:0/751162954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ae00c6c80 0x7f3ae015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 >> 172.21.15.66:0/751162954 conn(0x7f3ae00b2900 msgr2=0x7f3ae0157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:55.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 shutdown_connections 2024-05-10T11:14:55.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.044+0000 7f3ae63c8640 1 -- 172.21.15.66:0/751162954 wait complete. 2024-05-10T11:14:55.055 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:14:55.055 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:14:55.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.163+0000 7f890b4e8640 1 Processor -- start 2024-05-10T11:14:55.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.163+0000 7f890b4e8640 1 -- start start 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f890b4e8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f89040d5ca0 0x7f89040d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f890b4e8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89040d1080 con 0x7f89040d3d50 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f890b4e8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89040b4820 con 0x7f890415f490 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f890b4e8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f89040b4e70 con 0x7f89040d5ca0 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f8908a83640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f89040d3d50 0x7f89040b5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49358/0 (socket says 172.21.15.66:49358) 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f8908a83640 1 -- 172.21.15.66:0/759846673 learned_addr learned my addr 172.21.15.66:0/759846673 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f8909a85640 1 --2- 172.21.15.66:0/759846673 >> v2:172.21.15.190:3300/0 conn(0x7f89040d5ca0 0x7f89040d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061039486 0 0) 0x7f89040d1080 con 0x7f89040d3d50 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88f0003520 con 0x7f89040d3d50 2024-05-10T11:14:55.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 177014670 0 0) 0x7f88f0003520 con 0x7f89040d3d50 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 >> v2:172.21.15.190:3300/0 conn(0x7f89040d5ca0 msgr2=0x7f89040d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 --2- 172.21.15.66:0/759846673 >> v2:172.21.15.190:3300/0 conn(0x7f89040d5ca0 0x7f89040d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 >> v1:172.21.15.190:6789/0 conn(0x7f890415f490 legacy=0x7f89040d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89040b4b00 con 0x7f89040d3d50 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f88f4001670 con 0x7f89040d3d50 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 >> v1:172.21.15.66:6789/0 conn(0x7f89040d3d50 legacy=0x7f89040b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88f0004800 0x7f88f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.164+0000 7f88fbfff640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88f00051c0 0x7f88f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f89040b4e70 con 0x7f88f00039b0 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f88f000c160 con 0x7f88f0004800 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f88f000c360 con 0x7f88f00051c0 2024-05-10T11:14:55.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909284640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909a85640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88f00051c0 0x7f88f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8908a83640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88f0004800 0x7f88f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909284640 1 -- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88f00051c0 msgr2=0x7f88f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909284640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88f00051c0 0x7f88f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909284640 1 -- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88f0004800 msgr2=0x7f88f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909284640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88f0004800 0x7f88f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909284640 1 -- 172.21.15.66:0/759846673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f0003520 con 0x7f88f00039b0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.165+0000 7f8909a85640 1 -- 172.21.15.66:0/759846673 reap_dead start 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f8909284640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8900001750 tx=0x7f88f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b6854da2fcfe0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900001370 con 0x7f88f00039b0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89000052d0 con 0x7f88f00039b0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f88fbfff640 1 -- 172.21.15.66:0/759846673 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890002abe0 con 0x7f88f00039b0 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 -- 172.21.15.66:0/759846673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 msgr2=0x7f88f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8900001750 tx=0x7f88f0005830 comp rx=0 tx=0).stop 2024-05-10T11:14:55.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 -- 172.21.15.66:0/759846673 shutdown_connections 2024-05-10T11:14:55.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 --2- 172.21.15.66:0/759846673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 -- 172.21.15.66:0/759846673 >> 172.21.15.66:0/759846673 conn(0x7f89040d50f0 msgr2=0x7f89040d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:55.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 -- 172.21.15.66:0/759846673 shutdown_connections 2024-05-10T11:14:55.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.166+0000 7f890b4e8640 1 -- 172.21.15.66:0/759846673 wait complete. 2024-05-10T11:14:55.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 Processor -- start 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 -- start start 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f89040b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89041625a0 0x7f890415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89041611f0 0x7f8904161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f89040d2f60 con 0x7f88f00039b0 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f890415fa80 con 0x7f89041611f0 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f890b4e8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f89040d30e0 con 0x7f89041625a0 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f8909284640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f89040b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f8909284640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f89040b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42688/0 (socket says 172.21.15.66:42688) 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.168+0000 7f8909284640 1 -- 172.21.15.66:0/1368714010 learned_addr learned my addr 172.21.15.66:0/1368714010 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f8909284640 1 -- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89041625a0 msgr2=0x7f890415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f8909284640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89041625a0 0x7f890415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f8909284640 1 -- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89041611f0 msgr2=0x7f8904161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f8909284640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89041611f0 0x7f8904161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f8909284640 1 -- 172.21.15.66:0/1368714010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89040b8380 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f8909284640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f89040b7ca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f890002a590 tx=0x7f8900001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890003f030 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8900005480 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89040b8660 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900037040 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.169+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89040cc4a0 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.170+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890406a220 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.171+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8900042070 con 0x7f88f00039b0 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.171+0000 7f88f9ffb640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88e80762d0 0x7f88e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.171+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f8900007640 con 0x7f88f00039b0 2024-05-10T11:14:55.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.172+0000 7f8908a83640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88e80762d0 0x7f88e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:55.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.172+0000 7f8908a83640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88e80762d0 0x7f88e8078790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f89041f8a40 tx=0x7f88f4000ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:55.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.176+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f89000805d0 con 0x7f88f00039b0 2024-05-10T11:14:55.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:55.369+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f89040cf5b0 con 0x7f88f00039b0 2024-05-10T11:14:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.260+0000 7f88f9ffb640 1 -- 172.21.15.66:0/1368714010 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7f890007fed0 con 0x7f88f00039b0 2024-05-10T11:14:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:14:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.263+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88e80762d0 msgr2=0x7f88e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.263+0000 7f890b4e8640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88e80762d0 0x7f88e8078790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f89041f8a40 tx=0x7f88f4000ef0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.263+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 msgr2=0x7f89040b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.263+0000 7f890b4e8640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f89040b7ca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f890002a590 tx=0x7f8900001120 comp rx=0 tx=0).stop 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 shutdown_connections 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f88e80762d0 0x7f88e8078790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89041611f0 0x7f8904161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89041625a0 0x7f890415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 --2- 172.21.15.66:0/1368714010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f00039b0 0x7f89040b7ca0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 >> 172.21.15.66:0/1368714010 conn(0x7f89040d50f0 msgr2=0x7f89040b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 shutdown_connections 2024-05-10T11:14:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.264+0000 7f890b4e8640 1 -- 172.21.15.66:0/1368714010 wait complete. 2024-05-10T11:14:56.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:14:56.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 Processor -- start 2024-05-10T11:14:56.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 -- start start 2024-05-10T11:14:56.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f099c0d1480 0x7f099c0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:56.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f099c0b0f00 0x7f099c0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:56.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c0cd9b0 con 0x7f099c15d190 2024-05-10T11:14:56.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f099c0d1e20 con 0x7f099c0b0f00 2024-05-10T11:14:56.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.398+0000 7f09a2f90640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f099c0afe60 con 0x7f099c0d1480 2024-05-10T11:14:56.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a152d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f099c0b0f00 0x7f099c0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a0d2c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f099c15d190 0x7f099c0b3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49360/0 (socket says 172.21.15.66:49360) 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a0d2c640 1 -- 172.21.15.66:0/1682773975 learned_addr learned my addr 172.21.15.66:0/1682773975 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f099bfff640 1 --2- 172.21.15.66:0/1682773975 >> v2:172.21.15.190:3300/0 conn(0x7f099c0d1480 0x7f099c0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a152d640 1 -- 172.21.15.66:0/1682773975 >> v2:172.21.15.190:3300/0 conn(0x7f099c0d1480 msgr2=0x7f099c0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a152d640 1 --2- 172.21.15.66:0/1682773975 >> v2:172.21.15.190:3300/0 conn(0x7f099c0d1480 0x7f099c0d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a152d640 1 -- 172.21.15.66:0/1682773975 >> v1:172.21.15.66:6789/0 conn(0x7f099c15d190 legacy=0x7f099c0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f09a152d640 1 -- 172.21.15.66:0/1682773975 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c0b0140 con 0x7f099c0b0f00 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f099b7fe640 1 -- 172.21.15.66:0/1682773975 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676292627 0 0) 0x7f0990001290 con 0x7f099c15d190 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.399+0000 7f099bfff640 1 --2- 172.21.15.66:0/1682773975 >> v2:172.21.15.190:3300/0 conn(0x7f099c0d1480 0x7f099c0d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a152d640 1 --2- 172.21.15.66:0/1682773975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0b0f00 0x7f099c0b1390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f099c074400 tx=0x7f099402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e567fd1a8697769c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f099b7fe640 1 -- 172.21.15.66:0/1682773975 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994007740 con 0x7f099c0b0f00 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f099b7fe640 1 -- 172.21.15.66:0/1682773975 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09940078e0 con 0x7f099c0b0f00 2024-05-10T11:14:56.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f099b7fe640 1 -- 172.21.15.66:0/1682773975 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994007cb0 con 0x7f099c0b0f00 2024-05-10T11:14:56.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a2f90640 1 -- 172.21.15.66:0/1682773975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0b0f00 msgr2=0x7f099c0b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:56.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a2f90640 1 --2- 172.21.15.66:0/1682773975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0b0f00 0x7f099c0b1390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f099c074400 tx=0x7f099402a680 comp rx=0 tx=0).stop 2024-05-10T11:14:56.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a2f90640 1 -- 172.21.15.66:0/1682773975 shutdown_connections 2024-05-10T11:14:56.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a2f90640 1 --2- 172.21.15.66:0/1682773975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0b0f00 0x7f099c0b1390 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a2f90640 1 --2- 172.21.15.66:0/1682773975 >> v2:172.21.15.190:3300/0 conn(0x7f099c0d1480 0x7f099c0d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.400+0000 7f09a2f90640 1 -- 172.21.15.66:0/1682773975 >> 172.21.15.66:0/1682773975 conn(0x7f099c09ba20 msgr2=0x7f099c09be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.401+0000 7f09a2f90640 1 -- 172.21.15.66:0/1682773975 shutdown_connections 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.401+0000 7f09a2f90640 1 -- 172.21.15.66:0/1682773975 wait complete. 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.402+0000 7f09a2f90640 1 Processor -- start 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.402+0000 7f09a2f90640 1 -- start start 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f099c0b0f00 0x7f099c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 0x7f099c15e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f099c15d190 0x7f099c1eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0b09e0 con 0x7f099c0d1480 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0b0700 con 0x7f099c0b0f00 2024-05-10T11:14:56.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f099c0afaf0 con 0x7f099c15d190 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 0x7f099c15e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 0x7f099c15e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42714/0 (socket says 172.21.15.66:42714) 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 -- 172.21.15.66:0/487933965 learned_addr learned my addr 172.21.15.66:0/487933965 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a0d2c640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f099c0b0f00 0x7f099c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a152d640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f099c15d190 0x7f099c1eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 -- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f099c15d190 msgr2=0x7f099c1eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f099c15d190 0x7f099c1eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 -- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f099c0b0f00 msgr2=0x7f099c0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f099c0b0f00 0x7f099c0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 -- 172.21.15.66:0/487933965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c15f040 con 0x7f099c0d1480 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a152d640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f099c15d190 0x7f099c1eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a0d2c640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f099c0b0f00 0x7f099c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f099bfff640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 0x7f099c15e5c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f098800e810 tx=0x7f098800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098800f040 con 0x7f099c0d1480 2024-05-10T11:14:56.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0988004030 con 0x7f099c0d1480 2024-05-10T11:14:56.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988004400 con 0x7f099c0d1480 2024-05-10T11:14:56.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.403+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c15f320 con 0x7f099c0d1480 2024-05-10T11:14:56.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.404+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c15f8e0 con 0x7f099c0d1480 2024-05-10T11:14:56.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.404+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c0693f0 con 0x7f099c0d1480 2024-05-10T11:14:56.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.405+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f098800c6d0 con 0x7f099c0d1480 2024-05-10T11:14:56.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.406+0000 7f09997fa640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0980076300 0x7f09800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:56.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.406+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5619+0+0 (secure 0 0 0) 0x7f0988097300 con 0x7f099c0d1480 2024-05-10T11:14:56.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.406+0000 7f09a0d2c640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0980076300 0x7f09800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:56.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.406+0000 7f09a0d2c640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0980076300 0x7f09800787c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f09900017a0 tx=0x7f0990009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:56.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.410+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0988017020 con 0x7f099c0d1480 2024-05-10T11:14:56.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:56.601+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f099c0b8cb0 con 0x7f099c0d1480 2024-05-10T11:14:57.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.263+0000 7f09997fa640 1 -- 172.21.15.66:0/487933965 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7f0988060cb0 con 0x7f099c0d1480 2024-05-10T11:14:57.263 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0980076300 msgr2=0x7f09800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0980076300 0x7f09800787c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f09900017a0 tx=0x7f0990009040 comp rx=0 tx=0).stop 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 msgr2=0x7f099c15e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 0x7f099c15e5c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f098800e810 tx=0x7f098800ecd0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 shutdown_connections 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0980076300 0x7f09800787c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f099c15d190 0x7f099c1eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f099c0d1480 0x7f099c15e5c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 --2- 172.21.15.66:0/487933965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f099c0b0f00 0x7f099c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.266+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 >> 172.21.15.66:0/487933965 conn(0x7f099c09ba20 msgr2=0x7f099c158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:57.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.267+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 shutdown_connections 2024-05-10T11:14:57.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.267+0000 7f09a2f90640 1 -- 172.21.15.66:0/487933965 wait complete. 2024-05-10T11:14:57.291 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:14:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 Processor -- start 2024-05-10T11:14:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 -- start start 2024-05-10T11:14:57.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c15f410 0x7f7f2c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:57.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7f2c0d0f10 0x7f7f2c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2c0d2800 con 0x7f7f2c0b54d0 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c0d2ae0 con 0x7f7f2c0d0f10 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.403+0000 7f7f31ff7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0d01d0 con 0x7f7f2c15f410 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7f2c0d0f10 0x7f7f2c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7f2c0d0f10 0x7f7f2c0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42720/0 (socket says 172.21.15.66:42720) 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 -- 172.21.15.66:0/2613875141 learned_addr learned my addr 172.21.15.66:0/2613875141 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2b7fe640 1 --2- 172.21.15.66:0/2613875141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c15f410 0x7f7f2c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 -- 172.21.15.66:0/2613875141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c15f410 msgr2=0x7f7f2c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 --2- 172.21.15.66:0/2613875141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c15f410 0x7f7f2c0d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 -- 172.21.15.66:0/2613875141 >> v1:172.21.15.190:6789/0 conn(0x7f7f2c0b54d0 legacy=0x7f7f2c0d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.404+0000 7f7f2affd640 1 -- 172.21.15.66:0/2613875141 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c0d04b0 con 0x7f7f2c0d0f10 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f2affd640 1 --2- 172.21.15.66:0/2613875141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c0b4f90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009870 tx=0x7f7f2002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d7649df6c0f722 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f2a7fc640 1 -- 172.21.15.66:0/2613875141 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20037070 con 0x7f7f2c0d0f10 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f2a7fc640 1 -- 172.21.15.66:0/2613875141 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f20032440 con 0x7f7f2c0d0f10 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f2a7fc640 1 -- 172.21.15.66:0/2613875141 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20032810 con 0x7f7f2c0d0f10 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f31ff7640 1 -- 172.21.15.66:0/2613875141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c0d0f10 msgr2=0x7f7f2c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/2613875141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c0b4f90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009870 tx=0x7f7f2002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f31ff7640 1 -- 172.21.15.66:0/2613875141 shutdown_connections 2024-05-10T11:14:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/2613875141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c0b4f90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/2613875141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c15f410 0x7f7f2c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.405+0000 7f7f31ff7640 1 -- 172.21.15.66:0/2613875141 >> 172.21.15.66:0/2613875141 conn(0x7f7f2c08ed30 msgr2=0x7f7f2c09e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.406+0000 7f7f31ff7640 1 -- 172.21.15.66:0/2613875141 shutdown_connections 2024-05-10T11:14:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.406+0000 7f7f31ff7640 1 -- 172.21.15.66:0/2613875141 wait complete. 2024-05-10T11:14:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.407+0000 7f7f31ff7640 1 Processor -- start 2024-05-10T11:14:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.407+0000 7f7f31ff7640 1 -- start start 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c0b54d0 0x7f7f2c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 0x7f7f2c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0cffb0 con 0x7f7f2c15f410 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0cfe30 con 0x7f7f2c0d0f10 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0d3de0 con 0x7f7f2c0b54d0 2024-05-10T11:14:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 0x7f7f2c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 0x7f7f2c14d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42736/0 (socket says 172.21.15.66:42736) 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 -- 172.21.15.66:0/3396636795 learned_addr learned my addr 172.21.15.66:0/3396636795 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2b7fe640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c0b54d0 0x7f7f2c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2affd640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 -- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c0b54d0 msgr2=0x7f7f2c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c0b54d0 0x7f7f2c0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 -- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f2c0d0f10 msgr2=0x7f7f2c14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 -- 172.21.15.66:0/3396636795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c0cc570 con 0x7f7f2c15f410 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2affd640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f2bfff640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 0x7f7f2c14d980 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400c6e0 tx=0x7f7f2400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24003b70 con 0x7f7f2c15f410 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f24003d30 con 0x7f7f2c15f410 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c0cc850 con 0x7f7f2c15f410 2024-05-10T11:14:57.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24005310 con 0x7f7f2c15f410 2024-05-10T11:14:57.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.408+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c15bb70 con 0x7f7f2c15f410 2024-05-10T11:14:57.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.410+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c06a220 con 0x7f7f2c15f410 2024-05-10T11:14:57.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.410+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f240054b0 con 0x7f7f2c15f410 2024-05-10T11:14:57.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.411+0000 7f7f13fff640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7f180762d0 0x7f7f18078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:57.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.411+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6001+0+0 (secure 0 0 0) 0x7f7f240974f0 con 0x7f7f2c15f410 2024-05-10T11:14:57.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.411+0000 7f7f2b7fe640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7f180762d0 0x7f7f18078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:57.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.411+0000 7f7f2b7fe640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7f180762d0 0x7f7f18078790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009ad0 tx=0x7f7f1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:57.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.415+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7f24060db0 con 0x7f7f2c15f410 2024-05-10T11:14:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:57.644+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7f2c0d6090 con 0x7f7f2c15f410 2024-05-10T11:14:58.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.280+0000 7f7f13fff640 1 -- 172.21.15.66:0/3396636795 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v30) ==== 173+0+0 (secure 0 0 0) 0x7f7f240606b0 con 0x7f7f2c15f410 2024-05-10T11:14:58.281 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 9 and data pool 10 2024-05-10T11:14:58.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.286+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7f180762d0 msgr2=0x7f7f18078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.286+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7f180762d0 0x7f7f18078790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009ad0 tx=0x7f7f1c008040 comp rx=0 tx=0).stop 2024-05-10T11:14:58.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.286+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 msgr2=0x7f7f2c14d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.286+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 0x7f7f2c14d980 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400c6e0 tx=0x7f7f2400cba0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.288+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 shutdown_connections 2024-05-10T11:14:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.288+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7f180762d0 0x7f7f18078790 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.288+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f2c15f410 0x7f7f2c14d980 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.288+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f2c0d0f10 0x7f7f2c14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.288+0000 7f7f31ff7640 1 --2- 172.21.15.66:0/3396636795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f2c0b54d0 0x7f7f2c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.288+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 >> 172.21.15.66:0/3396636795 conn(0x7f7f2c08ed30 msgr2=0x7f7f2c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:58.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.291+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 shutdown_connections 2024-05-10T11:14:58.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.292+0000 7f7f31ff7640 1 -- 172.21.15.66:0/3396636795 wait complete. 2024-05-10T11:14:58.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:14:58.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.421+0000 7fb8ea4c4640 1 Processor -- start 2024-05-10T11:14:58.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.421+0000 7fb8ea4c4640 1 -- start start 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8ea4c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8e40d5cb0 0x7fb8e40d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8ea4c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e4162b30 0x7fb8e40d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8ea4c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e40b45f0 con 0x7fb8e4162750 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8ea4c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e40b4f20 con 0x7fb8e40d5cb0 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8ea4c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e40d0fe0 con 0x7fb8e4162b30 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8e37fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8e40d5cb0 0x7fb8e40d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8e8a61640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e4162b30 0x7fb8e40d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8e3fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb8e4162750 0x7fb8e40d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:48340/0 (socket says 172.21.15.66:48340) 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8e3fff640 1 -- 172.21.15.66:0/2091973935 learned_addr learned my addr 172.21.15.66:0/2091973935 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.422+0000 7fb8e2ffd640 1 -- 172.21.15.66:0/2091973935 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957645226 0 0) 0x7fb8e40b45f0 con 0x7fb8e4162750 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e2ffd640 1 -- 172.21.15.66:0/2091973935 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8cc003520 con 0x7fb8e4162750 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e37fe640 1 -- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e4162b30 msgr2=0x7fb8e40d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e37fe640 1 --2- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e4162b30 0x7fb8e40d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e37fe640 1 -- 172.21.15.66:0/2091973935 >> v1:172.21.15.190:6789/0 conn(0x7fb8e4162750 legacy=0x7fb8e40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e37fe640 1 -- 172.21.15.66:0/2091973935 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e40b48d0 con 0x7fb8e40d5cb0 2024-05-10T11:14:58.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e8a61640 1 --2- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e4162b30 0x7fb8e40d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.423+0000 7fb8e37fe640 1 --2- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e40d5cb0 0x7fb8e40d3630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80097a0 tx=0x7fb8d802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b5f525410d7587 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8e2ffd640 1 -- 172.21.15.66:0/2091973935 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8037070 con 0x7fb8e40d5cb0 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8e2ffd640 1 -- 172.21.15.66:0/2091973935 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d802ae50 con 0x7fb8e40d5cb0 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8e2ffd640 1 -- 172.21.15.66:0/2091973935 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8032660 con 0x7fb8e40d5cb0 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e40d5cb0 msgr2=0x7fb8e40d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e40d5cb0 0x7fb8e40d3630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80097a0 tx=0x7fb8d802a100 comp rx=0 tx=0).stop 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/2091973935 shutdown_connections 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e4162b30 0x7fb8e40d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/2091973935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e40d5cb0 0x7fb8e40d3630 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/2091973935 >> 172.21.15.66:0/2091973935 conn(0x7fb8e409e3b0 msgr2=0x7fb8e40d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/2091973935 shutdown_connections 2024-05-10T11:14:58.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.424+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/2091973935 wait complete. 2024-05-10T11:14:58.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.425+0000 7fb8ea4c4640 1 Processor -- start 2024-05-10T11:14:58.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 -- start start 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 0x7fb8e40b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e4162b30 0x7fb8e4148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e406d9d0 0x7fb8e406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e40b53b0 con 0x7fb8e4162750 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e40d0d80 con 0x7fb8e4162b30 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8ea4c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e40b5530 con 0x7fb8e406d9d0 2024-05-10T11:14:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8e3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 0x7fb8e40b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8e3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 0x7fb8e40b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42742/0 (socket says 172.21.15.66:42742) 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.426+0000 7fb8e3fff640 1 -- 172.21.15.66:0/1815067506 learned_addr learned my addr 172.21.15.66:0/1815067506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e37fe640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e4162b30 0x7fb8e4148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e8a61640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e406d9d0 0x7fb8e406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e3fff640 1 -- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e406d9d0 msgr2=0x7fb8e406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e3fff640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e406d9d0 0x7fb8e406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e3fff640 1 -- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e4162b30 msgr2=0x7fb8e4148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e3fff640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e4162b30 0x7fb8e4148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e3fff640 1 -- 172.21.15.66:0/1815067506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e40b9dc0 con 0x7fb8e4162750 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e37fe640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e4162b30 0x7fb8e4148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e3fff640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 0x7fb8e40b7f90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400c430 tx=0x7fb8d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4017070 con 0x7fb8e4162750 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d4005ce0 con 0x7fb8e4162750 2024-05-10T11:14:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e40ba0a0 con 0x7fb8e4162750 2024-05-10T11:14:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40072f0 con 0x7fb8e4162750 2024-05-10T11:14:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.427+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e40ba660 con 0x7fb8e4162750 2024-05-10T11:14:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.428+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e40cfc40 con 0x7fb8e4162750 2024-05-10T11:14:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.429+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8d401a070 con 0x7fb8e4162750 2024-05-10T11:14:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.429+0000 7fb8e0ff9640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8d00762d0 0x7fb8d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.429+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fb8d4096b90 con 0x7fb8e4162750 2024-05-10T11:14:58.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.430+0000 7fb8e37fe640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8d00762d0 0x7fb8d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.430+0000 7fb8e37fe640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8d00762d0 0x7fb8d0078790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8034000 tx=0x7fb8d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:58.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.434+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb8e40cfc40 con 0x7fb8e4162750 2024-05-10T11:14:58.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.624+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8e406a220 con 0x7fb8e4162750 2024-05-10T11:14:58.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.626+0000 7fb8e0ff9640 1 -- 172.21.15.66:0/1815067506 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16897 (secure 0 0 0) 0x7fb8d40603f0 con 0x7fb8e4162750 2024-05-10T11:14:58.626 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:58.626 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":61,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:57.646211+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:14:55.374882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T11:14:56.606536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:14:58.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8d00762d0 msgr2=0x7fb8d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8d00762d0 0x7fb8d0078790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8034000 tx=0x7fb8d802e000 comp rx=0 tx=0).stop 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 msgr2=0x7fb8e40b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 0x7fb8e40b7f90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400c430 tx=0x7fb8d400c8f0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 shutdown_connections 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb8d00762d0 0x7fb8d0078790 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8e406d9d0 0x7fb8e406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8e4162b30 0x7fb8e4148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 --2- 172.21.15.66:0/1815067506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e4162750 0x7fb8e40b7f90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 >> 172.21.15.66:0/1815067506 conn(0x7fb8e409e3b0 msgr2=0x7fb8e40cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 shutdown_connections 2024-05-10T11:14:58.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.628+0000 7fb8ea4c4640 1 -- 172.21.15.66:0/1815067506 wait complete. 2024-05-10T11:14:58.640 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:14:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.743+0000 7f0e9b340640 1 Processor -- start 2024-05-10T11:14:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.743+0000 7f0e9b340640 1 -- start start 2024-05-10T11:14:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e9b340640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e94162750 0x7f0e940d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e9b340640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0e940d5cb0 0x7f0e940d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e9b340640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e940d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e9b340640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0e940b4f20 con 0x7f0e940d5cb0 2024-05-10T11:14:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e9b340640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0e940d0fe0 con 0x7f0e94162750 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e9b340640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0e940b45f0 con 0x7f0e94162b30 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e988db640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0e940d5cb0 0x7f0e940d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e988db640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0e940d5cb0 0x7f0e940d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42748/0 (socket says 172.21.15.66:42748) 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e988db640 1 -- 172.21.15.66:0/2006908440 learned_addr learned my addr 172.21.15.66:0/2006908440 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e998dd640 1 --2- 172.21.15.66:0/2006908440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e940d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.744+0000 7f0e990dc640 1 --2- 172.21.15.66:0/2006908440 >> v2:172.21.15.190:3300/0 conn(0x7f0e94162750 0x7f0e940d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.745+0000 7f0e988db640 1 -- 172.21.15.66:0/2006908440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 msgr2=0x7f0e940d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.745+0000 7f0e988db640 1 --2- 172.21.15.66:0/2006908440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e940d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.745+0000 7f0e988db640 1 -- 172.21.15.66:0/2006908440 >> v2:172.21.15.190:3300/0 conn(0x7f0e94162750 msgr2=0x7f0e940d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.745+0000 7f0e988db640 1 --2- 172.21.15.66:0/2006908440 >> v2:172.21.15.190:3300/0 conn(0x7f0e94162750 0x7f0e940d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.745+0000 7f0e988db640 1 -- 172.21.15.66:0/2006908440 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940b48d0 con 0x7f0e940d5cb0 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.745+0000 7f0e988db640 1 --2- 172.21.15.66:0/2006908440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e940d5cb0 0x7f0e940d3630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0e940b7c40 tx=0x7f0e8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3e7c9721d30300 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e93fff640 1 -- 172.21.15.66:0/2006908440 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88037070 con 0x7f0e940d5cb0 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e93fff640 1 -- 172.21.15.66:0/2006908440 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88032440 con 0x7f0e940d5cb0 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e93fff640 1 -- 172.21.15.66:0/2006908440 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88032810 con 0x7f0e940d5cb0 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 -- 172.21.15.66:0/2006908440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e940d5cb0 msgr2=0x7f0e940d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 --2- 172.21.15.66:0/2006908440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e940d5cb0 0x7f0e940d3630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0e940b7c40 tx=0x7f0e8802a140 comp rx=0 tx=0).stop 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 -- 172.21.15.66:0/2006908440 shutdown_connections 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 --2- 172.21.15.66:0/2006908440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e940d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 --2- 172.21.15.66:0/2006908440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e940d5cb0 0x7f0e940d3630 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 --2- 172.21.15.66:0/2006908440 >> v2:172.21.15.190:3300/0 conn(0x7f0e94162750 0x7f0e940d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 -- 172.21.15.66:0/2006908440 >> 172.21.15.66:0/2006908440 conn(0x7f0e9409e3b0 msgr2=0x7f0e940d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 -- 172.21.15.66:0/2006908440 shutdown_connections 2024-05-10T11:14:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.746+0000 7f0e9b340640 1 -- 172.21.15.66:0/2006908440 wait complete. 2024-05-10T11:14:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.747+0000 7f0e9b340640 1 Processor -- start 2024-05-10T11:14:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 -- start start 2024-05-10T11:14:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 0x7f0e941f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e94159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e940b8620 0x7f0e940b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940d0d30 con 0x7f0e94162750 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940d0bb0 con 0x7f0e940b8620 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e9b340640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0e940d1660 con 0x7f0e94162b30 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e990dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 0x7f0e941f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e990dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 0x7f0e941f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42756/0 (socket says 172.21.15.66:42756) 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.748+0000 7f0e990dc640 1 -- 172.21.15.66:0/3130014456 learned_addr learned my addr 172.21.15.66:0/3130014456 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e988db640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e94159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e998dd640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e940b8620 0x7f0e940b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e990dc640 1 -- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 msgr2=0x7f0e94159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e990dc640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e94159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e990dc640 1 -- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e940b8620 msgr2=0x7f0e940b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e990dc640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e940b8620 0x7f0e940b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e990dc640 1 -- 172.21.15.66:0/3130014456 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940b8e80 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e998dd640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e940b8620 0x7f0e940b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e990dc640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 0x7f0e941f4b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00e890 tx=0x7f0e8c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c017070 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00c940 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e94159b70 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00cd10 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.749+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e941f54f0 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.750+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9406a220 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.751+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e8c01a070 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.751+0000 7f0e91ffb640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0e800762d0 0x7f0e80078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.751+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f0e8c0976e0 con 0x7f0e94162750 2024-05-10T11:14:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.752+0000 7f0e988db640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0e800762d0 0x7f0e80078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:58.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.752+0000 7f0e988db640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0e800762d0 0x7f0e80078790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e88034000 tx=0x7f0e8802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:58.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.756+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0e94159b70 con 0x7f0e94162750 2024-05-10T11:14:58.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.949+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e940d01a0 con 0x7f0e94162750 2024-05-10T11:14:58.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.950+0000 7f0e91ffb640 1 -- 172.21.15.66:0/3130014456 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16897 (secure 0 0 0) 0x7f0e8c060f40 con 0x7f0e94162750 2024-05-10T11:14:58.951 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:14:58.951 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":61,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:57.646211+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:14:55.374882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T11:14:56.606536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:14:58.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0e800762d0 msgr2=0x7f0e80078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0e800762d0 0x7f0e80078790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e88034000 tx=0x7f0e8802e000 comp rx=0 tx=0).stop 2024-05-10T11:14:58.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 msgr2=0x7f0e941f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 0x7f0e941f4b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00e890 tx=0x7f0e8c00ed50 comp rx=0 tx=0).stop 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 shutdown_connections 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0e800762d0 0x7f0e80078790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e940b8620 0x7f0e940b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e94162b30 0x7f0e94159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 --2- 172.21.15.66:0/3130014456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e94162750 0x7f0e941f4b60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 >> 172.21.15.66:0/3130014456 conn(0x7f0e9409e3b0 msgr2=0x7f0e9406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 shutdown_connections 2024-05-10T11:14:58.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:58.953+0000 7f0e9b340640 1 -- 172.21.15.66:0/3130014456 wait complete. 2024-05-10T11:14:58.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:14:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.071+0000 7f9cbf9f9640 1 Processor -- start 2024-05-10T11:14:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.071+0000 7f9cbf9f9640 1 -- start start 2024-05-10T11:14:59.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbf9f9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9cb806df20 0x7f9cb80739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbf9f9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9cb8073f20 0x7f9cb815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbf9f9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb8157a40 con 0x7f9cb806c2c0 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbf9f9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb8161990 con 0x7f9cb806df20 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbf9f9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb8160d80 con 0x7f9cb8073f20 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9cb806df20 0x7f9cb80739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9cb806df20 0x7f9cb80739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42772/0 (socket says 172.21.15.66:42772) 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 -- 172.21.15.66:0/2086619191 learned_addr learned my addr 172.21.15.66:0/2086619191 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbdf96640 1 --2- 172.21.15.66:0/2086619191 >> v2:172.21.15.190:3300/0 conn(0x7f9cb8073f20 0x7f9cb815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 -- 172.21.15.66:0/2086619191 >> v2:172.21.15.190:3300/0 conn(0x7f9cb8073f20 msgr2=0x7f9cb815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 --2- 172.21.15.66:0/2086619191 >> v2:172.21.15.190:3300/0 conn(0x7f9cb8073f20 0x7f9cb815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 -- 172.21.15.66:0/2086619191 >> v1:172.21.15.190:6789/0 conn(0x7f9cb806c2c0 legacy=0x7f9cb806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:59.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.072+0000 7f9cbcf94640 1 -- 172.21.15.66:0/2086619191 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb8161060 con 0x7f9cb806df20 2024-05-10T11:14:59.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.073+0000 7f9cbcf94640 1 --2- 172.21.15.66:0/2086619191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806df20 0x7f9cb80739e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9cb806f1c0 tx=0x7f9ca802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3a473b0f4eb94 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:59.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.073+0000 7f9caffff640 1 -- 172.21.15.66:0/2086619191 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8037070 con 0x7f9cb806df20 2024-05-10T11:14:59.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.073+0000 7f9caffff640 1 -- 172.21.15.66:0/2086619191 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca8032440 con 0x7f9cb806df20 2024-05-10T11:14:59.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.073+0000 7f9caffff640 1 -- 172.21.15.66:0/2086619191 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8032810 con 0x7f9cb806df20 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/2086619191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806df20 msgr2=0x7f9cb80739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/2086619191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806df20 0x7f9cb80739e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9cb806f1c0 tx=0x7f9ca802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/2086619191 shutdown_connections 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/2086619191 >> v2:172.21.15.190:3300/0 conn(0x7f9cb8073f20 0x7f9cb815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/2086619191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806df20 0x7f9cb80739e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/2086619191 >> 172.21.15.66:0/2086619191 conn(0x7f9cb80d0c90 msgr2=0x7f9cb80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/2086619191 shutdown_connections 2024-05-10T11:14:59.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.074+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/2086619191 wait complete. 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.075+0000 7f9cbf9f9640 1 Processor -- start 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.075+0000 7f9cbf9f9640 1 -- start start 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 0x7f9cb81e7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cb806df20 0x7f9cb8160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cb8073f20 0x7f9cb815e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb80cd440 con 0x7f9cb806c2c0 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb8161620 con 0x7f9cb8073f20 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb8072180 con 0x7f9cb806df20 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 0x7f9cb81e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 0x7f9cb81e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42786/0 (socket says 172.21.15.66:42786) 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 -- 172.21.15.66:0/3966571117 learned_addr learned my addr 172.21.15.66:0/3966571117 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 -- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cb806df20 msgr2=0x7f9cb8160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cb806df20 0x7f9cb8160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 -- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cb8073f20 msgr2=0x7f9cb815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cb8073f20 0x7f9cb815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 -- 172.21.15.66:0/3966571117 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb80c4940 con 0x7f9cb806c2c0 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbd795640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 0x7f9cb81e7880 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c3c0 tx=0x7f9cb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40052d0 con 0x7f9cb806c2c0 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb4005490 con 0x7f9cb806c2c0 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb80c4c20 con 0x7f9cb806c2c0 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.076+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007260 con 0x7f9cb806c2c0 2024-05-10T11:14:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.077+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb80c51e0 con 0x7f9cb806c2c0 2024-05-10T11:14:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.078+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb806a220 con 0x7f9cb806c2c0 2024-05-10T11:14:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.078+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9cb4007400 con 0x7f9cb806c2c0 2024-05-10T11:14:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.079+0000 7f9cadffb640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c9c0762d0 0x7f9c9c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:14:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.079+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f9cb4096b70 con 0x7f9cb806c2c0 2024-05-10T11:14:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.079+0000 7f9cbcf94640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c9c0762d0 0x7f9c9c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:14:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.080+0000 7f9cbcf94640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c9c0762d0 0x7f9c9c078790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8034000 tx=0x7f9ca802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:14:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.083+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9cb8157a40 con 0x7f9cb806c2c0 2024-05-10T11:14:59.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:14:59.313+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9cb806f510 con 0x7f9cb806c2c0 2024-05-10T11:15:00.262 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-05-10T11:15:00.262+0000 7f94ce33b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:15:00.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.292+0000 7f9cadffb640 1 -- 172.21.15.66:0/3966571117 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7f9cb40603d0 con 0x7f9cb806c2c0 2024-05-10T11:15:00.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c9c0762d0 msgr2=0x7f9c9c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c9c0762d0 0x7f9c9c078790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8034000 tx=0x7f9ca802c000 comp rx=0 tx=0).stop 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 msgr2=0x7f9cb81e7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 0x7f9cb81e7880 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c3c0 tx=0x7f9cb400c880 comp rx=0 tx=0).stop 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 shutdown_connections 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c9c0762d0 0x7f9c9c078790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cb8073f20 0x7f9cb815e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cb806df20 0x7f9cb8160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 --2- 172.21.15.66:0/3966571117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cb806c2c0 0x7f9cb81e7880 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 >> 172.21.15.66:0/3966571117 conn(0x7f9cb80d0c90 msgr2=0x7f9cb80b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 shutdown_connections 2024-05-10T11:15:00.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.295+0000 7f9cbf9f9640 1 -- 172.21.15.66:0/3966571117 wait complete. 2024-05-10T11:15:00.309 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:15:00.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:15:00.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.422+0000 7ff0efe59640 1 Processor -- start 2024-05-10T11:15:00.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.422+0000 7ff0efe59640 1 -- start start 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0efe59640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0e80d2d10 0x7ff0e80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0efe59640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0e80d1f50 0x7ff0e80d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0efe59640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e80d31a0 con 0x7ff0e80d3df0 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0efe59640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e80cfd50 con 0x7ff0e80d1f50 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0efe59640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e80b5d90 con 0x7ff0e80d2d10 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0ee3f6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0e80d1f50 0x7ff0e80d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0ee3f6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0e80d1f50 0x7ff0e80d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42790/0 (socket says 172.21.15.66:42790) 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.423+0000 7ff0ee3f6640 1 -- 172.21.15.66:0/4163354176 learned_addr learned my addr 172.21.15.66:0/4163354176 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:00.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ee3f6640 1 -- 172.21.15.66:0/4163354176 >> v2:172.21.15.190:3300/0 conn(0x7ff0e80d2d10 msgr2=0x7ff0e80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:00.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ee3f6640 1 --2- 172.21.15.66:0/4163354176 >> v2:172.21.15.190:3300/0 conn(0x7ff0e80d2d10 0x7ff0e80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ee3f6640 1 -- 172.21.15.66:0/4163354176 >> v1:172.21.15.190:6789/0 conn(0x7ff0e80d3df0 legacy=0x7ff0e80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:00.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ee3f6640 1 -- 172.21.15.66:0/4163354176 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e80d41d0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ee3f6640 1 --2- 172.21.15.66:0/4163354176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e80d04a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff0e809eae0 tx=0x7ff0e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a41eb527282a41 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ecbf3640 1 -- 172.21.15.66:0/4163354176 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0036070 con 0x7ff0e80d1f50 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ecbf3640 1 -- 172.21.15.66:0/4163354176 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e0031600 con 0x7ff0e80d1f50 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.424+0000 7ff0ecbf3640 1 -- 172.21.15.66:0/4163354176 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00319d0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 -- 172.21.15.66:0/4163354176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 msgr2=0x7ff0e80d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 --2- 172.21.15.66:0/4163354176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e80d04a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff0e809eae0 tx=0x7ff0e002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 -- 172.21.15.66:0/4163354176 shutdown_connections 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 --2- 172.21.15.66:0/4163354176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e80d04a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 --2- 172.21.15.66:0/4163354176 >> v2:172.21.15.190:3300/0 conn(0x7ff0e80d2d10 0x7ff0e80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 -- 172.21.15.66:0/4163354176 >> 172.21.15.66:0/4163354176 conn(0x7ff0e809e450 msgr2=0x7ff0e80d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:00.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 -- 172.21.15.66:0/4163354176 shutdown_connections 2024-05-10T11:15:00.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.425+0000 7ff0efe59640 1 -- 172.21.15.66:0/4163354176 wait complete. 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.426+0000 7ff0efe59640 1 Processor -- start 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.426+0000 7ff0efe59640 1 -- start start 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0efe59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0efe59640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e80d2d10 0x7ff0e8162c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0efe59640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e80d3df0 0x7ff0e80b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0efe59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e80b57d0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0efe59640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e80d2380 con 0x7ff0e80d3df0 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0efe59640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e80b5ab0 con 0x7ff0e80d2d10 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0edbf5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0edbf5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e81591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42800/0 (socket says 172.21.15.66:42800) 2024-05-10T11:15:00.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0edbf5640 1 -- 172.21.15.66:0/647898198 learned_addr learned my addr 172.21.15.66:0/647898198 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0ee3f6640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e80d3df0 0x7ff0e80b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.427+0000 7ff0ed3f4640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e80d2d10 0x7ff0e8162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0edbf5640 1 -- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e80d2d10 msgr2=0x7ff0e8162c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0edbf5640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e80d2d10 0x7ff0e8162c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0edbf5640 1 -- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e80d3df0 msgr2=0x7ff0e80b9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0edbf5640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e80d3df0 0x7ff0e80b9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0edbf5640 1 -- 172.21.15.66:0/647898198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e81f59a0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0edbf5640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e81591d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400b3e0 tx=0x7ff0e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4015020 con 0x7ff0e80d1f50 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e4011850 con 0x7ff0e80d1f50 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4011c40 con 0x7ff0e80d1f50 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e81f5c10 con 0x7ff0e80d1f50 2024-05-10T11:15:00.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.428+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e81f64b0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.429+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e81f5de0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.430+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff0e4018020 con 0x7ff0e80d1f50 2024-05-10T11:15:00.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.430+0000 7ff0de7fc640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0cc0762d0 0x7ff0cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:00.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.430+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7ff0e40975c0 con 0x7ff0e80d1f50 2024-05-10T11:15:00.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.431+0000 7ff0ed3f4640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0cc0762d0 0x7ff0cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:00.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.431+0000 7ff0ed3f4640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0cc0762d0 0x7ff0cc078790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009890 tx=0x7ff0d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:00.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.435+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff0e401f020 con 0x7ff0e80d1f50 2024-05-10T11:15:00.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:00.665+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff0e806a220 con 0x7ff0e80d1f50 2024-05-10T11:15:01.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.293+0000 7ff0de7fc640 1 -- 172.21.15.66:0/647898198 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7ff0e4060e20 con 0x7ff0e80d1f50 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0cc0762d0 msgr2=0x7ff0cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0cc0762d0 0x7ff0cc078790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009890 tx=0x7ff0d8008040 comp rx=0 tx=0).stop 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 msgr2=0x7ff0e81591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e81591d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400b3e0 tx=0x7ff0e400b8a0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 shutdown_connections 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0cc0762d0 0x7ff0cc078790 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e80d3df0 0x7ff0e80b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e80d2d10 0x7ff0e8162c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 --2- 172.21.15.66:0/647898198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0e80d1f50 0x7ff0e81591d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 >> 172.21.15.66:0/647898198 conn(0x7ff0e809e450 msgr2=0x7ff0e806ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 shutdown_connections 2024-05-10T11:15:01.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.296+0000 7ff0efe59640 1 -- 172.21.15.66:0/647898198 wait complete. 2024-05-10T11:15:01.311 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:15:01.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:15:01.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.421+0000 7fa896dc1640 1 Processor -- start 2024-05-10T11:15:01.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.421+0000 7fa896dc1640 1 -- start start 2024-05-10T11:15:01.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.422+0000 7fa896dc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89015f4e0 0x7fa89006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.422+0000 7fa896dc1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8900b0a90 con 0x7fa89015f8c0 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.422+0000 7fa896dc1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8900b3540 con 0x7fa89006e620 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.422+0000 7fa896dc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8900b23f0 con 0x7fa89015f4e0 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.422+0000 7fa88ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa89015f8c0 0x7fa89006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49370/0 (socket says 172.21.15.66:49370) 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.422+0000 7fa88ffff640 1 -- 172.21.15.66:0/3065306750 learned_addr learned my addr 172.21.15.66:0/3065306750 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa894b5d640 1 --2- 172.21.15.66:0/3065306750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89015f4e0 0x7fa89006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572116417 0 0) 0x7fa8900b0a90 con 0x7fa89015f8c0 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa880003520 con 0x7fa89015f8c0 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16364581 0 0) 0x7fa8900b3540 con 0x7fa89006e620 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8900b0a90 con 0x7fa89006e620 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa894b5d640 1 -- 172.21.15.66:0/3065306750 >> v1:172.21.15.190:6789/0 conn(0x7fa89006e620 legacy=0x7fa8900d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa894b5d640 1 -- 172.21.15.66:0/3065306750 >> v1:172.21.15.66:6789/0 conn(0x7fa89015f8c0 legacy=0x7fa89006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2846902805 0 0) 0x7fa880003520 con 0x7fa89015f8c0 2024-05-10T11:15:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.423+0000 7fa894b5d640 1 -- 172.21.15.66:0/3065306750 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8900b3820 con 0x7fa89015f4e0 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa894b5d640 1 --2- 172.21.15.66:0/3065306750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89015f4e0 0x7fa89006d9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8840097d0 tx=0x7fa88402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f89031f3a40337 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884037070 con 0x7fa89015f4e0 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88402ab90 con 0x7fa89015f4e0 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa88f7fe640 1 -- 172.21.15.66:0/3065306750 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c001670 con 0x7fa89015f4e0 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa896dc1640 1 -- 172.21.15.66:0/3065306750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89015f4e0 msgr2=0x7fa89006d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa896dc1640 1 --2- 172.21.15.66:0/3065306750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89015f4e0 0x7fa89006d9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8840097d0 tx=0x7fa88402a100 comp rx=0 tx=0).stop 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa896dc1640 1 -- 172.21.15.66:0/3065306750 shutdown_connections 2024-05-10T11:15:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.424+0000 7fa896dc1640 1 --2- 172.21.15.66:0/3065306750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89015f4e0 0x7fa89006d9d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.425+0000 7fa896dc1640 1 -- 172.21.15.66:0/3065306750 >> 172.21.15.66:0/3065306750 conn(0x7fa8900d2df0 msgr2=0x7fa8900d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:01.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.425+0000 7fa896dc1640 1 -- 172.21.15.66:0/3065306750 shutdown_connections 2024-05-10T11:15:01.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.425+0000 7fa896dc1640 1 -- 172.21.15.66:0/3065306750 wait complete. 2024-05-10T11:15:01.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.426+0000 7fa896dc1640 1 Processor -- start 2024-05-10T11:15:01.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.426+0000 7fa896dc1640 1 -- start start 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa896dc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006e620 0x7fa890157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa896dc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa89015f4e0 0x7fa8901569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa896dc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 0x7fa89015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa896dc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8900b3de0 con 0x7fa89015f8c0 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa896dc1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa8900b4150 con 0x7fa89015f4e0 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa896dc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8900b45e0 con 0x7fa89006e620 2024-05-10T11:15:01.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 0x7fa89015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 0x7fa89015db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42816/0 (socket says 172.21.15.66:42816) 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 -- 172.21.15.66:0/2418668615 learned_addr learned my addr 172.21.15.66:0/2418668615 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa88ffff640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa89015f4e0 0x7fa8901569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa894b5d640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006e620 0x7fa890157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 -- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006e620 msgr2=0x7fa890157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006e620 0x7fa890157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 -- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa89015f4e0 msgr2=0x7fa8901569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa89015f4e0 0x7fa8901569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 -- 172.21.15.66:0/2418668615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8900b80a0 con 0x7fa89015f8c0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.427+0000 7fa89535e640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 0x7fa89015db60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c710 tx=0x7fa88800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.428+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888003b70 con 0x7fa89015f8c0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.428+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa888003d10 con 0x7fa89015f8c0 2024-05-10T11:15:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.428+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8900b8380 con 0x7fa89015f8c0 2024-05-10T11:15:01.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.428+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88800a9f0 con 0x7fa89015f8c0 2024-05-10T11:15:01.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.428+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8901572f0 con 0x7fa89015f8c0 2024-05-10T11:15:01.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.429+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89006a220 con 0x7fa89015f8c0 2024-05-10T11:15:01.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.429+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa88800ab90 con 0x7fa89015f8c0 2024-05-10T11:15:01.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.430+0000 7fa88d7fa640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8740762d0 0x7fa874078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.430+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa8880974c0 con 0x7fa89015f8c0 2024-05-10T11:15:01.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.430+0000 7fa894b5d640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8740762d0 0x7fa874078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.431+0000 7fa894b5d640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8740762d0 0x7fa874078790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa884034000 tx=0x7fa88402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:01.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.434+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa88800ce20 con 0x7fa89015f8c0 2024-05-10T11:15:01.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:15:01.603 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:15:01.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.665+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8900695b0 con 0x7fa89015f8c0 2024-05-10T11:15:01.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.665+0000 7fa88d7fa640 1 -- 172.21.15.66:0/2418668615 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5185 (secure 0 0 0) 0x7fa888060640 con 0x7fa89015f8c0 2024-05-10T11:15:01.666 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:01.666 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:00.666858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:15:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 34 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8740762d0 msgr2=0x7fa874078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8740762d0 0x7fa874078790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa884034000 tx=0x7fa88402e000 comp rx=0 tx=0).stop 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 msgr2=0x7fa89015db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 0x7fa89015db60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c710 tx=0x7fa88800cbd0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 shutdown_connections 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8740762d0 0x7fa874078790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa89015f8c0 0x7fa89015db60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa89015f4e0 0x7fa8901569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 --2- 172.21.15.66:0/2418668615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006e620 0x7fa890157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 >> 172.21.15.66:0/2418668615 conn(0x7fa8900d2df0 msgr2=0x7fa890157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 shutdown_connections 2024-05-10T11:15:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.667+0000 7fa896dc1640 1 -- 172.21.15.66:0/2418668615 wait complete. 2024-05-10T11:15:01.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:15:01.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.783+0000 7f8a616b4640 1 Processor -- start 2024-05-10T11:15:01.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.783+0000 7f8a616b4640 1 -- start start 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.783+0000 7f8a616b4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a5c0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.783+0000 7f8a616b4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0ce590 con 0x7f8a5c15d650 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.783+0000 7f8a616b4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0d0500 con 0x7f8a5c0b43a0 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.783+0000 7f8a616b4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c15da30 con 0x7f8a5c0d3980 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a5affd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8a5c15d650 0x7f8a5c0cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49376/0 (socket says 172.21.15.66:49376) 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a5affd640 1 -- 172.21.15.66:0/3016966723 learned_addr learned my addr 172.21.15.66:0/3016966723 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a5a7fc640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a5c0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251951338 0 0) 0x7f8a54001490 con 0x7f8a5c15d650 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a48003520 con 0x7f8a5c15d650 2024-05-10T11:15:01.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4019463045 0 0) 0x7f8a48003520 con 0x7f8a5c15d650 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 msgr2=0x7f8a5c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a5c0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 >> v1:172.21.15.190:6789/0 conn(0x7f8a5c0b43a0 legacy=0x7f8a5c0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0ce810 con 0x7f8a5c15d650 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f8a54001bc0 con 0x7f8a5c15d650 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 >> v1:172.21.15.66:6789/0 conn(0x7f8a5c15d650 legacy=0x7f8a5c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48003fb0 0x7f8a48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4800bad0 con 0x7f8a48004d40 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4800bc80 con 0x7f8a48003fb0 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4800be80 con 0x7f8a5c0d3980 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a5b7fe640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a5a7fc640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48003fb0 0x7f8a48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.784+0000 7f8a5affd640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5b7fe640 1 -- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 msgr2=0x7f8a480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5b7fe640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5b7fe640 1 -- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48003fb0 msgr2=0x7f8a48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5b7fe640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48003fb0 0x7f8a48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5b7fe640 1 -- 172.21.15.66:0/3016966723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a48003520 con 0x7f8a48004d40 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5a7fc640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48003fb0 0x7f8a48004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5affd640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0d3980 0x7f8a480039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.785+0000 7f8a5b7fe640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c001720 tx=0x7f8a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f3cb85059f4028 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c001370 con 0x7f8a48004d40 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0052d0 con 0x7f8a48004d40 2024-05-10T11:15:01.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a59ffb640 1 -- 172.21.15.66:0/3016966723 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c02abc0 con 0x7f8a48004d40 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a616b4640 1 -- 172.21.15.66:0/3016966723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a48004d40 msgr2=0x7f8a480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3016966723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c001720 tx=0x7f8a48005830 comp rx=0 tx=0).stop 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a5b7fe640 1 -- 172.21.15.66:0/3016966723 reap_dead start 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a616b4640 1 -- 172.21.15.66:0/3016966723 shutdown_connections 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a616b4640 1 -- 172.21.15.66:0/3016966723 >> 172.21.15.66:0/3016966723 conn(0x7f8a5c0d2df0 msgr2=0x7f8a5c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a616b4640 1 -- 172.21.15.66:0/3016966723 shutdown_connections 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.786+0000 7f8a616b4640 1 -- 172.21.15.66:0/3016966723 wait complete. 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 Processor -- start 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 -- start start 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48004d40 0x7f8a5c1f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 0x7f8a5c0b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0b5db0 0x7f8a5c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0cfc50 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0cedd0 con 0x7f8a48004d40 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a616b4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c0cfdd0 con 0x7f8a5c0b5db0 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a5a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 0x7f8a5c0b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a5a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 0x7f8a5c0b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42836/0 (socket says 172.21.15.66:42836) 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.788+0000 7f8a5a7fc640 1 -- 172.21.15.66:0/3783194622 learned_addr learned my addr 172.21.15.66:0/3783194622 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5affd640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48004d40 0x7f8a5c1f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5b7fe640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0b5db0 0x7f8a5c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5a7fc640 1 -- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0b5db0 msgr2=0x7f8a5c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5a7fc640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0b5db0 0x7f8a5c159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5a7fc640 1 -- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48004d40 msgr2=0x7f8a5c1f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5a7fc640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48004d40 0x7f8a5c1f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5a7fc640 1 -- 172.21.15.66:0/3783194622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0c73a0 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a5a7fc640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 0x7f8a5c0b8650 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8a44011ca0 tx=0x7f8a4400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:01.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400fd20 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44014440 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c0caa80 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44014830 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.789+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c0cb040 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.790+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c0cdde0 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.791+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a44012040 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.791+0000 7f8a537fe640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a3c0762d0 0x7f8a3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:01.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.791+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8a44097fe0 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.791+0000 7f8a5affd640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a3c0762d0 0x7f8a3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:01.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.792+0000 7f8a5affd640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a3c0762d0 0x7f8a3c078790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a54001630 tx=0x7f8a54006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:01.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.795+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8a5c0cdde0 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.987+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a5c06a220 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.988+0000 7f8a537fe640 1 -- 172.21.15.66:0/3783194622 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16884 (secure 0 0 0) 0x7f8a44019030 con 0x7f8a5c0c6e70 2024-05-10T11:15:01.989 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:01.989 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":62,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:14:59.281803+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:14:55.374882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T11:14:56.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a3c0762d0 msgr2=0x7f8a3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a3c0762d0 0x7f8a3c078790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a54001630 tx=0x7f8a54006040 comp rx=0 tx=0).stop 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 msgr2=0x7f8a5c0b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 0x7f8a5c0b8650 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8a44011ca0 tx=0x7f8a4400f610 comp rx=0 tx=0).stop 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 shutdown_connections 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a3c0762d0 0x7f8a3c078790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5c0b5db0 0x7f8a5c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a5c0c6e70 0x7f8a5c0b8650 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 --2- 172.21.15.66:0/3783194622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a48004d40 0x7f8a5c1f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 >> 172.21.15.66:0/3783194622 conn(0x7f8a5c0d2df0 msgr2=0x7f8a5c0b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:01.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 shutdown_connections 2024-05-10T11:15:01.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:01.990+0000 7f8a616b4640 1 -- 172.21.15.66:0/3783194622 wait complete. 2024-05-10T11:15:02.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:15:02.002 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:15:02.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.106+0000 7f151da3e640 1 Processor -- start 2024-05-10T11:15:02.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.106+0000 7f151da3e640 1 -- start start 2024-05-10T11:15:02.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f151da3e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f151815f390 0x7f15180d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f151da3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f151da3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15180cfd10 con 0x7f15180b4c00 2024-05-10T11:15:02.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f151da3e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f15180cff90 con 0x7f151815f390 2024-05-10T11:15:02.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f151da3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1518163d00 con 0x7f15180d5190 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f151815f390 0x7f15180d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f151815f390 0x7f15180d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42852/0 (socket says 172.21.15.66:42852) 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 -- 172.21.15.66:0/3243630014 learned_addr learned my addr 172.21.15.66:0/3243630014 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f15167fc640 1 --2- 172.21.15.66:0/3243630014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 -- 172.21.15.66:0/3243630014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 msgr2=0x7f15180d55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 --2- 172.21.15.66:0/3243630014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180d55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 -- 172.21.15.66:0/3243630014 >> v1:172.21.15.190:6789/0 conn(0x7f15180b4c00 legacy=0x7f15180b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.107+0000 7f1516ffd640 1 -- 172.21.15.66:0/3243630014 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180d0250 con 0x7f151815f390 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.108+0000 7f1516ffd640 1 --2- 172.21.15.66:0/3243630014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f15180d0a50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1508009870 tx=0x7f150802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda83c9349a4c30d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.108+0000 7f1515ffb640 1 -- 172.21.15.66:0/3243630014 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508037070 con 0x7f151815f390 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.108+0000 7f1515ffb640 1 -- 172.21.15.66:0/3243630014 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1508032440 con 0x7f151815f390 2024-05-10T11:15:02.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.108+0000 7f1515ffb640 1 -- 172.21.15.66:0/3243630014 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508032810 con 0x7f151815f390 2024-05-10T11:15:02.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 -- 172.21.15.66:0/3243630014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 msgr2=0x7f15180d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 --2- 172.21.15.66:0/3243630014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f15180d0a50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1508009870 tx=0x7f150802a270 comp rx=0 tx=0).stop 2024-05-10T11:15:02.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 -- 172.21.15.66:0/3243630014 shutdown_connections 2024-05-10T11:15:02.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 --2- 172.21.15.66:0/3243630014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 --2- 172.21.15.66:0/3243630014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f15180d0a50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 -- 172.21.15.66:0/3243630014 >> 172.21.15.66:0/3243630014 conn(0x7f151808ecb0 msgr2=0x7f151809e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:02.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 -- 172.21.15.66:0/3243630014 shutdown_connections 2024-05-10T11:15:02.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.109+0000 7f151da3e640 1 -- 172.21.15.66:0/3243630014 wait complete. 2024-05-10T11:15:02.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.110+0000 7f151da3e640 1 Processor -- start 2024-05-10T11:15:02.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.110+0000 7f151da3e640 1 -- start start 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f151da3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15180b4c00 0x7f1518160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f151da3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f151da3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f1518153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f151da3e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15180d0f90 con 0x7f151815f390 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f151da3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15180d5af0 con 0x7f15180b4c00 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f151da3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f15180d1110 con 0x7f15180d5190 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f1518153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f1518153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42854/0 (socket says 172.21.15.66:42854) 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 -- 172.21.15.66:0/3790539624 learned_addr learned my addr 172.21.15.66:0/3790539624 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15167fc640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f1516ffd640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15180b4c00 0x7f1518160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 -- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 msgr2=0x7f15180b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 -- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15180b4c00 msgr2=0x7f1518160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15180b4c00 0x7f1518160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 -- 172.21.15.66:0/3790539624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180c9330 con 0x7f151815f390 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.111+0000 7f15177fe640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f1518153590 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f151000c6b0 tx=0x7f151000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.112+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510003b70 con 0x7f151815f390 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.112+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1510003d30 con 0x7f151815f390 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.112+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510005310 con 0x7f151815f390 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.112+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15180c98f0 con 0x7f151815f390 2024-05-10T11:15:02.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.112+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15180c9eb0 con 0x7f151815f390 2024-05-10T11:15:02.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.113+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15180b6be0 con 0x7f151815f390 2024-05-10T11:15:02.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.113+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f15100054b0 con 0x7f151815f390 2024-05-10T11:15:02.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.114+0000 7f14fffff640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15040762d0 0x7f1504078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.114+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f1510097660 con 0x7f151815f390 2024-05-10T11:15:02.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.114+0000 7f1516ffd640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15040762d0 0x7f1504078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.115+0000 7f1516ffd640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15040762d0 0x7f1504078790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1508034000 tx=0x7f150802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.118+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f15180b6be0 con 0x7f151815f390 2024-05-10T11:15:02.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.308+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f151806a220 con 0x7f15040762d0 2024-05-10T11:15:02.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.315+0000 7f14fffff640 1 -- 172.21.15.66:0/3790539624 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250070 (secure 0 0 0) 0x7f151806a220 con 0x7f15040762d0 2024-05-10T11:15:02.318 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:02.319 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:15:02.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15040762d0 msgr2=0x7f1504078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15040762d0 0x7f1504078790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1508034000 tx=0x7f150802e000 comp rx=0 tx=0).stop 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 msgr2=0x7f1518153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f1518153590 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f151000c6b0 tx=0x7f151000cb70 comp rx=0 tx=0).stop 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 shutdown_connections 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15040762d0 0x7f1504078790 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f151815f390 0x7f1518153590 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15180d5190 0x7f15180b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 --2- 172.21.15.66:0/3790539624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15180b4c00 0x7f1518160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 >> 172.21.15.66:0/3790539624 conn(0x7f151808ecb0 msgr2=0x7f15180b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 shutdown_connections 2024-05-10T11:15:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.318+0000 7f151da3e640 1 -- 172.21.15.66:0/3790539624 wait complete. 2024-05-10T11:15:02.329 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-10T11:15:01.720024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":129,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223020,"kb_used_data":6832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751700,"statfs":{"total":773094113280,"available":772865740800,"internally_reserved":0,"allocated":6995968,"data_stored":3746854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457177"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277939+0000","last_change":"2024-05-10T11:14:57.277939+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277939+0000","last_undegraded":"2024-05-10T11:14:57.277939+0000","last_fullsized":"2024-05-10T11:14:57.277939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277888+0000","last_change":"2024-05-10T11:14:57.277888+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277888+0000","last_undegraded":"2024-05-10T11:14:57.277888+0000","last_fullsized":"2024-05-10T11:14:57.277888+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304210+0000","last_change":"2024-05-10T11:14:58.297410+0000","last_active":"2024-05-10T11:14:58.304210+0000","last_peered":"2024-05-10T11:14:58.304210+0000","last_clean":"2024-05-10T11:14:58.304210+0000","last_became_active":"2024-05-10T11:14:58.297147+0000","last_became_peered":"2024-05-10T11:14:58.297147+0000","last_unstale":"2024-05-10T11:14:58.304210+0000","last_undegraded":"2024-05-10T11:14:58.304210+0000","last_fullsized":"2024-05-10T11:14:58.304210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:13.060645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306506+0000","last_change":"2024-05-10T11:14:58.294909+0000","last_active":"2024-05-10T11:14:58.306506+0000","last_peered":"2024-05-10T11:14:58.306506+0000","last_clean":"2024-05-10T11:14:58.306506+0000","last_became_active":"2024-05-10T11:14:58.294219+0000","last_became_peered":"2024-05-10T11:14:58.294219+0000","last_unstale":"2024-05-10T11:14:58.306506+0000","last_undegraded":"2024-05-10T11:14:58.306506+0000","last_fullsized":"2024-05-10T11:14:58.306506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305830+0000","last_change":"2024-05-10T11:14:58.302152+0000","last_active":"2024-05-10T11:14:58.305830+0000","last_peered":"2024-05-10T11:14:58.305830+0000","last_clean":"2024-05-10T11:14:58.305830+0000","last_became_active":"2024-05-10T11:14:58.301618+0000","last_became_peered":"2024-05-10T11:14:58.301618+0000","last_unstale":"2024-05-10T11:14:58.305830+0000","last_undegraded":"2024-05-10T11:14:58.305830+0000","last_fullsized":"2024-05-10T11:14:58.305830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:22.704456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271980+0000","last_change":"2024-05-10T11:14:57.271980+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271980+0000","last_undegraded":"2024-05-10T11:14:57.271980+0000","last_fullsized":"2024-05-10T11:14:57.271980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271169+0000","last_change":"2024-05-10T11:14:57.271169+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271169+0000","last_undegraded":"2024-05-10T11:14:57.271169+0000","last_fullsized":"2024-05-10T11:14:57.271169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293457+0000","last_change":"2024-05-10T11:14:58.305552+0000","last_active":"2024-05-10T11:14:59.293457+0000","last_peered":"2024-05-10T11:14:59.293457+0000","last_clean":"2024-05-10T11:14:59.293457+0000","last_became_active":"2024-05-10T11:14:58.305299+0000","last_became_peered":"2024-05-10T11:14:58.305299+0000","last_unstale":"2024-05-10T11:14:59.293457+0000","last_undegraded":"2024-05-10T11:14:59.293457+0000","last_fullsized":"2024-05-10T11:14:59.293457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:38.945852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309803+0000","last_change":"2024-05-10T11:14:58.307371+0000","last_active":"2024-05-10T11:14:58.309803+0000","last_peered":"2024-05-10T11:14:58.309803+0000","last_clean":"2024-05-10T11:14:58.309803+0000","last_became_active":"2024-05-10T11:14:58.307064+0000","last_became_peered":"2024-05-10T11:14:58.307064+0000","last_unstale":"2024-05-10T11:14:58.309803+0000","last_undegraded":"2024-05-10T11:14:58.309803+0000","last_fullsized":"2024-05-10T11:14:58.309803+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:41.509127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304218+0000","last_change":"2024-05-10T11:14:58.299020+0000","last_active":"2024-05-10T11:14:58.304218+0000","last_peered":"2024-05-10T11:14:58.304218+0000","last_clean":"2024-05-10T11:14:58.304218+0000","last_became_active":"2024-05-10T11:14:58.298147+0000","last_became_peered":"2024-05-10T11:14:58.298147+0000","last_unstale":"2024-05-10T11:14:58.304218+0000","last_undegraded":"2024-05-10T11:14:58.304218+0000","last_fullsized":"2024-05-10T11:14:58.304218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:55.573266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306767+0000","last_change":"2024-05-10T11:14:58.292521+0000","last_active":"2024-05-10T11:14:58.306767+0000","last_peered":"2024-05-10T11:14:58.306767+0000","last_clean":"2024-05-10T11:14:58.306767+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.306767+0000","last_undegraded":"2024-05-10T11:14:58.306767+0000","last_fullsized":"2024-05-10T11:14:58.306767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293615+0000","last_change":"2024-05-10T11:14:58.303388+0000","last_active":"2024-05-10T11:14:59.293615+0000","last_peered":"2024-05-10T11:14:59.293615+0000","last_clean":"2024-05-10T11:14:59.293615+0000","last_became_active":"2024-05-10T11:14:58.303093+0000","last_became_peered":"2024-05-10T11:14:58.303093+0000","last_unstale":"2024-05-10T11:14:59.293615+0000","last_undegraded":"2024-05-10T11:14:59.293615+0000","last_fullsized":"2024-05-10T11:14:59.293615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:27.443250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293798+0000","last_change":"2024-05-10T11:14:58.300330+0000","last_active":"2024-05-10T11:14:59.293798+0000","last_peered":"2024-05-10T11:14:59.293798+0000","last_clean":"2024-05-10T11:14:59.293798+0000","last_became_active":"2024-05-10T11:14:58.300074+0000","last_became_peered":"2024-05-10T11:14:58.300074+0000","last_unstale":"2024-05-10T11:14:59.293798+0000","last_undegraded":"2024-05-10T11:14:59.293798+0000","last_fullsized":"2024-05-10T11:14:59.293798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304170+0000","last_change":"2024-05-10T11:14:58.296851+0000","last_active":"2024-05-10T11:14:58.304170+0000","last_peered":"2024-05-10T11:14:58.304170+0000","last_clean":"2024-05-10T11:14:58.304170+0000","last_became_active":"2024-05-10T11:14:58.296494+0000","last_became_peered":"2024-05-10T11:14:58.296494+0000","last_unstale":"2024-05-10T11:14:58.304170+0000","last_undegraded":"2024-05-10T11:14:58.304170+0000","last_fullsized":"2024-05-10T11:14:58.304170+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:54.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307806+0000","last_change":"2024-05-10T11:14:58.303310+0000","last_active":"2024-05-10T11:14:58.307806+0000","last_peered":"2024-05-10T11:14:58.307806+0000","last_clean":"2024-05-10T11:14:58.307806+0000","last_became_active":"2024-05-10T11:14:58.303026+0000","last_became_peered":"2024-05-10T11:14:58.303026+0000","last_unstale":"2024-05-10T11:14:58.307806+0000","last_undegraded":"2024-05-10T11:14:58.307806+0000","last_fullsized":"2024-05-10T11:14:58.307806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:31:04.702811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270646+0000","last_change":"2024-05-10T11:14:57.270646+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270646+0000","last_undegraded":"2024-05-10T11:14:57.270646+0000","last_fullsized":"2024-05-10T11:14:57.270646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274602+0000","last_change":"2024-05-10T11:14:57.274602+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274602+0000","last_undegraded":"2024-05-10T11:14:57.274602+0000","last_fullsized":"2024-05-10T11:14:57.274602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306599+0000","last_change":"2024-05-10T11:14:58.294765+0000","last_active":"2024-05-10T11:14:58.306599+0000","last_peered":"2024-05-10T11:14:58.306599+0000","last_clean":"2024-05-10T11:14:58.306599+0000","last_became_active":"2024-05-10T11:14:58.294194+0000","last_became_peered":"2024-05-10T11:14:58.294194+0000","last_unstale":"2024-05-10T11:14:58.306599+0000","last_undegraded":"2024-05-10T11:14:58.306599+0000","last_fullsized":"2024-05-10T11:14:58.306599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300735+0000","last_change":"2024-05-10T11:14:58.291296+0000","last_active":"2024-05-10T11:14:58.300735+0000","last_peered":"2024-05-10T11:14:58.300735+0000","last_clean":"2024-05-10T11:14:58.300735+0000","last_became_active":"2024-05-10T11:14:58.291032+0000","last_became_peered":"2024-05-10T11:14:58.291032+0000","last_unstale":"2024-05-10T11:14:58.300735+0000","last_undegraded":"2024-05-10T11:14:58.300735+0000","last_fullsized":"2024-05-10T11:14:58.300735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274968+0000","last_change":"2024-05-10T11:14:57.274968+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274968+0000","last_undegraded":"2024-05-10T11:14:57.274968+0000","last_fullsized":"2024-05-10T11:14:57.274968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293720+0000","last_change":"2024-05-10T11:14:58.292301+0000","last_active":"2024-05-10T11:14:59.293720+0000","last_peered":"2024-05-10T11:14:59.293720+0000","last_clean":"2024-05-10T11:14:59.293720+0000","last_became_active":"2024-05-10T11:14:58.292011+0000","last_became_peered":"2024-05-10T11:14:58.292011+0000","last_unstale":"2024-05-10T11:14:59.293720+0000","last_undegraded":"2024-05-10T11:14:59.293720+0000","last_fullsized":"2024-05-10T11:14:59.293720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:27.519315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273321+0000","last_change":"2024-05-10T11:14:57.273321+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273321+0000","last_undegraded":"2024-05-10T11:14:57.273321+0000","last_fullsized":"2024-05-10T11:14:57.273321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.272697+0000","last_change":"2024-05-10T11:14:57.272697+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.272697+0000","last_undegraded":"2024-05-10T11:14:57.272697+0000","last_fullsized":"2024-05-10T11:14:57.272697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304156+0000","last_change":"2024-05-10T11:14:58.296984+0000","last_active":"2024-05-10T11:14:58.304156+0000","last_peered":"2024-05-10T11:14:58.304156+0000","last_clean":"2024-05-10T11:14:58.304156+0000","last_became_active":"2024-05-10T11:14:58.296624+0000","last_became_peered":"2024-05-10T11:14:58.296624+0000","last_unstale":"2024-05-10T11:14:58.304156+0000","last_undegraded":"2024-05-10T11:14:58.304156+0000","last_fullsized":"2024-05-10T11:14:58.304156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:10.187464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293927+0000","last_change":"2024-05-10T11:14:58.294450+0000","last_active":"2024-05-10T11:14:59.293927+0000","last_peered":"2024-05-10T11:14:59.293927+0000","last_clean":"2024-05-10T11:14:59.293927+0000","last_became_active":"2024-05-10T11:14:58.294145+0000","last_became_peered":"2024-05-10T11:14:58.294145+0000","last_unstale":"2024-05-10T11:14:59.293927+0000","last_undegraded":"2024-05-10T11:14:59.293927+0000","last_fullsized":"2024-05-10T11:14:59.293927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293796+0000","last_change":"2024-05-10T11:14:58.295269+0000","last_active":"2024-05-10T11:14:59.293796+0000","last_peered":"2024-05-10T11:14:59.293796+0000","last_clean":"2024-05-10T11:14:59.293796+0000","last_became_active":"2024-05-10T11:14:58.294820+0000","last_became_peered":"2024-05-10T11:14:58.294820+0000","last_unstale":"2024-05-10T11:14:59.293796+0000","last_undegraded":"2024-05-10T11:14:59.293796+0000","last_fullsized":"2024-05-10T11:14:59.293796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:37.670772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306749+0000","last_change":"2024-05-10T11:14:58.292277+0000","last_active":"2024-05-10T11:14:58.306749+0000","last_peered":"2024-05-10T11:14:58.306749+0000","last_clean":"2024-05-10T11:14:58.306749+0000","last_became_active":"2024-05-10T11:14:58.291531+0000","last_became_peered":"2024-05-10T11:14:58.291531+0000","last_unstale":"2024-05-10T11:14:58.306749+0000","last_undegraded":"2024-05-10T11:14:58.306749+0000","last_fullsized":"2024-05-10T11:14:58.306749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.278535+0000","last_change":"2024-05-10T11:14:57.278535+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.278535+0000","last_undegraded":"2024-05-10T11:14:57.278535+0000","last_fullsized":"2024-05-10T11:14:57.278535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.312652+0000","last_change":"2024-05-10T11:14:58.309493+0000","last_active":"2024-05-10T11:14:58.312652+0000","last_peered":"2024-05-10T11:14:58.312652+0000","last_clean":"2024-05-10T11:14:58.312652+0000","last_became_active":"2024-05-10T11:14:58.308480+0000","last_became_peered":"2024-05-10T11:14:58.308480+0000","last_unstale":"2024-05-10T11:14:58.312652+0000","last_undegraded":"2024-05-10T11:14:58.312652+0000","last_fullsized":"2024-05-10T11:14:58.312652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:00:22.050849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293420+0000","last_change":"2024-05-10T11:14:58.304102+0000","last_active":"2024-05-10T11:14:59.293420+0000","last_peered":"2024-05-10T11:14:59.293420+0000","last_clean":"2024-05-10T11:14:59.293420+0000","last_became_active":"2024-05-10T11:14:58.303832+0000","last_became_peered":"2024-05-10T11:14:58.303832+0000","last_unstale":"2024-05-10T11:14:59.293420+0000","last_undegraded":"2024-05-10T11:14:59.293420+0000","last_fullsized":"2024-05-10T11:14:59.293420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:24.954543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306675+0000","last_change":"2024-05-10T11:14:58.290600+0000","last_active":"2024-05-10T11:14:58.306675+0000","last_peered":"2024-05-10T11:14:58.306675+0000","last_clean":"2024-05-10T11:14:58.306675+0000","last_became_active":"2024-05-10T11:14:58.290320+0000","last_became_peered":"2024-05-10T11:14:58.290320+0000","last_unstale":"2024-05-10T11:14:58.306675+0000","last_undegraded":"2024-05-10T11:14:58.306675+0000","last_fullsized":"2024-05-10T11:14:58.306675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:01.249122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271538+0000","last_change":"2024-05-10T11:14:57.271538+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271538+0000","last_undegraded":"2024-05-10T11:14:57.271538+0000","last_fullsized":"2024-05-10T11:14:57.271538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299993+0000","last_change":"2024-05-10T11:14:58.293177+0000","last_active":"2024-05-10T11:14:58.299993+0000","last_peered":"2024-05-10T11:14:58.299993+0000","last_clean":"2024-05-10T11:14:58.299993+0000","last_became_active":"2024-05-10T11:14:58.292884+0000","last_became_peered":"2024-05-10T11:14:58.292884+0000","last_unstale":"2024-05-10T11:14:58.299993+0000","last_undegraded":"2024-05-10T11:14:58.299993+0000","last_fullsized":"2024-05-10T11:14:58.299993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288082+0000","last_change":"2024-05-10T11:14:57.284107+0000","last_active":"2024-05-10T11:14:57.288082+0000","last_peered":"2024-05-10T11:14:57.288082+0000","last_clean":"2024-05-10T11:14:57.288082+0000","last_became_active":"2024-05-10T11:14:57.283807+0000","last_became_peered":"2024-05-10T11:14:57.283807+0000","last_unstale":"2024-05-10T11:14:57.288082+0000","last_undegraded":"2024-05-10T11:14:57.288082+0000","last_fullsized":"2024-05-10T11:14:57.288082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:06.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306728+0000","last_change":"2024-05-10T11:14:58.291184+0000","last_active":"2024-05-10T11:14:58.306728+0000","last_peered":"2024-05-10T11:14:58.306728+0000","last_clean":"2024-05-10T11:14:58.306728+0000","last_became_active":"2024-05-10T11:14:58.290918+0000","last_became_peered":"2024-05-10T11:14:58.290918+0000","last_unstale":"2024-05-10T11:14:58.306728+0000","last_undegraded":"2024-05-10T11:14:58.306728+0000","last_fullsized":"2024-05-10T11:14:58.306728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283390+0000","last_change":"2024-05-10T11:14:57.278080+0000","last_active":"2024-05-10T11:14:57.283390+0000","last_peered":"2024-05-10T11:14:57.283390+0000","last_clean":"2024-05-10T11:14:57.283390+0000","last_became_active":"2024-05-10T11:14:57.277750+0000","last_became_peered":"2024-05-10T11:14:57.277750+0000","last_unstale":"2024-05-10T11:14:57.283390+0000","last_undegraded":"2024-05-10T11:14:57.283390+0000","last_fullsized":"2024-05-10T11:14:57.283390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:27:23.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271033+0000","last_change":"2024-05-10T11:14:57.271033+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271033+0000","last_undegraded":"2024-05-10T11:14:57.271033+0000","last_fullsized":"2024-05-10T11:14:57.271033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283415+0000","last_change":"2024-05-10T11:14:57.278386+0000","last_active":"2024-05-10T11:14:57.283415+0000","last_peered":"2024-05-10T11:14:57.283415+0000","last_clean":"2024-05-10T11:14:57.283415+0000","last_became_active":"2024-05-10T11:14:57.278063+0000","last_became_peered":"2024-05-10T11:14:57.278063+0000","last_unstale":"2024-05-10T11:14:57.283415+0000","last_undegraded":"2024-05-10T11:14:57.283415+0000","last_fullsized":"2024-05-10T11:14:57.283415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:17.184537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304139+0000","last_change":"2024-05-10T11:14:58.296717+0000","last_active":"2024-05-10T11:14:58.304139+0000","last_peered":"2024-05-10T11:14:58.304139+0000","last_clean":"2024-05-10T11:14:58.304139+0000","last_became_active":"2024-05-10T11:14:58.296326+0000","last_became_peered":"2024-05-10T11:14:58.296326+0000","last_unstale":"2024-05-10T11:14:58.304139+0000","last_undegraded":"2024-05-10T11:14:58.304139+0000","last_fullsized":"2024-05-10T11:14:58.304139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:00.644583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287875+0000","last_change":"2024-05-10T11:14:57.284933+0000","last_active":"2024-05-10T11:14:57.287875+0000","last_peered":"2024-05-10T11:14:57.287875+0000","last_clean":"2024-05-10T11:14:57.287875+0000","last_became_active":"2024-05-10T11:14:57.284634+0000","last_became_peered":"2024-05-10T11:14:57.284634+0000","last_unstale":"2024-05-10T11:14:57.287875+0000","last_undegraded":"2024-05-10T11:14:57.287875+0000","last_fullsized":"2024-05-10T11:14:57.287875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:09.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270165+0000","last_change":"2024-05-10T11:14:57.270165+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270165+0000","last_undegraded":"2024-05-10T11:14:57.270165+0000","last_fullsized":"2024-05-10T11:14:57.270165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288408+0000","last_change":"2024-05-10T11:14:57.282928+0000","last_active":"2024-05-10T11:14:57.288408+0000","last_peered":"2024-05-10T11:14:57.288408+0000","last_clean":"2024-05-10T11:14:57.288408+0000","last_became_active":"2024-05-10T11:14:57.282648+0000","last_became_peered":"2024-05-10T11:14:57.282648+0000","last_unstale":"2024-05-10T11:14:57.288408+0000","last_undegraded":"2024-05-10T11:14:57.288408+0000","last_fullsized":"2024-05-10T11:14:57.288408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:55.414121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273482+0000","last_change":"2024-05-10T11:14:57.273482+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273482+0000","last_undegraded":"2024-05-10T11:14:57.273482+0000","last_fullsized":"2024-05-10T11:14:57.273482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288470+0000","last_change":"2024-05-10T11:14:57.281848+0000","last_active":"2024-05-10T11:14:57.288470+0000","last_peered":"2024-05-10T11:14:57.288470+0000","last_clean":"2024-05-10T11:14:57.288470+0000","last_became_active":"2024-05-10T11:14:57.281514+0000","last_became_peered":"2024-05-10T11:14:57.281514+0000","last_unstale":"2024-05-10T11:14:57.288470+0000","last_undegraded":"2024-05-10T11:14:57.288470+0000","last_fullsized":"2024-05-10T11:14:57.288470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:09.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.303741+0000","last_change":"2024-05-10T11:14:58.301360+0000","last_active":"2024-05-10T11:14:58.303741+0000","last_peered":"2024-05-10T11:14:58.303741+0000","last_clean":"2024-05-10T11:14:58.303741+0000","last_became_active":"2024-05-10T11:14:58.301013+0000","last_became_peered":"2024-05-10T11:14:58.301013+0000","last_unstale":"2024-05-10T11:14:58.303741+0000","last_undegraded":"2024-05-10T11:14:58.303741+0000","last_fullsized":"2024-05-10T11:14:58.303741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288594+0000","last_change":"2024-05-10T11:14:57.284239+0000","last_active":"2024-05-10T11:14:57.288594+0000","last_peered":"2024-05-10T11:14:57.288594+0000","last_clean":"2024-05-10T11:14:57.288594+0000","last_became_active":"2024-05-10T11:14:57.283872+0000","last_became_peered":"2024-05-10T11:14:57.283872+0000","last_unstale":"2024-05-10T11:14:57.288594+0000","last_undegraded":"2024-05-10T11:14:57.288594+0000","last_fullsized":"2024-05-10T11:14:57.288594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:57.173000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274149+0000","last_change":"2024-05-10T11:14:57.274149+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274149+0000","last_undegraded":"2024-05-10T11:14:57.274149+0000","last_fullsized":"2024-05-10T11:14:57.274149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.284885+0000","last_change":"2024-05-10T11:14:57.283820+0000","last_active":"2024-05-10T11:14:58.284885+0000","last_peered":"2024-05-10T11:14:58.284885+0000","last_clean":"2024-05-10T11:14:58.284885+0000","last_became_active":"2024-05-10T11:14:57.283489+0000","last_became_peered":"2024-05-10T11:14:57.283489+0000","last_unstale":"2024-05-10T11:14:58.284885+0000","last_undegraded":"2024-05-10T11:14:58.284885+0000","last_fullsized":"2024-05-10T11:14:58.284885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.244441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277648+0000","last_change":"2024-05-10T11:14:57.277648+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277648+0000","last_undegraded":"2024-05-10T11:14:57.277648+0000","last_fullsized":"2024-05-10T11:14:57.277648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.286683+0000","last_change":"2024-05-10T11:14:57.285058+0000","last_active":"2024-05-10T11:14:58.286683+0000","last_peered":"2024-05-10T11:14:58.286683+0000","last_clean":"2024-05-10T11:14:58.286683+0000","last_became_active":"2024-05-10T11:14:57.284745+0000","last_became_peered":"2024-05-10T11:14:57.284745+0000","last_unstale":"2024-05-10T11:14:58.286683+0000","last_undegraded":"2024-05-10T11:14:58.286683+0000","last_fullsized":"2024-05-10T11:14:58.286683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:26.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273343+0000","last_change":"2024-05-10T11:14:57.273343+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273343+0000","last_undegraded":"2024-05-10T11:14:57.273343+0000","last_fullsized":"2024-05-10T11:14:57.273343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.282335+0000","last_change":"2024-05-10T11:14:57.285480+0000","last_active":"2024-05-10T11:14:58.282335+0000","last_peered":"2024-05-10T11:14:58.282335+0000","last_clean":"2024-05-10T11:14:58.282335+0000","last_became_active":"2024-05-10T11:14:57.284658+0000","last_became_peered":"2024-05-10T11:14:57.284658+0000","last_unstale":"2024-05-10T11:14:58.282335+0000","last_undegraded":"2024-05-10T11:14:58.282335+0000","last_fullsized":"2024-05-10T11:14:58.282335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:50.772681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300570+0000","last_change":"2024-05-10T11:14:58.293724+0000","last_active":"2024-05-10T11:14:58.300570+0000","last_peered":"2024-05-10T11:14:58.300570+0000","last_clean":"2024-05-10T11:14:58.300570+0000","last_became_active":"2024-05-10T11:14:58.293401+0000","last_became_peered":"2024-05-10T11:14:58.293401+0000","last_unstale":"2024-05-10T11:14:58.300570+0000","last_undegraded":"2024-05-10T11:14:58.300570+0000","last_fullsized":"2024-05-10T11:14:58.300570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309144+0000","last_change":"2024-05-10T11:14:57.285078+0000","last_active":"2024-05-10T11:14:58.309144+0000","last_peered":"2024-05-10T11:14:58.309144+0000","last_clean":"2024-05-10T11:14:58.309144+0000","last_became_active":"2024-05-10T11:14:57.284761+0000","last_became_peered":"2024-05-10T11:14:57.284761+0000","last_unstale":"2024-05-10T11:14:58.309144+0000","last_undegraded":"2024-05-10T11:14:58.309144+0000","last_fullsized":"2024-05-10T11:14:58.309144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:06:59.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306505+0000","last_change":"2024-05-10T11:14:58.293097+0000","last_active":"2024-05-10T11:14:58.306505+0000","last_peered":"2024-05-10T11:14:58.306505+0000","last_clean":"2024-05-10T11:14:58.306505+0000","last_became_active":"2024-05-10T11:14:58.292833+0000","last_became_peered":"2024-05-10T11:14:58.292833+0000","last_unstale":"2024-05-10T11:14:58.306505+0000","last_undegraded":"2024-05-10T11:14:58.306505+0000","last_fullsized":"2024-05-10T11:14:58.306505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288111+0000","last_change":"2024-05-10T11:14:57.283470+0000","last_active":"2024-05-10T11:14:57.288111+0000","last_peered":"2024-05-10T11:14:57.288111+0000","last_clean":"2024-05-10T11:14:57.288111+0000","last_became_active":"2024-05-10T11:14:57.283190+0000","last_became_peered":"2024-05-10T11:14:57.283190+0000","last_unstale":"2024-05-10T11:14:57.288111+0000","last_undegraded":"2024-05-10T11:14:57.288111+0000","last_fullsized":"2024-05-10T11:14:57.288111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:39.017034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308266+0000","last_change":"2024-05-10T11:14:58.302029+0000","last_active":"2024-05-10T11:14:58.308266+0000","last_peered":"2024-05-10T11:14:58.308266+0000","last_clean":"2024-05-10T11:14:58.308266+0000","last_became_active":"2024-05-10T11:14:58.301749+0000","last_became_peered":"2024-05-10T11:14:58.301749+0000","last_unstale":"2024-05-10T11:14:58.308266+0000","last_undegraded":"2024-05-10T11:14:58.308266+0000","last_fullsized":"2024-05-10T11:14:58.308266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308805+0000","last_change":"2024-05-10T11:14:57.288628+0000","last_active":"2024-05-10T11:14:58.308805+0000","last_peered":"2024-05-10T11:14:58.308805+0000","last_clean":"2024-05-10T11:14:58.308805+0000","last_became_active":"2024-05-10T11:14:57.288267+0000","last_became_peered":"2024-05-10T11:14:57.288267+0000","last_unstale":"2024-05-10T11:14:58.308805+0000","last_undegraded":"2024-05-10T11:14:58.308805+0000","last_fullsized":"2024-05-10T11:14:58.308805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:52.106425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293396+0000","last_change":"2024-05-10T11:14:58.292318+0000","last_active":"2024-05-10T11:14:59.293396+0000","last_peered":"2024-05-10T11:14:59.293396+0000","last_clean":"2024-05-10T11:14:59.293396+0000","last_became_active":"2024-05-10T11:14:58.292027+0000","last_became_peered":"2024-05-10T11:14:58.292027+0000","last_unstale":"2024-05-10T11:14:59.293396+0000","last_undegraded":"2024-05-10T11:14:59.293396+0000","last_fullsized":"2024-05-10T11:14:59.293396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:52.214989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293493+0000","last_change":"2024-05-10T11:14:57.285459+0000","last_active":"2024-05-10T11:14:59.293493+0000","last_peered":"2024-05-10T11:14:59.293493+0000","last_clean":"2024-05-10T11:14:59.293493+0000","last_became_active":"2024-05-10T11:14:57.285146+0000","last_became_peered":"2024-05-10T11:14:57.285146+0000","last_unstale":"2024-05-10T11:14:59.293493+0000","last_undegraded":"2024-05-10T11:14:59.293493+0000","last_fullsized":"2024-05-10T11:14:59.293493+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:54.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299748+0000","last_change":"2024-05-10T11:14:58.290578+0000","last_active":"2024-05-10T11:14:58.299748+0000","last_peered":"2024-05-10T11:14:58.299748+0000","last_clean":"2024-05-10T11:14:58.299748+0000","last_became_active":"2024-05-10T11:14:58.290298+0000","last_became_peered":"2024-05-10T11:14:58.290298+0000","last_unstale":"2024-05-10T11:14:58.299748+0000","last_undegraded":"2024-05-10T11:14:58.299748+0000","last_fullsized":"2024-05-10T11:14:58.299748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.293943+0000","last_change":"2024-05-10T11:14:57.288627+0000","last_active":"2024-05-10T11:14:58.293943+0000","last_peered":"2024-05-10T11:14:58.293943+0000","last_clean":"2024-05-10T11:14:58.293943+0000","last_became_active":"2024-05-10T11:14:57.288307+0000","last_became_peered":"2024-05-10T11:14:57.288307+0000","last_unstale":"2024-05-10T11:14:58.293943+0000","last_undegraded":"2024-05-10T11:14:58.293943+0000","last_fullsized":"2024-05-10T11:14:58.293943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:36.022029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274125+0000","last_change":"2024-05-10T11:14:57.274125+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274125+0000","last_undegraded":"2024-05-10T11:14:57.274125+0000","last_fullsized":"2024-05-10T11:14:57.274125+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.313414+0000","last_change":"2024-05-10T11:14:57.278123+0000","last_active":"2024-05-10T11:14:58.313414+0000","last_peered":"2024-05-10T11:14:58.313414+0000","last_clean":"2024-05-10T11:14:58.313414+0000","last_became_active":"2024-05-10T11:14:57.277822+0000","last_became_peered":"2024-05-10T11:14:57.277822+0000","last_unstale":"2024-05-10T11:14:58.313414+0000","last_undegraded":"2024-05-10T11:14:58.313414+0000","last_fullsized":"2024-05-10T11:14:58.313414+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:57.287132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307694+0000","last_change":"2024-05-10T11:14:58.303477+0000","last_active":"2024-05-10T11:14:58.307694+0000","last_peered":"2024-05-10T11:14:58.307694+0000","last_clean":"2024-05-10T11:14:58.307694+0000","last_became_active":"2024-05-10T11:14:58.303122+0000","last_became_peered":"2024-05-10T11:14:58.303122+0000","last_unstale":"2024-05-10T11:14:58.307694+0000","last_undegraded":"2024-05-10T11:14:58.307694+0000","last_fullsized":"2024-05-10T11:14:58.307694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:17.047773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293870+0000","last_change":"2024-05-10T11:14:57.281686+0000","last_active":"2024-05-10T11:14:59.293870+0000","last_peered":"2024-05-10T11:14:59.293870+0000","last_clean":"2024-05-10T11:14:59.293870+0000","last_became_active":"2024-05-10T11:14:57.281376+0000","last_became_peered":"2024-05-10T11:14:57.281376+0000","last_unstale":"2024-05-10T11:14:59.293870+0000","last_undegraded":"2024-05-10T11:14:59.293870+0000","last_fullsized":"2024-05-10T11:14:59.293870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:26.398829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305865+0000","last_change":"2024-05-10T11:14:58.301783+0000","last_active":"2024-05-10T11:14:58.305865+0000","last_peered":"2024-05-10T11:14:58.305865+0000","last_clean":"2024-05-10T11:14:58.305865+0000","last_became_active":"2024-05-10T11:14:58.301333+0000","last_became_peered":"2024-05-10T11:14:58.301333+0000","last_unstale":"2024-05-10T11:14:58.305865+0000","last_undegraded":"2024-05-10T11:14:58.305865+0000","last_fullsized":"2024-05-10T11:14:58.305865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:29.273264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309603+0000","last_change":"2024-05-10T11:14:57.291311+0000","last_active":"2024-05-10T11:14:58.309603+0000","last_peered":"2024-05-10T11:14:58.309603+0000","last_clean":"2024-05-10T11:14:58.309603+0000","last_became_active":"2024-05-10T11:14:57.291046+0000","last_became_peered":"2024-05-10T11:14:57.291046+0000","last_unstale":"2024-05-10T11:14:58.309603+0000","last_undegraded":"2024-05-10T11:14:58.309603+0000","last_fullsized":"2024-05-10T11:14:58.309603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:09.641351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306454+0000","last_change":"2024-05-10T11:14:58.294613+0000","last_active":"2024-05-10T11:14:58.306454+0000","last_peered":"2024-05-10T11:14:58.306454+0000","last_clean":"2024-05-10T11:14:58.306454+0000","last_became_active":"2024-05-10T11:14:58.291580+0000","last_became_peered":"2024-05-10T11:14:58.291580+0000","last_unstale":"2024-05-10T11:14:58.306454+0000","last_undegraded":"2024-05-10T11:14:58.306454+0000","last_fullsized":"2024-05-10T11:14:58.306454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307967+0000","last_change":"2024-05-10T11:14:57.286479+0000","last_active":"2024-05-10T11:14:58.307967+0000","last_peered":"2024-05-10T11:14:58.307967+0000","last_clean":"2024-05-10T11:14:58.307967+0000","last_became_active":"2024-05-10T11:14:57.286168+0000","last_became_peered":"2024-05-10T11:14:57.286168+0000","last_unstale":"2024-05-10T11:14:58.307967+0000","last_undegraded":"2024-05-10T11:14:58.307967+0000","last_fullsized":"2024-05-10T11:14:58.307967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:50.752141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299821+0000","last_change":"2024-05-10T11:14:58.291617+0000","last_active":"2024-05-10T11:14:58.299821+0000","last_peered":"2024-05-10T11:14:58.299821+0000","last_clean":"2024-05-10T11:14:58.299821+0000","last_became_active":"2024-05-10T11:14:58.291313+0000","last_became_peered":"2024-05-10T11:14:58.291313+0000","last_unstale":"2024-05-10T11:14:58.299821+0000","last_undegraded":"2024-05-10T11:14:58.299821+0000","last_fullsized":"2024-05-10T11:14:58.299821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287797+0000","last_change":"2024-05-10T11:14:57.280903+0000","last_active":"2024-05-10T11:14:57.287797+0000","last_peered":"2024-05-10T11:14:57.287797+0000","last_clean":"2024-05-10T11:14:57.287797+0000","last_became_active":"2024-05-10T11:14:57.280595+0000","last_became_peered":"2024-05-10T11:14:57.280595+0000","last_unstale":"2024-05-10T11:14:57.287797+0000","last_undegraded":"2024-05-10T11:14:57.287797+0000","last_fullsized":"2024-05-10T11:14:57.287797+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:17.184537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270526+0000","last_change":"2024-05-10T11:14:57.270526+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270526+0000","last_undegraded":"2024-05-10T11:14:57.270526+0000","last_fullsized":"2024-05-10T11:14:57.270526+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287922+0000","last_change":"2024-05-10T11:14:57.285784+0000","last_active":"2024-05-10T11:14:57.287922+0000","last_peered":"2024-05-10T11:14:57.287922+0000","last_clean":"2024-05-10T11:14:57.287922+0000","last_became_active":"2024-05-10T11:14:57.285511+0000","last_became_peered":"2024-05-10T11:14:57.285511+0000","last_unstale":"2024-05-10T11:14:57.287922+0000","last_undegraded":"2024-05-10T11:14:57.287922+0000","last_fullsized":"2024-05-10T11:14:57.287922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:55.414121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293402+0000","last_change":"2024-05-10T11:14:58.294900+0000","last_active":"2024-05-10T11:14:59.293402+0000","last_peered":"2024-05-10T11:14:59.293402+0000","last_clean":"2024-05-10T11:14:59.293402+0000","last_became_active":"2024-05-10T11:14:58.293875+0000","last_became_peered":"2024-05-10T11:14:58.293875+0000","last_unstale":"2024-05-10T11:14:59.293402+0000","last_undegraded":"2024-05-10T11:14:59.293402+0000","last_fullsized":"2024-05-10T11:14:59.293402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:35.553377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293556+0000","last_change":"2024-05-10T11:14:57.281997+0000","last_active":"2024-05-10T11:14:59.293556+0000","last_peered":"2024-05-10T11:14:59.293556+0000","last_clean":"2024-05-10T11:14:59.293556+0000","last_became_active":"2024-05-10T11:14:57.281468+0000","last_became_peered":"2024-05-10T11:14:57.281468+0000","last_unstale":"2024-05-10T11:14:59.293556+0000","last_undegraded":"2024-05-10T11:14:59.293556+0000","last_fullsized":"2024-05-10T11:14:59.293556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:08.557076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300074+0000","last_change":"2024-05-10T11:14:58.292189+0000","last_active":"2024-05-10T11:14:58.300074+0000","last_peered":"2024-05-10T11:14:58.300074+0000","last_clean":"2024-05-10T11:14:58.300074+0000","last_became_active":"2024-05-10T11:14:58.291853+0000","last_became_peered":"2024-05-10T11:14:58.291853+0000","last_unstale":"2024-05-10T11:14:58.300074+0000","last_undegraded":"2024-05-10T11:14:58.300074+0000","last_fullsized":"2024-05-10T11:14:58.300074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.293002+0000","last_change":"2024-05-10T11:14:57.286677+0000","last_active":"2024-05-10T11:14:57.293002+0000","last_peered":"2024-05-10T11:14:57.293002+0000","last_clean":"2024-05-10T11:14:57.293002+0000","last_became_active":"2024-05-10T11:14:57.286392+0000","last_became_peered":"2024-05-10T11:14:57.286392+0000","last_unstale":"2024-05-10T11:14:57.293002+0000","last_undegraded":"2024-05-10T11:14:57.293002+0000","last_fullsized":"2024-05-10T11:14:57.293002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:13.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270508+0000","last_change":"2024-05-10T11:14:57.270508+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270508+0000","last_undegraded":"2024-05-10T11:14:57.270508+0000","last_fullsized":"2024-05-10T11:14:57.270508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.294020+0000","last_change":"2024-05-10T11:14:57.283832+0000","last_active":"2024-05-10T11:14:59.294020+0000","last_peered":"2024-05-10T11:14:59.294020+0000","last_clean":"2024-05-10T11:14:59.294020+0000","last_became_active":"2024-05-10T11:14:57.283428+0000","last_became_peered":"2024-05-10T11:14:57.283428+0000","last_unstale":"2024-05-10T11:14:59.294020+0000","last_undegraded":"2024-05-10T11:14:59.294020+0000","last_fullsized":"2024-05-10T11:14:59.294020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271126+0000","last_change":"2024-05-10T11:14:57.271126+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271126+0000","last_undegraded":"2024-05-10T11:14:57.271126+0000","last_fullsized":"2024-05-10T11:14:57.271126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293984+0000","last_change":"2024-05-10T11:14:57.282035+0000","last_active":"2024-05-10T11:14:59.293984+0000","last_peered":"2024-05-10T11:14:59.293984+0000","last_clean":"2024-05-10T11:14:59.293984+0000","last_became_active":"2024-05-10T11:14:57.281774+0000","last_became_peered":"2024-05-10T11:14:57.281774+0000","last_unstale":"2024-05-10T11:14:59.293984+0000","last_undegraded":"2024-05-10T11:14:59.293984+0000","last_fullsized":"2024-05-10T11:14:59.293984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:13.792438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293942+0000","last_change":"2024-05-10T11:14:58.296279+0000","last_active":"2024-05-10T11:14:59.293942+0000","last_peered":"2024-05-10T11:14:59.293942+0000","last_clean":"2024-05-10T11:14:59.293942+0000","last_became_active":"2024-05-10T11:14:58.296001+0000","last_became_peered":"2024-05-10T11:14:58.296001+0000","last_unstale":"2024-05-10T11:14:59.293942+0000","last_undegraded":"2024-05-10T11:14:59.293942+0000","last_fullsized":"2024-05-10T11:14:59.293942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283395+0000","last_change":"2024-05-10T11:14:57.277996+0000","last_active":"2024-05-10T11:14:57.283395+0000","last_peered":"2024-05-10T11:14:57.283395+0000","last_clean":"2024-05-10T11:14:57.283395+0000","last_became_active":"2024-05-10T11:14:57.277696+0000","last_became_peered":"2024-05-10T11:14:57.277696+0000","last_unstale":"2024-05-10T11:14:57.283395+0000","last_undegraded":"2024-05-10T11:14:57.283395+0000","last_fullsized":"2024-05-10T11:14:57.283395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299916+0000","last_change":"2024-05-10T11:14:58.292302+0000","last_active":"2024-05-10T11:14:58.299916+0000","last_peered":"2024-05-10T11:14:58.299916+0000","last_clean":"2024-05-10T11:14:58.299916+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.299916+0000","last_undegraded":"2024-05-10T11:14:58.299916+0000","last_fullsized":"2024-05-10T11:14:58.299916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.285523+0000","last_change":"2024-05-10T11:14:57.281319+0000","last_active":"2024-05-10T11:14:57.285523+0000","last_peered":"2024-05-10T11:14:57.285523+0000","last_clean":"2024-05-10T11:14:57.285523+0000","last_became_active":"2024-05-10T11:14:57.281041+0000","last_became_peered":"2024-05-10T11:14:57.281041+0000","last_unstale":"2024-05-10T11:14:57.285523+0000","last_undegraded":"2024-05-10T11:14:57.285523+0000","last_fullsized":"2024-05-10T11:14:57.285523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:51.028755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300460+0000","last_change":"2024-05-10T11:14:58.299193+0000","last_active":"2024-05-10T11:14:58.300460+0000","last_peered":"2024-05-10T11:14:58.300460+0000","last_clean":"2024-05-10T11:14:58.300460+0000","last_became_active":"2024-05-10T11:14:58.293535+0000","last_became_peered":"2024-05-10T11:14:58.293535+0000","last_unstale":"2024-05-10T11:14:58.300460+0000","last_undegraded":"2024-05-10T11:14:58.300460+0000","last_fullsized":"2024-05-10T11:14:58.300460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:26.263371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289955+0000","last_change":"2024-05-10T11:14:57.288619+0000","last_active":"2024-05-10T11:14:58.289955+0000","last_peered":"2024-05-10T11:14:58.289955+0000","last_clean":"2024-05-10T11:14:58.289955+0000","last_became_active":"2024-05-10T11:14:57.288345+0000","last_became_peered":"2024-05-10T11:14:57.288345+0000","last_unstale":"2024-05-10T11:14:58.289955+0000","last_undegraded":"2024-05-10T11:14:58.289955+0000","last_fullsized":"2024-05-10T11:14:58.289955+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:56.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309165+0000","last_change":"2024-05-10T11:14:58.307212+0000","last_active":"2024-05-10T11:14:58.309165+0000","last_peered":"2024-05-10T11:14:58.309165+0000","last_clean":"2024-05-10T11:14:58.309165+0000","last_became_active":"2024-05-10T11:14:58.306894+0000","last_became_peered":"2024-05-10T11:14:58.306894+0000","last_unstale":"2024-05-10T11:14:58.309165+0000","last_undegraded":"2024-05-10T11:14:58.309165+0000","last_fullsized":"2024-05-10T11:14:58.309165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288545+0000","last_change":"2024-05-10T11:14:57.285145+0000","last_active":"2024-05-10T11:14:57.288545+0000","last_peered":"2024-05-10T11:14:57.288545+0000","last_clean":"2024-05-10T11:14:57.288545+0000","last_became_active":"2024-05-10T11:14:57.284872+0000","last_became_peered":"2024-05-10T11:14:57.284872+0000","last_unstale":"2024-05-10T11:14:57.288545+0000","last_undegraded":"2024-05-10T11:14:57.288545+0000","last_fullsized":"2024-05-10T11:14:57.288545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:39.777254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.276036+0000","last_change":"2024-05-10T11:14:57.276036+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.276036+0000","last_undegraded":"2024-05-10T11:14:57.276036+0000","last_fullsized":"2024-05-10T11:14:57.276036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288615+0000","last_change":"2024-05-10T11:14:57.284501+0000","last_active":"2024-05-10T11:14:57.288615+0000","last_peered":"2024-05-10T11:14:57.288615+0000","last_clean":"2024-05-10T11:14:57.288615+0000","last_became_active":"2024-05-10T11:14:57.283858+0000","last_became_peered":"2024-05-10T11:14:57.283858+0000","last_unstale":"2024-05-10T11:14:57.288615+0000","last_undegraded":"2024-05-10T11:14:57.288615+0000","last_fullsized":"2024-05-10T11:14:57.288615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.826064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271224+0000","last_change":"2024-05-10T11:14:57.271224+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271224+0000","last_undegraded":"2024-05-10T11:14:57.271224+0000","last_fullsized":"2024-05-10T11:14:57.271224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288077+0000","last_change":"2024-05-10T11:14:57.284893+0000","last_active":"2024-05-10T11:14:57.288077+0000","last_peered":"2024-05-10T11:14:57.288077+0000","last_clean":"2024-05-10T11:14:57.288077+0000","last_became_active":"2024-05-10T11:14:57.284424+0000","last_became_peered":"2024-05-10T11:14:57.284424+0000","last_unstale":"2024-05-10T11:14:57.288077+0000","last_undegraded":"2024-05-10T11:14:57.288077+0000","last_fullsized":"2024-05-10T11:14:57.288077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:59.649807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300040+0000","last_change":"2024-05-10T11:14:58.293110+0000","last_active":"2024-05-10T11:14:58.300040+0000","last_peered":"2024-05-10T11:14:58.300040+0000","last_clean":"2024-05-10T11:14:58.300040+0000","last_became_active":"2024-05-10T11:14:58.292854+0000","last_became_peered":"2024-05-10T11:14:58.292854+0000","last_unstale":"2024-05-10T11:14:58.300040+0000","last_undegraded":"2024-05-10T11:14:58.300040+0000","last_fullsized":"2024-05-10T11:14:58.300040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288438+0000","last_change":"2024-05-10T11:14:57.282272+0000","last_active":"2024-05-10T11:14:57.288438+0000","last_peered":"2024-05-10T11:14:57.288438+0000","last_clean":"2024-05-10T11:14:57.288438+0000","last_became_active":"2024-05-10T11:14:57.281986+0000","last_became_peered":"2024-05-10T11:14:57.281986+0000","last_unstale":"2024-05-10T11:14:57.288438+0000","last_undegraded":"2024-05-10T11:14:57.288438+0000","last_fullsized":"2024-05-10T11:14:57.288438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:13.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":184,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289692+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:14:58.289692+0000","last_peered":"2024-05-10T11:14:58.289692+0000","last_clean":"2024-05-10T11:14:58.289692+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:14:58.289692+0000","last_undegraded":"2024-05-10T11:14:58.289692+0000","last_fullsized":"2024-05-10T11:14:58.289692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":916015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":324905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":326483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":317704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":311045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":311045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1310720,"data_stored":908072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":331585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:15:02.333 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:15:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 Processor -- start 2024-05-10T11:15:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 -- start start 2024-05-10T11:15:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf0015f3b0 0x7fbf000d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf0015f790 0x7fbf000d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf000d30b0 con 0x7fbf000d5d30 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbf000d3390 con 0x7fbf0015f3b0 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.474+0000 7fbf0612b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbf000c8c80 con 0x7fbf0015f790 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf0015f3b0 0x7fbf000d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf0015f3b0 0x7fbf000d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42866/0 (socket says 172.21.15.66:42866) 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 -- 172.21.15.66:0/1636498331 learned_addr learned my addr 172.21.15.66:0/1636498331 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbefeffd640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf0015f790 0x7fbf000d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 -- 172.21.15.66:0/1636498331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf0015f790 msgr2=0x7fbf000d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf0015f790 0x7fbf000d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 -- 172.21.15.66:0/1636498331 >> v1:172.21.15.190:6789/0 conn(0x7fbf000d5d30 legacy=0x7fbf000c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbeff7fe640 1 -- 172.21.15.66:0/1636498331 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000c8f60 con 0x7fbf0015f3b0 2024-05-10T11:15:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.475+0000 7fbefeffd640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf0015f790 0x7fbf000d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:02.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbeff7fe640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf000d36f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009870 tx=0x7fbef002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193a2ac18eb1bbf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbefe7fc640 1 -- 172.21.15.66:0/1636498331 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0037070 con 0x7fbf0015f3b0 2024-05-10T11:15:02.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbefe7fc640 1 -- 172.21.15.66:0/1636498331 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef0032440 con 0x7fbf0015f3b0 2024-05-10T11:15:02.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbefe7fc640 1 -- 172.21.15.66:0/1636498331 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0032810 con 0x7fbf0015f3b0 2024-05-10T11:15:02.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbf0612b640 1 -- 172.21.15.66:0/1636498331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 msgr2=0x7fbf000d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbf0612b640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf000d36f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009870 tx=0x7fbef002a210 comp rx=0 tx=0).stop 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbf0612b640 1 -- 172.21.15.66:0/1636498331 shutdown_connections 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbf0612b640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf0015f790 0x7fbf000d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbf0612b640 1 --2- 172.21.15.66:0/1636498331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf000d36f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.476+0000 7fbf0612b640 1 -- 172.21.15.66:0/1636498331 >> 172.21.15.66:0/1636498331 conn(0x7fbf000d5130 msgr2=0x7fbf000d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.477+0000 7fbf0612b640 1 -- 172.21.15.66:0/1636498331 shutdown_connections 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.477+0000 7fbf0612b640 1 -- 172.21.15.66:0/1636498331 wait complete. 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.478+0000 7fbf0612b640 1 Processor -- start 2024-05-10T11:15:02.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.478+0000 7fbf0612b640 1 -- start start 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbf0612b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf000d5d30 0x7fbf001f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbf0612b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf00155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbf0612b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf000ce7e0 0x7fbf00161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbf0612b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000d0e60 con 0x7fbf0015f3b0 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbf0612b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000d0ce0 con 0x7fbf000ce7e0 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbf0612b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbf000d0fe0 con 0x7fbf000d5d30 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf00155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf00155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42882/0 (socket says 172.21.15.66:42882) 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 -- 172.21.15.66:0/230049252 learned_addr learned my addr 172.21.15.66:0/230049252 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:02.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefffff640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf000ce7e0 0x7fbf00161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbeff7fe640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf000d5d30 0x7fbf001f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 -- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf000d5d30 msgr2=0x7fbf001f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf000d5d30 0x7fbf001f7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 -- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf000ce7e0 msgr2=0x7fbf00161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf000ce7e0 0x7fbf00161d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 -- 172.21.15.66:0/230049252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf001566d0 con 0x7fbf0015f3b0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbeff7fe640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf000d5d30 0x7fbf001f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbefeffd640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf00155d60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c820 tx=0x7fbef400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4015070 con 0x7fbf0015f3b0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.479+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef4007a30 con 0x7fbf0015f3b0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.480+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf001569b0 con 0x7fbf0015f3b0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.480+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4007e20 con 0x7fbf0015f3b0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.480+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf00156f70 con 0x7fbf0015f3b0 2024-05-10T11:15:02.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.480+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0006a220 con 0x7fbf0015f3b0 2024-05-10T11:15:02.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.481+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbef4018070 con 0x7fbf0015f3b0 2024-05-10T11:15:02.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.482+0000 7fbee7fff640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbeec0762d0 0x7fbeec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.482+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fbef4097560 con 0x7fbf0015f3b0 2024-05-10T11:15:02.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.482+0000 7fbeff7fe640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbeec0762d0 0x7fbeec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.482+0000 7fbeff7fe640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbeec0762d0 0x7fbeec078790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbef0034000 tx=0x7fbef002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.486+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbef40606f0 con 0x7fbf0015f3b0 2024-05-10T11:15:02.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.671+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf0006dee0 con 0x7fbeec0762d0 2024-05-10T11:15:02.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.678+0000 7fbee7fff640 1 -- 172.21.15.66:0/230049252 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250070 (secure 0 0 0) 0x7fbef007f0f0 con 0x7fbeec0762d0 2024-05-10T11:15:02.681 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:02.682 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:15:02.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbeec0762d0 msgr2=0x7fbeec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbeec0762d0 0x7fbeec078790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbef0034000 tx=0x7fbef002e000 comp rx=0 tx=0).stop 2024-05-10T11:15:02.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 msgr2=0x7fbf00155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf00155d60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c820 tx=0x7fbef400cce0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 shutdown_connections 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbeec0762d0 0x7fbeec078790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf000ce7e0 0x7fbf00161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf0015f3b0 0x7fbf00155d60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 --2- 172.21.15.66:0/230049252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf000d5d30 0x7fbf001f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 >> 172.21.15.66:0/230049252 conn(0x7fbf000d5130 msgr2=0x7fbf000c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 shutdown_connections 2024-05-10T11:15:02.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.681+0000 7fbf0612b640 1 -- 172.21.15.66:0/230049252 wait complete. 2024-05-10T11:15:02.692 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-10T11:15:01.720024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":129,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223020,"kb_used_data":6832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751700,"statfs":{"total":773094113280,"available":772865740800,"internally_reserved":0,"allocated":6995968,"data_stored":3746854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457177"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277939+0000","last_change":"2024-05-10T11:14:57.277939+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277939+0000","last_undegraded":"2024-05-10T11:14:57.277939+0000","last_fullsized":"2024-05-10T11:14:57.277939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277888+0000","last_change":"2024-05-10T11:14:57.277888+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277888+0000","last_undegraded":"2024-05-10T11:14:57.277888+0000","last_fullsized":"2024-05-10T11:14:57.277888+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304210+0000","last_change":"2024-05-10T11:14:58.297410+0000","last_active":"2024-05-10T11:14:58.304210+0000","last_peered":"2024-05-10T11:14:58.304210+0000","last_clean":"2024-05-10T11:14:58.304210+0000","last_became_active":"2024-05-10T11:14:58.297147+0000","last_became_peered":"2024-05-10T11:14:58.297147+0000","last_unstale":"2024-05-10T11:14:58.304210+0000","last_undegraded":"2024-05-10T11:14:58.304210+0000","last_fullsized":"2024-05-10T11:14:58.304210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:13.060645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306506+0000","last_change":"2024-05-10T11:14:58.294909+0000","last_active":"2024-05-10T11:14:58.306506+0000","last_peered":"2024-05-10T11:14:58.306506+0000","last_clean":"2024-05-10T11:14:58.306506+0000","last_became_active":"2024-05-10T11:14:58.294219+0000","last_became_peered":"2024-05-10T11:14:58.294219+0000","last_unstale":"2024-05-10T11:14:58.306506+0000","last_undegraded":"2024-05-10T11:14:58.306506+0000","last_fullsized":"2024-05-10T11:14:58.306506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305830+0000","last_change":"2024-05-10T11:14:58.302152+0000","last_active":"2024-05-10T11:14:58.305830+0000","last_peered":"2024-05-10T11:14:58.305830+0000","last_clean":"2024-05-10T11:14:58.305830+0000","last_became_active":"2024-05-10T11:14:58.301618+0000","last_became_peered":"2024-05-10T11:14:58.301618+0000","last_unstale":"2024-05-10T11:14:58.305830+0000","last_undegraded":"2024-05-10T11:14:58.305830+0000","last_fullsized":"2024-05-10T11:14:58.305830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:22.704456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271980+0000","last_change":"2024-05-10T11:14:57.271980+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271980+0000","last_undegraded":"2024-05-10T11:14:57.271980+0000","last_fullsized":"2024-05-10T11:14:57.271980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271169+0000","last_change":"2024-05-10T11:14:57.271169+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271169+0000","last_undegraded":"2024-05-10T11:14:57.271169+0000","last_fullsized":"2024-05-10T11:14:57.271169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293457+0000","last_change":"2024-05-10T11:14:58.305552+0000","last_active":"2024-05-10T11:14:59.293457+0000","last_peered":"2024-05-10T11:14:59.293457+0000","last_clean":"2024-05-10T11:14:59.293457+0000","last_became_active":"2024-05-10T11:14:58.305299+0000","last_became_peered":"2024-05-10T11:14:58.305299+0000","last_unstale":"2024-05-10T11:14:59.293457+0000","last_undegraded":"2024-05-10T11:14:59.293457+0000","last_fullsized":"2024-05-10T11:14:59.293457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:38.945852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309803+0000","last_change":"2024-05-10T11:14:58.307371+0000","last_active":"2024-05-10T11:14:58.309803+0000","last_peered":"2024-05-10T11:14:58.309803+0000","last_clean":"2024-05-10T11:14:58.309803+0000","last_became_active":"2024-05-10T11:14:58.307064+0000","last_became_peered":"2024-05-10T11:14:58.307064+0000","last_unstale":"2024-05-10T11:14:58.309803+0000","last_undegraded":"2024-05-10T11:14:58.309803+0000","last_fullsized":"2024-05-10T11:14:58.309803+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:41.509127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304218+0000","last_change":"2024-05-10T11:14:58.299020+0000","last_active":"2024-05-10T11:14:58.304218+0000","last_peered":"2024-05-10T11:14:58.304218+0000","last_clean":"2024-05-10T11:14:58.304218+0000","last_became_active":"2024-05-10T11:14:58.298147+0000","last_became_peered":"2024-05-10T11:14:58.298147+0000","last_unstale":"2024-05-10T11:14:58.304218+0000","last_undegraded":"2024-05-10T11:14:58.304218+0000","last_fullsized":"2024-05-10T11:14:58.304218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:55.573266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306767+0000","last_change":"2024-05-10T11:14:58.292521+0000","last_active":"2024-05-10T11:14:58.306767+0000","last_peered":"2024-05-10T11:14:58.306767+0000","last_clean":"2024-05-10T11:14:58.306767+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.306767+0000","last_undegraded":"2024-05-10T11:14:58.306767+0000","last_fullsized":"2024-05-10T11:14:58.306767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293615+0000","last_change":"2024-05-10T11:14:58.303388+0000","last_active":"2024-05-10T11:14:59.293615+0000","last_peered":"2024-05-10T11:14:59.293615+0000","last_clean":"2024-05-10T11:14:59.293615+0000","last_became_active":"2024-05-10T11:14:58.303093+0000","last_became_peered":"2024-05-10T11:14:58.303093+0000","last_unstale":"2024-05-10T11:14:59.293615+0000","last_undegraded":"2024-05-10T11:14:59.293615+0000","last_fullsized":"2024-05-10T11:14:59.293615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:27.443250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293798+0000","last_change":"2024-05-10T11:14:58.300330+0000","last_active":"2024-05-10T11:14:59.293798+0000","last_peered":"2024-05-10T11:14:59.293798+0000","last_clean":"2024-05-10T11:14:59.293798+0000","last_became_active":"2024-05-10T11:14:58.300074+0000","last_became_peered":"2024-05-10T11:14:58.300074+0000","last_unstale":"2024-05-10T11:14:59.293798+0000","last_undegraded":"2024-05-10T11:14:59.293798+0000","last_fullsized":"2024-05-10T11:14:59.293798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304170+0000","last_change":"2024-05-10T11:14:58.296851+0000","last_active":"2024-05-10T11:14:58.304170+0000","last_peered":"2024-05-10T11:14:58.304170+0000","last_clean":"2024-05-10T11:14:58.304170+0000","last_became_active":"2024-05-10T11:14:58.296494+0000","last_became_peered":"2024-05-10T11:14:58.296494+0000","last_unstale":"2024-05-10T11:14:58.304170+0000","last_undegraded":"2024-05-10T11:14:58.304170+0000","last_fullsized":"2024-05-10T11:14:58.304170+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:54.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307806+0000","last_change":"2024-05-10T11:14:58.303310+0000","last_active":"2024-05-10T11:14:58.307806+0000","last_peered":"2024-05-10T11:14:58.307806+0000","last_clean":"2024-05-10T11:14:58.307806+0000","last_became_active":"2024-05-10T11:14:58.303026+0000","last_became_peered":"2024-05-10T11:14:58.303026+0000","last_unstale":"2024-05-10T11:14:58.307806+0000","last_undegraded":"2024-05-10T11:14:58.307806+0000","last_fullsized":"2024-05-10T11:14:58.307806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:31:04.702811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270646+0000","last_change":"2024-05-10T11:14:57.270646+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270646+0000","last_undegraded":"2024-05-10T11:14:57.270646+0000","last_fullsized":"2024-05-10T11:14:57.270646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274602+0000","last_change":"2024-05-10T11:14:57.274602+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274602+0000","last_undegraded":"2024-05-10T11:14:57.274602+0000","last_fullsized":"2024-05-10T11:14:57.274602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306599+0000","last_change":"2024-05-10T11:14:58.294765+0000","last_active":"2024-05-10T11:14:58.306599+0000","last_peered":"2024-05-10T11:14:58.306599+0000","last_clean":"2024-05-10T11:14:58.306599+0000","last_became_active":"2024-05-10T11:14:58.294194+0000","last_became_peered":"2024-05-10T11:14:58.294194+0000","last_unstale":"2024-05-10T11:14:58.306599+0000","last_undegraded":"2024-05-10T11:14:58.306599+0000","last_fullsized":"2024-05-10T11:14:58.306599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300735+0000","last_change":"2024-05-10T11:14:58.291296+0000","last_active":"2024-05-10T11:14:58.300735+0000","last_peered":"2024-05-10T11:14:58.300735+0000","last_clean":"2024-05-10T11:14:58.300735+0000","last_became_active":"2024-05-10T11:14:58.291032+0000","last_became_peered":"2024-05-10T11:14:58.291032+0000","last_unstale":"2024-05-10T11:14:58.300735+0000","last_undegraded":"2024-05-10T11:14:58.300735+0000","last_fullsized":"2024-05-10T11:14:58.300735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274968+0000","last_change":"2024-05-10T11:14:57.274968+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274968+0000","last_undegraded":"2024-05-10T11:14:57.274968+0000","last_fullsized":"2024-05-10T11:14:57.274968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293720+0000","last_change":"2024-05-10T11:14:58.292301+0000","last_active":"2024-05-10T11:14:59.293720+0000","last_peered":"2024-05-10T11:14:59.293720+0000","last_clean":"2024-05-10T11:14:59.293720+0000","last_became_active":"2024-05-10T11:14:58.292011+0000","last_became_peered":"2024-05-10T11:14:58.292011+0000","last_unstale":"2024-05-10T11:14:59.293720+0000","last_undegraded":"2024-05-10T11:14:59.293720+0000","last_fullsized":"2024-05-10T11:14:59.293720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:27.519315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273321+0000","last_change":"2024-05-10T11:14:57.273321+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273321+0000","last_undegraded":"2024-05-10T11:14:57.273321+0000","last_fullsized":"2024-05-10T11:14:57.273321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.272697+0000","last_change":"2024-05-10T11:14:57.272697+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.272697+0000","last_undegraded":"2024-05-10T11:14:57.272697+0000","last_fullsized":"2024-05-10T11:14:57.272697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304156+0000","last_change":"2024-05-10T11:14:58.296984+0000","last_active":"2024-05-10T11:14:58.304156+0000","last_peered":"2024-05-10T11:14:58.304156+0000","last_clean":"2024-05-10T11:14:58.304156+0000","last_became_active":"2024-05-10T11:14:58.296624+0000","last_became_peered":"2024-05-10T11:14:58.296624+0000","last_unstale":"2024-05-10T11:14:58.304156+0000","last_undegraded":"2024-05-10T11:14:58.304156+0000","last_fullsized":"2024-05-10T11:14:58.304156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:10.187464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293927+0000","last_change":"2024-05-10T11:14:58.294450+0000","last_active":"2024-05-10T11:14:59.293927+0000","last_peered":"2024-05-10T11:14:59.293927+0000","last_clean":"2024-05-10T11:14:59.293927+0000","last_became_active":"2024-05-10T11:14:58.294145+0000","last_became_peered":"2024-05-10T11:14:58.294145+0000","last_unstale":"2024-05-10T11:14:59.293927+0000","last_undegraded":"2024-05-10T11:14:59.293927+0000","last_fullsized":"2024-05-10T11:14:59.293927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293796+0000","last_change":"2024-05-10T11:14:58.295269+0000","last_active":"2024-05-10T11:14:59.293796+0000","last_peered":"2024-05-10T11:14:59.293796+0000","last_clean":"2024-05-10T11:14:59.293796+0000","last_became_active":"2024-05-10T11:14:58.294820+0000","last_became_peered":"2024-05-10T11:14:58.294820+0000","last_unstale":"2024-05-10T11:14:59.293796+0000","last_undegraded":"2024-05-10T11:14:59.293796+0000","last_fullsized":"2024-05-10T11:14:59.293796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:37.670772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306749+0000","last_change":"2024-05-10T11:14:58.292277+0000","last_active":"2024-05-10T11:14:58.306749+0000","last_peered":"2024-05-10T11:14:58.306749+0000","last_clean":"2024-05-10T11:14:58.306749+0000","last_became_active":"2024-05-10T11:14:58.291531+0000","last_became_peered":"2024-05-10T11:14:58.291531+0000","last_unstale":"2024-05-10T11:14:58.306749+0000","last_undegraded":"2024-05-10T11:14:58.306749+0000","last_fullsized":"2024-05-10T11:14:58.306749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.278535+0000","last_change":"2024-05-10T11:14:57.278535+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.278535+0000","last_undegraded":"2024-05-10T11:14:57.278535+0000","last_fullsized":"2024-05-10T11:14:57.278535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.312652+0000","last_change":"2024-05-10T11:14:58.309493+0000","last_active":"2024-05-10T11:14:58.312652+0000","last_peered":"2024-05-10T11:14:58.312652+0000","last_clean":"2024-05-10T11:14:58.312652+0000","last_became_active":"2024-05-10T11:14:58.308480+0000","last_became_peered":"2024-05-10T11:14:58.308480+0000","last_unstale":"2024-05-10T11:14:58.312652+0000","last_undegraded":"2024-05-10T11:14:58.312652+0000","last_fullsized":"2024-05-10T11:14:58.312652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:00:22.050849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293420+0000","last_change":"2024-05-10T11:14:58.304102+0000","last_active":"2024-05-10T11:14:59.293420+0000","last_peered":"2024-05-10T11:14:59.293420+0000","last_clean":"2024-05-10T11:14:59.293420+0000","last_became_active":"2024-05-10T11:14:58.303832+0000","last_became_peered":"2024-05-10T11:14:58.303832+0000","last_unstale":"2024-05-10T11:14:59.293420+0000","last_undegraded":"2024-05-10T11:14:59.293420+0000","last_fullsized":"2024-05-10T11:14:59.293420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:24.954543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306675+0000","last_change":"2024-05-10T11:14:58.290600+0000","last_active":"2024-05-10T11:14:58.306675+0000","last_peered":"2024-05-10T11:14:58.306675+0000","last_clean":"2024-05-10T11:14:58.306675+0000","last_became_active":"2024-05-10T11:14:58.290320+0000","last_became_peered":"2024-05-10T11:14:58.290320+0000","last_unstale":"2024-05-10T11:14:58.306675+0000","last_undegraded":"2024-05-10T11:14:58.306675+0000","last_fullsized":"2024-05-10T11:14:58.306675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:01.249122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271538+0000","last_change":"2024-05-10T11:14:57.271538+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271538+0000","last_undegraded":"2024-05-10T11:14:57.271538+0000","last_fullsized":"2024-05-10T11:14:57.271538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299993+0000","last_change":"2024-05-10T11:14:58.293177+0000","last_active":"2024-05-10T11:14:58.299993+0000","last_peered":"2024-05-10T11:14:58.299993+0000","last_clean":"2024-05-10T11:14:58.299993+0000","last_became_active":"2024-05-10T11:14:58.292884+0000","last_became_peered":"2024-05-10T11:14:58.292884+0000","last_unstale":"2024-05-10T11:14:58.299993+0000","last_undegraded":"2024-05-10T11:14:58.299993+0000","last_fullsized":"2024-05-10T11:14:58.299993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288082+0000","last_change":"2024-05-10T11:14:57.284107+0000","last_active":"2024-05-10T11:14:57.288082+0000","last_peered":"2024-05-10T11:14:57.288082+0000","last_clean":"2024-05-10T11:14:57.288082+0000","last_became_active":"2024-05-10T11:14:57.283807+0000","last_became_peered":"2024-05-10T11:14:57.283807+0000","last_unstale":"2024-05-10T11:14:57.288082+0000","last_undegraded":"2024-05-10T11:14:57.288082+0000","last_fullsized":"2024-05-10T11:14:57.288082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:06.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306728+0000","last_change":"2024-05-10T11:14:58.291184+0000","last_active":"2024-05-10T11:14:58.306728+0000","last_peered":"2024-05-10T11:14:58.306728+0000","last_clean":"2024-05-10T11:14:58.306728+0000","last_became_active":"2024-05-10T11:14:58.290918+0000","last_became_peered":"2024-05-10T11:14:58.290918+0000","last_unstale":"2024-05-10T11:14:58.306728+0000","last_undegraded":"2024-05-10T11:14:58.306728+0000","last_fullsized":"2024-05-10T11:14:58.306728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283390+0000","last_change":"2024-05-10T11:14:57.278080+0000","last_active":"2024-05-10T11:14:57.283390+0000","last_peered":"2024-05-10T11:14:57.283390+0000","last_clean":"2024-05-10T11:14:57.283390+0000","last_became_active":"2024-05-10T11:14:57.277750+0000","last_became_peered":"2024-05-10T11:14:57.277750+0000","last_unstale":"2024-05-10T11:14:57.283390+0000","last_undegraded":"2024-05-10T11:14:57.283390+0000","last_fullsized":"2024-05-10T11:14:57.283390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:27:23.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271033+0000","last_change":"2024-05-10T11:14:57.271033+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271033+0000","last_undegraded":"2024-05-10T11:14:57.271033+0000","last_fullsized":"2024-05-10T11:14:57.271033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283415+0000","last_change":"2024-05-10T11:14:57.278386+0000","last_active":"2024-05-10T11:14:57.283415+0000","last_peered":"2024-05-10T11:14:57.283415+0000","last_clean":"2024-05-10T11:14:57.283415+0000","last_became_active":"2024-05-10T11:14:57.278063+0000","last_became_peered":"2024-05-10T11:14:57.278063+0000","last_unstale":"2024-05-10T11:14:57.283415+0000","last_undegraded":"2024-05-10T11:14:57.283415+0000","last_fullsized":"2024-05-10T11:14:57.283415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:17.184537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304139+0000","last_change":"2024-05-10T11:14:58.296717+0000","last_active":"2024-05-10T11:14:58.304139+0000","last_peered":"2024-05-10T11:14:58.304139+0000","last_clean":"2024-05-10T11:14:58.304139+0000","last_became_active":"2024-05-10T11:14:58.296326+0000","last_became_peered":"2024-05-10T11:14:58.296326+0000","last_unstale":"2024-05-10T11:14:58.304139+0000","last_undegraded":"2024-05-10T11:14:58.304139+0000","last_fullsized":"2024-05-10T11:14:58.304139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:00.644583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287875+0000","last_change":"2024-05-10T11:14:57.284933+0000","last_active":"2024-05-10T11:14:57.287875+0000","last_peered":"2024-05-10T11:14:57.287875+0000","last_clean":"2024-05-10T11:14:57.287875+0000","last_became_active":"2024-05-10T11:14:57.284634+0000","last_became_peered":"2024-05-10T11:14:57.284634+0000","last_unstale":"2024-05-10T11:14:57.287875+0000","last_undegraded":"2024-05-10T11:14:57.287875+0000","last_fullsized":"2024-05-10T11:14:57.287875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:09.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270165+0000","last_change":"2024-05-10T11:14:57.270165+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270165+0000","last_undegraded":"2024-05-10T11:14:57.270165+0000","last_fullsized":"2024-05-10T11:14:57.270165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288408+0000","last_change":"2024-05-10T11:14:57.282928+0000","last_active":"2024-05-10T11:14:57.288408+0000","last_peered":"2024-05-10T11:14:57.288408+0000","last_clean":"2024-05-10T11:14:57.288408+0000","last_became_active":"2024-05-10T11:14:57.282648+0000","last_became_peered":"2024-05-10T11:14:57.282648+0000","last_unstale":"2024-05-10T11:14:57.288408+0000","last_undegraded":"2024-05-10T11:14:57.288408+0000","last_fullsized":"2024-05-10T11:14:57.288408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:55.414121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273482+0000","last_change":"2024-05-10T11:14:57.273482+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273482+0000","last_undegraded":"2024-05-10T11:14:57.273482+0000","last_fullsized":"2024-05-10T11:14:57.273482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288470+0000","last_change":"2024-05-10T11:14:57.281848+0000","last_active":"2024-05-10T11:14:57.288470+0000","last_peered":"2024-05-10T11:14:57.288470+0000","last_clean":"2024-05-10T11:14:57.288470+0000","last_became_active":"2024-05-10T11:14:57.281514+0000","last_became_peered":"2024-05-10T11:14:57.281514+0000","last_unstale":"2024-05-10T11:14:57.288470+0000","last_undegraded":"2024-05-10T11:14:57.288470+0000","last_fullsized":"2024-05-10T11:14:57.288470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:09.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.303741+0000","last_change":"2024-05-10T11:14:58.301360+0000","last_active":"2024-05-10T11:14:58.303741+0000","last_peered":"2024-05-10T11:14:58.303741+0000","last_clean":"2024-05-10T11:14:58.303741+0000","last_became_active":"2024-05-10T11:14:58.301013+0000","last_became_peered":"2024-05-10T11:14:58.301013+0000","last_unstale":"2024-05-10T11:14:58.303741+0000","last_undegraded":"2024-05-10T11:14:58.303741+0000","last_fullsized":"2024-05-10T11:14:58.303741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288594+0000","last_change":"2024-05-10T11:14:57.284239+0000","last_active":"2024-05-10T11:14:57.288594+0000","last_peered":"2024-05-10T11:14:57.288594+0000","last_clean":"2024-05-10T11:14:57.288594+0000","last_became_active":"2024-05-10T11:14:57.283872+0000","last_became_peered":"2024-05-10T11:14:57.283872+0000","last_unstale":"2024-05-10T11:14:57.288594+0000","last_undegraded":"2024-05-10T11:14:57.288594+0000","last_fullsized":"2024-05-10T11:14:57.288594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:57.173000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274149+0000","last_change":"2024-05-10T11:14:57.274149+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274149+0000","last_undegraded":"2024-05-10T11:14:57.274149+0000","last_fullsized":"2024-05-10T11:14:57.274149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.284885+0000","last_change":"2024-05-10T11:14:57.283820+0000","last_active":"2024-05-10T11:14:58.284885+0000","last_peered":"2024-05-10T11:14:58.284885+0000","last_clean":"2024-05-10T11:14:58.284885+0000","last_became_active":"2024-05-10T11:14:57.283489+0000","last_became_peered":"2024-05-10T11:14:57.283489+0000","last_unstale":"2024-05-10T11:14:58.284885+0000","last_undegraded":"2024-05-10T11:14:58.284885+0000","last_fullsized":"2024-05-10T11:14:58.284885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.244441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277648+0000","last_change":"2024-05-10T11:14:57.277648+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277648+0000","last_undegraded":"2024-05-10T11:14:57.277648+0000","last_fullsized":"2024-05-10T11:14:57.277648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.286683+0000","last_change":"2024-05-10T11:14:57.285058+0000","last_active":"2024-05-10T11:14:58.286683+0000","last_peered":"2024-05-10T11:14:58.286683+0000","last_clean":"2024-05-10T11:14:58.286683+0000","last_became_active":"2024-05-10T11:14:57.284745+0000","last_became_peered":"2024-05-10T11:14:57.284745+0000","last_unstale":"2024-05-10T11:14:58.286683+0000","last_undegraded":"2024-05-10T11:14:58.286683+0000","last_fullsized":"2024-05-10T11:14:58.286683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:26.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273343+0000","last_change":"2024-05-10T11:14:57.273343+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273343+0000","last_undegraded":"2024-05-10T11:14:57.273343+0000","last_fullsized":"2024-05-10T11:14:57.273343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.282335+0000","last_change":"2024-05-10T11:14:57.285480+0000","last_active":"2024-05-10T11:14:58.282335+0000","last_peered":"2024-05-10T11:14:58.282335+0000","last_clean":"2024-05-10T11:14:58.282335+0000","last_became_active":"2024-05-10T11:14:57.284658+0000","last_became_peered":"2024-05-10T11:14:57.284658+0000","last_unstale":"2024-05-10T11:14:58.282335+0000","last_undegraded":"2024-05-10T11:14:58.282335+0000","last_fullsized":"2024-05-10T11:14:58.282335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:50.772681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300570+0000","last_change":"2024-05-10T11:14:58.293724+0000","last_active":"2024-05-10T11:14:58.300570+0000","last_peered":"2024-05-10T11:14:58.300570+0000","last_clean":"2024-05-10T11:14:58.300570+0000","last_became_active":"2024-05-10T11:14:58.293401+0000","last_became_peered":"2024-05-10T11:14:58.293401+0000","last_unstale":"2024-05-10T11:14:58.300570+0000","last_undegraded":"2024-05-10T11:14:58.300570+0000","last_fullsized":"2024-05-10T11:14:58.300570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309144+0000","last_change":"2024-05-10T11:14:57.285078+0000","last_active":"2024-05-10T11:14:58.309144+0000","last_peered":"2024-05-10T11:14:58.309144+0000","last_clean":"2024-05-10T11:14:58.309144+0000","last_became_active":"2024-05-10T11:14:57.284761+0000","last_became_peered":"2024-05-10T11:14:57.284761+0000","last_unstale":"2024-05-10T11:14:58.309144+0000","last_undegraded":"2024-05-10T11:14:58.309144+0000","last_fullsized":"2024-05-10T11:14:58.309144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:06:59.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306505+0000","last_change":"2024-05-10T11:14:58.293097+0000","last_active":"2024-05-10T11:14:58.306505+0000","last_peered":"2024-05-10T11:14:58.306505+0000","last_clean":"2024-05-10T11:14:58.306505+0000","last_became_active":"2024-05-10T11:14:58.292833+0000","last_became_peered":"2024-05-10T11:14:58.292833+0000","last_unstale":"2024-05-10T11:14:58.306505+0000","last_undegraded":"2024-05-10T11:14:58.306505+0000","last_fullsized":"2024-05-10T11:14:58.306505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288111+0000","last_change":"2024-05-10T11:14:57.283470+0000","last_active":"2024-05-10T11:14:57.288111+0000","last_peered":"2024-05-10T11:14:57.288111+0000","last_clean":"2024-05-10T11:14:57.288111+0000","last_became_active":"2024-05-10T11:14:57.283190+0000","last_became_peered":"2024-05-10T11:14:57.283190+0000","last_unstale":"2024-05-10T11:14:57.288111+0000","last_undegraded":"2024-05-10T11:14:57.288111+0000","last_fullsized":"2024-05-10T11:14:57.288111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:39.017034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308266+0000","last_change":"2024-05-10T11:14:58.302029+0000","last_active":"2024-05-10T11:14:58.308266+0000","last_peered":"2024-05-10T11:14:58.308266+0000","last_clean":"2024-05-10T11:14:58.308266+0000","last_became_active":"2024-05-10T11:14:58.301749+0000","last_became_peered":"2024-05-10T11:14:58.301749+0000","last_unstale":"2024-05-10T11:14:58.308266+0000","last_undegraded":"2024-05-10T11:14:58.308266+0000","last_fullsized":"2024-05-10T11:14:58.308266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308805+0000","last_change":"2024-05-10T11:14:57.288628+0000","last_active":"2024-05-10T11:14:58.308805+0000","last_peered":"2024-05-10T11:14:58.308805+0000","last_clean":"2024-05-10T11:14:58.308805+0000","last_became_active":"2024-05-10T11:14:57.288267+0000","last_became_peered":"2024-05-10T11:14:57.288267+0000","last_unstale":"2024-05-10T11:14:58.308805+0000","last_undegraded":"2024-05-10T11:14:58.308805+0000","last_fullsized":"2024-05-10T11:14:58.308805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:52.106425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293396+0000","last_change":"2024-05-10T11:14:58.292318+0000","last_active":"2024-05-10T11:14:59.293396+0000","last_peered":"2024-05-10T11:14:59.293396+0000","last_clean":"2024-05-10T11:14:59.293396+0000","last_became_active":"2024-05-10T11:14:58.292027+0000","last_became_peered":"2024-05-10T11:14:58.292027+0000","last_unstale":"2024-05-10T11:14:59.293396+0000","last_undegraded":"2024-05-10T11:14:59.293396+0000","last_fullsized":"2024-05-10T11:14:59.293396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:52.214989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293493+0000","last_change":"2024-05-10T11:14:57.285459+0000","last_active":"2024-05-10T11:14:59.293493+0000","last_peered":"2024-05-10T11:14:59.293493+0000","last_clean":"2024-05-10T11:14:59.293493+0000","last_became_active":"2024-05-10T11:14:57.285146+0000","last_became_peered":"2024-05-10T11:14:57.285146+0000","last_unstale":"2024-05-10T11:14:59.293493+0000","last_undegraded":"2024-05-10T11:14:59.293493+0000","last_fullsized":"2024-05-10T11:14:59.293493+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:54.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299748+0000","last_change":"2024-05-10T11:14:58.290578+0000","last_active":"2024-05-10T11:14:58.299748+0000","last_peered":"2024-05-10T11:14:58.299748+0000","last_clean":"2024-05-10T11:14:58.299748+0000","last_became_active":"2024-05-10T11:14:58.290298+0000","last_became_peered":"2024-05-10T11:14:58.290298+0000","last_unstale":"2024-05-10T11:14:58.299748+0000","last_undegraded":"2024-05-10T11:14:58.299748+0000","last_fullsized":"2024-05-10T11:14:58.299748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.293943+0000","last_change":"2024-05-10T11:14:57.288627+0000","last_active":"2024-05-10T11:14:58.293943+0000","last_peered":"2024-05-10T11:14:58.293943+0000","last_clean":"2024-05-10T11:14:58.293943+0000","last_became_active":"2024-05-10T11:14:57.288307+0000","last_became_peered":"2024-05-10T11:14:57.288307+0000","last_unstale":"2024-05-10T11:14:58.293943+0000","last_undegraded":"2024-05-10T11:14:58.293943+0000","last_fullsized":"2024-05-10T11:14:58.293943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:36.022029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274125+0000","last_change":"2024-05-10T11:14:57.274125+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274125+0000","last_undegraded":"2024-05-10T11:14:57.274125+0000","last_fullsized":"2024-05-10T11:14:57.274125+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.313414+0000","last_change":"2024-05-10T11:14:57.278123+0000","last_active":"2024-05-10T11:14:58.313414+0000","last_peered":"2024-05-10T11:14:58.313414+0000","last_clean":"2024-05-10T11:14:58.313414+0000","last_became_active":"2024-05-10T11:14:57.277822+0000","last_became_peered":"2024-05-10T11:14:57.277822+0000","last_unstale":"2024-05-10T11:14:58.313414+0000","last_undegraded":"2024-05-10T11:14:58.313414+0000","last_fullsized":"2024-05-10T11:14:58.313414+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:57.287132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307694+0000","last_change":"2024-05-10T11:14:58.303477+0000","last_active":"2024-05-10T11:14:58.307694+0000","last_peered":"2024-05-10T11:14:58.307694+0000","last_clean":"2024-05-10T11:14:58.307694+0000","last_became_active":"2024-05-10T11:14:58.303122+0000","last_became_peered":"2024-05-10T11:14:58.303122+0000","last_unstale":"2024-05-10T11:14:58.307694+0000","last_undegraded":"2024-05-10T11:14:58.307694+0000","last_fullsized":"2024-05-10T11:14:58.307694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:17.047773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293870+0000","last_change":"2024-05-10T11:14:57.281686+0000","last_active":"2024-05-10T11:14:59.293870+0000","last_peered":"2024-05-10T11:14:59.293870+0000","last_clean":"2024-05-10T11:14:59.293870+0000","last_became_active":"2024-05-10T11:14:57.281376+0000","last_became_peered":"2024-05-10T11:14:57.281376+0000","last_unstale":"2024-05-10T11:14:59.293870+0000","last_undegraded":"2024-05-10T11:14:59.293870+0000","last_fullsized":"2024-05-10T11:14:59.293870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:26.398829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305865+0000","last_change":"2024-05-10T11:14:58.301783+0000","last_active":"2024-05-10T11:14:58.305865+0000","last_peered":"2024-05-10T11:14:58.305865+0000","last_clean":"2024-05-10T11:14:58.305865+0000","last_became_active":"2024-05-10T11:14:58.301333+0000","last_became_peered":"2024-05-10T11:14:58.301333+0000","last_unstale":"2024-05-10T11:14:58.305865+0000","last_undegraded":"2024-05-10T11:14:58.305865+0000","last_fullsized":"2024-05-10T11:14:58.305865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:29.273264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309603+0000","last_change":"2024-05-10T11:14:57.291311+0000","last_active":"2024-05-10T11:14:58.309603+0000","last_peered":"2024-05-10T11:14:58.309603+0000","last_clean":"2024-05-10T11:14:58.309603+0000","last_became_active":"2024-05-10T11:14:57.291046+0000","last_became_peered":"2024-05-10T11:14:57.291046+0000","last_unstale":"2024-05-10T11:14:58.309603+0000","last_undegraded":"2024-05-10T11:14:58.309603+0000","last_fullsized":"2024-05-10T11:14:58.309603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:09.641351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306454+0000","last_change":"2024-05-10T11:14:58.294613+0000","last_active":"2024-05-10T11:14:58.306454+0000","last_peered":"2024-05-10T11:14:58.306454+0000","last_clean":"2024-05-10T11:14:58.306454+0000","last_became_active":"2024-05-10T11:14:58.291580+0000","last_became_peered":"2024-05-10T11:14:58.291580+0000","last_unstale":"2024-05-10T11:14:58.306454+0000","last_undegraded":"2024-05-10T11:14:58.306454+0000","last_fullsized":"2024-05-10T11:14:58.306454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307967+0000","last_change":"2024-05-10T11:14:57.286479+0000","last_active":"2024-05-10T11:14:58.307967+0000","last_peered":"2024-05-10T11:14:58.307967+0000","last_clean":"2024-05-10T11:14:58.307967+0000","last_became_active":"2024-05-10T11:14:57.286168+0000","last_became_peered":"2024-05-10T11:14:57.286168+0000","last_unstale":"2024-05-10T11:14:58.307967+0000","last_undegraded":"2024-05-10T11:14:58.307967+0000","last_fullsized":"2024-05-10T11:14:58.307967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:50.752141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299821+0000","last_change":"2024-05-10T11:14:58.291617+0000","last_active":"2024-05-10T11:14:58.299821+0000","last_peered":"2024-05-10T11:14:58.299821+0000","last_clean":"2024-05-10T11:14:58.299821+0000","last_became_active":"2024-05-10T11:14:58.291313+0000","last_became_peered":"2024-05-10T11:14:58.291313+0000","last_unstale":"2024-05-10T11:14:58.299821+0000","last_undegraded":"2024-05-10T11:14:58.299821+0000","last_fullsized":"2024-05-10T11:14:58.299821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287797+0000","last_change":"2024-05-10T11:14:57.280903+0000","last_active":"2024-05-10T11:14:57.287797+0000","last_peered":"2024-05-10T11:14:57.287797+0000","last_clean":"2024-05-10T11:14:57.287797+0000","last_became_active":"2024-05-10T11:14:57.280595+0000","last_became_peered":"2024-05-10T11:14:57.280595+0000","last_unstale":"2024-05-10T11:14:57.287797+0000","last_undegraded":"2024-05-10T11:14:57.287797+0000","last_fullsized":"2024-05-10T11:14:57.287797+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:17.184537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270526+0000","last_change":"2024-05-10T11:14:57.270526+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270526+0000","last_undegraded":"2024-05-10T11:14:57.270526+0000","last_fullsized":"2024-05-10T11:14:57.270526+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287922+0000","last_change":"2024-05-10T11:14:57.285784+0000","last_active":"2024-05-10T11:14:57.287922+0000","last_peered":"2024-05-10T11:14:57.287922+0000","last_clean":"2024-05-10T11:14:57.287922+0000","last_became_active":"2024-05-10T11:14:57.285511+0000","last_became_peered":"2024-05-10T11:14:57.285511+0000","last_unstale":"2024-05-10T11:14:57.287922+0000","last_undegraded":"2024-05-10T11:14:57.287922+0000","last_fullsized":"2024-05-10T11:14:57.287922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:55.414121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293402+0000","last_change":"2024-05-10T11:14:58.294900+0000","last_active":"2024-05-10T11:14:59.293402+0000","last_peered":"2024-05-10T11:14:59.293402+0000","last_clean":"2024-05-10T11:14:59.293402+0000","last_became_active":"2024-05-10T11:14:58.293875+0000","last_became_peered":"2024-05-10T11:14:58.293875+0000","last_unstale":"2024-05-10T11:14:59.293402+0000","last_undegraded":"2024-05-10T11:14:59.293402+0000","last_fullsized":"2024-05-10T11:14:59.293402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:35.553377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293556+0000","last_change":"2024-05-10T11:14:57.281997+0000","last_active":"2024-05-10T11:14:59.293556+0000","last_peered":"2024-05-10T11:14:59.293556+0000","last_clean":"2024-05-10T11:14:59.293556+0000","last_became_active":"2024-05-10T11:14:57.281468+0000","last_became_peered":"2024-05-10T11:14:57.281468+0000","last_unstale":"2024-05-10T11:14:59.293556+0000","last_undegraded":"2024-05-10T11:14:59.293556+0000","last_fullsized":"2024-05-10T11:14:59.293556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:08.557076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300074+0000","last_change":"2024-05-10T11:14:58.292189+0000","last_active":"2024-05-10T11:14:58.300074+0000","last_peered":"2024-05-10T11:14:58.300074+0000","last_clean":"2024-05-10T11:14:58.300074+0000","last_became_active":"2024-05-10T11:14:58.291853+0000","last_became_peered":"2024-05-10T11:14:58.291853+0000","last_unstale":"2024-05-10T11:14:58.300074+0000","last_undegraded":"2024-05-10T11:14:58.300074+0000","last_fullsized":"2024-05-10T11:14:58.300074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.293002+0000","last_change":"2024-05-10T11:14:57.286677+0000","last_active":"2024-05-10T11:14:57.293002+0000","last_peered":"2024-05-10T11:14:57.293002+0000","last_clean":"2024-05-10T11:14:57.293002+0000","last_became_active":"2024-05-10T11:14:57.286392+0000","last_became_peered":"2024-05-10T11:14:57.286392+0000","last_unstale":"2024-05-10T11:14:57.293002+0000","last_undegraded":"2024-05-10T11:14:57.293002+0000","last_fullsized":"2024-05-10T11:14:57.293002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:13.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270508+0000","last_change":"2024-05-10T11:14:57.270508+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270508+0000","last_undegraded":"2024-05-10T11:14:57.270508+0000","last_fullsized":"2024-05-10T11:14:57.270508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.294020+0000","last_change":"2024-05-10T11:14:57.283832+0000","last_active":"2024-05-10T11:14:59.294020+0000","last_peered":"2024-05-10T11:14:59.294020+0000","last_clean":"2024-05-10T11:14:59.294020+0000","last_became_active":"2024-05-10T11:14:57.283428+0000","last_became_peered":"2024-05-10T11:14:57.283428+0000","last_unstale":"2024-05-10T11:14:59.294020+0000","last_undegraded":"2024-05-10T11:14:59.294020+0000","last_fullsized":"2024-05-10T11:14:59.294020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271126+0000","last_change":"2024-05-10T11:14:57.271126+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271126+0000","last_undegraded":"2024-05-10T11:14:57.271126+0000","last_fullsized":"2024-05-10T11:14:57.271126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293984+0000","last_change":"2024-05-10T11:14:57.282035+0000","last_active":"2024-05-10T11:14:59.293984+0000","last_peered":"2024-05-10T11:14:59.293984+0000","last_clean":"2024-05-10T11:14:59.293984+0000","last_became_active":"2024-05-10T11:14:57.281774+0000","last_became_peered":"2024-05-10T11:14:57.281774+0000","last_unstale":"2024-05-10T11:14:59.293984+0000","last_undegraded":"2024-05-10T11:14:59.293984+0000","last_fullsized":"2024-05-10T11:14:59.293984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:13.792438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293942+0000","last_change":"2024-05-10T11:14:58.296279+0000","last_active":"2024-05-10T11:14:59.293942+0000","last_peered":"2024-05-10T11:14:59.293942+0000","last_clean":"2024-05-10T11:14:59.293942+0000","last_became_active":"2024-05-10T11:14:58.296001+0000","last_became_peered":"2024-05-10T11:14:58.296001+0000","last_unstale":"2024-05-10T11:14:59.293942+0000","last_undegraded":"2024-05-10T11:14:59.293942+0000","last_fullsized":"2024-05-10T11:14:59.293942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283395+0000","last_change":"2024-05-10T11:14:57.277996+0000","last_active":"2024-05-10T11:14:57.283395+0000","last_peered":"2024-05-10T11:14:57.283395+0000","last_clean":"2024-05-10T11:14:57.283395+0000","last_became_active":"2024-05-10T11:14:57.277696+0000","last_became_peered":"2024-05-10T11:14:57.277696+0000","last_unstale":"2024-05-10T11:14:57.283395+0000","last_undegraded":"2024-05-10T11:14:57.283395+0000","last_fullsized":"2024-05-10T11:14:57.283395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299916+0000","last_change":"2024-05-10T11:14:58.292302+0000","last_active":"2024-05-10T11:14:58.299916+0000","last_peered":"2024-05-10T11:14:58.299916+0000","last_clean":"2024-05-10T11:14:58.299916+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.299916+0000","last_undegraded":"2024-05-10T11:14:58.299916+0000","last_fullsized":"2024-05-10T11:14:58.299916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.285523+0000","last_change":"2024-05-10T11:14:57.281319+0000","last_active":"2024-05-10T11:14:57.285523+0000","last_peered":"2024-05-10T11:14:57.285523+0000","last_clean":"2024-05-10T11:14:57.285523+0000","last_became_active":"2024-05-10T11:14:57.281041+0000","last_became_peered":"2024-05-10T11:14:57.281041+0000","last_unstale":"2024-05-10T11:14:57.285523+0000","last_undegraded":"2024-05-10T11:14:57.285523+0000","last_fullsized":"2024-05-10T11:14:57.285523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:51.028755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300460+0000","last_change":"2024-05-10T11:14:58.299193+0000","last_active":"2024-05-10T11:14:58.300460+0000","last_peered":"2024-05-10T11:14:58.300460+0000","last_clean":"2024-05-10T11:14:58.300460+0000","last_became_active":"2024-05-10T11:14:58.293535+0000","last_became_peered":"2024-05-10T11:14:58.293535+0000","last_unstale":"2024-05-10T11:14:58.300460+0000","last_undegraded":"2024-05-10T11:14:58.300460+0000","last_fullsized":"2024-05-10T11:14:58.300460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:26.263371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289955+0000","last_change":"2024-05-10T11:14:57.288619+0000","last_active":"2024-05-10T11:14:58.289955+0000","last_peered":"2024-05-10T11:14:58.289955+0000","last_clean":"2024-05-10T11:14:58.289955+0000","last_became_active":"2024-05-10T11:14:57.288345+0000","last_became_peered":"2024-05-10T11:14:57.288345+0000","last_unstale":"2024-05-10T11:14:58.289955+0000","last_undegraded":"2024-05-10T11:14:58.289955+0000","last_fullsized":"2024-05-10T11:14:58.289955+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:56.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309165+0000","last_change":"2024-05-10T11:14:58.307212+0000","last_active":"2024-05-10T11:14:58.309165+0000","last_peered":"2024-05-10T11:14:58.309165+0000","last_clean":"2024-05-10T11:14:58.309165+0000","last_became_active":"2024-05-10T11:14:58.306894+0000","last_became_peered":"2024-05-10T11:14:58.306894+0000","last_unstale":"2024-05-10T11:14:58.309165+0000","last_undegraded":"2024-05-10T11:14:58.309165+0000","last_fullsized":"2024-05-10T11:14:58.309165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288545+0000","last_change":"2024-05-10T11:14:57.285145+0000","last_active":"2024-05-10T11:14:57.288545+0000","last_peered":"2024-05-10T11:14:57.288545+0000","last_clean":"2024-05-10T11:14:57.288545+0000","last_became_active":"2024-05-10T11:14:57.284872+0000","last_became_peered":"2024-05-10T11:14:57.284872+0000","last_unstale":"2024-05-10T11:14:57.288545+0000","last_undegraded":"2024-05-10T11:14:57.288545+0000","last_fullsized":"2024-05-10T11:14:57.288545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:39.777254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.276036+0000","last_change":"2024-05-10T11:14:57.276036+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.276036+0000","last_undegraded":"2024-05-10T11:14:57.276036+0000","last_fullsized":"2024-05-10T11:14:57.276036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288615+0000","last_change":"2024-05-10T11:14:57.284501+0000","last_active":"2024-05-10T11:14:57.288615+0000","last_peered":"2024-05-10T11:14:57.288615+0000","last_clean":"2024-05-10T11:14:57.288615+0000","last_became_active":"2024-05-10T11:14:57.283858+0000","last_became_peered":"2024-05-10T11:14:57.283858+0000","last_unstale":"2024-05-10T11:14:57.288615+0000","last_undegraded":"2024-05-10T11:14:57.288615+0000","last_fullsized":"2024-05-10T11:14:57.288615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.826064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271224+0000","last_change":"2024-05-10T11:14:57.271224+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271224+0000","last_undegraded":"2024-05-10T11:14:57.271224+0000","last_fullsized":"2024-05-10T11:14:57.271224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288077+0000","last_change":"2024-05-10T11:14:57.284893+0000","last_active":"2024-05-10T11:14:57.288077+0000","last_peered":"2024-05-10T11:14:57.288077+0000","last_clean":"2024-05-10T11:14:57.288077+0000","last_became_active":"2024-05-10T11:14:57.284424+0000","last_became_peered":"2024-05-10T11:14:57.284424+0000","last_unstale":"2024-05-10T11:14:57.288077+0000","last_undegraded":"2024-05-10T11:14:57.288077+0000","last_fullsized":"2024-05-10T11:14:57.288077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:59.649807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300040+0000","last_change":"2024-05-10T11:14:58.293110+0000","last_active":"2024-05-10T11:14:58.300040+0000","last_peered":"2024-05-10T11:14:58.300040+0000","last_clean":"2024-05-10T11:14:58.300040+0000","last_became_active":"2024-05-10T11:14:58.292854+0000","last_became_peered":"2024-05-10T11:14:58.292854+0000","last_unstale":"2024-05-10T11:14:58.300040+0000","last_undegraded":"2024-05-10T11:14:58.300040+0000","last_fullsized":"2024-05-10T11:14:58.300040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288438+0000","last_change":"2024-05-10T11:14:57.282272+0000","last_active":"2024-05-10T11:14:57.288438+0000","last_peered":"2024-05-10T11:14:57.288438+0000","last_clean":"2024-05-10T11:14:57.288438+0000","last_became_active":"2024-05-10T11:14:57.281986+0000","last_became_peered":"2024-05-10T11:14:57.281986+0000","last_unstale":"2024-05-10T11:14:57.288438+0000","last_undegraded":"2024-05-10T11:14:57.288438+0000","last_fullsized":"2024-05-10T11:14:57.288438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:13.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":184,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289692+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:14:58.289692+0000","last_peered":"2024-05-10T11:14:58.289692+0000","last_clean":"2024-05-10T11:14:58.289692+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:14:58.289692+0000","last_undegraded":"2024-05-10T11:14:58.289692+0000","last_fullsized":"2024-05-10T11:14:58.289692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":916015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":324905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":326483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":317704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":311045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":311045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1310720,"data_stored":908072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":331585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:15:02.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:15:02.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.836+0000 7fc04ad4e640 1 Processor -- start 2024-05-10T11:15:02.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.836+0000 7fc04ad4e640 1 -- start start 2024-05-10T11:15:02.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc04ad4e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc04415f8c0 0x7fc04406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc04ad4e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0440b0a90 con 0x7fc04415f4e0 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc04ad4e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0440b3540 con 0x7fc04406e620 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc04ad4e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc0440b23f0 con 0x7fc04415f8c0 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc048aea640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc04415f4e0 0x7fc04406d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49380/0 (socket says 172.21.15.66:49380) 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc048aea640 1 -- 172.21.15.66:0/2472167549 learned_addr learned my addr 172.21.15.66:0/2472167549 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134894877 0 0) 0x7fc0440b0a90 con 0x7fc04415f4e0 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc030003520 con 0x7fc04415f4e0 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.837+0000 7fc043fff640 1 --2- 172.21.15.66:0/2472167549 >> v2:172.21.15.190:3300/0 conn(0x7fc04415f8c0 0x7fc04406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714875189 0 0) 0x7fc030003520 con 0x7fc04415f4e0 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 >> v2:172.21.15.190:3300/0 conn(0x7fc04415f8c0 msgr2=0x7fc04406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 --2- 172.21.15.66:0/2472167549 >> v2:172.21.15.190:3300/0 conn(0x7fc04415f8c0 0x7fc04406e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 >> v1:172.21.15.190:6789/0 conn(0x7fc04406e620 legacy=0x7fc0440d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0440b3820 con 0x7fc04415f4e0 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fc034001670 con 0x7fc04415f4e0 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 >> v1:172.21.15.66:6789/0 conn(0x7fc04415f4e0 legacy=0x7fc04406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc030003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc030004800 0x7fc030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0300051c0 0x7fc03000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440b23f0 con 0x7fc0300039b0 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc03000c160 con 0x7fc030004800 2024-05-10T11:15:02.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc03000c360 con 0x7fc0300051c0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc048aea640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc030003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0492eb640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0300051c0 0x7fc03000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc043fff640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc030004800 0x7fc030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc048aea640 1 -- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0300051c0 msgr2=0x7fc03000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc048aea640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0300051c0 0x7fc03000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc048aea640 1 -- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc030004800 msgr2=0x7fc030004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc048aea640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc030004800 0x7fc030004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc048aea640 1 -- 172.21.15.66:0/2472167549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc030003520 con 0x7fc0300039b0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc043fff640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc030004800 0x7fc030004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.838+0000 7fc0492eb640 1 -- 172.21.15.66:0/2472167549 reap_dead start 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.839+0000 7fc048aea640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc030003dd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c210 tx=0x7fc030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7895cf2784852c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.839+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034007d30 con 0x7fc0300039b0 2024-05-10T11:15:02.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.839+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034005ad0 con 0x7fc0300039b0 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.839+0000 7fc0437fe640 1 -- 172.21.15.66:0/2472167549 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034007070 con 0x7fc0300039b0 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.839+0000 7fc04ad4e640 1 -- 172.21.15.66:0/2472167549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 msgr2=0x7fc030003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.839+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc030003dd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c210 tx=0x7fc030005830 comp rx=0 tx=0).stop 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.840+0000 7fc04ad4e640 1 -- 172.21.15.66:0/2472167549 shutdown_connections 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.840+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/2472167549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc030003dd0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.840+0000 7fc04ad4e640 1 -- 172.21.15.66:0/2472167549 >> 172.21.15.66:0/2472167549 conn(0x7fc0440d2df0 msgr2=0x7fc0440d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.840+0000 7fc04ad4e640 1 -- 172.21.15.66:0/2472167549 shutdown_connections 2024-05-10T11:15:02.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.840+0000 7fc04ad4e640 1 -- 172.21.15.66:0/2472167549 wait complete. 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.841+0000 7fc04ad4e640 1 Processor -- start 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.841+0000 7fc04ad4e640 1 -- start start 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc044147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0440c68c0 0x7fc0441e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc044070c90 0x7fc044071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440b3de0 con 0x7fc0300039b0 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440b4150 con 0x7fc0440c68c0 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc0440b45e0 con 0x7fc044070c90 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc044147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc044147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42898/0 (socket says 172.21.15.66:42898) 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 -- 172.21.15.66:0/1774245345 learned_addr learned my addr 172.21.15.66:0/1774245345 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc043fff640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0440c68c0 0x7fc0441e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc0492eb640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc044070c90 0x7fc044071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 -- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc044070c90 msgr2=0x7fc044071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc044070c90 0x7fc044071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 -- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0440c68c0 msgr2=0x7fc0441e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0440c68c0 0x7fc0441e7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 -- 172.21.15.66:0/1774245345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0441480a0 con 0x7fc0300039b0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc0492eb640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc044070c90 0x7fc044071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc048aea640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc044147b60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c210 tx=0x7fc034001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034041070 con 0x7fc0300039b0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034000ed0 con 0x7fc0300039b0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0441e86c0 con 0x7fc0300039b0 2024-05-10T11:15:02.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034007290 con 0x7fc0300039b0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.842+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0441e8c80 con 0x7fc0300039b0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.843+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04406a220 con 0x7fc0300039b0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.844+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc034044070 con 0x7fc0300039b0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.845+0000 7fc0417fa640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc024076300 0x7fc0240787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.845+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fc0340b7b30 con 0x7fc0300039b0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.845+0000 7fc043fff640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc024076300 0x7fc0240787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.845+0000 7fc043fff640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc024076300 0x7fc0240787c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0440697b0 tx=0x7fc02c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:02.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:02.849+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc03404b070 con 0x7fc0300039b0 2024-05-10T11:15:03.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.037+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0440c97d0 con 0x7fc024076300 2024-05-10T11:15:03.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.043+0000 7fc0417fa640 1 -- 172.21.15.66:0/1774245345 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250070 (secure 0 0 0) 0x7fc0440c97d0 con 0x7fc024076300 2024-05-10T11:15:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:03.047 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:15:03.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc024076300 msgr2=0x7fc0240787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc024076300 0x7fc0240787c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0440697b0 tx=0x7fc02c008040 comp rx=0 tx=0).stop 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 msgr2=0x7fc044147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc044147b60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c210 tx=0x7fc034001a40 comp rx=0 tx=0).stop 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 shutdown_connections 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc024076300 0x7fc0240787c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc044070c90 0x7fc044071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0440c68c0 0x7fc0441e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 --2- 172.21.15.66:0/1774245345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0300039b0 0x7fc044147b60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 >> 172.21.15.66:0/1774245345 conn(0x7fc0440d2df0 msgr2=0x7fc04415d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 shutdown_connections 2024-05-10T11:15:03.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.046+0000 7fc04ad4e640 1 -- 172.21.15.66:0/1774245345 wait complete. 2024-05-10T11:15:03.057 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-10T11:15:01.720024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":129,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223020,"kb_used_data":6832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751700,"statfs":{"total":773094113280,"available":772865740800,"internally_reserved":0,"allocated":6995968,"data_stored":3746854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457177"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277939+0000","last_change":"2024-05-10T11:14:57.277939+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277939+0000","last_undegraded":"2024-05-10T11:14:57.277939+0000","last_fullsized":"2024-05-10T11:14:57.277939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277888+0000","last_change":"2024-05-10T11:14:57.277888+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277888+0000","last_undegraded":"2024-05-10T11:14:57.277888+0000","last_fullsized":"2024-05-10T11:14:57.277888+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304210+0000","last_change":"2024-05-10T11:14:58.297410+0000","last_active":"2024-05-10T11:14:58.304210+0000","last_peered":"2024-05-10T11:14:58.304210+0000","last_clean":"2024-05-10T11:14:58.304210+0000","last_became_active":"2024-05-10T11:14:58.297147+0000","last_became_peered":"2024-05-10T11:14:58.297147+0000","last_unstale":"2024-05-10T11:14:58.304210+0000","last_undegraded":"2024-05-10T11:14:58.304210+0000","last_fullsized":"2024-05-10T11:14:58.304210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:13.060645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306506+0000","last_change":"2024-05-10T11:14:58.294909+0000","last_active":"2024-05-10T11:14:58.306506+0000","last_peered":"2024-05-10T11:14:58.306506+0000","last_clean":"2024-05-10T11:14:58.306506+0000","last_became_active":"2024-05-10T11:14:58.294219+0000","last_became_peered":"2024-05-10T11:14:58.294219+0000","last_unstale":"2024-05-10T11:14:58.306506+0000","last_undegraded":"2024-05-10T11:14:58.306506+0000","last_fullsized":"2024-05-10T11:14:58.306506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305830+0000","last_change":"2024-05-10T11:14:58.302152+0000","last_active":"2024-05-10T11:14:58.305830+0000","last_peered":"2024-05-10T11:14:58.305830+0000","last_clean":"2024-05-10T11:14:58.305830+0000","last_became_active":"2024-05-10T11:14:58.301618+0000","last_became_peered":"2024-05-10T11:14:58.301618+0000","last_unstale":"2024-05-10T11:14:58.305830+0000","last_undegraded":"2024-05-10T11:14:58.305830+0000","last_fullsized":"2024-05-10T11:14:58.305830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:22.704456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271980+0000","last_change":"2024-05-10T11:14:57.271980+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271980+0000","last_undegraded":"2024-05-10T11:14:57.271980+0000","last_fullsized":"2024-05-10T11:14:57.271980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271169+0000","last_change":"2024-05-10T11:14:57.271169+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271169+0000","last_undegraded":"2024-05-10T11:14:57.271169+0000","last_fullsized":"2024-05-10T11:14:57.271169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293457+0000","last_change":"2024-05-10T11:14:58.305552+0000","last_active":"2024-05-10T11:14:59.293457+0000","last_peered":"2024-05-10T11:14:59.293457+0000","last_clean":"2024-05-10T11:14:59.293457+0000","last_became_active":"2024-05-10T11:14:58.305299+0000","last_became_peered":"2024-05-10T11:14:58.305299+0000","last_unstale":"2024-05-10T11:14:59.293457+0000","last_undegraded":"2024-05-10T11:14:59.293457+0000","last_fullsized":"2024-05-10T11:14:59.293457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:38.945852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309803+0000","last_change":"2024-05-10T11:14:58.307371+0000","last_active":"2024-05-10T11:14:58.309803+0000","last_peered":"2024-05-10T11:14:58.309803+0000","last_clean":"2024-05-10T11:14:58.309803+0000","last_became_active":"2024-05-10T11:14:58.307064+0000","last_became_peered":"2024-05-10T11:14:58.307064+0000","last_unstale":"2024-05-10T11:14:58.309803+0000","last_undegraded":"2024-05-10T11:14:58.309803+0000","last_fullsized":"2024-05-10T11:14:58.309803+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:41.509127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304218+0000","last_change":"2024-05-10T11:14:58.299020+0000","last_active":"2024-05-10T11:14:58.304218+0000","last_peered":"2024-05-10T11:14:58.304218+0000","last_clean":"2024-05-10T11:14:58.304218+0000","last_became_active":"2024-05-10T11:14:58.298147+0000","last_became_peered":"2024-05-10T11:14:58.298147+0000","last_unstale":"2024-05-10T11:14:58.304218+0000","last_undegraded":"2024-05-10T11:14:58.304218+0000","last_fullsized":"2024-05-10T11:14:58.304218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:55.573266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306767+0000","last_change":"2024-05-10T11:14:58.292521+0000","last_active":"2024-05-10T11:14:58.306767+0000","last_peered":"2024-05-10T11:14:58.306767+0000","last_clean":"2024-05-10T11:14:58.306767+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.306767+0000","last_undegraded":"2024-05-10T11:14:58.306767+0000","last_fullsized":"2024-05-10T11:14:58.306767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293615+0000","last_change":"2024-05-10T11:14:58.303388+0000","last_active":"2024-05-10T11:14:59.293615+0000","last_peered":"2024-05-10T11:14:59.293615+0000","last_clean":"2024-05-10T11:14:59.293615+0000","last_became_active":"2024-05-10T11:14:58.303093+0000","last_became_peered":"2024-05-10T11:14:58.303093+0000","last_unstale":"2024-05-10T11:14:59.293615+0000","last_undegraded":"2024-05-10T11:14:59.293615+0000","last_fullsized":"2024-05-10T11:14:59.293615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:27.443250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293798+0000","last_change":"2024-05-10T11:14:58.300330+0000","last_active":"2024-05-10T11:14:59.293798+0000","last_peered":"2024-05-10T11:14:59.293798+0000","last_clean":"2024-05-10T11:14:59.293798+0000","last_became_active":"2024-05-10T11:14:58.300074+0000","last_became_peered":"2024-05-10T11:14:58.300074+0000","last_unstale":"2024-05-10T11:14:59.293798+0000","last_undegraded":"2024-05-10T11:14:59.293798+0000","last_fullsized":"2024-05-10T11:14:59.293798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304170+0000","last_change":"2024-05-10T11:14:58.296851+0000","last_active":"2024-05-10T11:14:58.304170+0000","last_peered":"2024-05-10T11:14:58.304170+0000","last_clean":"2024-05-10T11:14:58.304170+0000","last_became_active":"2024-05-10T11:14:58.296494+0000","last_became_peered":"2024-05-10T11:14:58.296494+0000","last_unstale":"2024-05-10T11:14:58.304170+0000","last_undegraded":"2024-05-10T11:14:58.304170+0000","last_fullsized":"2024-05-10T11:14:58.304170+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:54.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307806+0000","last_change":"2024-05-10T11:14:58.303310+0000","last_active":"2024-05-10T11:14:58.307806+0000","last_peered":"2024-05-10T11:14:58.307806+0000","last_clean":"2024-05-10T11:14:58.307806+0000","last_became_active":"2024-05-10T11:14:58.303026+0000","last_became_peered":"2024-05-10T11:14:58.303026+0000","last_unstale":"2024-05-10T11:14:58.307806+0000","last_undegraded":"2024-05-10T11:14:58.307806+0000","last_fullsized":"2024-05-10T11:14:58.307806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:31:04.702811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270646+0000","last_change":"2024-05-10T11:14:57.270646+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270646+0000","last_undegraded":"2024-05-10T11:14:57.270646+0000","last_fullsized":"2024-05-10T11:14:57.270646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274602+0000","last_change":"2024-05-10T11:14:57.274602+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274602+0000","last_undegraded":"2024-05-10T11:14:57.274602+0000","last_fullsized":"2024-05-10T11:14:57.274602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306599+0000","last_change":"2024-05-10T11:14:58.294765+0000","last_active":"2024-05-10T11:14:58.306599+0000","last_peered":"2024-05-10T11:14:58.306599+0000","last_clean":"2024-05-10T11:14:58.306599+0000","last_became_active":"2024-05-10T11:14:58.294194+0000","last_became_peered":"2024-05-10T11:14:58.294194+0000","last_unstale":"2024-05-10T11:14:58.306599+0000","last_undegraded":"2024-05-10T11:14:58.306599+0000","last_fullsized":"2024-05-10T11:14:58.306599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300735+0000","last_change":"2024-05-10T11:14:58.291296+0000","last_active":"2024-05-10T11:14:58.300735+0000","last_peered":"2024-05-10T11:14:58.300735+0000","last_clean":"2024-05-10T11:14:58.300735+0000","last_became_active":"2024-05-10T11:14:58.291032+0000","last_became_peered":"2024-05-10T11:14:58.291032+0000","last_unstale":"2024-05-10T11:14:58.300735+0000","last_undegraded":"2024-05-10T11:14:58.300735+0000","last_fullsized":"2024-05-10T11:14:58.300735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274968+0000","last_change":"2024-05-10T11:14:57.274968+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274968+0000","last_undegraded":"2024-05-10T11:14:57.274968+0000","last_fullsized":"2024-05-10T11:14:57.274968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293720+0000","last_change":"2024-05-10T11:14:58.292301+0000","last_active":"2024-05-10T11:14:59.293720+0000","last_peered":"2024-05-10T11:14:59.293720+0000","last_clean":"2024-05-10T11:14:59.293720+0000","last_became_active":"2024-05-10T11:14:58.292011+0000","last_became_peered":"2024-05-10T11:14:58.292011+0000","last_unstale":"2024-05-10T11:14:59.293720+0000","last_undegraded":"2024-05-10T11:14:59.293720+0000","last_fullsized":"2024-05-10T11:14:59.293720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:27.519315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273321+0000","last_change":"2024-05-10T11:14:57.273321+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273321+0000","last_undegraded":"2024-05-10T11:14:57.273321+0000","last_fullsized":"2024-05-10T11:14:57.273321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.272697+0000","last_change":"2024-05-10T11:14:57.272697+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.272697+0000","last_undegraded":"2024-05-10T11:14:57.272697+0000","last_fullsized":"2024-05-10T11:14:57.272697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304156+0000","last_change":"2024-05-10T11:14:58.296984+0000","last_active":"2024-05-10T11:14:58.304156+0000","last_peered":"2024-05-10T11:14:58.304156+0000","last_clean":"2024-05-10T11:14:58.304156+0000","last_became_active":"2024-05-10T11:14:58.296624+0000","last_became_peered":"2024-05-10T11:14:58.296624+0000","last_unstale":"2024-05-10T11:14:58.304156+0000","last_undegraded":"2024-05-10T11:14:58.304156+0000","last_fullsized":"2024-05-10T11:14:58.304156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:10.187464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293927+0000","last_change":"2024-05-10T11:14:58.294450+0000","last_active":"2024-05-10T11:14:59.293927+0000","last_peered":"2024-05-10T11:14:59.293927+0000","last_clean":"2024-05-10T11:14:59.293927+0000","last_became_active":"2024-05-10T11:14:58.294145+0000","last_became_peered":"2024-05-10T11:14:58.294145+0000","last_unstale":"2024-05-10T11:14:59.293927+0000","last_undegraded":"2024-05-10T11:14:59.293927+0000","last_fullsized":"2024-05-10T11:14:59.293927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293796+0000","last_change":"2024-05-10T11:14:58.295269+0000","last_active":"2024-05-10T11:14:59.293796+0000","last_peered":"2024-05-10T11:14:59.293796+0000","last_clean":"2024-05-10T11:14:59.293796+0000","last_became_active":"2024-05-10T11:14:58.294820+0000","last_became_peered":"2024-05-10T11:14:58.294820+0000","last_unstale":"2024-05-10T11:14:59.293796+0000","last_undegraded":"2024-05-10T11:14:59.293796+0000","last_fullsized":"2024-05-10T11:14:59.293796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:37.670772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306749+0000","last_change":"2024-05-10T11:14:58.292277+0000","last_active":"2024-05-10T11:14:58.306749+0000","last_peered":"2024-05-10T11:14:58.306749+0000","last_clean":"2024-05-10T11:14:58.306749+0000","last_became_active":"2024-05-10T11:14:58.291531+0000","last_became_peered":"2024-05-10T11:14:58.291531+0000","last_unstale":"2024-05-10T11:14:58.306749+0000","last_undegraded":"2024-05-10T11:14:58.306749+0000","last_fullsized":"2024-05-10T11:14:58.306749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.278535+0000","last_change":"2024-05-10T11:14:57.278535+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.278535+0000","last_undegraded":"2024-05-10T11:14:57.278535+0000","last_fullsized":"2024-05-10T11:14:57.278535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.312652+0000","last_change":"2024-05-10T11:14:58.309493+0000","last_active":"2024-05-10T11:14:58.312652+0000","last_peered":"2024-05-10T11:14:58.312652+0000","last_clean":"2024-05-10T11:14:58.312652+0000","last_became_active":"2024-05-10T11:14:58.308480+0000","last_became_peered":"2024-05-10T11:14:58.308480+0000","last_unstale":"2024-05-10T11:14:58.312652+0000","last_undegraded":"2024-05-10T11:14:58.312652+0000","last_fullsized":"2024-05-10T11:14:58.312652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:00:22.050849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293420+0000","last_change":"2024-05-10T11:14:58.304102+0000","last_active":"2024-05-10T11:14:59.293420+0000","last_peered":"2024-05-10T11:14:59.293420+0000","last_clean":"2024-05-10T11:14:59.293420+0000","last_became_active":"2024-05-10T11:14:58.303832+0000","last_became_peered":"2024-05-10T11:14:58.303832+0000","last_unstale":"2024-05-10T11:14:59.293420+0000","last_undegraded":"2024-05-10T11:14:59.293420+0000","last_fullsized":"2024-05-10T11:14:59.293420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:24.954543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306675+0000","last_change":"2024-05-10T11:14:58.290600+0000","last_active":"2024-05-10T11:14:58.306675+0000","last_peered":"2024-05-10T11:14:58.306675+0000","last_clean":"2024-05-10T11:14:58.306675+0000","last_became_active":"2024-05-10T11:14:58.290320+0000","last_became_peered":"2024-05-10T11:14:58.290320+0000","last_unstale":"2024-05-10T11:14:58.306675+0000","last_undegraded":"2024-05-10T11:14:58.306675+0000","last_fullsized":"2024-05-10T11:14:58.306675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:01.249122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271538+0000","last_change":"2024-05-10T11:14:57.271538+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271538+0000","last_undegraded":"2024-05-10T11:14:57.271538+0000","last_fullsized":"2024-05-10T11:14:57.271538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299993+0000","last_change":"2024-05-10T11:14:58.293177+0000","last_active":"2024-05-10T11:14:58.299993+0000","last_peered":"2024-05-10T11:14:58.299993+0000","last_clean":"2024-05-10T11:14:58.299993+0000","last_became_active":"2024-05-10T11:14:58.292884+0000","last_became_peered":"2024-05-10T11:14:58.292884+0000","last_unstale":"2024-05-10T11:14:58.299993+0000","last_undegraded":"2024-05-10T11:14:58.299993+0000","last_fullsized":"2024-05-10T11:14:58.299993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288082+0000","last_change":"2024-05-10T11:14:57.284107+0000","last_active":"2024-05-10T11:14:57.288082+0000","last_peered":"2024-05-10T11:14:57.288082+0000","last_clean":"2024-05-10T11:14:57.288082+0000","last_became_active":"2024-05-10T11:14:57.283807+0000","last_became_peered":"2024-05-10T11:14:57.283807+0000","last_unstale":"2024-05-10T11:14:57.288082+0000","last_undegraded":"2024-05-10T11:14:57.288082+0000","last_fullsized":"2024-05-10T11:14:57.288082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:06.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306728+0000","last_change":"2024-05-10T11:14:58.291184+0000","last_active":"2024-05-10T11:14:58.306728+0000","last_peered":"2024-05-10T11:14:58.306728+0000","last_clean":"2024-05-10T11:14:58.306728+0000","last_became_active":"2024-05-10T11:14:58.290918+0000","last_became_peered":"2024-05-10T11:14:58.290918+0000","last_unstale":"2024-05-10T11:14:58.306728+0000","last_undegraded":"2024-05-10T11:14:58.306728+0000","last_fullsized":"2024-05-10T11:14:58.306728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283390+0000","last_change":"2024-05-10T11:14:57.278080+0000","last_active":"2024-05-10T11:14:57.283390+0000","last_peered":"2024-05-10T11:14:57.283390+0000","last_clean":"2024-05-10T11:14:57.283390+0000","last_became_active":"2024-05-10T11:14:57.277750+0000","last_became_peered":"2024-05-10T11:14:57.277750+0000","last_unstale":"2024-05-10T11:14:57.283390+0000","last_undegraded":"2024-05-10T11:14:57.283390+0000","last_fullsized":"2024-05-10T11:14:57.283390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:27:23.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271033+0000","last_change":"2024-05-10T11:14:57.271033+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271033+0000","last_undegraded":"2024-05-10T11:14:57.271033+0000","last_fullsized":"2024-05-10T11:14:57.271033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283415+0000","last_change":"2024-05-10T11:14:57.278386+0000","last_active":"2024-05-10T11:14:57.283415+0000","last_peered":"2024-05-10T11:14:57.283415+0000","last_clean":"2024-05-10T11:14:57.283415+0000","last_became_active":"2024-05-10T11:14:57.278063+0000","last_became_peered":"2024-05-10T11:14:57.278063+0000","last_unstale":"2024-05-10T11:14:57.283415+0000","last_undegraded":"2024-05-10T11:14:57.283415+0000","last_fullsized":"2024-05-10T11:14:57.283415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:17.184537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304139+0000","last_change":"2024-05-10T11:14:58.296717+0000","last_active":"2024-05-10T11:14:58.304139+0000","last_peered":"2024-05-10T11:14:58.304139+0000","last_clean":"2024-05-10T11:14:58.304139+0000","last_became_active":"2024-05-10T11:14:58.296326+0000","last_became_peered":"2024-05-10T11:14:58.296326+0000","last_unstale":"2024-05-10T11:14:58.304139+0000","last_undegraded":"2024-05-10T11:14:58.304139+0000","last_fullsized":"2024-05-10T11:14:58.304139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:00.644583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287875+0000","last_change":"2024-05-10T11:14:57.284933+0000","last_active":"2024-05-10T11:14:57.287875+0000","last_peered":"2024-05-10T11:14:57.287875+0000","last_clean":"2024-05-10T11:14:57.287875+0000","last_became_active":"2024-05-10T11:14:57.284634+0000","last_became_peered":"2024-05-10T11:14:57.284634+0000","last_unstale":"2024-05-10T11:14:57.287875+0000","last_undegraded":"2024-05-10T11:14:57.287875+0000","last_fullsized":"2024-05-10T11:14:57.287875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:09.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270165+0000","last_change":"2024-05-10T11:14:57.270165+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270165+0000","last_undegraded":"2024-05-10T11:14:57.270165+0000","last_fullsized":"2024-05-10T11:14:57.270165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288408+0000","last_change":"2024-05-10T11:14:57.282928+0000","last_active":"2024-05-10T11:14:57.288408+0000","last_peered":"2024-05-10T11:14:57.288408+0000","last_clean":"2024-05-10T11:14:57.288408+0000","last_became_active":"2024-05-10T11:14:57.282648+0000","last_became_peered":"2024-05-10T11:14:57.282648+0000","last_unstale":"2024-05-10T11:14:57.288408+0000","last_undegraded":"2024-05-10T11:14:57.288408+0000","last_fullsized":"2024-05-10T11:14:57.288408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:55.414121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273482+0000","last_change":"2024-05-10T11:14:57.273482+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273482+0000","last_undegraded":"2024-05-10T11:14:57.273482+0000","last_fullsized":"2024-05-10T11:14:57.273482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288470+0000","last_change":"2024-05-10T11:14:57.281848+0000","last_active":"2024-05-10T11:14:57.288470+0000","last_peered":"2024-05-10T11:14:57.288470+0000","last_clean":"2024-05-10T11:14:57.288470+0000","last_became_active":"2024-05-10T11:14:57.281514+0000","last_became_peered":"2024-05-10T11:14:57.281514+0000","last_unstale":"2024-05-10T11:14:57.288470+0000","last_undegraded":"2024-05-10T11:14:57.288470+0000","last_fullsized":"2024-05-10T11:14:57.288470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:09.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.303741+0000","last_change":"2024-05-10T11:14:58.301360+0000","last_active":"2024-05-10T11:14:58.303741+0000","last_peered":"2024-05-10T11:14:58.303741+0000","last_clean":"2024-05-10T11:14:58.303741+0000","last_became_active":"2024-05-10T11:14:58.301013+0000","last_became_peered":"2024-05-10T11:14:58.301013+0000","last_unstale":"2024-05-10T11:14:58.303741+0000","last_undegraded":"2024-05-10T11:14:58.303741+0000","last_fullsized":"2024-05-10T11:14:58.303741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288594+0000","last_change":"2024-05-10T11:14:57.284239+0000","last_active":"2024-05-10T11:14:57.288594+0000","last_peered":"2024-05-10T11:14:57.288594+0000","last_clean":"2024-05-10T11:14:57.288594+0000","last_became_active":"2024-05-10T11:14:57.283872+0000","last_became_peered":"2024-05-10T11:14:57.283872+0000","last_unstale":"2024-05-10T11:14:57.288594+0000","last_undegraded":"2024-05-10T11:14:57.288594+0000","last_fullsized":"2024-05-10T11:14:57.288594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:57.173000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274149+0000","last_change":"2024-05-10T11:14:57.274149+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274149+0000","last_undegraded":"2024-05-10T11:14:57.274149+0000","last_fullsized":"2024-05-10T11:14:57.274149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.284885+0000","last_change":"2024-05-10T11:14:57.283820+0000","last_active":"2024-05-10T11:14:58.284885+0000","last_peered":"2024-05-10T11:14:58.284885+0000","last_clean":"2024-05-10T11:14:58.284885+0000","last_became_active":"2024-05-10T11:14:57.283489+0000","last_became_peered":"2024-05-10T11:14:57.283489+0000","last_unstale":"2024-05-10T11:14:58.284885+0000","last_undegraded":"2024-05-10T11:14:58.284885+0000","last_fullsized":"2024-05-10T11:14:58.284885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.244441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.277648+0000","last_change":"2024-05-10T11:14:57.277648+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.277648+0000","last_undegraded":"2024-05-10T11:14:57.277648+0000","last_fullsized":"2024-05-10T11:14:57.277648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.286683+0000","last_change":"2024-05-10T11:14:57.285058+0000","last_active":"2024-05-10T11:14:58.286683+0000","last_peered":"2024-05-10T11:14:58.286683+0000","last_clean":"2024-05-10T11:14:58.286683+0000","last_became_active":"2024-05-10T11:14:57.284745+0000","last_became_peered":"2024-05-10T11:14:57.284745+0000","last_unstale":"2024-05-10T11:14:58.286683+0000","last_undegraded":"2024-05-10T11:14:58.286683+0000","last_fullsized":"2024-05-10T11:14:58.286683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:26.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.273343+0000","last_change":"2024-05-10T11:14:57.273343+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.273343+0000","last_undegraded":"2024-05-10T11:14:57.273343+0000","last_fullsized":"2024-05-10T11:14:57.273343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.282335+0000","last_change":"2024-05-10T11:14:57.285480+0000","last_active":"2024-05-10T11:14:58.282335+0000","last_peered":"2024-05-10T11:14:58.282335+0000","last_clean":"2024-05-10T11:14:58.282335+0000","last_became_active":"2024-05-10T11:14:57.284658+0000","last_became_peered":"2024-05-10T11:14:57.284658+0000","last_unstale":"2024-05-10T11:14:58.282335+0000","last_undegraded":"2024-05-10T11:14:58.282335+0000","last_fullsized":"2024-05-10T11:14:58.282335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:50.772681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300570+0000","last_change":"2024-05-10T11:14:58.293724+0000","last_active":"2024-05-10T11:14:58.300570+0000","last_peered":"2024-05-10T11:14:58.300570+0000","last_clean":"2024-05-10T11:14:58.300570+0000","last_became_active":"2024-05-10T11:14:58.293401+0000","last_became_peered":"2024-05-10T11:14:58.293401+0000","last_unstale":"2024-05-10T11:14:58.300570+0000","last_undegraded":"2024-05-10T11:14:58.300570+0000","last_fullsized":"2024-05-10T11:14:58.300570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309144+0000","last_change":"2024-05-10T11:14:57.285078+0000","last_active":"2024-05-10T11:14:58.309144+0000","last_peered":"2024-05-10T11:14:58.309144+0000","last_clean":"2024-05-10T11:14:58.309144+0000","last_became_active":"2024-05-10T11:14:57.284761+0000","last_became_peered":"2024-05-10T11:14:57.284761+0000","last_unstale":"2024-05-10T11:14:58.309144+0000","last_undegraded":"2024-05-10T11:14:58.309144+0000","last_fullsized":"2024-05-10T11:14:58.309144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:06:59.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306505+0000","last_change":"2024-05-10T11:14:58.293097+0000","last_active":"2024-05-10T11:14:58.306505+0000","last_peered":"2024-05-10T11:14:58.306505+0000","last_clean":"2024-05-10T11:14:58.306505+0000","last_became_active":"2024-05-10T11:14:58.292833+0000","last_became_peered":"2024-05-10T11:14:58.292833+0000","last_unstale":"2024-05-10T11:14:58.306505+0000","last_undegraded":"2024-05-10T11:14:58.306505+0000","last_fullsized":"2024-05-10T11:14:58.306505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288111+0000","last_change":"2024-05-10T11:14:57.283470+0000","last_active":"2024-05-10T11:14:57.288111+0000","last_peered":"2024-05-10T11:14:57.288111+0000","last_clean":"2024-05-10T11:14:57.288111+0000","last_became_active":"2024-05-10T11:14:57.283190+0000","last_became_peered":"2024-05-10T11:14:57.283190+0000","last_unstale":"2024-05-10T11:14:57.288111+0000","last_undegraded":"2024-05-10T11:14:57.288111+0000","last_fullsized":"2024-05-10T11:14:57.288111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:39.017034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308266+0000","last_change":"2024-05-10T11:14:58.302029+0000","last_active":"2024-05-10T11:14:58.308266+0000","last_peered":"2024-05-10T11:14:58.308266+0000","last_clean":"2024-05-10T11:14:58.308266+0000","last_became_active":"2024-05-10T11:14:58.301749+0000","last_became_peered":"2024-05-10T11:14:58.301749+0000","last_unstale":"2024-05-10T11:14:58.308266+0000","last_undegraded":"2024-05-10T11:14:58.308266+0000","last_fullsized":"2024-05-10T11:14:58.308266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308805+0000","last_change":"2024-05-10T11:14:57.288628+0000","last_active":"2024-05-10T11:14:58.308805+0000","last_peered":"2024-05-10T11:14:58.308805+0000","last_clean":"2024-05-10T11:14:58.308805+0000","last_became_active":"2024-05-10T11:14:57.288267+0000","last_became_peered":"2024-05-10T11:14:57.288267+0000","last_unstale":"2024-05-10T11:14:58.308805+0000","last_undegraded":"2024-05-10T11:14:58.308805+0000","last_fullsized":"2024-05-10T11:14:58.308805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:52.106425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293396+0000","last_change":"2024-05-10T11:14:58.292318+0000","last_active":"2024-05-10T11:14:59.293396+0000","last_peered":"2024-05-10T11:14:59.293396+0000","last_clean":"2024-05-10T11:14:59.293396+0000","last_became_active":"2024-05-10T11:14:58.292027+0000","last_became_peered":"2024-05-10T11:14:58.292027+0000","last_unstale":"2024-05-10T11:14:59.293396+0000","last_undegraded":"2024-05-10T11:14:59.293396+0000","last_fullsized":"2024-05-10T11:14:59.293396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:52.214989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293493+0000","last_change":"2024-05-10T11:14:57.285459+0000","last_active":"2024-05-10T11:14:59.293493+0000","last_peered":"2024-05-10T11:14:59.293493+0000","last_clean":"2024-05-10T11:14:59.293493+0000","last_became_active":"2024-05-10T11:14:57.285146+0000","last_became_peered":"2024-05-10T11:14:57.285146+0000","last_unstale":"2024-05-10T11:14:59.293493+0000","last_undegraded":"2024-05-10T11:14:59.293493+0000","last_fullsized":"2024-05-10T11:14:59.293493+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:54.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299748+0000","last_change":"2024-05-10T11:14:58.290578+0000","last_active":"2024-05-10T11:14:58.299748+0000","last_peered":"2024-05-10T11:14:58.299748+0000","last_clean":"2024-05-10T11:14:58.299748+0000","last_became_active":"2024-05-10T11:14:58.290298+0000","last_became_peered":"2024-05-10T11:14:58.290298+0000","last_unstale":"2024-05-10T11:14:58.299748+0000","last_undegraded":"2024-05-10T11:14:58.299748+0000","last_fullsized":"2024-05-10T11:14:58.299748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.293943+0000","last_change":"2024-05-10T11:14:57.288627+0000","last_active":"2024-05-10T11:14:58.293943+0000","last_peered":"2024-05-10T11:14:58.293943+0000","last_clean":"2024-05-10T11:14:58.293943+0000","last_became_active":"2024-05-10T11:14:57.288307+0000","last_became_peered":"2024-05-10T11:14:57.288307+0000","last_unstale":"2024-05-10T11:14:58.293943+0000","last_undegraded":"2024-05-10T11:14:58.293943+0000","last_fullsized":"2024-05-10T11:14:58.293943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:36.022029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.274125+0000","last_change":"2024-05-10T11:14:57.274125+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.274125+0000","last_undegraded":"2024-05-10T11:14:57.274125+0000","last_fullsized":"2024-05-10T11:14:57.274125+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.313414+0000","last_change":"2024-05-10T11:14:57.278123+0000","last_active":"2024-05-10T11:14:58.313414+0000","last_peered":"2024-05-10T11:14:58.313414+0000","last_clean":"2024-05-10T11:14:58.313414+0000","last_became_active":"2024-05-10T11:14:57.277822+0000","last_became_peered":"2024-05-10T11:14:57.277822+0000","last_unstale":"2024-05-10T11:14:58.313414+0000","last_undegraded":"2024-05-10T11:14:58.313414+0000","last_fullsized":"2024-05-10T11:14:58.313414+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:57.287132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307694+0000","last_change":"2024-05-10T11:14:58.303477+0000","last_active":"2024-05-10T11:14:58.307694+0000","last_peered":"2024-05-10T11:14:58.307694+0000","last_clean":"2024-05-10T11:14:58.307694+0000","last_became_active":"2024-05-10T11:14:58.303122+0000","last_became_peered":"2024-05-10T11:14:58.303122+0000","last_unstale":"2024-05-10T11:14:58.307694+0000","last_undegraded":"2024-05-10T11:14:58.307694+0000","last_fullsized":"2024-05-10T11:14:58.307694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:17.047773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293870+0000","last_change":"2024-05-10T11:14:57.281686+0000","last_active":"2024-05-10T11:14:59.293870+0000","last_peered":"2024-05-10T11:14:59.293870+0000","last_clean":"2024-05-10T11:14:59.293870+0000","last_became_active":"2024-05-10T11:14:57.281376+0000","last_became_peered":"2024-05-10T11:14:57.281376+0000","last_unstale":"2024-05-10T11:14:59.293870+0000","last_undegraded":"2024-05-10T11:14:59.293870+0000","last_fullsized":"2024-05-10T11:14:59.293870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:26.398829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305865+0000","last_change":"2024-05-10T11:14:58.301783+0000","last_active":"2024-05-10T11:14:58.305865+0000","last_peered":"2024-05-10T11:14:58.305865+0000","last_clean":"2024-05-10T11:14:58.305865+0000","last_became_active":"2024-05-10T11:14:58.301333+0000","last_became_peered":"2024-05-10T11:14:58.301333+0000","last_unstale":"2024-05-10T11:14:58.305865+0000","last_undegraded":"2024-05-10T11:14:58.305865+0000","last_fullsized":"2024-05-10T11:14:58.305865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:29.273264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309603+0000","last_change":"2024-05-10T11:14:57.291311+0000","last_active":"2024-05-10T11:14:58.309603+0000","last_peered":"2024-05-10T11:14:58.309603+0000","last_clean":"2024-05-10T11:14:58.309603+0000","last_became_active":"2024-05-10T11:14:57.291046+0000","last_became_peered":"2024-05-10T11:14:57.291046+0000","last_unstale":"2024-05-10T11:14:58.309603+0000","last_undegraded":"2024-05-10T11:14:58.309603+0000","last_fullsized":"2024-05-10T11:14:58.309603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:09.641351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306454+0000","last_change":"2024-05-10T11:14:58.294613+0000","last_active":"2024-05-10T11:14:58.306454+0000","last_peered":"2024-05-10T11:14:58.306454+0000","last_clean":"2024-05-10T11:14:58.306454+0000","last_became_active":"2024-05-10T11:14:58.291580+0000","last_became_peered":"2024-05-10T11:14:58.291580+0000","last_unstale":"2024-05-10T11:14:58.306454+0000","last_undegraded":"2024-05-10T11:14:58.306454+0000","last_fullsized":"2024-05-10T11:14:58.306454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307967+0000","last_change":"2024-05-10T11:14:57.286479+0000","last_active":"2024-05-10T11:14:58.307967+0000","last_peered":"2024-05-10T11:14:58.307967+0000","last_clean":"2024-05-10T11:14:58.307967+0000","last_became_active":"2024-05-10T11:14:57.286168+0000","last_became_peered":"2024-05-10T11:14:57.286168+0000","last_unstale":"2024-05-10T11:14:58.307967+0000","last_undegraded":"2024-05-10T11:14:58.307967+0000","last_fullsized":"2024-05-10T11:14:58.307967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:50.752141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299821+0000","last_change":"2024-05-10T11:14:58.291617+0000","last_active":"2024-05-10T11:14:58.299821+0000","last_peered":"2024-05-10T11:14:58.299821+0000","last_clean":"2024-05-10T11:14:58.299821+0000","last_became_active":"2024-05-10T11:14:58.291313+0000","last_became_peered":"2024-05-10T11:14:58.291313+0000","last_unstale":"2024-05-10T11:14:58.299821+0000","last_undegraded":"2024-05-10T11:14:58.299821+0000","last_fullsized":"2024-05-10T11:14:58.299821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287797+0000","last_change":"2024-05-10T11:14:57.280903+0000","last_active":"2024-05-10T11:14:57.287797+0000","last_peered":"2024-05-10T11:14:57.287797+0000","last_clean":"2024-05-10T11:14:57.287797+0000","last_became_active":"2024-05-10T11:14:57.280595+0000","last_became_peered":"2024-05-10T11:14:57.280595+0000","last_unstale":"2024-05-10T11:14:57.287797+0000","last_undegraded":"2024-05-10T11:14:57.287797+0000","last_fullsized":"2024-05-10T11:14:57.287797+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:17.184537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270526+0000","last_change":"2024-05-10T11:14:57.270526+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270526+0000","last_undegraded":"2024-05-10T11:14:57.270526+0000","last_fullsized":"2024-05-10T11:14:57.270526+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.287922+0000","last_change":"2024-05-10T11:14:57.285784+0000","last_active":"2024-05-10T11:14:57.287922+0000","last_peered":"2024-05-10T11:14:57.287922+0000","last_clean":"2024-05-10T11:14:57.287922+0000","last_became_active":"2024-05-10T11:14:57.285511+0000","last_became_peered":"2024-05-10T11:14:57.285511+0000","last_unstale":"2024-05-10T11:14:57.287922+0000","last_undegraded":"2024-05-10T11:14:57.287922+0000","last_fullsized":"2024-05-10T11:14:57.287922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:55.414121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293402+0000","last_change":"2024-05-10T11:14:58.294900+0000","last_active":"2024-05-10T11:14:59.293402+0000","last_peered":"2024-05-10T11:14:59.293402+0000","last_clean":"2024-05-10T11:14:59.293402+0000","last_became_active":"2024-05-10T11:14:58.293875+0000","last_became_peered":"2024-05-10T11:14:58.293875+0000","last_unstale":"2024-05-10T11:14:59.293402+0000","last_undegraded":"2024-05-10T11:14:59.293402+0000","last_fullsized":"2024-05-10T11:14:59.293402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:35.553377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293556+0000","last_change":"2024-05-10T11:14:57.281997+0000","last_active":"2024-05-10T11:14:59.293556+0000","last_peered":"2024-05-10T11:14:59.293556+0000","last_clean":"2024-05-10T11:14:59.293556+0000","last_became_active":"2024-05-10T11:14:57.281468+0000","last_became_peered":"2024-05-10T11:14:57.281468+0000","last_unstale":"2024-05-10T11:14:59.293556+0000","last_undegraded":"2024-05-10T11:14:59.293556+0000","last_fullsized":"2024-05-10T11:14:59.293556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:08.557076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300074+0000","last_change":"2024-05-10T11:14:58.292189+0000","last_active":"2024-05-10T11:14:58.300074+0000","last_peered":"2024-05-10T11:14:58.300074+0000","last_clean":"2024-05-10T11:14:58.300074+0000","last_became_active":"2024-05-10T11:14:58.291853+0000","last_became_peered":"2024-05-10T11:14:58.291853+0000","last_unstale":"2024-05-10T11:14:58.300074+0000","last_undegraded":"2024-05-10T11:14:58.300074+0000","last_fullsized":"2024-05-10T11:14:58.300074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.293002+0000","last_change":"2024-05-10T11:14:57.286677+0000","last_active":"2024-05-10T11:14:57.293002+0000","last_peered":"2024-05-10T11:14:57.293002+0000","last_clean":"2024-05-10T11:14:57.293002+0000","last_became_active":"2024-05-10T11:14:57.286392+0000","last_became_peered":"2024-05-10T11:14:57.286392+0000","last_unstale":"2024-05-10T11:14:57.293002+0000","last_undegraded":"2024-05-10T11:14:57.293002+0000","last_fullsized":"2024-05-10T11:14:57.293002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:13.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.270508+0000","last_change":"2024-05-10T11:14:57.270508+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.270508+0000","last_undegraded":"2024-05-10T11:14:57.270508+0000","last_fullsized":"2024-05-10T11:14:57.270508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.294020+0000","last_change":"2024-05-10T11:14:57.283832+0000","last_active":"2024-05-10T11:14:59.294020+0000","last_peered":"2024-05-10T11:14:59.294020+0000","last_clean":"2024-05-10T11:14:59.294020+0000","last_became_active":"2024-05-10T11:14:57.283428+0000","last_became_peered":"2024-05-10T11:14:57.283428+0000","last_unstale":"2024-05-10T11:14:59.294020+0000","last_undegraded":"2024-05-10T11:14:59.294020+0000","last_fullsized":"2024-05-10T11:14:59.294020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271126+0000","last_change":"2024-05-10T11:14:57.271126+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271126+0000","last_undegraded":"2024-05-10T11:14:57.271126+0000","last_fullsized":"2024-05-10T11:14:57.271126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293984+0000","last_change":"2024-05-10T11:14:57.282035+0000","last_active":"2024-05-10T11:14:59.293984+0000","last_peered":"2024-05-10T11:14:59.293984+0000","last_clean":"2024-05-10T11:14:59.293984+0000","last_became_active":"2024-05-10T11:14:57.281774+0000","last_became_peered":"2024-05-10T11:14:57.281774+0000","last_unstale":"2024-05-10T11:14:59.293984+0000","last_undegraded":"2024-05-10T11:14:59.293984+0000","last_fullsized":"2024-05-10T11:14:59.293984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:13.792438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293942+0000","last_change":"2024-05-10T11:14:58.296279+0000","last_active":"2024-05-10T11:14:59.293942+0000","last_peered":"2024-05-10T11:14:59.293942+0000","last_clean":"2024-05-10T11:14:59.293942+0000","last_became_active":"2024-05-10T11:14:58.296001+0000","last_became_peered":"2024-05-10T11:14:58.296001+0000","last_unstale":"2024-05-10T11:14:59.293942+0000","last_undegraded":"2024-05-10T11:14:59.293942+0000","last_fullsized":"2024-05-10T11:14:59.293942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.283395+0000","last_change":"2024-05-10T11:14:57.277996+0000","last_active":"2024-05-10T11:14:57.283395+0000","last_peered":"2024-05-10T11:14:57.283395+0000","last_clean":"2024-05-10T11:14:57.283395+0000","last_became_active":"2024-05-10T11:14:57.277696+0000","last_became_peered":"2024-05-10T11:14:57.277696+0000","last_unstale":"2024-05-10T11:14:57.283395+0000","last_undegraded":"2024-05-10T11:14:57.283395+0000","last_fullsized":"2024-05-10T11:14:57.283395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299916+0000","last_change":"2024-05-10T11:14:58.292302+0000","last_active":"2024-05-10T11:14:58.299916+0000","last_peered":"2024-05-10T11:14:58.299916+0000","last_clean":"2024-05-10T11:14:58.299916+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.299916+0000","last_undegraded":"2024-05-10T11:14:58.299916+0000","last_fullsized":"2024-05-10T11:14:58.299916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.285523+0000","last_change":"2024-05-10T11:14:57.281319+0000","last_active":"2024-05-10T11:14:57.285523+0000","last_peered":"2024-05-10T11:14:57.285523+0000","last_clean":"2024-05-10T11:14:57.285523+0000","last_became_active":"2024-05-10T11:14:57.281041+0000","last_became_peered":"2024-05-10T11:14:57.281041+0000","last_unstale":"2024-05-10T11:14:57.285523+0000","last_undegraded":"2024-05-10T11:14:57.285523+0000","last_fullsized":"2024-05-10T11:14:57.285523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:51.028755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300460+0000","last_change":"2024-05-10T11:14:58.299193+0000","last_active":"2024-05-10T11:14:58.300460+0000","last_peered":"2024-05-10T11:14:58.300460+0000","last_clean":"2024-05-10T11:14:58.300460+0000","last_became_active":"2024-05-10T11:14:58.293535+0000","last_became_peered":"2024-05-10T11:14:58.293535+0000","last_unstale":"2024-05-10T11:14:58.300460+0000","last_undegraded":"2024-05-10T11:14:58.300460+0000","last_fullsized":"2024-05-10T11:14:58.300460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:26.263371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289955+0000","last_change":"2024-05-10T11:14:57.288619+0000","last_active":"2024-05-10T11:14:58.289955+0000","last_peered":"2024-05-10T11:14:58.289955+0000","last_clean":"2024-05-10T11:14:58.289955+0000","last_became_active":"2024-05-10T11:14:57.288345+0000","last_became_peered":"2024-05-10T11:14:57.288345+0000","last_unstale":"2024-05-10T11:14:58.289955+0000","last_undegraded":"2024-05-10T11:14:58.289955+0000","last_fullsized":"2024-05-10T11:14:58.289955+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:56.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309165+0000","last_change":"2024-05-10T11:14:58.307212+0000","last_active":"2024-05-10T11:14:58.309165+0000","last_peered":"2024-05-10T11:14:58.309165+0000","last_clean":"2024-05-10T11:14:58.309165+0000","last_became_active":"2024-05-10T11:14:58.306894+0000","last_became_peered":"2024-05-10T11:14:58.306894+0000","last_unstale":"2024-05-10T11:14:58.309165+0000","last_undegraded":"2024-05-10T11:14:58.309165+0000","last_fullsized":"2024-05-10T11:14:58.309165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288545+0000","last_change":"2024-05-10T11:14:57.285145+0000","last_active":"2024-05-10T11:14:57.288545+0000","last_peered":"2024-05-10T11:14:57.288545+0000","last_clean":"2024-05-10T11:14:57.288545+0000","last_became_active":"2024-05-10T11:14:57.284872+0000","last_became_peered":"2024-05-10T11:14:57.284872+0000","last_unstale":"2024-05-10T11:14:57.288545+0000","last_undegraded":"2024-05-10T11:14:57.288545+0000","last_fullsized":"2024-05-10T11:14:57.288545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:39.777254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.276036+0000","last_change":"2024-05-10T11:14:57.276036+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.276036+0000","last_undegraded":"2024-05-10T11:14:57.276036+0000","last_fullsized":"2024-05-10T11:14:57.276036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288615+0000","last_change":"2024-05-10T11:14:57.284501+0000","last_active":"2024-05-10T11:14:57.288615+0000","last_peered":"2024-05-10T11:14:57.288615+0000","last_clean":"2024-05-10T11:14:57.288615+0000","last_became_active":"2024-05-10T11:14:57.283858+0000","last_became_peered":"2024-05-10T11:14:57.283858+0000","last_unstale":"2024-05-10T11:14:57.288615+0000","last_undegraded":"2024-05-10T11:14:57.288615+0000","last_fullsized":"2024-05-10T11:14:57.288615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.826064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-10T11:14:57.271224+0000","last_change":"2024-05-10T11:14:57.271224+0000","last_active":"2024-05-10T11:14:57.261994+0000","last_peered":"2024-05-10T11:14:57.261994+0000","last_clean":"2024-05-10T11:14:57.261994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:14:57.271224+0000","last_undegraded":"2024-05-10T11:14:57.271224+0000","last_fullsized":"2024-05-10T11:14:57.271224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288077+0000","last_change":"2024-05-10T11:14:57.284893+0000","last_active":"2024-05-10T11:14:57.288077+0000","last_peered":"2024-05-10T11:14:57.288077+0000","last_clean":"2024-05-10T11:14:57.288077+0000","last_became_active":"2024-05-10T11:14:57.284424+0000","last_became_peered":"2024-05-10T11:14:57.284424+0000","last_unstale":"2024-05-10T11:14:57.288077+0000","last_undegraded":"2024-05-10T11:14:57.288077+0000","last_fullsized":"2024-05-10T11:14:57.288077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:59.649807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300040+0000","last_change":"2024-05-10T11:14:58.293110+0000","last_active":"2024-05-10T11:14:58.300040+0000","last_peered":"2024-05-10T11:14:58.300040+0000","last_clean":"2024-05-10T11:14:58.300040+0000","last_became_active":"2024-05-10T11:14:58.292854+0000","last_became_peered":"2024-05-10T11:14:58.292854+0000","last_unstale":"2024-05-10T11:14:58.300040+0000","last_undegraded":"2024-05-10T11:14:58.300040+0000","last_fullsized":"2024-05-10T11:14:58.300040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-10T11:14:57.288438+0000","last_change":"2024-05-10T11:14:57.282272+0000","last_active":"2024-05-10T11:14:57.288438+0000","last_peered":"2024-05-10T11:14:57.288438+0000","last_clean":"2024-05-10T11:14:57.288438+0000","last_became_active":"2024-05-10T11:14:57.281986+0000","last_became_peered":"2024-05-10T11:14:57.281986+0000","last_unstale":"2024-05-10T11:14:57.288438+0000","last_undegraded":"2024-05-10T11:14:57.288438+0000","last_fullsized":"2024-05-10T11:14:57.288438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:13.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":184,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289692+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:14:58.289692+0000","last_peered":"2024-05-10T11:14:58.289692+0000","last_clean":"2024-05-10T11:14:58.289692+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:14:58.289692+0000","last_undegraded":"2024-05-10T11:14:58.289692+0000","last_fullsized":"2024-05-10T11:14:58.289692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":916015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":324905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":326483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":317704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":311045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":311045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1310720,"data_stored":908072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":331585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:15:03.061 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-05-10T11:15:03.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.277939+0000', 'last_change': '2024-05-10T11:14:57.277939+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.277939+0000', 'last_undegraded': '2024-05-10T11:14:57.277939+0000', 'last_fullsized': '2024-05-10T11:14:57.277939+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.061 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-05-10T11:15:03.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.277888+0000', 'last_change': '2024-05-10T11:14:57.277888+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.277888+0000', 'last_undegraded': '2024-05-10T11:14:57.277888+0000', 'last_fullsized': '2024-05-10T11:14:57.277888+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.061 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3a is not active+clean 2024-05-10T11:15:03.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.271980+0000', 'last_change': '2024-05-10T11:14:57.271980+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.271980+0000', 'last_undegraded': '2024-05-10T11:14:57.271980+0000', 'last_fullsized': '2024-05-10T11:14:57.271980+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:PG 10.39 is not active+clean 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.271169+0000', 'last_change': '2024-05-10T11:14:57.271169+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.271169+0000', 'last_undegraded': '2024-05-10T11:14:57.271169+0000', 'last_fullsized': '2024-05-10T11:14:57.271169+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.270646+0000', 'last_change': '2024-05-10T11:14:57.270646+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.270646+0000', 'last_undegraded': '2024-05-10T11:14:57.270646+0000', 'last_fullsized': '2024-05-10T11:14:57.270646+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.274602+0000', 'last_change': '2024-05-10T11:14:57.274602+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.274602+0000', 'last_undegraded': '2024-05-10T11:14:57.274602+0000', 'last_fullsized': '2024-05-10T11:14:57.274602+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2c is not active+clean 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.274968+0000', 'last_change': '2024-05-10T11:14:57.274968+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.274968+0000', 'last_undegraded': '2024-05-10T11:14:57.274968+0000', 'last_fullsized': '2024-05-10T11:14:57.274968+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2a is not active+clean 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.273321+0000', 'last_change': '2024-05-10T11:14:57.273321+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.273321+0000', 'last_undegraded': '2024-05-10T11:14:57.273321+0000', 'last_fullsized': '2024-05-10T11:14:57.273321+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T11:15:03.062 INFO:tasks.ceph.ceph_manager.ceph:PG 10.29 is not active+clean 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.272697+0000', 'last_change': '2024-05-10T11:14:57.272697+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.272697+0000', 'last_undegraded': '2024-05-10T11:14:57.272697+0000', 'last_fullsized': '2024-05-10T11:14:57.272697+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.278535+0000', 'last_change': '2024-05-10T11:14:57.278535+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.278535+0000', 'last_undegraded': '2024-05-10T11:14:57.278535+0000', 'last_fullsized': '2024-05-10T11:14:57.278535+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:PG 10.20 is not active+clean 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.271538+0000', 'last_change': '2024-05-10T11:14:57.271538+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.271538+0000', 'last_undegraded': '2024-05-10T11:14:57.271538+0000', 'last_fullsized': '2024-05-10T11:14:57.271538+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.271033+0000', 'last_change': '2024-05-10T11:14:57.271033+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.271033+0000', 'last_undegraded': '2024-05-10T11:14:57.271033+0000', 'last_fullsized': '2024-05-10T11:14:57.271033+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.270165+0000', 'last_change': '2024-05-10T11:14:57.270165+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.270165+0000', 'last_undegraded': '2024-05-10T11:14:57.270165+0000', 'last_fullsized': '2024-05-10T11:14:57.270165+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T11:15:03.063 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.273482+0000', 'last_change': '2024-05-10T11:14:57.273482+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.273482+0000', 'last_undegraded': '2024-05-10T11:14:57.273482+0000', 'last_fullsized': '2024-05-10T11:14:57.273482+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.274149+0000', 'last_change': '2024-05-10T11:14:57.274149+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.274149+0000', 'last_undegraded': '2024-05-10T11:14:57.274149+0000', 'last_fullsized': '2024-05-10T11:14:57.274149+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.277648+0000', 'last_change': '2024-05-10T11:14:57.277648+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.277648+0000', 'last_undegraded': '2024-05-10T11:14:57.277648+0000', 'last_fullsized': '2024-05-10T11:14:57.277648+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.273343+0000', 'last_change': '2024-05-10T11:14:57.273343+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.273343+0000', 'last_undegraded': '2024-05-10T11:14:57.273343+0000', 'last_fullsized': '2024-05-10T11:14:57.273343+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.274125+0000', 'last_change': '2024-05-10T11:14:57.274125+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.274125+0000', 'last_undegraded': '2024-05-10T11:14:57.274125+0000', 'last_fullsized': '2024-05-10T11:14:57.274125+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-05-10T11:15:03.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.270526+0000', 'last_change': '2024-05-10T11:14:57.270526+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.270526+0000', 'last_undegraded': '2024-05-10T11:14:57.270526+0000', 'last_fullsized': '2024-05-10T11:14:57.270526+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.270508+0000', 'last_change': '2024-05-10T11:14:57.270508+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.270508+0000', 'last_undegraded': '2024-05-10T11:14:57.270508+0000', 'last_fullsized': '2024-05-10T11:14:57.270508+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.271126+0000', 'last_change': '2024-05-10T11:14:57.271126+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.271126+0000', 'last_undegraded': '2024-05-10T11:14:57.271126+0000', 'last_fullsized': '2024-05-10T11:14:57.271126+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.276036+0000', 'last_change': '2024-05-10T11:14:57.276036+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.276036+0000', 'last_undegraded': '2024-05-10T11:14:57.276036+0000', 'last_fullsized': '2024-05-10T11:14:57.276036+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-05-10T11:15:03.065 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:14:57.271224+0000', 'last_change': '2024-05-10T11:14:57.271224+0000', 'last_active': '2024-05-10T11:14:57.261994+0000', 'last_peered': '2024-05-10T11:14:57.261994+0000', 'last_clean': '2024-05-10T11:14:57.261994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:14:57.271224+0000', 'last_undegraded': '2024-05-10T11:14:57.271224+0000', 'last_fullsized': '2024-05-10T11:14:57.271224+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'last_clean_scrub_stamp': '2024-05-10T11:14:57.261994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T11:15:03.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T11:15:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.200+0000 7f63ec008640 1 Processor -- start 2024-05-10T11:15:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.200+0000 7f63ec008640 1 -- start start 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63ec008640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f63e4162750 0x7f63e40d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63ec008640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162b30 0x7f63e40b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63ec008640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e40b45f0 con 0x7f63e40d5cb0 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63ec008640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f63e40b4f20 con 0x7f63e4162750 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63ec008640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40d0fe0 con 0x7f63e4162b30 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e95a3640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f63e40d5cb0 0x7f63e40d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49384/0 (socket says 172.21.15.66:49384) 2024-05-10T11:15:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e95a3640 1 -- 172.21.15.66:0/663526945 learned_addr learned my addr 172.21.15.66:0/663526945 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e9da4640 1 --2- 172.21.15.66:0/663526945 >> v2:172.21.15.190:3300/0 conn(0x7f63e4162750 0x7f63e40d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63ea5a5640 1 --2- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162b30 0x7f63e40b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e8da2640 1 -- 172.21.15.66:0/663526945 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833698399 0 0) 0x7f63e40b45f0 con 0x7f63e40d5cb0 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e8da2640 1 -- 172.21.15.66:0/663526945 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d0003520 con 0x7f63e40d5cb0 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e8da2640 1 -- 172.21.15.66:0/663526945 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 853052216 0 0) 0x7f63d0003520 con 0x7f63e40d5cb0 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e9da4640 1 -- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162b30 msgr2=0x7f63e40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e9da4640 1 --2- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162b30 0x7f63e40b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e9da4640 1 -- 172.21.15.66:0/663526945 >> v1:172.21.15.66:6789/0 conn(0x7f63e40d5cb0 legacy=0x7f63e40d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.201+0000 7f63e9da4640 1 -- 172.21.15.66:0/663526945 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40b48d0 con 0x7f63e4162750 2024-05-10T11:15:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.202+0000 7f63e9da4640 1 --2- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e4162750 0x7f63e40d0670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f63e00097a0 tx=0x7f63e002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6baaf8799ce4c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.202+0000 7f63e8da2640 1 -- 172.21.15.66:0/663526945 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0037070 con 0x7f63e4162750 2024-05-10T11:15:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.202+0000 7f63e8da2640 1 -- 172.21.15.66:0/663526945 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e002ab10 con 0x7f63e4162750 2024-05-10T11:15:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.202+0000 7f63e8da2640 1 -- 172.21.15.66:0/663526945 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4001670 con 0x7f63e4162750 2024-05-10T11:15:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 -- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e4162750 msgr2=0x7f63e40d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 --2- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e4162750 0x7f63e40d0670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f63e00097a0 tx=0x7f63e002a080 comp rx=0 tx=0).stop 2024-05-10T11:15:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 -- 172.21.15.66:0/663526945 shutdown_connections 2024-05-10T11:15:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 --2- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162b30 0x7f63e40b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 --2- 172.21.15.66:0/663526945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e4162750 0x7f63e40d0670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 -- 172.21.15.66:0/663526945 >> 172.21.15.66:0/663526945 conn(0x7f63e409e3b0 msgr2=0x7f63e40d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 -- 172.21.15.66:0/663526945 shutdown_connections 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.203+0000 7f63ec008640 1 -- 172.21.15.66:0/663526945 wait complete. 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.204+0000 7f63ec008640 1 Processor -- start 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.204+0000 7f63ec008640 1 -- start start 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ec008640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162750 0x7f63e415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ec008640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 0x7f63e40a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ec008640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e40a1cb0 0x7f63e40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ec008640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40d0d30 con 0x7f63e4162b30 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ec008640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40d0bb0 con 0x7f63e40a1cb0 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ec008640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40d3d40 con 0x7f63e4162750 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 0x7f63e40a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 0x7f63e40a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42900/0 (socket says 172.21.15.66:42900) 2024-05-10T11:15:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 -- 172.21.15.66:0/3185441065 learned_addr learned my addr 172.21.15.66:0/3185441065 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e9da4640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162750 0x7f63e415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63ea5a5640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e40a1cb0 0x7f63e40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 -- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162750 msgr2=0x7f63e415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162750 0x7f63e415ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 -- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e40a1cb0 msgr2=0x7f63e40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e40a1cb0 0x7f63e40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.205+0000 7f63e95a3640 1 -- 172.21.15.66:0/3185441065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40a2250 con 0x7f63e4162b30 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.206+0000 7f63e95a3640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 0x7f63e40a1770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63d400c700 tx=0x7f63d400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.206+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4017070 con 0x7f63e4162b30 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.206+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d4005ad0 con 0x7f63e4162b30 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.206+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e40a2530 con 0x7f63e4162b30 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.206+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4007070 con 0x7f63e4162b30 2024-05-10T11:15:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.206+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e40a2af0 con 0x7f63e4162b30 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.207+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e406a220 con 0x7f63e4162b30 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.207+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63d401a070 con 0x7f63e4162b30 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.208+0000 7f63da7fc640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63c80762d0 0x7f63c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.208+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f63d4096aa0 con 0x7f63e4162b30 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.208+0000 7f63e9da4640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63c80762d0 0x7f63c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.209+0000 7f63e9da4640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63c80762d0 0x7f63c8078790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63e0034000 tx=0x7f63e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:03.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.212+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f63d405fcb0 con 0x7f63e4162b30 2024-05-10T11:15:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.477+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f63e40b2080 con 0x7f63e4162b30 2024-05-10T11:15:03.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.477+0000 7f63da7fc640 1 -- 172.21.15.66:0/3185441065 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1647 (secure 0 0 0) 0x7f63d40682f0 con 0x7f63e4162b30 2024-05-10T11:15:03.478 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:03.478 INFO:teuthology.orchestra.run.smithi066.stdout:{"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":176,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1715339538,"num_in_osds":8,"osd_in_since":1715339529,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"creating+peering","count":23}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":590584,"bytes_used":228372480,"bytes_avail":772865740800,"bytes_total":773094113280,"inactive_pgs_ratio":0.23711340129375458,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":34,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":5754}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-05-10T11:14:21.709677+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63c80762d0 msgr2=0x7f63c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63c80762d0 0x7f63c8078790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63e0034000 tx=0x7f63e002e000 comp rx=0 tx=0).stop 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 msgr2=0x7f63e40a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 0x7f63e40a1770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63d400c700 tx=0x7f63d400cbc0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 shutdown_connections 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63c80762d0 0x7f63c8078790 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63e40a1cb0 0x7f63e40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63e4162b30 0x7f63e40a1770 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 --2- 172.21.15.66:0/3185441065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63e4162750 0x7f63e415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 >> 172.21.15.66:0/3185441065 conn(0x7f63e409e3b0 msgr2=0x7f63e40b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:03.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 shutdown_connections 2024-05-10T11:15:03.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.479+0000 7f63ec008640 1 -- 172.21.15.66:0/3185441065 wait complete. 2024-05-10T11:15:03.490 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T11:15:03.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:15:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.594+0000 7f8d18683640 1 Processor -- start 2024-05-10T11:15:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.594+0000 7f8d18683640 1 -- start start 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d18683640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8d100cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d18683640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1015fc90 con 0x7f8d100b8860 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d18683640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d100b8c40 con 0x7f8d100cfbb0 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d18683640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1006ec30 con 0x7f8d100d0230 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1641f640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8d100b8860 0x7f8d1006e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49390/0 (socket says 172.21.15.66:49390) 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1641f640 1 -- 172.21.15.66:0/1569341547 learned_addr learned my addr 172.21.15.66:0/1569341547 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d15c1e640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8d100cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837846793 0 0) 0x7f8d1015fc90 con 0x7f8d100b8860 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cfc003520 con 0x7f8d100b8860 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4256498182 0 0) 0x7f8cfc003520 con 0x7f8d100b8860 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 msgr2=0x7f8d100cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1541d640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8d100cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.595+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 >> v1:172.21.15.190:6789/0 conn(0x7f8d100cfbb0 legacy=0x7f8d100ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d100cd570 con 0x7f8d100b8860 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f8d0c001670 con 0x7f8d100b8860 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 >> v1:172.21.15.66:6789/0 conn(0x7f8d100b8860 legacy=0x7f8d1006e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cfc0039e0 0x7f8cfc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cfc004800 0x7f8cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8cfc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1006ec30 con 0x7f8cfc0039e0 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc00baf0 con 0x7f8cfc004800 2024-05-10T11:15:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc00bcf0 con 0x7f8d100d0230 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1641f640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cfc0039e0 0x7f8cfc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d15c1e640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cfc004800 0x7f8cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d16c20640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8cfc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1641f640 1 -- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 msgr2=0x7f8cfc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1641f640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8cfc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1641f640 1 -- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cfc004800 msgr2=0x7f8cfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1641f640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cfc004800 0x7f8cfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d1641f640 1 -- 172.21.15.66:0/1569341547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc003520 con 0x7f8cfc0039e0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.596+0000 7f8d16c20640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d100d0230 0x7f8cfc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d1641f640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cfc0039e0 0x7f8cfc003e00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c210 tx=0x7f8cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af3fff9c68559fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c007d30 con 0x7f8cfc0039e0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c005ad0 con 0x7f8cfc0039e0 2024-05-10T11:15:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d1541d640 1 -- 172.21.15.66:0/1569341547 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c007070 con 0x7f8cfc0039e0 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d18683640 1 -- 172.21.15.66:0/1569341547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cfc0039e0 msgr2=0x7f8cfc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d18683640 1 --2- 172.21.15.66:0/1569341547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cfc0039e0 0x7f8cfc003e00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c210 tx=0x7f8cfc005830 comp rx=0 tx=0).stop 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.597+0000 7f8d16c20640 1 -- 172.21.15.66:0/1569341547 reap_dead start 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.598+0000 7f8d18683640 1 -- 172.21.15.66:0/1569341547 shutdown_connections 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.598+0000 7f8d18683640 1 -- 172.21.15.66:0/1569341547 >> 172.21.15.66:0/1569341547 conn(0x7f8d100d2df0 msgr2=0x7f8d100d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.598+0000 7f8d18683640 1 -- 172.21.15.66:0/1569341547 shutdown_connections 2024-05-10T11:15:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.598+0000 7f8d18683640 1 -- 172.21.15.66:0/1569341547 wait complete. 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.599+0000 7f8d18683640 1 Processor -- start 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.599+0000 7f8d18683640 1 -- start start 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.599+0000 7f8d18683640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cfc0039e0 0x7f8d100ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.599+0000 7f8d18683640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 0x7f8d101f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d18683640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d101f8fd0 0x7f8d100cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d18683640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100cdb30 con 0x7f8d1014a720 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d18683640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1006ee50 con 0x7f8d101f8fd0 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d18683640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8d100cde10 con 0x7f8cfc0039e0 2024-05-10T11:15:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 0x7f8d101f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 0x7f8d101f8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42908/0 (socket says 172.21.15.66:42908) 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 -- 172.21.15.66:0/3912627723 learned_addr learned my addr 172.21.15.66:0/3912627723 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d1641f640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cfc0039e0 0x7f8d100ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d16c20640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d101f8fd0 0x7f8d100cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 -- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cfc0039e0 msgr2=0x7f8d100ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cfc0039e0 0x7f8d100ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 -- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d101f8fd0 msgr2=0x7f8d100cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d101f8fd0 0x7f8d100cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 -- 172.21.15.66:0/3912627723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d100ccd80 con 0x7f8d1014a720 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d16c20640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d101f8fd0 0x7f8d100cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d1641f640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cfc0039e0 0x7f8d100ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d15c1e640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 0x7f8d101f8a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8d000119a0 tx=0x7f8d00011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000faf0 con 0x7f8d1014a720 2024-05-10T11:15:03.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0000fc90 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d100cd060 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00014440 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.600+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d10161060 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.601+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1006a220 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.602+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d00012040 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.602+0000 7f8d06ffd640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8cf4076300 0x7f8cf40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.602+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8d00097ca0 con 0x7f8d1014a720 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.603+0000 7f8d1641f640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8cf4076300 0x7f8cf40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.603+0000 7f8d1641f640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8cf4076300 0x7f8cf40787c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c033000 tx=0x7f8d0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.607+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8d00019030 con 0x7f8d1014a720 2024-05-10T11:15:03.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.794+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d10070440 con 0x7f8cf4076300 2024-05-10T11:15:03.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.800+0000 7f8d06ffd640 1 -- 172.21.15.66:0/3912627723 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251982 (secure 0 0 0) 0x7f8d10070440 con 0x7f8cf4076300 2024-05-10T11:15:03.803 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:03.804 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8cf4076300 msgr2=0x7f8cf40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8cf4076300 0x7f8cf40787c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c033000 tx=0x7f8d0c02e000 comp rx=0 tx=0).stop 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 msgr2=0x7f8d101f8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 0x7f8d101f8a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8d000119a0 tx=0x7f8d00011e60 comp rx=0 tx=0).stop 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 shutdown_connections 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8cf4076300 0x7f8cf40787c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d101f8fd0 0x7f8d100cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1014a720 0x7f8d101f8a90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 --2- 172.21.15.66:0/3912627723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cfc0039e0 0x7f8d100ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 >> 172.21.15.66:0/3912627723 conn(0x7f8d100d2df0 msgr2=0x7f8d100ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 shutdown_connections 2024-05-10T11:15:03.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:03.803+0000 7f8d18683640 1 -- 172.21.15.66:0/3912627723 wait complete. 2024-05-10T11:15:03.814 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-05-10T11:15:03.720447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223184,"kb_used_data":6980,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751536,"statfs":{"total":773094113280,"available":772865572864,"internally_reserved":0,"allocated":7147520,"data_stored":3817984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.454293"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412195+0000","last_change":"2024-05-10T11:14:58.299340+0000","last_active":"2024-05-10T11:14:59.412195+0000","last_peered":"2024-05-10T11:14:59.412195+0000","last_clean":"2024-05-10T11:14:59.412195+0000","last_became_active":"2024-05-10T11:14:58.298806+0000","last_became_peered":"2024-05-10T11:14:58.298806+0000","last_unstale":"2024-05-10T11:14:59.412195+0000","last_undegraded":"2024-05-10T11:14:59.412195+0000","last_fullsized":"2024-05-10T11:14:59.412195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:10.667637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411809+0000","last_change":"2024-05-10T11:14:58.293599+0000","last_active":"2024-05-10T11:14:59.411809+0000","last_peered":"2024-05-10T11:14:59.411809+0000","last_clean":"2024-05-10T11:14:59.411809+0000","last_became_active":"2024-05-10T11:14:58.293236+0000","last_became_peered":"2024-05-10T11:14:58.293236+0000","last_unstale":"2024-05-10T11:14:59.411809+0000","last_undegraded":"2024-05-10T11:14:59.411809+0000","last_fullsized":"2024-05-10T11:14:59.411809+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:40.766419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304210+0000","last_change":"2024-05-10T11:14:58.297410+0000","last_active":"2024-05-10T11:14:58.304210+0000","last_peered":"2024-05-10T11:14:58.304210+0000","last_clean":"2024-05-10T11:14:58.304210+0000","last_became_active":"2024-05-10T11:14:58.297147+0000","last_became_peered":"2024-05-10T11:14:58.297147+0000","last_unstale":"2024-05-10T11:14:58.304210+0000","last_undegraded":"2024-05-10T11:14:58.304210+0000","last_fullsized":"2024-05-10T11:14:58.304210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:13.060645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306506+0000","last_change":"2024-05-10T11:14:58.294909+0000","last_active":"2024-05-10T11:14:58.306506+0000","last_peered":"2024-05-10T11:14:58.306506+0000","last_clean":"2024-05-10T11:14:58.306506+0000","last_became_active":"2024-05-10T11:14:58.294219+0000","last_became_peered":"2024-05-10T11:14:58.294219+0000","last_unstale":"2024-05-10T11:14:58.306506+0000","last_undegraded":"2024-05-10T11:14:58.306506+0000","last_fullsized":"2024-05-10T11:14:58.306506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305830+0000","last_change":"2024-05-10T11:14:58.302152+0000","last_active":"2024-05-10T11:14:58.305830+0000","last_peered":"2024-05-10T11:14:58.305830+0000","last_clean":"2024-05-10T11:14:58.305830+0000","last_became_active":"2024-05-10T11:14:58.301618+0000","last_became_peered":"2024-05-10T11:14:58.301618+0000","last_unstale":"2024-05-10T11:14:58.305830+0000","last_undegraded":"2024-05-10T11:14:58.305830+0000","last_fullsized":"2024-05-10T11:14:58.305830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:22.704456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412481+0000","last_change":"2024-05-10T11:14:58.299499+0000","last_active":"2024-05-10T11:14:59.412481+0000","last_peered":"2024-05-10T11:14:59.412481+0000","last_clean":"2024-05-10T11:14:59.412481+0000","last_became_active":"2024-05-10T11:14:58.299133+0000","last_became_peered":"2024-05-10T11:14:58.299133+0000","last_unstale":"2024-05-10T11:14:59.412481+0000","last_undegraded":"2024-05-10T11:14:59.412481+0000","last_fullsized":"2024-05-10T11:14:59.412481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:02:09.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299325+0000","last_change":"2024-05-10T11:14:58.304622+0000","last_active":"2024-05-10T11:14:59.299325+0000","last_peered":"2024-05-10T11:14:59.299325+0000","last_clean":"2024-05-10T11:14:59.299325+0000","last_became_active":"2024-05-10T11:14:58.304303+0000","last_became_peered":"2024-05-10T11:14:58.304303+0000","last_unstale":"2024-05-10T11:14:59.299325+0000","last_undegraded":"2024-05-10T11:14:59.299325+0000","last_fullsized":"2024-05-10T11:14:59.299325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:33.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293457+0000","last_change":"2024-05-10T11:14:58.305552+0000","last_active":"2024-05-10T11:14:59.293457+0000","last_peered":"2024-05-10T11:14:59.293457+0000","last_clean":"2024-05-10T11:14:59.293457+0000","last_became_active":"2024-05-10T11:14:58.305299+0000","last_became_peered":"2024-05-10T11:14:58.305299+0000","last_unstale":"2024-05-10T11:14:59.293457+0000","last_undegraded":"2024-05-10T11:14:59.293457+0000","last_fullsized":"2024-05-10T11:14:59.293457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:38.945852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309803+0000","last_change":"2024-05-10T11:14:58.307371+0000","last_active":"2024-05-10T11:14:58.309803+0000","last_peered":"2024-05-10T11:14:58.309803+0000","last_clean":"2024-05-10T11:14:58.309803+0000","last_became_active":"2024-05-10T11:14:58.307064+0000","last_became_peered":"2024-05-10T11:14:58.307064+0000","last_unstale":"2024-05-10T11:14:58.309803+0000","last_undegraded":"2024-05-10T11:14:58.309803+0000","last_fullsized":"2024-05-10T11:14:58.309803+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:41.509127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304218+0000","last_change":"2024-05-10T11:14:58.299020+0000","last_active":"2024-05-10T11:14:58.304218+0000","last_peered":"2024-05-10T11:14:58.304218+0000","last_clean":"2024-05-10T11:14:58.304218+0000","last_became_active":"2024-05-10T11:14:58.298147+0000","last_became_peered":"2024-05-10T11:14:58.298147+0000","last_unstale":"2024-05-10T11:14:58.304218+0000","last_undegraded":"2024-05-10T11:14:58.304218+0000","last_fullsized":"2024-05-10T11:14:58.304218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:55.573266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306767+0000","last_change":"2024-05-10T11:14:58.292521+0000","last_active":"2024-05-10T11:14:58.306767+0000","last_peered":"2024-05-10T11:14:58.306767+0000","last_clean":"2024-05-10T11:14:58.306767+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.306767+0000","last_undegraded":"2024-05-10T11:14:58.306767+0000","last_fullsized":"2024-05-10T11:14:58.306767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293615+0000","last_change":"2024-05-10T11:14:58.303388+0000","last_active":"2024-05-10T11:14:59.293615+0000","last_peered":"2024-05-10T11:14:59.293615+0000","last_clean":"2024-05-10T11:14:59.293615+0000","last_became_active":"2024-05-10T11:14:58.303093+0000","last_became_peered":"2024-05-10T11:14:58.303093+0000","last_unstale":"2024-05-10T11:14:59.293615+0000","last_undegraded":"2024-05-10T11:14:59.293615+0000","last_fullsized":"2024-05-10T11:14:59.293615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:27.443250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293798+0000","last_change":"2024-05-10T11:14:58.300330+0000","last_active":"2024-05-10T11:14:59.293798+0000","last_peered":"2024-05-10T11:14:59.293798+0000","last_clean":"2024-05-10T11:14:59.293798+0000","last_became_active":"2024-05-10T11:14:58.300074+0000","last_became_peered":"2024-05-10T11:14:58.300074+0000","last_unstale":"2024-05-10T11:14:59.293798+0000","last_undegraded":"2024-05-10T11:14:59.293798+0000","last_fullsized":"2024-05-10T11:14:59.293798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304170+0000","last_change":"2024-05-10T11:14:58.296851+0000","last_active":"2024-05-10T11:14:58.304170+0000","last_peered":"2024-05-10T11:14:58.304170+0000","last_clean":"2024-05-10T11:14:58.304170+0000","last_became_active":"2024-05-10T11:14:58.296494+0000","last_became_peered":"2024-05-10T11:14:58.296494+0000","last_unstale":"2024-05-10T11:14:58.304170+0000","last_undegraded":"2024-05-10T11:14:58.304170+0000","last_fullsized":"2024-05-10T11:14:58.304170+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:54.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307806+0000","last_change":"2024-05-10T11:14:58.303310+0000","last_active":"2024-05-10T11:14:58.307806+0000","last_peered":"2024-05-10T11:14:58.307806+0000","last_clean":"2024-05-10T11:14:58.307806+0000","last_became_active":"2024-05-10T11:14:58.303026+0000","last_became_peered":"2024-05-10T11:14:58.303026+0000","last_unstale":"2024-05-10T11:14:58.307806+0000","last_undegraded":"2024-05-10T11:14:58.307806+0000","last_fullsized":"2024-05-10T11:14:58.307806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:31:04.702811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299304+0000","last_change":"2024-05-10T11:14:58.295774+0000","last_active":"2024-05-10T11:14:59.299304+0000","last_peered":"2024-05-10T11:14:59.299304+0000","last_clean":"2024-05-10T11:14:59.299304+0000","last_became_active":"2024-05-10T11:14:58.295468+0000","last_became_peered":"2024-05-10T11:14:58.295468+0000","last_unstale":"2024-05-10T11:14:59.299304+0000","last_undegraded":"2024-05-10T11:14:59.299304+0000","last_fullsized":"2024-05-10T11:14:59.299304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:27.753374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411891+0000","last_change":"2024-05-10T11:14:58.301222+0000","last_active":"2024-05-10T11:14:59.411891+0000","last_peered":"2024-05-10T11:14:59.411891+0000","last_clean":"2024-05-10T11:14:59.411891+0000","last_became_active":"2024-05-10T11:14:58.300928+0000","last_became_peered":"2024-05-10T11:14:58.300928+0000","last_unstale":"2024-05-10T11:14:59.411891+0000","last_undegraded":"2024-05-10T11:14:59.411891+0000","last_fullsized":"2024-05-10T11:14:59.411891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:18.189218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306599+0000","last_change":"2024-05-10T11:14:58.294765+0000","last_active":"2024-05-10T11:14:58.306599+0000","last_peered":"2024-05-10T11:14:58.306599+0000","last_clean":"2024-05-10T11:14:58.306599+0000","last_became_active":"2024-05-10T11:14:58.294194+0000","last_became_peered":"2024-05-10T11:14:58.294194+0000","last_unstale":"2024-05-10T11:14:58.306599+0000","last_undegraded":"2024-05-10T11:14:58.306599+0000","last_fullsized":"2024-05-10T11:14:58.306599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300735+0000","last_change":"2024-05-10T11:14:58.291296+0000","last_active":"2024-05-10T11:14:58.300735+0000","last_peered":"2024-05-10T11:14:58.300735+0000","last_clean":"2024-05-10T11:14:58.300735+0000","last_became_active":"2024-05-10T11:14:58.291032+0000","last_became_peered":"2024-05-10T11:14:58.291032+0000","last_unstale":"2024-05-10T11:14:58.300735+0000","last_undegraded":"2024-05-10T11:14:58.300735+0000","last_fullsized":"2024-05-10T11:14:58.300735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288145+0000","last_change":"2024-05-10T11:14:58.289734+0000","last_active":"2024-05-10T11:14:59.288145+0000","last_peered":"2024-05-10T11:14:59.288145+0000","last_clean":"2024-05-10T11:14:59.288145+0000","last_became_active":"2024-05-10T11:14:58.289197+0000","last_became_peered":"2024-05-10T11:14:58.289197+0000","last_unstale":"2024-05-10T11:14:59.288145+0000","last_undegraded":"2024-05-10T11:14:59.288145+0000","last_fullsized":"2024-05-10T11:14:59.288145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:00.327758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293720+0000","last_change":"2024-05-10T11:14:58.292301+0000","last_active":"2024-05-10T11:14:59.293720+0000","last_peered":"2024-05-10T11:14:59.293720+0000","last_clean":"2024-05-10T11:14:59.293720+0000","last_became_active":"2024-05-10T11:14:58.292011+0000","last_became_peered":"2024-05-10T11:14:58.292011+0000","last_unstale":"2024-05-10T11:14:59.293720+0000","last_undegraded":"2024-05-10T11:14:59.293720+0000","last_fullsized":"2024-05-10T11:14:59.293720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:27.519315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287996+0000","last_change":"2024-05-10T11:14:58.297912+0000","last_active":"2024-05-10T11:14:59.287996+0000","last_peered":"2024-05-10T11:14:59.287996+0000","last_clean":"2024-05-10T11:14:59.287996+0000","last_became_active":"2024-05-10T11:14:58.297518+0000","last_became_peered":"2024-05-10T11:14:58.297518+0000","last_unstale":"2024-05-10T11:14:59.287996+0000","last_undegraded":"2024-05-10T11:14:59.287996+0000","last_fullsized":"2024-05-10T11:14:59.287996+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:02:09.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287937+0000","last_change":"2024-05-10T11:14:58.305600+0000","last_active":"2024-05-10T11:14:59.287937+0000","last_peered":"2024-05-10T11:14:59.287937+0000","last_clean":"2024-05-10T11:14:59.287937+0000","last_became_active":"2024-05-10T11:14:58.305231+0000","last_became_peered":"2024-05-10T11:14:58.305231+0000","last_unstale":"2024-05-10T11:14:59.287937+0000","last_undegraded":"2024-05-10T11:14:59.287937+0000","last_fullsized":"2024-05-10T11:14:59.287937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:18.792791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304156+0000","last_change":"2024-05-10T11:14:58.296984+0000","last_active":"2024-05-10T11:14:58.304156+0000","last_peered":"2024-05-10T11:14:58.304156+0000","last_clean":"2024-05-10T11:14:58.304156+0000","last_became_active":"2024-05-10T11:14:58.296624+0000","last_became_peered":"2024-05-10T11:14:58.296624+0000","last_unstale":"2024-05-10T11:14:58.304156+0000","last_undegraded":"2024-05-10T11:14:58.304156+0000","last_fullsized":"2024-05-10T11:14:58.304156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:10.187464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293927+0000","last_change":"2024-05-10T11:14:58.294450+0000","last_active":"2024-05-10T11:14:59.293927+0000","last_peered":"2024-05-10T11:14:59.293927+0000","last_clean":"2024-05-10T11:14:59.293927+0000","last_became_active":"2024-05-10T11:14:58.294145+0000","last_became_peered":"2024-05-10T11:14:58.294145+0000","last_unstale":"2024-05-10T11:14:59.293927+0000","last_undegraded":"2024-05-10T11:14:59.293927+0000","last_fullsized":"2024-05-10T11:14:59.293927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293796+0000","last_change":"2024-05-10T11:14:58.295269+0000","last_active":"2024-05-10T11:14:59.293796+0000","last_peered":"2024-05-10T11:14:59.293796+0000","last_clean":"2024-05-10T11:14:59.293796+0000","last_became_active":"2024-05-10T11:14:58.294820+0000","last_became_peered":"2024-05-10T11:14:58.294820+0000","last_unstale":"2024-05-10T11:14:59.293796+0000","last_undegraded":"2024-05-10T11:14:59.293796+0000","last_fullsized":"2024-05-10T11:14:59.293796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:37.670772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306749+0000","last_change":"2024-05-10T11:14:58.292277+0000","last_active":"2024-05-10T11:14:58.306749+0000","last_peered":"2024-05-10T11:14:58.306749+0000","last_clean":"2024-05-10T11:14:58.306749+0000","last_became_active":"2024-05-10T11:14:58.291531+0000","last_became_peered":"2024-05-10T11:14:58.291531+0000","last_unstale":"2024-05-10T11:14:58.306749+0000","last_undegraded":"2024-05-10T11:14:58.306749+0000","last_fullsized":"2024-05-10T11:14:58.306749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:14.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411680+0000","last_change":"2024-05-10T11:14:58.292535+0000","last_active":"2024-05-10T11:14:59.411680+0000","last_peered":"2024-05-10T11:14:59.411680+0000","last_clean":"2024-05-10T11:14:59.411680+0000","last_became_active":"2024-05-10T11:14:58.292081+0000","last_became_peered":"2024-05-10T11:14:58.292081+0000","last_unstale":"2024-05-10T11:14:59.411680+0000","last_undegraded":"2024-05-10T11:14:59.411680+0000","last_fullsized":"2024-05-10T11:14:59.411680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:14.797119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.312652+0000","last_change":"2024-05-10T11:14:58.309493+0000","last_active":"2024-05-10T11:14:58.312652+0000","last_peered":"2024-05-10T11:14:58.312652+0000","last_clean":"2024-05-10T11:14:58.312652+0000","last_became_active":"2024-05-10T11:14:58.308480+0000","last_became_peered":"2024-05-10T11:14:58.308480+0000","last_unstale":"2024-05-10T11:14:58.312652+0000","last_undegraded":"2024-05-10T11:14:58.312652+0000","last_fullsized":"2024-05-10T11:14:58.312652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:00:22.050849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293420+0000","last_change":"2024-05-10T11:14:58.304102+0000","last_active":"2024-05-10T11:14:59.293420+0000","last_peered":"2024-05-10T11:14:59.293420+0000","last_clean":"2024-05-10T11:14:59.293420+0000","last_became_active":"2024-05-10T11:14:58.303832+0000","last_became_peered":"2024-05-10T11:14:58.303832+0000","last_unstale":"2024-05-10T11:14:59.293420+0000","last_undegraded":"2024-05-10T11:14:59.293420+0000","last_fullsized":"2024-05-10T11:14:59.293420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:24.954543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306675+0000","last_change":"2024-05-10T11:14:58.290600+0000","last_active":"2024-05-10T11:14:58.306675+0000","last_peered":"2024-05-10T11:14:58.306675+0000","last_clean":"2024-05-10T11:14:58.306675+0000","last_became_active":"2024-05-10T11:14:58.290320+0000","last_became_peered":"2024-05-10T11:14:58.290320+0000","last_unstale":"2024-05-10T11:14:58.306675+0000","last_undegraded":"2024-05-10T11:14:58.306675+0000","last_fullsized":"2024-05-10T11:14:58.306675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:01.249122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411554+0000","last_change":"2024-05-10T11:14:58.288413+0000","last_active":"2024-05-10T11:14:59.411554+0000","last_peered":"2024-05-10T11:14:59.411554+0000","last_clean":"2024-05-10T11:14:59.411554+0000","last_became_active":"2024-05-10T11:14:58.288120+0000","last_became_peered":"2024-05-10T11:14:58.288120+0000","last_unstale":"2024-05-10T11:14:59.411554+0000","last_undegraded":"2024-05-10T11:14:59.411554+0000","last_fullsized":"2024-05-10T11:14:59.411554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299993+0000","last_change":"2024-05-10T11:14:58.293177+0000","last_active":"2024-05-10T11:14:58.299993+0000","last_peered":"2024-05-10T11:14:58.299993+0000","last_clean":"2024-05-10T11:14:58.299993+0000","last_became_active":"2024-05-10T11:14:58.292884+0000","last_became_peered":"2024-05-10T11:14:58.292884+0000","last_unstale":"2024-05-10T11:14:58.299993+0000","last_undegraded":"2024-05-10T11:14:58.299993+0000","last_fullsized":"2024-05-10T11:14:58.299993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:54.031470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411988+0000","last_change":"2024-05-10T11:14:57.284107+0000","last_active":"2024-05-10T11:14:59.411988+0000","last_peered":"2024-05-10T11:14:59.411988+0000","last_clean":"2024-05-10T11:14:59.411988+0000","last_became_active":"2024-05-10T11:14:57.283807+0000","last_became_peered":"2024-05-10T11:14:57.283807+0000","last_unstale":"2024-05-10T11:14:59.411988+0000","last_undegraded":"2024-05-10T11:14:59.411988+0000","last_fullsized":"2024-05-10T11:14:59.411988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:01.976954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306728+0000","last_change":"2024-05-10T11:14:58.291184+0000","last_active":"2024-05-10T11:14:58.306728+0000","last_peered":"2024-05-10T11:14:58.306728+0000","last_clean":"2024-05-10T11:14:58.306728+0000","last_became_active":"2024-05-10T11:14:58.290918+0000","last_became_peered":"2024-05-10T11:14:58.290918+0000","last_unstale":"2024-05-10T11:14:58.306728+0000","last_undegraded":"2024-05-10T11:14:58.306728+0000","last_fullsized":"2024-05-10T11:14:58.306728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412147+0000","last_change":"2024-05-10T11:14:57.278080+0000","last_active":"2024-05-10T11:14:59.412147+0000","last_peered":"2024-05-10T11:14:59.412147+0000","last_clean":"2024-05-10T11:14:59.412147+0000","last_became_active":"2024-05-10T11:14:57.277750+0000","last_became_peered":"2024-05-10T11:14:57.277750+0000","last_unstale":"2024-05-10T11:14:59.412147+0000","last_undegraded":"2024-05-10T11:14:59.412147+0000","last_fullsized":"2024-05-10T11:14:59.412147+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:51.210308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412107+0000","last_change":"2024-05-10T11:14:58.290201+0000","last_active":"2024-05-10T11:14:59.412107+0000","last_peered":"2024-05-10T11:14:59.412107+0000","last_clean":"2024-05-10T11:14:59.412107+0000","last_became_active":"2024-05-10T11:14:58.289926+0000","last_became_peered":"2024-05-10T11:14:58.289926+0000","last_unstale":"2024-05-10T11:14:59.412107+0000","last_undegraded":"2024-05-10T11:14:59.412107+0000","last_fullsized":"2024-05-10T11:14:59.412107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412174+0000","last_change":"2024-05-10T11:14:57.278386+0000","last_active":"2024-05-10T11:14:59.412174+0000","last_peered":"2024-05-10T11:14:59.412174+0000","last_clean":"2024-05-10T11:14:59.412174+0000","last_became_active":"2024-05-10T11:14:57.278063+0000","last_became_peered":"2024-05-10T11:14:57.278063+0000","last_unstale":"2024-05-10T11:14:59.412174+0000","last_undegraded":"2024-05-10T11:14:59.412174+0000","last_fullsized":"2024-05-10T11:14:59.412174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.826064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.304139+0000","last_change":"2024-05-10T11:14:58.296717+0000","last_active":"2024-05-10T11:14:58.304139+0000","last_peered":"2024-05-10T11:14:58.304139+0000","last_clean":"2024-05-10T11:14:58.304139+0000","last_became_active":"2024-05-10T11:14:58.296326+0000","last_became_peered":"2024-05-10T11:14:58.296326+0000","last_unstale":"2024-05-10T11:14:58.304139+0000","last_undegraded":"2024-05-10T11:14:58.304139+0000","last_fullsized":"2024-05-10T11:14:58.304139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:00.644583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412194+0000","last_change":"2024-05-10T11:14:57.284933+0000","last_active":"2024-05-10T11:14:59.412194+0000","last_peered":"2024-05-10T11:14:59.412194+0000","last_clean":"2024-05-10T11:14:59.412194+0000","last_became_active":"2024-05-10T11:14:57.284634+0000","last_became_peered":"2024-05-10T11:14:57.284634+0000","last_unstale":"2024-05-10T11:14:59.412194+0000","last_undegraded":"2024-05-10T11:14:59.412194+0000","last_fullsized":"2024-05-10T11:14:59.412194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:24:13.908401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299497+0000","last_change":"2024-05-10T11:14:58.290166+0000","last_active":"2024-05-10T11:14:59.299497+0000","last_peered":"2024-05-10T11:14:59.299497+0000","last_clean":"2024-05-10T11:14:59.299497+0000","last_became_active":"2024-05-10T11:14:58.289670+0000","last_became_peered":"2024-05-10T11:14:58.289670+0000","last_unstale":"2024-05-10T11:14:59.299497+0000","last_undegraded":"2024-05-10T11:14:59.299497+0000","last_fullsized":"2024-05-10T11:14:59.299497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:21.026213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288231+0000","last_change":"2024-05-10T11:14:57.282928+0000","last_active":"2024-05-10T11:14:59.288231+0000","last_peered":"2024-05-10T11:14:59.288231+0000","last_clean":"2024-05-10T11:14:59.288231+0000","last_became_active":"2024-05-10T11:14:57.282648+0000","last_became_peered":"2024-05-10T11:14:57.282648+0000","last_unstale":"2024-05-10T11:14:59.288231+0000","last_undegraded":"2024-05-10T11:14:59.288231+0000","last_fullsized":"2024-05-10T11:14:59.288231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:37.941170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411486+0000","last_change":"2024-05-10T11:14:58.297126+0000","last_active":"2024-05-10T11:14:59.411486+0000","last_peered":"2024-05-10T11:14:59.411486+0000","last_clean":"2024-05-10T11:14:59.411486+0000","last_became_active":"2024-05-10T11:14:58.296806+0000","last_became_peered":"2024-05-10T11:14:58.296806+0000","last_unstale":"2024-05-10T11:14:59.411486+0000","last_undegraded":"2024-05-10T11:14:59.411486+0000","last_fullsized":"2024-05-10T11:14:59.411486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:55.143332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287922+0000","last_change":"2024-05-10T11:14:57.281848+0000","last_active":"2024-05-10T11:14:59.287922+0000","last_peered":"2024-05-10T11:14:59.287922+0000","last_clean":"2024-05-10T11:14:59.287922+0000","last_became_active":"2024-05-10T11:14:57.281514+0000","last_became_peered":"2024-05-10T11:14:57.281514+0000","last_unstale":"2024-05-10T11:14:59.287922+0000","last_undegraded":"2024-05-10T11:14:59.287922+0000","last_fullsized":"2024-05-10T11:14:59.287922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:24:13.908401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.303741+0000","last_change":"2024-05-10T11:14:58.301360+0000","last_active":"2024-05-10T11:14:58.303741+0000","last_peered":"2024-05-10T11:14:58.303741+0000","last_clean":"2024-05-10T11:14:58.303741+0000","last_became_active":"2024-05-10T11:14:58.301013+0000","last_became_peered":"2024-05-10T11:14:58.301013+0000","last_unstale":"2024-05-10T11:14:58.303741+0000","last_undegraded":"2024-05-10T11:14:58.303741+0000","last_fullsized":"2024-05-10T11:14:58.303741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287935+0000","last_change":"2024-05-10T11:14:57.284239+0000","last_active":"2024-05-10T11:14:59.287935+0000","last_peered":"2024-05-10T11:14:59.287935+0000","last_clean":"2024-05-10T11:14:59.287935+0000","last_became_active":"2024-05-10T11:14:57.283872+0000","last_became_peered":"2024-05-10T11:14:57.283872+0000","last_unstale":"2024-05-10T11:14:59.287935+0000","last_undegraded":"2024-05-10T11:14:59.287935+0000","last_fullsized":"2024-05-10T11:14:59.287935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:23.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288181+0000","last_change":"2024-05-10T11:14:58.293106+0000","last_active":"2024-05-10T11:14:59.288181+0000","last_peered":"2024-05-10T11:14:59.288181+0000","last_clean":"2024-05-10T11:14:59.288181+0000","last_became_active":"2024-05-10T11:14:58.292708+0000","last_became_peered":"2024-05-10T11:14:58.292708+0000","last_unstale":"2024-05-10T11:14:59.288181+0000","last_undegraded":"2024-05-10T11:14:59.288181+0000","last_fullsized":"2024-05-10T11:14:59.288181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:21:32.657479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.284885+0000","last_change":"2024-05-10T11:14:57.283820+0000","last_active":"2024-05-10T11:14:58.284885+0000","last_peered":"2024-05-10T11:14:58.284885+0000","last_clean":"2024-05-10T11:14:58.284885+0000","last_became_active":"2024-05-10T11:14:57.283489+0000","last_became_peered":"2024-05-10T11:14:57.283489+0000","last_unstale":"2024-05-10T11:14:58.284885+0000","last_undegraded":"2024-05-10T11:14:58.284885+0000","last_fullsized":"2024-05-10T11:14:58.284885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.244441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411846+0000","last_change":"2024-05-10T11:14:58.288434+0000","last_active":"2024-05-10T11:14:59.411846+0000","last_peered":"2024-05-10T11:14:59.411846+0000","last_clean":"2024-05-10T11:14:59.411846+0000","last_became_active":"2024-05-10T11:14:58.288154+0000","last_became_peered":"2024-05-10T11:14:58.288154+0000","last_unstale":"2024-05-10T11:14:59.411846+0000","last_undegraded":"2024-05-10T11:14:59.411846+0000","last_fullsized":"2024-05-10T11:14:59.411846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:27:24.962755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.286683+0000","last_change":"2024-05-10T11:14:57.285058+0000","last_active":"2024-05-10T11:14:58.286683+0000","last_peered":"2024-05-10T11:14:58.286683+0000","last_clean":"2024-05-10T11:14:58.286683+0000","last_became_active":"2024-05-10T11:14:57.284745+0000","last_became_peered":"2024-05-10T11:14:57.284745+0000","last_unstale":"2024-05-10T11:14:58.286683+0000","last_undegraded":"2024-05-10T11:14:58.286683+0000","last_fullsized":"2024-05-10T11:14:58.286683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:26.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288196+0000","last_change":"2024-05-10T11:14:58.295803+0000","last_active":"2024-05-10T11:14:59.288196+0000","last_peered":"2024-05-10T11:14:59.288196+0000","last_clean":"2024-05-10T11:14:59.288196+0000","last_became_active":"2024-05-10T11:14:58.295501+0000","last_became_peered":"2024-05-10T11:14:58.295501+0000","last_unstale":"2024-05-10T11:14:59.288196+0000","last_undegraded":"2024-05-10T11:14:59.288196+0000","last_fullsized":"2024-05-10T11:14:59.288196+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:44:18.165904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.282335+0000","last_change":"2024-05-10T11:14:57.285480+0000","last_active":"2024-05-10T11:14:58.282335+0000","last_peered":"2024-05-10T11:14:58.282335+0000","last_clean":"2024-05-10T11:14:58.282335+0000","last_became_active":"2024-05-10T11:14:57.284658+0000","last_became_peered":"2024-05-10T11:14:57.284658+0000","last_unstale":"2024-05-10T11:14:58.282335+0000","last_undegraded":"2024-05-10T11:14:58.282335+0000","last_fullsized":"2024-05-10T11:14:58.282335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:50.772681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300570+0000","last_change":"2024-05-10T11:14:58.293724+0000","last_active":"2024-05-10T11:14:58.300570+0000","last_peered":"2024-05-10T11:14:58.300570+0000","last_clean":"2024-05-10T11:14:58.300570+0000","last_became_active":"2024-05-10T11:14:58.293401+0000","last_became_peered":"2024-05-10T11:14:58.293401+0000","last_unstale":"2024-05-10T11:14:58.300570+0000","last_undegraded":"2024-05-10T11:14:58.300570+0000","last_fullsized":"2024-05-10T11:14:58.300570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309144+0000","last_change":"2024-05-10T11:14:57.285078+0000","last_active":"2024-05-10T11:14:58.309144+0000","last_peered":"2024-05-10T11:14:58.309144+0000","last_clean":"2024-05-10T11:14:58.309144+0000","last_became_active":"2024-05-10T11:14:57.284761+0000","last_became_peered":"2024-05-10T11:14:57.284761+0000","last_unstale":"2024-05-10T11:14:58.309144+0000","last_undegraded":"2024-05-10T11:14:58.309144+0000","last_fullsized":"2024-05-10T11:14:58.309144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:06:59.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306505+0000","last_change":"2024-05-10T11:14:58.293097+0000","last_active":"2024-05-10T11:14:58.306505+0000","last_peered":"2024-05-10T11:14:58.306505+0000","last_clean":"2024-05-10T11:14:58.306505+0000","last_became_active":"2024-05-10T11:14:58.292833+0000","last_became_peered":"2024-05-10T11:14:58.292833+0000","last_unstale":"2024-05-10T11:14:58.306505+0000","last_undegraded":"2024-05-10T11:14:58.306505+0000","last_fullsized":"2024-05-10T11:14:58.306505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411945+0000","last_change":"2024-05-10T11:14:57.283470+0000","last_active":"2024-05-10T11:14:59.411945+0000","last_peered":"2024-05-10T11:14:59.411945+0000","last_clean":"2024-05-10T11:14:59.411945+0000","last_became_active":"2024-05-10T11:14:57.283190+0000","last_became_peered":"2024-05-10T11:14:57.283190+0000","last_unstale":"2024-05-10T11:14:59.411945+0000","last_undegraded":"2024-05-10T11:14:59.411945+0000","last_fullsized":"2024-05-10T11:14:59.411945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:58.822085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308266+0000","last_change":"2024-05-10T11:14:58.302029+0000","last_active":"2024-05-10T11:14:58.308266+0000","last_peered":"2024-05-10T11:14:58.308266+0000","last_clean":"2024-05-10T11:14:58.308266+0000","last_became_active":"2024-05-10T11:14:58.301749+0000","last_became_peered":"2024-05-10T11:14:58.301749+0000","last_unstale":"2024-05-10T11:14:58.308266+0000","last_undegraded":"2024-05-10T11:14:58.308266+0000","last_fullsized":"2024-05-10T11:14:58.308266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:15.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.308805+0000","last_change":"2024-05-10T11:14:57.288628+0000","last_active":"2024-05-10T11:14:58.308805+0000","last_peered":"2024-05-10T11:14:58.308805+0000","last_clean":"2024-05-10T11:14:58.308805+0000","last_became_active":"2024-05-10T11:14:57.288267+0000","last_became_peered":"2024-05-10T11:14:57.288267+0000","last_unstale":"2024-05-10T11:14:58.308805+0000","last_undegraded":"2024-05-10T11:14:58.308805+0000","last_fullsized":"2024-05-10T11:14:58.308805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:52.106425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293396+0000","last_change":"2024-05-10T11:14:58.292318+0000","last_active":"2024-05-10T11:14:59.293396+0000","last_peered":"2024-05-10T11:14:59.293396+0000","last_clean":"2024-05-10T11:14:59.293396+0000","last_became_active":"2024-05-10T11:14:58.292027+0000","last_became_peered":"2024-05-10T11:14:58.292027+0000","last_unstale":"2024-05-10T11:14:59.293396+0000","last_undegraded":"2024-05-10T11:14:59.293396+0000","last_fullsized":"2024-05-10T11:14:59.293396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:52.214989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293493+0000","last_change":"2024-05-10T11:14:57.285459+0000","last_active":"2024-05-10T11:14:59.293493+0000","last_peered":"2024-05-10T11:14:59.293493+0000","last_clean":"2024-05-10T11:14:59.293493+0000","last_became_active":"2024-05-10T11:14:57.285146+0000","last_became_peered":"2024-05-10T11:14:57.285146+0000","last_unstale":"2024-05-10T11:14:59.293493+0000","last_undegraded":"2024-05-10T11:14:59.293493+0000","last_fullsized":"2024-05-10T11:14:59.293493+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:54.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299748+0000","last_change":"2024-05-10T11:14:58.290578+0000","last_active":"2024-05-10T11:14:58.299748+0000","last_peered":"2024-05-10T11:14:58.299748+0000","last_clean":"2024-05-10T11:14:58.299748+0000","last_became_active":"2024-05-10T11:14:58.290298+0000","last_became_peered":"2024-05-10T11:14:58.290298+0000","last_unstale":"2024-05-10T11:14:58.299748+0000","last_undegraded":"2024-05-10T11:14:58.299748+0000","last_fullsized":"2024-05-10T11:14:58.299748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:43.197856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.293943+0000","last_change":"2024-05-10T11:14:57.288627+0000","last_active":"2024-05-10T11:14:58.293943+0000","last_peered":"2024-05-10T11:14:58.293943+0000","last_clean":"2024-05-10T11:14:58.293943+0000","last_became_active":"2024-05-10T11:14:57.288307+0000","last_became_peered":"2024-05-10T11:14:57.288307+0000","last_unstale":"2024-05-10T11:14:58.293943+0000","last_undegraded":"2024-05-10T11:14:58.293943+0000","last_fullsized":"2024-05-10T11:14:58.293943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:36.022029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411686+0000","last_change":"2024-05-10T11:14:58.303641+0000","last_active":"2024-05-10T11:14:59.411686+0000","last_peered":"2024-05-10T11:14:59.411686+0000","last_clean":"2024-05-10T11:14:59.411686+0000","last_became_active":"2024-05-10T11:14:58.303277+0000","last_became_peered":"2024-05-10T11:14:58.303277+0000","last_unstale":"2024-05-10T11:14:59.411686+0000","last_undegraded":"2024-05-10T11:14:59.411686+0000","last_fullsized":"2024-05-10T11:14:59.411686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:27.403510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.313414+0000","last_change":"2024-05-10T11:14:57.278123+0000","last_active":"2024-05-10T11:14:58.313414+0000","last_peered":"2024-05-10T11:14:58.313414+0000","last_clean":"2024-05-10T11:14:58.313414+0000","last_became_active":"2024-05-10T11:14:57.277822+0000","last_became_peered":"2024-05-10T11:14:57.277822+0000","last_unstale":"2024-05-10T11:14:58.313414+0000","last_undegraded":"2024-05-10T11:14:58.313414+0000","last_fullsized":"2024-05-10T11:14:58.313414+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:57.287132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307694+0000","last_change":"2024-05-10T11:14:58.303477+0000","last_active":"2024-05-10T11:14:58.307694+0000","last_peered":"2024-05-10T11:14:58.307694+0000","last_clean":"2024-05-10T11:14:58.307694+0000","last_became_active":"2024-05-10T11:14:58.303122+0000","last_became_peered":"2024-05-10T11:14:58.303122+0000","last_unstale":"2024-05-10T11:14:58.307694+0000","last_undegraded":"2024-05-10T11:14:58.307694+0000","last_fullsized":"2024-05-10T11:14:58.307694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:17.047773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293870+0000","last_change":"2024-05-10T11:14:57.281686+0000","last_active":"2024-05-10T11:14:59.293870+0000","last_peered":"2024-05-10T11:14:59.293870+0000","last_clean":"2024-05-10T11:14:59.293870+0000","last_became_active":"2024-05-10T11:14:57.281376+0000","last_became_peered":"2024-05-10T11:14:57.281376+0000","last_unstale":"2024-05-10T11:14:59.293870+0000","last_undegraded":"2024-05-10T11:14:59.293870+0000","last_fullsized":"2024-05-10T11:14:59.293870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:26.398829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.305865+0000","last_change":"2024-05-10T11:14:58.301783+0000","last_active":"2024-05-10T11:14:58.305865+0000","last_peered":"2024-05-10T11:14:58.305865+0000","last_clean":"2024-05-10T11:14:58.305865+0000","last_became_active":"2024-05-10T11:14:58.301333+0000","last_became_peered":"2024-05-10T11:14:58.301333+0000","last_unstale":"2024-05-10T11:14:58.305865+0000","last_undegraded":"2024-05-10T11:14:58.305865+0000","last_fullsized":"2024-05-10T11:14:58.305865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:29.273264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309603+0000","last_change":"2024-05-10T11:14:57.291311+0000","last_active":"2024-05-10T11:14:58.309603+0000","last_peered":"2024-05-10T11:14:58.309603+0000","last_clean":"2024-05-10T11:14:58.309603+0000","last_became_active":"2024-05-10T11:14:57.291046+0000","last_became_peered":"2024-05-10T11:14:57.291046+0000","last_unstale":"2024-05-10T11:14:58.309603+0000","last_undegraded":"2024-05-10T11:14:58.309603+0000","last_fullsized":"2024-05-10T11:14:58.309603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:09.641351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.306454+0000","last_change":"2024-05-10T11:14:58.294613+0000","last_active":"2024-05-10T11:14:58.306454+0000","last_peered":"2024-05-10T11:14:58.306454+0000","last_clean":"2024-05-10T11:14:58.306454+0000","last_became_active":"2024-05-10T11:14:58.291580+0000","last_became_peered":"2024-05-10T11:14:58.291580+0000","last_unstale":"2024-05-10T11:14:58.306454+0000","last_undegraded":"2024-05-10T11:14:58.306454+0000","last_fullsized":"2024-05-10T11:14:58.306454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.307967+0000","last_change":"2024-05-10T11:14:57.286479+0000","last_active":"2024-05-10T11:14:58.307967+0000","last_peered":"2024-05-10T11:14:58.307967+0000","last_clean":"2024-05-10T11:14:58.307967+0000","last_became_active":"2024-05-10T11:14:57.286168+0000","last_became_peered":"2024-05-10T11:14:57.286168+0000","last_unstale":"2024-05-10T11:14:58.307967+0000","last_undegraded":"2024-05-10T11:14:58.307967+0000","last_fullsized":"2024-05-10T11:14:58.307967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:50.752141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299821+0000","last_change":"2024-05-10T11:14:58.291617+0000","last_active":"2024-05-10T11:14:58.299821+0000","last_peered":"2024-05-10T11:14:58.299821+0000","last_clean":"2024-05-10T11:14:58.299821+0000","last_became_active":"2024-05-10T11:14:58.291313+0000","last_became_peered":"2024-05-10T11:14:58.291313+0000","last_unstale":"2024-05-10T11:14:58.299821+0000","last_undegraded":"2024-05-10T11:14:58.299821+0000","last_fullsized":"2024-05-10T11:14:58.299821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:47.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288145+0000","last_change":"2024-05-10T11:14:57.280903+0000","last_active":"2024-05-10T11:14:59.288145+0000","last_peered":"2024-05-10T11:14:59.288145+0000","last_clean":"2024-05-10T11:14:59.288145+0000","last_became_active":"2024-05-10T11:14:57.280595+0000","last_became_peered":"2024-05-10T11:14:57.280595+0000","last_unstale":"2024-05-10T11:14:59.288145+0000","last_undegraded":"2024-05-10T11:14:59.288145+0000","last_fullsized":"2024-05-10T11:14:59.288145+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:26.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411820+0000","last_change":"2024-05-10T11:14:58.291334+0000","last_active":"2024-05-10T11:14:59.411820+0000","last_peered":"2024-05-10T11:14:59.411820+0000","last_clean":"2024-05-10T11:14:59.411820+0000","last_became_active":"2024-05-10T11:14:58.290873+0000","last_became_peered":"2024-05-10T11:14:58.290873+0000","last_unstale":"2024-05-10T11:14:59.411820+0000","last_undegraded":"2024-05-10T11:14:59.411820+0000","last_fullsized":"2024-05-10T11:14:59.411820+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412294+0000","last_change":"2024-05-10T11:14:57.285784+0000","last_active":"2024-05-10T11:14:59.412294+0000","last_peered":"2024-05-10T11:14:59.412294+0000","last_clean":"2024-05-10T11:14:59.412294+0000","last_became_active":"2024-05-10T11:14:57.285511+0000","last_became_peered":"2024-05-10T11:14:57.285511+0000","last_unstale":"2024-05-10T11:14:59.412294+0000","last_undegraded":"2024-05-10T11:14:59.412294+0000","last_fullsized":"2024-05-10T11:14:59.412294+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:39.777254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293402+0000","last_change":"2024-05-10T11:14:58.294900+0000","last_active":"2024-05-10T11:14:59.293402+0000","last_peered":"2024-05-10T11:14:59.293402+0000","last_clean":"2024-05-10T11:14:59.293402+0000","last_became_active":"2024-05-10T11:14:58.293875+0000","last_became_peered":"2024-05-10T11:14:58.293875+0000","last_unstale":"2024-05-10T11:14:59.293402+0000","last_undegraded":"2024-05-10T11:14:59.293402+0000","last_fullsized":"2024-05-10T11:14:59.293402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:35.553377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293556+0000","last_change":"2024-05-10T11:14:57.281997+0000","last_active":"2024-05-10T11:14:59.293556+0000","last_peered":"2024-05-10T11:14:59.293556+0000","last_clean":"2024-05-10T11:14:59.293556+0000","last_became_active":"2024-05-10T11:14:57.281468+0000","last_became_peered":"2024-05-10T11:14:57.281468+0000","last_unstale":"2024-05-10T11:14:59.293556+0000","last_undegraded":"2024-05-10T11:14:59.293556+0000","last_fullsized":"2024-05-10T11:14:59.293556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:08.557076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300074+0000","last_change":"2024-05-10T11:14:58.292189+0000","last_active":"2024-05-10T11:14:58.300074+0000","last_peered":"2024-05-10T11:14:58.300074+0000","last_clean":"2024-05-10T11:14:58.300074+0000","last_became_active":"2024-05-10T11:14:58.291853+0000","last_became_peered":"2024-05-10T11:14:58.291853+0000","last_unstale":"2024-05-10T11:14:58.300074+0000","last_undegraded":"2024-05-10T11:14:58.300074+0000","last_fullsized":"2024-05-10T11:14:58.300074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:26.302273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411923+0000","last_change":"2024-05-10T11:14:57.286677+0000","last_active":"2024-05-10T11:14:59.411923+0000","last_peered":"2024-05-10T11:14:59.411923+0000","last_clean":"2024-05-10T11:14:59.411923+0000","last_became_active":"2024-05-10T11:14:57.286392+0000","last_became_peered":"2024-05-10T11:14:57.286392+0000","last_unstale":"2024-05-10T11:14:59.411923+0000","last_undegraded":"2024-05-10T11:14:59.411923+0000","last_fullsized":"2024-05-10T11:14:59.411923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:34.548696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412227+0000","last_change":"2024-05-10T11:14:58.297756+0000","last_active":"2024-05-10T11:14:59.412227+0000","last_peered":"2024-05-10T11:14:59.412227+0000","last_clean":"2024-05-10T11:14:59.412227+0000","last_became_active":"2024-05-10T11:14:58.297477+0000","last_became_peered":"2024-05-10T11:14:58.297477+0000","last_unstale":"2024-05-10T11:14:59.412227+0000","last_undegraded":"2024-05-10T11:14:59.412227+0000","last_fullsized":"2024-05-10T11:14:59.412227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:18.792791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.294020+0000","last_change":"2024-05-10T11:14:57.283832+0000","last_active":"2024-05-10T11:14:59.294020+0000","last_peered":"2024-05-10T11:14:59.294020+0000","last_clean":"2024-05-10T11:14:59.294020+0000","last_became_active":"2024-05-10T11:14:57.283428+0000","last_became_peered":"2024-05-10T11:14:57.283428+0000","last_unstale":"2024-05-10T11:14:59.294020+0000","last_undegraded":"2024-05-10T11:14:59.294020+0000","last_fullsized":"2024-05-10T11:14:59.294020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299477+0000","last_change":"2024-05-10T11:14:58.289925+0000","last_active":"2024-05-10T11:14:59.299477+0000","last_peered":"2024-05-10T11:14:59.299477+0000","last_clean":"2024-05-10T11:14:59.299477+0000","last_became_active":"2024-05-10T11:14:58.289633+0000","last_became_peered":"2024-05-10T11:14:58.289633+0000","last_unstale":"2024-05-10T11:14:59.299477+0000","last_undegraded":"2024-05-10T11:14:59.299477+0000","last_fullsized":"2024-05-10T11:14:59.299477+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:38.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293984+0000","last_change":"2024-05-10T11:14:57.282035+0000","last_active":"2024-05-10T11:14:59.293984+0000","last_peered":"2024-05-10T11:14:59.293984+0000","last_clean":"2024-05-10T11:14:59.293984+0000","last_became_active":"2024-05-10T11:14:57.281774+0000","last_became_peered":"2024-05-10T11:14:57.281774+0000","last_unstale":"2024-05-10T11:14:59.293984+0000","last_undegraded":"2024-05-10T11:14:59.293984+0000","last_fullsized":"2024-05-10T11:14:59.293984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:13.792438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293942+0000","last_change":"2024-05-10T11:14:58.296279+0000","last_active":"2024-05-10T11:14:59.293942+0000","last_peered":"2024-05-10T11:14:59.293942+0000","last_clean":"2024-05-10T11:14:59.293942+0000","last_became_active":"2024-05-10T11:14:58.296001+0000","last_became_peered":"2024-05-10T11:14:58.296001+0000","last_unstale":"2024-05-10T11:14:59.293942+0000","last_undegraded":"2024-05-10T11:14:59.293942+0000","last_fullsized":"2024-05-10T11:14:59.293942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412224+0000","last_change":"2024-05-10T11:14:57.277996+0000","last_active":"2024-05-10T11:14:59.412224+0000","last_peered":"2024-05-10T11:14:59.412224+0000","last_clean":"2024-05-10T11:14:59.412224+0000","last_became_active":"2024-05-10T11:14:57.277696+0000","last_became_peered":"2024-05-10T11:14:57.277696+0000","last_unstale":"2024-05-10T11:14:59.412224+0000","last_undegraded":"2024-05-10T11:14:59.412224+0000","last_fullsized":"2024-05-10T11:14:59.412224+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:08.450607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.299916+0000","last_change":"2024-05-10T11:14:58.292302+0000","last_active":"2024-05-10T11:14:58.299916+0000","last_peered":"2024-05-10T11:14:58.299916+0000","last_clean":"2024-05-10T11:14:58.299916+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:58.299916+0000","last_undegraded":"2024-05-10T11:14:58.299916+0000","last_fullsized":"2024-05-10T11:14:58.299916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:34.339013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411964+0000","last_change":"2024-05-10T11:14:57.281319+0000","last_active":"2024-05-10T11:14:59.411964+0000","last_peered":"2024-05-10T11:14:59.411964+0000","last_clean":"2024-05-10T11:14:59.411964+0000","last_became_active":"2024-05-10T11:14:57.281041+0000","last_became_peered":"2024-05-10T11:14:57.281041+0000","last_unstale":"2024-05-10T11:14:59.411964+0000","last_undegraded":"2024-05-10T11:14:59.411964+0000","last_fullsized":"2024-05-10T11:14:59.411964+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:54.982213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300460+0000","last_change":"2024-05-10T11:14:58.299193+0000","last_active":"2024-05-10T11:14:58.300460+0000","last_peered":"2024-05-10T11:14:58.300460+0000","last_clean":"2024-05-10T11:14:58.300460+0000","last_became_active":"2024-05-10T11:14:58.293535+0000","last_became_peered":"2024-05-10T11:14:58.293535+0000","last_unstale":"2024-05-10T11:14:58.300460+0000","last_undegraded":"2024-05-10T11:14:58.300460+0000","last_fullsized":"2024-05-10T11:14:58.300460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:26.263371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289955+0000","last_change":"2024-05-10T11:14:57.288619+0000","last_active":"2024-05-10T11:14:58.289955+0000","last_peered":"2024-05-10T11:14:58.289955+0000","last_clean":"2024-05-10T11:14:58.289955+0000","last_became_active":"2024-05-10T11:14:57.288345+0000","last_became_peered":"2024-05-10T11:14:57.288345+0000","last_unstale":"2024-05-10T11:14:58.289955+0000","last_undegraded":"2024-05-10T11:14:58.289955+0000","last_fullsized":"2024-05-10T11:14:58.289955+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:56.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.309165+0000","last_change":"2024-05-10T11:14:58.307212+0000","last_active":"2024-05-10T11:14:58.309165+0000","last_peered":"2024-05-10T11:14:58.309165+0000","last_clean":"2024-05-10T11:14:58.309165+0000","last_became_active":"2024-05-10T11:14:58.306894+0000","last_became_peered":"2024-05-10T11:14:58.306894+0000","last_unstale":"2024-05-10T11:14:58.309165+0000","last_undegraded":"2024-05-10T11:14:58.309165+0000","last_fullsized":"2024-05-10T11:14:58.309165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:36.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288108+0000","last_change":"2024-05-10T11:14:57.285145+0000","last_active":"2024-05-10T11:14:59.288108+0000","last_peered":"2024-05-10T11:14:59.288108+0000","last_clean":"2024-05-10T11:14:59.288108+0000","last_became_active":"2024-05-10T11:14:57.284872+0000","last_became_peered":"2024-05-10T11:14:57.284872+0000","last_unstale":"2024-05-10T11:14:59.288108+0000","last_undegraded":"2024-05-10T11:14:59.288108+0000","last_fullsized":"2024-05-10T11:14:59.288108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:34.548696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411550+0000","last_change":"2024-05-10T11:14:58.300595+0000","last_active":"2024-05-10T11:14:59.411550+0000","last_peered":"2024-05-10T11:14:59.411550+0000","last_clean":"2024-05-10T11:14:59.411550+0000","last_became_active":"2024-05-10T11:14:58.300322+0000","last_became_peered":"2024-05-10T11:14:58.300322+0000","last_unstale":"2024-05-10T11:14:59.411550+0000","last_undegraded":"2024-05-10T11:14:59.411550+0000","last_fullsized":"2024-05-10T11:14:59.411550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:09.561757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288038+0000","last_change":"2024-05-10T11:14:57.284501+0000","last_active":"2024-05-10T11:14:59.288038+0000","last_peered":"2024-05-10T11:14:59.288038+0000","last_clean":"2024-05-10T11:14:59.288038+0000","last_became_active":"2024-05-10T11:14:57.283858+0000","last_became_peered":"2024-05-10T11:14:57.283858+0000","last_unstale":"2024-05-10T11:14:59.288038+0000","last_undegraded":"2024-05-10T11:14:59.288038+0000","last_fullsized":"2024-05-10T11:14:59.288038+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:51.210308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299487+0000","last_change":"2024-05-10T11:14:58.296316+0000","last_active":"2024-05-10T11:14:59.299487+0000","last_peered":"2024-05-10T11:14:59.299487+0000","last_clean":"2024-05-10T11:14:59.299487+0000","last_became_active":"2024-05-10T11:14:58.295787+0000","last_became_peered":"2024-05-10T11:14:58.295787+0000","last_unstale":"2024-05-10T11:14:59.299487+0000","last_undegraded":"2024-05-10T11:14:59.299487+0000","last_fullsized":"2024-05-10T11:14:59.299487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:37.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411457+0000","last_change":"2024-05-10T11:14:57.284893+0000","last_active":"2024-05-10T11:14:59.411457+0000","last_peered":"2024-05-10T11:14:59.411457+0000","last_clean":"2024-05-10T11:14:59.411457+0000","last_became_active":"2024-05-10T11:14:57.284424+0000","last_became_peered":"2024-05-10T11:14:57.284424+0000","last_unstale":"2024-05-10T11:14:59.411457+0000","last_undegraded":"2024-05-10T11:14:59.411457+0000","last_fullsized":"2024-05-10T11:14:59.411457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:31.485594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.300040+0000","last_change":"2024-05-10T11:14:58.293110+0000","last_active":"2024-05-10T11:14:58.300040+0000","last_peered":"2024-05-10T11:14:58.300040+0000","last_clean":"2024-05-10T11:14:58.300040+0000","last_became_active":"2024-05-10T11:14:58.292854+0000","last_became_peered":"2024-05-10T11:14:58.292854+0000","last_unstale":"2024-05-10T11:14:58.300040+0000","last_undegraded":"2024-05-10T11:14:58.300040+0000","last_fullsized":"2024-05-10T11:14:58.300040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:51.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287869+0000","last_change":"2024-05-10T11:14:57.282272+0000","last_active":"2024-05-10T11:14:59.287869+0000","last_peered":"2024-05-10T11:14:59.287869+0000","last_clean":"2024-05-10T11:14:59.287869+0000","last_became_active":"2024-05-10T11:14:57.281986+0000","last_became_peered":"2024-05-10T11:14:57.281986+0000","last_unstale":"2024-05-10T11:14:59.287869+0000","last_undegraded":"2024-05-10T11:14:59.287869+0000","last_fullsized":"2024-05-10T11:14:59.287869+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:08.450607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":184,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-10T11:14:58.289692+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:14:58.289692+0000","last_peered":"2024-05-10T11:14:58.289692+0000","last_clean":"2024-05-10T11:14:58.289692+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:14:58.289692+0000","last_undegraded":"2024-05-10T11:14:58.289692+0000","last_fullsized":"2024-05-10T11:14:58.289692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":916015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":324905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":326483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":331563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":331563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":333939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1335296,"data_stored":921931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":331585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:15:06.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:15:06.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.935+0000 7f2e743b6640 1 Processor -- start 2024-05-10T11:15:06.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.935+0000 7f2e743b6640 1 -- start start 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.936+0000 7f2e743b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e743b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e6c0cfbb0 0x7f2e6c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e743b6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6c15fc90 con 0x7f2e6c0b8860 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e743b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c06ec30 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e743b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c06ee50 con 0x7f2e6c0d0230 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72953640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e6c0cfbb0 0x7f2e6c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72152640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2e6c0b8860 0x7f2e6c06e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34828/0 (socket says 172.21.15.66:34828) 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72152640 1 -- 172.21.15.66:0/487964155 learned_addr learned my addr 172.21.15.66:0/487964155 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e71951640 1 --2- 172.21.15.66:0/487964155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72953640 1 -- 172.21.15.66:0/487964155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 msgr2=0x7f2e6c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72953640 1 --2- 172.21.15.66:0/487964155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72953640 1 -- 172.21.15.66:0/487964155 >> v1:172.21.15.66:6789/0 conn(0x7f2e6c0b8860 legacy=0x7f2e6c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e71150640 1 -- 172.21.15.66:0/487964155 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5250570 0 0) 0x7f2e6c15fc90 con 0x7f2e6c0b8860 2024-05-10T11:15:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.937+0000 7f2e72953640 1 -- 172.21.15.66:0/487964155 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0b8c40 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.938+0000 7f2e72953640 1 --2- 172.21.15.66:0/487964155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0ce330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009dc0 tx=0x7f2e6402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41b471165447d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.938+0000 7f2e71150640 1 -- 172.21.15.66:0/487964155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64007740 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.938+0000 7f2e71150640 1 -- 172.21.15.66:0/487964155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e640078e0 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.938+0000 7f2e71150640 1 -- 172.21.15.66:0/487964155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64007cb0 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.938+0000 7f2e743b6640 1 -- 172.21.15.66:0/487964155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 msgr2=0x7f2e6c0ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.938+0000 7f2e743b6640 1 --2- 172.21.15.66:0/487964155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0ce330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009dc0 tx=0x7f2e6402a5f0 comp rx=0 tx=0).stop 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.939+0000 7f2e743b6640 1 -- 172.21.15.66:0/487964155 shutdown_connections 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.939+0000 7f2e743b6640 1 --2- 172.21.15.66:0/487964155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0ce330 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.939+0000 7f2e743b6640 1 --2- 172.21.15.66:0/487964155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.939+0000 7f2e743b6640 1 -- 172.21.15.66:0/487964155 >> 172.21.15.66:0/487964155 conn(0x7f2e6c0d2df0 msgr2=0x7f2e6c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.939+0000 7f2e743b6640 1 -- 172.21.15.66:0/487964155 shutdown_connections 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.939+0000 7f2e743b6640 1 -- 172.21.15.66:0/487964155 wait complete. 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.940+0000 7f2e743b6640 1 Processor -- start 2024-05-10T11:15:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.940+0000 7f2e743b6640 1 -- start start 2024-05-10T11:15:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e743b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e6c0b8860 0x7f2e6c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e743b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e743b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e743b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c0cdb30 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e743b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c0cd850 con 0x7f2e6c0b8860 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e743b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c0cde10 con 0x7f2e6c0d0230 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34860/0 (socket says 172.21.15.66:34860) 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 -- 172.21.15.66:0/2248826614 learned_addr learned my addr 172.21.15.66:0/2248826614 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e72953640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e72152640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e6c0b8860 0x7f2e6c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 -- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 msgr2=0x7f2e6c150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 -- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e6c0b8860 msgr2=0x7f2e6c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e6c0b8860 0x7f2e6c0ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 -- 172.21.15.66:0/2248826614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0c8e00 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e72152640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e6c0b8860 0x7f2e6c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e71951640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0c8420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00d5f0 tx=0x7f2e5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.941+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0125f0 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.942+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c019070 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.942+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c0c90e0 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.942+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0129d0 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.942+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c0ceae0 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.943+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6c06a220 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.943+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e5c012b70 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.944+0000 7f2e62ffd640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e500762d0 0x7f2e50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.944+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f2e5c097b30 con 0x7f2e6c0cfbb0 2024-05-10T11:15:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.944+0000 7f2e72152640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e500762d0 0x7f2e50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.945+0000 7f2e72152640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e500762d0 0x7f2e50078790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2e68000f60 tx=0x7f2e68007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:06.948+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2e5c061390 con 0x7f2e6c0cfbb0 2024-05-10T11:15:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.135+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e6c0d1e20 con 0x7f2e500762d0 2024-05-10T11:15:07.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.141+0000 7f2e62ffd640 1 -- 172.21.15.66:0/2248826614 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251973 (secure 0 0 0) 0x7f2e6c0d1e20 con 0x7f2e500762d0 2024-05-10T11:15:07.144 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e500762d0 msgr2=0x7f2e50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e500762d0 0x7f2e50078790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2e68000f60 tx=0x7f2e68007c10 comp rx=0 tx=0).stop 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 msgr2=0x7f2e6c0c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0c8420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00d5f0 tx=0x7f2e5c00dab0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 shutdown_connections 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e500762d0 0x7f2e50078790 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e6c0d0230 0x7f2e6c150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e6c0cfbb0 0x7f2e6c0c8420 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 --2- 172.21.15.66:0/2248826614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e6c0b8860 0x7f2e6c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 >> 172.21.15.66:0/2248826614 conn(0x7f2e6c0d2df0 msgr2=0x7f2e6c06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 shutdown_connections 2024-05-10T11:15:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.144+0000 7f2e743b6640 1 -- 172.21.15.66:0/2248826614 wait complete. 2024-05-10T11:15:07.155 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-05-10T11:15:05.720987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223208,"kb_used_data":7016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751512,"statfs":{"total":773094113280,"available":772865548288,"internally_reserved":0,"allocated":7184384,"data_stored":3838060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001997"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412195+0000","last_change":"2024-05-10T11:14:58.299340+0000","last_active":"2024-05-10T11:14:59.412195+0000","last_peered":"2024-05-10T11:14:59.412195+0000","last_clean":"2024-05-10T11:14:59.412195+0000","last_became_active":"2024-05-10T11:14:58.298806+0000","last_became_peered":"2024-05-10T11:14:58.298806+0000","last_unstale":"2024-05-10T11:14:59.412195+0000","last_undegraded":"2024-05-10T11:14:59.412195+0000","last_fullsized":"2024-05-10T11:14:59.412195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:10.667637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411809+0000","last_change":"2024-05-10T11:14:58.293599+0000","last_active":"2024-05-10T11:14:59.411809+0000","last_peered":"2024-05-10T11:14:59.411809+0000","last_clean":"2024-05-10T11:14:59.411809+0000","last_became_active":"2024-05-10T11:14:58.293236+0000","last_became_peered":"2024-05-10T11:14:58.293236+0000","last_unstale":"2024-05-10T11:14:59.411809+0000","last_undegraded":"2024-05-10T11:14:59.411809+0000","last_fullsized":"2024-05-10T11:14:59.411809+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:40.766419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412611+0000","last_change":"2024-05-10T11:14:58.297410+0000","last_active":"2024-05-10T11:14:59.412611+0000","last_peered":"2024-05-10T11:14:59.412611+0000","last_clean":"2024-05-10T11:14:59.412611+0000","last_became_active":"2024-05-10T11:14:58.297147+0000","last_became_peered":"2024-05-10T11:14:58.297147+0000","last_unstale":"2024-05-10T11:14:59.412611+0000","last_undegraded":"2024-05-10T11:14:59.412611+0000","last_fullsized":"2024-05-10T11:14:59.412611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:07.730645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413044+0000","last_change":"2024-05-10T11:14:58.294909+0000","last_active":"2024-05-10T11:14:59.413044+0000","last_peered":"2024-05-10T11:14:59.413044+0000","last_clean":"2024-05-10T11:14:59.413044+0000","last_became_active":"2024-05-10T11:14:58.294219+0000","last_became_peered":"2024-05-10T11:14:58.294219+0000","last_unstale":"2024-05-10T11:14:59.413044+0000","last_undegraded":"2024-05-10T11:14:59.413044+0000","last_fullsized":"2024-05-10T11:14:59.413044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:43.202523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412094+0000","last_change":"2024-05-10T11:14:58.302152+0000","last_active":"2024-05-10T11:14:59.412094+0000","last_peered":"2024-05-10T11:14:59.412094+0000","last_clean":"2024-05-10T11:14:59.412094+0000","last_became_active":"2024-05-10T11:14:58.301618+0000","last_became_peered":"2024-05-10T11:14:58.301618+0000","last_unstale":"2024-05-10T11:14:59.412094+0000","last_undegraded":"2024-05-10T11:14:59.412094+0000","last_fullsized":"2024-05-10T11:14:59.412094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:48.994765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412481+0000","last_change":"2024-05-10T11:14:58.299499+0000","last_active":"2024-05-10T11:14:59.412481+0000","last_peered":"2024-05-10T11:14:59.412481+0000","last_clean":"2024-05-10T11:14:59.412481+0000","last_became_active":"2024-05-10T11:14:58.299133+0000","last_became_peered":"2024-05-10T11:14:58.299133+0000","last_unstale":"2024-05-10T11:14:59.412481+0000","last_undegraded":"2024-05-10T11:14:59.412481+0000","last_fullsized":"2024-05-10T11:14:59.412481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:02:09.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299325+0000","last_change":"2024-05-10T11:14:58.304622+0000","last_active":"2024-05-10T11:14:59.299325+0000","last_peered":"2024-05-10T11:14:59.299325+0000","last_clean":"2024-05-10T11:14:59.299325+0000","last_became_active":"2024-05-10T11:14:58.304303+0000","last_became_peered":"2024-05-10T11:14:58.304303+0000","last_unstale":"2024-05-10T11:14:59.299325+0000","last_undegraded":"2024-05-10T11:14:59.299325+0000","last_fullsized":"2024-05-10T11:14:59.299325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:33.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293457+0000","last_change":"2024-05-10T11:14:58.305552+0000","last_active":"2024-05-10T11:14:59.293457+0000","last_peered":"2024-05-10T11:14:59.293457+0000","last_clean":"2024-05-10T11:14:59.293457+0000","last_became_active":"2024-05-10T11:14:58.305299+0000","last_became_peered":"2024-05-10T11:14:58.305299+0000","last_unstale":"2024-05-10T11:14:59.293457+0000","last_undegraded":"2024-05-10T11:14:59.293457+0000","last_fullsized":"2024-05-10T11:14:59.293457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:38.945852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413509+0000","last_change":"2024-05-10T11:14:58.307371+0000","last_active":"2024-05-10T11:14:59.413509+0000","last_peered":"2024-05-10T11:14:59.413509+0000","last_clean":"2024-05-10T11:14:59.413509+0000","last_became_active":"2024-05-10T11:14:58.307064+0000","last_became_peered":"2024-05-10T11:14:58.307064+0000","last_unstale":"2024-05-10T11:14:59.413509+0000","last_undegraded":"2024-05-10T11:14:59.413509+0000","last_fullsized":"2024-05-10T11:14:59.413509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:49.859079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413130+0000","last_change":"2024-05-10T11:14:58.299020+0000","last_active":"2024-05-10T11:14:59.413130+0000","last_peered":"2024-05-10T11:14:59.413130+0000","last_clean":"2024-05-10T11:14:59.413130+0000","last_became_active":"2024-05-10T11:14:58.298147+0000","last_became_peered":"2024-05-10T11:14:58.298147+0000","last_unstale":"2024-05-10T11:14:59.413130+0000","last_undegraded":"2024-05-10T11:14:59.413130+0000","last_fullsized":"2024-05-10T11:14:59.413130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:07.318862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413641+0000","last_change":"2024-05-10T11:14:58.292521+0000","last_active":"2024-05-10T11:14:59.413641+0000","last_peered":"2024-05-10T11:14:59.413641+0000","last_clean":"2024-05-10T11:14:59.413641+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:59.413641+0000","last_undegraded":"2024-05-10T11:14:59.413641+0000","last_fullsized":"2024-05-10T11:14:59.413641+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:54.290626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293615+0000","last_change":"2024-05-10T11:14:58.303388+0000","last_active":"2024-05-10T11:14:59.293615+0000","last_peered":"2024-05-10T11:14:59.293615+0000","last_clean":"2024-05-10T11:14:59.293615+0000","last_became_active":"2024-05-10T11:14:58.303093+0000","last_became_peered":"2024-05-10T11:14:58.303093+0000","last_unstale":"2024-05-10T11:14:59.293615+0000","last_undegraded":"2024-05-10T11:14:59.293615+0000","last_fullsized":"2024-05-10T11:14:59.293615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:27.443250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293798+0000","last_change":"2024-05-10T11:14:58.300330+0000","last_active":"2024-05-10T11:14:59.293798+0000","last_peered":"2024-05-10T11:14:59.293798+0000","last_clean":"2024-05-10T11:14:59.293798+0000","last_became_active":"2024-05-10T11:14:58.300074+0000","last_became_peered":"2024-05-10T11:14:58.300074+0000","last_unstale":"2024-05-10T11:14:59.293798+0000","last_undegraded":"2024-05-10T11:14:59.293798+0000","last_fullsized":"2024-05-10T11:14:59.293798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412999+0000","last_change":"2024-05-10T11:14:58.296851+0000","last_active":"2024-05-10T11:14:59.412999+0000","last_peered":"2024-05-10T11:14:59.412999+0000","last_clean":"2024-05-10T11:14:59.412999+0000","last_became_active":"2024-05-10T11:14:58.296494+0000","last_became_peered":"2024-05-10T11:14:58.296494+0000","last_unstale":"2024-05-10T11:14:59.412999+0000","last_undegraded":"2024-05-10T11:14:59.412999+0000","last_fullsized":"2024-05-10T11:14:59.412999+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:08:59.127867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413000+0000","last_change":"2024-05-10T11:14:58.303310+0000","last_active":"2024-05-10T11:14:59.413000+0000","last_peered":"2024-05-10T11:14:59.413000+0000","last_clean":"2024-05-10T11:14:59.413000+0000","last_became_active":"2024-05-10T11:14:58.303026+0000","last_became_peered":"2024-05-10T11:14:58.303026+0000","last_unstale":"2024-05-10T11:14:59.413000+0000","last_undegraded":"2024-05-10T11:14:59.413000+0000","last_fullsized":"2024-05-10T11:14:59.413000+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:10.549386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299304+0000","last_change":"2024-05-10T11:14:58.295774+0000","last_active":"2024-05-10T11:14:59.299304+0000","last_peered":"2024-05-10T11:14:59.299304+0000","last_clean":"2024-05-10T11:14:59.299304+0000","last_became_active":"2024-05-10T11:14:58.295468+0000","last_became_peered":"2024-05-10T11:14:58.295468+0000","last_unstale":"2024-05-10T11:14:59.299304+0000","last_undegraded":"2024-05-10T11:14:59.299304+0000","last_fullsized":"2024-05-10T11:14:59.299304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:27.753374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411891+0000","last_change":"2024-05-10T11:14:58.301222+0000","last_active":"2024-05-10T11:14:59.411891+0000","last_peered":"2024-05-10T11:14:59.411891+0000","last_clean":"2024-05-10T11:14:59.411891+0000","last_became_active":"2024-05-10T11:14:58.300928+0000","last_became_peered":"2024-05-10T11:14:58.300928+0000","last_unstale":"2024-05-10T11:14:59.411891+0000","last_undegraded":"2024-05-10T11:14:59.411891+0000","last_fullsized":"2024-05-10T11:14:59.411891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:18.189218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412422+0000","last_change":"2024-05-10T11:14:58.294765+0000","last_active":"2024-05-10T11:14:59.412422+0000","last_peered":"2024-05-10T11:14:59.412422+0000","last_clean":"2024-05-10T11:14:59.412422+0000","last_became_active":"2024-05-10T11:14:58.294194+0000","last_became_peered":"2024-05-10T11:14:58.294194+0000","last_unstale":"2024-05-10T11:14:59.412422+0000","last_undegraded":"2024-05-10T11:14:59.412422+0000","last_fullsized":"2024-05-10T11:14:59.412422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:04:33.945652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412608+0000","last_change":"2024-05-10T11:14:58.291296+0000","last_active":"2024-05-10T11:14:59.412608+0000","last_peered":"2024-05-10T11:14:59.412608+0000","last_clean":"2024-05-10T11:14:59.412608+0000","last_became_active":"2024-05-10T11:14:58.291032+0000","last_became_peered":"2024-05-10T11:14:58.291032+0000","last_unstale":"2024-05-10T11:14:59.412608+0000","last_undegraded":"2024-05-10T11:14:59.412608+0000","last_fullsized":"2024-05-10T11:14:59.412608+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:51.756822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288145+0000","last_change":"2024-05-10T11:14:58.289734+0000","last_active":"2024-05-10T11:14:59.288145+0000","last_peered":"2024-05-10T11:14:59.288145+0000","last_clean":"2024-05-10T11:14:59.288145+0000","last_became_active":"2024-05-10T11:14:58.289197+0000","last_became_peered":"2024-05-10T11:14:58.289197+0000","last_unstale":"2024-05-10T11:14:59.288145+0000","last_undegraded":"2024-05-10T11:14:59.288145+0000","last_fullsized":"2024-05-10T11:14:59.288145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:00.327758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293720+0000","last_change":"2024-05-10T11:14:58.292301+0000","last_active":"2024-05-10T11:14:59.293720+0000","last_peered":"2024-05-10T11:14:59.293720+0000","last_clean":"2024-05-10T11:14:59.293720+0000","last_became_active":"2024-05-10T11:14:58.292011+0000","last_became_peered":"2024-05-10T11:14:58.292011+0000","last_unstale":"2024-05-10T11:14:59.293720+0000","last_undegraded":"2024-05-10T11:14:59.293720+0000","last_fullsized":"2024-05-10T11:14:59.293720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:27.519315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287996+0000","last_change":"2024-05-10T11:14:58.297912+0000","last_active":"2024-05-10T11:14:59.287996+0000","last_peered":"2024-05-10T11:14:59.287996+0000","last_clean":"2024-05-10T11:14:59.287996+0000","last_became_active":"2024-05-10T11:14:58.297518+0000","last_became_peered":"2024-05-10T11:14:58.297518+0000","last_unstale":"2024-05-10T11:14:59.287996+0000","last_undegraded":"2024-05-10T11:14:59.287996+0000","last_fullsized":"2024-05-10T11:14:59.287996+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:02:09.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287937+0000","last_change":"2024-05-10T11:14:58.305600+0000","last_active":"2024-05-10T11:14:59.287937+0000","last_peered":"2024-05-10T11:14:59.287937+0000","last_clean":"2024-05-10T11:14:59.287937+0000","last_became_active":"2024-05-10T11:14:58.305231+0000","last_became_peered":"2024-05-10T11:14:58.305231+0000","last_unstale":"2024-05-10T11:14:59.287937+0000","last_undegraded":"2024-05-10T11:14:59.287937+0000","last_fullsized":"2024-05-10T11:14:59.287937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:18.792791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413503+0000","last_change":"2024-05-10T11:14:58.296984+0000","last_active":"2024-05-10T11:14:59.413503+0000","last_peered":"2024-05-10T11:14:59.413503+0000","last_clean":"2024-05-10T11:14:59.413503+0000","last_became_active":"2024-05-10T11:14:58.296624+0000","last_became_peered":"2024-05-10T11:14:58.296624+0000","last_unstale":"2024-05-10T11:14:59.413503+0000","last_undegraded":"2024-05-10T11:14:59.413503+0000","last_fullsized":"2024-05-10T11:14:59.413503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:47.031356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293927+0000","last_change":"2024-05-10T11:14:58.294450+0000","last_active":"2024-05-10T11:14:59.293927+0000","last_peered":"2024-05-10T11:14:59.293927+0000","last_clean":"2024-05-10T11:14:59.293927+0000","last_became_active":"2024-05-10T11:14:58.294145+0000","last_became_peered":"2024-05-10T11:14:58.294145+0000","last_unstale":"2024-05-10T11:14:59.293927+0000","last_undegraded":"2024-05-10T11:14:59.293927+0000","last_fullsized":"2024-05-10T11:14:59.293927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293796+0000","last_change":"2024-05-10T11:14:58.295269+0000","last_active":"2024-05-10T11:14:59.293796+0000","last_peered":"2024-05-10T11:14:59.293796+0000","last_clean":"2024-05-10T11:14:59.293796+0000","last_became_active":"2024-05-10T11:14:58.294820+0000","last_became_peered":"2024-05-10T11:14:58.294820+0000","last_unstale":"2024-05-10T11:14:59.293796+0000","last_undegraded":"2024-05-10T11:14:59.293796+0000","last_fullsized":"2024-05-10T11:14:59.293796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:37.670772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413749+0000","last_change":"2024-05-10T11:14:58.292277+0000","last_active":"2024-05-10T11:14:59.413749+0000","last_peered":"2024-05-10T11:14:59.413749+0000","last_clean":"2024-05-10T11:14:59.413749+0000","last_became_active":"2024-05-10T11:14:58.291531+0000","last_became_peered":"2024-05-10T11:14:58.291531+0000","last_unstale":"2024-05-10T11:14:59.413749+0000","last_undegraded":"2024-05-10T11:14:59.413749+0000","last_fullsized":"2024-05-10T11:14:59.413749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:00.756071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411680+0000","last_change":"2024-05-10T11:14:58.292535+0000","last_active":"2024-05-10T11:14:59.411680+0000","last_peered":"2024-05-10T11:14:59.411680+0000","last_clean":"2024-05-10T11:14:59.411680+0000","last_became_active":"2024-05-10T11:14:58.292081+0000","last_became_peered":"2024-05-10T11:14:58.292081+0000","last_unstale":"2024-05-10T11:14:59.411680+0000","last_undegraded":"2024-05-10T11:14:59.411680+0000","last_fullsized":"2024-05-10T11:14:59.411680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:14.797119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413428+0000","last_change":"2024-05-10T11:14:58.309493+0000","last_active":"2024-05-10T11:14:59.413428+0000","last_peered":"2024-05-10T11:14:59.413428+0000","last_clean":"2024-05-10T11:14:59.413428+0000","last_became_active":"2024-05-10T11:14:58.308480+0000","last_became_peered":"2024-05-10T11:14:58.308480+0000","last_unstale":"2024-05-10T11:14:59.413428+0000","last_undegraded":"2024-05-10T11:14:59.413428+0000","last_fullsized":"2024-05-10T11:14:59.413428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:01:31.005814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293420+0000","last_change":"2024-05-10T11:14:58.304102+0000","last_active":"2024-05-10T11:14:59.293420+0000","last_peered":"2024-05-10T11:14:59.293420+0000","last_clean":"2024-05-10T11:14:59.293420+0000","last_became_active":"2024-05-10T11:14:58.303832+0000","last_became_peered":"2024-05-10T11:14:58.303832+0000","last_unstale":"2024-05-10T11:14:59.293420+0000","last_undegraded":"2024-05-10T11:14:59.293420+0000","last_fullsized":"2024-05-10T11:14:59.293420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:24.954543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412301+0000","last_change":"2024-05-10T11:14:58.290600+0000","last_active":"2024-05-10T11:14:59.412301+0000","last_peered":"2024-05-10T11:14:59.412301+0000","last_clean":"2024-05-10T11:14:59.412301+0000","last_became_active":"2024-05-10T11:14:58.290320+0000","last_became_peered":"2024-05-10T11:14:58.290320+0000","last_unstale":"2024-05-10T11:14:59.412301+0000","last_undegraded":"2024-05-10T11:14:59.412301+0000","last_fullsized":"2024-05-10T11:14:59.412301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:22.704456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411554+0000","last_change":"2024-05-10T11:14:58.288413+0000","last_active":"2024-05-10T11:14:59.411554+0000","last_peered":"2024-05-10T11:14:59.411554+0000","last_clean":"2024-05-10T11:14:59.411554+0000","last_became_active":"2024-05-10T11:14:58.288120+0000","last_became_peered":"2024-05-10T11:14:58.288120+0000","last_unstale":"2024-05-10T11:14:59.411554+0000","last_undegraded":"2024-05-10T11:14:59.411554+0000","last_fullsized":"2024-05-10T11:14:59.411554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:06.502089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412550+0000","last_change":"2024-05-10T11:14:58.293177+0000","last_active":"2024-05-10T11:14:59.412550+0000","last_peered":"2024-05-10T11:14:59.412550+0000","last_clean":"2024-05-10T11:14:59.412550+0000","last_became_active":"2024-05-10T11:14:58.292884+0000","last_became_peered":"2024-05-10T11:14:58.292884+0000","last_unstale":"2024-05-10T11:14:59.412550+0000","last_undegraded":"2024-05-10T11:14:59.412550+0000","last_fullsized":"2024-05-10T11:14:59.412550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:00.756071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411988+0000","last_change":"2024-05-10T11:14:57.284107+0000","last_active":"2024-05-10T11:14:59.411988+0000","last_peered":"2024-05-10T11:14:59.411988+0000","last_clean":"2024-05-10T11:14:59.411988+0000","last_became_active":"2024-05-10T11:14:57.283807+0000","last_became_peered":"2024-05-10T11:14:57.283807+0000","last_unstale":"2024-05-10T11:14:59.411988+0000","last_undegraded":"2024-05-10T11:14:59.411988+0000","last_fullsized":"2024-05-10T11:14:59.411988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:01.976954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413811+0000","last_change":"2024-05-10T11:14:58.291184+0000","last_active":"2024-05-10T11:14:59.413811+0000","last_peered":"2024-05-10T11:14:59.413811+0000","last_clean":"2024-05-10T11:14:59.413811+0000","last_became_active":"2024-05-10T11:14:58.290918+0000","last_became_peered":"2024-05-10T11:14:58.290918+0000","last_unstale":"2024-05-10T11:14:59.413811+0000","last_undegraded":"2024-05-10T11:14:59.413811+0000","last_fullsized":"2024-05-10T11:14:59.413811+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:10.646032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412147+0000","last_change":"2024-05-10T11:14:57.278080+0000","last_active":"2024-05-10T11:14:59.412147+0000","last_peered":"2024-05-10T11:14:59.412147+0000","last_clean":"2024-05-10T11:14:59.412147+0000","last_became_active":"2024-05-10T11:14:57.277750+0000","last_became_peered":"2024-05-10T11:14:57.277750+0000","last_unstale":"2024-05-10T11:14:59.412147+0000","last_undegraded":"2024-05-10T11:14:59.412147+0000","last_fullsized":"2024-05-10T11:14:59.412147+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:51.210308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412107+0000","last_change":"2024-05-10T11:14:58.290201+0000","last_active":"2024-05-10T11:14:59.412107+0000","last_peered":"2024-05-10T11:14:59.412107+0000","last_clean":"2024-05-10T11:14:59.412107+0000","last_became_active":"2024-05-10T11:14:58.289926+0000","last_became_peered":"2024-05-10T11:14:58.289926+0000","last_unstale":"2024-05-10T11:14:59.412107+0000","last_undegraded":"2024-05-10T11:14:59.412107+0000","last_fullsized":"2024-05-10T11:14:59.412107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412174+0000","last_change":"2024-05-10T11:14:57.278386+0000","last_active":"2024-05-10T11:14:59.412174+0000","last_peered":"2024-05-10T11:14:59.412174+0000","last_clean":"2024-05-10T11:14:59.412174+0000","last_became_active":"2024-05-10T11:14:57.278063+0000","last_became_peered":"2024-05-10T11:14:57.278063+0000","last_unstale":"2024-05-10T11:14:59.412174+0000","last_undegraded":"2024-05-10T11:14:59.412174+0000","last_fullsized":"2024-05-10T11:14:59.412174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.826064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413272+0000","last_change":"2024-05-10T11:14:58.296717+0000","last_active":"2024-05-10T11:14:59.413272+0000","last_peered":"2024-05-10T11:14:59.413272+0000","last_clean":"2024-05-10T11:14:59.413272+0000","last_became_active":"2024-05-10T11:14:58.296326+0000","last_became_peered":"2024-05-10T11:14:58.296326+0000","last_unstale":"2024-05-10T11:14:59.413272+0000","last_undegraded":"2024-05-10T11:14:59.413272+0000","last_fullsized":"2024-05-10T11:14:59.413272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:17.847789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412194+0000","last_change":"2024-05-10T11:14:57.284933+0000","last_active":"2024-05-10T11:14:59.412194+0000","last_peered":"2024-05-10T11:14:59.412194+0000","last_clean":"2024-05-10T11:14:59.412194+0000","last_became_active":"2024-05-10T11:14:57.284634+0000","last_became_peered":"2024-05-10T11:14:57.284634+0000","last_unstale":"2024-05-10T11:14:59.412194+0000","last_undegraded":"2024-05-10T11:14:59.412194+0000","last_fullsized":"2024-05-10T11:14:59.412194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:24:13.908401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299497+0000","last_change":"2024-05-10T11:14:58.290166+0000","last_active":"2024-05-10T11:14:59.299497+0000","last_peered":"2024-05-10T11:14:59.299497+0000","last_clean":"2024-05-10T11:14:59.299497+0000","last_became_active":"2024-05-10T11:14:58.289670+0000","last_became_peered":"2024-05-10T11:14:58.289670+0000","last_unstale":"2024-05-10T11:14:59.299497+0000","last_undegraded":"2024-05-10T11:14:59.299497+0000","last_fullsized":"2024-05-10T11:14:59.299497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:21.026213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288231+0000","last_change":"2024-05-10T11:14:57.282928+0000","last_active":"2024-05-10T11:14:59.288231+0000","last_peered":"2024-05-10T11:14:59.288231+0000","last_clean":"2024-05-10T11:14:59.288231+0000","last_became_active":"2024-05-10T11:14:57.282648+0000","last_became_peered":"2024-05-10T11:14:57.282648+0000","last_unstale":"2024-05-10T11:14:59.288231+0000","last_undegraded":"2024-05-10T11:14:59.288231+0000","last_fullsized":"2024-05-10T11:14:59.288231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:37.941170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411486+0000","last_change":"2024-05-10T11:14:58.297126+0000","last_active":"2024-05-10T11:14:59.411486+0000","last_peered":"2024-05-10T11:14:59.411486+0000","last_clean":"2024-05-10T11:14:59.411486+0000","last_became_active":"2024-05-10T11:14:58.296806+0000","last_became_peered":"2024-05-10T11:14:58.296806+0000","last_unstale":"2024-05-10T11:14:59.411486+0000","last_undegraded":"2024-05-10T11:14:59.411486+0000","last_fullsized":"2024-05-10T11:14:59.411486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:55.143332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287922+0000","last_change":"2024-05-10T11:14:57.281848+0000","last_active":"2024-05-10T11:14:59.287922+0000","last_peered":"2024-05-10T11:14:59.287922+0000","last_clean":"2024-05-10T11:14:59.287922+0000","last_became_active":"2024-05-10T11:14:57.281514+0000","last_became_peered":"2024-05-10T11:14:57.281514+0000","last_unstale":"2024-05-10T11:14:59.287922+0000","last_undegraded":"2024-05-10T11:14:59.287922+0000","last_fullsized":"2024-05-10T11:14:59.287922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:24:13.908401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411967+0000","last_change":"2024-05-10T11:14:58.301360+0000","last_active":"2024-05-10T11:14:59.411967+0000","last_peered":"2024-05-10T11:14:59.411967+0000","last_clean":"2024-05-10T11:14:59.411967+0000","last_became_active":"2024-05-10T11:14:58.301013+0000","last_became_peered":"2024-05-10T11:14:58.301013+0000","last_unstale":"2024-05-10T11:14:59.411967+0000","last_undegraded":"2024-05-10T11:14:59.411967+0000","last_fullsized":"2024-05-10T11:14:59.411967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:04:33.945652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287935+0000","last_change":"2024-05-10T11:14:57.284239+0000","last_active":"2024-05-10T11:14:59.287935+0000","last_peered":"2024-05-10T11:14:59.287935+0000","last_clean":"2024-05-10T11:14:59.287935+0000","last_became_active":"2024-05-10T11:14:57.283872+0000","last_became_peered":"2024-05-10T11:14:57.283872+0000","last_unstale":"2024-05-10T11:14:59.287935+0000","last_undegraded":"2024-05-10T11:14:59.287935+0000","last_fullsized":"2024-05-10T11:14:59.287935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:23.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288181+0000","last_change":"2024-05-10T11:14:58.293106+0000","last_active":"2024-05-10T11:14:59.288181+0000","last_peered":"2024-05-10T11:14:59.288181+0000","last_clean":"2024-05-10T11:14:59.288181+0000","last_became_active":"2024-05-10T11:14:58.292708+0000","last_became_peered":"2024-05-10T11:14:58.292708+0000","last_unstale":"2024-05-10T11:14:59.288181+0000","last_undegraded":"2024-05-10T11:14:59.288181+0000","last_fullsized":"2024-05-10T11:14:59.288181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:21:32.657479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411927+0000","last_change":"2024-05-10T11:14:57.283820+0000","last_active":"2024-05-10T11:14:59.411927+0000","last_peered":"2024-05-10T11:14:59.411927+0000","last_clean":"2024-05-10T11:14:59.411927+0000","last_became_active":"2024-05-10T11:14:57.283489+0000","last_became_peered":"2024-05-10T11:14:57.283489+0000","last_unstale":"2024-05-10T11:14:59.411927+0000","last_undegraded":"2024-05-10T11:14:59.411927+0000","last_fullsized":"2024-05-10T11:14:59.411927+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.244441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411846+0000","last_change":"2024-05-10T11:14:58.288434+0000","last_active":"2024-05-10T11:14:59.411846+0000","last_peered":"2024-05-10T11:14:59.411846+0000","last_clean":"2024-05-10T11:14:59.411846+0000","last_became_active":"2024-05-10T11:14:58.288154+0000","last_became_peered":"2024-05-10T11:14:58.288154+0000","last_unstale":"2024-05-10T11:14:59.411846+0000","last_undegraded":"2024-05-10T11:14:59.411846+0000","last_fullsized":"2024-05-10T11:14:59.411846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:27:24.962755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413614+0000","last_change":"2024-05-10T11:14:57.285058+0000","last_active":"2024-05-10T11:14:59.413614+0000","last_peered":"2024-05-10T11:14:59.413614+0000","last_clean":"2024-05-10T11:14:59.413614+0000","last_became_active":"2024-05-10T11:14:57.284745+0000","last_became_peered":"2024-05-10T11:14:57.284745+0000","last_unstale":"2024-05-10T11:14:59.413614+0000","last_undegraded":"2024-05-10T11:14:59.413614+0000","last_fullsized":"2024-05-10T11:14:59.413614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:26.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288196+0000","last_change":"2024-05-10T11:14:58.295803+0000","last_active":"2024-05-10T11:14:59.288196+0000","last_peered":"2024-05-10T11:14:59.288196+0000","last_clean":"2024-05-10T11:14:59.288196+0000","last_became_active":"2024-05-10T11:14:58.295501+0000","last_became_peered":"2024-05-10T11:14:58.295501+0000","last_unstale":"2024-05-10T11:14:59.288196+0000","last_undegraded":"2024-05-10T11:14:59.288196+0000","last_fullsized":"2024-05-10T11:14:59.288196+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:44:18.165904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412685+0000","last_change":"2024-05-10T11:14:57.285480+0000","last_active":"2024-05-10T11:14:59.412685+0000","last_peered":"2024-05-10T11:14:59.412685+0000","last_clean":"2024-05-10T11:14:59.412685+0000","last_became_active":"2024-05-10T11:14:57.284658+0000","last_became_peered":"2024-05-10T11:14:57.284658+0000","last_unstale":"2024-05-10T11:14:59.412685+0000","last_undegraded":"2024-05-10T11:14:59.412685+0000","last_fullsized":"2024-05-10T11:14:59.412685+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:50.772681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412895+0000","last_change":"2024-05-10T11:14:58.293724+0000","last_active":"2024-05-10T11:14:59.412895+0000","last_peered":"2024-05-10T11:14:59.412895+0000","last_clean":"2024-05-10T11:14:59.412895+0000","last_became_active":"2024-05-10T11:14:58.293401+0000","last_became_peered":"2024-05-10T11:14:58.293401+0000","last_unstale":"2024-05-10T11:14:59.412895+0000","last_undegraded":"2024-05-10T11:14:59.412895+0000","last_fullsized":"2024-05-10T11:14:59.412895+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:37.026710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412736+0000","last_change":"2024-05-10T11:14:57.285078+0000","last_active":"2024-05-10T11:14:59.412736+0000","last_peered":"2024-05-10T11:14:59.412736+0000","last_clean":"2024-05-10T11:14:59.412736+0000","last_became_active":"2024-05-10T11:14:57.284761+0000","last_became_peered":"2024-05-10T11:14:57.284761+0000","last_unstale":"2024-05-10T11:14:59.412736+0000","last_undegraded":"2024-05-10T11:14:59.412736+0000","last_fullsized":"2024-05-10T11:14:59.412736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:06:59.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413669+0000","last_change":"2024-05-10T11:14:58.293097+0000","last_active":"2024-05-10T11:14:59.413669+0000","last_peered":"2024-05-10T11:14:59.413669+0000","last_clean":"2024-05-10T11:14:59.413669+0000","last_became_active":"2024-05-10T11:14:58.292833+0000","last_became_peered":"2024-05-10T11:14:58.292833+0000","last_unstale":"2024-05-10T11:14:59.413669+0000","last_undegraded":"2024-05-10T11:14:59.413669+0000","last_fullsized":"2024-05-10T11:14:59.413669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:27.043048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411945+0000","last_change":"2024-05-10T11:14:57.283470+0000","last_active":"2024-05-10T11:14:59.411945+0000","last_peered":"2024-05-10T11:14:59.411945+0000","last_clean":"2024-05-10T11:14:59.411945+0000","last_became_active":"2024-05-10T11:14:57.283190+0000","last_became_peered":"2024-05-10T11:14:57.283190+0000","last_unstale":"2024-05-10T11:14:59.411945+0000","last_undegraded":"2024-05-10T11:14:59.411945+0000","last_fullsized":"2024-05-10T11:14:59.411945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:58.822085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412043+0000","last_change":"2024-05-10T11:14:58.302029+0000","last_active":"2024-05-10T11:14:59.412043+0000","last_peered":"2024-05-10T11:14:59.412043+0000","last_clean":"2024-05-10T11:14:59.412043+0000","last_became_active":"2024-05-10T11:14:58.301749+0000","last_became_peered":"2024-05-10T11:14:58.301749+0000","last_unstale":"2024-05-10T11:14:59.412043+0000","last_undegraded":"2024-05-10T11:14:59.412043+0000","last_fullsized":"2024-05-10T11:14:59.412043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:29.273264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413298+0000","last_change":"2024-05-10T11:14:57.288628+0000","last_active":"2024-05-10T11:14:59.413298+0000","last_peered":"2024-05-10T11:14:59.413298+0000","last_clean":"2024-05-10T11:14:59.413298+0000","last_became_active":"2024-05-10T11:14:57.288267+0000","last_became_peered":"2024-05-10T11:14:57.288267+0000","last_unstale":"2024-05-10T11:14:59.413298+0000","last_undegraded":"2024-05-10T11:14:59.413298+0000","last_fullsized":"2024-05-10T11:14:59.413298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:52.106425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293396+0000","last_change":"2024-05-10T11:14:58.292318+0000","last_active":"2024-05-10T11:14:59.293396+0000","last_peered":"2024-05-10T11:14:59.293396+0000","last_clean":"2024-05-10T11:14:59.293396+0000","last_became_active":"2024-05-10T11:14:58.292027+0000","last_became_peered":"2024-05-10T11:14:58.292027+0000","last_unstale":"2024-05-10T11:14:59.293396+0000","last_undegraded":"2024-05-10T11:14:59.293396+0000","last_fullsized":"2024-05-10T11:14:59.293396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:52.214989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293493+0000","last_change":"2024-05-10T11:14:57.285459+0000","last_active":"2024-05-10T11:14:59.293493+0000","last_peered":"2024-05-10T11:14:59.293493+0000","last_clean":"2024-05-10T11:14:59.293493+0000","last_became_active":"2024-05-10T11:14:57.285146+0000","last_became_peered":"2024-05-10T11:14:57.285146+0000","last_unstale":"2024-05-10T11:14:59.293493+0000","last_undegraded":"2024-05-10T11:14:59.293493+0000","last_fullsized":"2024-05-10T11:14:59.293493+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:54.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412118+0000","last_change":"2024-05-10T11:14:58.290578+0000","last_active":"2024-05-10T11:14:59.412118+0000","last_peered":"2024-05-10T11:14:59.412118+0000","last_clean":"2024-05-10T11:14:59.412118+0000","last_became_active":"2024-05-10T11:14:58.290298+0000","last_became_peered":"2024-05-10T11:14:58.290298+0000","last_unstale":"2024-05-10T11:14:59.412118+0000","last_undegraded":"2024-05-10T11:14:59.412118+0000","last_fullsized":"2024-05-10T11:14:59.412118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:22.006404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413280+0000","last_change":"2024-05-10T11:14:57.288627+0000","last_active":"2024-05-10T11:14:59.413280+0000","last_peered":"2024-05-10T11:14:59.413280+0000","last_clean":"2024-05-10T11:14:59.413280+0000","last_became_active":"2024-05-10T11:14:57.288307+0000","last_became_peered":"2024-05-10T11:14:57.288307+0000","last_unstale":"2024-05-10T11:14:59.413280+0000","last_undegraded":"2024-05-10T11:14:59.413280+0000","last_fullsized":"2024-05-10T11:14:59.413280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:36.022029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411686+0000","last_change":"2024-05-10T11:14:58.303641+0000","last_active":"2024-05-10T11:14:59.411686+0000","last_peered":"2024-05-10T11:14:59.411686+0000","last_clean":"2024-05-10T11:14:59.411686+0000","last_became_active":"2024-05-10T11:14:58.303277+0000","last_became_peered":"2024-05-10T11:14:58.303277+0000","last_unstale":"2024-05-10T11:14:59.411686+0000","last_undegraded":"2024-05-10T11:14:59.411686+0000","last_fullsized":"2024-05-10T11:14:59.411686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:27.403510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412176+0000","last_change":"2024-05-10T11:14:57.278123+0000","last_active":"2024-05-10T11:14:59.412176+0000","last_peered":"2024-05-10T11:14:59.412176+0000","last_clean":"2024-05-10T11:14:59.412176+0000","last_became_active":"2024-05-10T11:14:57.277822+0000","last_became_peered":"2024-05-10T11:14:57.277822+0000","last_unstale":"2024-05-10T11:14:59.412176+0000","last_undegraded":"2024-05-10T11:14:59.412176+0000","last_fullsized":"2024-05-10T11:14:59.412176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:57.287132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413037+0000","last_change":"2024-05-10T11:14:58.303477+0000","last_active":"2024-05-10T11:14:59.413037+0000","last_peered":"2024-05-10T11:14:59.413037+0000","last_clean":"2024-05-10T11:14:59.413037+0000","last_became_active":"2024-05-10T11:14:58.303122+0000","last_became_peered":"2024-05-10T11:14:58.303122+0000","last_unstale":"2024-05-10T11:14:59.413037+0000","last_undegraded":"2024-05-10T11:14:59.413037+0000","last_fullsized":"2024-05-10T11:14:59.413037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:02.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293870+0000","last_change":"2024-05-10T11:14:57.281686+0000","last_active":"2024-05-10T11:14:59.293870+0000","last_peered":"2024-05-10T11:14:59.293870+0000","last_clean":"2024-05-10T11:14:59.293870+0000","last_became_active":"2024-05-10T11:14:57.281376+0000","last_became_peered":"2024-05-10T11:14:57.281376+0000","last_unstale":"2024-05-10T11:14:59.293870+0000","last_undegraded":"2024-05-10T11:14:59.293870+0000","last_fullsized":"2024-05-10T11:14:59.293870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:26.398829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412788+0000","last_change":"2024-05-10T11:14:58.301783+0000","last_active":"2024-05-10T11:14:59.412788+0000","last_peered":"2024-05-10T11:14:59.412788+0000","last_clean":"2024-05-10T11:14:59.412788+0000","last_became_active":"2024-05-10T11:14:58.301333+0000","last_became_peered":"2024-05-10T11:14:58.301333+0000","last_unstale":"2024-05-10T11:14:59.412788+0000","last_undegraded":"2024-05-10T11:14:59.412788+0000","last_fullsized":"2024-05-10T11:14:59.412788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:57.326586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413310+0000","last_change":"2024-05-10T11:14:57.291311+0000","last_active":"2024-05-10T11:14:59.413310+0000","last_peered":"2024-05-10T11:14:59.413310+0000","last_clean":"2024-05-10T11:14:59.413310+0000","last_became_active":"2024-05-10T11:14:57.291046+0000","last_became_peered":"2024-05-10T11:14:57.291046+0000","last_unstale":"2024-05-10T11:14:59.413310+0000","last_undegraded":"2024-05-10T11:14:59.413310+0000","last_fullsized":"2024-05-10T11:14:59.413310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:09.641351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412581+0000","last_change":"2024-05-10T11:14:58.294613+0000","last_active":"2024-05-10T11:14:59.412581+0000","last_peered":"2024-05-10T11:14:59.412581+0000","last_clean":"2024-05-10T11:14:59.412581+0000","last_became_active":"2024-05-10T11:14:58.291580+0000","last_became_peered":"2024-05-10T11:14:58.291580+0000","last_unstale":"2024-05-10T11:14:59.412581+0000","last_undegraded":"2024-05-10T11:14:59.412581+0000","last_fullsized":"2024-05-10T11:14:59.412581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:22.006404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412870+0000","last_change":"2024-05-10T11:14:57.286479+0000","last_active":"2024-05-10T11:14:59.412870+0000","last_peered":"2024-05-10T11:14:59.412870+0000","last_clean":"2024-05-10T11:14:59.412870+0000","last_became_active":"2024-05-10T11:14:57.286168+0000","last_became_peered":"2024-05-10T11:14:57.286168+0000","last_unstale":"2024-05-10T11:14:59.412870+0000","last_undegraded":"2024-05-10T11:14:59.412870+0000","last_fullsized":"2024-05-10T11:14:59.412870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:50.752141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412576+0000","last_change":"2024-05-10T11:14:58.291617+0000","last_active":"2024-05-10T11:14:59.412576+0000","last_peered":"2024-05-10T11:14:59.412576+0000","last_clean":"2024-05-10T11:14:59.412576+0000","last_became_active":"2024-05-10T11:14:58.291313+0000","last_became_peered":"2024-05-10T11:14:58.291313+0000","last_unstale":"2024-05-10T11:14:59.412576+0000","last_undegraded":"2024-05-10T11:14:59.412576+0000","last_fullsized":"2024-05-10T11:14:59.412576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:10.646032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288145+0000","last_change":"2024-05-10T11:14:57.280903+0000","last_active":"2024-05-10T11:14:59.288145+0000","last_peered":"2024-05-10T11:14:59.288145+0000","last_clean":"2024-05-10T11:14:59.288145+0000","last_became_active":"2024-05-10T11:14:57.280595+0000","last_became_peered":"2024-05-10T11:14:57.280595+0000","last_unstale":"2024-05-10T11:14:59.288145+0000","last_undegraded":"2024-05-10T11:14:59.288145+0000","last_fullsized":"2024-05-10T11:14:59.288145+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:26.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411820+0000","last_change":"2024-05-10T11:14:58.291334+0000","last_active":"2024-05-10T11:14:59.411820+0000","last_peered":"2024-05-10T11:14:59.411820+0000","last_clean":"2024-05-10T11:14:59.411820+0000","last_became_active":"2024-05-10T11:14:58.290873+0000","last_became_peered":"2024-05-10T11:14:58.290873+0000","last_unstale":"2024-05-10T11:14:59.411820+0000","last_undegraded":"2024-05-10T11:14:59.411820+0000","last_fullsized":"2024-05-10T11:14:59.411820+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:33.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412294+0000","last_change":"2024-05-10T11:14:57.285784+0000","last_active":"2024-05-10T11:14:59.412294+0000","last_peered":"2024-05-10T11:14:59.412294+0000","last_clean":"2024-05-10T11:14:59.412294+0000","last_became_active":"2024-05-10T11:14:57.285511+0000","last_became_peered":"2024-05-10T11:14:57.285511+0000","last_unstale":"2024-05-10T11:14:59.412294+0000","last_undegraded":"2024-05-10T11:14:59.412294+0000","last_fullsized":"2024-05-10T11:14:59.412294+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:39.777254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293402+0000","last_change":"2024-05-10T11:14:58.294900+0000","last_active":"2024-05-10T11:14:59.293402+0000","last_peered":"2024-05-10T11:14:59.293402+0000","last_clean":"2024-05-10T11:14:59.293402+0000","last_became_active":"2024-05-10T11:14:58.293875+0000","last_became_peered":"2024-05-10T11:14:58.293875+0000","last_unstale":"2024-05-10T11:14:59.293402+0000","last_undegraded":"2024-05-10T11:14:59.293402+0000","last_fullsized":"2024-05-10T11:14:59.293402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:35.553377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293556+0000","last_change":"2024-05-10T11:14:57.281997+0000","last_active":"2024-05-10T11:14:59.293556+0000","last_peered":"2024-05-10T11:14:59.293556+0000","last_clean":"2024-05-10T11:14:59.293556+0000","last_became_active":"2024-05-10T11:14:57.281468+0000","last_became_peered":"2024-05-10T11:14:57.281468+0000","last_unstale":"2024-05-10T11:14:59.293556+0000","last_undegraded":"2024-05-10T11:14:59.293556+0000","last_fullsized":"2024-05-10T11:14:59.293556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:08.557076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412255+0000","last_change":"2024-05-10T11:14:58.292189+0000","last_active":"2024-05-10T11:14:59.412255+0000","last_peered":"2024-05-10T11:14:59.412255+0000","last_clean":"2024-05-10T11:14:59.412255+0000","last_became_active":"2024-05-10T11:14:58.291853+0000","last_became_peered":"2024-05-10T11:14:58.291853+0000","last_unstale":"2024-05-10T11:14:59.412255+0000","last_undegraded":"2024-05-10T11:14:59.412255+0000","last_fullsized":"2024-05-10T11:14:59.412255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:54.290626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411923+0000","last_change":"2024-05-10T11:14:57.286677+0000","last_active":"2024-05-10T11:14:59.411923+0000","last_peered":"2024-05-10T11:14:59.411923+0000","last_clean":"2024-05-10T11:14:59.411923+0000","last_became_active":"2024-05-10T11:14:57.286392+0000","last_became_peered":"2024-05-10T11:14:57.286392+0000","last_unstale":"2024-05-10T11:14:59.411923+0000","last_undegraded":"2024-05-10T11:14:59.411923+0000","last_fullsized":"2024-05-10T11:14:59.411923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:34.548696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412227+0000","last_change":"2024-05-10T11:14:58.297756+0000","last_active":"2024-05-10T11:14:59.412227+0000","last_peered":"2024-05-10T11:14:59.412227+0000","last_clean":"2024-05-10T11:14:59.412227+0000","last_became_active":"2024-05-10T11:14:58.297477+0000","last_became_peered":"2024-05-10T11:14:58.297477+0000","last_unstale":"2024-05-10T11:14:59.412227+0000","last_undegraded":"2024-05-10T11:14:59.412227+0000","last_fullsized":"2024-05-10T11:14:59.412227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:18.792791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.294020+0000","last_change":"2024-05-10T11:14:57.283832+0000","last_active":"2024-05-10T11:14:59.294020+0000","last_peered":"2024-05-10T11:14:59.294020+0000","last_clean":"2024-05-10T11:14:59.294020+0000","last_became_active":"2024-05-10T11:14:57.283428+0000","last_became_peered":"2024-05-10T11:14:57.283428+0000","last_unstale":"2024-05-10T11:14:59.294020+0000","last_undegraded":"2024-05-10T11:14:59.294020+0000","last_fullsized":"2024-05-10T11:14:59.294020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:39.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299477+0000","last_change":"2024-05-10T11:14:58.289925+0000","last_active":"2024-05-10T11:14:59.299477+0000","last_peered":"2024-05-10T11:14:59.299477+0000","last_clean":"2024-05-10T11:14:59.299477+0000","last_became_active":"2024-05-10T11:14:58.289633+0000","last_became_peered":"2024-05-10T11:14:58.289633+0000","last_unstale":"2024-05-10T11:14:59.299477+0000","last_undegraded":"2024-05-10T11:14:59.299477+0000","last_fullsized":"2024-05-10T11:14:59.299477+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:38.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293984+0000","last_change":"2024-05-10T11:14:57.282035+0000","last_active":"2024-05-10T11:14:59.293984+0000","last_peered":"2024-05-10T11:14:59.293984+0000","last_clean":"2024-05-10T11:14:59.293984+0000","last_became_active":"2024-05-10T11:14:57.281774+0000","last_became_peered":"2024-05-10T11:14:57.281774+0000","last_unstale":"2024-05-10T11:14:59.293984+0000","last_undegraded":"2024-05-10T11:14:59.293984+0000","last_fullsized":"2024-05-10T11:14:59.293984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:13.792438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.293942+0000","last_change":"2024-05-10T11:14:58.296279+0000","last_active":"2024-05-10T11:14:59.293942+0000","last_peered":"2024-05-10T11:14:59.293942+0000","last_clean":"2024-05-10T11:14:59.293942+0000","last_became_active":"2024-05-10T11:14:58.296001+0000","last_became_peered":"2024-05-10T11:14:58.296001+0000","last_unstale":"2024-05-10T11:14:59.293942+0000","last_undegraded":"2024-05-10T11:14:59.293942+0000","last_fullsized":"2024-05-10T11:14:59.293942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:17.331721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412224+0000","last_change":"2024-05-10T11:14:57.277996+0000","last_active":"2024-05-10T11:14:59.412224+0000","last_peered":"2024-05-10T11:14:59.412224+0000","last_clean":"2024-05-10T11:14:59.412224+0000","last_became_active":"2024-05-10T11:14:57.277696+0000","last_became_peered":"2024-05-10T11:14:57.277696+0000","last_unstale":"2024-05-10T11:14:59.412224+0000","last_undegraded":"2024-05-10T11:14:59.412224+0000","last_fullsized":"2024-05-10T11:14:59.412224+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:08.450607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412752+0000","last_change":"2024-05-10T11:14:58.292302+0000","last_active":"2024-05-10T11:14:59.412752+0000","last_peered":"2024-05-10T11:14:59.412752+0000","last_clean":"2024-05-10T11:14:59.412752+0000","last_became_active":"2024-05-10T11:14:58.292014+0000","last_became_peered":"2024-05-10T11:14:58.292014+0000","last_unstale":"2024-05-10T11:14:59.412752+0000","last_undegraded":"2024-05-10T11:14:59.412752+0000","last_fullsized":"2024-05-10T11:14:59.412752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:53.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411964+0000","last_change":"2024-05-10T11:14:57.281319+0000","last_active":"2024-05-10T11:14:59.411964+0000","last_peered":"2024-05-10T11:14:59.411964+0000","last_clean":"2024-05-10T11:14:59.411964+0000","last_became_active":"2024-05-10T11:14:57.281041+0000","last_became_peered":"2024-05-10T11:14:57.281041+0000","last_unstale":"2024-05-10T11:14:59.411964+0000","last_undegraded":"2024-05-10T11:14:59.411964+0000","last_fullsized":"2024-05-10T11:14:59.411964+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:54.982213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411909+0000","last_change":"2024-05-10T11:14:58.299193+0000","last_active":"2024-05-10T11:14:59.411909+0000","last_peered":"2024-05-10T11:14:59.411909+0000","last_clean":"2024-05-10T11:14:59.411909+0000","last_became_active":"2024-05-10T11:14:58.293535+0000","last_became_peered":"2024-05-10T11:14:58.293535+0000","last_unstale":"2024-05-10T11:14:59.411909+0000","last_undegraded":"2024-05-10T11:14:59.411909+0000","last_fullsized":"2024-05-10T11:14:59.411909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:43.202523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413416+0000","last_change":"2024-05-10T11:14:57.288619+0000","last_active":"2024-05-10T11:14:59.413416+0000","last_peered":"2024-05-10T11:14:59.413416+0000","last_clean":"2024-05-10T11:14:59.413416+0000","last_became_active":"2024-05-10T11:14:57.288345+0000","last_became_peered":"2024-05-10T11:14:57.288345+0000","last_unstale":"2024-05-10T11:14:59.413416+0000","last_undegraded":"2024-05-10T11:14:59.413416+0000","last_fullsized":"2024-05-10T11:14:59.413416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:56.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412579+0000","last_change":"2024-05-10T11:14:58.307212+0000","last_active":"2024-05-10T11:14:59.412579+0000","last_peered":"2024-05-10T11:14:59.412579+0000","last_clean":"2024-05-10T11:14:59.412579+0000","last_became_active":"2024-05-10T11:14:58.306894+0000","last_became_peered":"2024-05-10T11:14:58.306894+0000","last_unstale":"2024-05-10T11:14:59.412579+0000","last_undegraded":"2024-05-10T11:14:59.412579+0000","last_fullsized":"2024-05-10T11:14:59.412579+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:48.994765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288108+0000","last_change":"2024-05-10T11:14:57.285145+0000","last_active":"2024-05-10T11:14:59.288108+0000","last_peered":"2024-05-10T11:14:59.288108+0000","last_clean":"2024-05-10T11:14:59.288108+0000","last_became_active":"2024-05-10T11:14:57.284872+0000","last_became_peered":"2024-05-10T11:14:57.284872+0000","last_unstale":"2024-05-10T11:14:59.288108+0000","last_undegraded":"2024-05-10T11:14:59.288108+0000","last_fullsized":"2024-05-10T11:14:59.288108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:34.548696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411550+0000","last_change":"2024-05-10T11:14:58.300595+0000","last_active":"2024-05-10T11:14:59.411550+0000","last_peered":"2024-05-10T11:14:59.411550+0000","last_clean":"2024-05-10T11:14:59.411550+0000","last_became_active":"2024-05-10T11:14:58.300322+0000","last_became_peered":"2024-05-10T11:14:58.300322+0000","last_unstale":"2024-05-10T11:14:59.411550+0000","last_undegraded":"2024-05-10T11:14:59.411550+0000","last_fullsized":"2024-05-10T11:14:59.411550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:09.561757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.288038+0000","last_change":"2024-05-10T11:14:57.284501+0000","last_active":"2024-05-10T11:14:59.288038+0000","last_peered":"2024-05-10T11:14:59.288038+0000","last_clean":"2024-05-10T11:14:59.288038+0000","last_became_active":"2024-05-10T11:14:57.283858+0000","last_became_peered":"2024-05-10T11:14:57.283858+0000","last_unstale":"2024-05-10T11:14:59.288038+0000","last_undegraded":"2024-05-10T11:14:59.288038+0000","last_fullsized":"2024-05-10T11:14:59.288038+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:51.210308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.299487+0000","last_change":"2024-05-10T11:14:58.296316+0000","last_active":"2024-05-10T11:14:59.299487+0000","last_peered":"2024-05-10T11:14:59.299487+0000","last_clean":"2024-05-10T11:14:59.299487+0000","last_became_active":"2024-05-10T11:14:58.295787+0000","last_became_peered":"2024-05-10T11:14:58.295787+0000","last_unstale":"2024-05-10T11:14:59.299487+0000","last_undegraded":"2024-05-10T11:14:59.299487+0000","last_fullsized":"2024-05-10T11:14:59.299487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:37.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.411457+0000","last_change":"2024-05-10T11:14:57.284893+0000","last_active":"2024-05-10T11:14:59.411457+0000","last_peered":"2024-05-10T11:14:59.411457+0000","last_clean":"2024-05-10T11:14:59.411457+0000","last_became_active":"2024-05-10T11:14:57.284424+0000","last_became_peered":"2024-05-10T11:14:57.284424+0000","last_unstale":"2024-05-10T11:14:59.411457+0000","last_undegraded":"2024-05-10T11:14:59.411457+0000","last_fullsized":"2024-05-10T11:14:59.411457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:31.485594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.412339+0000","last_change":"2024-05-10T11:14:58.293110+0000","last_active":"2024-05-10T11:14:59.412339+0000","last_peered":"2024-05-10T11:14:59.412339+0000","last_clean":"2024-05-10T11:14:59.412339+0000","last_became_active":"2024-05-10T11:14:58.292854+0000","last_became_peered":"2024-05-10T11:14:58.292854+0000","last_unstale":"2024-05-10T11:14:59.412339+0000","last_undegraded":"2024-05-10T11:14:59.412339+0000","last_fullsized":"2024-05-10T11:14:59.412339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:57.261994+0000","last_clean_scrub_stamp":"2024-05-10T11:14:57.261994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:27.043048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.287869+0000","last_change":"2024-05-10T11:14:57.282272+0000","last_active":"2024-05-10T11:14:59.287869+0000","last_peered":"2024-05-10T11:14:59.287869+0000","last_clean":"2024-05-10T11:14:59.287869+0000","last_became_active":"2024-05-10T11:14:57.281986+0000","last_became_peered":"2024-05-10T11:14:57.281986+0000","last_unstale":"2024-05-10T11:14:59.287869+0000","last_undegraded":"2024-05-10T11:14:59.287869+0000","last_fullsized":"2024-05-10T11:14:59.287869+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:14:56.257313+0000","last_clean_scrub_stamp":"2024-05-10T11:14:56.257313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:08.450607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":186,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T11:14:59.413437+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:14:59.413437+0000","last_peered":"2024-05-10T11:14:59.413437+0000","last_clean":"2024-05-10T11:14:59.413437+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:14:59.413437+0000","last_undegraded":"2024-05-10T11:14:59.413437+0000","last_fullsized":"2024-05-10T11:14:59.413437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1351680,"data_stored":922707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":331597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":333175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":331563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":331563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":333939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1335296,"data_stored":921931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":331585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:15:07.158 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:15:07.159 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:15:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.305+0000 7f2384247640 1 Processor -- start 2024-05-10T11:15:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.305+0000 7f2384247640 1 -- start start 2024-05-10T11:15:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f2384247640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f237c162900 0x7f237c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f2384247640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c162ce0 0x7f237c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f2384247640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f237c0d4190 con 0x7f237c0d3950 2024-05-10T11:15:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f2384247640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f237c0cfc40 con 0x7f237c162900 2024-05-10T11:15:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f2384247640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f237c0d3eb0 con 0x7f237c162ce0 2024-05-10T11:15:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f2381fe3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f237c162900 0x7f237c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f23827e4640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f237c0d3950 0x7f237c0d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34844/0 (socket says 172.21.15.66:34844) 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f23827e4640 1 -- 172.21.15.66:0/3062149944 learned_addr learned my addr 172.21.15.66:0/3062149944 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.306+0000 7f23817e2640 1 --2- 172.21.15.66:0/3062149944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c162ce0 0x7f237c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.307+0000 7f2381fe3640 1 -- 172.21.15.66:0/3062149944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c162ce0 msgr2=0x7f237c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.307+0000 7f2381fe3640 1 --2- 172.21.15.66:0/3062149944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c162ce0 0x7f237c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.307+0000 7f2381fe3640 1 -- 172.21.15.66:0/3062149944 >> v1:172.21.15.66:6789/0 conn(0x7f237c0d3950 legacy=0x7f237c0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.307+0000 7f2381fe3640 1 -- 172.21.15.66:0/3062149944 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c0cfee0 con 0x7f237c162900 2024-05-10T11:15:07.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.307+0000 7f2381fe3640 1 --2- 172.21.15.66:0/3062149944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162900 0x7f237c0d3410 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f236c009d90 tx=0x7f236c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5add4a968123f6ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:07.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2380fe1640 1 -- 172.21.15.66:0/3062149944 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c031600 con 0x7f237c162900 2024-05-10T11:15:07.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2380fe1640 1 -- 172.21.15.66:0/3062149944 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c0317a0 con 0x7f237c162900 2024-05-10T11:15:07.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2380fe1640 1 -- 172.21.15.66:0/3062149944 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c031b70 con 0x7f237c162900 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 -- 172.21.15.66:0/3062149944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162900 msgr2=0x7f237c0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 --2- 172.21.15.66:0/3062149944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162900 0x7f237c0d3410 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f236c009d90 tx=0x7f236c02a5d0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 -- 172.21.15.66:0/3062149944 shutdown_connections 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 --2- 172.21.15.66:0/3062149944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c162ce0 0x7f237c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 --2- 172.21.15.66:0/3062149944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162900 0x7f237c0d3410 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 -- 172.21.15.66:0/3062149944 >> 172.21.15.66:0/3062149944 conn(0x7f237c09e430 msgr2=0x7f237c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 -- 172.21.15.66:0/3062149944 shutdown_connections 2024-05-10T11:15:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.308+0000 7f2384247640 1 -- 172.21.15.66:0/3062149944 wait complete. 2024-05-10T11:15:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 Processor -- start 2024-05-10T11:15:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 -- start start 2024-05-10T11:15:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c0d3950 0x7f237c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f237c162900 0x7f237c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 0x7f237c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f237c0b4300 con 0x7f237c162ce0 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f237c0b4180 con 0x7f237c162900 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f2384247640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f237c0d10d0 con 0x7f237c0d3950 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f23827e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 0x7f237c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.310+0000 7f23827e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 0x7f237c0b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34866/0 (socket says 172.21.15.66:34866) 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 -- 172.21.15.66:0/1099492347 learned_addr learned my addr 172.21.15.66:0/1099492347 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23817e2640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f237c162900 0x7f237c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f2381fe3640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c0d3950 0x7f237c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 -- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c0d3950 msgr2=0x7f237c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c0d3950 0x7f237c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 -- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f237c162900 msgr2=0x7f237c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f237c162900 0x7f237c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 -- 172.21.15.66:0/1099492347 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c0b47d0 con 0x7f237c162ce0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f23827e4640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 0x7f237c0b4f60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f237400c370 tx=0x7f237400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374017070 con 0x7f237c162ce0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374005ce0 con 0x7f237c162ce0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23740072d0 con 0x7f237c162ce0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c0cbab0 con 0x7f237c162ce0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.311+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c0ce500 con 0x7f237c162ce0 2024-05-10T11:15:07.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.312+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c06a220 con 0x7f237c162ce0 2024-05-10T11:15:07.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.313+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f237401a070 con 0x7f237c162ce0 2024-05-10T11:15:07.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.313+0000 7f237a7fc640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23680762d0 0x7f2368078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.313+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f23740968c0 con 0x7f237c162ce0 2024-05-10T11:15:07.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.314+0000 7f2381fe3640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23680762d0 0x7f2368078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.314+0000 7f2381fe3640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23680762d0 0x7f2368078790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f236c034000 tx=0x7f236c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.318+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f237c0d4190 con 0x7f237c162ce0 2024-05-10T11:15:07.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.583+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f237c160630 con 0x7f237c162ce0 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.586+0000 7f237a7fc640 1 -- 172.21.15.66:0/1099492347 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f237405fad0 con 0x7f237c162ce0 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:15:07.586 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:15:07.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23680762d0 msgr2=0x7f2368078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23680762d0 0x7f2368078790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f236c034000 tx=0x7f236c02f000 comp rx=0 tx=0).stop 2024-05-10T11:15:07.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 msgr2=0x7f237c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 0x7f237c0b4f60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f237400c370 tx=0x7f237400c830 comp rx=0 tx=0).stop 2024-05-10T11:15:07.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 shutdown_connections 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23680762d0 0x7f2368078790 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f237c162ce0 0x7f237c0b4f60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f237c162900 0x7f237c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 --2- 172.21.15.66:0/1099492347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f237c0d3950 0x7f237c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 >> 172.21.15.66:0/1099492347 conn(0x7f237c09e430 msgr2=0x7f237c1609f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 shutdown_connections 2024-05-10T11:15:07.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.588+0000 7f2384247640 1 -- 172.21.15.66:0/1099492347 wait complete. 2024-05-10T11:15:07.599 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:15:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.703+0000 7f2ccea2a640 1 Processor -- start 2024-05-10T11:15:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.703+0000 7f2ccea2a640 1 -- start start 2024-05-10T11:15:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2ccea2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc80d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2ccea2a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2cc80d5cb0 0x7f2cc80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2ccea2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc80b45f0 con 0x7f2cc8162b30 2024-05-10T11:15:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2ccea2a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc80b4f20 con 0x7f2cc80d5cb0 2024-05-10T11:15:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2ccea2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc80d0fe0 con 0x7f2cc8162750 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2cc77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2cc80d5cb0 0x7f2cc80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2cc77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2cc80d5cb0 0x7f2cc80d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34870/0 (socket says 172.21.15.66:34870) 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2cc77fe640 1 -- 172.21.15.66:0/393380047 learned_addr learned my addr 172.21.15.66:0/393380047 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.704+0000 7f2cc7fff640 1 --2- 172.21.15.66:0/393380047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc80d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.705+0000 7f2cc77fe640 1 -- 172.21.15.66:0/393380047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 msgr2=0x7f2cc80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.705+0000 7f2cc77fe640 1 --2- 172.21.15.66:0/393380047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc80d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.705+0000 7f2cc77fe640 1 -- 172.21.15.66:0/393380047 >> v1:172.21.15.190:6789/0 conn(0x7f2cc8162b30 legacy=0x7f2cc80d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.705+0000 7f2cc77fe640 1 -- 172.21.15.66:0/393380047 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc80b48d0 con 0x7f2cc80d5cb0 2024-05-10T11:15:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.705+0000 7f2cc77fe640 1 --2- 172.21.15.66:0/393380047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc80d5cb0 0x7f2cc80d3630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009870 tx=0x7f2cbc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ecebb0b11871db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2cc6ffd640 1 -- 172.21.15.66:0/393380047 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc037070 con 0x7f2cc80d5cb0 2024-05-10T11:15:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2cc6ffd640 1 -- 172.21.15.66:0/393380047 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc032440 con 0x7f2cc80d5cb0 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2cc6ffd640 1 -- 172.21.15.66:0/393380047 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc032810 con 0x7f2cc80d5cb0 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 -- 172.21.15.66:0/393380047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc80d5cb0 msgr2=0x7f2cc80d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/393380047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc80d5cb0 0x7f2cc80d3630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009870 tx=0x7f2cbc02a1c0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 -- 172.21.15.66:0/393380047 shutdown_connections 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/393380047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc80d5cb0 0x7f2cc80d3630 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/393380047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 -- 172.21.15.66:0/393380047 >> 172.21.15.66:0/393380047 conn(0x7f2cc809e3b0 msgr2=0x7f2cc80d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 -- 172.21.15.66:0/393380047 shutdown_connections 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.706+0000 7f2ccea2a640 1 -- 172.21.15.66:0/393380047 wait complete. 2024-05-10T11:15:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.707+0000 7f2ccea2a640 1 Processor -- start 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 -- start start 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc81f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 0x7f2cc80b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cc80ce9e0 0x7f2cc81f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc80d0d30 con 0x7f2cc8162b30 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc80d0bb0 con 0x7f2cc80ce9e0 2024-05-10T11:15:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2ccea2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc80b63c0 con 0x7f2cc8162750 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2cc77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 0x7f2cc80b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2cc77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 0x7f2cc80b9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34872/0 (socket says 172.21.15.66:34872) 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.708+0000 7f2cc77fe640 1 -- 172.21.15.66:0/2916464086 learned_addr learned my addr 172.21.15.66:0/2916464086 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc7fff640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc81f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cccfc7640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cc80ce9e0 0x7f2cc81f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc77fe640 1 -- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 msgr2=0x7f2cc81f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc77fe640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc81f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc77fe640 1 -- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cc80ce9e0 msgr2=0x7f2cc81f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc77fe640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cc80ce9e0 0x7f2cc81f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc77fe640 1 -- 172.21.15.66:0/2916464086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc80b8fb0 con 0x7f2cc8162b30 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc77fe640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 0x7f2cc80b9d70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc000c00 tx=0x7f2cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc041020 con 0x7f2cc8162b30 2024-05-10T11:15:07.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc0306c0 con 0x7f2cc8162b30 2024-05-10T11:15:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc80b9290 con 0x7f2cc8162b30 2024-05-10T11:15:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc037040 con 0x7f2cc8162b30 2024-05-10T11:15:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.709+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc80cef80 con 0x7f2cc8162b30 2024-05-10T11:15:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.710+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc806a220 con 0x7f2cc8162b30 2024-05-10T11:15:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.711+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2cbc044020 con 0x7f2cc8162b30 2024-05-10T11:15:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.711+0000 7f2cc4ff9640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2cb40762d0 0x7f2cb4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.711+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f2cbc0b7da0 con 0x7f2cc8162b30 2024-05-10T11:15:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.712+0000 7f2cc7fff640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2cb40762d0 0x7f2cb4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.712+0000 7f2cc7fff640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2cb40762d0 0x7f2cb4078790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8006fd0 tx=0x7f2cb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:07.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.716+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2cbc04b030 con 0x7f2cc8162b30 2024-05-10T11:15:07.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.947+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cc80d1690 con 0x7f2cc8162b30 2024-05-10T11:15:07.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.947+0000 7f2cc4ff9640 1 -- 172.21.15.66:0/2916464086 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5185 (secure 0 0 0) 0x7f2cbc080fb0 con 0x7f2cc8162b30 2024-05-10T11:15:07.948 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:07.948 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:00.666858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:15:07.948 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 34 2024-05-10T11:15:07.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2cb40762d0 msgr2=0x7f2cb4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2cb40762d0 0x7f2cb4078790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8006fd0 tx=0x7f2cb8008040 comp rx=0 tx=0).stop 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 msgr2=0x7f2cc80b9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 0x7f2cc80b9d70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc000c00 tx=0x7f2cbc0046c0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 shutdown_connections 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2cb40762d0 0x7f2cb4078790 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cc80ce9e0 0x7f2cc81f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc8162b30 0x7f2cc80b9d70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 --2- 172.21.15.66:0/2916464086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cc8162750 0x7f2cc81f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 >> 172.21.15.66:0/2916464086 conn(0x7f2cc809e3b0 msgr2=0x7f2cc806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 shutdown_connections 2024-05-10T11:15:07.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:07.950+0000 7f2ccea2a640 1 -- 172.21.15.66:0/2916464086 wait complete. 2024-05-10T11:15:08.364 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:14:57.646172+0000', 'modified': '2024-05-10T11:15:00.666858+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5754}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5754': {'gid': 5754, 'name': 'd', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.190:6837/2375668947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6835', 'nonce': 2375668947}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 2375668947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5754, 'qdb_cluster': [5754]} 2024-05-10T11:15:08.364 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:15:08.364 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-10T11:15:08.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.471+0000 7f0ef330a640 1 Processor -- start 2024-05-10T11:15:08.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.472+0000 7f0ef330a640 1 -- start start 2024-05-10T11:15:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.472+0000 7f0ef330a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0eec15f790 0x7f0eec0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.472+0000 7f0ef330a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.472+0000 7f0ef330a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eec0d30b0 con 0x7f0eec15f3b0 2024-05-10T11:15:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef330a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0eec0d3390 con 0x7f0eec15f790 2024-05-10T11:15:08.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef330a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec0c8c80 con 0x7f0eec0d5d30 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef08a5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0eec15f790 0x7f0eec0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef10a6640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0eec15f3b0 0x7f0eec0d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:36126/0 (socket says 172.21.15.66:36126) 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef10a6640 1 -- 172.21.15.66:0/2948285322 learned_addr learned my addr 172.21.15.66:0/2948285322 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef08a5640 1 -- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 msgr2=0x7f0eec0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef08a5640 1 -- 172.21.15.66:0/2948285322 >> v1:172.21.15.190:6789/0 conn(0x7f0eec15f3b0 legacy=0x7f0eec0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0edffff640 1 -- 172.21.15.66:0/2948285322 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795325359 0 0) 0x7f0eec0d30b0 con 0x7f0eec15f3b0 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef08a5640 1 -- 172.21.15.66:0/2948285322 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec0c8f60 con 0x7f0eec15f790 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.473+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.474+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f790 0x7f0eec0cfcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00097a0 tx=0x7f0ee002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbaf9f655f5875ac server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.474+0000 7f0edffff640 1 -- 172.21.15.66:0/2948285322 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0037070 con 0x7f0eec15f790 2024-05-10T11:15:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.474+0000 7f0edffff640 1 -- 172.21.15.66:0/2948285322 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee0032440 con 0x7f0eec15f790 2024-05-10T11:15:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.474+0000 7f0edffff640 1 -- 172.21.15.66:0/2948285322 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0032810 con 0x7f0eec15f790 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 -- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f790 msgr2=0x7f0eec0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 --2- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f790 0x7f0eec0cfcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00097a0 tx=0x7f0ee002a180 comp rx=0 tx=0).stop 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 -- 172.21.15.66:0/2948285322 shutdown_connections 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 --2- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 --2- 172.21.15.66:0/2948285322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f790 0x7f0eec0cfcd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 -- 172.21.15.66:0/2948285322 >> 172.21.15.66:0/2948285322 conn(0x7f0eec0d5130 msgr2=0x7f0eec0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 -- 172.21.15.66:0/2948285322 shutdown_connections 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.475+0000 7f0ef330a640 1 -- 172.21.15.66:0/2948285322 wait complete. 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.476+0000 7f0ef330a640 1 Processor -- start 2024-05-10T11:15:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.476+0000 7f0ef330a640 1 -- start start 2024-05-10T11:15:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef330a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef330a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f3b0 0x7f0eec0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef330a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 0x7f0eec14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef330a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0d3f80 con 0x7f0eec0b2860 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef330a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0d3e00 con 0x7f0eec15f3b0 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef330a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec0ca770 con 0x7f0eec0d5d30 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 0x7f0eec14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 0x7f0eec14d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34876/0 (socket says 172.21.15.66:34876) 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef18a7640 1 -- 172.21.15.66:0/3356543004 learned_addr learned my addr 172.21.15.66:0/3356543004 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.477+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f3b0 0x7f0eec0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef18a7640 1 -- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 msgr2=0x7f0eec0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef18a7640 1 -- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f3b0 msgr2=0x7f0eec0b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f3b0 0x7f0eec0b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef18a7640 1 -- 172.21.15.66:0/3356543004 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec0b3070 con 0x7f0eec0b2860 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 0x7f0eec14d420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009f00 tx=0x7f0ee400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0eddffb640 1 -- 172.21.15.66:0/3356543004 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4018030 con 0x7f0eec0b2860 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0eddffb640 1 -- 172.21.15.66:0/3356543004 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee400ce50 con 0x7f0eec0b2860 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec0b3350 con 0x7f0eec0b2860 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0eddffb640 1 -- 172.21.15.66:0/3356543004 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4003bb0 con 0x7f0eec0b2860 2024-05-10T11:15:08.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.478+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec0b3910 con 0x7f0eec0b2860 2024-05-10T11:15:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.480+0000 7f0eddffb640 1 -- 172.21.15.66:0/3356543004 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ee401b070 con 0x7f0eec0b2860 2024-05-10T11:15:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.481+0000 7f0eddffb640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ed00762d0 0x7f0ed0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.481+0000 7f0eddffb640 1 -- 172.21.15.66:0/3356543004 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0ee4098100 con 0x7f0eec0b2860 2024-05-10T11:15:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.481+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ed00762d0 0x7f0ed0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.481+0000 7f0ef6025740 1 Processor -- start 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.481+0000 7f0ef6025740 1 -- start start 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ed00762d0 0x7f0ed0078790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8000f60 tx=0x7f0ee8007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5304760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b5304ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 0x5569b52d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef6025740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5569b523e8d0 con 0x5569b52d4bb0 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569b51f7c10 con 0x5569b5301f50 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5569b523a890 con 0x5569b5302330 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 0x5569b52d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 0x5569b52d83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34878/0 (socket says 172.21.15.66:34878) 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef18a7640 1 -- 172.21.15.66:0/361634298 learned_addr learned my addr 172.21.15.66:0/361634298 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5304760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b5304ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.482+0000 7f0ef18a7640 1 -- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 msgr2=0x5569b5304ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b5304ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef18a7640 1 -- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 msgr2=0x5569b5304760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5304760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef18a7640 1 -- 172.21.15.66:0/361634298 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b51ff5d0 con 0x5569b52d4bb0 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b5304ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 0x5569b52d83c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0ee405d270 tx=0x7f0ee405d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0781bc778f1e05f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ed6ffd640 1 -- 172.21.15.66:0/361634298 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4069fa0 con 0x5569b52d4bb0 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ed6ffd640 1 -- 172.21.15.66:0/361634298 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40650b0 con 0x5569b52d4bb0 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ed6ffd640 1 -- 172.21.15.66:0/361634298 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4060450 con 0x5569b52d4bb0 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 -- 172.21.15.66:0/361634298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 msgr2=0x5569b52d83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 0x5569b52d83c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0ee405d270 tx=0x7f0ee405d970 comp rx=0 tx=0).stop 2024-05-10T11:15:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 -- 172.21.15.66:0/361634298 shutdown_connections 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b52d4bb0 0x5569b52d83c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b5304ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 --2- 172.21.15.66:0/361634298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5304760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.483+0000 7f0ef6025740 1 -- 172.21.15.66:0/361634298 >> 172.21.15.66:0/361634298 conn(0x5569b52d6e20 msgr2=0x5569b531f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.484+0000 7f0ef6025740 1 -- 172.21.15.66:0/361634298 shutdown_connections 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.484+0000 7f0ef6025740 1 -- 172.21.15.66:0/361634298 wait complete. 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.484+0000 7f0ef6025740 1 -- start start 2024-05-10T11:15:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.484+0000 7f0ef6025740 1 Processor -- start 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b5323510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5302330 0x5569b52fb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b5306240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5569b52d9fd0 con 0x5569b5301f50 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569b51fb760 con 0x5569b5302330 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5569b52da2b0 con 0x5569b52fbab0 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef6025740 10 client.0 _ll_register_callbacks cb 0x5569b5234cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b5323510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b5323510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34886/0 (socket says 172.21.15.66:34886) 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 -- 172.21.15.66:0/4225877184 learned_addr learned my addr 172.21.15.66:0/4225877184 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b5306240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5302330 0x5569b52fb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 -- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 msgr2=0x5569b5306240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b5306240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 -- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5302330 msgr2=0x5569b52fb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5302330 0x5569b52fb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.485+0000 7f0ef10a6640 1 -- 172.21.15.66:0/4225877184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b4f502d0 con 0x5569b5301f50 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b5323510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8013670 tx=0x7f0ee8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51275677169f3d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ecbfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ecbfff640 1 -- 172.21.15.66:0/4225877184 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8027060 con 0x5569b5301f50 2024-05-10T11:15:08.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ecbfff640 1 -- 172.21.15.66:0/4225877184 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0ee8022c40 con 0x5569b5301f50 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee40650b0 con 0x5569b5301f50 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ecbfff640 1 -- 172.21.15.66:0/4225877184 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ee8022e40 con 0x5569b5301f50 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 10 client.5892 fetch_fsmap learned FSMap version 34 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5569b501a6b0 con 0x5569b5301f50 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ecbfff640 1 -- 172.21.15.66:0/4225877184 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40650b0 con 0x5569b5301f50 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ecbfff640 1 -- 172.21.15.66:0/4225877184 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f0ee8012620 con 0x5569b5301f50 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 10 client.5892 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 10 client.5892 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 20 client.5892 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5326fc0 0x5569b533da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 4 client.5892 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.486+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569b51c2760 con 0x5569b5326fc0 2024-05-10T11:15:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.487+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5326fc0 0x5569b533da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.487+0000 7f0ecbfff640 10 client.5892 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.487+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5326fc0 0x5569b533da20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab8e25fcd48a2f4c server_cookie=d3081677a3d90dff in_seq=0 out_seq=0 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ecbfff640 1 -- 172.21.15.66:0/4225877184 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5569b51c2760 con 0x5569b5326fc0 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ecbfff640 10 client.5892 handle_command_reply: tid=0 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 client.5892 shutdown 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 msgr2=0x5569b5323510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b5323510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8013670 tx=0x7f0ee8000ed0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 shutdown_connections 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b5306240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5302330 0x5569b52fb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5326fc0 0x5569b533da20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 --2- 172.21.15.66:0/4225877184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b5323510 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ecbfff640 0 client.5892 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 >> 172.21.15.66:0/4225877184 conn(0x5569b52d4bb0 msgr2=0x5569b52fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 shutdown_connections 2024-05-10T11:15:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 1 -- 172.21.15.66:0/4225877184 wait complete. 2024-05-10T11:15:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.488+0000 7f0ef6025740 20 client.5892 trim_cache size 0 max 16384 2024-05-10T11:15:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 Processor -- start 2024-05-10T11:15:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 -- start start 2024-05-10T11:15:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b53049c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5308420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 0x5569b531f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec200c90 con 0x5569b5302330 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0cdb60 con 0x5569b5301f50 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.507+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec200830 con 0x5569b52fbab0 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 0x5569b531f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 0x5569b531f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34890/0 (socket says 172.21.15.66:34890) 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 -- 172.21.15.66:0/2374463764 learned_addr learned my addr 172.21.15.66:0/2374463764 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 -- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 msgr2=0x5569b53049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b53049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5308420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b53049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 -- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 msgr2=0x5569b5308420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5308420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 -- 172.21.15.66:0/2374463764 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b533a110 con 0x5569b5302330 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5308420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b53049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ef18a7640 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 0x5569b531f760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40964f0 tx=0x7f0ee4077000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327b767bc5526aed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ed67fc640 1 -- 172.21.15.66:0/2374463764 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee405d480 con 0x5569b5302330 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ed67fc640 1 -- 172.21.15.66:0/2374463764 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40650b0 con 0x5569b5302330 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.508+0000 7f0ed67fc640 1 -- 172.21.15.66:0/2374463764 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee405d620 con 0x5569b5302330 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 -- 172.21.15.66:0/2374463764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 msgr2=0x5569b531f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 0x5569b531f760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40964f0 tx=0x7f0ee4077000 comp rx=0 tx=0).stop 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 -- 172.21.15.66:0/2374463764 shutdown_connections 2024-05-10T11:15:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5302330 0x5569b531f760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b5301f50 0x5569b5308420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 --2- 172.21.15.66:0/2374463764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b52fbab0 0x5569b53049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 -- 172.21.15.66:0/2374463764 >> 172.21.15.66:0/2374463764 conn(0x5569b52d4bb0 msgr2=0x5569b52d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 -- 172.21.15.66:0/2374463764 shutdown_connections 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 -- 172.21.15.66:0/2374463764 wait complete. 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 -- start start 2024-05-10T11:15:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.509+0000 7f0ef6025740 1 Processor -- start 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b52fbab0 0x5569b539d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b531f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b531fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5569b5306d40 con 0x5569b5301f50 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569b5322dd0 con 0x5569b52fbab0 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5569b5324300 con 0x5569b5302330 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef6025740 10 client.0 _ll_register_callbacks cb 0x7f0ee80073c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef08a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b531f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef08a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b531f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34898/0 (socket says 172.21.15.66:34898) 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.510+0000 7f0ef08a5640 1 -- 172.21.15.66:0/222418120 learned_addr learned my addr 172.21.15.66:0/222418120 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b52fbab0 0x5569b539d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef08a5640 1 -- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 msgr2=0x5569b531fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b531fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef08a5640 1 -- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b52fbab0 msgr2=0x5569b539d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b52fbab0 0x5569b539d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef08a5640 1 -- 172.21.15.66:0/222418120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b52d5810 con 0x5569b5301f50 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef08a5640 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b531f760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006b10 tx=0x7f0ee002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b900d2f6e6342b5b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ecbfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ecbfff640 1 -- 172.21.15.66:0/222418120 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee004d060 con 0x5569b5301f50 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ecbfff640 1 -- 172.21.15.66:0/222418120 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0ee0047500 con 0x5569b5301f50 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee40650b0 con 0x5569b5301f50 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ecbfff640 1 -- 172.21.15.66:0/222418120 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ee0053050 con 0x5569b5301f50 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 10 client.5898 fetch_fsmap learned FSMap version 34 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5569b5301240 con 0x5569b5301f50 2024-05-10T11:15:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ecbfff640 1 -- 172.21.15.66:0/222418120 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40650b0 con 0x5569b5301f50 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ecbfff640 1 -- 172.21.15.66:0/222418120 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f0ee0056020 con 0x5569b5301f50 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 10 client.5898 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 10 client.5898 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 20 client.5898 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5307c40 0x5569b52d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 4 client.5898 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.511+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "status"}) -- 0x5569b524c4e0 con 0x5569b5307c40 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5307c40 0x5569b52d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef10a6640 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5307c40 0x5569b52d8410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12fd3c53133c8e2 server_cookie=f36b18e8aab7f887 in_seq=0 out_seq=0 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ecbfff640 10 client.5898 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ecbfff640 1 -- 172.21.15.66:0/222418120 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5569b524c4e0 con 0x5569b5307c40 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ecbfff640 10 client.5898 handle_command_reply: tid=0 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 client.5898 shutdown 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 msgr2=0x5569b531f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b531f760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006b10 tx=0x7f0ee002c070 comp rx=0 tx=0).stop 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 shutdown_connections 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569b5302330 0x5569b531fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5569b5307c40 0x5569b52d8410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569b5301f50 0x5569b531f760 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 --2- 172.21.15.66:0/222418120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569b52fbab0 0x5569b539d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 >> 172.21.15.66:0/222418120 conn(0x5569b52d4bb0 msgr2=0x5569b5305580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.512+0000 7f0ecbfff640 0 client.5898 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 shutdown_connections 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef6025740 1 -- 172.21.15.66:0/222418120 wait complete. 2024-05-10T11:15:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef6025740 20 client.5898 trim_cache size 0 max 16384 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 5754, 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 10.230176931999999, 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 34, 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 62, 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 62, 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 15.196741683000001 2024-05-10T11:15:08.520 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ed00762d0 msgr2=0x7f0ed0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ed00762d0 0x7f0ed0078790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8000f60 tx=0x7f0ee8007d50 comp rx=0 tx=0).stop 2024-05-10T11:15:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 msgr2=0x7f0eec14d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 0x7f0eec14d420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009f00 tx=0x7f0ee400c490 comp rx=0 tx=0).stop 2024-05-10T11:15:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 shutdown_connections 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0ed00762d0 0x7f0ed0078790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eec0b2860 0x7f0eec14d420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eec15f3b0 0x7f0eec0b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 --2- 172.21.15.66:0/3356543004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eec0d5d30 0x7f0eec0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 >> 172.21.15.66:0/3356543004 conn(0x7f0eec0d5130 msgr2=0x7f0eec0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 shutdown_connections 2024-05-10T11:15:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.513+0000 7f0ef330a640 1 -- 172.21.15.66:0/3356543004 wait complete. 2024-05-10T11:15:08.525 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:15:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.628+0000 7fa7a2987640 1 Processor -- start 2024-05-10T11:15:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.628+0000 7fa7a2987640 1 -- start start 2024-05-10T11:15:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.629+0000 7fa7a2987640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa79c1598c0 0x7fa79c06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.629+0000 7fa7a2987640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c06f1c0 con 0x7fa79c0c7390 2024-05-10T11:15:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.629+0000 7fa7a2987640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c06f4a0 con 0x7fa79c06ec40 2024-05-10T11:15:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.629+0000 7fa7a2987640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa79c06f780 con 0x7fa79c1598c0 2024-05-10T11:15:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.629+0000 7fa7a0f24640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa79c0c7390 0x7fa79c0cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34854/0 (socket says 172.21.15.66:34854) 2024-05-10T11:15:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.629+0000 7fa7a0f24640 1 -- 172.21.15.66:0/2683482763 learned_addr learned my addr 172.21.15.66:0/2683482763 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79bfff640 1 --2- 172.21.15.66:0/2683482763 >> v2:172.21.15.190:3300/0 conn(0x7fa79c1598c0 0x7fa79c06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757265483 0 0) 0x7fa79c06f1c0 con 0x7fa79c0c7390 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa784003520 con 0x7fa79c0c7390 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630764876 0 0) 0x7fa784003520 con 0x7fa79c0c7390 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 >> v2:172.21.15.190:3300/0 conn(0x7fa79c1598c0 msgr2=0x7fa79c06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 --2- 172.21.15.66:0/2683482763 >> v2:172.21.15.190:3300/0 conn(0x7fa79c1598c0 0x7fa79c06e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 >> v1:172.21.15.190:6789/0 conn(0x7fa79c06ec40 legacy=0x7fa79c0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c06fa60 con 0x7fa79c0c7390 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fa7940019f0 con 0x7fa79c0c7390 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79bfff640 1 --2- 172.21.15.66:0/2683482763 >> v2:172.21.15.190:3300/0 conn(0x7fa79c1598c0 0x7fa79c06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 >> v1:172.21.15.66:6789/0 conn(0x7fa79c0c7390 legacy=0x7fa79c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7840039b0 0x7fa784003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7840051c0 0x7fa78400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c06f780 con 0x7fa784004800 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa78400c060 con 0x7fa7840051c0 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa78400c260 con 0x7fa7840039b0 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa7a0f24640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7840051c0 0x7fa78400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79bfff640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7840039b0 0x7fa784003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.630+0000 7fa79b7fe640 1 -- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7840039b0 msgr2=0x7fa784003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7840039b0 0x7fa784003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79b7fe640 1 -- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7840051c0 msgr2=0x7fa78400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7840051c0 0x7fa78400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79b7fe640 1 -- 172.21.15.66:0/2683482763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784003520 con 0x7fa784004800 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa7a0f24640 1 -- 172.21.15.66:0/2683482763 reap_dead start 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa784004c80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa790001750 tx=0x7fa784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa49efb60f0c2879 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa790001370 con 0x7fa784004800 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7900052d0 con 0x7fa784004800 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.631+0000 7fa79affd640 1 -- 172.21.15.66:0/2683482763 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79002abc0 con 0x7fa784004800 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 -- 172.21.15.66:0/2683482763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 msgr2=0x7fa784004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa784004c80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa790001750 tx=0x7fa784005830 comp rx=0 tx=0).stop 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 -- 172.21.15.66:0/2683482763 shutdown_connections 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 --2- 172.21.15.66:0/2683482763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa784004c80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 -- 172.21.15.66:0/2683482763 >> 172.21.15.66:0/2683482763 conn(0x7fa79c0b2900 msgr2=0x7fa79c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 -- 172.21.15.66:0/2683482763 shutdown_connections 2024-05-10T11:15:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.632+0000 7fa7a2987640 1 -- 172.21.15.66:0/2683482763 wait complete. 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.633+0000 7fa7a2987640 1 Processor -- start 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.633+0000 7fa7a2987640 1 -- start start 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a2987640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa79c0af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a2987640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa79c073d90 0x7fa79c152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a2987640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa79c1f8d10 0x7fa79c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a2987640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c159ca0 con 0x7fa784004800 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a2987640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c15c6e0 con 0x7fa79c073d90 2024-05-10T11:15:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a2987640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c159e20 con 0x7fa79c1f8d10 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa79bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa79c0af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa79bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa79c0af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34922/0 (socket says 172.21.15.66:34922) 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa79bfff640 1 -- 172.21.15.66:0/193448350 learned_addr learned my addr 172.21.15.66:0/193448350 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa7a0f24640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa79c1f8d10 0x7fa79c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.634+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa79c073d90 0x7fa79c152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa79bfff640 1 -- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa79c1f8d10 msgr2=0x7fa79c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa79bfff640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa79c1f8d10 0x7fa79c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa79bfff640 1 -- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa79c073d90 msgr2=0x7fa79c152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa79bfff640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa79c073d90 0x7fa79c152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa79bfff640 1 -- 172.21.15.66:0/193448350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c153480 con 0x7fa784004800 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa79bfff640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa79c0af6b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa78c011d00 tx=0x7fa78c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00fd20 con 0x7fa784004800 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78c004030 con 0x7fa784004800 2024-05-10T11:15:08.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c074210 con 0x7fa784004800 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c004420 con 0x7fa784004800 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.635+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c0b0070 con 0x7fa784004800 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.636+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c06a220 con 0x7fa784004800 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.637+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa78c012040 con 0x7fa784004800 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.637+0000 7fa798ff9640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa7880762d0 0x7fa788078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.637+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa78c097d30 con 0x7fa784004800 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.637+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa7880762d0 0x7fa788078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.638+0000 7fa79b7fe640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa7880762d0 0x7fa788078790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa790032000 tx=0x7fa79002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.641+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa79c153480 con 0x7fa784004800 2024-05-10T11:15:08.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.876+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa79c06e4e0 con 0x7fa784004800 2024-05-10T11:15:08.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.876+0000 7fa798ff9640 1 -- 172.21.15.66:0/193448350 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fa78c019070 con 0x7fa784004800 2024-05-10T11:15:08.877 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:15:08.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa7880762d0 msgr2=0x7fa788078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa7880762d0 0x7fa788078790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa790032000 tx=0x7fa79002e000 comp rx=0 tx=0).stop 2024-05-10T11:15:08.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 msgr2=0x7fa79c0af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:08.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa79c0af6b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa78c011d00 tx=0x7fa78c00f610 comp rx=0 tx=0).stop 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 shutdown_connections 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa7880762d0 0x7fa788078790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa79c1f8d10 0x7fa79c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa79c073d90 0x7fa79c152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 --2- 172.21.15.66:0/193448350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa784004800 0x7fa79c0af6b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.878+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 >> 172.21.15.66:0/193448350 conn(0x7fa79c0b2900 msgr2=0x7fa79c0c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.879+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 shutdown_connections 2024-05-10T11:15:08.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:08.879+0000 7fa7a2987640 1 -- 172.21.15.66:0/193448350 wait complete. 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:15:08.890 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:15:08.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:15:08.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:08.891 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:15:08.907 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:15:08.908 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42585sec preferred_lft 42585sec 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.909 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:15:08.910 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:15:08.910 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:15:08.910 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:15:08.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:08.910 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:15:08.972 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:15:08.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:08.974 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:15:09.031 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:15:09.031 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:15:09.031 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:15:09.031 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:15:09.031 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:15:09.031 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:15:09.031 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:15:09.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:15:09.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:15:09.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:15:09.032 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:15:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:15:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:15:09.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:09.162 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:15:09.177 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:15:09.177 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:15:09.178 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:15:09.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:09.178 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:15:09.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:15:09.244 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:15:09.300 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:15:09.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:15:09.300 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:15:09.356 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:15:09.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:09.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:15:09.441 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:15:09.442 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:15:09.442 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:15:09.450 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:15:09.451 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:15:09.451 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:15:09.451 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:15:09.451 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:15:09.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:15:09.460 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:15:09.460 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:15:09.460 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:15:09.460 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:15:09.460 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:15:09.460 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:15:09.461 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:15:09.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:09.462 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:15:09.488 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:15:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:15:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:15:09.593 INFO:teuthology.orchestra.run.smithi066.stdout:client5198 2024-05-10T11:15:09.593 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:15:09.593 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:15:09.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:09.610 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-05-10T11:15:09.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:09.672 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-05-10T11:15:09.730 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:15:09.730 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:15:09.730 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:15:09.730 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:15:09.730 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-05-10T11:15:09.730 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:15:09.838 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:15:09.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:15:09.847 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:15:09.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.990+0000 7f113415f640 1 Processor -- start 2024-05-10T11:15:10.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.990+0000 7f113415f640 1 -- start start 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f113415f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f112c070bd0 0x7f112c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f113415f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112c160190 con 0x7f112c15f620 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f113415f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112c160470 con 0x7f112c06c990 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f113415f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f112c06cd70 con 0x7f112c070bd0 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f11326fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f112c070bd0 0x7f112c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f11316fa640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f112c15f620 0x7f112c0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34870/0 (socket says 172.21.15.66:34870) 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.991+0000 7f11316fa640 1 -- 172.21.15.66:0/34214081 learned_addr learned my addr 172.21.15.66:0/34214081 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.992+0000 7f11326fc640 1 -- 172.21.15.66:0/34214081 >> v1:172.21.15.190:6789/0 conn(0x7f112c06c990 legacy=0x7f112c163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.992+0000 7f11326fc640 1 -- 172.21.15.66:0/34214081 >> v1:172.21.15.66:6789/0 conn(0x7f112c15f620 legacy=0x7f112c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.992+0000 7f11326fc640 1 -- 172.21.15.66:0/34214081 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c162e60 con 0x7f112c070bd0 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.992+0000 7f1130ef9640 1 -- 172.21.15.66:0/34214081 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419009293 0 0) 0x7f112c160190 con 0x7f112c15f620 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.992+0000 7f11326fc640 1 --2- 172.21.15.66:0/34214081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c070bd0 0x7f112c15fa80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1124009d90 tx=0x7f112402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cc8549f755b71a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f1130ef9640 1 -- 172.21.15.66:0/34214081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124007740 con 0x7f112c070bd0 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f1130ef9640 1 -- 172.21.15.66:0/34214081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240078e0 con 0x7f112c070bd0 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f1130ef9640 1 -- 172.21.15.66:0/34214081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124007cb0 con 0x7f112c070bd0 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 -- 172.21.15.66:0/34214081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c070bd0 msgr2=0x7f112c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 --2- 172.21.15.66:0/34214081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c070bd0 0x7f112c15fa80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1124009d90 tx=0x7f112402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 -- 172.21.15.66:0/34214081 shutdown_connections 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 --2- 172.21.15.66:0/34214081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c070bd0 0x7f112c15fa80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 -- 172.21.15.66:0/34214081 >> 172.21.15.66:0/34214081 conn(0x7f112c0b3980 msgr2=0x7f112c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 -- 172.21.15.66:0/34214081 shutdown_connections 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.993+0000 7f113415f640 1 -- 172.21.15.66:0/34214081 wait complete. 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.994+0000 7f113415f640 1 Processor -- start 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.994+0000 7f113415f640 1 -- start start 2024-05-10T11:15:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f113415f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 0x7f112c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f113415f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f112c070bd0 0x7f112c0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f113415f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f112c15f620 0x7f112c0b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f113415f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f112c0cf920 con 0x7f112c06c990 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f113415f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f112c073e70 con 0x7f112c15f620 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f113415f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f112c0cfaa0 con 0x7f112c070bd0 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f1131efb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 0x7f112c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f1131efb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 0x7f112c15bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34948/0 (socket says 172.21.15.66:34948) 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f1131efb640 1 -- 172.21.15.66:0/4170427514 learned_addr learned my addr 172.21.15.66:0/4170427514 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f11316fa640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f112c070bd0 0x7f112c0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.995+0000 7f11326fc640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f112c15f620 0x7f112c0b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f1131efb640 1 -- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f112c070bd0 msgr2=0x7f112c0b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f1131efb640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f112c070bd0 0x7f112c0b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f1131efb640 1 -- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f112c15f620 msgr2=0x7f112c0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f1131efb640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f112c15f620 0x7f112c0b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f1131efb640 1 -- 172.21.15.66:0/4170427514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c15c040 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f11316fa640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f112c070bd0 0x7f112c0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f1131efb640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 0x7f112c15bb00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f112800c430 tx=0x7f112800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128011790 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1128017070 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112c0b5fb0 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128011bb0 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.996+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112c160c60 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.997+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112c06a220 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.998+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f112801c460 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.998+0000 7f11227fc640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11100762d0 0x7f1110078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.998+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f1128097600 con 0x7f112c06c990 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.999+0000 7f11316fa640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11100762d0 0x7f1110078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:09.999+0000 7f11316fa640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11100762d0 0x7f1110078790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f112c1f9380 tx=0x7f111c007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.002+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1128060dd0 con 0x7f112c06c990 2024-05-10T11:15:10.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.230+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f112c073540 con 0x7f112c06c990 2024-05-10T11:15:10.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.230+0000 7f11227fc640 1 -- 172.21.15.66:0/4170427514 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5185 (secure 0 0 0) 0x7f11280606d0 con 0x7f112c06c990 2024-05-10T11:15:10.231 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:10.231 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:00.666858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:15:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 34 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11100762d0 msgr2=0x7f1110078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11100762d0 0x7f1110078790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f112c1f9380 tx=0x7f111c007ca0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 msgr2=0x7f112c15bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 0x7f112c15bb00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f112800c430 tx=0x7f112800c8f0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 shutdown_connections 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11100762d0 0x7f1110078790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f112c15f620 0x7f112c0b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f112c070bd0 0x7f112c0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 --2- 172.21.15.66:0/4170427514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112c06c990 0x7f112c15bb00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 >> 172.21.15.66:0/4170427514 conn(0x7f112c0b3980 msgr2=0x7f112c15c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 shutdown_connections 2024-05-10T11:15:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.232+0000 7f113415f640 1 -- 172.21.15.66:0/4170427514 wait complete. 2024-05-10T11:15:10.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-05-10T11:15:10.381 INFO:teuthology.orchestra.run.smithi190.stdout:{"message":"","return_code":0} 2024-05-10T11:15:10.382 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:15:10.382 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T11:15:10.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.428+0000 7faa224cbf40 1 Processor -- start 2024-05-10T11:15:10.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.428+0000 7faa224cbf40 1 -- start start 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa224cbf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e4f630 0x55dd13eddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa224cbf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e690f0 0x55dd13ef3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa224cbf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13ef4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa224cbf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd13e4ffe0 con 0x55dd13edec00 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa224cbf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dd13dc7f50 con 0x55dd13e690f0 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa224cbf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dd13e69aa0 con 0x55dd13e4f630 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13ef4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13ef4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34972/0 (socket says 172.21.15.66:34972) 2024-05-10T11:15:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 -- 172.21.15.66:0/3476033210 learned_addr learned my addr 172.21.15.66:0/3476033210 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1ffc5640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e4f630 0x55dd13eddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1f7c4640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e690f0 0x55dd13ef3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 -- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e4f630 msgr2=0x55dd13eddcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e4f630 0x55dd13eddcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 -- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e690f0 msgr2=0x55dd13ef3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e690f0 0x55dd13ef3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 -- 172.21.15.66:0/3476033210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd13edd290 con 0x55dd13edec00 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1ffc5640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e4f630 0x55dd13eddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1f7c4640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e690f0 0x55dd13ef3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa207c6640 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13ef4280 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7faa180098a0 tx=0x7faa18005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c57929a6157cba9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1e7c2640 1 -- 172.21.15.66:0/3476033210 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18008930 con 0x55dd13edec00 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1e7c2640 1 -- 172.21.15.66:0/3476033210 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa18018070 con 0x55dd13edec00 2024-05-10T11:15:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.429+0000 7faa1e7c2640 1 -- 172.21.15.66:0/3476033210 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18008d10 con 0x55dd13edec00 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 -- 172.21.15.66:0/3476033210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 msgr2=0x55dd13ef4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13ef4280 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7faa180098a0 tx=0x7faa18005a00 comp rx=0 tx=0).stop 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 -- 172.21.15.66:0/3476033210 shutdown_connections 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13ef4280 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e690f0 0x55dd13ef3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 --2- 172.21.15.66:0/3476033210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e4f630 0x55dd13eddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 -- 172.21.15.66:0/3476033210 >> 172.21.15.66:0/3476033210 conn(0x55dd13e1f7c0 msgr2=0x55dd13edb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 -- 172.21.15.66:0/3476033210 shutdown_connections 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 -- 172.21.15.66:0/3476033210 wait complete. 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.430+0000 7faa224cbf40 1 Processor -- start 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 -- start start 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e4f630 0x55dd13ed4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e690f0 0x55dd13ed4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13edb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd13ed8560 con 0x55dd13edec00 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dd13ef47c0 con 0x55dd13e4f630 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa224cbf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dd13edd530 con 0x55dd13e690f0 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa207c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13edb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa207c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13edb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34984/0 (socket says 172.21.15.66:34984) 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa207c6640 1 -- 172.21.15.66:0/391951780 learned_addr learned my addr 172.21.15.66:0/391951780 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa1ffc5640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e4f630 0x55dd13ed4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.431+0000 7faa1f7c4640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e690f0 0x55dd13ed4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa207c6640 1 -- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e690f0 msgr2=0x55dd13ed4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa207c6640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dd13e690f0 0x55dd13ed4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa207c6640 1 -- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e4f630 msgr2=0x55dd13ed4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa207c6640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dd13e4f630 0x55dd13ed4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa207c6640 1 -- 172.21.15.66:0/391951780 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd13e687e0 con 0x55dd13edec00 2024-05-10T11:15:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa207c6640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13edb040 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c010 tx=0x7faa18003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa1d7c0640 1 -- 172.21.15.66:0/391951780 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18025620 con 0x55dd13edec00 2024-05-10T11:15:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa1d7c0640 1 -- 172.21.15.66:0/391951780 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa18021070 con 0x55dd13edec00 2024-05-10T11:15:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd13eda700 con 0x55dd13edec00 2024-05-10T11:15:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa1d7c0640 1 -- 172.21.15.66:0/391951780 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18025a20 con 0x55dd13edec00 2024-05-10T11:15:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.432+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd13e4f0f0 con 0x55dd13edec00 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.433+0000 7faa1d7c0640 1 -- 172.21.15.66:0/391951780 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa18013420 con 0x55dd13edec00 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.434+0000 7faa1d7c0640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa0c074cb0 0x7faa0c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.434+0000 7faa1d7c0640 1 -- 172.21.15.66:0/391951780 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7faa18097d90 con 0x55dd13edec00 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.434+0000 7faa1ffc5640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa0c074cb0 0x7faa0c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.434+0000 7faa224cbf40 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55dd13edb580 0x55dd13ef2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.434+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62) -- 0x55dd13ef2750 con 0x55dd13edb580 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.434+0000 7faa1f7c4640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55dd13edb580 0x55dd13ef2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa1ffc5640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa0c074cb0 0x7faa0c077170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55dd13e697d0 tx=0x7faa10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa1f7c4640 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55dd13edb580 0x55dd13ef2210 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa1f7c4640 1 -- 172.21.15.66:0/391951780 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7faa14051070 con 0x55dd13edb580 2024-05-10T11:15:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55dd13edb580 msgr2=0x55dd13ef2210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55dd13edb580 0x55dd13ef2210 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa0c074cb0 msgr2=0x7faa0c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa0c074cb0 0x7faa0c077170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55dd13e697d0 tx=0x7faa10008040 comp rx=0 tx=0).stop 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 msgr2=0x55dd13edb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 --2- 172.21.15.66:0/391951780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd13edec00 0x55dd13edb040 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c010 tx=0x7faa18003020 comp rx=0 tx=0).stop 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa207c6640 1 -- 172.21.15.66:0/391951780 reap_dead start 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 shutdown_connections 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 >> 172.21.15.66:0/391951780 conn(0x55dd13e1f7c0 msgr2=0x55dd13ed56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 shutdown_connections 2024-05-10T11:15:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.435+0000 7faa224cbf40 1 -- 172.21.15.66:0/391951780 wait complete. 2024-05-10T11:15:10.441 INFO:teuthology.orchestra.run.smithi066.stdout:Xfiledir_test 2024-05-10T11:15:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:10.441 DEBUG:teuthology.orchestra.run.smithi066:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627777, 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "ancestors": [ 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "dirino": 1099511627776, 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "file", 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 2 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "dirino": 1, 2024-05-10T11:15:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "dir_test", 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 4 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 10, 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout: "old_pools": [] 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:10.491 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:10.493 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-05-10T11:15:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.579+0000 7f71b52b1f40 1 Processor -- start 2024-05-10T11:15:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.579+0000 7f71b52b1f40 1 -- start start 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b52b1f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f719c0022a0 0x55ce0bf320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b52b1f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 0x55ce0bf50980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b52b1f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 0x55ce0bf4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b52b1f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce0be1ef50 con 0x55ce0bf312f0 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b52b1f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ce0be22f90 con 0x7f719c0022a0 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b52b1f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ce0bebe5d0 con 0x55ce0bf4ed70 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 0x55ce0bf50980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 0x55ce0bf50980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35014/0 (socket says 172.21.15.66:35014) 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 -- 172.21.15.66:0/1819140062 learned_addr learned my addr 172.21.15.66:0/1819140062 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 -- 172.21.15.66:0/1819140062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 msgr2=0x55ce0bf4b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 0x55ce0bf4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 -- 172.21.15.66:0/1819140062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f719c0022a0 msgr2=0x55ce0bf320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f719c0022a0 0x55ce0bf320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 -- 172.21.15.66:0/1819140062 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0bf2b7f0 con 0x55ce0bf312f0 2024-05-10T11:15:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b25ac640 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 0x55ce0bf50980 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f71a8001410 tx=0x7f71a800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dfa97b34633e4a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b15aa640 1 -- 172.21.15.66:0/1819140062 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a800dd20 con 0x55ce0bf312f0 2024-05-10T11:15:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b15aa640 1 -- 172.21.15.66:0/1819140062 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a8003110 con 0x55ce0bf312f0 2024-05-10T11:15:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.580+0000 7f71b15aa640 1 -- 172.21.15.66:0/1819140062 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8003300 con 0x55ce0bf312f0 2024-05-10T11:15:10.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 -- 172.21.15.66:0/1819140062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 msgr2=0x55ce0bf50980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 0x55ce0bf50980 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f71a8001410 tx=0x7f71a800d630 comp rx=0 tx=0).stop 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 -- 172.21.15.66:0/1819140062 shutdown_connections 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 0x55ce0bf4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce0bf312f0 0x55ce0bf50980 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/1819140062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f719c0022a0 0x55ce0bf320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 -- 172.21.15.66:0/1819140062 >> 172.21.15.66:0/1819140062 conn(0x55ce0be767d0 msgr2=0x55ce0bf4cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 -- 172.21.15.66:0/1819140062 shutdown_connections 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.581+0000 7f71b52b1f40 1 -- 172.21.15.66:0/1819140062 wait complete. 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 Processor -- start 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 -- start start 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ce0bf312f0 0x55ce0bfd69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 0x55ce0bfddd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f719c0022a0 0x55ce0bf34110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce0bf4f580 con 0x7f719c0022a0 2024-05-10T11:15:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ce0bf32600 con 0x55ce0bf312f0 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b52b1f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ce0bf4f860 con 0x55ce0bf4ed70 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b35ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f719c0022a0 0x55ce0bf34110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b35ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f719c0022a0 0x55ce0bf34110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35024/0 (socket says 172.21.15.66:35024) 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b35ae640 1 -- 172.21.15.66:0/331124976 learned_addr learned my addr 172.21.15.66:0/331124976 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.582+0000 7f71b2dad640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ce0bf312f0 0x55ce0bfd69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b25ac640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 0x55ce0bfddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b35ae640 1 -- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 msgr2=0x55ce0bfddd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b35ae640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ce0bf4ed70 0x55ce0bfddd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b35ae640 1 -- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ce0bf312f0 msgr2=0x55ce0bfd69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b35ae640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ce0bf312f0 0x55ce0bfd69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b35ae640 1 -- 172.21.15.66:0/331124976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0bfd6fa0 con 0x7f719c0022a0 2024-05-10T11:15:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b35ae640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f719c0022a0 0x55ce0bf34110 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55ce0bec0f90 tx=0x7f71ac00e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f719bfff640 1 -- 172.21.15.66:0/331124976 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00f450 con 0x7f719c0022a0 2024-05-10T11:15:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f719bfff640 1 -- 172.21.15.66:0/331124976 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ac013030 con 0x7f719c0022a0 2024-05-10T11:15:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce0bfd7280 con 0x7f719c0022a0 2024-05-10T11:15:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f719bfff640 1 -- 172.21.15.66:0/331124976 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00f850 con 0x7f719c0022a0 2024-05-10T11:15:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.583+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0bf4b060 con 0x7f719c0022a0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.585+0000 7f719bfff640 1 -- 172.21.15.66:0/331124976 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f71ac00f9f0 con 0x7f719c0022a0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.585+0000 7f719bfff640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f71a0074cb0 0x7f71a0077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.585+0000 7f719bfff640 1 -- 172.21.15.66:0/331124976 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f71ac096a70 con 0x7f719c0022a0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.586+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55ce0bfde2c0 0x55ce0bfd8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.586+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62) -- 0x55ce0bf4a270 con 0x55ce0bfde2c0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.586+0000 7f71b2dad640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f71a0074cb0 0x7f71a0077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.586+0000 7f71b25ac640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55ce0bfde2c0 0x55ce0bfd8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.586+0000 7f71b2dad640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f71a0074cb0 0x7f71a0077170 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f71a4058000 tx=0x7f71a404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.586+0000 7f71b25ac640 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55ce0bfde2c0 0x55ce0bfd8de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b25ac640 1 -- 172.21.15.66:0/331124976 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v62'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a800e040 con 0x55ce0bfde2c0 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55ce0bfde2c0 msgr2=0x55ce0bfd8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55ce0bfde2c0 0x55ce0bfd8de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f71a0074cb0 msgr2=0x7f71a0077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f71a0074cb0 0x7f71a0077170 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f71a4058000 tx=0x7f71a404f000 comp rx=0 tx=0).stop 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f719c0022a0 msgr2=0x55ce0bf34110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 --2- 172.21.15.66:0/331124976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f719c0022a0 0x55ce0bf34110 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55ce0bec0f90 tx=0x7f71ac00e7b0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b35ae640 1 -- 172.21.15.66:0/331124976 reap_dead start 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 shutdown_connections 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.587+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 >> 172.21.15.66:0/331124976 conn(0x55ce0be767d0 msgr2=0x55ce0bf31d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.588+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 shutdown_connections 2024-05-10T11:15:10.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.588+0000 7f71b52b1f40 1 -- 172.21.15.66:0/331124976 wait complete. 2024-05-10T11:15:10.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:10.591 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-05-10T11:15:10.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.698+0000 7f8e43e25640 1 Processor -- start 2024-05-10T11:15:10.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.698+0000 7f8e43e25640 1 -- start start 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e43e25640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e3c15f600 0x7f8e3c0d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e43e25640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8e3c0d0b90 0x7f8e3c0d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e43e25640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3c0b46b0 con 0x7f8e3c0d3b50 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e43e25640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8e3c0b4990 con 0x7f8e3c0d0b90 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e43e25640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8e3c0b4c70 con 0x7f8e3c15f600 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8e3c0d0b90 0x7f8e3c0d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8e3c0d0b90 0x7f8e3c0d3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35032/0 (socket says 172.21.15.66:35032) 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 -- 172.21.15.66:0/594973579 learned_addr learned my addr 172.21.15.66:0/594973579 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/594973579 >> v2:172.21.15.190:3300/0 conn(0x7f8e3c15f600 0x7f8e3c0d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 -- 172.21.15.66:0/594973579 >> v2:172.21.15.190:3300/0 conn(0x7f8e3c15f600 msgr2=0x7f8e3c0d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 --2- 172.21.15.66:0/594973579 >> v2:172.21.15.190:3300/0 conn(0x7f8e3c15f600 0x7f8e3c0d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 -- 172.21.15.66:0/594973579 >> v1:172.21.15.190:6789/0 conn(0x7f8e3c0d3b50 legacy=0x7f8e3c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.699+0000 7f8e413c0640 1 -- 172.21.15.66:0/594973579 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c0b4f50 con 0x7f8e3c0d0b90 2024-05-10T11:15:10.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.700+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/594973579 >> v2:172.21.15.190:3300/0 conn(0x7f8e3c15f600 0x7f8e3c0d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.700+0000 7f8e413c0640 1 --2- 172.21.15.66:0/594973579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c0d3610 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c08f430 tx=0x7f8e2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c540710901362d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.700+0000 7f8e40bbf640 1 -- 172.21.15.66:0/594973579 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c037070 con 0x7f8e3c0d0b90 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.700+0000 7f8e40bbf640 1 -- 172.21.15.66:0/594973579 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c032440 con 0x7f8e3c0d0b90 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.700+0000 7f8e40bbf640 1 -- 172.21.15.66:0/594973579 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c032810 con 0x7f8e3c0d0b90 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 -- 172.21.15.66:0/594973579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c0d0b90 msgr2=0x7f8e3c0d3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 --2- 172.21.15.66:0/594973579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c0d3610 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c08f430 tx=0x7f8e2c02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 -- 172.21.15.66:0/594973579 shutdown_connections 2024-05-10T11:15:10.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 --2- 172.21.15.66:0/594973579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c0d3610 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 --2- 172.21.15.66:0/594973579 >> v2:172.21.15.190:3300/0 conn(0x7f8e3c15f600 0x7f8e3c0d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 -- 172.21.15.66:0/594973579 >> 172.21.15.66:0/594973579 conn(0x7f8e3c09e390 msgr2=0x7f8e3c0d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 -- 172.21.15.66:0/594973579 shutdown_connections 2024-05-10T11:15:10.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.701+0000 7f8e43e25640 1 -- 172.21.15.66:0/594973579 wait complete. 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.702+0000 7f8e43e25640 1 Processor -- start 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.702+0000 7f8e43e25640 1 -- start start 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e43e25640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e43e25640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3c0d3b50 0x7f8e3c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e43e25640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 0x7f8e3c0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e43e25640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c0b68e0 con 0x7f8e3c15f600 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e43e25640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c0b6760 con 0x7f8e3c0d0b90 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e43e25640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c0d1d70 con 0x7f8e3c0d3b50 2024-05-10T11:15:10.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 0x7f8e3c0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e41bc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 0x7f8e3c0ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35044/0 (socket says 172.21.15.66:35044) 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 -- 172.21.15.66:0/1761919274 learned_addr learned my addr 172.21.15.66:0/1761919274 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e413c0640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3c0d3b50 0x7f8e3c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 -- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3c0d3b50 msgr2=0x7f8e3c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3c0d3b50 0x7f8e3c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 -- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3c0d0b90 msgr2=0x7f8e3c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.703+0000 7f8e423c2640 1 -- 172.21.15.66:0/1761919274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c0a0200 con 0x7f8e3c15f600 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.704+0000 7f8e423c2640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 0x7f8e3c0ce650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400c7b0 tx=0x7f8e3400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.704+0000 7f8e327fc640 1 -- 172.21.15.66:0/1761919274 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34004b60 con 0x7f8e3c15f600 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.704+0000 7f8e327fc640 1 -- 172.21.15.66:0/1761919274 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e34004d00 con 0x7f8e3c15f600 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.704+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c0baa20 con 0x7f8e3c15f600 2024-05-10T11:15:10.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.704+0000 7f8e327fc640 1 -- 172.21.15.66:0/1761919274 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400aa90 con 0x7f8e3c15f600 2024-05-10T11:15:10.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.704+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c160890 con 0x7f8e3c15f600 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.706+0000 7f8e327fc640 1 -- 172.21.15.66:0/1761919274 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e3400ac30 con 0x7f8e3c15f600 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.706+0000 7f8e327fc640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e200762d0 0x7f8e20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.707+0000 7f8e327fc640 1 -- 172.21.15.66:0/1761919274 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8e34097b50 con 0x7f8e3c15f600 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.707+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e200762d0 0x7f8e20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.707+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e200762d0 0x7f8e20078790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c1f8800 tx=0x7f8e38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.707+0000 7f8e46c18740 1 Processor -- start 2024-05-10T11:15:10.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.707+0000 7f8e46c18740 1 -- start start 2024-05-10T11:15:10.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a59770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a59775e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 0x5618a594ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e46c18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5618a58b0bc0 con 0x5618a59474f0 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5618a5869d30 con 0x5618a5974890 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5618a58acb80 con 0x5618a5974c70 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 0x5618a594ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 0x5618a594ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35052/0 (socket says 172.21.15.66:35052) 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e423c2640 1 -- 172.21.15.66:0/407135935 learned_addr learned my addr 172.21.15.66:0/407135935 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e413c0640 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a59775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.708+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a59770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e423c2640 1 -- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 msgr2=0x5618a59775e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e423c2640 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a59775e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e423c2640 1 -- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 msgr2=0x5618a59770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e423c2640 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a59770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e423c2640 1 -- 172.21.15.66:0/407135935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618a584e100 con 0x5618a59474f0 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e423c2640 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 0x5618a594ad00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8e3405d2b0 tx=0x7f8e34060610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b867c90669e139b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e1f7fe640 1 -- 172.21.15.66:0/407135935 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34079030 con 0x5618a59474f0 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e1f7fe640 1 -- 172.21.15.66:0/407135935 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e340607d0 con 0x5618a59474f0 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e1f7fe640 1 -- 172.21.15.66:0/407135935 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34060cc0 con 0x5618a59474f0 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e46c18740 1 -- 172.21.15.66:0/407135935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 msgr2=0x5618a594ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.709+0000 7f8e46c18740 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 0x5618a594ad00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8e3405d2b0 tx=0x7f8e34060610 comp rx=0 tx=0).stop 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 -- 172.21.15.66:0/407135935 shutdown_connections 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a59474f0 0x5618a594ad00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a59775e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 --2- 172.21.15.66:0/407135935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a59770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 -- 172.21.15.66:0/407135935 >> 172.21.15.66:0/407135935 conn(0x5618a5949760 msgr2=0x5618a59920a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 -- 172.21.15.66:0/407135935 shutdown_connections 2024-05-10T11:15:10.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 -- 172.21.15.66:0/407135935 wait complete. 2024-05-10T11:15:10.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 -- start start 2024-05-10T11:15:10.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.710+0000 7f8e46c18740 1 Processor -- start 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974890 0x5618a596c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 0x5618a596c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5993f50 0x5618a59943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5618a58b0bc0 con 0x5618a5974c70 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5618a586d870 con 0x5618a5993f50 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5618a594c910 con 0x5618a5974890 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e46c18740 10 client.0 _ll_register_callbacks cb 0x5618a58bdb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e413c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 0x5618a596c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e413c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 0x5618a596c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35062/0 (socket says 172.21.15.66:35062) 2024-05-10T11:15:10.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.711+0000 7f8e413c0640 1 -- 172.21.15.66:0/2457939085 learned_addr learned my addr 172.21.15.66:0/2457939085 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5993f50 0x5618a59943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974890 0x5618a596c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e413c0640 1 -- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974890 msgr2=0x5618a596c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e413c0640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974890 0x5618a596c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e413c0640 1 -- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5993f50 msgr2=0x5618a59943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e413c0640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5993f50 0x5618a59943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e413c0640 1 -- 172.21.15.66:0/2457939085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618a568e7b0 con 0x5618a5974c70 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e413c0640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 0x5618a596c950 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02a1e0 tx=0x7f8e2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b171a7d473c4ea1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2457939085 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c037040 con 0x5618a5974c70 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2457939085 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8e2c047480 con 0x5618a5974c70 2024-05-10T11:15:10.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e340607d0 con 0x5618a5974c70 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2457939085 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e2c04f050 con 0x5618a5974c70 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 10 client.5943 fetch_fsmap learned FSMap version 34 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5618a56eef40 con 0x5618a5974c70 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2457939085 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e340607d0 con 0x5618a5974c70 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2457939085 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f8e2c052020 con 0x5618a5974c70 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 10 client.5943 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 10 client.5943 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 20 client.5943 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a5994910 0x5618a59afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 4 client.5943 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.712+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618a58be7d0 con 0x5618a5994910 2024-05-10T11:15:10.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.713+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a5994910 0x5618a59afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.713+0000 7f8e1cff9640 10 client.5943 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.713+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a5994910 0x5618a59afe20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f67afbf62e996c9 server_cookie=6549bad081ea61e9 in_seq=0 out_seq=0 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2457939085 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5618a58be7d0 con 0x5618a5994910 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e1cff9640 10 client.5943 handle_command_reply: tid=0 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 client.5943 shutdown 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 msgr2=0x5618a596c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 0x5618a596c950 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02a1e0 tx=0x7f8e2c004730 comp rx=0 tx=0).stop 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 shutdown_connections 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5993f50 0x5618a59943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a5994910 0x5618a59afe20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5974c70 0x5618a596c950 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2457939085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974890 0x5618a596c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e1cff9640 0 client.5943 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 >> 172.21.15.66:0/2457939085 conn(0x5618a59474f0 msgr2=0x5618a5972f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 shutdown_connections 2024-05-10T11:15:10.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 1 -- 172.21.15.66:0/2457939085 wait complete. 2024-05-10T11:15:10.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.714+0000 7f8e46c18740 20 client.5943 trim_cache size 0 max 16384 2024-05-10T11:15:10.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.732+0000 7f8e46c18740 1 Processor -- start 2024-05-10T11:15:10.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.732+0000 7f8e46c18740 1 -- start start 2024-05-10T11:15:10.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5974000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e46c18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c201e50 con 0x5618a5993f50 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c200ec0 con 0x5618a5974890 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c0a12b0 con 0x5618a5974c70 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35070/0 (socket says 172.21.15.66:35070) 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 -- 172.21.15.66:0/2871376111 learned_addr learned my addr 172.21.15.66:0/2871376111 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e413c0640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5974000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 -- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 msgr2=0x5618a5946250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 -- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 msgr2=0x5618a5974000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.733+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5974000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e423c2640 1 -- 172.21.15.66:0/2871376111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618a5994740 con 0x5618a5993f50 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e413c0640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5974000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8e34063010 tx=0x7f8e34064000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79f0a0c762016a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e1effd640 1 -- 172.21.15.66:0/2871376111 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34079040 con 0x5618a5993f50 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e1effd640 1 -- 172.21.15.66:0/2871376111 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e34082070 con 0x5618a5993f50 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e1effd640 1 -- 172.21.15.66:0/2871376111 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e340607d0 con 0x5618a5993f50 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 -- 172.21.15.66:0/2871376111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 msgr2=0x5618a5946790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8e34063010 tx=0x7f8e34064000 comp rx=0 tx=0).stop 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 -- 172.21.15.66:0/2871376111 shutdown_connections 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2871376111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5974000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 -- 172.21.15.66:0/2871376111 >> 172.21.15.66:0/2871376111 conn(0x5618a59474f0 msgr2=0x5618a5947bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 -- 172.21.15.66:0/2871376111 shutdown_connections 2024-05-10T11:15:10.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.734+0000 7f8e46c18740 1 -- 172.21.15.66:0/2871376111 wait complete. 2024-05-10T11:15:10.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.735+0000 7f8e46c18740 1 -- start start 2024-05-10T11:15:10.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.735+0000 7f8e46c18740 1 Processor -- start 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5a12e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5618a597af10 con 0x5618a5993f50 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c0a1900 con 0x5618a5974890 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5618a5a13350 con 0x5618a5974c70 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e46c18740 10 client.0 _ll_register_callbacks cb 0x7f8e2c0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35072/0 (socket says 172.21.15.66:35072) 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 -- 172.21.15.66:0/2498025321 learned_addr learned my addr 172.21.15.66:0/2498025321 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5a12e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e413c0640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 -- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 msgr2=0x5618a5946250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 -- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 msgr2=0x5618a5a12e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5a12e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.736+0000 7f8e423c2640 1 -- 172.21.15.66:0/2498025321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618a55820a0 con 0x5618a5993f50 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e423c2640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8e340609c0 tx=0x7f8e34011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9569896131d0ff7d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2498025321 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e340607d0 con 0x5618a5993f50 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2498025321 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8e34083e60 con 0x5618a5993f50 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e34082070 con 0x5618a5993f50 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2498025321 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e34064fc0 con 0x5618a5993f50 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 10 client.5949 fetch_fsmap learned FSMap version 34 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5618a598d180 con 0x5618a5993f50 2024-05-10T11:15:10.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2498025321 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e34082070 con 0x5618a5993f50 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2498025321 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f8e34072070 con 0x5618a5993f50 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 10 client.5949 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 10 client.5949 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 20 client.5949 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a594b120 0x5618a594b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 4 client.5949 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x5618a58b8640 con 0x5618a594b120 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.737+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a594b120 0x5618a594b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e1cff9640 10 client.5949 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e41bc1640 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a594b120 0x5618a594b530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e04a1eb0c85c8 server_cookie=e85736cf4a45854b in_seq=0 out_seq=0 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e1cff9640 1 -- 172.21.15.66:0/2498025321 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618a58b8640 con 0x5618a594b120 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e1cff9640 10 client.5949 handle_command_reply: tid=0 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 client.5949 shutdown 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 msgr2=0x5618a5946790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8e340609c0 tx=0x7f8e34011000 comp rx=0 tx=0).stop 2024-05-10T11:15:10.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 shutdown_connections 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5618a594b120 0x5618a594b530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5618a5993f50 0x5618a5946790 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5618a5974c70 0x5618a5946250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e1cff9640 0 client.5949 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 --2- 172.21.15.66:0/2498025321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618a5974890 0x5618a5a12e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.738+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 >> 172.21.15.66:0/2498025321 conn(0x5618a59474f0 msgr2=0x5618a598f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 shutdown_connections 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e46c18740 1 -- 172.21.15.66:0/2498025321 wait complete. 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e46c18740 20 client.5949 trim_cache size 0 max 16384 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:10.745 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:15:10.746 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "1794bfed-16ec-4bcc-ba64-d1c60fdb45c4", 2024-05-10T11:15:10.746 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:15:10.746 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:10.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e200762d0 msgr2=0x7f8e20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e200762d0 0x7f8e20078790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c1f8800 tx=0x7f8e38008040 comp rx=0 tx=0).stop 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 msgr2=0x7f8e3c0ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 0x7f8e3c0ce650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400c7b0 tx=0x7f8e3400cc70 comp rx=0 tx=0).stop 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 shutdown_connections 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e200762d0 0x7f8e20078790 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e3c15f600 0x7f8e3c0ce650 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3c0d3b50 0x7f8e3c0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 --2- 172.21.15.66:0/1761919274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3c0d0b90 0x7f8e3c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 >> 172.21.15.66:0/1761919274 conn(0x7f8e3c09e390 msgr2=0x7f8e3c06e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 shutdown_connections 2024-05-10T11:15:10.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.739+0000 7f8e43e25640 1 -- 172.21.15.66:0/1761919274 wait complete. 2024-05-10T11:15:10.747 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-05-10T11:15:10.739+0000 7f94ca333640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5198=0-4194304@1} caps={5198=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5198 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x557868f50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:15:10.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:10.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T11:15:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.856+0000 7fa3f2f89640 1 Processor -- start 2024-05-10T11:15:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.856+0000 7fa3f2f89640 1 -- start start 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f2f89640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 0x7fa3ec0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f2f89640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f2f89640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa3ec0b2dd0 0x7fa3ec0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f2f89640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa3ec06e720 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f2f89640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa3ec06de80 con 0x7fa3ec0cf3e0 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f2f89640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec06e160 con 0x7fa3ec0cd500 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f1526640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa3ec0b2dd0 0x7fa3ec0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f0d25640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 0x7fa3ec0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:46852/0 (socket says 172.21.15.66:46852) 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f0d25640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 0x7fa3ec0cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:49350/0 (socket says 172.21.15.66:49350) 2024-05-10T11:15:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 -- 172.21.15.66:0/1820557230 learned_addr learned my addr 172.21.15.66:0/1820557230 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f1526640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa3ec0b2dd0 0x7fa3ec0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35080/0 (socket says 172.21.15.66:35080) 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 -- 172.21.15.66:0/1820557230 >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 msgr2=0x7fa3ec0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/1820557230 >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 0x7fa3ec0cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 -- 172.21.15.66:0/1820557230 >> v2:172.21.15.66:3300/0 conn(0x7fa3ec0b2dd0 msgr2=0x7fa3ec0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/1820557230 >> v2:172.21.15.66:3300/0 conn(0x7fa3ec0b2dd0 0x7fa3ec0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3e3fff640 1 -- 172.21.15.66:0/1820557230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec06e440 con 0x7fa3ec0cd500 2024-05-10T11:15:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.857+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/1820557230 >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 0x7fa3ec0cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:10.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.858+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/1820557230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0cfe00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec06fed0 tx=0x7fa3dc02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa6292be5199b989 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.858+0000 7fa3e37fe640 1 -- 172.21.15.66:0/1820557230 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc037070 con 0x7fa3ec0cd500 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.858+0000 7fa3e37fe640 1 -- 172.21.15.66:0/1820557230 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc032440 con 0x7fa3ec0cd500 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.858+0000 7fa3e37fe640 1 -- 172.21.15.66:0/1820557230 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc032810 con 0x7fa3ec0cd500 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 -- 172.21.15.66:0/1820557230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 msgr2=0x7fa3ec0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/1820557230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0cfe00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec06fed0 tx=0x7fa3dc02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 -- 172.21.15.66:0/1820557230 shutdown_connections 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/1820557230 >> v2:172.21.15.66:3300/0 conn(0x7fa3ec0b2dd0 0x7fa3ec0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/1820557230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0cfe00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/1820557230 >> v2:172.21.15.190:3300/0 conn(0x7fa3ec0cf3e0 0x7fa3ec0cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 -- 172.21.15.66:0/1820557230 >> 172.21.15.66:0/1820557230 conn(0x7fa3ec0d2eb0 msgr2=0x7fa3ec0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 -- 172.21.15.66:0/1820557230 shutdown_connections 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.859+0000 7fa3f2f89640 1 -- 172.21.15.66:0/1820557230 wait complete. 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.860+0000 7fa3f2f89640 1 Processor -- start 2024-05-10T11:15:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.860+0000 7fa3f2f89640 1 -- start start 2024-05-10T11:15:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f2f89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 0x7fa3ec1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f2f89640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f2f89640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3ec0cf3e0 0x7fa3ec071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f2f89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b37a0 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f2f89640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b4510 con 0x7fa3ec0cf3e0 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f2f89640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b3920 con 0x7fa3ec0cd500 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 0x7fa3ec1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 0x7fa3ec1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35088/0 (socket says 172.21.15.66:35088) 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 -- 172.21.15.66:0/2275065567 learned_addr learned my addr 172.21.15.66:0/2275065567 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f1526640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3ec0cf3e0 0x7fa3ec071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 -- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 msgr2=0x7fa3ec0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 -- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3ec0cf3e0 msgr2=0x7fa3ec071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3ec0cf3e0 0x7fa3ec071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f0d25640 1 -- 172.21.15.66:0/2275065567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec0c8a10 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.861+0000 7fa3f1526640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3ec0cf3e0 0x7fa3ec071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.862+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 0x7fa3ec1563f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e960 tx=0x7fa3e800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.862+0000 7fa3e17fa640 1 -- 172.21.15.66:0/2275065567 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8017070 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.862+0000 7fa3e17fa640 1 -- 172.21.15.66:0/2275065567 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e800ca00 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.862+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec0c7970 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.862+0000 7fa3e17fa640 1 -- 172.21.15.66:0/2275065567 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800cdd0 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.862+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec0c7f30 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.863+0000 7fa3e17fa640 1 -- 172.21.15.66:0/2275065567 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3e801a070 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.864+0000 7fa3e17fa640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3d80762d0 0x7fa3d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.864+0000 7fa3e17fa640 1 -- 172.21.15.66:0/2275065567 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa3e8097540 con 0x7fa3ec0b2dd0 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.864+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3d80762d0 0x7fa3d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3d80762d0 0x7fa3d8078790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 Processor -- start 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 -- start start 2024-05-10T11:15:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298809a160 0x56298804caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 0x562988051950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562988019690 con 0x56298807cb40 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562987fb6f30 con 0x56298807d280 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562987f6fb20 con 0x56298809a160 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f1526640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 0x562988051950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f1526640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 0x562988051950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35100/0 (socket says 172.21.15.66:35100) 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.865+0000 7fa3f1526640 1 -- 172.21.15.66:0/1872379208 learned_addr learned my addr 172.21.15.66:0/1872379208 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298809a160 0x56298804caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f1526640 1 -- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298809a160 msgr2=0x56298804caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f1526640 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298809a160 0x56298804caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f1526640 1 -- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 msgr2=0x56298807c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f1526640 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f1526640 1 -- 172.21.15.66:0/1872379208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562987f67e60 con 0x56298807cb40 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3f1526640 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 0x562988051950 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40076b0 tx=0x7fa3e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37bdbb1c33c5cc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3d27fc640 1 -- 172.21.15.66:0/1872379208 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e401a020 con 0x56298807cb40 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3d27fc640 1 -- 172.21.15.66:0/1872379208 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e4016800 con 0x56298807cb40 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.866+0000 7fa3d27fc640 1 -- 172.21.15.66:0/1872379208 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4016bd0 con 0x56298807cb40 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1872379208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 msgr2=0x562988051950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 0x562988051950 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40076b0 tx=0x7fa3e400b040 comp rx=0 tx=0).stop 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1872379208 shutdown_connections 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298807cb40 0x562988051950 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1872379208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298809a160 0x56298804caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1872379208 >> 172.21.15.66:0/1872379208 conn(0x56298804ed60 msgr2=0x562988097600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1872379208 shutdown_connections 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1872379208 wait complete. 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.867+0000 7fa3f5d7c740 1 -- start start 2024-05-10T11:15:10.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 Processor -- start 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x56298807e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x562988098c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988099180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562987f735e0 con 0x5629880747c0 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562987fb2ef0 con 0x56298809a160 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562988050f10 con 0x56298807d280 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f5d7c740 10 client.0 _ll_register_callbacks cb 0x562987f6e320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f1526640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988099180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f1526640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988099180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35116/0 (socket says 172.21.15.66:35116) 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.868+0000 7fa3f1526640 1 -- 172.21.15.66:0/3050420193 learned_addr learned my addr 172.21.15.66:0/3050420193 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x56298807e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x562988098c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f1526640 1 -- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 msgr2=0x56298807e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f1526640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x56298807e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f1526640 1 -- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 msgr2=0x562988098c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f1526640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x562988098c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f1526640 1 -- 172.21.15.66:0/3050420193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562987d927d0 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x562988098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f1526640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988099180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4018000 tx=0x7fa3e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0b10b678c2f7f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/3050420193 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4024070 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/3050420193 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa3e401f660 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3e4016800 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/3050420193 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3e402f050 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f5d7c740 10 client.5961 fetch_fsmap learned FSMap version 34 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x562987cc83f0 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/3050420193 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e4016800 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/3050420193 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7fa3e4032020 con 0x5629880747c0 2024-05-10T11:15:10.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f5d7c740 10 client.5961 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.869+0000 7fa3f5d7c740 10 client.5961 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3f5d7c740 20 client.5961 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5629880ab500 0x5629880ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3f5d7c740 4 client.5961 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562987fc4b40 con 0x5629880ab500 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5629880ab500 0x5629880ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3cb7fe640 10 client.5961 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.870+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5629880ab500 0x5629880ab8e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ef94a4d854329c server_cookie=f0d3060199545a in_seq=0 out_seq=0 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/3050420193 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562987fc4b40 con 0x5629880ab500 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3cb7fe640 10 client.5961 handle_command_reply: tid=0 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 client.5961 shutdown 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 msgr2=0x562988099180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988099180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4018000 tx=0x7fa3e4004a40 comp rx=0 tx=0).stop 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 shutdown_connections 2024-05-10T11:15:10.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x5629880ab500 0x5629880ab8e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988099180 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x562988098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3cb7fe640 0 client.5961 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3050420193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x56298807e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 >> 172.21.15.66:0/3050420193 conn(0x56298807cb40 msgr2=0x56298804c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 shutdown_connections 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3050420193 wait complete. 2024-05-10T11:15:10.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.871+0000 7fa3f5d7c740 20 client.5961 trim_cache size 0 max 16384 2024-05-10T11:15:10.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.889+0000 7fa3f5d7c740 1 Processor -- start 2024-05-10T11:15:10.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.889+0000 7fa3f5d7c740 1 -- start start 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988052710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x5629880bb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x5629880bba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec201f00 con 0x5629880747c0 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec200ee0 con 0x56298809a160 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b6c50 con 0x56298807d280 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988052710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988052710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35122/0 (socket says 172.21.15.66:35122) 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 -- 172.21.15.66:0/3095673693 learned_addr learned my addr 172.21.15.66:0/3095673693 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x5629880bb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 -- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 msgr2=0x5629880bb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x5629880bb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f1526640 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x5629880bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 -- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 msgr2=0x5629880bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x5629880bba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 -- 172.21.15.66:0/3095673693 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562987c880f0 con 0x5629880747c0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988052710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8060450 tx=0x7fa3e8095840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2471584008eceb2e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3d1ffb640 1 -- 172.21.15.66:0/3095673693 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8021040 con 0x5629880747c0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3d1ffb640 1 -- 172.21.15.66:0/3095673693 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e8079030 con 0x5629880747c0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.890+0000 7fa3d1ffb640 1 -- 172.21.15.66:0/3095673693 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8069470 con 0x5629880747c0 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3095673693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 msgr2=0x562988052710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988052710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8060450 tx=0x7fa3e8095840 comp rx=0 tx=0).stop 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3095673693 shutdown_connections 2024-05-10T11:15:10.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298809a160 0x5629880bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56298807d280 0x5629880bb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/3095673693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5629880747c0 0x562988052710 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3095673693 >> 172.21.15.66:0/3095673693 conn(0x56298807cb40 msgr2=0x562988098b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3095673693 shutdown_connections 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/3095673693 wait complete. 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.891+0000 7fa3f5d7c740 1 -- start start 2024-05-10T11:15:10.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 Processor -- start 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629880747c0 0x56298804b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 0x56298808ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56298807c640 con 0x56298809a160 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec2008c0 con 0x56298807d280 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.892+0000 7fa3f5d7c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5629880994e0 con 0x5629880747c0 2024-05-10T11:15:10.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f5d7c740 10 client.0 _ll_register_callbacks cb 0x7fa3dc040050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 0x56298808ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 0x56298808ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35128/0 (socket says 172.21.15.66:35128) 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 -- 172.21.15.66:0/1929073474 learned_addr learned my addr 172.21.15.66:0/1929073474 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629880747c0 0x56298804b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3e3fff640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 -- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629880747c0 msgr2=0x56298804b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629880747c0 0x56298804b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 -- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 msgr2=0x56298807ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 -- 172.21.15.66:0/1929073474 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562988080440 con 0x56298809a160 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f1526640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 0x56298808ea10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4002230 tx=0x7fa3e400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955ea0581969c632 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/1929073474 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4024070 con 0x56298809a160 2024-05-10T11:15:10.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/1929073474 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa3e401fdb0 con 0x56298809a160 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3e8079030 con 0x56298809a160 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/1929073474 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3e403b050 con 0x56298809a160 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f5d7c740 10 client.5967 fetch_fsmap learned FSMap version 34 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x56298804c080 con 0x56298809a160 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.893+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/1929073474 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e8079030 con 0x56298809a160 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/1929073474 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7fa3e403e020 con 0x56298809a160 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 10 client.5967 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 10 client.5967 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 20 client.5967 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x56298808d6a0 0x562988114550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 4 client.5967 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562987fbe9b0 con 0x56298808d6a0 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x56298808d6a0 0x562988114550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3cb7fe640 10 client.5967 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f0d25640 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x56298808d6a0 0x562988114550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33350baef250a569 server_cookie=2446b6592bc0e93c in_seq=0 out_seq=0 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3cb7fe640 1 -- 172.21.15.66:0/1929073474 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+253 (crc 0 0 0) 0x562987fbe9b0 con 0x56298808d6a0 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3cb7fe640 10 client.5967 handle_command_reply: tid=0 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 1 client.5967 shutdown 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 msgr2=0x56298808ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.894+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 0x56298808ea10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4002230 tx=0x7fa3e400d040 comp rx=0 tx=0).stop 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 shutdown_connections 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x56298808d6a0 0x562988114550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56298809a160 0x56298808ea10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56298807d280 0x56298807ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3cb7fe640 0 client.5967 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 --2- 172.21.15.66:0/1929073474 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629880747c0 0x56298804b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 >> 172.21.15.66:0/1929073474 conn(0x56298807cb40 msgr2=0x56298808cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 shutdown_connections 2024-05-10T11:15:10.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 1 -- 172.21.15.66:0/1929073474 wait complete. 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f5d7c740 20 client.5967 trim_cache size 0 max 16384 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout: "1794bfed-16ec-4bcc-ba64-d1c60fdb45c4": { 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "1794bfed-16ec-4bcc-ba64-d1c60fdb45c4", 2024-05-10T11:15:10.902 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive" 2024-05-10T11:15:10.903 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:15:10.903 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:15:10.903 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:10.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3d80762d0 msgr2=0x7fa3d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3d80762d0 0x7fa3d8078790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc02e000 comp rx=0 tx=0).stop 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 msgr2=0x7fa3ec1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 0x7fa3ec1563f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e960 tx=0x7fa3e800ee20 comp rx=0 tx=0).stop 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 shutdown_connections 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa3d80762d0 0x7fa3d8078790 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3ec0cf3e0 0x7fa3ec071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3ec0cd500 0x7fa3ec0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 --2- 172.21.15.66:0/2275065567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3ec0b2dd0 0x7fa3ec1563f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 >> 172.21.15.66:0/2275065567 conn(0x7fa3ec0d2eb0 msgr2=0x7fa3ec0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 shutdown_connections 2024-05-10T11:15:10.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:10.895+0000 7fa3f2f89640 1 -- 172.21.15.66:0/2275065567 wait complete. 2024-05-10T11:15:10.906 INFO:tasks.cephfs.filesystem:scrub status for tag:1794bfed-16ec-4bcc-ba64-d1c60fdb45c4 - {'path': '/', 'tag': '1794bfed-16ec-4bcc-ba64-d1c60fdb45c4', 'options': 'recursive'} 2024-05-10T11:15:14.609 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:15:14.609+0000 7fa7d81b5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T11:15:31.684 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:15:31.687 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:15:40.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:40.908 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T11:15:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.027+0000 7f429fa37640 1 Processor -- start 2024-05-10T11:15:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 -- start start 2024-05-10T11:15:41.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f429815f410 0x7f42980d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f42980d0f10 0x7f42980b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42980b54d0 0x7f42980d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f42980d2800 con 0x7f429815f410 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f42980d2ae0 con 0x7f42980d0f10 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.028+0000 7f429fa37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f42980d01d0 con 0x7f42980b54d0 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f429815f410 0x7f42980d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f429815f410 0x7f42980d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55908/0 (socket says 172.21.15.66:55908) 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 -- 172.21.15.66:0/944208268 learned_addr learned my addr 172.21.15.66:0/944208268 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429cfd2640 1 --2- 172.21.15.66:0/944208268 >> v2:172.21.15.190:3300/0 conn(0x7f42980d0f10 0x7f42980b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429dfd4640 1 --2- 172.21.15.66:0/944208268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42980b54d0 0x7f42980d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 -- 172.21.15.66:0/944208268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42980b54d0 msgr2=0x7f42980d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 --2- 172.21.15.66:0/944208268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42980b54d0 0x7f42980d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 -- 172.21.15.66:0/944208268 >> v2:172.21.15.190:3300/0 conn(0x7f42980d0f10 msgr2=0x7f42980b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 --2- 172.21.15.66:0/944208268 >> v2:172.21.15.190:3300/0 conn(0x7f42980d0f10 0x7f42980b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429d7d3640 1 -- 172.21.15.66:0/944208268 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42980d04b0 con 0x7f429815f410 2024-05-10T11:15:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.029+0000 7f429cfd2640 1 --2- 172.21.15.66:0/944208268 >> v2:172.21.15.190:3300/0 conn(0x7f42980d0f10 0x7f42980b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.030+0000 7f429d7d3640 1 --2- 172.21.15.66:0/944208268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f429815f410 0x7f42980d09d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f42980b7ee0 tx=0x7f429002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d384e041a32dc0e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.030+0000 7f4297fff640 1 -- 172.21.15.66:0/944208268 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290037070 con 0x7f429815f410 2024-05-10T11:15:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.030+0000 7f4297fff640 1 -- 172.21.15.66:0/944208268 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4290032440 con 0x7f429815f410 2024-05-10T11:15:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.030+0000 7f4297fff640 1 -- 172.21.15.66:0/944208268 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290032810 con 0x7f429815f410 2024-05-10T11:15:41.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 -- 172.21.15.66:0/944208268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f429815f410 msgr2=0x7f42980d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 --2- 172.21.15.66:0/944208268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f429815f410 0x7f42980d09d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f42980b7ee0 tx=0x7f429002a140 comp rx=0 tx=0).stop 2024-05-10T11:15:41.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 -- 172.21.15.66:0/944208268 shutdown_connections 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 --2- 172.21.15.66:0/944208268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42980b54d0 0x7f42980d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 --2- 172.21.15.66:0/944208268 >> v2:172.21.15.190:3300/0 conn(0x7f42980d0f10 0x7f42980b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 --2- 172.21.15.66:0/944208268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f429815f410 0x7f42980d09d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 -- 172.21.15.66:0/944208268 >> 172.21.15.66:0/944208268 conn(0x7f429808ed30 msgr2=0x7f429809e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 -- 172.21.15.66:0/944208268 shutdown_connections 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.031+0000 7f429fa37640 1 -- 172.21.15.66:0/944208268 wait complete. 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.032+0000 7f429fa37640 1 Processor -- start 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.032+0000 7f429fa37640 1 -- start start 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429fa37640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 0x7f42981539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429fa37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42980d0f10 0x7f42980b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429fa37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f429815f410 0x7f42980b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429fa37640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f42980cffb0 con 0x7f42980b54d0 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429fa37640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f42980cfe30 con 0x7f42980d0f10 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429fa37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f42980d3c10 con 0x7f429815f410 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 0x7f42981539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 0x7f42981539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55912/0 (socket says 172.21.15.66:55912) 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 -- 172.21.15.66:0/2717194630 learned_addr learned my addr 172.21.15.66:0/2717194630 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429dfd4640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f429815f410 0x7f42980b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429cfd2640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42980d0f10 0x7f42980b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 -- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f429815f410 msgr2=0x7f42980b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f429815f410 0x7f42980b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 -- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42980d0f10 msgr2=0x7f42980b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42980d0f10 0x7f42980b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 -- 172.21.15.66:0/2717194630 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42980b7fe0 con 0x7f42980b54d0 2024-05-10T11:15:41.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429dfd4640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f429815f410 0x7f42980b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.033+0000 7f429d7d3640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 0x7f42981539c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f429002a180 tx=0x7f42900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.034+0000 7f4295ffb640 1 -- 172.21.15.66:0/2717194630 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290041020 con 0x7f42980b54d0 2024-05-10T11:15:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.034+0000 7f4295ffb640 1 -- 172.21.15.66:0/2717194630 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42900306c0 con 0x7f42980b54d0 2024-05-10T11:15:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.034+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42980b82c0 con 0x7f42980b54d0 2024-05-10T11:15:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.034+0000 7f4295ffb640 1 -- 172.21.15.66:0/2717194630 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290037040 con 0x7f42980b54d0 2024-05-10T11:15:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.034+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42980b8880 con 0x7f42980b54d0 2024-05-10T11:15:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.036+0000 7f4295ffb640 1 -- 172.21.15.66:0/2717194630 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4290044020 con 0x7f42980b54d0 2024-05-10T11:15:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.036+0000 7f4295ffb640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42840762d0 0x7f4284078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.036+0000 7f4295ffb640 1 -- 172.21.15.66:0/2717194630 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f42900b7ff0 con 0x7f42980b54d0 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.036+0000 7f429cfd2640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42840762d0 0x7f4284078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.037+0000 7f42a282c740 1 Processor -- start 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.037+0000 7f42a282c740 1 -- start start 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.037+0000 7f429cfd2640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42840762d0 0x7f4284078790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f428c006fd0 tx=0x7f428c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f016819af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016849600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f42a282c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 0x55f01681e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f42a282c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0167e6690 con 0x55f016849b40 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f016783f30 con 0x55f016867160 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f01673cb20 con 0x55f01684a280 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 0x55f01681e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 0x55f01681e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55916/0 (socket says 172.21.15.66:55916) 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 -- 172.21.15.66:0/369007502 learned_addr learned my addr 172.21.15.66:0/369007502 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429d7d3640 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f016819af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429cfd2640 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016849600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 -- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 msgr2=0x55f016849600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016849600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 -- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 msgr2=0x55f016819af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f016819af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 -- 172.21.15.66:0/369007502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f016734e60 con 0x55f016849b40 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f429dfd4640 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 0x55f01681e950 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4288007390 tx=0x7f4288007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e47ac6a6df2b6ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.038+0000 7f427effd640 1 -- 172.21.15.66:0/369007502 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428801a070 con 0x55f016849b40 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f427effd640 1 -- 172.21.15.66:0/369007502 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4288003da0 con 0x55f016849b40 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f427effd640 1 -- 172.21.15.66:0/369007502 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288004230 con 0x55f016849b40 2024-05-10T11:15:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 -- 172.21.15.66:0/369007502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 msgr2=0x55f01681e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 0x55f01681e950 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4288007390 tx=0x7f4288007850 comp rx=0 tx=0).stop 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 -- 172.21.15.66:0/369007502 shutdown_connections 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f016849b40 0x55f01681e950 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016849600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 --2- 172.21.15.66:0/369007502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f016819af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 -- 172.21.15.66:0/369007502 >> 172.21.15.66:0/369007502 conn(0x55f01681bd60 msgr2=0x55f016864600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 -- 172.21.15.66:0/369007502 shutdown_connections 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.039+0000 7f42a282c740 1 -- 172.21.15.66:0/369007502 wait complete. 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.040+0000 7f42a282c740 1 -- start start 2024-05-10T11:15:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.040+0000 7f42a282c740 1 Processor -- start 2024-05-10T11:15:41.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f01684a280 0x55f016865b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f016867160 0x55f01684ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01684cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0167405e0 con 0x55f0168753a0 2024-05-10T11:15:41.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f01677fef0 con 0x55f01684a280 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f01681df10 con 0x55f016867160 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f42a282c740 10 client.0 _ll_register_callbacks cb 0x55f01673b320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01684cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01684cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55924/0 (socket says 172.21.15.66:55924) 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 -- 172.21.15.66:0/4144393748 learned_addr learned my addr 172.21.15.66:0/4144393748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429cfd2640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f016867160 0x55f01684ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429d7d3640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f01684a280 0x55f016865b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 -- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f016867160 msgr2=0x55f01684ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f016867160 0x55f01684ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 -- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f01684a280 msgr2=0x55f016865b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f01684a280 0x55f016865b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 -- 172.21.15.66:0/4144393748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01655f7d0 con 0x55f0168753a0 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f429dfd4640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01684cfa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4288018040 tx=0x7f4288004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f51e69876c883c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.041+0000 7f4277fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f4277fff640 1 -- 172.21.15.66:0/4144393748 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288025020 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f4277fff640 1 -- 172.21.15.66:0/4144393748 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f4288004670 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4288003da0 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f4277fff640 1 -- 172.21.15.66:0/4144393748 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f428802f050 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 10 client.5979 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55f0164953f0 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f4277fff640 1 -- 172.21.15.66:0/4144393748 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4288003da0 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f4277fff640 1 -- 172.21.15.66:0/4144393748 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f4288032020 con 0x55f0168753a0 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 10 client.5979 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 10 client.5979 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 20 client.5979 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016877c10 0x55f016878030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 4 client.5979 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f016791b40 con 0x55f016877c10 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.042+0000 7f429d7d3640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016877c10 0x55f016878030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.043+0000 7f429d7d3640 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016877c10 0x55f016878030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fcba44ac5f13721 server_cookie=dad097a0fde6a87a in_seq=0 out_seq=0 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.043+0000 7f4277fff640 10 client.5979 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.043+0000 7f4277fff640 1 -- 172.21.15.66:0/4144393748 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f016791b40 con 0x55f016877c10 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.043+0000 7f4277fff640 10 client.5979 handle_command_reply: tid=0 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 client.5979 shutdown 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 msgr2=0x55f01684cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01684cfa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4288018040 tx=0x7f4288004ab0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 shutdown_connections 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016877c10 0x55f016878030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01684cfa0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f016867160 0x55f01684ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 --2- 172.21.15.66:0/4144393748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f01684a280 0x55f016865b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 >> 172.21.15.66:0/4144393748 conn(0x55f016849b40 msgr2=0x55f01681d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f4277fff640 0 client.5979 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 shutdown_connections 2024-05-10T11:15:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 1 -- 172.21.15.66:0/4144393748 wait complete. 2024-05-10T11:15:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.044+0000 7f42a282c740 20 client.5979 trim_cache size 0 max 16384 2024-05-10T11:15:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.062+0000 7f42a282c740 1 Processor -- start 2024-05-10T11:15:41.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.062+0000 7f42a282c740 1 -- start start 2024-05-10T11:15:41.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f42a282c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 0x55f0168887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f01681f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f0168753a0 0x55f01681f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f42a282c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4298202170 con 0x55f01684a280 2024-05-10T11:15:41.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4298201150 con 0x55f016867160 2024-05-10T11:15:41.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f42980ba2f0 con 0x55f0168753a0 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 0x55f0168887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 0x55f0168887b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55932/0 (socket says 172.21.15.66:55932) 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 -- 172.21.15.66:0/3863076015 learned_addr learned my addr 172.21.15.66:0/3863076015 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429cfd2640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f01681f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429dfd4640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f0168753a0 0x55f01681f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 -- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f0168753a0 msgr2=0x55f01681f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f0168753a0 0x55f01681f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 -- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 msgr2=0x55f01681f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f01681f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429d7d3640 1 -- 172.21.15.66:0/3863076015 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0164550f0 con 0x55f01684a280 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429cfd2640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f01681f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.063+0000 7f429dfd4640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f0168753a0 0x55f01681f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f429d7d3640 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 0x55f0168887b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4290081050 tx=0x7f42900b6260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e054559601cddb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f427e7fc640 1 -- 172.21.15.66:0/3863076015 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900810c0 con 0x55f01684a280 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f427e7fc640 1 -- 172.21.15.66:0/3863076015 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4290085470 con 0x55f01684a280 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f427e7fc640 1 -- 172.21.15.66:0/3863076015 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290089e90 con 0x55f01684a280 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 -- 172.21.15.66:0/3863076015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 msgr2=0x55f0168887b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 0x55f0168887b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4290081050 tx=0x7f42900b6260 comp rx=0 tx=0).stop 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 -- 172.21.15.66:0/3863076015 shutdown_connections 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f0168753a0 0x55f01681f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f01681f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 --2- 172.21.15.66:0/3863076015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f01684a280 0x55f0168887b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 -- 172.21.15.66:0/3863076015 >> 172.21.15.66:0/3863076015 conn(0x55f016849b40 msgr2=0x55f016866470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 -- 172.21.15.66:0/3863076015 shutdown_connections 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.064+0000 7f42a282c740 1 -- 172.21.15.66:0/3863076015 wait complete. 2024-05-10T11:15:41.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.065+0000 7f42a282c740 1 -- start start 2024-05-10T11:15:41.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.065+0000 7f42a282c740 1 Processor -- start 2024-05-10T11:15:41.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016859f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f0168458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01681f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f01681a3c0 con 0x55f0168753a0 2024-05-10T11:15:41.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4298200a80 con 0x55f016867160 2024-05-10T11:15:41.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f01681a600 con 0x55f01684a280 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f42a282c740 10 client.0 _ll_register_callbacks cb 0x7f4288018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01681f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01681f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55940/0 (socket says 172.21.15.66:55940) 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 -- 172.21.15.66:0/2778183781 learned_addr learned my addr 172.21.15.66:0/2778183781 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429cfd2640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f0168458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429d7d3640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016859f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 -- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 msgr2=0x55f016859f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016859f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 -- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 msgr2=0x55f0168458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f0168458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 -- 172.21.15.66:0/2778183781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01681fc50 con 0x55f0168753a0 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f429dfd4640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01681f710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f428802d040 tx=0x7f428800d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c3ac1eb7a5af04 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.066+0000 7f4277fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f4277fff640 1 -- 172.21.15.66:0/2778183781 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288038060 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f4277fff640 1 -- 172.21.15.66:0/2778183781 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f428802a530 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4290085470 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f4277fff640 1 -- 172.21.15.66:0/2778183781 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f428803e050 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 10 client.5985 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55f016818ed0 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f4277fff640 1 -- 172.21.15.66:0/2778183781 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4290085470 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f4277fff640 1 -- 172.21.15.66:0/2778183781 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f4288041020 con 0x55f0168753a0 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 10 client.5985 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 10 client.5985 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 20 client.5985 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016887db0 0x55f016888190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 4 client.5985 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:15:41.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f01678b9b0 con 0x55f016887db0 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.067+0000 7f429d7d3640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016887db0 0x55f016888190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f429d7d3640 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016887db0 0x55f016888190 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e9325014278e85c server_cookie=2db48326954b4ecf in_seq=0 out_seq=0 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f4277fff640 10 client.5985 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f4277fff640 1 -- 172.21.15.66:0/2778183781 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f01678b9b0 con 0x55f016887db0 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f4277fff640 10 client.5985 handle_command_reply: tid=0 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 client.5985 shutdown 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 msgr2=0x55f01681f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01681f710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f428802d040 tx=0x7f428800d000 comp rx=0 tx=0).stop 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 shutdown_connections 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55f016887db0 0x55f016888190 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0168753a0 0x55f01681f710 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f016867160 0x55f0168458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 --2- 172.21.15.66:0/2778183781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f01684a280 0x55f016859f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f4277fff640 0 client.5985 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 >> 172.21.15.66:0/2778183781 conn(0x55f016849b40 msgr2=0x55f016844f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 shutdown_connections 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 1 -- 172.21.15.66:0/2778183781 wait complete. 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.068+0000 7f42a282c740 20 client.5985 trim_cache size 0 max 16384 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:15:41.074 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:41.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42840762d0 msgr2=0x7f4284078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42840762d0 0x7f4284078790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f428c006fd0 tx=0x7f428c008040 comp rx=0 tx=0).stop 2024-05-10T11:15:41.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 msgr2=0x7f42981539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 0x7f42981539c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f429002a180 tx=0x7f42900046c0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 shutdown_connections 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42840762d0 0x7f4284078790 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f429815f410 0x7f42980b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42980d0f10 0x7f42980b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 --2- 172.21.15.66:0/2717194630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42980b54d0 0x7f42981539c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 >> 172.21.15.66:0/2717194630 conn(0x7f429808ed30 msgr2=0x7f429806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 shutdown_connections 2024-05-10T11:15:41.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.069+0000 7f429fa37640 1 -- 172.21.15.66:0/2717194630 wait complete. 2024-05-10T11:15:41.079 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:15:41.079 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:15:41.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.184+0000 7f123212b640 1 Processor -- start 2024-05-10T11:15:41.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.184+0000 7f123212b640 1 -- start start 2024-05-10T11:15:41.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f123212b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f122c163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f123212b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f122c070bd0 0x7f122c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f123212b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122c163ba0 con 0x7f122c15f620 2024-05-10T11:15:41.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f123212b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f122c06cd70 con 0x7f122c070bd0 2024-05-10T11:15:41.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f123212b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f122c160190 con 0x7f122c06c990 2024-05-10T11:15:41.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f1222ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f122c15f620 0x7f122c0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47044/0 (socket says 172.21.15.66:47044) 2024-05-10T11:15:41.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f1222ffd640 1 -- 172.21.15.66:0/2276980891 learned_addr learned my addr 172.21.15.66:0/2276980891 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:41.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808909155 0 0) 0x7f122c163ba0 con 0x7f122c15f620 2024-05-10T11:15:41.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122b7fe640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f122c163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122bfff640 1 --2- 172.21.15.66:0/2276980891 >> v2:172.21.15.190:3300/0 conn(0x7f122c070bd0 0x7f122c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1218003520 con 0x7f122c15f620 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2274963583 0 0) 0x7f1218003520 con 0x7f122c15f620 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 msgr2=0x7f122c163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f122c163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 >> v2:172.21.15.190:3300/0 conn(0x7f122c070bd0 msgr2=0x7f122c15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 --2- 172.21.15.66:0/2276980891 >> v2:172.21.15.190:3300/0 conn(0x7f122c070bd0 0x7f122c15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c160470 con 0x7f122c15f620 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f1214001690 con 0x7f122c15f620 2024-05-10T11:15:41.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122b7fe640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f122c163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 >> v1:172.21.15.66:6789/0 conn(0x7f122c15f620 legacy=0x7f122c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12180039b0 0x7f1218003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f1218004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f12180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f122c06cd70 con 0x7f1218004800 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f122c160190 con 0x7f12180039b0 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.185+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f121800b9c0 con 0x7f122c06c990 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f1222ffd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f1218004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f122b7fe640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12180039b0 0x7f1218003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f122bfff640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f12180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f1222ffd640 1 -- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 msgr2=0x7f12180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f1222ffd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f12180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f1222ffd640 1 -- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12180039b0 msgr2=0x7f1218003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f1222ffd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12180039b0 0x7f1218003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f1222ffd640 1 -- 172.21.15.66:0/2276980891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218003520 con 0x7f1218004800 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.186+0000 7f122bfff640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c06c990 0x7f12180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f1222ffd640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f1218004c80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f121400c210 tx=0x7f1218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee74a1909c948e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214007d60 con 0x7f1218004800 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1214005af0 con 0x7f1218004800 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f122affd640 1 -- 172.21.15.66:0/2276980891 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214007070 con 0x7f1218004800 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f123212b640 1 -- 172.21.15.66:0/2276980891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 msgr2=0x7f1218004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f123212b640 1 --2- 172.21.15.66:0/2276980891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f1218004c80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f121400c210 tx=0x7f1218005830 comp rx=0 tx=0).stop 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f122bfff640 1 -- 172.21.15.66:0/2276980891 reap_dead start 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f123212b640 1 -- 172.21.15.66:0/2276980891 shutdown_connections 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f123212b640 1 -- 172.21.15.66:0/2276980891 >> 172.21.15.66:0/2276980891 conn(0x7f122c0b3980 msgr2=0x7f122c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f123212b640 1 -- 172.21.15.66:0/2276980891 shutdown_connections 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.187+0000 7f123212b640 1 -- 172.21.15.66:0/2276980891 wait complete. 2024-05-10T11:15:41.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 Processor -- start 2024-05-10T11:15:41.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 -- start start 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f122c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f122c14e6e0 0x7f122c161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c14eb60 0x7f122c161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f122c073e70 con 0x7f1218004800 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f122c163140 con 0x7f122c14e6e0 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.189+0000 7f123212b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f122c163660 con 0x7f122c14eb60 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f122c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f122c0b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55952/0 (socket says 172.21.15.66:55952) 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 -- 172.21.15.66:0/997141708 learned_addr learned my addr 172.21.15.66:0/997141708 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 -- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c14eb60 msgr2=0x7f122c161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c14eb60 0x7f122c161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 -- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f122c14e6e0 msgr2=0x7f122c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f122c14e6e0 0x7f122c161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 -- 172.21.15.66:0/997141708 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c0b56c0 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f122b7fe640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f122c0b6760 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f121c011930 tx=0x7f121c011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c00fa70 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c00fc10 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122c0b59a0 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c004030 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.190+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122c0b5f60 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.191+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122c06a220 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.192+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f121c012040 con 0x7f1218004800 2024-05-10T11:15:41.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.192+0000 7f1228ff9640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f120c076300 0x7f120c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.192+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f121c0979c0 con 0x7f1218004800 2024-05-10T11:15:41.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.192+0000 7f1222ffd640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f120c076300 0x7f120c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.193+0000 7f1222ffd640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f120c076300 0x7f120c0787c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1214033000 tx=0x7f1214007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.197+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f121c099e20 con 0x7f1218004800 2024-05-10T11:15:41.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.426+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f122c073540 con 0x7f1218004800 2024-05-10T11:15:41.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.426+0000 7f1228ff9640 1 -- 172.21.15.66:0/997141708 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5185 (secure 0 0 0) 0x7f121c019070 con 0x7f1218004800 2024-05-10T11:15:41.426 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:41.426 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:14.318937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:15:41.426 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 35 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f120c076300 msgr2=0x7f120c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f120c076300 0x7f120c0787c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1214033000 tx=0x7f1214007000 comp rx=0 tx=0).stop 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 msgr2=0x7f122c0b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f122c0b6760 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f121c011930 tx=0x7f121c011df0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 shutdown_connections 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f120c076300 0x7f120c0787c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f122c14eb60 0x7f122c161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f122c14e6e0 0x7f122c161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 --2- 172.21.15.66:0/997141708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1218004800 0x7f122c0b6760 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 >> 172.21.15.66:0/997141708 conn(0x7f122c0b3980 msgr2=0x7f122c0b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 shutdown_connections 2024-05-10T11:15:41.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.428+0000 7f123212b640 1 -- 172.21.15.66:0/997141708 wait complete. 2024-05-10T11:15:41.439 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage ls --format=json-pretty 2024-05-10T11:15:41.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 Processor -- start 2024-05-10T11:15:41.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 -- start start 2024-05-10T11:15:41.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9c2c162a80 0x7f9c2c0d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c2c0cfc00 0x7f9c2c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2c0d3410 con 0x7f9c2c0d1720 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c0b64b0 con 0x7f9c2c162a80 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.545+0000 7f9c32f24640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c0d08d0 con 0x7f9c2c0cfc00 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c30cc0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9c2c162a80 0x7f9c2c0d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c314c1640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9c2c0d1720 0x7f9c2c0d1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47052/0 (socket says 172.21.15.66:47052) 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c314c1640 1 -- 172.21.15.66:0/1706844607 learned_addr learned my addr 172.21.15.66:0/1706844607 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c30cc0640 1 -- 172.21.15.66:0/1706844607 >> v2:172.21.15.190:3300/0 conn(0x7f9c2c0cfc00 msgr2=0x7f9c2c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/1706844607 >> v2:172.21.15.190:3300/0 conn(0x7f9c2c0cfc00 0x7f9c2c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c2b7fe640 1 -- 172.21.15.66:0/1706844607 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834134974 0 0) 0x7f9c2c0d3410 con 0x7f9c2c0d1720 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/1706844607 >> v2:172.21.15.190:3300/0 conn(0x7f9c2c0cfc00 0x7f9c2c0d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c30cc0640 1 -- 172.21.15.66:0/1706844607 >> v1:172.21.15.66:6789/0 conn(0x7f9c2c0d1720 legacy=0x7f9c2c0d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.546+0000 7f9c30cc0640 1 -- 172.21.15.66:0/1706844607 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c0d0bb0 con 0x7f9c2c162a80 2024-05-10T11:15:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/1706844607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c162a80 0x7f9c2c0d2ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0d1360 tx=0x7f9c1402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58720c416d3e70c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c2b7fe640 1 -- 172.21.15.66:0/1706844607 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14037070 con 0x7f9c2c162a80 2024-05-10T11:15:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c2b7fe640 1 -- 172.21.15.66:0/1706844607 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c14032440 con 0x7f9c2c162a80 2024-05-10T11:15:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c2b7fe640 1 -- 172.21.15.66:0/1706844607 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14032810 con 0x7f9c2c162a80 2024-05-10T11:15:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c32f24640 1 -- 172.21.15.66:0/1706844607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c162a80 msgr2=0x7f9c2c0d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c32f24640 1 --2- 172.21.15.66:0/1706844607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c162a80 0x7f9c2c0d2ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0d1360 tx=0x7f9c1402a230 comp rx=0 tx=0).stop 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c32f24640 1 -- 172.21.15.66:0/1706844607 shutdown_connections 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c32f24640 1 --2- 172.21.15.66:0/1706844607 >> v2:172.21.15.190:3300/0 conn(0x7f9c2c0cfc00 0x7f9c2c0d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c32f24640 1 --2- 172.21.15.66:0/1706844607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c162a80 0x7f9c2c0d2ed0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.547+0000 7f9c32f24640 1 -- 172.21.15.66:0/1706844607 >> 172.21.15.66:0/1706844607 conn(0x7f9c2c0d50f0 msgr2=0x7f9c2c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.548+0000 7f9c32f24640 1 -- 172.21.15.66:0/1706844607 shutdown_connections 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.548+0000 7f9c32f24640 1 -- 172.21.15.66:0/1706844607 wait complete. 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.549+0000 7f9c32f24640 1 Processor -- start 2024-05-10T11:15:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.549+0000 7f9c32f24640 1 -- start start 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c0cfc00 0x7f9c2c14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 0x7f9c2c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2c162a80 0x7f9c2c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c0b6140 con 0x7f9c2c0d1720 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c0b6790 con 0x7f9c2c0cfc00 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c0d5e40 con 0x7f9c2c162a80 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 0x7f9c2c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 0x7f9c2c15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55982/0 (socket says 172.21.15.66:55982) 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 -- 172.21.15.66:0/3025035590 learned_addr learned my addr 172.21.15.66:0/3025035590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c0cfc00 0x7f9c2c14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c314c1640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2c162a80 0x7f9c2c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 -- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2c162a80 msgr2=0x7f9c2c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2c162a80 0x7f9c2c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 -- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c0cfc00 msgr2=0x7f9c2c14d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c0cfc00 0x7f9c2c14d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 -- 172.21.15.66:0/3025035590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c15c630 con 0x7f9c2c0d1720 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 0x7f9c2c15b8c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00ccd0 tx=0x7f9c1c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c297fa640 1 -- 172.21.15.66:0/3025035590 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c003990 con 0x7f9c2c0d1720 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c297fa640 1 -- 172.21.15.66:0/3025035590 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c003b30 con 0x7f9c2c0d1720 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c15c910 con 0x7f9c2c0d1720 2024-05-10T11:15:41.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.550+0000 7f9c297fa640 1 -- 172.21.15.66:0/3025035590 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c004020 con 0x7f9c2c0d1720 2024-05-10T11:15:41.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.551+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c15ced0 con 0x7f9c2c0d1720 2024-05-10T11:15:41.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.552+0000 7f9c297fa640 1 -- 172.21.15.66:0/3025035590 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c1c0041c0 con 0x7f9c2c0d1720 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.553+0000 7f9c297fa640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c0c076300 0x7f9c0c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.553+0000 7f9c297fa640 1 -- 172.21.15.66:0/3025035590 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f9c1c097cd0 con 0x7f9c2c0d1720 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.553+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c0c076300 0x7f9c0c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.553+0000 7f9c35c40740 1 Processor -- start 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.553+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c0c076300 0x7f9c0c0787c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c14034000 tx=0x7f9c1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.553+0000 7f9c35c40740 1 -- start start 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cba6d0 0x557dc1c6d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c9cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 0x557dc1c71ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c35c40740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557dc1b5d920 con 0x557dc1c9d0b0 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557dc1bd2dd0 con 0x557dc1cba6d0 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557dc1b833e0 con 0x557dc1c9d7f0 2024-05-10T11:15:41.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c314c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 0x557dc1c71ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c314c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 0x557dc1c71ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55994/0 (socket says 172.21.15.66:55994) 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c314c1640 1 -- 172.21.15.66:0/2517481619 learned_addr learned my addr 172.21.15.66:0/2517481619 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cba6d0 0x557dc1c6d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.554+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c9cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c314c1640 1 -- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 msgr2=0x557dc1c9cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c314c1640 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c9cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c314c1640 1 -- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cba6d0 msgr2=0x557dc1c6d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c314c1640 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cba6d0 0x557dc1c6d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c314c1640 1 -- 172.21.15.66:0/2517481619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc19b47c0 con 0x557dc1c9d0b0 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cba6d0 0x557dc1c6d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c314c1640 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 0x557dc1c71ec0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c24007400 tx=0x7f9c24005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa91eb07f9b03c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c227fc640 1 -- 172.21.15.66:0/2517481619 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24019070 con 0x557dc1c9d0b0 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c227fc640 1 -- 172.21.15.66:0/2517481619 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24005e10 con 0x557dc1c9d0b0 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c227fc640 1 -- 172.21.15.66:0/2517481619 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24001ad0 con 0x557dc1c9d0b0 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c35c40740 1 -- 172.21.15.66:0/2517481619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 msgr2=0x557dc1c71ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.555+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 0x557dc1c71ec0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c24007400 tx=0x7f9c24005bc0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 -- 172.21.15.66:0/2517481619 shutdown_connections 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1c9d0b0 0x557dc1c71ec0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c9cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2517481619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cba6d0 0x557dc1c6d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 -- 172.21.15.66:0/2517481619 >> 172.21.15.66:0/2517481619 conn(0x557dc1c6f560 msgr2=0x557dc1cb7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 -- 172.21.15.66:0/2517481619 shutdown_connections 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 -- 172.21.15.66:0/2517481619 wait complete. 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 -- start start 2024-05-10T11:15:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.556+0000 7f9c35c40740 1 Processor -- start 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c8d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cb7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1c9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557dc1bdb440 con 0x557dc1cba6d0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557dc1bd6120 con 0x557dc1cb83c0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557dc1be4210 con 0x557dc1c9d7f0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c35c40740 10 client.0 _ll_register_callbacks cb 0x557dc1b7b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cb7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cb7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55996/0 (socket says 172.21.15.66:55996) 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c2bfff640 1 -- 172.21.15.66:0/2767066316 learned_addr learned my addr 172.21.15.66:0/2767066316 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c8d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.557+0000 7f9c314c1640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1c9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c2bfff640 1 -- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 msgr2=0x557dc1c8d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c8d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c2bfff640 1 -- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 msgr2=0x557dc1c9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1c9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c2bfff640 1 -- 172.21.15.66:0/2767066316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc1a14f50 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c314c1640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1c9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cb7e80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00aac0 tx=0x7f9c1c060480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3088a0b9f1be58d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/2767066316 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c078070 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/2767066316 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f9c1c0672c0 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c24005e10 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/2767066316 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9c1c080050 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 10 client.6006 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x557dc18a80b0 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/2767066316 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24005e10 con 0x557dc1cba6d0 2024-05-10T11:15:41.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/2767066316 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f9c1c05c680 con 0x557dc1cba6d0 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 10 client.6006 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 10 client.6006 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 20 client.6006 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.558+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cc7a40 0x557dc1cb95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.559+0000 7f9c35c40740 4 client.6006 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.559+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dc1be4a20 con 0x557dc1cc7a40 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.559+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cc7a40 0x557dc1cb95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.559+0000 7f9c0b7fe640 10 client.6006 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.559+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cc7a40 0x557dc1cb95e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a340c38ed4cd2756 server_cookie=79e72ea189b1e478 in_seq=0 out_seq=0 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/2767066316 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557dc1be4a20 con 0x557dc1cc7a40 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c0b7fe640 10 client.6006 handle_command_reply: tid=0 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 client.6006 shutdown 2024-05-10T11:15:41.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 msgr2=0x557dc1cb7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cb7e80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00aac0 tx=0x7f9c1c060480 comp rx=0 tx=0).stop 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 shutdown_connections 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1c9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cc7a40 0x557dc1cb95e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cb7e80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 --2- 172.21.15.66:0/2767066316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1c8d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c0b7fe640 0 client.6006 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 >> 172.21.15.66:0/2767066316 conn(0x557dc1c9d0b0 msgr2=0x557dc1c6ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 shutdown_connections 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.560+0000 7f9c35c40740 1 -- 172.21.15.66:0/2767066316 wait complete. 2024-05-10T11:15:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.561+0000 7f9c35c40740 20 client.6006 trim_cache size 0 max 16384 2024-05-10T11:15:41.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.574+0000 7f9c35c40740 1 Processor -- start 2024-05-10T11:15:41.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.574+0000 7f9c35c40740 1 -- start start 2024-05-10T11:15:41.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1cb3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1cbaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cbb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c35c40740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c200f80 con 0x557dc1cba6d0 2024-05-10T11:15:41.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c0cd490 con 0x557dc1cb83c0 2024-05-10T11:15:41.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c0cdae0 con 0x557dc1c9d7f0 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cbb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cbb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56010/0 (socket says 172.21.15.66:56010) 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 -- 172.21.15.66:0/3656244878 learned_addr learned my addr 172.21.15.66:0/3656244878 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1cbaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1cb3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 -- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 msgr2=0x557dc1cb3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1cb3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 -- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 msgr2=0x557dc1cbaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1cbaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c314c1640 1 -- 172.21.15.66:0/3656244878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc1cb81f0 con 0x557dc1cba6d0 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.575+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1cbaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c314c1640 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cbb4d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9c24001680 tx=0x7f9c2400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3b8062c7e891d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c21ffb640 1 -- 172.21.15.66:0/3656244878 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24019030 con 0x557dc1cba6d0 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c21ffb640 1 -- 172.21.15.66:0/3656244878 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2401a040 con 0x557dc1cba6d0 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c21ffb640 1 -- 172.21.15.66:0/3656244878 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24001af0 con 0x557dc1cba6d0 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 -- 172.21.15.66:0/3656244878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 msgr2=0x557dc1cbb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cbb4d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9c24001680 tx=0x7f9c2400c000 comp rx=0 tx=0).stop 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 -- 172.21.15.66:0/3656244878 shutdown_connections 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cba6d0 0x557dc1cbb4d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1cb83c0 0x557dc1cbaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 --2- 172.21.15.66:0/3656244878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1c9d7f0 0x557dc1cb3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 -- 172.21.15.66:0/3656244878 >> 172.21.15.66:0/3656244878 conn(0x557dc1c9d0b0 msgr2=0x557dc1c72dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 -- 172.21.15.66:0/3656244878 shutdown_connections 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.576+0000 7f9c35c40740 1 -- 172.21.15.66:0/3656244878 wait complete. 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.577+0000 7f9c35c40740 1 -- start start 2024-05-10T11:15:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.577+0000 7f9c35c40740 1 Processor -- start 2024-05-10T11:15:41.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1c9d7f0 0x557dc1c99110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 0x557dc1cae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1cba6d0 0x557dc1cb3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557dc1c9ecf0 con 0x557dc1cb83c0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557dc1b8ca20 con 0x557dc1c9d7f0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557dc1cc7e40 con 0x557dc1cba6d0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 10 client.0 _ll_register_callbacks cb 0x7f9c1c004a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 0x557dc1cae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 0x557dc1cae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56022/0 (socket says 172.21.15.66:56022) 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 -- 172.21.15.66:0/1618067541 learned_addr learned my addr 172.21.15.66:0/1618067541 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c314c1640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1cba6d0 0x557dc1cb3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1c9d7f0 0x557dc1c99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 -- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1cba6d0 msgr2=0x557dc1cb3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1cba6d0 0x557dc1cb3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 -- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1c9d7f0 msgr2=0x557dc1c99110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1c9d7f0 0x557dc1c99110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 -- 172.21.15.66:0/1618067541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc1cdb140 con 0x557dc1cb83c0 2024-05-10T11:15:41.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c2bfff640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 0x557dc1cae900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c097ff0 tx=0x7f9c1c063040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc47a5a0568c262 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/1618067541 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c078040 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/1618067541 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f9c1c0672c0 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.578+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c2401a040 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/1618067541 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9c1c01d040 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 10 client.6012 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x557dc1cdbcd0 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/1618067541 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2401a040 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/1618067541 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f9c1c0044b0 con 0x557dc1cb83c0 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 10 client.6012 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 10 client.6012 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 20 client.6012 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:41.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cb44e0 0x557dc1cc6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 4 client.6012 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x557dc1bde890 con 0x557dc1cb44e0 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cb44e0 0x557dc1cc6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c0b7fe640 10 client.6012 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.579+0000 7f9c30cc0640 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cb44e0 0x557dc1cc6270 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e608ae5aefd3fe4 server_cookie=dba5091af160e498 in_seq=0 out_seq=0 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c0b7fe640 1 -- 172.21.15.66:0/1618067541 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+141 (crc 0 0 0) 0x557dc1bde890 con 0x557dc1cb44e0 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c0b7fe640 10 client.6012 handle_command_reply: tid=0 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 client.6012 shutdown 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 msgr2=0x557dc1cae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 0x557dc1cae900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c097ff0 tx=0x7f9c1c063040 comp rx=0 tx=0).stop 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 shutdown_connections 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc1cba6d0 0x557dc1cb3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x557dc1cb44e0 0x557dc1cc6270 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc1cb83c0 0x557dc1cae900 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c0b7fe640 0 client.6012 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 --2- 172.21.15.66:0/1618067541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc1c9d7f0 0x557dc1c99110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 >> 172.21.15.66:0/1618067541 conn(0x557dc1c9d0b0 msgr2=0x557dc1cb6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 shutdown_connections 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 1 -- 172.21.15.66:0/1618067541 wait complete. 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c35c40740 20 client.6012 trim_cache size 0 max 16384 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:15:41.586 INFO:teuthology.orchestra.run.smithi066.stdout: "damage_type": "backtrace", 2024-05-10T11:15:41.587 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 2525702276, 2024-05-10T11:15:41.587 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627777, 2024-05-10T11:15:41.587 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/dir_test/file" 2024-05-10T11:15:41.587 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:15:41.587 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c0c076300 msgr2=0x7f9c0c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c32f24640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c0c076300 0x7f9c0c0787c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c14034000 tx=0x7f9c1402e000 comp rx=0 tx=0).stop 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 msgr2=0x7f9c2c15b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.580+0000 7f9c32f24640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 0x7f9c2c15b8c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00ccd0 tx=0x7f9c1c00a5c0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 shutdown_connections 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9c0c076300 0x7f9c0c0787c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2c162a80 0x7f9c2c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2c0d1720 0x7f9c2c15b8c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 --2- 172.21.15.66:0/3025035590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c0cfc00 0x7f9c2c14d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 >> 172.21.15.66:0/3025035590 conn(0x7f9c2c0d50f0 msgr2=0x7f9c2c160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 shutdown_connections 2024-05-10T11:15:41.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.581+0000 7f9c32f24640 1 -- 172.21.15.66:0/3025035590 wait complete. 2024-05-10T11:15:41.591 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:15:41.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.694+0000 7f18dc22a640 1 Processor -- start 2024-05-10T11:15:41.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.695+0000 7f18dc22a640 1 -- start start 2024-05-10T11:15:41.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.695+0000 7f18dc22a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f18d415f3b0 0x7f18d40d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18dc22a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d40d30b0 con 0x7f18d415f790 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18dc22a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d40d3390 con 0x7f18d40d5d30 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18dc22a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f18d40c8c80 con 0x7f18d415f3b0 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d9fc6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f18d415f3b0 0x7f18d40d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d97c5640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f18d415f790 0x7f18d40c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47054/0 (socket says 172.21.15.66:47054) 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d9fc6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f18d415f3b0 0x7f18d40d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56024/0 (socket says 172.21.15.66:56024) 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d9fc6640 1 -- 172.21.15.66:0/3024161920 learned_addr learned my addr 172.21.15.66:0/3024161920 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d9fc6640 1 -- 172.21.15.66:0/3024161920 >> v1:172.21.15.190:6789/0 conn(0x7f18d40d5d30 legacy=0x7f18d40d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d9fc6640 1 -- 172.21.15.66:0/3024161920 >> v1:172.21.15.66:6789/0 conn(0x7f18d415f790 legacy=0x7f18d40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d8fc4640 1 -- 172.21.15.66:0/3024161920 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122428586 0 0) 0x7f18d40d30b0 con 0x7f18d415f790 2024-05-10T11:15:41.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.696+0000 7f18d9fc6640 1 -- 172.21.15.66:0/3024161920 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d40c8f60 con 0x7f18d415f3b0 2024-05-10T11:15:41.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18d9fc6640 1 --2- 172.21.15.66:0/3024161920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d36f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009870 tx=0x7f18d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6788cc9eee423568 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18d8fc4640 1 -- 172.21.15.66:0/3024161920 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0037070 con 0x7f18d415f3b0 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18d8fc4640 1 -- 172.21.15.66:0/3024161920 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d0032440 con 0x7f18d415f3b0 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18d8fc4640 1 -- 172.21.15.66:0/3024161920 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0032810 con 0x7f18d415f3b0 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18dc22a640 1 -- 172.21.15.66:0/3024161920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 msgr2=0x7f18d40d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18dc22a640 1 --2- 172.21.15.66:0/3024161920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d36f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009870 tx=0x7f18d002a2a0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18dc22a640 1 -- 172.21.15.66:0/3024161920 shutdown_connections 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18dc22a640 1 --2- 172.21.15.66:0/3024161920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d36f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.697+0000 7f18dc22a640 1 -- 172.21.15.66:0/3024161920 >> 172.21.15.66:0/3024161920 conn(0x7f18d40d5130 msgr2=0x7f18d40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.698+0000 7f18dc22a640 1 -- 172.21.15.66:0/3024161920 shutdown_connections 2024-05-10T11:15:41.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.698+0000 7f18dc22a640 1 -- 172.21.15.66:0/3024161920 wait complete. 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 Processor -- start 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 -- start start 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18d40d5d30 0x7f18d40b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18d40ba450 0x7f18d41453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f18d40d3db0 con 0x7f18d415f3b0 2024-05-10T11:15:41.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18d40d3c30 con 0x7f18d40ba450 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.699+0000 7f18dc22a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f18d40d3f30 con 0x7f18d40d5d30 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56026/0 (socket says 172.21.15.66:56026) 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 -- 172.21.15.66:0/1379356759 learned_addr learned my addr 172.21.15.66:0/1379356759 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d9fc6640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18d40d5d30 0x7f18d40b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18da7c7640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18d40ba450 0x7f18d41453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 -- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18d40d5d30 msgr2=0x7f18d40b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18d40d5d30 0x7f18d40b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 -- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18d40ba450 msgr2=0x7f18d41453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18d40ba450 0x7f18d41453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 -- 172.21.15.66:0/1379356759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d41f4dc0 con 0x7f18d415f3b0 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d9fc6640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18d40d5d30 0x7f18d40b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:41.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18d97c5640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d1c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c780 tx=0x7f18c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8018070 con 0x7f18d415f3b0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c800a640 con 0x7f18d415f3b0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d40b96f0 con 0x7f18d415f3b0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c800aa30 con 0x7f18d415f3b0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.700+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d41481c0 con 0x7f18d415f3b0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.701+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d406a220 con 0x7f18d415f3b0 2024-05-10T11:15:41.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.702+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18c801b070 con 0x7f18d415f3b0 2024-05-10T11:15:41.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.702+0000 7f18c67fc640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18b80762d0 0x7f18b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:41.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.703+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f18c8096dd0 con 0x7f18d415f3b0 2024-05-10T11:15:41.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.703+0000 7f18d9fc6640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18b80762d0 0x7f18b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:41.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.703+0000 7f18d9fc6640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18b80762d0 0x7f18b8078790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18d0034000 tx=0x7f18d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:41.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.707+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f18d40b96f0 con 0x7f18d415f3b0 2024-05-10T11:15:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.942+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f18d4075da0 con 0x7f18d415f3b0 2024-05-10T11:15:41.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.942+0000 7f18c67fc640 1 -- 172.21.15.66:0/1379356759 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f18c8060510 con 0x7f18d415f3b0 2024-05-10T11:15:41.941 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:15:41.942 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18b80762d0 msgr2=0x7f18b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18b80762d0 0x7f18b8078790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18d0034000 tx=0x7f18d002e000 comp rx=0 tx=0).stop 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 msgr2=0x7f18d40d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d1c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c780 tx=0x7f18c800cc40 comp rx=0 tx=0).stop 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 shutdown_connections 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f18b80762d0 0x7f18b8078790 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18d40ba450 0x7f18d41453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18d415f3b0 0x7f18d40d1c40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 --2- 172.21.15.66:0/1379356759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18d40d5d30 0x7f18d40b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:41.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 >> 172.21.15.66:0/1379356759 conn(0x7f18d40d5130 msgr2=0x7f18d40cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:41.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 shutdown_connections 2024-05-10T11:15:41.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:41.944+0000 7f18dc22a640 1 -- 172.21.15.66:0/1379356759 wait complete. 2024-05-10T11:15:41.954 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T11:15:41.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:41.954 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-05-10T11:15:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.062+0000 7f16f7a45640 1 Processor -- start 2024-05-10T11:15:42.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.063+0000 7f16f7a45640 1 -- start start 2024-05-10T11:15:42.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.063+0000 7f16f7a45640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16f015f490 0x7f16f00d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.063+0000 7f16f7a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16f00d5ca0 0x7f16f00d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.063+0000 7f16f7a45640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f00d1080 con 0x7f16f00d3b80 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.063+0000 7f16f7a45640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f16f00d3ff0 con 0x7f16f015f490 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.063+0000 7f16f7a45640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f16f00b4e70 con 0x7f16f00d5ca0 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f57e1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16f015f490 0x7f16f00d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f5fe2640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f16f00d3b80 0x7f16f00cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47068/0 (socket says 172.21.15.66:47068) 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f5fe2640 1 -- 172.21.15.66:0/3844487803 learned_addr learned my addr 172.21.15.66:0/3844487803 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f57e1640 1 -- 172.21.15.66:0/3844487803 >> v2:172.21.15.190:3300/0 conn(0x7f16f00d5ca0 msgr2=0x7f16f00d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f57e1640 1 --2- 172.21.15.66:0/3844487803 >> v2:172.21.15.190:3300/0 conn(0x7f16f00d5ca0 0x7f16f00d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f57e1640 1 -- 172.21.15.66:0/3844487803 >> v1:172.21.15.66:6789/0 conn(0x7f16f00d3b80 legacy=0x7f16f00cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.064+0000 7f16f57e1640 1 -- 172.21.15.66:0/3844487803 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00b4820 con 0x7f16f015f490 2024-05-10T11:15:42.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f57e1640 1 --2- 172.21.15.66:0/3844487803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f015f490 0x7f16f00d2f60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16f00a2fa0 tx=0x7f16ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5ac20579869c74 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16e7fff640 1 -- 172.21.15.66:0/3844487803 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec037070 con 0x7f16f015f490 2024-05-10T11:15:42.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16e7fff640 1 -- 172.21.15.66:0/3844487803 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec032440 con 0x7f16f015f490 2024-05-10T11:15:42.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16e7fff640 1 -- 172.21.15.66:0/3844487803 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec02ae60 con 0x7f16f015f490 2024-05-10T11:15:42.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f7a45640 1 -- 172.21.15.66:0/3844487803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f015f490 msgr2=0x7f16f00d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f7a45640 1 --2- 172.21.15.66:0/3844487803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f015f490 0x7f16f00d2f60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16f00a2fa0 tx=0x7f16ec02a110 comp rx=0 tx=0).stop 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f7a45640 1 -- 172.21.15.66:0/3844487803 shutdown_connections 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f7a45640 1 --2- 172.21.15.66:0/3844487803 >> v2:172.21.15.190:3300/0 conn(0x7f16f00d5ca0 0x7f16f00d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f7a45640 1 --2- 172.21.15.66:0/3844487803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f015f490 0x7f16f00d2f60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.065+0000 7f16f7a45640 1 -- 172.21.15.66:0/3844487803 >> 172.21.15.66:0/3844487803 conn(0x7f16f00d50f0 msgr2=0x7f16f00d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.066+0000 7f16f7a45640 1 -- 172.21.15.66:0/3844487803 shutdown_connections 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.066+0000 7f16f7a45640 1 -- 172.21.15.66:0/3844487803 wait complete. 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.067+0000 7f16f7a45640 1 Processor -- start 2024-05-10T11:15:42.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.067+0000 7f16f7a45640 1 -- start start 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 0x7f16f01533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f00d5ca0 0x7f16f00c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f015f490 0x7f16f00c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16f015f9f0 con 0x7f16f00d3b80 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16f015f870 con 0x7f16f015f490 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f16f00b6310 con 0x7f16f00d5ca0 2024-05-10T11:15:42.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 0x7f16f01533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 0x7f16f01533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56052/0 (socket says 172.21.15.66:56052) 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 -- 172.21.15.66:0/1656683089 learned_addr learned my addr 172.21.15.66:0/1656683089 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 -- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f00d5ca0 msgr2=0x7f16f00c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f00d5ca0 0x7f16f00c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 -- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f015f490 msgr2=0x7f16f00c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f015f490 0x7f16f00c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 -- 172.21.15.66:0/1656683089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00cc260 con 0x7f16f00d3b80 2024-05-10T11:15:42.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f57e1640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 0x7f16f01533c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f16ec02a150 tx=0x7f16ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16e5ffb640 1 -- 172.21.15.66:0/1656683089 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec041070 con 0x7f16f00d3b80 2024-05-10T11:15:42.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16e5ffb640 1 -- 172.21.15.66:0/1656683089 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec03c870 con 0x7f16f00d3b80 2024-05-10T11:15:42.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f00cc540 con 0x7f16f00d3b80 2024-05-10T11:15:42.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.068+0000 7f16e5ffb640 1 -- 172.21.15.66:0/1656683089 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec037040 con 0x7f16f00d3b80 2024-05-10T11:15:42.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.069+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f0155ab0 con 0x7f16f00d3b80 2024-05-10T11:15:42.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.071+0000 7f16e5ffb640 1 -- 172.21.15.66:0/1656683089 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16ec044070 con 0x7f16f00d3b80 2024-05-10T11:15:42.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.071+0000 7f16e5ffb640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16d40762d0 0x7f16d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.071+0000 7f16e5ffb640 1 -- 172.21.15.66:0/1656683089 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f16ec0b8410 con 0x7f16f00d3b80 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.071+0000 7f16f4fe0640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16d40762d0 0x7f16d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 Processor -- start 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 -- start start 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16f4fe0640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16d40762d0 0x7f16d4078790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f16f01563b0 tx=0x7f16e0006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fba5a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8a860 0x55a5fba5f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5fb9c4bc0 con 0x55a5fbaa7e80 2024-05-10T11:15:42.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a5fb97dd00 con 0x55a5fba8a860 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.072+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a5fb9c0b80 con 0x55a5fba8afa0 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fba5a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fba5a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56066/0 (socket says 172.21.15.66:56066) 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 -- 172.21.15.66:0/4038025240 learned_addr learned my addr 172.21.15.66:0/4038025240 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8a860 0x55a5fba5f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f4fe0640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 -- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 msgr2=0x55a5fba8a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 -- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8a860 msgr2=0x55a5fba5f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8a860 0x55a5fba5f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 -- 172.21.15.66:0/4038025240 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5fb7a2940 con 0x55a5fbaa7e80 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8a860 0x55a5fba5f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f4fe0640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16f57e1640 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fba5a810 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f16ec035040 tx=0x7f16ec032440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef3a69660affc10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16daffd640 1 -- 172.21.15.66:0/4038025240 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec04b040 con 0x55a5fbaa7e80 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16daffd640 1 -- 172.21.15.66:0/4038025240 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec081450 con 0x55a5fbaa7e80 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.073+0000 7f16daffd640 1 -- 172.21.15.66:0/4038025240 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0b8270 con 0x55a5fbaa7e80 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 -- 172.21.15.66:0/4038025240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 msgr2=0x55a5fba5a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fba5a810 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f16ec035040 tx=0x7f16ec032440 comp rx=0 tx=0).stop 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 -- 172.21.15.66:0/4038025240 shutdown_connections 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8a860 0x55a5fba5f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/4038025240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fba5a810 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 -- 172.21.15.66:0/4038025240 >> 172.21.15.66:0/4038025240 conn(0x55a5fba5ca80 msgr2=0x55a5fbaa5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 -- 172.21.15.66:0/4038025240 shutdown_connections 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 -- 172.21.15.66:0/4038025240 wait complete. 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 -- start start 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.074+0000 7f16fa3fd740 1 Processor -- start 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 0x55a5fbaa6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5fb9c4bc0 con 0x55a5fba8c6e0 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a5fb981830 con 0x55a5fbaa7e80 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a5fba5ec30 con 0x55a5fba8afa0 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.075+0000 7f16fa3fd740 10 client.0 _ll_register_callbacks cb 0x55a5fb9be750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 0x55a5fbaa6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 0x55a5fbaa6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56070/0 (socket says 172.21.15.66:56070) 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 -- 172.21.15.66:0/2092806544 learned_addr learned my addr 172.21.15.66:0/2092806544 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f57e1640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f4fe0640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 -- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 msgr2=0x55a5fba8cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 -- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 msgr2=0x55a5fbaa6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 -- 172.21.15.66:0/2092806544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5fb8030d0 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f4fe0640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 0x55a5fbaa6990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f16e800d770 tx=0x7f16e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd976e62cb4667e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16cffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16cffff640 1 -- 172.21.15.66:0/2092806544 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e800ba60 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16cffff640 1 -- 172.21.15.66:0/2092806544 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f16e800bc00 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ec081450 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16cffff640 1 -- 172.21.15.66:0/2092806544 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f16e801f050 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16fa3fd740 10 client.6036 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55a5fb696230 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.076+0000 7f16cffff640 1 -- 172.21.15.66:0/2092806544 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec081450 con 0x55a5fba8c6e0 2024-05-10T11:15:42.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16cffff640 1 -- 172.21.15.66:0/2092806544 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f16e8022020 con 0x55a5fba8c6e0 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16fa3fd740 10 client.6036 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16fa3fd740 10 client.6036 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16fa3fd740 20 client.6036 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fba8b4e0 0x55a5fba8b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16fa3fd740 4 client.6036 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5fb9d27d0 con 0x55a5fba8b4e0 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16f57e1640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fba8b4e0 0x55a5fba8b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16cffff640 10 client.6036 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.077+0000 7f16f57e1640 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fba8b4e0 0x55a5fba8b8f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7709e8427af6fc0 server_cookie=fcdd317ec8482139 in_seq=0 out_seq=0 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16cffff640 1 -- 172.21.15.66:0/2092806544 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a5fb9d27d0 con 0x55a5fba8b4e0 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16cffff640 10 client.6036 handle_command_reply: tid=0 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 client.6036 shutdown 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 msgr2=0x55a5fbaa6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 0x55a5fbaa6990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f16e800d770 tx=0x7f16e800dc30 comp rx=0 tx=0).stop 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 shutdown_connections 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fba8b4e0 0x55a5fba8b8f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8c6e0 0x55a5fbaa6990 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16cffff640 0 client.6036 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/2092806544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8afa0 0x55a5fba8cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 >> 172.21.15.66:0/2092806544 conn(0x55a5fba8a860 msgr2=0x55a5fba59f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 shutdown_connections 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 1 -- 172.21.15.66:0/2092806544 wait complete. 2024-05-10T11:15:42.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.078+0000 7f16fa3fd740 20 client.6036 trim_cache size 0 max 16384 2024-05-10T11:15:42.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.097+0000 7f16fa3fd740 1 Processor -- start 2024-05-10T11:15:42.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.097+0000 7f16fa3fd740 1 -- start start 2024-05-10T11:15:42.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 0x55a5fbac8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 0x55a5fbaa6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16f02020c0 con 0x55a5fba8afa0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16f02010c0 con 0x55a5fbaa7e80 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f16f00cdf00 con 0x55a5fba8c6e0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 0x55a5fbac8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 0x55a5fbac8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56084/0 (socket says 172.21.15.66:56084) 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 -- 172.21.15.66:0/3086711498 learned_addr learned my addr 172.21.15.66:0/3086711498 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 -- 172.21.15.66:0/3086711498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 msgr2=0x55a5fbaa6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 0x55a5fbaa6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 -- 172.21.15.66:0/3086711498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 msgr2=0x55a5fbaa6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 -- 172.21.15.66:0/3086711498 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5fba8be80 con 0x55a5fba8afa0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16f57e1640 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 0x55a5fbac8360 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f16ec07d480 tx=0x7f16ec0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbc943a2e5ee2ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.098+0000 7f16da7fc640 1 -- 172.21.15.66:0/3086711498 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec04b040 con 0x55a5fba8afa0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16da7fc640 1 -- 172.21.15.66:0/3086711498 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec0b8070 con 0x55a5fba8afa0 2024-05-10T11:15:42.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16da7fc640 1 -- 172.21.15.66:0/3086711498 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0818b0 con 0x55a5fba8afa0 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 -- 172.21.15.66:0/3086711498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 msgr2=0x55a5fbac8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 0x55a5fbac8360 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f16ec07d480 tx=0x7f16ec0b8000 comp rx=0 tx=0).stop 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 -- 172.21.15.66:0/3086711498 shutdown_connections 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fbaa7e80 0x55a5fbaa6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 0x55a5fbaa6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/3086711498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fba8afa0 0x55a5fbac8360 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 -- 172.21.15.66:0/3086711498 >> 172.21.15.66:0/3086711498 conn(0x55a5fba8a860 msgr2=0x55a5fbac8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 -- 172.21.15.66:0/3086711498 shutdown_connections 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.099+0000 7f16fa3fd740 1 -- 172.21.15.66:0/3086711498 wait complete. 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.100+0000 7f16fa3fd740 1 -- start start 2024-05-10T11:15:42.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.100+0000 7f16fa3fd740 1 Processor -- start 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8afa0 0x55a5fbb23260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 0x55a5fbab6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fbb24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5fbac9270 con 0x55a5fbaa7e80 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0200a50 con 0x55a5fba8afa0 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a5fbab7130 con 0x55a5fba8c6e0 2024-05-10T11:15:42.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 10 client.0 _ll_register_callbacks cb 0x7f16e80019c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fbb24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fbb24090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56090/0 (socket says 172.21.15.66:56090) 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 -- 172.21.15.66:0/1508795590 learned_addr learned my addr 172.21.15.66:0/1508795590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 -- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 msgr2=0x55a5fbab6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 0x55a5fbab6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 -- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8afa0 msgr2=0x55a5fbb23260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8afa0 0x55a5fbb23260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 -- 172.21.15.66:0/1508795590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5fba86f40 con 0x55a5fbaa7e80 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16f5fe2640 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fbb24090 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000f80 tx=0x7f16e80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c33b1019ab5002 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16cffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16cffff640 1 -- 172.21.15.66:0/1508795590 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8012750 con 0x55a5fbaa7e80 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16cffff640 1 -- 172.21.15.66:0/1508795590 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f16e80128f0 con 0x55a5fbaa7e80 2024-05-10T11:15:42.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ec0b8070 con 0x55a5fbaa7e80 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.101+0000 7f16cffff640 1 -- 172.21.15.66:0/1508795590 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f16e8034050 con 0x55a5fbaa7e80 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 10 client.6042 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55a5fbab6bc0 con 0x55a5fbaa7e80 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16cffff640 1 -- 172.21.15.66:0/1508795590 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec0b8070 con 0x55a5fbaa7e80 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16cffff640 1 -- 172.21.15.66:0/1508795590 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f16e8037020 con 0x55a5fbaa7e80 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 10 client.6042 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 10 client.6042 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 20 client.6042 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fbac7cf0 0x55a5fbab4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 4 client.6042 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x55a5fba5bed0 con 0x55a5fbac7cf0 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16f57e1640 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fbac7cf0 0x55a5fbab4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16f57e1640 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fbac7cf0 0x55a5fbab4cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71c0dcf512d2fabf server_cookie=79cd1646a7b08ab5 in_seq=0 out_seq=0 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.102+0000 7f16cffff640 10 client.6042 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16cffff640 1 -- 172.21.15.66:0/1508795590 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a5fba5bed0 con 0x55a5fbac7cf0 2024-05-10T11:15:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16cffff640 10 client.6042 handle_command_reply: tid=0 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 client.6042 shutdown 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 msgr2=0x55a5fbb24090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fbb24090 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000f80 tx=0x7f16e80014a0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 shutdown_connections 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55a5fbac7cf0 0x55a5fbab4cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5fbaa7e80 0x55a5fbb24090 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16cffff640 0 client.6042 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5fba8c6e0 0x55a5fbab6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 --2- 172.21.15.66:0/1508795590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5fba8afa0 0x55a5fbb23260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.103+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 >> 172.21.15.66:0/1508795590 conn(0x55a5fba8a860 msgr2=0x55a5fba5e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 shutdown_connections 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16fa3fd740 1 -- 172.21.15.66:0/1508795590 wait complete. 2024-05-10T11:15:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16fa3fd740 20 client.6042 trim_cache size 0 max 16384 2024-05-10T11:15:42.109 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:42.109 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:15:42.109 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "cb39306f-1269-474c-95d4-7735766af592", 2024-05-10T11:15:42.109 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:15:42.109 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16d40762d0 msgr2=0x7f16d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16d40762d0 0x7f16d4078790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f16f01563b0 tx=0x7f16e0006c90 comp rx=0 tx=0).stop 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 msgr2=0x7f16f01533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 0x7f16f01533c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f16ec02a150 tx=0x7f16ec0046c0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 shutdown_connections 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16d40762d0 0x7f16d4078790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f015f490 0x7f16f00c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f00d5ca0 0x7f16f00c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 --2- 172.21.15.66:0/1656683089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f00d3b80 0x7f16f01533c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 >> 172.21.15.66:0/1656683089 conn(0x7f16f00d50f0 msgr2=0x7f16f00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 shutdown_connections 2024-05-10T11:15:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.104+0000 7f16f7a45640 1 -- 172.21.15.66:0/1656683089 wait complete. 2024-05-10T11:15:42.111 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-05-10T11:15:42.103+0000 7f94ca333640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5198=0-4194304@1} caps={5198=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5198 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x557868f50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:15:42.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:15:42.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T11:15:42.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.221+0000 7f6c9055f640 1 Processor -- start 2024-05-10T11:15:42.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.221+0000 7f6c9055f640 1 -- start start 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c9055f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6c88162900 0x7f6c880d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c9055f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6c880d3950 0x7f6c880d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c9055f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c880d4190 con 0x7f6c88162ce0 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c9055f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f6c880cfc40 con 0x7f6c88162900 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c9055f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6c880d3eb0 con 0x7f6c880d3950 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6c88162900 0x7f6c880d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6c88162900 0x7f6c880d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56094/0 (socket says 172.21.15.66:56094) 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/2654526049 learned_addr learned my addr 172.21.15.66:0/2654526049 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/2654526049 >> v2:172.21.15.190:3300/0 conn(0x7f6c880d3950 msgr2=0x7f6c880d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/2654526049 >> v2:172.21.15.190:3300/0 conn(0x7f6c880d3950 0x7f6c880d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/2654526049 >> v2:172.21.15.190:3300/0 conn(0x7f6c880d3950 0x7f6c880d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/2654526049 >> v1:172.21.15.190:6789/0 conn(0x7f6c88162ce0 legacy=0x7f6c880b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.222+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/2654526049 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c880cfee0 con 0x7f6c88162900 2024-05-10T11:15:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.223+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/2654526049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c880d3410 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6c8808d760 tx=0x7f6c8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51a155292771e7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.223+0000 7f6c8d2f9640 1 -- 172.21.15.66:0/2654526049 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84037070 con 0x7f6c88162900 2024-05-10T11:15:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.223+0000 7f6c8d2f9640 1 -- 172.21.15.66:0/2654526049 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c84032440 con 0x7f6c88162900 2024-05-10T11:15:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.223+0000 7f6c8d2f9640 1 -- 172.21.15.66:0/2654526049 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84032810 con 0x7f6c88162900 2024-05-10T11:15:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 -- 172.21.15.66:0/2654526049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 msgr2=0x7f6c880d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 --2- 172.21.15.66:0/2654526049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c880d3410 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6c8808d760 tx=0x7f6c8402a1a0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 -- 172.21.15.66:0/2654526049 shutdown_connections 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 --2- 172.21.15.66:0/2654526049 >> v2:172.21.15.190:3300/0 conn(0x7f6c880d3950 0x7f6c880d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 --2- 172.21.15.66:0/2654526049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c880d3410 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 -- 172.21.15.66:0/2654526049 >> 172.21.15.66:0/2654526049 conn(0x7f6c8809e430 msgr2=0x7f6c880d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 -- 172.21.15.66:0/2654526049 shutdown_connections 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.224+0000 7f6c9055f640 1 -- 172.21.15.66:0/2654526049 wait complete. 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.225+0000 7f6c9055f640 1 Processor -- start 2024-05-10T11:15:42.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.225+0000 7f6c9055f640 1 -- start start 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c880d3950 0x7f6c880b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c88157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c88162ce0 0x7f6c880b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c880b4300 con 0x7f6c88162900 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c880b4180 con 0x7f6c88162ce0 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6c880b4ff0 con 0x7f6c880d3950 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c88157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c88157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56110/0 (socket says 172.21.15.66:56110) 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 -- 172.21.15.66:0/1500739037 learned_addr learned my addr 172.21.15.66:0/1500739037 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 -- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c880d3950 msgr2=0x7f6c880b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c880d3950 0x7f6c880b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 -- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c88162ce0 msgr2=0x7f6c880b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c88162ce0 0x7f6c880b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 -- 172.21.15.66:0/1500739037 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c880ce5c0 con 0x7f6c88162900 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c88157d10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c460 tx=0x7f6c7800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c7effd640 1 -- 172.21.15.66:0/1500739037 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78016020 con 0x7f6c88162900 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c7effd640 1 -- 172.21.15.66:0/1500739037 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c78012870 con 0x7f6c88162900 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c7effd640 1 -- 172.21.15.66:0/1500739037 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78012c60 con 0x7f6c88162900 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c880cdd20 con 0x7f6c88162900 2024-05-10T11:15:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.226+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c880ce2e0 con 0x7f6c88162900 2024-05-10T11:15:42.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.228+0000 7f6c7effd640 1 -- 172.21.15.66:0/1500739037 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c78019020 con 0x7f6c88162900 2024-05-10T11:15:42.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.229+0000 7f6c7effd640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c6c0762d0 0x7f6c6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.229+0000 7f6c7effd640 1 -- 172.21.15.66:0/1500739037 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f6c780972a0 con 0x7f6c88162900 2024-05-10T11:15:42.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.229+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c6c0762d0 0x7f6c6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.229+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c6c0762d0 0x7f6c6c078790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c84034000 tx=0x7f6c8402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 Processor -- start 2024-05-10T11:15:42.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 -- start start 2024-05-10T11:15:42.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb75ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761c280 0x55dfb761b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 0x55dfb75f0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dfb75b8690 con 0x55dfb761bb40 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dfb7555f30 con 0x55dfb7639160 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.230+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dfb750eb20 con 0x55dfb761c280 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 0x55dfb75f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 0x55dfb75f0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56118/0 (socket says 172.21.15.66:56118) 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 -- 172.21.15.66:0/1419065790 learned_addr learned my addr 172.21.15.66:0/1419065790 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb75ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761c280 0x55dfb761b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 -- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761c280 msgr2=0x55dfb761b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761c280 0x55dfb761b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 -- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 msgr2=0x55dfb75ebaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb75ebaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 -- 172.21.15.66:0/1419065790 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfb7506e60 con 0x55dfb761bb40 2024-05-10T11:15:42.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 0x55dfb75f0950 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007cb0 tx=0x7f6c8000c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86219a5ff7f2ce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c6bfff640 1 -- 172.21.15.66:0/1419065790 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80014070 con 0x55dfb761bb40 2024-05-10T11:15:42.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c6bfff640 1 -- 172.21.15.66:0/1419065790 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8000f3f0 con 0x55dfb761bb40 2024-05-10T11:15:42.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.231+0000 7f6c6bfff640 1 -- 172.21.15.66:0/1419065790 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000f7c0 con 0x55dfb761bb40 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 -- 172.21.15.66:0/1419065790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 msgr2=0x55dfb75f0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 0x55dfb75f0950 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007cb0 tx=0x7f6c8000c640 comp rx=0 tx=0).stop 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 -- 172.21.15.66:0/1419065790 shutdown_connections 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761bb40 0x55dfb75f0950 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761c280 0x55dfb761b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 --2- 172.21.15.66:0/1419065790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb75ebaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 -- 172.21.15.66:0/1419065790 >> 172.21.15.66:0/1419065790 conn(0x55dfb75edd60 msgr2=0x55dfb7636600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 -- 172.21.15.66:0/1419065790 shutdown_connections 2024-05-10T11:15:42.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.232+0000 7f6c93279740 1 -- 172.21.15.66:0/1419065790 wait complete. 2024-05-10T11:15:42.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.233+0000 7f6c93279740 1 -- start start 2024-05-10T11:15:42.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.233+0000 7f6c93279740 1 Processor -- start 2024-05-10T11:15:42.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 0x55dfb76099f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb7605e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761d940 0x55dfb761ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dfb75125e0 con 0x55dfb761c280 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dfb7551ef0 con 0x55dfb7639160 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dfb75eff10 con 0x55dfb761d940 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c93279740 10 client.0 _ll_register_callbacks cb 0x55dfb750d320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 0x55dfb76099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 0x55dfb76099f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56134/0 (socket says 172.21.15.66:56134) 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/337672087 learned_addr learned my addr 172.21.15.66:0/337672087 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761d940 0x55dfb761ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb7605e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761d940 msgr2=0x55dfb761ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761d940 0x55dfb761ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 msgr2=0x55dfb7605e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb7605e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 -- 172.21.15.66:0/337672087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfb73317d0 con 0x55dfb761c280 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 0x55dfb76099f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009960 tx=0x7f6c84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1c0bedb8396015 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c697fa640 1 -- 172.21.15.66:0/337672087 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8404c020 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.234+0000 7f6c697fa640 1 -- 172.21.15.66:0/337672087 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f6c84032dc0 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c8000f3f0 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c697fa640 1 -- 172.21.15.66:0/337672087 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6c84056050 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 10 client.6054 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55dfb72673f0 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c697fa640 1 -- 172.21.15.66:0/337672087 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8000f3f0 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c697fa640 1 -- 172.21.15.66:0/337672087 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f6c84059020 con 0x55dfb761c280 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 10 client.6054 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 10 client.6054 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 20 client.6054 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb761e9d0 0x55dfb761a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 4 client.6054 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfb7563b40 con 0x55dfb761e9d0 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.235+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb761e9d0 0x55dfb761a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb761e9d0 0x55dfb761a900 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d52efa15a990b5e0 server_cookie=e4645eae617a24b4 in_seq=0 out_seq=0 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c697fa640 10 client.6054 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c697fa640 1 -- 172.21.15.66:0/337672087 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dfb7563b40 con 0x55dfb761e9d0 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c697fa640 10 client.6054 handle_command_reply: tid=0 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 client.6054 shutdown 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 msgr2=0x55dfb76099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 0x55dfb76099f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009960 tx=0x7f6c84004730 comp rx=0 tx=0).stop 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 shutdown_connections 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb761d940 0x55dfb761ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb7639160 0x55dfb7605e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb761e9d0 0x55dfb761a900 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 --2- 172.21.15.66:0/337672087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761c280 0x55dfb76099f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 >> 172.21.15.66:0/337672087 conn(0x55dfb761bb40 msgr2=0x55dfb75eb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.236+0000 7f6c697fa640 0 client.6054 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.237+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 shutdown_connections 2024-05-10T11:15:42.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.237+0000 7f6c93279740 1 -- 172.21.15.66:0/337672087 wait complete. 2024-05-10T11:15:42.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.237+0000 7f6c93279740 20 client.6054 trim_cache size 0 max 16384 2024-05-10T11:15:42.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 Processor -- start 2024-05-10T11:15:42.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 -- start start 2024-05-10T11:15:42.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb761af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7648f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88202330 con 0x55dfb761d940 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88201310 con 0x55dfb761c280 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6c880ccd80 con 0x55dfb7639160 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c8dafa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7648f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c8dafa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7648f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56150/0 (socket says 172.21.15.66:56150) 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.255+0000 7f6c8dafa640 1 -- 172.21.15.66:0/2825825813 learned_addr learned my addr 172.21.15.66:0/2825825813 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c8dafa640 1 -- 172.21.15.66:0/2825825813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 msgr2=0x55dfb76195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c8dafa640 1 -- 172.21.15.66:0/2825825813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 msgr2=0x55dfb761af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb761af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c8dafa640 1 -- 172.21.15.66:0/2825825813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfb761fb50 con 0x55dfb761d940 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7648f10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6c7805fd90 tx=0x7f6c78063040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefaa6f777e8c1b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c6b7fe640 1 -- 172.21.15.66:0/2825825813 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78092070 con 0x55dfb761d940 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c6b7fe640 1 -- 172.21.15.66:0/2825825813 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c780955a0 con 0x55dfb761d940 2024-05-10T11:15:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c6b7fe640 1 -- 172.21.15.66:0/2825825813 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78064150 con 0x55dfb761d940 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c93279740 1 -- 172.21.15.66:0/2825825813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 msgr2=0x55dfb7648f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c93279740 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7648f10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6c7805fd90 tx=0x7f6c78063040 comp rx=0 tx=0).stop 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.256+0000 7f6c93279740 1 -- 172.21.15.66:0/2825825813 shutdown_connections 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7648f10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 --2- 172.21.15.66:0/2825825813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb761af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 -- 172.21.15.66:0/2825825813 >> 172.21.15.66:0/2825825813 conn(0x55dfb761bb40 msgr2=0x55dfb7639a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 -- 172.21.15.66:0/2825825813 shutdown_connections 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 -- 172.21.15.66:0/2825825813 wait complete. 2024-05-10T11:15:42.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 -- start start 2024-05-10T11:15:42.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.257+0000 7f6c93279740 1 Processor -- start 2024-05-10T11:15:42.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb7639fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7631cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88200c40 con 0x55dfb761d940 2024-05-10T11:15:42.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dfb75ed620 con 0x55dfb761c280 2024-05-10T11:15:42.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dfb76b4990 con 0x55dfb7639160 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c93279740 10 client.0 _ll_register_callbacks cb 0x7f6c840096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7631cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7631cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56152/0 (socket says 172.21.15.66:56152) 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 -- 172.21.15.66:0/688122918 learned_addr learned my addr 172.21.15.66:0/688122918 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb7639fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 -- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 msgr2=0x55dfb76321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 -- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 msgr2=0x55dfb7639fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:15:42.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb7639fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8dafa640 1 -- 172.21.15.66:0/688122918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfb72270f0 con 0x55dfb761d940 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb7639fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.258+0000 7f6c8eafc640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c8dafa640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7631cb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6c7805ffd0 tx=0x7f6c78097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c863bb82f88c4d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c697fa640 1 -- 172.21.15.66:0/688122918 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78092040 con 0x55dfb761d940 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c697fa640 1 -- 172.21.15.66:0/688122918 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f6c78064360 con 0x55dfb761d940 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c780955a0 con 0x55dfb761d940 2024-05-10T11:15:42.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c697fa640 1 -- 172.21.15.66:0/688122918 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6c78064680 con 0x55dfb761d940 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 10 client.6060 fetch_fsmap learned FSMap version 35 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55dfb7637170 con 0x55dfb761d940 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c697fa640 1 -- 172.21.15.66:0/688122918 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c780955a0 con 0x55dfb761d940 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c697fa640 1 -- 172.21.15.66:0/688122918 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f6c7806a060 con 0x55dfb761d940 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 10 client.6060 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 10 client.6060 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 20 client.6060 populate_metadata read hostname 'smithi066' 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb76361a0 0x55dfb762c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 4 client.6060 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfb755d9b0 con 0x55dfb76361a0 2024-05-10T11:15:42.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.259+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb76361a0 0x55dfb762c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c697fa640 10 client.6060 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c8e2fb640 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb76361a0 0x55dfb762c470 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da4c947a4a3cff0 server_cookie=379863178cc2679e in_seq=0 out_seq=0 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c697fa640 1 -- 172.21.15.66:0/688122918 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x55dfb755d9b0 con 0x55dfb76361a0 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c697fa640 10 client.6060 handle_command_reply: tid=0 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 client.6060 shutdown 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 msgr2=0x55dfb7631cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7631cb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6c7805ffd0 tx=0x7f6c78097040 comp rx=0 tx=0).stop 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 shutdown_connections 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dfb7639160 0x55dfb76321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55dfb76361a0 0x55dfb762c470 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfb761d940 0x55dfb7631cb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 --2- 172.21.15.66:0/688122918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfb761c280 0x55dfb7639fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c697fa640 0 client.6060 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 >> 172.21.15.66:0/688122918 conn(0x55dfb761bb40 msgr2=0x55dfb7609740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 shutdown_connections 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 1 -- 172.21.15.66:0/688122918 wait complete. 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.260+0000 7f6c93279740 20 client.6060 trim_cache size 0 max 16384 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: "cb39306f-1269-474c-95d4-7735766af592": { 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "cb39306f-1269-474c-95d4-7735766af592", 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair,force" 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:15:42.269 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:15:42.270 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:15:42.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c6c0762d0 msgr2=0x7f6c6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c6c0762d0 0x7f6c6c078790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c84034000 tx=0x7f6c8402c000 comp rx=0 tx=0).stop 2024-05-10T11:15:42.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 msgr2=0x7f6c88157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:15:42.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c88157d10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c460 tx=0x7f6c7800c920 comp rx=0 tx=0).stop 2024-05-10T11:15:42.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 shutdown_connections 2024-05-10T11:15:42.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6c6c0762d0 0x7f6c6c078790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c88162ce0 0x7f6c880b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c88162900 0x7f6c88157d10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 --2- 172.21.15.66:0/1500739037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c880d3950 0x7f6c880b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:15:42.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 >> 172.21.15.66:0/1500739037 conn(0x7f6c8809e430 msgr2=0x7f6c8806d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:15:42.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 shutdown_connections 2024-05-10T11:15:42.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:15:42.261+0000 7f6c9055f640 1 -- 172.21.15.66:0/1500739037 wait complete. 2024-05-10T11:15:42.272 INFO:tasks.cephfs.filesystem:scrub status for tag:cb39306f-1269-474c-95d4-7735766af592 - {'path': '/', 'tag': 'cb39306f-1269-474c-95d4-7735766af592', 'options': 'recursive,repair,force'} 2024-05-10T11:16:01.798 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:16:01.801 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:16:12.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:12.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T11:16:12.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.392+0000 7fd8cef9e640 1 Processor -- start 2024-05-10T11:16:12.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.392+0000 7fd8cef9e640 1 -- start start 2024-05-10T11:16:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cef9e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8c8162ae0 0x7fd8c80d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cef9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cef9e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c80d0b00 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cef9e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c80b7d70 con 0x7fd8c8162ae0 2024-05-10T11:16:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cef9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c80b8610 con 0x7fd8c80d5a40 2024-05-10T11:16:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cdf9c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8c8162ae0 0x7fd8c80d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cdf9c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8c8162ae0 0x7fd8c80d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47230/0 (socket says 172.21.15.66:47230) 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8ce79d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd8c80cfbf0 0x7fd8c80d2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44396/0 (socket says 172.21.15.66:44396) 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3787500064 learned_addr learned my addr 172.21.15.66:0/3787500064 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.393+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/3787500064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.394+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3787500064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 msgr2=0x7fd8c80d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.394+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/3787500064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c80d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.394+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3787500064 >> v1:172.21.15.66:6789/0 conn(0x7fd8c80cfbf0 legacy=0x7fd8c80d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.394+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3787500064 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c80d22d0 con 0x7fd8c8162ae0 2024-05-10T11:16:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.394+0000 7fd8ccf9a640 1 -- 172.21.15.66:0/3787500064 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188744427 0 0) 0x7fd8c0001490 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.394+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/3787500064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c8162ae0 0x7fd8c80d1580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009870 tx=0x7fd8c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8fe37eb9074f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8ccf9a640 1 -- 172.21.15.66:0/3787500064 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4037070 con 0x7fd8c8162ae0 2024-05-10T11:16:12.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8ccf9a640 1 -- 172.21.15.66:0/3787500064 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c4032440 con 0x7fd8c8162ae0 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8ccf9a640 1 -- 172.21.15.66:0/3787500064 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4032810 con 0x7fd8c8162ae0 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 -- 172.21.15.66:0/3787500064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c8162ae0 msgr2=0x7fd8c80d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/3787500064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c8162ae0 0x7fd8c80d1580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009870 tx=0x7fd8c402a270 comp rx=0 tx=0).stop 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 -- 172.21.15.66:0/3787500064 shutdown_connections 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/3787500064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c80d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/3787500064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c8162ae0 0x7fd8c80d1580 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 -- 172.21.15.66:0/3787500064 >> 172.21.15.66:0/3787500064 conn(0x7fd8c80d4f20 msgr2=0x7fd8c80d5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 -- 172.21.15.66:0/3787500064 shutdown_connections 2024-05-10T11:16:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.395+0000 7fd8cef9e640 1 -- 172.21.15.66:0/3787500064 wait complete. 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 Processor -- start 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 -- start start 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 0x7fd8c80cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c8160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8c8162ae0 0x7fd8c8161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c80b82a0 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c80b7fc0 con 0x7fd8c8162ae0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.397+0000 7fd8cef9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c80b9ab0 con 0x7fd8c80d5a40 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 0x7fd8c80cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 0x7fd8c80cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47242/0 (socket says 172.21.15.66:47242) 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/1848490424 learned_addr learned my addr 172.21.15.66:0/1848490424 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 msgr2=0x7fd8c8160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c8160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8c8162ae0 msgr2=0x7fd8c8161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8c8162ae0 0x7fd8c8161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/1848490424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c80ce0b0 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 0x7fd8c80cd6f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40097c0 tx=0x7fd8c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8be7fc640 1 -- 172.21.15.66:0/1848490424 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4041070 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8be7fc640 1 -- 172.21.15.66:0/1848490424 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c403c870 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c80ce390 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8be7fc640 1 -- 172.21.15.66:0/1848490424 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4037040 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.398+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c80ce670 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.400+0000 7fd8be7fc640 1 -- 172.21.15.66:0/1848490424 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd8c4044070 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.401+0000 7fd8be7fc640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8ac0762d0 0x7fd8ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.401+0000 7fd8be7fc640 1 -- 172.21.15.66:0/1848490424 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd8c40b80d0 con 0x7fd8c80cfbf0 2024-05-10T11:16:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.401+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8ac0762d0 0x7fd8ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.401+0000 7fd8d2ffb740 1 Processor -- start 2024-05-10T11:16:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.401+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8ac0762d0 0x7fd8ac078790 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8006a90 tx=0x7fd8b8006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.401+0000 7fd8d2ffb740 1 -- start start 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdaddccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0cd00 0x559cdade1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559cdada9690 con 0x559cdae2a320 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559cdad46f30 con 0x559cdae0cd00 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559cdacffb20 con 0x559cdae0d440 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdaddccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdaddccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47248/0 (socket says 172.21.15.66:47248) 2024-05-10T11:16:12.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/2018335052 learned_addr learned my addr 172.21.15.66:0/2018335052 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0cd00 0x559cdade1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 msgr2=0x559cdae0c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae0c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0cd00 msgr2=0x559cdade1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0cd00 0x559cdade1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.402+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/2018335052 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdacf7e60 con 0x559cdae2a320 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.403+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdaddccb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40b6410 tx=0x7fd8c4080af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b8abb8e741b6d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.403+0000 7fd8ab7fe640 1 -- 172.21.15.66:0/2018335052 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c404b070 con 0x559cdae2a320 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.403+0000 7fd8ab7fe640 1 -- 172.21.15.66:0/2018335052 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c4080cb0 con 0x559cdae2a320 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.403+0000 7fd8ab7fe640 1 -- 172.21.15.66:0/2018335052 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40818a0 con 0x559cdae2a320 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.403+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2018335052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 msgr2=0x559cdaddccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.403+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdaddccb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40b6410 tx=0x7fd8c4080af0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2018335052 shutdown_connections 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0cd00 0x559cdade1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2018335052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdaddccb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2018335052 >> 172.21.15.66:0/2018335052 conn(0x559cdaddef20 msgr2=0x559cdae277c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2018335052 shutdown_connections 2024-05-10T11:16:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2018335052 wait complete. 2024-05-10T11:16:12.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 -- start start 2024-05-10T11:16:12.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.404+0000 7fd8d2ffb740 1 Processor -- start 2024-05-10T11:16:12.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdadfa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdadfac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559cdad035e0 con 0x559cdadfa7f0 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559cdad42ef0 con 0x559cdae2a320 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559cdada9690 con 0x559cdae0d440 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8d2ffb740 10 client.0 _ll_register_callbacks cb 0x559cdacfe320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8ce79d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdadfac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8ce79d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdadfac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47260/0 (socket says 172.21.15.66:47260) 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.405+0000 7fd8ce79d640 1 -- 172.21.15.66:0/4240747392 learned_addr learned my addr 172.21.15.66:0/4240747392 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdadfa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8ce79d640 1 -- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 msgr2=0x559cdadfa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdadfa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8ce79d640 1 -- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 msgr2=0x559cdae202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae202e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8ce79d640 1 -- 172.21.15.66:0/4240747392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdab227d0 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdadfac70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0002150 tx=0x7fd8c0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142be3cc4a41d4f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/4240747392 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011580 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/4240747392 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd8c0010040 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c4080cb0 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/4240747392 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd8c0011720 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8d2ffb740 10 client.6075 fetch_fsmap learned FSMap version 36 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x559cdaa583f0 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/4240747392 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c4080cb0 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.406+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/4240747392 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7fd8c00118c0 con 0x559cdadfa7f0 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8d2ffb740 10 client.6075 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8d2ffb740 10 client.6075 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8d2ffb740 20 client.6075 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdae1ea80 0x559cdae277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8d2ffb740 4 client.6075 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cdad54b40 con 0x559cdae1ea80 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdae1ea80 0x559cdae277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdae1ea80 0x559cdae277c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0553fcc9857df9 server_cookie=33460706a7d71345 in_seq=0 out_seq=0 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.407+0000 7fd8a8ff9640 10 client.6075 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/4240747392 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559cdad54b40 con 0x559cdae1ea80 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8a8ff9640 10 client.6075 handle_command_reply: tid=0 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 client.6075 shutdown 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 msgr2=0x559cdadfac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdadfac70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0002150 tx=0x7fd8c0007430 comp rx=0 tx=0).stop 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 shutdown_connections 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdae1ea80 0x559cdae277c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdadfac70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae202e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8a8ff9640 0 client.6075 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/4240747392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdadfa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 >> 172.21.15.66:0/4240747392 conn(0x559cdae0cd00 msgr2=0x559cdade04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 shutdown_connections 2024-05-10T11:16:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/4240747392 wait complete. 2024-05-10T11:16:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.408+0000 7fd8d2ffb740 20 client.6075 trim_cache size 0 max 16384 2024-05-10T11:16:12.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.427+0000 7fd8d2ffb740 1 Processor -- start 2024-05-10T11:16:12.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.427+0000 7fd8d2ffb740 1 -- start start 2024-05-10T11:16:12.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdadfa7f0 0x559cdaddfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0d440 0x559cdadf9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdae3a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8202000 con 0x559cdae2a320 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8200fe0 con 0x559cdae0d440 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c8200310 con 0x559cdadfa7f0 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdae3a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdae3a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47262/0 (socket says 172.21.15.66:47262) 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 -- 172.21.15.66:0/2556943549 learned_addr learned my addr 172.21.15.66:0/2556943549 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 -- 172.21.15.66:0/2556943549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdadfa7f0 msgr2=0x559cdaddfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdadfa7f0 0x559cdaddfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 -- 172.21.15.66:0/2556943549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0d440 msgr2=0x559cdadf9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0d440 0x559cdadf9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 -- 172.21.15.66:0/2556943549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdaa180f0 con 0x559cdae2a320 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdae3a0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0007ca0 tx=0x7fd8c000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a0cf8878b0e4cb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8aaffd640 1 -- 172.21.15.66:0/2556943549 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00118c0 con 0x559cdae2a320 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8aaffd640 1 -- 172.21.15.66:0/2556943549 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c001d410 con 0x559cdae2a320 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.428+0000 7fd8aaffd640 1 -- 172.21.15.66:0/2556943549 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c001d800 con 0x559cdae2a320 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2556943549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 msgr2=0x559cdae3a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdae3a0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0007ca0 tx=0x7fd8c000c000 comp rx=0 tx=0).stop 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2556943549 shutdown_connections 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdae2a320 0x559cdae3a0f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae0d440 0x559cdadf9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/2556943549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdadfa7f0 0x559cdaddfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2556943549 >> 172.21.15.66:0/2556943549 conn(0x559cdae0cd00 msgr2=0x559cdadd8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2556943549 shutdown_connections 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/2556943549 wait complete. 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.429+0000 7fd8d2ffb740 1 -- start start 2024-05-10T11:16:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 Processor -- start 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdaea4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae08b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae09090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8200910 con 0x559cdadfa7f0 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559cdaddff10 con 0x559cdae2a320 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559cdae4b230 con 0x559cdae0d440 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.430+0000 7fd8d2ffb740 10 client.0 _ll_register_callbacks cb 0x7fd8c0004be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:12.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdaea4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdaea4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47270/0 (socket says 172.21.15.66:47270) 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3956903762 learned_addr learned my addr 172.21.15.66:0/3956903762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae08b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8ce79d640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae09090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 msgr2=0x559cdae08b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae08b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 msgr2=0x559cdae09090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae09090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 -- 172.21.15.66:0/3956903762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdae4b840 con 0x559cdadfa7f0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8cdf9c640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdaea4830 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd8c407d790 tx=0x7fd8c40b6340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2903de96d642cf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/3956903762 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40b3070 con 0x559cdadfa7f0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/3956903762 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd8c4081400 con 0x559cdadfa7f0 2024-05-10T11:16:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c001d410 con 0x559cdadfa7f0 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/3956903762 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd8c40a2050 con 0x559cdadfa7f0 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8d2ffb740 10 client.6081 fetch_fsmap learned FSMap version 36 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x559cdae28fd0 con 0x559cdadfa7f0 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.431+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/3956903762 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c001d410 con 0x559cdadfa7f0 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/3956903762 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7fd8c4089ae0 con 0x559cdadfa7f0 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 10 client.6081 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 10 client.6081 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 20 client.6081 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdadf9040 0x559cdae4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 4 client.6081 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559cdae21830 con 0x559cdadf9040 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdadf9040 0x559cdae4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8cd79b640 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdadf9040 0x559cdae4a000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88bd467ce1caaef0 server_cookie=2f97fc688824af in_seq=0 out_seq=0 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8a8ff9640 10 client.6081 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8a8ff9640 1 -- 172.21.15.66:0/3956903762 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559cdae21830 con 0x559cdadf9040 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8a8ff9640 10 client.6081 handle_command_reply: tid=0 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.432+0000 7fd8d2ffb740 1 client.6081 shutdown 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 msgr2=0x559cdaea4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdaea4830 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd8c407d790 tx=0x7fd8c40b6340 comp rx=0 tx=0).stop 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 shutdown_connections 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559cdae2a320 0x559cdae09090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559cdae0d440 0x559cdae08b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x559cdadf9040 0x559cdae4a000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 --2- 172.21.15.66:0/3956903762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559cdadfa7f0 0x559cdaea4830 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8a8ff9640 0 client.6081 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 >> 172.21.15.66:0/3956903762 conn(0x559cdae0cd00 msgr2=0x559cdadd8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 shutdown_connections 2024-05-10T11:16:12.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 1 -- 172.21.15.66:0/3956903762 wait complete. 2024-05-10T11:16:12.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8d2ffb740 20 client.6081 trim_cache size 0 max 16384 2024-05-10T11:16:12.439 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:16:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:16:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:16:12.439 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8ac0762d0 msgr2=0x7fd8ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8ac0762d0 0x7fd8ac078790 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8006a90 tx=0x7fd8b8006a20 comp rx=0 tx=0).stop 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 msgr2=0x7fd8c80cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 0x7fd8c80cd6f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40097c0 tx=0x7fd8c40046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 shutdown_connections 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8ac0762d0 0x7fd8ac078790 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8c8162ae0 0x7fd8c8161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8c80d5a40 0x7fd8c8160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 --2- 172.21.15.66:0/1848490424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8c80cfbf0 0x7fd8c80cd6f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 >> 172.21.15.66:0/1848490424 conn(0x7fd8c80d4f20 msgr2=0x7fd8c806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.433+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 shutdown_connections 2024-05-10T11:16:12.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.434+0000 7fd8cef9e640 1 -- 172.21.15.66:0/1848490424 wait complete. 2024-05-10T11:16:12.445 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:16:12.445 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.548+0000 7fd69782a640 1 Processor -- start 2024-05-10T11:16:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.549+0000 7fd69782a640 1 -- start start 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.549+0000 7fd69782a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd6900c6c80 0x7fd6900c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.549+0000 7fd69782a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 0x7fd6900cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.549+0000 7fd69782a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd69006f1c0 con 0x7fd6901598c0 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.549+0000 7fd69782a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd69006f4a0 con 0x7fd6900c6c80 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.549+0000 7fd69782a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd69006f780 con 0x7fd6900cee40 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd6955c6640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd6901598c0 0x7fd69006e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44402/0 (socket says 172.21.15.66:44402) 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd6955c6640 1 -- 172.21.15.66:0/1479223344 learned_addr learned my addr 172.21.15.66:0/1479223344 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd694dc5640 1 --2- 172.21.15.66:0/1479223344 >> v2:172.21.15.190:3300/0 conn(0x7fd6900c6c80 0x7fd6900c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043942979 0 0) 0x7fd69006f1c0 con 0x7fd6901598c0 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd695dc7640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 0x7fd6900cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd67c003520 con 0x7fd6901598c0 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 620829554 0 0) 0x7fd67c003520 con 0x7fd6901598c0 2024-05-10T11:16:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 msgr2=0x7fd6900cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 0x7fd6900cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 >> v2:172.21.15.190:3300/0 conn(0x7fd6900c6c80 msgr2=0x7fd6900c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 --2- 172.21.15.66:0/1479223344 >> v2:172.21.15.190:3300/0 conn(0x7fd6900c6c80 0x7fd6900c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69006fa60 con 0x7fd6901598c0 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fd684001670 con 0x7fd6901598c0 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 >> v1:172.21.15.66:6789/0 conn(0x7fd6901598c0 legacy=0x7fd69006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 0x7fd67c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c003f30 0x7fd67c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c004d40 0x7fd67c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd69006f4a0 con 0x7fd67c004d40 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd69006f780 con 0x7fd67c003f30 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c00b9c0 con 0x7fd6900cee40 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd695dc7640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c004d40 0x7fd67c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd6955c6640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 0x7fd67c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.550+0000 7fd694dc5640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c003f30 0x7fd67c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd695dc7640 1 -- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 msgr2=0x7fd67c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd695dc7640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900cee40 0x7fd67c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd695dc7640 1 -- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c003f30 msgr2=0x7fd67c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd695dc7640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c003f30 0x7fd67c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd695dc7640 1 -- 172.21.15.66:0/1479223344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c003520 con 0x7fd67c004d40 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd695dc7640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c004d40 0x7fd67c0051c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd688009fc0 tx=0x7fd67c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3f0d258bf50329 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.551+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688009c10 con 0x7fd67c004d40 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688036070 con 0x7fd67c004d40 2024-05-10T11:16:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd683fff640 1 -- 172.21.15.66:0/1479223344 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688031670 con 0x7fd67c004d40 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd69782a640 1 -- 172.21.15.66:0/1479223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c004d40 msgr2=0x7fd67c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd69782a640 1 --2- 172.21.15.66:0/1479223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c004d40 0x7fd67c0051c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd688009fc0 tx=0x7fd67c005830 comp rx=0 tx=0).stop 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd695dc7640 1 -- 172.21.15.66:0/1479223344 reap_dead start 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd69782a640 1 -- 172.21.15.66:0/1479223344 shutdown_connections 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd69782a640 1 -- 172.21.15.66:0/1479223344 >> 172.21.15.66:0/1479223344 conn(0x7fd6900b2900 msgr2=0x7fd6900b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd69782a640 1 -- 172.21.15.66:0/1479223344 shutdown_connections 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.552+0000 7fd69782a640 1 -- 172.21.15.66:0/1479223344 wait complete. 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 Processor -- start 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 -- start start 2024-05-10T11:16:12.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c004d40 0x7fd6900add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900b1b10 0x7fd6900af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 0x7fd6900afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd69006ee10 con 0x7fd69015ece0 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd69015c6e0 con 0x7fd67c004d40 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd69782a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd69015dfb0 con 0x7fd6900b1b10 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd695dc7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 0x7fd6900afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd695dc7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 0x7fd6900afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47290/0 (socket says 172.21.15.66:47290) 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.554+0000 7fd695dc7640 1 -- 172.21.15.66:0/230757087 learned_addr learned my addr 172.21.15.66:0/230757087 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd6955c6640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c004d40 0x7fd6900add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd694dc5640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900b1b10 0x7fd6900af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd695dc7640 1 -- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900b1b10 msgr2=0x7fd6900af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd695dc7640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900b1b10 0x7fd6900af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd695dc7640 1 -- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c004d40 msgr2=0x7fd6900add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd695dc7640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c004d40 0x7fd6900add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd695dc7640 1 -- 172.21.15.66:0/230757087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6900b1fd0 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd6955c6640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c004d40 0x7fd6900add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd694dc5640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900b1b10 0x7fd6900af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd695dc7640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 0x7fd6900afdb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd688033040 tx=0x7fd688009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688009c10 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688031dd0 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69015e200 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688003bd0 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.555+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69015e7c0 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.556+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69006a220 con 0x7fd69015ece0 2024-05-10T11:16:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.557+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd688005d10 con 0x7fd69015ece0 2024-05-10T11:16:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.557+0000 7fd681ffb640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6740762d0 0x7fd674078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.558+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd6880b8bd0 con 0x7fd69015ece0 2024-05-10T11:16:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.558+0000 7fd6955c6640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6740762d0 0x7fd674078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.558+0000 7fd6955c6640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6740762d0 0x7fd674078790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd684001050 tx=0x7fd684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.562+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd688049060 con 0x7fd69015ece0 2024-05-10T11:16:12.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.791+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd69006e4e0 con 0x7fd69015ece0 2024-05-10T11:16:12.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.791+0000 7fd681ffb640 1 -- 172.21.15.66:0/230757087 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5186 (secure 0 0 0) 0x7fd688082310 con 0x7fd69015ece0 2024-05-10T11:16:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:12.792 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:46.320508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":15,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:16:12.792 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6740762d0 msgr2=0x7fd674078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6740762d0 0x7fd674078790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd684001050 tx=0x7fd684009040 comp rx=0 tx=0).stop 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 msgr2=0x7fd6900afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 0x7fd6900afdb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd688033040 tx=0x7fd688009750 comp rx=0 tx=0).stop 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 shutdown_connections 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6740762d0 0x7fd674078790 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69015ece0 0x7fd6900afdb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6900b1b10 0x7fd6900af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 --2- 172.21.15.66:0/230757087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c004d40 0x7fd6900add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 >> 172.21.15.66:0/230757087 conn(0x7fd6900b2900 msgr2=0x7fd6900c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 shutdown_connections 2024-05-10T11:16:12.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.793+0000 7fd69782a640 1 -- 172.21.15.66:0/230757087 wait complete. 2024-05-10T11:16:12.805 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage ls --format=json-pretty 2024-05-10T11:16:12.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.910+0000 7f2eba340640 1 Processor -- start 2024-05-10T11:16:12.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.910+0000 7f2eba340640 1 -- start start 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eba340640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40cf3e0 0x7f2eb40cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eba340640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2eb40d2190 0x7f2eb40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eba340640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb406e720 con 0x7f2eb40cd500 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eba340640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb406de80 con 0x7f2eb40d2190 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eba340640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb406e160 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eb88dd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2eb40d2190 0x7f2eb40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eabfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2eb40cd500 0x7f2eb40b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44404/0 (socket says 172.21.15.66:44404) 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eabfff640 1 -- 172.21.15.66:0/2959190357 learned_addr learned my addr 172.21.15.66:0/2959190357 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2959190357 >> v2:172.21.15.66:3300/0 conn(0x7f2eb40d2190 0x7f2eb40cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47300/0 (socket says 172.21.15.66:47300) 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.911+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/2959190357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40cf3e0 0x7f2eb40cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2959190357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40cf3e0 msgr2=0x7f2eb40cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2959190357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40cf3e0 0x7f2eb40cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2959190357 >> v1:172.21.15.66:6789/0 conn(0x7f2eb40cd500 legacy=0x7f2eb40b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb37fe640 1 -- 172.21.15.66:0/2959190357 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143735096 0 0) 0x7f2eb406e720 con 0x7f2eb40cd500 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2959190357 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb406e440 con 0x7f2eb40d2190 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2959190357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40d2190 0x7f2eb40cfe00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909c073224cb0a54 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.912+0000 7f2eb37fe640 1 -- 172.21.15.66:0/2959190357 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac007740 con 0x7f2eb40d2190 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eb37fe640 1 -- 172.21.15.66:0/2959190357 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0078e0 con 0x7f2eb40d2190 2024-05-10T11:16:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eb37fe640 1 -- 172.21.15.66:0/2959190357 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac007cb0 con 0x7f2eb40d2190 2024-05-10T11:16:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 -- 172.21.15.66:0/2959190357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40d2190 msgr2=0x7f2eb40cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 --2- 172.21.15.66:0/2959190357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40d2190 0x7f2eb40cfe00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02a660 comp rx=0 tx=0).stop 2024-05-10T11:16:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 -- 172.21.15.66:0/2959190357 shutdown_connections 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 --2- 172.21.15.66:0/2959190357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40d2190 0x7f2eb40cfe00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 --2- 172.21.15.66:0/2959190357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40cf3e0 0x7f2eb40cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 -- 172.21.15.66:0/2959190357 >> 172.21.15.66:0/2959190357 conn(0x7f2eb40d2eb0 msgr2=0x7f2eb40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 -- 172.21.15.66:0/2959190357 shutdown_connections 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.913+0000 7f2eba340640 1 -- 172.21.15.66:0/2959190357 wait complete. 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.914+0000 7f2eba340640 1 Processor -- start 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.914+0000 7f2eba340640 1 -- start start 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eba340640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb40cd500 0x7f2eb41f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eba340640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 0x7f2eb409d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eba340640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40d2190 0x7f2eb409dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eba340640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40b34e0 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eba340640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40b4510 con 0x7f2eb40cd500 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eba340640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb40b3660 con 0x7f2eb40d2190 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 0x7f2eb409d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 0x7f2eb409d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47304/0 (socket says 172.21.15.66:47304) 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.915+0000 7f2eabfff640 1 -- 172.21.15.66:0/3395960168 learned_addr learned my addr 172.21.15.66:0/3395960168 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb40cd500 0x7f2eb41f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eabfff640 1 -- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40d2190 msgr2=0x7f2eb409dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40d2190 0x7f2eb409dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eabfff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40d2190 0x7f2eb409dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eabfff640 1 -- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb40cd500 msgr2=0x7f2eb41f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eabfff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb40cd500 0x7f2eb41f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eabfff640 1 -- 172.21.15.66:0/3395960168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40cb5f0 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb40cd500 0x7f2eb41f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40d2190 0x7f2eb409dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eabfff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 0x7f2eb409d6a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c4e0 tx=0x7f2e9c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb17fa640 1 -- 172.21.15.66:0/3395960168 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c018070 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb17fa640 1 -- 172.21.15.66:0/3395960168 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c007500 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb409e1f0 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eb17fa640 1 -- 172.21.15.66:0/3395960168 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c004a20 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.916+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb40ca470 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.918+0000 7f2eb17fa640 1 -- 172.21.15.66:0/3395960168 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e9c01b070 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.918+0000 7f2eb17fa640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e940762d0 0x7f2e94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.918+0000 7f2eb17fa640 1 -- 172.21.15.66:0/3395960168 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f2e9c096b20 con 0x7f2eb40cf3e0 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.919+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e940762d0 0x7f2e94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.919+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e940762d0 0x7f2e94078790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4006fd0 tx=0x7f2ea4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.919+0000 7f2ebd056740 1 Processor -- start 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.919+0000 7f2ebd056740 1 -- start start 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f3472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f3777f0 0x55686f376b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 0x55686f34bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2ebd056740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55686f237920 con 0x55686f3770b0 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55686f2acdd0 con 0x55686f3946d0 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55686f25d3e0 con 0x55686f3777f0 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 0x55686f34bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 0x55686f34bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47308/0 (socket says 172.21.15.66:47308) 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 -- 172.21.15.66:0/542008615 learned_addr learned my addr 172.21.15.66:0/542008615 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f3472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eabfff640 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f3777f0 0x55686f376b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 -- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f3777f0 msgr2=0x55686f376b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f3777f0 0x55686f376b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 -- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 msgr2=0x55686f3472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f3472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.920+0000 7f2eb88dd640 1 -- 172.21.15.66:0/542008615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55686f08e7c0 con 0x55686f3770b0 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 0x55686f34bec0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009e80 tx=0x7f2eac02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf410d6832d7083 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ea9ffb640 1 -- 172.21.15.66:0/542008615 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac040070 con 0x55686f3770b0 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ea9ffb640 1 -- 172.21.15.66:0/542008615 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0079a0 con 0x55686f3770b0 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ea9ffb640 1 -- 172.21.15.66:0/542008615 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac007d50 con 0x55686f3770b0 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 -- 172.21.15.66:0/542008615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 msgr2=0x55686f34bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 0x55686f34bec0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009e80 tx=0x7f2eac02f000 comp rx=0 tx=0).stop 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 -- 172.21.15.66:0/542008615 shutdown_connections 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3770b0 0x55686f34bec0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f3777f0 0x55686f376b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 --2- 172.21.15.66:0/542008615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f3472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 -- 172.21.15.66:0/542008615 >> 172.21.15.66:0/542008615 conn(0x55686f349560 msgr2=0x55686f391b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 -- 172.21.15.66:0/542008615 shutdown_connections 2024-05-10T11:16:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.921+0000 7f2ebd056740 1 -- 172.21.15.66:0/542008615 wait complete. 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.922+0000 7f2ebd056740 1 -- start start 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.922+0000 7f2ebd056740 1 Processor -- start 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f392530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f390770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f390cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55686f2b5440 con 0x55686f3777f0 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55686f2b0120 con 0x55686f3946d0 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55686f2be210 con 0x55686f364dd0 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2ebd056740 10 client.0 _ll_register_callbacks cb 0x55686f255690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f392530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f392530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47324/0 (socket says 172.21.15.66:47324) 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 -- 172.21.15.66:0/1365642379 learned_addr learned my addr 172.21.15.66:0/1365642379 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eabfff640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f390770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f390cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 -- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 msgr2=0x55686f390cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f390cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 -- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 msgr2=0x55686f390770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f390770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 -- 172.21.15.66:0/1365642379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55686f0eef50 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f392530 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400eaa0 tx=0x7f2ea4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654d1e19beb37006 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.923+0000 7f2e92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2e92ffd640 1 -- 172.21.15.66:0/1365642379 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4028060 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2e92ffd640 1 -- 172.21.15.66:0/1365642379 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f2ea4023460 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eac0079a0 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2e92ffd640 1 -- 172.21.15.66:0/1365642379 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2ea402e050 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 10 client.6102 fetch_fsmap learned FSMap version 36 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55686ef820b0 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2e92ffd640 1 -- 172.21.15.66:0/1365642379 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0079a0 con 0x55686f3777f0 2024-05-10T11:16:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2e92ffd640 1 -- 172.21.15.66:0/1365642379 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7f2ea4031020 con 0x55686f3777f0 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 10 client.6102 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 10 client.6102 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 20 client.6102 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f363b00 0x55686f363ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 4 client.6102 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55686f2bea20 con 0x55686f363b00 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.924+0000 7f2eabfff640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f363b00 0x55686f363ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.925+0000 7f2eabfff640 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f363b00 0x55686f363ee0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b3127586373a84 server_cookie=3818f14ffab26df7 in_seq=0 out_seq=0 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.925+0000 7f2e92ffd640 10 client.6102 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.925+0000 7f2e92ffd640 1 -- 172.21.15.66:0/1365642379 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55686f2bea20 con 0x55686f363b00 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.925+0000 7f2e92ffd640 10 client.6102 handle_command_reply: tid=0 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.925+0000 7f2ebd056740 1 client.6102 shutdown 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 msgr2=0x55686f392530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f392530 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400eaa0 tx=0x7f2ea4004730 comp rx=0 tx=0).stop 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 shutdown_connections 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f390cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f3946d0 0x55686f390770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f363b00 0x55686f363ee0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 --2- 172.21.15.66:0/1365642379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f392530 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2e92ffd640 0 client.6102 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 >> 172.21.15.66:0/1365642379 conn(0x55686f3770b0 msgr2=0x55686f346a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 shutdown_connections 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 1 -- 172.21.15.66:0/1365642379 wait complete. 2024-05-10T11:16:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.926+0000 7f2ebd056740 20 client.6102 trim_cache size 0 max 16384 2024-05-10T11:16:12.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.939+0000 7f2ebd056740 1 Processor -- start 2024-05-10T11:16:12.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 -- start start 2024-05-10T11:16:12.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f363b00 0x55686f34a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f364dd0 0x55686f34adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4200fd0 con 0x55686f3777f0 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4200420 con 0x55686f364dd0 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb4200920 con 0x55686f363b00 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2eb88dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2eb88dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47332/0 (socket says 172.21.15.66:47332) 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.940+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2167798997 learned_addr learned my addr 172.21.15.66:0/2167798997 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2167798997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f363b00 msgr2=0x55686f34a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f363b00 0x55686f34a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2167798997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f364dd0 msgr2=0x55686f34adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f364dd0 0x55686f34adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2167798997 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55686f341d40 con 0x55686f3777f0 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5680 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2eac007300 tx=0x7f2eac030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6985bdc870c829f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ea97fa640 1 -- 172.21.15.66:0/2167798997 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac040070 con 0x55686f3777f0 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ea97fa640 1 -- 172.21.15.66:0/2167798997 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac003cd0 con 0x55686f3777f0 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ea97fa640 1 -- 172.21.15.66:0/2167798997 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0079e0 con 0x55686f3777f0 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 -- 172.21.15.66:0/2167798997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 msgr2=0x55686f3b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5680 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2eac007300 tx=0x7f2eac030000 comp rx=0 tx=0).stop 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 -- 172.21.15.66:0/2167798997 shutdown_connections 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5680 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f364dd0 0x55686f34adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2167798997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f363b00 0x55686f34a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 -- 172.21.15.66:0/2167798997 >> 172.21.15.66:0/2167798997 conn(0x55686f3770b0 msgr2=0x55686f394f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 -- 172.21.15.66:0/2167798997 shutdown_connections 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.941+0000 7f2ebd056740 1 -- 172.21.15.66:0/2167798997 wait complete. 2024-05-10T11:16:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.942+0000 7f2ebd056740 1 -- start start 2024-05-10T11:16:12.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.942+0000 7f2ebd056740 1 Processor -- start 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f363b00 0x55686f40fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f3b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55686f3652e0 con 0x55686f3777f0 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55686f266a20 con 0x55686f363b00 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55686f361460 con 0x55686f364dd0 2024-05-10T11:16:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2ebd056740 10 client.0 _ll_register_callbacks cb 0x7f2ea4009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47340/0 (socket says 172.21.15.66:47340) 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2203751265 learned_addr learned my addr 172.21.15.66:0/2203751265 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f363b00 0x55686f40fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eabfff640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f3b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 msgr2=0x55686f3b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f3b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f363b00 msgr2=0x55686f40fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f363b00 0x55686f40fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.943+0000 7f2eb88dd640 1 -- 172.21.15.66:0/2203751265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55686f3464d0 con 0x55686f3777f0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2eb88dd640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5a10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2eac032000 tx=0x7f2eac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f80cb7a038fb68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2e92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2e92ffd640 1 -- 172.21.15.66:0/2203751265 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac054070 con 0x55686f3777f0 2024-05-10T11:16:12.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2e92ffd640 1 -- 172.21.15.66:0/2203751265 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f2eac059ce0 con 0x55686f3777f0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eac003cd0 con 0x55686f3777f0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2e92ffd640 1 -- 172.21.15.66:0/2203751265 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2eac060050 con 0x55686f3777f0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 10 client.6108 fetch_fsmap learned FSMap version 36 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55686f34d020 con 0x55686f3777f0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2e92ffd640 1 -- 172.21.15.66:0/2203751265 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac003cd0 con 0x55686f3777f0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2e92ffd640 1 -- 172.21.15.66:0/2203751265 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7f2eac063020 con 0x55686f3777f0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 10 client.6108 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 10 client.6108 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 20 client.6108 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f3946d0 0x55686f373140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 4 client.6108 mds_command: new command op to 5754 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 --> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55686f2b8890 con 0x55686f3946d0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.944+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f3946d0 0x55686f373140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2eb3fff640 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f3946d0 0x55686f373140 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1463efe308a4d72f server_cookie=1a912e0ef8895a3d in_seq=0 out_seq=0 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2e92ffd640 10 client.6108 ms_handle_connect on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2e92ffd640 1 -- 172.21.15.66:0/2203751265 <== mds.0 v2:172.21.15.190:6835/2375668947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55686f2b8890 con 0x55686f3946d0 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2e92ffd640 10 client.6108 handle_command_reply: tid=0 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 client.6108 shutdown 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 msgr2=0x55686f3b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5a10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2eac032000 tx=0x7f2eac004ab0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 shutdown_connections 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:6835/2375668947,v1:172.21.15.190:6837/2375668947] conn(0x55686f3946d0 0x55686f373140 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55686f3777f0 0x55686f3b5a10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55686f364dd0 0x55686f3b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 --2- 172.21.15.66:0/2203751265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55686f363b00 0x55686f40fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2e92ffd640 0 client.6108 ms_handle_reset on v2:172.21.15.190:6835/2375668947 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 >> 172.21.15.66:0/2203751265 conn(0x55686f3770b0 msgr2=0x55686f394f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 shutdown_connections 2024-05-10T11:16:12.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.945+0000 7f2ebd056740 1 -- 172.21.15.66:0/2203751265 wait complete. 2024-05-10T11:16:12.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2ebd056740 20 client.6108 trim_cache size 0 max 16384 2024-05-10T11:16:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:12.952 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e940762d0 msgr2=0x7f2e94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e940762d0 0x7f2e94078790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4006fd0 tx=0x7f2ea4008040 comp rx=0 tx=0).stop 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 msgr2=0x7f2eb409d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 0x7f2eb409d6a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c4e0 tx=0x7f2e9c00c9a0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 shutdown_connections 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e940762d0 0x7f2e94078790 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb40d2190 0x7f2eb409dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2eb40cf3e0 0x7f2eb409d6a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 --2- 172.21.15.66:0/3395960168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb40cd500 0x7f2eb41f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 >> 172.21.15.66:0/3395960168 conn(0x7f2eb40d2eb0 msgr2=0x7f2eb4071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:12.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 shutdown_connections 2024-05-10T11:16:12.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:12.946+0000 7f2eba340640 1 -- 172.21.15.66:0/3395960168 wait complete. 2024-05-10T11:16:12.957 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:16:13.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.059+0000 7f3933b32640 1 Processor -- start 2024-05-10T11:16:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.059+0000 7f3933b32640 1 -- start start 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f3933b32640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f392c15f620 0x7f392c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f3933b32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f3933b32640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c160190 con 0x7f392c06c990 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f3933b32640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f392c06cd70 con 0x7f392c15f620 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f3933b32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f392c160470 con 0x7f392c0704c0 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f39310cd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f392c15f620 0x7f392c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f39318ce640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f392c06c990 0x7f392c163660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44420/0 (socket says 172.21.15.66:44420) 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f39318ce640 1 -- 172.21.15.66:0/3776805591 learned_addr learned my addr 172.21.15.66:0/3776805591 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.060+0000 7f39320cf640 1 --2- 172.21.15.66:0/3776805591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.061+0000 7f39310cd640 1 -- 172.21.15.66:0/3776805591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 msgr2=0x7f392c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.061+0000 7f39310cd640 1 --2- 172.21.15.66:0/3776805591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.061+0000 7f39310cd640 1 -- 172.21.15.66:0/3776805591 >> v1:172.21.15.66:6789/0 conn(0x7f392c06c990 legacy=0x7f392c163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.061+0000 7f39308cc640 1 -- 172.21.15.66:0/3776805591 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368028357 0 0) 0x7f392c160190 con 0x7f392c06c990 2024-05-10T11:16:13.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.061+0000 7f39310cd640 1 -- 172.21.15.66:0/3776805591 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c162e60 con 0x7f392c15f620 2024-05-10T11:16:13.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.061+0000 7f39310cd640 1 --2- 172.21.15.66:0/3776805591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c15fa80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f391c0097a0 tx=0x7f391c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239ad821875c4601 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:13.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f39308cc640 1 -- 172.21.15.66:0/3776805591 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c037070 con 0x7f392c15f620 2024-05-10T11:16:13.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f39308cc640 1 -- 172.21.15.66:0/3776805591 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c032440 con 0x7f392c15f620 2024-05-10T11:16:13.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f39308cc640 1 -- 172.21.15.66:0/3776805591 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c032810 con 0x7f392c15f620 2024-05-10T11:16:13.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 -- 172.21.15.66:0/3776805591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 msgr2=0x7f392c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 --2- 172.21.15.66:0/3776805591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c15fa80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f391c0097a0 tx=0x7f391c02a180 comp rx=0 tx=0).stop 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 -- 172.21.15.66:0/3776805591 shutdown_connections 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 --2- 172.21.15.66:0/3776805591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 --2- 172.21.15.66:0/3776805591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c15fa80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 -- 172.21.15.66:0/3776805591 >> 172.21.15.66:0/3776805591 conn(0x7f392c0b3980 msgr2=0x7f392c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 -- 172.21.15.66:0/3776805591 shutdown_connections 2024-05-10T11:16:13.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.062+0000 7f3933b32640 1 -- 172.21.15.66:0/3776805591 wait complete. 2024-05-10T11:16:13.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.063+0000 7f3933b32640 1 Processor -- start 2024-05-10T11:16:13.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.063+0000 7f3933b32640 1 -- start start 2024-05-10T11:16:13.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f3933b32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c06c990 0x7f392c161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f3933b32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f3933b32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f3933b32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f392c073e70 con 0x7f392c15f620 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f3933b32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f392c070e60 con 0x7f392c06c990 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f3933b32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0cf920 con 0x7f392c0704c0 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f39320cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f39320cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c0b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47348/0 (socket says 172.21.15.66:47348) 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f39320cf640 1 -- 172.21.15.66:0/2504654493 learned_addr learned my addr 172.21.15.66:0/2504654493 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f39318ce640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c06c990 0x7f392c161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.064+0000 7f39310cd640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39320cf640 1 -- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 msgr2=0x7f392c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39320cf640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c15edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39320cf640 1 -- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c06c990 msgr2=0x7f392c161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39320cf640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c06c990 0x7f392c161cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39320cf640 1 -- 172.21.15.66:0/2504654493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c15dd30 con 0x7f392c15f620 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39320cf640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c0b4790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3924007e40 tx=0x7f392400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924014620 con 0x7f392c15f620 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3924019070 con 0x7f392c15f620 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c15e010 con 0x7f392c15f620 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924014a20 con 0x7f392c15f620 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.065+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c15e5d0 con 0x7f392c15f620 2024-05-10T11:16:13.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.066+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c06fdc0 con 0x7f392c15f620 2024-05-10T11:16:13.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.067+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3924014bc0 con 0x7f392c15f620 2024-05-10T11:16:13.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.068+0000 7f39227fc640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39100762d0 0x7f3910078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.068+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f3924097f60 con 0x7f392c15f620 2024-05-10T11:16:13.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.068+0000 7f39318ce640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39100762d0 0x7f3910078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.068+0000 7f39318ce640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39100762d0 0x7f3910078790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3928000f60 tx=0x7f3928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:13.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.072+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f392c06fdc0 con 0x7f392c15f620 2024-05-10T11:16:13.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.300+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f392c070920 con 0x7f392c15f620 2024-05-10T11:16:13.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.300+0000 7f39227fc640 1 -- 172.21.15.66:0/2504654493 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f392c070920 con 0x7f392c15f620 2024-05-10T11:16:13.301 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:13.301 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T11:16:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39100762d0 msgr2=0x7f3910078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39100762d0 0x7f3910078790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3928000f60 tx=0x7f3928009040 comp rx=0 tx=0).stop 2024-05-10T11:16:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 msgr2=0x7f392c0b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c0b4790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3924007e40 tx=0x7f392400e4b0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 shutdown_connections 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39100762d0 0x7f3910078790 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f392c15f620 0x7f392c0b4790 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f392c0704c0 0x7f392c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 --2- 172.21.15.66:0/2504654493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c06c990 0x7f392c161cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.302+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 >> 172.21.15.66:0/2504654493 conn(0x7f392c0b3980 msgr2=0x7f392c15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.303+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 shutdown_connections 2024-05-10T11:16:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.303+0000 7f3933b32640 1 -- 172.21.15.66:0/2504654493 wait complete. 2024-05-10T11:16:13.314 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T11:16:13.314 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:16:13.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:16:13.352 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:16:13.395 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:16:13.396 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:16:13.396 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:13.396 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:13.413 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:13.413 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:13.469 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:16:13.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.613+0000 7fe1f5724640 1 Processor -- start 2024-05-10T11:16:13.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.613+0000 7fe1f5724640 1 -- start start 2024-05-10T11:16:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1f5724640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe1f01611e0 0x7fe1f00cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1f5724640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f00c6a80 con 0x7fe1f00c65f0 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1f5724640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f00cd090 con 0x7fe1f015ce60 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1f5724640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f00cd370 con 0x7fe1f01611e0 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1e67fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe1f01611e0 0x7fe1f00cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1ef7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe1f00c65f0 0x7fe1f015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44432/0 (socket says 172.21.15.66:44432) 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1ef7fe640 1 -- 172.21.15.66:0/2315682584 learned_addr learned my addr 172.21.15.66:0/2315682584 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1e67fc640 1 -- 172.21.15.66:0/2315682584 >> v1:172.21.15.190:6789/0 conn(0x7fe1f015ce60 legacy=0x7fe1f0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1e67fc640 1 -- 172.21.15.66:0/2315682584 >> v1:172.21.15.66:6789/0 conn(0x7fe1f00c65f0 legacy=0x7fe1f015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1ee7fc640 1 -- 172.21.15.66:0/2315682584 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2743466714 0 0) 0x7fe1e8001490 con 0x7fe1f00c65f0 2024-05-10T11:16:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.614+0000 7fe1e67fc640 1 -- 172.21.15.66:0/2315682584 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f00cd650 con 0x7fe1f01611e0 2024-05-10T11:16:13.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.615+0000 7fe1e67fc640 1 --2- 172.21.15.66:0/2315682584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f01611e0 0x7fe1f00cb300 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80097a0 tx=0x7fe1d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a552aa1c16f436dd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.615+0000 7fe1ee7fc640 1 -- 172.21.15.66:0/2315682584 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8037070 con 0x7fe1f01611e0 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.615+0000 7fe1ee7fc640 1 -- 172.21.15.66:0/2315682584 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8032440 con 0x7fe1f01611e0 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.615+0000 7fe1ee7fc640 1 -- 172.21.15.66:0/2315682584 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8032810 con 0x7fe1f01611e0 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 -- 172.21.15.66:0/2315682584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f01611e0 msgr2=0x7fe1f00cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 --2- 172.21.15.66:0/2315682584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f01611e0 0x7fe1f00cb300 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80097a0 tx=0x7fe1d802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 -- 172.21.15.66:0/2315682584 shutdown_connections 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 --2- 172.21.15.66:0/2315682584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f01611e0 0x7fe1f00cb300 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 -- 172.21.15.66:0/2315682584 >> 172.21.15.66:0/2315682584 conn(0x7fe1f00b2900 msgr2=0x7fe1f00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 -- 172.21.15.66:0/2315682584 shutdown_connections 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.616+0000 7fe1f5724640 1 -- 172.21.15.66:0/2315682584 wait complete. 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.617+0000 7fe1f5724640 1 Processor -- start 2024-05-10T11:16:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.617+0000 7fe1f5724640 1 -- start start 2024-05-10T11:16:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1f5724640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f00c65f0 0x7fe1f0143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1f5724640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 0x7fe1f00b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1f5724640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1f01611e0 0x7fe1f00b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1f5724640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f00cde50 con 0x7fe1f015ce60 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1f5724640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f00ccd60 con 0x7fe1f00c65f0 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1f5724640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f00cdfd0 con 0x7fe1f01611e0 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 0x7fe1f00b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 0x7fe1f00b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47372/0 (socket says 172.21.15.66:47372) 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 -- 172.21.15.66:0/872463739 learned_addr learned my addr 172.21.15.66:0/872463739 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 -- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1f01611e0 msgr2=0x7fe1f00b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1eeffd640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f00c65f0 0x7fe1f0143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1f01611e0 0x7fe1f00b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 -- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f00c65f0 msgr2=0x7fe1f0143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f00c65f0 0x7fe1f0143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 -- 172.21.15.66:0/872463739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f01f8660 con 0x7fe1f015ce60 2024-05-10T11:16:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.618+0000 7fe1e67fc640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 0x7fe1f00b2090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8035040 tx=0x7fe1d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.619+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8037050 con 0x7fe1f015ce60 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.619+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8038040 con 0x7fe1f015ce60 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.619+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8004490 con 0x7fe1f015ce60 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.619+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f01f8940 con 0x7fe1f015ce60 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.619+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01f8f00 con 0x7fe1f015ce60 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.620+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f006a220 con 0x7fe1f015ce60 2024-05-10T11:16:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.620+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe1d8030900 con 0x7fe1f015ce60 2024-05-10T11:16:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.621+0000 7fe1e7fff640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1d00762d0 0x7fe1d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.621+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fe1d80b8450 con 0x7fe1f015ce60 2024-05-10T11:16:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.621+0000 7fe1eeffd640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1d00762d0 0x7fe1d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.621+0000 7fe1eeffd640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1d00762d0 0x7fe1d0078790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0000f60 tx=0x7fe1e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.625+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe1d8081b90 con 0x7fe1f015ce60 2024-05-10T11:16:13.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.832+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe1f00af170 con 0x7fe1f015ce60 2024-05-10T11:16:13.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.832+0000 7fe1e7fff640 1 -- 172.21.15.66:0/872463739 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7fe1d8081490 con 0x7fe1f015ce60 2024-05-10T11:16:13.833 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:16:13.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1d00762d0 msgr2=0x7fe1d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1d00762d0 0x7fe1d0078790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0000f60 tx=0x7fe1e0009040 comp rx=0 tx=0).stop 2024-05-10T11:16:13.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 msgr2=0x7fe1f00b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:13.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 0x7fe1f00b2090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8035040 tx=0x7fe1d80046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 shutdown_connections 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1d00762d0 0x7fe1d0078790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1f01611e0 0x7fe1f00b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f015ce60 0x7fe1f00b2090 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 --2- 172.21.15.66:0/872463739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f00c65f0 0x7fe1f0143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.834+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 >> 172.21.15.66:0/872463739 conn(0x7fe1f00b2900 msgr2=0x7fe1f01590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.835+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 shutdown_connections 2024-05-10T11:16:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:13.835+0000 7fe1f5724640 1 -- 172.21.15.66:0/872463739 wait complete. 2024-05-10T11:16:13.846 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:16:13.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:13.846 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:13.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:16:13.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:13.890 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:16:13.947 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:16:13.947 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:16:13.947 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:13.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:16:13.965 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:16:13.965 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:13.965 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:14.003 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:16:14.004 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:16:14.004 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:16:14.004 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:14.022 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:16:14.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.147+0000 7fec9cdf2640 1 Processor -- start 2024-05-10T11:16:14.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.147+0000 7fec9cdf2640 1 -- start start 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec9cdf2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec980b3170 0x7fec98168100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec9cdf2640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980ce590 con 0x7fec980d3980 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec9cdf2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980d0500 con 0x7fec9815d650 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec9cdf2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fec9815da30 con 0x7fec980b3170 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec95d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fec980d3980 0x7fec980cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44436/0 (socket says 172.21.15.66:44436) 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec95d9b640 1 -- 172.21.15.66:0/2438639975 learned_addr learned my addr 172.21.15.66:0/2438639975 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:14.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec96d9d640 1 --2- 172.21.15.66:0/2438639975 >> v2:172.21.15.190:3300/0 conn(0x7fec980b3170 0x7fec98168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec9559a640 1 -- 172.21.15.66:0/2438639975 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375668327 0 0) 0x7fec8c001110 con 0x7fec980d3980 2024-05-10T11:16:14.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.148+0000 7fec9559a640 1 -- 172.21.15.66:0/2438639975 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec80003520 con 0x7fec980d3980 2024-05-10T11:16:14.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.149+0000 7fec96d9d640 1 -- 172.21.15.66:0/2438639975 >> v1:172.21.15.190:6789/0 conn(0x7fec9815d650 legacy=0x7fec980cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.149+0000 7fec96d9d640 1 -- 172.21.15.66:0/2438639975 >> v1:172.21.15.66:6789/0 conn(0x7fec980d3980 legacy=0x7fec980cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.149+0000 7fec96d9d640 1 -- 172.21.15.66:0/2438639975 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec980ce810 con 0x7fec980b3170 2024-05-10T11:16:14.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.149+0000 7fec96d9d640 1 --2- 172.21.15.66:0/2438639975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980b3170 0x7fec98168100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fec90009d90 tx=0x7fec9002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84957531ce2e8859 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.149+0000 7fec9559a640 1 -- 172.21.15.66:0/2438639975 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90007740 con 0x7fec980b3170 2024-05-10T11:16:14.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.149+0000 7fec9559a640 1 -- 172.21.15.66:0/2438639975 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec900078e0 con 0x7fec980b3170 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9559a640 1 -- 172.21.15.66:0/2438639975 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90007cb0 con 0x7fec980b3170 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 -- 172.21.15.66:0/2438639975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980b3170 msgr2=0x7fec98168100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/2438639975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980b3170 0x7fec98168100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fec90009d90 tx=0x7fec9002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 -- 172.21.15.66:0/2438639975 shutdown_connections 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/2438639975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980b3170 0x7fec98168100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 -- 172.21.15.66:0/2438639975 >> 172.21.15.66:0/2438639975 conn(0x7fec980d2df0 msgr2=0x7fec980d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 -- 172.21.15.66:0/2438639975 shutdown_connections 2024-05-10T11:16:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.150+0000 7fec9cdf2640 1 -- 172.21.15.66:0/2438639975 wait complete. 2024-05-10T11:16:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 Processor -- start 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 -- start start 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec980b3170 0x7fec980b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980d3980 0x7fec980b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 0x7fec980b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec980b43a0 con 0x7fec9815d650 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec980cedd0 con 0x7fec980d3980 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.152+0000 7fec9cdf2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fec980b4520 con 0x7fec980b3170 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 0x7fec980b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 0x7fec980b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47386/0 (socket says 172.21.15.66:47386) 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 -- 172.21.15.66:0/3636726934 learned_addr learned my addr 172.21.15.66:0/3636726934 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec9659c640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec980b3170 0x7fec980b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec95d9b640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980d3980 0x7fec980b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 -- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec980b3170 msgr2=0x7fec980b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec980b3170 0x7fec980b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 -- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980d3980 msgr2=0x7fec980b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980d3980 0x7fec980b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 -- 172.21.15.66:0/3636726934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9806dfe0 con 0x7fec9815d650 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec96d9d640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 0x7fec980b84b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fec90009eb0 tx=0x7fec90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90040070 con 0x7fec9815d650 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec90031c40 con 0x7fec9815d650 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9806e2c0 con 0x7fec9815d650 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90009450 con 0x7fec9815d650 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.153+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9806e880 con 0x7fec9815d650 2024-05-10T11:16:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.154+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9806a220 con 0x7fec9815d650 2024-05-10T11:16:14.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.155+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec90039040 con 0x7fec9815d650 2024-05-10T11:16:14.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.156+0000 7fec86ffd640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fec780762d0 0x7fec78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.156+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fec900b8560 con 0x7fec9815d650 2024-05-10T11:16:14.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.156+0000 7fec9659c640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fec780762d0 0x7fec78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.156+0000 7fec9659c640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fec780762d0 0x7fec78078790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec880016e0 tx=0x7fec88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.160+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fec90081650 con 0x7fec9815d650 2024-05-10T11:16:14.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.390+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec980d2420 con 0x7fec9815d650 2024-05-10T11:16:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.391+0000 7fec86ffd640 1 -- 172.21.15.66:0/3636726934 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5186 (secure 0 0 0) 0x7fec90085950 con 0x7fec9815d650 2024-05-10T11:16:14.391 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:14.391 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:46.320508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":15,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:16:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-05-10T11:16:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fec780762d0 msgr2=0x7fec78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fec780762d0 0x7fec78078790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec880016e0 tx=0x7fec88009040 comp rx=0 tx=0).stop 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 msgr2=0x7fec980b84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 0x7fec980b84b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fec90009eb0 tx=0x7fec90004a40 comp rx=0 tx=0).stop 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 shutdown_connections 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fec780762d0 0x7fec78078790 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec9815d650 0x7fec980b84b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec980d3980 0x7fec980b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 --2- 172.21.15.66:0/3636726934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec980b3170 0x7fec980b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 >> 172.21.15.66:0/3636726934 conn(0x7fec980d2df0 msgr2=0x7fec9815c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 shutdown_connections 2024-05-10T11:16:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.393+0000 7fec9cdf2640 1 -- 172.21.15.66:0/3636726934 wait complete. 2024-05-10T11:16:14.404 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:14.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.508+0000 7f12a203e640 1 Processor -- start 2024-05-10T11:16:14.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.508+0000 7f12a203e640 1 -- start start 2024-05-10T11:16:14.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f12a203e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f129c1611e0 0x7f129c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f12a203e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f129c0c65f0 0x7f129c15d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f12a203e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c0c6a80 con 0x7f129c15ce60 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f12a203e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f129c0cd090 con 0x7f129c0c65f0 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f12a203e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f129c0cd370 con 0x7f129c1611e0 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f129c0c65f0 0x7f129c15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129b7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f129c15ce60 0x7f129c160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44448/0 (socket says 172.21.15.66:44448) 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f129c0c65f0 0x7f129c15d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47390/0 (socket says 172.21.15.66:47390) 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129b7fe640 1 -- 172.21.15.66:0/374961928 learned_addr learned my addr 172.21.15.66:0/374961928 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129affd640 1 --2- 172.21.15.66:0/374961928 >> v2:172.21.15.190:3300/0 conn(0x7f129c1611e0 0x7f129c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129bfff640 1 -- 172.21.15.66:0/374961928 >> v2:172.21.15.190:3300/0 conn(0x7f129c1611e0 msgr2=0x7f129c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129bfff640 1 --2- 172.21.15.66:0/374961928 >> v2:172.21.15.190:3300/0 conn(0x7f129c1611e0 0x7f129c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129bfff640 1 -- 172.21.15.66:0/374961928 >> v1:172.21.15.66:6789/0 conn(0x7f129c15ce60 legacy=0x7f129c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129bfff640 1 -- 172.21.15.66:0/374961928 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c0cd650 con 0x7f129c0c65f0 2024-05-10T11:16:14.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129a7fc640 1 -- 172.21.15.66:0/374961928 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920820698 0 0) 0x7f128c001110 con 0x7f129c15ce60 2024-05-10T11:16:14.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.509+0000 7f129affd640 1 --2- 172.21.15.66:0/374961928 >> v2:172.21.15.190:3300/0 conn(0x7f129c1611e0 0x7f129c0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:14.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.510+0000 7f129bfff640 1 --2- 172.21.15.66:0/374961928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0c65f0 0x7f129c15d240 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f129c074260 tx=0x7f129402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b36975c2d4414e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.510+0000 7f129a7fc640 1 -- 172.21.15.66:0/374961928 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294007740 con 0x7f129c0c65f0 2024-05-10T11:16:14.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.510+0000 7f129a7fc640 1 -- 172.21.15.66:0/374961928 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12940078e0 con 0x7f129c0c65f0 2024-05-10T11:16:14.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.510+0000 7f129a7fc640 1 -- 172.21.15.66:0/374961928 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294007cb0 con 0x7f129c0c65f0 2024-05-10T11:16:14.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 -- 172.21.15.66:0/374961928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0c65f0 msgr2=0x7f129c15d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 --2- 172.21.15.66:0/374961928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0c65f0 0x7f129c15d240 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f129c074260 tx=0x7f129402a5f0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 -- 172.21.15.66:0/374961928 shutdown_connections 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 --2- 172.21.15.66:0/374961928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0c65f0 0x7f129c15d240 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 --2- 172.21.15.66:0/374961928 >> v2:172.21.15.190:3300/0 conn(0x7f129c1611e0 0x7f129c0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 -- 172.21.15.66:0/374961928 >> 172.21.15.66:0/374961928 conn(0x7f129c0b2900 msgr2=0x7f129c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 -- 172.21.15.66:0/374961928 shutdown_connections 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.511+0000 7f12a203e640 1 -- 172.21.15.66:0/374961928 wait complete. 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.512+0000 7f12a203e640 1 Processor -- start 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.512+0000 7f12a203e640 1 -- start start 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f12a203e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0c65f0 0x7f129c0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f12a203e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 0x7f129c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f12a203e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c1611e0 0x7f129c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f12a203e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f129c0cde50 con 0x7f129c15ce60 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f12a203e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f129c0ccd60 con 0x7f129c1611e0 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f12a203e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f129c0cdfd0 con 0x7f129c0c65f0 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f129affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 0x7f129c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f129affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 0x7f129c1f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47402/0 (socket says 172.21.15.66:47402) 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f129affd640 1 -- 172.21.15.66:0/1801387337 learned_addr learned my addr 172.21.15.66:0/1801387337 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f129b7fe640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0c65f0 0x7f129c0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.513+0000 7f129bfff640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c1611e0 0x7f129c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f129affd640 1 -- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0c65f0 msgr2=0x7f129c0b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f129affd640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0c65f0 0x7f129c0b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f129affd640 1 -- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c1611e0 msgr2=0x7f129c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f129affd640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c1611e0 0x7f129c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f129affd640 1 -- 172.21.15.66:0/1801387337 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c09cc20 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f129affd640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 0x7f129c1f6390 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f129000d800 tx=0x7f129000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290004030 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12900041d0 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900096a0 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129c0b67b0 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.514+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129c1f6ec0 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.515+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129c06a220 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.515+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1290009840 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.516+0000 7f1283fff640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.516+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f1290097890 con 0x7f129c15ce60 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.516+0000 7f129b7fe640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.517+0000 7f129b7fe640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f128c000f60 tx=0x7f128c007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.520+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1290060a10 con 0x7f129c15ce60 2024-05-10T11:16:14.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.750+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f129c0c7300 con 0x7f129c15ce60 2024-05-10T11:16:14.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.751+0000 7f1283fff640 1 -- 172.21.15.66:0/1801387337 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5186 (secure 0 0 0) 0x7f1290064d10 con 0x7f129c15ce60 2024-05-10T11:16:14.752 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:14.752 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:46.320508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":15,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:16:14.752 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 msgr2=0x7f1288078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f128c000f60 tx=0x7f128c007b50 comp rx=0 tx=0).stop 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 msgr2=0x7f129c1f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 0x7f129c1f6390 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f129000d800 tx=0x7f129000dcc0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 shutdown_connections 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c1611e0 0x7f129c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c15ce60 0x7f129c1f6390 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 --2- 172.21.15.66:0/1801387337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0c65f0 0x7f129c0b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 >> 172.21.15.66:0/1801387337 conn(0x7f129c0b2900 msgr2=0x7f129c158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:14.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 shutdown_connections 2024-05-10T11:16:14.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.753+0000 7f12a203e640 1 -- 172.21.15.66:0/1801387337 wait complete. 2024-05-10T11:16:14.765 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:16:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.868+0000 7f63c529c640 1 Processor -- start 2024-05-10T11:16:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.868+0000 7f63c529c640 1 -- start start 2024-05-10T11:16:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63c529c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c015f620 0x7f63c015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63c529c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f63c00704c0 0x7f63c0070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63c529c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c0160190 con 0x7f63c006c990 2024-05-10T11:16:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63c529c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f63c006cd70 con 0x7f63c00704c0 2024-05-10T11:16:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63c529c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f63c0160470 con 0x7f63c015f620 2024-05-10T11:16:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63beffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f63c006c990 0x7f63c0163660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55110/0 (socket says 172.21.15.66:55110) 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63beffd640 1 -- 172.21.15.66:0/3770696979 learned_addr learned my addr 172.21.15.66:0/3770696979 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63be7fc640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c015f620 0x7f63c015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63bf7fe640 1 --2- 172.21.15.66:0/3770696979 >> v2:172.21.15.190:3300/0 conn(0x7f63c00704c0 0x7f63c0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63bdffb640 1 -- 172.21.15.66:0/3770696979 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761305518 0 0) 0x7f63c0160190 con 0x7f63c006c990 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.869+0000 7f63bdffb640 1 -- 172.21.15.66:0/3770696979 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63a8003520 con 0x7f63c006c990 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.870+0000 7f63bdffb640 1 -- 172.21.15.66:0/3770696979 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255241807 0 0) 0x7f63a8003520 con 0x7f63c006c990 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.870+0000 7f63bf7fe640 1 -- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c015f620 msgr2=0x7f63c015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.870+0000 7f63bf7fe640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c015f620 0x7f63c015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.870+0000 7f63bf7fe640 1 -- 172.21.15.66:0/3770696979 >> v1:172.21.15.66:6789/0 conn(0x7f63c006c990 legacy=0x7f63c0163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.870+0000 7f63bf7fe640 1 -- 172.21.15.66:0/3770696979 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c0162e60 con 0x7f63c00704c0 2024-05-10T11:16:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.870+0000 7f63be7fc640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c015f620 0x7f63c015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63bf7fe640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c00704c0 0x7f63c0070950 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009d90 tx=0x7f63b802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2289afdd70cb939b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63bdffb640 1 -- 172.21.15.66:0/3770696979 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b0001670 con 0x7f63c00704c0 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63bdffb640 1 -- 172.21.15.66:0/3770696979 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b8007540 con 0x7f63c00704c0 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63bdffb640 1 -- 172.21.15.66:0/3770696979 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b80078f0 con 0x7f63c00704c0 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 -- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c00704c0 msgr2=0x7f63c0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c00704c0 0x7f63c0070950 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009d90 tx=0x7f63b802a5f0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 -- 172.21.15.66:0/3770696979 shutdown_connections 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c00704c0 0x7f63c0070950 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 --2- 172.21.15.66:0/3770696979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c015f620 0x7f63c015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 -- 172.21.15.66:0/3770696979 >> 172.21.15.66:0/3770696979 conn(0x7f63c00b3980 msgr2=0x7f63c00b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:14.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 -- 172.21.15.66:0/3770696979 shutdown_connections 2024-05-10T11:16:14.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.871+0000 7f63c529c640 1 -- 172.21.15.66:0/3770696979 wait complete. 2024-05-10T11:16:14.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 Processor -- start 2024-05-10T11:16:14.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 -- start start 2024-05-10T11:16:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c006c990 0x7f63c0162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 0x7f63c00b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c015f620 0x7f63c00b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63c0073e70 con 0x7f63c00704c0 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f63c0070e90 con 0x7f63c015f620 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63c529c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f63c00cf920 con 0x7f63c006c990 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.873+0000 7f63be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 0x7f63c00b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 0x7f63c00b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46946/0 (socket says 172.21.15.66:46946) 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 -- 172.21.15.66:0/3494918578 learned_addr learned my addr 172.21.15.66:0/3494918578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 -- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c006c990 msgr2=0x7f63c0162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c006c990 0x7f63c0162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 -- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c015f620 msgr2=0x7f63c00b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c015f620 0x7f63c00b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 -- 172.21.15.66:0/3494918578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c01608a0 con 0x7f63c00704c0 2024-05-10T11:16:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63be7fc640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 0x7f63c00b2e50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f63b400e960 tx=0x7f63b400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4017070 con 0x7f63c00704c0 2024-05-10T11:16:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b400ca00 con 0x7f63c00704c0 2024-05-10T11:16:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c0160b40 con 0x7f63c00704c0 2024-05-10T11:16:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b400cdd0 con 0x7f63c00704c0 2024-05-10T11:16:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.874+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c0161100 con 0x7f63c00704c0 2024-05-10T11:16:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.875+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c006a220 con 0x7f63c00704c0 2024-05-10T11:16:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.876+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63b401a070 con 0x7f63c00704c0 2024-05-10T11:16:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.876+0000 7f63a77fe640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63ac0762d0 0x7f63ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.876+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f63b40976c0 con 0x7f63c00704c0 2024-05-10T11:16:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.877+0000 7f63beffd640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63ac0762d0 0x7f63ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.877+0000 7f63beffd640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63ac0762d0 0x7f63ac078790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63b0001760 tx=0x7f63b0001180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:14.881+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f63b4060e00 con 0x7f63c00704c0 2024-05-10T11:16:15.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.076+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63c0075220 con 0x7f63c00704c0 2024-05-10T11:16:15.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.077+0000 7f63a77fe640 1 -- 172.21.15.66:0/3494918578 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17124 (secure 0 0 0) 0x7f63b4060700 con 0x7f63c00704c0 2024-05-10T11:16:15.078 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:15.078 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":64,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:15:14.610232+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:14:55.374882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T11:14:56.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.19","mappings":[{"from":1,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:16:15.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.079+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63ac0762d0 msgr2=0x7f63ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.079+0000 7f63c529c640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63ac0762d0 0x7f63ac078790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63b0001760 tx=0x7f63b0001180 comp rx=0 tx=0).stop 2024-05-10T11:16:15.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 msgr2=0x7f63c00b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 0x7f63c00b2e50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f63b400e960 tx=0x7f63b400ee20 comp rx=0 tx=0).stop 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 shutdown_connections 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63ac0762d0 0x7f63ac078790 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c015f620 0x7f63c00b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c00704c0 0x7f63c00b2e50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 --2- 172.21.15.66:0/3494918578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c006c990 0x7f63c0162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 >> 172.21.15.66:0/3494918578 conn(0x7f63c00b3980 msgr2=0x7f63c00d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 shutdown_connections 2024-05-10T11:16:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.080+0000 7f63c529c640 1 -- 172.21.15.66:0/3494918578 wait complete. 2024-05-10T11:16:15.091 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:16:15.091 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.195+0000 7f5a12cc8640 1 Processor -- start 2024-05-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.195+0000 7f5a12cc8640 1 -- start start 2024-05-10T11:16:15.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a12cc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5a0c0c6730 0x7f5a0c06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a12cc8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a0c0c5b70 0x7f5a0c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a12cc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0c0c64c0 con 0x7f5a0c1625f0 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a12cc8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0c0ce880 con 0x7f5a0c0c6730 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a12cc8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0c0cead0 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5a0c0c6730 0x7f5a0c06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a10a64640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5a0c1625f0 0x7f5a0c0d0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55118/0 (socket says 172.21.15.66:55118) 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a10a64640 1 -- 172.21.15.66:0/1914551005 learned_addr learned my addr 172.21.15.66:0/1914551005 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a11265640 1 --2- 172.21.15.66:0/1914551005 >> v2:172.21.15.190:3300/0 conn(0x7f5a0c0c5b70 0x7f5a0c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0b7fe640 1 -- 172.21.15.66:0/1914551005 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196091830 0 0) 0x7f5a00001110 con 0x7f5a0c1625f0 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0b7fe640 1 -- 172.21.15.66:0/1914551005 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59fc003520 con 0x7f5a0c1625f0 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0bfff640 1 -- 172.21.15.66:0/1914551005 >> v2:172.21.15.190:3300/0 conn(0x7f5a0c0c5b70 msgr2=0x7f5a0c0c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0bfff640 1 --2- 172.21.15.66:0/1914551005 >> v2:172.21.15.190:3300/0 conn(0x7f5a0c0c5b70 0x7f5a0c0c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0bfff640 1 -- 172.21.15.66:0/1914551005 >> v1:172.21.15.66:6789/0 conn(0x7f5a0c1625f0 legacy=0x7f5a0c0d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.196+0000 7f5a0bfff640 1 -- 172.21.15.66:0/1914551005 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c0cedb0 con 0x7f5a0c0c6730 2024-05-10T11:16:15.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.197+0000 7f5a0bfff640 1 --2- 172.21.15.66:0/1914551005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c6730 0x7f5a0c06dd90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0b0820 tx=0x7f59f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2c8e08e7906999 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.197+0000 7f5a0b7fe640 1 -- 172.21.15.66:0/1914551005 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8037070 con 0x7f5a0c0c6730 2024-05-10T11:16:15.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.197+0000 7f5a0b7fe640 1 -- 172.21.15.66:0/1914551005 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8032440 con 0x7f5a0c0c6730 2024-05-10T11:16:15.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.197+0000 7f5a0b7fe640 1 -- 172.21.15.66:0/1914551005 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f802ae60 con 0x7f5a0c0c6730 2024-05-10T11:16:15.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 -- 172.21.15.66:0/1914551005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c6730 msgr2=0x7f5a0c06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/1914551005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c6730 0x7f5a0c06dd90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0b0820 tx=0x7f59f802a110 comp rx=0 tx=0).stop 2024-05-10T11:16:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 -- 172.21.15.66:0/1914551005 shutdown_connections 2024-05-10T11:16:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/1914551005 >> v2:172.21.15.190:3300/0 conn(0x7f5a0c0c5b70 0x7f5a0c0c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/1914551005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c6730 0x7f5a0c06dd90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 -- 172.21.15.66:0/1914551005 >> 172.21.15.66:0/1914551005 conn(0x7f5a0c0b2900 msgr2=0x7f5a0c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 -- 172.21.15.66:0/1914551005 shutdown_connections 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.198+0000 7f5a12cc8640 1 -- 172.21.15.66:0/1914551005 wait complete. 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.199+0000 7f5a12cc8640 1 Processor -- start 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.199+0000 7f5a12cc8640 1 -- start start 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a12cc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 0x7f5a0c09caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a12cc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a0c0c6730 0x7f5a0c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a12cc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a0c1625f0 0x7f5a0c09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a12cc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c1629d0 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a12cc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c0aec50 con 0x7f5a0c1625f0 2024-05-10T11:16:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a12cc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0c06e2d0 con 0x7f5a0c0c6730 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 0x7f5a0c09caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 0x7f5a0c09caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46958/0 (socket says 172.21.15.66:46958) 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 -- 172.21.15.66:0/935865750 learned_addr learned my addr 172.21.15.66:0/935865750 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a11265640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a0c1625f0 0x7f5a0c09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a0bfff640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a0c0c6730 0x7f5a0c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 -- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a0c0c6730 msgr2=0x7f5a0c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a0c0c6730 0x7f5a0c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 -- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a0c1625f0 msgr2=0x7f5a0c09d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a0c1625f0 0x7f5a0c09d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a10a64640 1 -- 172.21.15.66:0/935865750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c09cfe0 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.200+0000 7f5a11265640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a0c1625f0 0x7f5a0c09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.201+0000 7f5a10a64640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 0x7f5a0c09caa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000c730 tx=0x7f5a0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.201+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00017070 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.201+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00005ad0 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.201+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0c0b6380 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.201+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00007e20 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.201+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0c0b49a0 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.202+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0c06a220 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.202+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a0001a070 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.203+0000 7f5a097fa640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59f00762d0 0x7f59f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.203+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f5a00096b50 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.203+0000 7f5a0bfff640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59f00762d0 0x7f59f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.204+0000 7f5a0bfff640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59f00762d0 0x7f59f0078790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f59f8034000 tx=0x7f59f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.207+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5a0c0c64c0 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.436+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a0c0b6c40 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.437+0000 7f5a097fa640 1 -- 172.21.15.66:0/935865750 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5186 (secure 0 0 0) 0x7f5a00068280 con 0x7f5a0c0c5b70 2024-05-10T11:16:15.437 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:15.437 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:46.320508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":15,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:16:15.438 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-05-10T11:16:15.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59f00762d0 msgr2=0x7f59f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59f00762d0 0x7f59f0078790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f59f8034000 tx=0x7f59f802e000 comp rx=0 tx=0).stop 2024-05-10T11:16:15.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 msgr2=0x7f5a0c09caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 0x7f5a0c09caa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000c730 tx=0x7f5a0000cbf0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 shutdown_connections 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59f00762d0 0x7f59f0078790 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a0c1625f0 0x7f5a0c09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a0c0c6730 0x7f5a0c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 --2- 172.21.15.66:0/935865750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a0c0c5b70 0x7f5a0c09caa0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 >> 172.21.15.66:0/935865750 conn(0x7f5a0c0b2900 msgr2=0x7f5a0c0d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 shutdown_connections 2024-05-10T11:16:15.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.439+0000 7f5a12cc8640 1 -- 172.21.15.66:0/935865750 wait complete. 2024-05-10T11:16:15.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:15.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.553+0000 7f70eb119640 1 Processor -- start 2024-05-10T11:16:15.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.553+0000 7f70eb119640 1 -- start start 2024-05-10T11:16:15.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70eb119640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70e40d5cb0 0x7f70e40d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70eb119640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e40b45f0 con 0x7f70e4162b30 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70eb119640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e40b48d0 con 0x7f70e4162750 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70eb119640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f70e40b4f20 con 0x7f70e40d5cb0 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70e3fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70e40d5cb0 0x7f70e40d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70e96b6640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f70e4162b30 0x7f70e40b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55132/0 (socket says 172.21.15.66:55132) 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.554+0000 7f70e96b6640 1 -- 172.21.15.66:0/3329527184 learned_addr learned my addr 172.21.15.66:0/3329527184 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.555+0000 7f70e3fff640 1 -- 172.21.15.66:0/3329527184 >> v1:172.21.15.190:6789/0 conn(0x7f70e4162750 legacy=0x7f70e40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.555+0000 7f70e3fff640 1 -- 172.21.15.66:0/3329527184 >> v1:172.21.15.66:6789/0 conn(0x7f70e4162b30 legacy=0x7f70e40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.555+0000 7f70e37fe640 1 -- 172.21.15.66:0/3329527184 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521788339 0 0) 0x7f70e40b45f0 con 0x7f70e4162b30 2024-05-10T11:16:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.555+0000 7f70e3fff640 1 -- 172.21.15.66:0/3329527184 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e40b4bb0 con 0x7f70e40d5cb0 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.555+0000 7f70e3fff640 1 --2- 172.21.15.66:0/3329527184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e40d5cb0 0x7f70e40d3630 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009d90 tx=0x7f70d402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132f68c9ce53fdb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70e37fe640 1 -- 172.21.15.66:0/3329527184 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031600 con 0x7f70e40d5cb0 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70e37fe640 1 -- 172.21.15.66:0/3329527184 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d40317a0 con 0x7f70e40d5cb0 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70e37fe640 1 -- 172.21.15.66:0/3329527184 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031b70 con 0x7f70e40d5cb0 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 -- 172.21.15.66:0/3329527184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e40d5cb0 msgr2=0x7f70e40d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 --2- 172.21.15.66:0/3329527184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e40d5cb0 0x7f70e40d3630 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009d90 tx=0x7f70d402a610 comp rx=0 tx=0).stop 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 -- 172.21.15.66:0/3329527184 shutdown_connections 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 --2- 172.21.15.66:0/3329527184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e40d5cb0 0x7f70e40d3630 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 -- 172.21.15.66:0/3329527184 >> 172.21.15.66:0/3329527184 conn(0x7f70e409e3b0 msgr2=0x7f70e40d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 -- 172.21.15.66:0/3329527184 shutdown_connections 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.556+0000 7f70eb119640 1 -- 172.21.15.66:0/3329527184 wait complete. 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.557+0000 7f70eb119640 1 Processor -- start 2024-05-10T11:16:15.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.557+0000 7f70eb119640 1 -- start start 2024-05-10T11:16:15.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70eb119640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 0x7f70e414bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70eb119640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e4162b30 0x7f70e40b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70eb119640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e40b8180 0x7f70e414e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70eb119640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40d3f40 con 0x7f70e4162750 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70eb119640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40d3dc0 con 0x7f70e40b8180 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70eb119640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f70e40d0fe0 con 0x7f70e4162b30 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70e8eb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 0x7f70e414bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70e8eb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 0x7f70e414bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46990/0 (socket says 172.21.15.66:46990) 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.558+0000 7f70e8eb5640 1 -- 172.21.15.66:0/1380541568 learned_addr learned my addr 172.21.15.66:0/1380541568 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e3fff640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e4162b30 0x7f70e40b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e96b6640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e40b8180 0x7f70e414e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e8eb5640 1 -- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e4162b30 msgr2=0x7f70e40b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e8eb5640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e4162b30 0x7f70e40b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e8eb5640 1 -- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e40b8180 msgr2=0x7f70e414e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e8eb5640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e40b8180 0x7f70e414e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e8eb5640 1 -- 172.21.15.66:0/1380541568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e40cdeb0 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e3fff640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e4162b30 0x7f70e40b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e96b6640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e40b8180 0x7f70e414e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e8eb5640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 0x7f70e414bde0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00c460 tx=0x7f70dc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc016020 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc012870 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e40ce190 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc012c60 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.559+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e40ce750 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.560+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e40ceb30 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.561+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f70dc019020 con 0x7f70e4162750 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.561+0000 7f70e17fa640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c4076300 0x7f70c40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.562+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f70dc097510 con 0x7f70e4162750 2024-05-10T11:16:15.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.562+0000 7f70e3fff640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c4076300 0x7f70c40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.562+0000 7f70e3fff640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c4076300 0x7f70c40787c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70d4034000 tx=0x7f70d402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.566+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f70e40ceb30 con 0x7f70e4162750 2024-05-10T11:16:15.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.795+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70e406a220 con 0x7f70e4162750 2024-05-10T11:16:15.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.796+0000 7f70e17fa640 1 -- 172.21.15.66:0/1380541568 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5186 (secure 0 0 0) 0x7f70dc020030 con 0x7f70e4162750 2024-05-10T11:16:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:15.797 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:14:57.646172+0000","modified":"2024-05-10T11:15:46.320508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5754":{"gid":5754,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":15,"addr":"172.21.15.190:6837/2375668947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2375668947},{"type":"v1","addr":"172.21.15.190:6837","nonce":2375668947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5754,"qdb_cluster":[5754]},"id":4}]} 2024-05-10T11:16:15.797 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c4076300 msgr2=0x7f70c40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c4076300 0x7f70c40787c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70d4034000 tx=0x7f70d402f000 comp rx=0 tx=0).stop 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 msgr2=0x7f70e414bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 0x7f70e414bde0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00c460 tx=0x7f70dc00c920 comp rx=0 tx=0).stop 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 shutdown_connections 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c4076300 0x7f70c40787c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e40b8180 0x7f70e414e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e4162b30 0x7f70e40b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 --2- 172.21.15.66:0/1380541568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e4162750 0x7f70e414bde0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 >> 172.21.15.66:0/1380541568 conn(0x7f70e409e3b0 msgr2=0x7f70e40d5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 shutdown_connections 2024-05-10T11:16:15.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.798+0000 7f70eb119640 1 -- 172.21.15.66:0/1380541568 wait complete. 2024-05-10T11:16:15.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:16:15.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.913+0000 7f927ba83640 1 Processor -- start 2024-05-10T11:16:15.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.913+0000 7f927ba83640 1 -- start start 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927ba83640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9274162940 0x7f92740b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927ba83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f92740d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927ba83640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92740d2d20 con 0x7f92740b47a0 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927ba83640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9274162d20 con 0x7f9274162940 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927ba83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f92740d3000 con 0x7f92740d59d0 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927a020640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f92740b47a0 0x7f9274162f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55142/0 (socket says 172.21.15.66:55142) 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927a020640 1 -- 172.21.15.66:0/1221737119 learned_addr learned my addr 172.21.15.66:0/1221737119 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:15.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927901e640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f92740d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927981f640 1 --2- 172.21.15.66:0/1221737119 >> v2:172.21.15.190:3300/0 conn(0x7f9274162940 0x7f92740b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490907845 0 0) 0x7f92740d2d20 con 0x7f92740b47a0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9260003520 con 0x7f92740b47a0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1518899792 0 0) 0x7f9260003520 con 0x7f92740b47a0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 msgr2=0x7f92740d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f92740d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 >> v2:172.21.15.190:3300/0 conn(0x7f9274162940 msgr2=0x7f92740b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 --2- 172.21.15.66:0/1221737119 >> v2:172.21.15.190:3300/0 conn(0x7f9274162940 0x7f92740b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92740d32e0 con 0x7f92740b47a0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f926c0019f0 con 0x7f92740b47a0 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 >> v1:172.21.15.66:6789/0 conn(0x7f92740b47a0 legacy=0x7f9274162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92600039b0 0x7f9260003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.914+0000 7f927881d640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f9260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927881d640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9260004d40 0x7f92600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f92740d3000 con 0x7f9260004d40 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f926000b9c0 con 0x7f92600039b0 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f926000bbc0 con 0x7f92740d59d0 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927a020640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9260004d40 0x7f92600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927981f640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92600039b0 0x7f9260003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927901e640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f9260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927a020640 1 -- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 msgr2=0x7f9260004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927a020640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f9260004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927a020640 1 -- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92600039b0 msgr2=0x7f9260003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927a020640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92600039b0 0x7f9260003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927a020640 1 -- 172.21.15.66:0/1221737119 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9260003520 con 0x7f9260004d40 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.915+0000 7f927901e640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740d59d0 0x7f9260004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927a020640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9260004d40 0x7f92600051c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f926c0013d0 tx=0x7f9260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14332a330562a21d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c00a4e0 con 0x7f9260004d40 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c02f070 con 0x7f9260004d40 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927881d640 1 -- 172.21.15.66:0/1221737119 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c02bce0 con 0x7f9260004d40 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927ba83640 1 -- 172.21.15.66:0/1221737119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9260004d40 msgr2=0x7f92600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927ba83640 1 --2- 172.21.15.66:0/1221737119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9260004d40 0x7f92600051c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f926c0013d0 tx=0x7f9260005830 comp rx=0 tx=0).stop 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927a020640 1 -- 172.21.15.66:0/1221737119 reap_dead start 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927ba83640 1 -- 172.21.15.66:0/1221737119 shutdown_connections 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927ba83640 1 -- 172.21.15.66:0/1221737119 >> 172.21.15.66:0/1221737119 conn(0x7f927409e380 msgr2=0x7f92740d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927ba83640 1 -- 172.21.15.66:0/1221737119 shutdown_connections 2024-05-10T11:16:15.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.916+0000 7f927ba83640 1 -- 172.21.15.66:0/1221737119 wait complete. 2024-05-10T11:16:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 Processor -- start 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 -- start start 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9260004d40 0x7f92741523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740c88c0 0x7f92740ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 0x7f92740caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f92740d2390 con 0x7f92740c8d20 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f92740cfc50 con 0x7f9260004d40 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927ba83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f92740d2510 con 0x7f92740c88c0 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927a020640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 0x7f92740caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927a020640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 0x7f92740caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47018/0 (socket says 172.21.15.66:47018) 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.918+0000 7f927a020640 1 -- 172.21.15.66:0/1468924633 learned_addr learned my addr 172.21.15.66:0/1468924633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927a020640 1 -- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740c88c0 msgr2=0x7f92740ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927a020640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740c88c0 0x7f92740ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927981f640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9260004d40 0x7f92741523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927a020640 1 -- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9260004d40 msgr2=0x7f92741523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927a020640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9260004d40 0x7f92741523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927a020640 1 -- 172.21.15.66:0/1468924633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92740cc560 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927a020640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 0x7f92740caa00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f926c02b530 tx=0x7f926c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c002040 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c00a4c0 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92741f51f0 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c034670 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.919+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92740cc800 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.920+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927406a220 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.921+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f926c034810 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.921+0000 7f926a7fc640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92580762d0 0x7f9258078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.921+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f926c0b7a20 con 0x7f92740c8d20 2024-05-10T11:16:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.922+0000 7f927981f640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92580762d0 0x7f9258078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.922+0000 7f927981f640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92580762d0 0x7f9258078790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9270009a00 tx=0x7f9270008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:15.925+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f926c046060 con 0x7f92740c8d20 2024-05-10T11:16:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.117+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92740d2730 con 0x7f92740c8d20 2024-05-10T11:16:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.118+0000 7f926a7fc640 1 -- 172.21.15.66:0/1468924633 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17124 (secure 0 0 0) 0x7f926c081160 con 0x7f92740c8d20 2024-05-10T11:16:16.119 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:16.119 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":64,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:15:14.610232+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:14:55.374882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T11:14:56.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.19","mappings":[{"from":1,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92580762d0 msgr2=0x7f9258078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92580762d0 0x7f9258078790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9270009a00 tx=0x7f9270008040 comp rx=0 tx=0).stop 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 msgr2=0x7f92740caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 0x7f92740caa00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f926c02b530 tx=0x7f926c001dc0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 shutdown_connections 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f92580762d0 0x7f9258078790 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92740c8d20 0x7f92740caa00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92740c88c0 0x7f92740ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 --2- 172.21.15.66:0/1468924633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9260004d40 0x7f92741523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 >> 172.21.15.66:0/1468924633 conn(0x7f927409e380 msgr2=0x7f92740b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:16.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 shutdown_connections 2024-05-10T11:16:16.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.120+0000 7f927ba83640 1 -- 172.21.15.66:0/1468924633 wait complete. 2024-05-10T11:16:16.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:16:16.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.236+0000 7f6817012640 1 Processor -- start 2024-05-10T11:16:16.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.236+0000 7f6817012640 1 -- start start 2024-05-10T11:16:16.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f6817012640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f681015d650 0x7f68100cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f6817012640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68100ce590 con 0x7f68100b43a0 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f6817012640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68100d0500 con 0x7f68100d3980 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f6817012640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f681015da30 con 0x7f681015d650 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f68155af640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f68100b43a0 0x7f68100b2160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55150/0 (socket says 172.21.15.66:55150) 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f68155af640 1 -- 172.21.15.66:0/4071362523 learned_addr learned my addr 172.21.15.66:0/4071362523 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f6814dae640 1 --2- 172.21.15.66:0/4071362523 >> v2:172.21.15.190:3300/0 conn(0x7f681015d650 0x7f68100cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498203314 0 0) 0x7f6808001490 con 0x7f68100b43a0 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.237+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67f8003520 con 0x7f68100b43a0 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2132940301 0 0) 0x7f67f8003520 con 0x7f68100b43a0 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 >> v2:172.21.15.190:3300/0 conn(0x7f681015d650 msgr2=0x7f68100cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 --2- 172.21.15.66:0/4071362523 >> v2:172.21.15.190:3300/0 conn(0x7f681015d650 0x7f68100cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 >> v1:172.21.15.190:6789/0 conn(0x7f68100d3980 legacy=0x7f68100cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68100ce810 con 0x7f68100b43a0 2024-05-10T11:16:16.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f6808001bc0 con 0x7f68100b43a0 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 >> v1:172.21.15.66:6789/0 conn(0x7f68100b43a0 legacy=0x7f68100b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f80039b0 0x7f67f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f8004800 0x7f67f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80051c0 0x7f67f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f67f800c030 con 0x7f67f8004800 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f67f800c1e0 con 0x7f67f80039b0 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67f800c3e0 con 0x7f67f80051c0 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680ffff640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f8004800 0x7f67f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f6814dae640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f80039b0 0x7f67f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f68155af640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80051c0 0x7f67f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680ffff640 1 -- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80051c0 msgr2=0x7f67f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680ffff640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80051c0 0x7f67f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680ffff640 1 -- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f80039b0 msgr2=0x7f67f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680ffff640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f80039b0 0x7f67f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f680ffff640 1 -- 172.21.15.66:0/4071362523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f8003520 con 0x7f67f8004800 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.238+0000 7f68155af640 1 -- 172.21.15.66:0/4071362523 reap_dead start 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.239+0000 7f680ffff640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f8004800 0x7f67f8004c80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6804001750 tx=0x7f67f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64393dab431c037a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.239+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804001370 con 0x7f67f8004800 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.239+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68040052d0 con 0x7f67f8004800 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.239+0000 7f680f7fe640 1 -- 172.21.15.66:0/4071362523 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680402abc0 con 0x7f67f8004800 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 -- 172.21.15.66:0/4071362523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f8004800 msgr2=0x7f67f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f8004800 0x7f67f8004c80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6804001750 tx=0x7f67f8005830 comp rx=0 tx=0).stop 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 -- 172.21.15.66:0/4071362523 shutdown_connections 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 --2- 172.21.15.66:0/4071362523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f8004800 0x7f67f8004c80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 -- 172.21.15.66:0/4071362523 >> 172.21.15.66:0/4071362523 conn(0x7f68100d2df0 msgr2=0x7f68100d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 -- 172.21.15.66:0/4071362523 shutdown_connections 2024-05-10T11:16:16.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.240+0000 7f6817012640 1 -- 172.21.15.66:0/4071362523 wait complete. 2024-05-10T11:16:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.241+0000 7f6817012640 1 Processor -- start 2024-05-10T11:16:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.241+0000 7f6817012640 1 -- start start 2024-05-10T11:16:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f8004800 0x7f681015fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6810157a40 0x7f68100b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 0x7f68100c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68100cf540 con 0x7f68100c65a0 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f68100cedd0 con 0x7f67f8004800 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f68100cf6c0 con 0x7f6810157a40 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 0x7f68100c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 0x7f68100c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47038/0 (socket says 172.21.15.66:47038) 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 -- 172.21.15.66:0/1401318625 learned_addr learned my addr 172.21.15.66:0/1401318625 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f680ffff640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6810157a40 0x7f68100b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6814dae640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f8004800 0x7f681015fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 -- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6810157a40 msgr2=0x7f68100b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6810157a40 0x7f68100b76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 -- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f8004800 msgr2=0x7f681015fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f8004800 0x7f681015fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 -- 172.21.15.66:0/1401318625 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6810157ec0 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f68155af640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 0x7f68100c8a00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f68100734b0 tx=0x7f6808007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808017020 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680800e9c0 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.242+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68100b7f20 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.243+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680800ed90 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.243+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68100b5d90 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.244+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681006a220 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.244+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f680801a020 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.245+0000 7f680d7fa640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67fc0762d0 0x7f67fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.245+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f6808097800 con 0x7f68100c65a0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.245+0000 7f6814dae640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67fc0762d0 0x7f67fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.246+0000 7f6814dae640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67fc0762d0 0x7f67fc078790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6800009a60 tx=0x7f6800008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:16.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.249+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6808021030 con 0x7f68100c65a0 2024-05-10T11:16:16.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.483+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6810070500 con 0x7f68100c65a0 2024-05-10T11:16:16.484 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:16:16.484+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:16:16.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.485+0000 7f680d7fa640 1 -- 172.21.15.66:0/1401318625 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f68100ce590 con 0x7f68100c65a0 2024-05-10T11:16:16.485 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:16:16.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.487+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67fc0762d0 msgr2=0x7f67fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.487+0000 7f6817012640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67fc0762d0 0x7f67fc078790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6800009a60 tx=0x7f6800008040 comp rx=0 tx=0).stop 2024-05-10T11:16:16.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 msgr2=0x7f68100c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 0x7f68100c8a00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f68100734b0 tx=0x7f6808007af0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 shutdown_connections 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67fc0762d0 0x7f67fc078790 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68100c65a0 0x7f68100c8a00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6810157a40 0x7f68100b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 --2- 172.21.15.66:0/1401318625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f8004800 0x7f681015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 >> 172.21.15.66:0/1401318625 conn(0x7f68100d2df0 msgr2=0x7f68100afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 shutdown_connections 2024-05-10T11:16:16.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.488+0000 7f6817012640 1 -- 172.21.15.66:0/1401318625 wait complete. 2024-05-10T11:16:16.492 INFO:tasks.ceph.mds.d.smithi190.stderr: -7818> 2024-05-10T11:15:00.262+0000 7f94ce33b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:16:16.495 INFO:tasks.ceph.mds.d.smithi190.stderr: -4763> 2024-05-10T11:15:10.739+0000 7f94ca333640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5198=0-4194304@1} caps={5198=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5198 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x557868f50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:16:16.496 INFO:tasks.ceph.mds.d.smithi190.stderr: -2982> 2024-05-10T11:15:42.103+0000 7f94ca333640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5198=0-4194304@1} caps={5198=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5198 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x557868f50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:16:16.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:16:16.526 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:16:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.605+0000 7f1c0c62a640 1 Processor -- start 2024-05-10T11:16:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.605+0000 7f1c0c62a640 1 -- start start 2024-05-10T11:16:16.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.606+0000 7f1c0c62a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c04162ce0 0x7f1c040b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.606+0000 7f1c0c62a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c040b4e20 0x7f1c040d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.606+0000 7f1c0c62a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c040d4190 con 0x7f1c04162900 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.606+0000 7f1c0c62a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1c040cfc40 con 0x7f1c04162ce0 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.606+0000 7f1c0c62a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1c040d3eb0 con 0x7f1c040b4e20 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c04162ce0 0x7f1c040b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c04162ce0 0x7f1c040b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:55384/0 (socket says 172.21.15.66:55384) 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 -- 172.21.15.66:0/2849018759 learned_addr learned my addr 172.21.15.66:0/2849018759 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c0abc7640 1 --2- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c040b4e20 0x7f1c040d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 -- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c040b4e20 msgr2=0x7f1c040d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 --2- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c040b4e20 0x7f1c040d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 -- 172.21.15.66:0/2849018759 >> v1:172.21.15.190:6789/0 conn(0x7f1c04162900 legacy=0x7f1c040d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c09bc5640 1 -- 172.21.15.66:0/2849018759 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c040cfee0 con 0x7f1c04162ce0 2024-05-10T11:16:16.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.607+0000 7f1c093c4640 1 -- 172.21.15.66:0/2849018759 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463219709 0 0) 0x7f1c00001110 con 0x7f1c04162900 2024-05-10T11:16:16.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.608+0000 7f1c09bc5640 1 --2- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c040b48e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009870 tx=0x7f1bf802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77f110878725e0f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.608+0000 7f1c093c4640 1 -- 172.21.15.66:0/2849018759 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8037070 con 0x7f1c04162ce0 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.608+0000 7f1c093c4640 1 -- 172.21.15.66:0/2849018759 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf8032440 con 0x7f1c04162ce0 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.608+0000 7f1c093c4640 1 -- 172.21.15.66:0/2849018759 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8032810 con 0x7f1c04162ce0 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 -- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 msgr2=0x7f1c040b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c040b48e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009870 tx=0x7f1bf802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 -- 172.21.15.66:0/2849018759 shutdown_connections 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c040b4e20 0x7f1c040d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/2849018759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c040b48e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 -- 172.21.15.66:0/2849018759 >> 172.21.15.66:0/2849018759 conn(0x7f1c0409e430 msgr2=0x7f1c040d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 -- 172.21.15.66:0/2849018759 shutdown_connections 2024-05-10T11:16:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.609+0000 7f1c0c62a640 1 -- 172.21.15.66:0/2849018759 wait complete. 2024-05-10T11:16:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.610+0000 7f1c0c62a640 1 Processor -- start 2024-05-10T11:16:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.610+0000 7f1c0c62a640 1 -- start start 2024-05-10T11:16:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0c62a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 0x7f1c041633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0c62a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c04162900 0x7f1c04154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0c62a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c04154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0c62a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1c040b4180 con 0x7f1c040b4e20 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0c62a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1c040d3b20 con 0x7f1c04162ce0 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0c62a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1c040b4300 con 0x7f1c04162900 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 0x7f1c041633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 0x7f1c041633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47040/0 (socket says 172.21.15.66:47040) 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 -- 172.21.15.66:0/47738946 learned_addr learned my addr 172.21.15.66:0/47738946 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c09bc5640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c04162900 0x7f1c04154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0abc7640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c04154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 -- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c04162900 msgr2=0x7f1c04154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c04162900 0x7f1c04154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 -- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 msgr2=0x7f1c04154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c04154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 -- 172.21.15.66:0/47738946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c040cc330 con 0x7f1c040b4e20 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1c0a3c6640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 0x7f1c041633d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c750 tx=0x7f1c0000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.611+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00017070 con 0x7f1c040b4e20 2024-05-10T11:16:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.612+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000052b0 con 0x7f1c040b4e20 2024-05-10T11:16:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.612+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c040cc5f0 con 0x7f1c040b4e20 2024-05-10T11:16:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.612+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000a880 con 0x7f1c040b4e20 2024-05-10T11:16:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.612+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c040cd0d0 con 0x7f1c040b4e20 2024-05-10T11:16:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.612+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0406a220 con 0x7f1c040b4e20 2024-05-10T11:16:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.613+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c0001a070 con 0x7f1c040b4e20 2024-05-10T11:16:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.614+0000 7f1bf6ffd640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1be80762d0 0x7f1be8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.614+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6332+0+0 (secure 0 0 0) 0x7f1c00096ad0 con 0x7f1c040b4e20 2024-05-10T11:16:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.614+0000 7f1c09bc5640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1be80762d0 0x7f1be8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.614+0000 7f1c09bc5640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1be80762d0 0x7f1be8078790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8034000 tx=0x7f1bf802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.618+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1c040d4190 con 0x7f1c040b4e20 2024-05-10T11:16:16.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:16.847+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1c0409e840 con 0x7f1c040b4e20 2024-05-10T11:16:17.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.486+0000 7f1bf6ffd640 1 -- 172.21.15.66:0/47738946 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f1c00096020 con 0x7f1c040b4e20 2024-05-10T11:16:17.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.489+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1be80762d0 msgr2=0x7f1be8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:17.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.489+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1be80762d0 0x7f1be8078790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8034000 tx=0x7f1bf802e000 comp rx=0 tx=0).stop 2024-05-10T11:16:17.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.489+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 msgr2=0x7f1c041633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:17.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.489+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 0x7f1c041633d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c750 tx=0x7f1c0000cc10 comp rx=0 tx=0).stop 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 shutdown_connections 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1be80762d0 0x7f1be8078790 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c04162ce0 0x7f1c04154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c04162900 0x7f1c04154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 --2- 172.21.15.66:0/47738946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c040b4e20 0x7f1c041633d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 >> 172.21.15.66:0/47738946 conn(0x7f1c0409e430 msgr2=0x7f1c040b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 shutdown_connections 2024-05-10T11:16:17.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.490+0000 7f1c0c62a640 1 -- 172.21.15.66:0/47738946 wait complete. 2024-05-10T11:16:17.504 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:16:17.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.618+0000 7fc458551640 1 Processor -- start 2024-05-10T11:16:17.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.618+0000 7fc458551640 1 -- start start 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc458551640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc4500d3c50 0x7fc4500d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc458551640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4500d5b20 con 0x7fc4500d5710 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc458551640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4500b26c0 con 0x7fc45015f430 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc458551640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc45015f810 con 0x7fc4500d3c50 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc455aec640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc4500d3c50 0x7fc4500d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc456aee640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc4500d5710 0x7fc4500b3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55156/0 (socket says 172.21.15.66:55156) 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc456aee640 1 -- 172.21.15.66:0/106702705 learned_addr learned my addr 172.21.15.66:0/106702705 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc455aec640 1 -- 172.21.15.66:0/106702705 >> v1:172.21.15.190:6789/0 conn(0x7fc45015f430 legacy=0x7fc4500b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc455aec640 1 -- 172.21.15.66:0/106702705 >> v1:172.21.15.66:6789/0 conn(0x7fc4500d5710 legacy=0x7fc4500b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc4552eb640 1 -- 172.21.15.66:0/106702705 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921434220 0 0) 0x7fc448001490 con 0x7fc4500d5710 2024-05-10T11:16:17.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.619+0000 7fc455aec640 1 -- 172.21.15.66:0/106702705 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4500b29a0 con 0x7fc4500d3c50 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.620+0000 7fc455aec640 1 --2- 172.21.15.66:0/106702705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4500d3c50 0x7fc4500d51d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc4400097a0 tx=0x7fc44002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7866aca8d80a2799 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.620+0000 7fc4552eb640 1 -- 172.21.15.66:0/106702705 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440037070 con 0x7fc4500d3c50 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.620+0000 7fc4552eb640 1 -- 172.21.15.66:0/106702705 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc440032440 con 0x7fc4500d3c50 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.620+0000 7fc4552eb640 1 -- 172.21.15.66:0/106702705 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440032810 con 0x7fc4500d3c50 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 -- 172.21.15.66:0/106702705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4500d3c50 msgr2=0x7fc4500d51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 --2- 172.21.15.66:0/106702705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4500d3c50 0x7fc4500d51d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc4400097a0 tx=0x7fc44002a1e0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 -- 172.21.15.66:0/106702705 shutdown_connections 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 --2- 172.21.15.66:0/106702705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4500d3c50 0x7fc4500d51d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 -- 172.21.15.66:0/106702705 >> 172.21.15.66:0/106702705 conn(0x7fc45008ec60 msgr2=0x7fc45009e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 -- 172.21.15.66:0/106702705 shutdown_connections 2024-05-10T11:16:17.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.621+0000 7fc458551640 1 -- 172.21.15.66:0/106702705 wait complete. 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.622+0000 7fc458551640 1 Processor -- start 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.622+0000 7fc458551640 1 -- start start 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc458551640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4500d3c50 0x7fc45014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc458551640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4500d5710 0x7fc45014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc458551640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 0x7fc4500b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc458551640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4500b3e70 con 0x7fc45015f430 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc458551640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4500b2f60 con 0x7fc4500d5710 2024-05-10T11:16:17.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc458551640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc4500b3ff0 con 0x7fc4500d3c50 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 0x7fc4500b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 0x7fc4500b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47056/0 (socket says 172.21.15.66:47056) 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 -- 172.21.15.66:0/2174498938 learned_addr learned my addr 172.21.15.66:0/2174498938 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc455aec640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4500d5710 0x7fc45014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc4562ed640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4500d3c50 0x7fc45014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 -- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4500d3c50 msgr2=0x7fc45014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4500d3c50 0x7fc45014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 -- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4500d5710 msgr2=0x7fc45014cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4500d5710 0x7fc45014cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc456aee640 1 -- 172.21.15.66:0/2174498938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45014ca60 con 0x7fc45015f430 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc455aec640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4500d5710 0x7fc45014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.623+0000 7fc4562ed640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4500d3c50 0x7fc45014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:17.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.624+0000 7fc456aee640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 0x7fc4500b7f10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c7f0 tx=0x7fc44800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:17.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.624+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448018070 con 0x7fc45015f430 2024-05-10T11:16:17.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.624+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44800a5e0 con 0x7fc45015f430 2024-05-10T11:16:17.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.624+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44800aa10 con 0x7fc45015f430 2024-05-10T11:16:17.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.624+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4500c9ac0 con 0x7fc45015f430 2024-05-10T11:16:17.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.624+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4500ca080 con 0x7fc45015f430 2024-05-10T11:16:17.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.625+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45006a220 con 0x7fc45015f430 2024-05-10T11:16:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.625+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc44801b070 con 0x7fc45015f430 2024-05-10T11:16:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.626+0000 7fc446ffd640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4340762d0 0x7fc434078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.626+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6332+0+0 (secure 0 0 0) 0x7fc448096dc0 con 0x7fc45015f430 2024-05-10T11:16:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.626+0000 7fc4562ed640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4340762d0 0x7fc434078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.627+0000 7fc4562ed640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4340762d0 0x7fc434078790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc44c006fd0 tx=0x7fc44c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.630+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc4500d5b20 con 0x7fc45015f430 2024-05-10T11:16:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:17.825+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc450075d70 con 0x7fc45015f430 2024-05-10T11:16:18.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.491+0000 7fc446ffd640 1 -- 172.21.15.66:0/2174498938 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7fc4480604b0 con 0x7fc45015f430 2024-05-10T11:16:18.492 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.494+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4340762d0 msgr2=0x7fc434078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.494+0000 7fc458551640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4340762d0 0x7fc434078790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc44c006fd0 tx=0x7fc44c008040 comp rx=0 tx=0).stop 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.494+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 msgr2=0x7fc4500b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.494+0000 7fc458551640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 0x7fc4500b7f10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c7f0 tx=0x7fc44800ccb0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 shutdown_connections 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc4340762d0 0x7fc434078790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45015f430 0x7fc4500b7f10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4500d5710 0x7fc45014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 --2- 172.21.15.66:0/2174498938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4500d3c50 0x7fc45014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 >> 172.21.15.66:0/2174498938 conn(0x7fc45008ec60 msgr2=0x7fc45006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:18.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 shutdown_connections 2024-05-10T11:16:18.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.495+0000 7fc458551640 1 -- 172.21.15.66:0/2174498938 wait complete. 2024-05-10T11:16:18.508 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:16:18.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.616+0000 7f07776bd640 1 Processor -- start 2024-05-10T11:16:18.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.617+0000 7f07776bd640 1 -- start start 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.617+0000 7f07776bd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f077015d010 0x7f07700cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f07776bd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07700add50 con 0x7f07700d04e0 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f07776bd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07700ae030 con 0x7f07700d1540 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f07776bd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f07700b5af0 con 0x7f077015d010 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0775459640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f077015d010 0x7f07700cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0774c58640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f07700d04e0 0x7f07700d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55158/0 (socket says 172.21.15.66:55158) 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0774c58640 1 -- 172.21.15.66:0/4269048468 learned_addr learned my addr 172.21.15.66:0/4269048468 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0775459640 1 -- 172.21.15.66:0/4269048468 >> v1:172.21.15.190:6789/0 conn(0x7f07700d1540 legacy=0x7f07700b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0775459640 1 -- 172.21.15.66:0/4269048468 >> v1:172.21.15.66:6789/0 conn(0x7f07700d04e0 legacy=0x7f07700d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0767fff640 1 -- 172.21.15.66:0/4269048468 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700799975 0 0) 0x7f07700add50 con 0x7f07700d04e0 2024-05-10T11:16:18.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.618+0000 7f0775459640 1 -- 172.21.15.66:0/4269048468 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07700b5dd0 con 0x7f077015d010 2024-05-10T11:16:18.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.619+0000 7f0775459640 1 --2- 172.21.15.66:0/4269048468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077015d010 0x7f07700cfe90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2570ebe99e397a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:18.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.619+0000 7f0767fff640 1 -- 172.21.15.66:0/4269048468 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c037070 con 0x7f077015d010 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.619+0000 7f0767fff640 1 -- 172.21.15.66:0/4269048468 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c032440 con 0x7f077015d010 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.619+0000 7f0767fff640 1 -- 172.21.15.66:0/4269048468 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c032810 con 0x7f077015d010 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.619+0000 7f07776bd640 1 -- 172.21.15.66:0/4269048468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077015d010 msgr2=0x7f07700cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.619+0000 7f07776bd640 1 --2- 172.21.15.66:0/4269048468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077015d010 0x7f07700cfe90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.620+0000 7f07776bd640 1 -- 172.21.15.66:0/4269048468 shutdown_connections 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.620+0000 7f07776bd640 1 --2- 172.21.15.66:0/4269048468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077015d010 0x7f07700cfe90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.620+0000 7f07776bd640 1 -- 172.21.15.66:0/4269048468 >> 172.21.15.66:0/4269048468 conn(0x7f077006c4a0 msgr2=0x7f077006c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.620+0000 7f07776bd640 1 -- 172.21.15.66:0/4269048468 shutdown_connections 2024-05-10T11:16:18.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.620+0000 7f07776bd640 1 -- 172.21.15.66:0/4269048468 wait complete. 2024-05-10T11:16:18.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.621+0000 7f07776bd640 1 Processor -- start 2024-05-10T11:16:18.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.621+0000 7f07776bd640 1 -- start start 2024-05-10T11:16:18.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 0x7f077013e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:18.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07700d1540 0x7f07701f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:18.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f077015d010 0x7f077009ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:18.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07700b4490 con 0x7f07700d04e0 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f07700b4310 con 0x7f07700d1540 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f07700b4610 con 0x7f077015d010 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 0x7f077013e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 0x7f077013e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47086/0 (socket says 172.21.15.66:47086) 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 -- 172.21.15.66:0/2280819040 learned_addr learned my addr 172.21.15.66:0/2280819040 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 -- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f077015d010 msgr2=0x7f077009ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f077015d010 0x7f077009ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 -- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07700d1540 msgr2=0x7f07701f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07700d1540 0x7f07701f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 -- 172.21.15.66:0/2280819040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077009cfb0 con 0x7f07700d04e0 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0775459640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 0x7f077013e4d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c041070 con 0x7f07700d04e0 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c03c870 con 0x7f07700d04e0 2024-05-10T11:16:18.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0770150af0 con 0x7f07700d04e0 2024-05-10T11:16:18.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.622+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c037040 con 0x7f07700d04e0 2024-05-10T11:16:18.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.623+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07701f3440 con 0x7f07700d04e0 2024-05-10T11:16:18.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.624+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077006a220 con 0x7f07700d04e0 2024-05-10T11:16:18.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.624+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f076c044070 con 0x7f07700d04e0 2024-05-10T11:16:18.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.625+0000 7f0765ffb640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f07540762d0 0x7f0754078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:18.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.625+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5865+0+0 (secure 0 0 0) 0x7f076c0b8220 con 0x7f07700d04e0 2024-05-10T11:16:18.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.625+0000 7f0774c58640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f07540762d0 0x7f0754078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:18.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.626+0000 7f0774c58640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f07540762d0 0x7f0754078790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0760005880 tx=0x7f0760007950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:18.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.629+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0770150af0 con 0x7f07700d04e0 2024-05-10T11:16:18.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:18.823+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f07700b5760 con 0x7f07700d04e0 2024-05-10T11:16:19.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.493+0000 7f0765ffb640 1 -- 172.21.15.66:0/2280819040 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7f076c081ae0 con 0x7f07700d04e0 2024-05-10T11:16:19.494 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:16:19.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.497+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f07540762d0 msgr2=0x7f0754078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.497+0000 7f07776bd640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f07540762d0 0x7f0754078790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0760005880 tx=0x7f0760007950 comp rx=0 tx=0).stop 2024-05-10T11:16:19.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.497+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 msgr2=0x7f077013e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.497+0000 7f07776bd640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 0x7f077013e4d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.497+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 shutdown_connections 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f07540762d0 0x7f0754078790 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f077015d010 0x7f077009ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07700d1540 0x7f07701f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 --2- 172.21.15.66:0/2280819040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07700d04e0 0x7f077013e4d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 >> 172.21.15.66:0/2280819040 conn(0x7f077006c4a0 msgr2=0x7f0770154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 shutdown_connections 2024-05-10T11:16:19.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.498+0000 7f07776bd640 1 -- 172.21.15.66:0/2280819040 wait complete. 2024-05-10T11:16:19.516 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:16:19.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 Processor -- start 2024-05-10T11:16:19.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 -- start start 2024-05-10T11:16:19.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef3415f400 0x7fef3406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef3406e290 0x7fef340d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef340d1ed0 con 0x7fef340d1620 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fef3406e6f0 con 0x7fef3406e290 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.628+0000 7fef3a407640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fef340d21b0 con 0x7fef3415f400 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef3406e290 0x7fef340d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef3406e290 0x7fef340d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47100/0 (socket says 172.21.15.66:47100) 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 -- 172.21.15.66:0/4278424913 learned_addr learned my addr 172.21.15.66:0/4278424913 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 -- 172.21.15.66:0/4278424913 >> v2:172.21.15.190:3300/0 conn(0x7fef3415f400 msgr2=0x7fef3406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:19.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 --2- 172.21.15.66:0/4278424913 >> v2:172.21.15.190:3300/0 conn(0x7fef3415f400 0x7fef3406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 -- 172.21.15.66:0/4278424913 >> v1:172.21.15.190:6789/0 conn(0x7fef340d1620 legacy=0x7fef340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.629+0000 7fef2bfff640 1 -- 172.21.15.66:0/4278424913 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef340d2490 con 0x7fef3406e290 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef2bfff640 1 --2- 172.21.15.66:0/4278424913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3406e290 0x7fef340d10e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fef34074680 tx=0x7fef1c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadc64728b1f1195 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef337fe640 1 -- 172.21.15.66:0/4278424913 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c037070 con 0x7fef3406e290 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef337fe640 1 -- 172.21.15.66:0/4278424913 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c032440 con 0x7fef3406e290 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef337fe640 1 -- 172.21.15.66:0/4278424913 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c032810 con 0x7fef3406e290 2024-05-10T11:16:19.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 -- 172.21.15.66:0/4278424913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3406e290 msgr2=0x7fef340d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 --2- 172.21.15.66:0/4278424913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3406e290 0x7fef340d10e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fef34074680 tx=0x7fef1c02a230 comp rx=0 tx=0).stop 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 -- 172.21.15.66:0/4278424913 shutdown_connections 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 --2- 172.21.15.66:0/4278424913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3406e290 0x7fef340d10e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 --2- 172.21.15.66:0/4278424913 >> v2:172.21.15.190:3300/0 conn(0x7fef3415f400 0x7fef3406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 -- 172.21.15.66:0/4278424913 >> 172.21.15.66:0/4278424913 conn(0x7fef3409ba20 msgr2=0x7fef3409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.630+0000 7fef3a407640 1 -- 172.21.15.66:0/4278424913 shutdown_connections 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.631+0000 7fef3a407640 1 -- 172.21.15.66:0/4278424913 wait complete. 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 Processor -- start 2024-05-10T11:16:19.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 -- start start 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3406e290 0x7fef340c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef340d1620 0x7fef341f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 0x7fef341f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef3415f7e0 con 0x7fef3415f400 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef340d1a70 con 0x7fef340d1620 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.632+0000 7fef3a407640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef340c8910 con 0x7fef3406e290 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 0x7fef341f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 0x7fef341f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47106/0 (socket says 172.21.15.66:47106) 2024-05-10T11:16:19.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 -- 172.21.15.66:0/1825650256 learned_addr learned my addr 172.21.15.66:0/1825650256 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef2bfff640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef340d1620 0x7fef341f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef33fff640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3406e290 0x7fef340c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 -- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3406e290 msgr2=0x7fef340c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3406e290 0x7fef340c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 -- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef340d1620 msgr2=0x7fef341f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef340d1620 0x7fef341f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 -- 172.21.15.66:0/1825650256 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef340c7330 con 0x7fef3415f400 2024-05-10T11:16:19.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef389a4640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 0x7fef341f6330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c780 tx=0x7fef2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c017070 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c003da0 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0052b0 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef340c7610 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.633+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef340c7eb0 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.634+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef340693f0 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.635+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef2c005450 con 0x7fef3415f400 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.635+0000 7fef317fa640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef140762d0 0x7fef14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.636+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fef2c096ac0 con 0x7fef3415f400 2024-05-10T11:16:19.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.636+0000 7fef33fff640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef140762d0 0x7fef14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.636+0000 7fef33fff640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef140762d0 0x7fef14078790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fef24006fd0 tx=0x7fef24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:19.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.640+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fef2c060470 con 0x7fef3415f400 2024-05-10T11:16:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.833+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fef341f5da0 con 0x7fef3415f400 2024-05-10T11:16:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.837+0000 7fef317fa640 1 -- 172.21.15.66:0/1825650256 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fef2c05fd70 con 0x7fef3415f400 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef140762d0 msgr2=0x7fef14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef140762d0 0x7fef14078790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fef24006fd0 tx=0x7fef24008040 comp rx=0 tx=0).stop 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 msgr2=0x7fef341f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 0x7fef341f6330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c780 tx=0x7fef2c00cc40 comp rx=0 tx=0).stop 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 shutdown_connections 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef140762d0 0x7fef14078790 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3415f400 0x7fef341f6330 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef340d1620 0x7fef341f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 --2- 172.21.15.66:0/1825650256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3406e290 0x7fef340c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 >> 172.21.15.66:0/1825650256 conn(0x7fef3409ba20 msgr2=0x7fef340afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 shutdown_connections 2024-05-10T11:16:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.839+0000 7fef3a407640 1 -- 172.21.15.66:0/1825650256 wait complete. 2024-05-10T11:16:19.854 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.958+0000 7f3736f40640 1 Processor -- start 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.958+0000 7f3736f40640 1 -- start start 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f3736f40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 0x7f3730071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f3736f40640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3730071880 0x7f37300d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f3736f40640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3730072330 con 0x7f37300d1aa0 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f3736f40640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3730071d70 con 0x7f3730071880 2024-05-10T11:16:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f3736f40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3730072050 con 0x7f373015d290 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f37354dd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f37300d1aa0 0x7f37300cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55168/0 (socket says 172.21.15.66:55168) 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.959+0000 7f37354dd640 1 -- 172.21.15.66:0/1727000428 learned_addr learned my addr 172.21.15.66:0/1727000428 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 0x7f3730071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372ffff640 1 --2- 172.21.15.66:0/1727000428 >> v2:172.21.15.190:3300/0 conn(0x7f3730071880 0x7f37300d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9983106 0 0) 0x7f3730072330 con 0x7f37300d1aa0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f371c003520 con 0x7f37300d1aa0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2868841877 0 0) 0x7f371c003520 con 0x7f37300d1aa0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 msgr2=0x7f3730071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 0x7f3730071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 >> v2:172.21.15.190:3300/0 conn(0x7f3730071880 msgr2=0x7f37300d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 --2- 172.21.15.66:0/1727000428 >> v2:172.21.15.190:3300/0 conn(0x7f3730071880 0x7f37300d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37300cda70 con 0x7f37300d1aa0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f3718001670 con 0x7f37300d1aa0 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 >> v1:172.21.15.66:6789/0 conn(0x7f37300d1aa0 legacy=0x7f37300cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f371c0039b0 0x7f371c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c004800 0x7f371c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 0x7f371c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3730071d70 con 0x7f371c0039b0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3730072050 con 0x7f371c004800 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f371c00b9c0 con 0x7f373015d290 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f371c0039b0 0x7f371c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f372ffff640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c004800 0x7f371c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.960+0000 7f37354dd640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 0x7f371c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f3734cdc640 1 -- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 msgr2=0x7f371c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373015d290 0x7f371c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f3734cdc640 1 -- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c004800 msgr2=0x7f371c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c004800 0x7f371c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f3734cdc640 1 -- 172.21.15.66:0/1727000428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c003520 con 0x7f371c0039b0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f371c0039b0 0x7f371c003dd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ac0 tx=0x7f371c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c768dc85cd2b6c1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728036070 con 0x7f371c0039b0 2024-05-10T11:16:19.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728031400 con 0x7f371c0039b0 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.961+0000 7f372f7fe640 1 -- 172.21.15.66:0/1727000428 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728009690 con 0x7f371c0039b0 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f3736f40640 1 -- 172.21.15.66:0/1727000428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f371c0039b0 msgr2=0x7f371c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f3736f40640 1 --2- 172.21.15.66:0/1727000428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f371c0039b0 0x7f371c003dd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ac0 tx=0x7f371c005830 comp rx=0 tx=0).stop 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f37354dd640 1 -- 172.21.15.66:0/1727000428 reap_dead start 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f3736f40640 1 -- 172.21.15.66:0/1727000428 shutdown_connections 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f3736f40640 1 -- 172.21.15.66:0/1727000428 >> 172.21.15.66:0/1727000428 conn(0x7f373009ba20 msgr2=0x7f373009be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f3736f40640 1 -- 172.21.15.66:0/1727000428 shutdown_connections 2024-05-10T11:16:19.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.962+0000 7f3736f40640 1 -- 172.21.15.66:0/1727000428 wait complete. 2024-05-10T11:16:19.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.963+0000 7f3736f40640 1 Processor -- start 2024-05-10T11:16:19.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.963+0000 7f3736f40640 1 -- start start 2024-05-10T11:16:19.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3736f40640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c0039b0 0x7f373014a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3736f40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37301f6a80 0x7f373014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3736f40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 0x7f373015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3736f40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37300cf400 con 0x7f37300b1650 2024-05-10T11:16:19.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3736f40640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f37300cf280 con 0x7f371c0039b0 2024-05-10T11:16:19.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3736f40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f37300cf580 con 0x7f37301f6a80 2024-05-10T11:16:19.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f37354dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 0x7f373015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f37354dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 0x7f373015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47122/0 (socket says 172.21.15.66:47122) 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f37354dd640 1 -- 172.21.15.66:0/1112915665 learned_addr learned my addr 172.21.15.66:0/1112915665 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c0039b0 0x7f373014a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.964+0000 7f372ffff640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37301f6a80 0x7f373014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f37354dd640 1 -- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37301f6a80 msgr2=0x7f373014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f37354dd640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37301f6a80 0x7f373014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f37354dd640 1 -- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c0039b0 msgr2=0x7f373014a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f37354dd640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c0039b0 0x7f373014a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f37354dd640 1 -- 172.21.15.66:0/1112915665 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37300b7870 con 0x7f37300b1650 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f37354dd640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 0x7f373015f710 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3718001eb0 tx=0x7f3718007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371801a070 con 0x7f37300b1650 2024-05-10T11:16:19.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371800f910 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371800fd00 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373014a760 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.965+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37300b5b50 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.966+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37300693f0 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.967+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f371801d070 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.967+0000 7f372d7fa640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f37100762d0 0x7f3710078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.967+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f3718096bb0 con 0x7f37300b1650 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.968+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f37100762d0 0x7f3710078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.968+0000 7f3734cdc640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f37100762d0 0x7f3710078790 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3728033000 tx=0x7f3728008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:19.972+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f37180600c0 con 0x7f37300b1650 2024-05-10T11:16:20.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.242+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f373015c5e0 con 0x7f37300b1650 2024-05-10T11:16:20.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.497+0000 7f372d7fa640 1 -- 172.21.15.66:0/1112915665 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v199) ==== 169+0+0 (secure 0 0 0) 0x7f371809a070 con 0x7f37300b1650 2024-05-10T11:16:20.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f37100762d0 msgr2=0x7f3710078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f37100762d0 0x7f3710078790 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3728033000 tx=0x7f3728008030 comp rx=0 tx=0).stop 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 msgr2=0x7f373015f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 0x7f373015f710 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3718001eb0 tx=0x7f3718007720 comp rx=0 tx=0).stop 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 shutdown_connections 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f37100762d0 0x7f3710078790 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37300b1650 0x7f373015f710 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37301f6a80 0x7f373014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 --2- 172.21.15.66:0/1112915665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f371c0039b0 0x7f373014a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 >> 172.21.15.66:0/1112915665 conn(0x7f373009ba20 msgr2=0x7f37300b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 shutdown_connections 2024-05-10T11:16:20.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.500+0000 7f3736f40640 1 -- 172.21.15.66:0/1112915665 wait complete. 2024-05-10T11:16:20.511 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-05-10T11:16:20.512 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-05-10T11:16:20.512 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:16:20.512 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:16:20.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.616+0000 7f9b88919640 1 Processor -- start 2024-05-10T11:16:20.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.616+0000 7f9b88919640 1 -- start start 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b88919640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b840b8860 0x7f9b8406e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b88919640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b8415fc90 con 0x7f9b840cfd80 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b88919640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b840b8c40 con 0x7f9b840d0230 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b88919640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9b8406ee50 con 0x7f9b840b8860 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b8259c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b840b8860 0x7f9b8406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b82d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9b840cfd80 0x7f9b840ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55176/0 (socket says 172.21.15.66:55176) 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b82d9d640 1 -- 172.21.15.66:0/915099017 learned_addr learned my addr 172.21.15.66:0/915099017 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b8259c640 1 -- 172.21.15.66:0/915099017 >> v1:172.21.15.190:6789/0 conn(0x7f9b840d0230 legacy=0x7f9b840cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b8259c640 1 -- 172.21.15.66:0/915099017 >> v1:172.21.15.66:6789/0 conn(0x7f9b840cfd80 legacy=0x7f9b840ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b8259c640 1 -- 172.21.15.66:0/915099017 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b840cd570 con 0x7f9b840b8860 2024-05-10T11:16:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.617+0000 7f9b8159a640 1 -- 172.21.15.66:0/915099017 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256619419 0 0) 0x7f9b8415fc90 con 0x7f9b840cfd80 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.618+0000 7f9b8259c640 1 --2- 172.21.15.66:0/915099017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840b8860 0x7f9b8406e520 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009d90 tx=0x7f9b7402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e078a1b19da04a32 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.618+0000 7f9b8159a640 1 -- 172.21.15.66:0/915099017 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74031600 con 0x7f9b840b8860 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.618+0000 7f9b8159a640 1 -- 172.21.15.66:0/915099017 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b740317a0 con 0x7f9b840b8860 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.618+0000 7f9b8159a640 1 -- 172.21.15.66:0/915099017 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74031b70 con 0x7f9b840b8860 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 -- 172.21.15.66:0/915099017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840b8860 msgr2=0x7f9b8406e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 --2- 172.21.15.66:0/915099017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840b8860 0x7f9b8406e520 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009d90 tx=0x7f9b7402a610 comp rx=0 tx=0).stop 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 -- 172.21.15.66:0/915099017 shutdown_connections 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 --2- 172.21.15.66:0/915099017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840b8860 0x7f9b8406e520 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 -- 172.21.15.66:0/915099017 >> 172.21.15.66:0/915099017 conn(0x7f9b840d2df0 msgr2=0x7f9b840d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 -- 172.21.15.66:0/915099017 shutdown_connections 2024-05-10T11:16:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.619+0000 7f9b88919640 1 -- 172.21.15.66:0/915099017 wait complete. 2024-05-10T11:16:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.620+0000 7f9b88919640 1 Processor -- start 2024-05-10T11:16:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.620+0000 7f9b88919640 1 -- start start 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b88919640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b840b8860 0x7f9b84153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b88919640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 0x7f9b840c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b88919640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b840d0230 0x7f9b84070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b88919640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840cde10 con 0x7f9b840cfd80 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b88919640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840cdb30 con 0x7f9b840b8860 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b88919640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8406ea60 con 0x7f9b840d0230 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b81d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 0x7f9b840c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b81d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 0x7f9b840c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47138/0 (socket says 172.21.15.66:47138) 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b81d9b640 1 -- 172.21.15.66:0/2252878395 learned_addr learned my addr 172.21.15.66:0/2252878395 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b82d9d640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b840d0230 0x7f9b84070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.621+0000 7f9b8259c640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b840b8860 0x7f9b84153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b81d9b640 1 -- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b840d0230 msgr2=0x7f9b84070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b81d9b640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b840d0230 0x7f9b84070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b81d9b640 1 -- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b840b8860 msgr2=0x7f9b84153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b81d9b640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b840b8860 0x7f9b84153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b81d9b640 1 -- 172.21.15.66:0/2252878395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b84153db0 con 0x7f9b840cfd80 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b81d9b640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 0x7f9b840c72e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00b3f0 tx=0x7f9b6c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c015020 con 0x7f9b840cfd80 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6c011830 con 0x7f9b840cfd80 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841f85d0 con 0x7f9b840cfd80 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011c20 con 0x7f9b840cfd80 2024-05-10T11:16:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.622+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841f8b90 con 0x7f9b840cfd80 2024-05-10T11:16:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.623+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8406a220 con 0x7f9b840cfd80 2024-05-10T11:16:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.624+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b6c018020 con 0x7f9b840cfd80 2024-05-10T11:16:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.624+0000 7f9b7affd640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b640762d0 0x7f9b64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.624+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f9b6c096f90 con 0x7f9b840cfd80 2024-05-10T11:16:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.625+0000 7f9b8259c640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b640762d0 0x7f9b64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.625+0000 7f9b8259c640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b640762d0 0x7f9b64078790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9b74034000 tx=0x7f9b7402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.628+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9b6c01f030 con 0x7f9b840cfd80 2024-05-10T11:16:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.819+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b840cf880 con 0x7f9b840cfd80 2024-05-10T11:16:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.820+0000 7f9b7affd640 1 -- 172.21.15.66:0/2252878395 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13296 (secure 0 0 0) 0x7f9b6c060410 con 0x7f9b840cfd80 2024-05-10T11:16:20.821 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:20.821 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":67,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:16:19.492819+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.190:6837/2375668947":"2024-05-11T11:16:16.485055+0000","172.21.15.190:6835/2375668947":"2024-05-11T11:16:16.485055+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b640762d0 msgr2=0x7f9b64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b640762d0 0x7f9b64078790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9b74034000 tx=0x7f9b7402f000 comp rx=0 tx=0).stop 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 msgr2=0x7f9b840c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 0x7f9b840c72e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00b3f0 tx=0x7f9b6c00b8b0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 shutdown_connections 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b640762d0 0x7f9b64078790 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b840d0230 0x7f9b84070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b840cfd80 0x7f9b840c72e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 --2- 172.21.15.66:0/2252878395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b840b8860 0x7f9b84153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 >> 172.21.15.66:0/2252878395 conn(0x7f9b840d2df0 msgr2=0x7f9b840d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:20.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 shutdown_connections 2024-05-10T11:16:20.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.822+0000 7f9b88919640 1 -- 172.21.15.66:0/2252878395 wait complete. 2024-05-10T11:16:20.835 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:16:20.835 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:16:20.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.941+0000 7fbbc8ae8640 1 Processor -- start 2024-05-10T11:16:20.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.941+0000 7fbbc8ae8640 1 -- start start 2024-05-10T11:16:20.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc8ae8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40cfdd0 0x7fbbc40d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc8ae8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc415f790 con 0x7fbbc415f3b0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc8ae8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc40ce550 con 0x7fbbc40d0cc0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc8ae8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc40cf160 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc259c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbbc415f3b0 0x7fbbc4163930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55190/0 (socket says 172.21.15.66:55190) 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc259c640 1 -- 172.21.15.66:0/1841812323 learned_addr learned my addr 172.21.15.66:0/1841812323 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbb9d9b640 1 --2- 172.21.15.66:0/1841812323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40cfdd0 0x7fbbc40d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446129431 0 0) 0x7fbbc415f790 con 0x7fbbc415f3b0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb0003520 con 0x7fbbc415f3b0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349064075 0 0) 0x7fbbc40ce550 con 0x7fbbc40d0cc0 2024-05-10T11:16:20.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc415f790 con 0x7fbbc40d0cc0 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbb9d9b640 1 -- 172.21.15.66:0/1841812323 >> v1:172.21.15.190:6789/0 conn(0x7fbbc40d0cc0 legacy=0x7fbbc406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbb9d9b640 1 -- 172.21.15.66:0/1841812323 >> v1:172.21.15.66:6789/0 conn(0x7fbbc415f3b0 legacy=0x7fbbc4163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.942+0000 7fbbb9d9b640 1 -- 172.21.15.66:0/1841812323 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc40ce830 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.943+0000 7fbbb9d9b640 1 --2- 172.21.15.66:0/1841812323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40cfdd0 0x7fbbc40d0780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0097d0 tx=0x7fbbac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad116347ecf0ee6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.943+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac037070 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.943+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac032440 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.943+0000 7fbbc1d9b640 1 -- 172.21.15.66:0/1841812323 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0327f0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/1841812323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40cfdd0 msgr2=0x7fbbc40d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/1841812323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40cfdd0 0x7fbbc40d0780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0097d0 tx=0x7fbbac02a180 comp rx=0 tx=0).stop 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/1841812323 shutdown_connections 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/1841812323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40cfdd0 0x7fbbc40d0780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/1841812323 >> 172.21.15.66:0/1841812323 conn(0x7fbbc40b3c60 msgr2=0x7fbbc40b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/1841812323 shutdown_connections 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.944+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/1841812323 wait complete. 2024-05-10T11:16:20.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 Processor -- start 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 -- start start 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 0x7fbbc41f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40d0cc0 0x7fbbc414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc415f3b0 0x7fbbc4159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc406d540 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40cedf0 con 0x7fbbc415f3b0 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc8ae8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc406d6c0 con 0x7fbbc40d0cc0 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.946+0000 7fbbc259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 0x7fbbc41f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 0x7fbbc41f8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47150/0 (socket says 172.21.15.66:47150) 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 -- 172.21.15.66:0/635569884 learned_addr learned my addr 172.21.15.66:0/635569884 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbb9d9b640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40d0cc0 0x7fbbc414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc2d9d640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc415f3b0 0x7fbbc4159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 -- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40d0cc0 msgr2=0x7fbbc414e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40d0cc0 0x7fbbc414e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 -- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc415f3b0 msgr2=0x7fbbc4159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc415f3b0 0x7fbbc4159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 -- 172.21.15.66:0/635569884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc41f91b0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc259c640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 0x7fbbc41f8c70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400c410 tx=0x7fbbb400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4017070 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb4005ce0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc414eef0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40072d0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.947+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc40c6cf0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.948+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc40c7b20 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.949+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbbb401a070 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.949+0000 7fbbbb7fe640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbba40762d0 0x7fbba4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:20.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.950+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fbbb40966c0 con 0x7fbbc40cfdd0 2024-05-10T11:16:20.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.950+0000 7fbbb9d9b640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbba40762d0 0x7fbba4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:20.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.950+0000 7fbbb9d9b640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbba40762d0 0x7fbba4078790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbbac034000 tx=0x7fbbac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:20.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:20.954+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbbc414eef0 con 0x7fbbc40cfdd0 2024-05-10T11:16:21.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.144+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbbc40d2620 con 0x7fbbc40cfdd0 2024-05-10T11:16:21.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.144+0000 7fbbbb7fe640 1 -- 172.21.15.66:0/635569884 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7fbbc41f91b0 con 0x7fbbc40cfdd0 2024-05-10T11:16:21.145 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbba40762d0 msgr2=0x7fbba4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbba40762d0 0x7fbba4078790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbbac034000 tx=0x7fbbac02e000 comp rx=0 tx=0).stop 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 msgr2=0x7fbbc41f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 0x7fbbc41f8c70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400c410 tx=0x7fbbb400c8d0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 shutdown_connections 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbba40762d0 0x7fbba4078790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc415f3b0 0x7fbbc4159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc40d0cc0 0x7fbbc414e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 --2- 172.21.15.66:0/635569884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc40cfdd0 0x7fbbc41f8c70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 >> 172.21.15.66:0/635569884 conn(0x7fbbc40b3c60 msgr2=0x7fbbc40d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:21.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 shutdown_connections 2024-05-10T11:16:21.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.146+0000 7fbbc8ae8640 1 -- 172.21.15.66:0/635569884 wait complete. 2024-05-10T11:16:21.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-05-10T11:16:21.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.261+0000 7ffa11933640 1 Processor -- start 2024-05-10T11:16:21.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.261+0000 7ffa11933640 1 -- start start 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa11933640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffa0c0d1fb0 0x7ffa0c0b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa11933640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffa0c0b5900 0x7ffa0c0b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa11933640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa0c0d41f0 con 0x7ffa0c0b5520 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa11933640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ffa0c0d5c60 con 0x7ffa0c0d1fb0 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa11933640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ffa0c0d5eb0 con 0x7ffa0c0b5900 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa0affd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ffa0c0b5520 0x7ffa0c0d18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55196/0 (socket says 172.21.15.66:55196) 2024-05-10T11:16:21.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa0a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffa0c0d1fb0 0x7ffa0c0b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.262+0000 7ffa0affd640 1 -- 172.21.15.66:0/3568181037 learned_addr learned my addr 172.21.15.66:0/3568181037 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa0b7fe640 1 --2- 172.21.15.66:0/3568181037 >> v2:172.21.15.190:3300/0 conn(0x7ffa0c0b5900 0x7ffa0c0b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/3568181037 >> v2:172.21.15.190:3300/0 conn(0x7ffa0c0b5900 msgr2=0x7ffa0c0b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa0a7fc640 1 --2- 172.21.15.66:0/3568181037 >> v2:172.21.15.190:3300/0 conn(0x7ffa0c0b5900 0x7ffa0c0b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/3568181037 >> v1:172.21.15.66:6789/0 conn(0x7ffa0c0b5520 legacy=0x7ffa0c0d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa09ffb640 1 -- 172.21.15.66:0/3568181037 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004830125 0 0) 0x7ffa0c0d41f0 con 0x7ffa0c0b5520 2024-05-10T11:16:21.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/3568181037 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c0d0a30 con 0x7ffa0c0d1fb0 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.263+0000 7ffa0a7fc640 1 --2- 172.21.15.66:0/3568181037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0b8170 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c08d940 tx=0x7ff9f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01e78fba0bb00c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa09ffb640 1 -- 172.21.15.66:0/3568181037 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4037070 con 0x7ffa0c0d1fb0 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa09ffb640 1 -- 172.21.15.66:0/3568181037 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f4032440 con 0x7ffa0c0d1fb0 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa09ffb640 1 -- 172.21.15.66:0/3568181037 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4032810 con 0x7ffa0c0d1fb0 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 -- 172.21.15.66:0/3568181037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0d1fb0 msgr2=0x7ffa0c0b8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 --2- 172.21.15.66:0/3568181037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0b8170 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c08d940 tx=0x7ff9f402a1a0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 -- 172.21.15.66:0/3568181037 shutdown_connections 2024-05-10T11:16:21.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 --2- 172.21.15.66:0/3568181037 >> v2:172.21.15.190:3300/0 conn(0x7ffa0c0b5900 0x7ffa0c0b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 --2- 172.21.15.66:0/3568181037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0b8170 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 -- 172.21.15.66:0/3568181037 >> 172.21.15.66:0/3568181037 conn(0x7ffa0c0d5170 msgr2=0x7ffa0c0d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:21.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 -- 172.21.15.66:0/3568181037 shutdown_connections 2024-05-10T11:16:21.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.264+0000 7ffa11933640 1 -- 172.21.15.66:0/3568181037 wait complete. 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.265+0000 7ffa11933640 1 Processor -- start 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 -- start start 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa0c0b5520 0x7ffa0c1f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 0x7ffa0c0a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c0b6460 con 0x7ffa0c0b5900 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c0b62e0 con 0x7ffa0c0b5520 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa11933640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0c0b65e0 con 0x7ffa0c0d1fb0 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa0a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 0x7ffa0c0a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:21.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa0a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 0x7ffa0c0a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47174/0 (socket says 172.21.15.66:47174) 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.266+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/1816291880 learned_addr learned my addr 172.21.15.66:0/1816291880 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0affd640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa0c0b5520 0x7ffa0c1f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0b7fe640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa0c0d1fb0 msgr2=0x7ffa0c0a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0a7fc640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa0c0b5520 msgr2=0x7ffa0c1f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0a7fc640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa0c0b5520 0x7ffa0c1f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0a7fc640 1 -- 172.21.15.66:0/1816291880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c0cdeb0 con 0x7ffa0c0b5900 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa0a7fc640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 0x7ffa0c0a12c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4037050 con 0x7ffa0c0b5900 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f4038040 con 0x7ffa0c0b5900 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c0cdbd0 con 0x7ffa0c0b5900 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4004470 con 0x7ffa0c0b5900 2024-05-10T11:16:21.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.267+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c09f230 con 0x7ffa0c0b5900 2024-05-10T11:16:21.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.268+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0c0693f0 con 0x7ffa0c0b5900 2024-05-10T11:16:21.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.269+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9f4030900 con 0x7ffa0c0b5900 2024-05-10T11:16:21.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.269+0000 7ffa03fff640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9ec0762d0 0x7ff9ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:21.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.269+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7ff9f40b7ed0 con 0x7ffa0c0b5900 2024-05-10T11:16:21.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.269+0000 7ffa0affd640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9ec0762d0 0x7ff9ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:21.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.270+0000 7ffa0affd640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9ec0762d0 0x7ff9ec078790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffa040012e0 tx=0x7ffa04007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:21.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.274+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff9f4081a30 con 0x7ffa0c0b5900 2024-05-10T11:16:21.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:21.539+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7ffa0c0ba260 con 0x7ffa0c0b5900 2024-05-10T11:16:22.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.505+0000 7ffa03fff640 1 -- 172.21.15.66:0/1816291880 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v201) ==== 169+0+0 (secure 0 0 0) 0x7ff9f4081330 con 0x7ffa0c0b5900 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9ec0762d0 msgr2=0x7ff9ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9ec0762d0 0x7ff9ec078790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffa040012e0 tx=0x7ffa04007ed0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 msgr2=0x7ffa0c0a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 0x7ffa0c0a12c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f40046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 shutdown_connections 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9ec0762d0 0x7ff9ec078790 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa0c0d1fb0 0x7ffa0c0a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa0c0b5900 0x7ffa0c0a12c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 --2- 172.21.15.66:0/1816291880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa0c0b5520 0x7ffa0c1f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.508+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 >> 172.21.15.66:0/1816291880 conn(0x7ffa0c0d5170 msgr2=0x7ffa0c0b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:22.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.509+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 shutdown_connections 2024-05-10T11:16:22.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.509+0000 7ffa11933640 1 -- 172.21.15.66:0/1816291880 wait complete. 2024-05-10T11:16:22.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:16:22.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.635+0000 7f66f32c4640 1 Processor -- start 2024-05-10T11:16:22.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.635+0000 7f66f32c4640 1 -- start start 2024-05-10T11:16:22.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f32c4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f66ec162900 0x7f66ec0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f32c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f66ec162ce0 0x7f66ec0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f32c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ec0d4190 con 0x7f66ec0d3950 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f32c4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f66ec0cfc40 con 0x7f66ec162900 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f32c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f66ec0d3eb0 con 0x7f66ec162ce0 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f66ec162900 0x7f66ec0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f66ec162900 0x7f66ec0d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47182/0 (socket says 172.21.15.66:47182) 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 -- 172.21.15.66:0/2000103230 learned_addr learned my addr 172.21.15.66:0/2000103230 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 -- 172.21.15.66:0/2000103230 >> v2:172.21.15.190:3300/0 conn(0x7f66ec162ce0 msgr2=0x7f66ec0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 --2- 172.21.15.66:0/2000103230 >> v2:172.21.15.190:3300/0 conn(0x7f66ec162ce0 0x7f66ec0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 -- 172.21.15.66:0/2000103230 >> v1:172.21.15.190:6789/0 conn(0x7f66ec0d3950 legacy=0x7f66ec0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:22.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.636+0000 7f66f1060640 1 -- 172.21.15.66:0/2000103230 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec0cfee0 con 0x7f66ec162900 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.637+0000 7f66f1060640 1 --2- 172.21.15.66:0/2000103230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162900 0x7f66ec0d3410 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0c8bc0 tx=0x7f66e802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40640ca5cf65a0fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.637+0000 7f66e3fff640 1 -- 172.21.15.66:0/2000103230 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8036070 con 0x7f66ec162900 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.637+0000 7f66e3fff640 1 -- 172.21.15.66:0/2000103230 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8031600 con 0x7f66ec162900 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.637+0000 7f66e3fff640 1 -- 172.21.15.66:0/2000103230 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e80319d0 con 0x7f66ec162900 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 -- 172.21.15.66:0/2000103230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162900 msgr2=0x7f66ec0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2000103230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162900 0x7f66ec0d3410 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0c8bc0 tx=0x7f66e802a660 comp rx=0 tx=0).stop 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 -- 172.21.15.66:0/2000103230 shutdown_connections 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2000103230 >> v2:172.21.15.190:3300/0 conn(0x7f66ec162ce0 0x7f66ec0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2000103230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162900 0x7f66ec0d3410 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 -- 172.21.15.66:0/2000103230 >> 172.21.15.66:0/2000103230 conn(0x7f66ec09e430 msgr2=0x7f66ec0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:22.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 -- 172.21.15.66:0/2000103230 shutdown_connections 2024-05-10T11:16:22.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.638+0000 7f66f32c4640 1 -- 172.21.15.66:0/2000103230 wait complete. 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.639+0000 7f66f32c4640 1 Processor -- start 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.639+0000 7f66f32c4640 1 -- start start 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f32c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66ec0d3950 0x7f66ec15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f32c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66ec162900 0x7f66ec0ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f32c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 0x7f66ec160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f32c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec0b4300 con 0x7f66ec162ce0 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f32c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec0b4180 con 0x7f66ec162900 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f32c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec0d10d0 con 0x7f66ec0d3950 2024-05-10T11:16:22.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 0x7f66ec160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 0x7f66ec160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47198/0 (socket says 172.21.15.66:47198) 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 -- 172.21.15.66:0/2610949506 learned_addr learned my addr 172.21.15.66:0/2610949506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1060640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66ec0d3950 0x7f66ec15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f085f640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66ec162900 0x7f66ec0ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 -- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66ec0d3950 msgr2=0x7f66ec15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66ec0d3950 0x7f66ec15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 -- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66ec162900 msgr2=0x7f66ec0ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66ec162900 0x7f66ec0ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 -- 172.21.15.66:0/2610949506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec0cc8b0 con 0x7f66ec162ce0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.640+0000 7f66f1861640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 0x7f66ec160710 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c360 tx=0x7f66e400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.641+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4017070 con 0x7f66ec162ce0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.641+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e40035f0 con 0x7f66ec162ce0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.641+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec0ccb50 con 0x7f66ec162ce0 2024-05-10T11:16:22.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.641+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4003a20 con 0x7f66ec162ce0 2024-05-10T11:16:22.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.641+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec0cd110 con 0x7f66ec162ce0 2024-05-10T11:16:22.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.642+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ec06a220 con 0x7f66ec162ce0 2024-05-10T11:16:22.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.642+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f66e401a070 con 0x7f66ec162ce0 2024-05-10T11:16:22.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.643+0000 7f66e1ffb640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66d00762d0 0x7f66d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:22.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.643+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f66e4096740 con 0x7f66ec162ce0 2024-05-10T11:16:22.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.643+0000 7f66f1060640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66d00762d0 0x7f66d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:22.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.644+0000 7f66f1060640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66d00762d0 0x7f66d0078790 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f66e8033000 tx=0x7f66e8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:22.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.647+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f66e405fc50 con 0x7f66ec162ce0 2024-05-10T11:16:22.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.842+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f66ec0ce740 con 0x7f66ec162ce0 2024-05-10T11:16:22.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.847+0000 7f66e1ffb640 1 -- 172.21.15.66:0/2610949506 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f66e4063f50 con 0x7f66ec162ce0 2024-05-10T11:16:22.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66d00762d0 msgr2=0x7f66d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66d00762d0 0x7f66d0078790 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f66e8033000 tx=0x7f66e8009000 comp rx=0 tx=0).stop 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 msgr2=0x7f66ec160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 0x7f66ec160710 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c360 tx=0x7f66e400c820 comp rx=0 tx=0).stop 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 shutdown_connections 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66d00762d0 0x7f66d0078790 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66ec162ce0 0x7f66ec160710 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66ec162900 0x7f66ec0ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 --2- 172.21.15.66:0/2610949506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66ec0d3950 0x7f66ec15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.849+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 >> 172.21.15.66:0/2610949506 conn(0x7f66ec09e430 msgr2=0x7f66ec0d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.850+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 shutdown_connections 2024-05-10T11:16:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:22.850+0000 7f66f32c4640 1 -- 172.21.15.66:0/2610949506 wait complete. 2024-05-10T11:16:22.861 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:16:22.861 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:16:22.904 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:16:22.945 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:16:22.945 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:22.945 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:22.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:16:22.962 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:16:22.962 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:23.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:16:23.004 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:23.005 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:23.020 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:16:23.020 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:16:23.020 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:23.062 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:16:23.062 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:16:23.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:23.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.165+0000 7f998c47c640 1 Processor -- start 2024-05-10T11:16:23.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.165+0000 7f998c47c640 1 -- start start 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f998c47c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f99840d5cb0 0x7f99840d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f998c47c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9984162b30 0x7f99840d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f998c47c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99840b45f0 con 0x7f9984162750 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f998c47c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f99840b4f20 con 0x7f99840d5cb0 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f998c47c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f99840d0fe0 con 0x7f9984162b30 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f9989a17640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f99840d5cb0 0x7f99840d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f9989a17640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f99840d5cb0 0x7f99840d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47212/0 (socket says 172.21.15.66:47212) 2024-05-10T11:16:23.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f9989a17640 1 -- 172.21.15.66:0/115221812 learned_addr learned my addr 172.21.15.66:0/115221812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:23.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.166+0000 7f998a218640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9984162750 0x7f99840d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55200/0 (socket says 172.21.15.66:55200) 2024-05-10T11:16:23.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989a17640 1 -- 172.21.15.66:0/115221812 >> v2:172.21.15.190:3300/0 conn(0x7f9984162b30 msgr2=0x7f99840d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:23.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989a17640 1 --2- 172.21.15.66:0/115221812 >> v2:172.21.15.190:3300/0 conn(0x7f9984162b30 0x7f99840d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989a17640 1 -- 172.21.15.66:0/115221812 >> v1:172.21.15.66:6789/0 conn(0x7f9984162750 legacy=0x7f99840d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:23.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989a17640 1 -- 172.21.15.66:0/115221812 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99840b48d0 con 0x7f99840d5cb0 2024-05-10T11:16:23.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989216640 1 -- 172.21.15.66:0/115221812 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238977622 0 0) 0x7f99840b45f0 con 0x7f9984162750 2024-05-10T11:16:23.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989a17640 1 --2- 172.21.15.66:0/115221812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99840d5cb0 0x7f99840d3630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f99840d32c0 tx=0x7f997802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7149a4c4ee9c2c65 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.167+0000 7f9989216640 1 -- 172.21.15.66:0/115221812 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978037070 con 0x7f99840d5cb0 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f9989216640 1 -- 172.21.15.66:0/115221812 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9978032440 con 0x7f99840d5cb0 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f9989216640 1 -- 172.21.15.66:0/115221812 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978032810 con 0x7f99840d5cb0 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 -- 172.21.15.66:0/115221812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99840d5cb0 msgr2=0x7f99840d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 --2- 172.21.15.66:0/115221812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99840d5cb0 0x7f99840d3630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f99840d32c0 tx=0x7f997802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 -- 172.21.15.66:0/115221812 shutdown_connections 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 --2- 172.21.15.66:0/115221812 >> v2:172.21.15.190:3300/0 conn(0x7f9984162b30 0x7f99840d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 --2- 172.21.15.66:0/115221812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99840d5cb0 0x7f99840d3630 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 -- 172.21.15.66:0/115221812 >> 172.21.15.66:0/115221812 conn(0x7f998409e3b0 msgr2=0x7f99840d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 -- 172.21.15.66:0/115221812 shutdown_connections 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.168+0000 7f998c47c640 1 -- 172.21.15.66:0/115221812 wait complete. 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.169+0000 7f998c47c640 1 Processor -- start 2024-05-10T11:16:23.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.169+0000 7f998c47c640 1 -- start start 2024-05-10T11:16:23.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998c47c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9984162750 0x7f99840ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:23.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998c47c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 0x7f99840cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:23.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998c47c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99840b9370 0x7f99840b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:23.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998c47c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99840b53b0 con 0x7f9984162b30 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998c47c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f99840d0d80 con 0x7f99840b9370 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998c47c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f99840b5530 con 0x7f9984162750 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 0x7f99840cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 0x7f99840cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47226/0 (socket says 172.21.15.66:47226) 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 -- 172.21.15.66:0/1025113706 learned_addr learned my addr 172.21.15.66:0/1025113706 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998a218640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9984162750 0x7f99840ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998aa19640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99840b9370 0x7f99840b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 -- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9984162750 msgr2=0x7f99840ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9984162750 0x7f99840ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 -- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99840b9370 msgr2=0x7f99840b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99840b9370 0x7f99840b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f9989a17640 1 -- 172.21.15.66:0/1025113706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99840ceb50 con 0x7f9984162b30 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998a218640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9984162750 0x7f99840ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.170+0000 7f998aa19640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99840b9370 0x7f99840b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.171+0000 7f9989a17640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 0x7f99840cd3d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9978000c00 tx=0x7f99780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.171+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978041070 con 0x7f9984162b30 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.171+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997803c870 con 0x7f9984162b30 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.171+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99840cee30 con 0x7f9984162b30 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.171+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978037040 con 0x7f9984162b30 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.171+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99840ccbd0 con 0x7f9984162b30 2024-05-10T11:16:23.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.172+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998406a220 con 0x7f9984162b30 2024-05-10T11:16:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.172+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9978044070 con 0x7f9984162b30 2024-05-10T11:16:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.173+0000 7f9982ffd640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99700762d0 0x7f9970078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.173+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f99780b8010 con 0x7f9984162b30 2024-05-10T11:16:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.173+0000 7f998a218640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99700762d0 0x7f9970078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.174+0000 7f998a218640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99700762d0 0x7f9970078790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99740012e0 tx=0x7f9974009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:23.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.177+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9978081b70 con 0x7f9984162b30 2024-05-10T11:16:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.405+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99840d1d50 con 0x7f9984162b30 2024-05-10T11:16:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.405+0000 7f9982ffd640 1 -- 172.21.15.66:0/1025113706 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3869 (secure 0 0 0) 0x7f9978081470 con 0x7f9984162b30 2024-05-10T11:16:23.406 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:23.406 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/623955025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":623955025},{"type":"v1","addr":"172.21.15.190:6836","nonce":623955025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/4015276083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":4015276083},{"type":"v1","addr":"172.21.15.66:6835","nonce":4015276083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5647,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/417571989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":417571989},{"type":"v1","addr":"172.21.15.190:6837","nonce":417571989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1859061647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1859061647},{"type":"v1","addr":"172.21.15.66:6834","nonce":1859061647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-05-10T11:16:23.406 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 38 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99700762d0 msgr2=0x7f9970078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99700762d0 0x7f9970078790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99740012e0 tx=0x7f9974009040 comp rx=0 tx=0).stop 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 msgr2=0x7f99840cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 0x7f99840cd3d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9978000c00 tx=0x7f99780046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 shutdown_connections 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99700762d0 0x7f9970078790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99840b9370 0x7f99840b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9984162b30 0x7f99840cd3d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 --2- 172.21.15.66:0/1025113706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9984162750 0x7f99840ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:23.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 >> 172.21.15.66:0/1025113706 conn(0x7f998409e3b0 msgr2=0x7f99840d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:23.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 shutdown_connections 2024-05-10T11:16:23.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:23.407+0000 7f998c47c640 1 -- 172.21.15.66:0/1025113706 wait complete. 2024-05-10T11:16:23.419 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:16:23.419 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:16:23.419 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:16:23.419 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:16:23.419 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:16:23.419 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:16:23.419 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:16:23.420 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:16:23.420 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:16:23.420 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:16:23.420 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:16:23.420 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:16:23.420 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:16:23.420 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:16:23.421 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:16:23.421 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:16:23.432 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:16:23.432 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:16:23.435 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:16:23.435 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:16:23.436 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:16:23.436 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:16:23.475 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:16:23.475 DEBUG:teuthology.parallel:result is None 2024-05-10T11:16:23.478 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:16:23.478 DEBUG:teuthology.parallel:result is None 2024-05-10T11:16:23.479 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:16:23.479 DEBUG:teuthology.parallel:result is None 2024-05-10T11:16:23.552 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:16:23.562 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:16:23.563 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:16:28.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-10T11:16:29.432 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:16:29.432 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:16:29.436 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:16:29.436 DEBUG:teuthology.parallel:result is None 2024-05-10T11:16:29.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:16:29.523 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:16:29.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.552+0000 7fa9dd390640 1 Processor -- start 2024-05-10T11:16:29.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.552+0000 7fa9dd390640 1 -- start start 2024-05-10T11:16:29.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9dd390640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d81626d0 0x7fa9d806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:29.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9dd390640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9d806c800 0x7fa9d80aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:29.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9dd390640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d8163bd0 con 0x7fa9d80af4b0 2024-05-10T11:16:29.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9dd390640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d806cc60 con 0x7fa9d806c800 2024-05-10T11:16:29.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9dd390640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d8162ab0 con 0x7fa9d81626d0 2024-05-10T11:16:29.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9d67fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9d806c800 0x7fa9d80aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9d67fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9d806c800 0x7fa9d80aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49644/0 (socket says 172.21.15.66:49644) 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.553+0000 7fa9d67fc640 1 -- 172.21.15.66:0/1542672766 learned_addr learned my addr 172.21.15.66:0/1542672766 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d6ffd640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d81626d0 0x7fa9d806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d67fc640 1 -- 172.21.15.66:0/1542672766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d81626d0 msgr2=0x7fa9d806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d67fc640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d81626d0 0x7fa9d806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d67fc640 1 -- 172.21.15.66:0/1542672766 >> v1:172.21.15.190:6789/0 conn(0x7fa9d80af4b0 legacy=0x7fa9d8073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d67fc640 1 -- 172.21.15.66:0/1542672766 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d80af940 con 0x7fa9d806c800 2024-05-10T11:16:29.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d6ffd640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d81626d0 0x7fa9d806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:29.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.554+0000 7fa9d67fc640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d806c800 0x7fa9d80aef70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80098a0 tx=0x7fa9c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea15dd10da9d1bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:29.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9d5ffb640 1 -- 172.21.15.66:0/1542672766 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8037070 con 0x7fa9d806c800 2024-05-10T11:16:29.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9d5ffb640 1 -- 172.21.15.66:0/1542672766 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c8032440 con 0x7fa9d806c800 2024-05-10T11:16:29.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9d5ffb640 1 -- 172.21.15.66:0/1542672766 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8032810 con 0x7fa9d806c800 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 -- 172.21.15.66:0/1542672766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d806c800 msgr2=0x7fa9d80aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d806c800 0x7fa9d80aef70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80098a0 tx=0x7fa9c802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 -- 172.21.15.66:0/1542672766 shutdown_connections 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d806c800 0x7fa9d80aef70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 --2- 172.21.15.66:0/1542672766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d81626d0 0x7fa9d806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 -- 172.21.15.66:0/1542672766 >> 172.21.15.66:0/1542672766 conn(0x7fa9d80d1d70 msgr2=0x7fa9d80d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 -- 172.21.15.66:0/1542672766 shutdown_connections 2024-05-10T11:16:29.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.555+0000 7fa9dd390640 1 -- 172.21.15.66:0/1542672766 wait complete. 2024-05-10T11:16:29.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.557+0000 7fa9dd390640 1 Processor -- start 2024-05-10T11:16:29.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.557+0000 7fa9dd390640 1 -- start start 2024-05-10T11:16:29.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d806c800 0x7fa9d815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d80af4b0 0x7fa9d81f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 0x7fa9d815fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81633d0 con 0x7fa9d81626d0 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81630f0 con 0x7fa9d806c800 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d81636b0 con 0x7fa9d80af4b0 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 0x7fa9d815fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 0x7fa9d815fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49652/0 (socket says 172.21.15.66:49652) 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 -- 172.21.15.66:0/4062389349 learned_addr learned my addr 172.21.15.66:0/4062389349 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d6ffd640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d806c800 0x7fa9d815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d67fc640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d80af4b0 0x7fa9d81f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 -- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d80af4b0 msgr2=0x7fa9d81f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:29.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d80af4b0 0x7fa9d81f8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 -- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d806c800 msgr2=0x7fa9d815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d806c800 0x7fa9d815cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 -- 172.21.15.66:0/4062389349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d815d420 con 0x7fa9d81626d0 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d67fc640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d80af4b0 0x7fa9d81f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d6ffd640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d806c800 0x7fa9d815cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9d77fe640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 0x7fa9d815fba0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000c7b0 tx=0x7fa9d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0004b60 con 0x7fa9d81626d0 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d0004d00 con 0x7fa9d81626d0 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.558+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d815d700 con 0x7fa9d81626d0 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.559+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000aa90 con 0x7fa9d81626d0 2024-05-10T11:16:29.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.559+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d815dcc0 con 0x7fa9d81626d0 2024-05-10T11:16:29.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.559+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d80693f0 con 0x7fa9d81626d0 2024-05-10T11:16:29.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.560+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa9d000ac30 con 0x7fa9d81626d0 2024-05-10T11:16:29.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.561+0000 7fa9cf7fe640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9b80762d0 0x7fa9b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:29.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.561+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5335+0+0 (secure 0 0 0) 0x7fa9d00979e0 con 0x7fa9d81626d0 2024-05-10T11:16:29.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.561+0000 7fa9d6ffd640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9b80762d0 0x7fa9b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:29.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.562+0000 7fa9d6ffd640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9b80762d0 0x7fa9b8078790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80c6df0 tx=0x7fa9c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:29.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.566+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa9d00614b0 con 0x7fa9d81626d0 2024-05-10T11:16:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:29.769+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa9d806fa70 con 0x7fa9d81626d0 2024-05-10T11:16:30.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.798+0000 7fa9cf7fe640 1 -- 172.21.15.66:0/4062389349 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v72) ==== 97+0+0 (secure 0 0 0) 0x7fa9d0060db0 con 0x7fa9d81626d0 2024-05-10T11:16:30.799 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9b80762d0 msgr2=0x7fa9b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9b80762d0 0x7fa9b8078790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80c6df0 tx=0x7fa9c0008040 comp rx=0 tx=0).stop 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 msgr2=0x7fa9d815fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 0x7fa9d815fba0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000c7b0 tx=0x7fa9d000cc70 comp rx=0 tx=0).stop 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 shutdown_connections 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9b80762d0 0x7fa9b8078790 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d81626d0 0x7fa9d815fba0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9d80af4b0 0x7fa9d81f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 --2- 172.21.15.66:0/4062389349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d806c800 0x7fa9d815cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 >> 172.21.15.66:0/4062389349 conn(0x7fa9d80d1d70 msgr2=0x7fa9d806ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 shutdown_connections 2024-05-10T11:16:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.801+0000 7fa9dd390640 1 -- 172.21.15.66:0/4062389349 wait complete. 2024-05-10T11:16:30.816 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:16:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.925+0000 7f8ea6cc5640 1 Processor -- start 2024-05-10T11:16:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.925+0000 7f8ea6cc5640 1 -- start start 2024-05-10T11:16:30.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8ea6cc5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 0x7f8ea00d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8ea6cc5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea00b45f0 con 0x7f8ea00d5cb0 2024-05-10T11:16:30.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8ea6cc5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea00b48d0 con 0x7f8ea0162b30 2024-05-10T11:16:30.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8ea6cc5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea00b4f20 con 0x7f8ea0162750 2024-05-10T11:16:30.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e97fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8ea00d5cb0 0x7f8ea00d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44514/0 (socket says 172.21.15.66:44514) 2024-05-10T11:16:30.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e97fff640 1 -- 172.21.15.66:0/3373587139 learned_addr learned my addr 172.21.15.66:0/3373587139 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154626837 0 0) 0x7f8ea00b45f0 con 0x7f8ea00d5cb0 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8ea4a61640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 0x7f8ea00d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e88003520 con 0x7f8ea00d5cb0 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1331290241 0 0) 0x7f8e88003520 con 0x7f8ea00d5cb0 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 msgr2=0x7f8ea00d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 0x7f8ea00d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 >> v1:172.21.15.190:6789/0 conn(0x7f8ea0162b30 legacy=0x7f8ea00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea00b4bb0 con 0x7f8ea00d5cb0 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.926+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f8e90001670 con 0x7f8ea00d5cb0 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 >> v1:172.21.15.66:6789/0 conn(0x7f8ea00d5cb0 legacy=0x7f8ea00d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 0x7f8e880039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88003f60 0x7f8e88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e88004d40 0x7f8e880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00b4f20 con 0x7f8e88004d40 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8800bb50 con 0x7f8e88003f60 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8800bd50 con 0x7f8ea0162750 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea5262640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e88004d40 0x7f8e880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8e97fff640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88003f60 0x7f8e88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea4a61640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 0x7f8e880039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea5262640 1 -- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 msgr2=0x7f8e880039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea5262640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea0162750 0x7f8e880039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea5262640 1 -- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88003f60 msgr2=0x7f8e88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea5262640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88003f60 0x7f8e88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.927+0000 7f8ea5262640 1 -- 172.21.15.66:0/3373587139 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e88003520 con 0x7f8e88004d40 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8ea5262640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e88004d40 0x7f8e880051c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e98001e50 tx=0x7f8e88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a0ca482ffffb96 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98001a70 con 0x7f8e88004d40 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e98003970 con 0x7f8e88004d40 2024-05-10T11:16:30.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8e977fe640 1 -- 172.21.15.66:0/3373587139 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98003d60 con 0x7f8e88004d40 2024-05-10T11:16:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/3373587139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e88004d40 msgr2=0x7f8e880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/3373587139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e88004d40 0x7f8e880051c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e98001e50 tx=0x7f8e88005830 comp rx=0 tx=0).stop 2024-05-10T11:16:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8ea5262640 1 -- 172.21.15.66:0/3373587139 reap_dead start 2024-05-10T11:16:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/3373587139 shutdown_connections 2024-05-10T11:16:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.928+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/3373587139 >> 172.21.15.66:0/3373587139 conn(0x7f8ea009e3b0 msgr2=0x7f8ea00d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.929+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/3373587139 shutdown_connections 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.929+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/3373587139 wait complete. 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.930+0000 7f8ea6cc5640 1 Processor -- start 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.930+0000 7f8ea6cc5640 1 -- start start 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea6cc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88004d40 0x7f8ea0157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea6cc5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea00b7c70 0x7f8ea00b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea6cc5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 0x7f8ea01604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea6cc5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00d0fe0 con 0x7f8ea0160020 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea6cc5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00d3f50 con 0x7f8e88004d40 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea6cc5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea00d0670 con 0x7f8ea00b7c70 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 0x7f8ea01604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 0x7f8ea01604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49680/0 (socket says 172.21.15.66:49680) 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 -- 172.21.15.66:0/2206389541 learned_addr learned my addr 172.21.15.66:0/2206389541 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea4a61640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88004d40 0x7f8ea0157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8e97fff640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea00b7c70 0x7f8ea00b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 -- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea00b7c70 msgr2=0x7f8ea00b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea00b7c70 0x7f8ea00b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 -- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88004d40 msgr2=0x7f8ea0157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88004d40 0x7f8ea0157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 -- 172.21.15.66:0/2206389541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea00b8730 con 0x7f8ea0160020 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea4a61640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88004d40 0x7f8ea0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.931+0000 7f8ea5262640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 0x7f8ea01604d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e98008fd0 tx=0x7f8e980014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.932+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98037040 con 0x7f8ea0160020 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.932+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e98003e50 con 0x7f8ea0160020 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.932+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea00b8a10 con 0x7f8ea0160020 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.932+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98007db0 con 0x7f8ea0160020 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.932+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea00b8fd0 con 0x7f8ea0160020 2024-05-10T11:16:30.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.933+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea00baf40 con 0x7f8ea0160020 2024-05-10T11:16:30.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.933+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e98042020 con 0x7f8ea0160020 2024-05-10T11:16:30.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.934+0000 7f8e957fa640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e8c076300 0x7f8e8c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:30.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.934+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5249+0+0 (secure 0 0 0) 0x7f8e980b69f0 con 0x7f8ea0160020 2024-05-10T11:16:30.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.934+0000 7f8ea4a61640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e8c076300 0x7f8e8c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:30.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.935+0000 7f8ea4a61640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e8c076300 0x7f8e8c0787c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ea01f89a0 tx=0x7f8e9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:30.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:30.938+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8e98080030 con 0x7f8ea0160020 2024-05-10T11:16:31.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.208+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8ea006a220 con 0x7f8ea0160020 2024-05-10T11:16:31.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.208+0000 7f8e957fa640 1 -- 172.21.15.66:0/2206389541 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f8e98084330 con 0x7f8ea0160020 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.209 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:16:31.210 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:16:31.211 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.212 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:16:31.213 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.214 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:16:31.215 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.216 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow r", 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:16:31.217 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:16:31.218 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:16:31.219 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.220 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:16:31.221 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e8c076300 msgr2=0x7f8e8c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e8c076300 0x7f8e8c0787c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ea01f89a0 tx=0x7f8e9c008040 comp rx=0 tx=0).stop 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 msgr2=0x7f8ea01604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 0x7f8ea01604d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e98008fd0 tx=0x7f8e980014a0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 shutdown_connections 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8e8c076300 0x7f8e8c0787c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ea0160020 0x7f8ea01604d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ea00b7c70 0x7f8ea00b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 --2- 172.21.15.66:0/2206389541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e88004d40 0x7f8ea0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 >> 172.21.15.66:0/2206389541 conn(0x7f8ea009e3b0 msgr2=0x7f8ea006d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 shutdown_connections 2024-05-10T11:16:31.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.210+0000 7f8ea6cc5640 1 -- 172.21.15.66:0/2206389541 wait complete. 2024-05-10T11:16:31.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:16:31.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.328+0000 7f40c9d46640 1 Processor -- start 2024-05-10T11:16:31.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.328+0000 7f40c9d46640 1 -- start start 2024-05-10T11:16:31.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.328+0000 7f40c9d46640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f40c40b8860 0x7f40c406e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c9d46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40d0230 0x7f40c40cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c9d46640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c415fc90 con 0x7f40c40cfbb0 2024-05-10T11:16:31.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c9d46640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f40c406ee50 con 0x7f40c40b8860 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c9d46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f40c40b8c40 con 0x7f40c40d0230 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f40c40b8860 0x7f40c406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c3fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f40c40cfbb0 0x7f40c40d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44516/0 (socket says 172.21.15.66:44516) 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c3fff640 1 -- 172.21.15.66:0/3997281144 learned_addr learned my addr 172.21.15.66:0/3997281144 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c2ffd640 1 --2- 172.21.15.66:0/3997281144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40d0230 0x7f40c40cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c37fe640 1 -- 172.21.15.66:0/3997281144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40d0230 msgr2=0x7f40c40cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c37fe640 1 --2- 172.21.15.66:0/3997281144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40d0230 0x7f40c40cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c37fe640 1 -- 172.21.15.66:0/3997281144 >> v1:172.21.15.66:6789/0 conn(0x7f40c40cfbb0 legacy=0x7f40c40d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c37fe640 1 -- 172.21.15.66:0/3997281144 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c40cd570 con 0x7f40c40b8860 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.329+0000 7f40c27fc640 1 -- 172.21.15.66:0/3997281144 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892051370 0 0) 0x7f40c415fc90 con 0x7f40c40cfbb0 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c37fe640 1 --2- 172.21.15.66:0/3997281144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40b8860 0x7f40c406e520 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097a0 tx=0x7f40b402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fcea346ef4ecfc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c27fc640 1 -- 172.21.15.66:0/3997281144 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4037070 con 0x7f40c40b8860 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c27fc640 1 -- 172.21.15.66:0/3997281144 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b402ae50 con 0x7f40c40b8860 2024-05-10T11:16:31.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c27fc640 1 -- 172.21.15.66:0/3997281144 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4032660 con 0x7f40c40b8860 2024-05-10T11:16:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c9d46640 1 -- 172.21.15.66:0/3997281144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40b8860 msgr2=0x7f40c406e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3997281144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40b8860 0x7f40c406e520 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097a0 tx=0x7f40b402a100 comp rx=0 tx=0).stop 2024-05-10T11:16:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c9d46640 1 -- 172.21.15.66:0/3997281144 shutdown_connections 2024-05-10T11:16:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3997281144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40d0230 0x7f40c40cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3997281144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40b8860 0x7f40c406e520 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.330+0000 7f40c9d46640 1 -- 172.21.15.66:0/3997281144 >> 172.21.15.66:0/3997281144 conn(0x7f40c40d2df0 msgr2=0x7f40c40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.331+0000 7f40c9d46640 1 -- 172.21.15.66:0/3997281144 shutdown_connections 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.331+0000 7f40c9d46640 1 -- 172.21.15.66:0/3997281144 wait complete. 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.332+0000 7f40c9d46640 1 Processor -- start 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.332+0000 7f40c9d46640 1 -- start start 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40b8860 0x7f40c40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 0x7f40c41f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40c40d0230 0x7f40c41f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40c40cde10 con 0x7f40c40cfbb0 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f40c40cdb30 con 0x7f40c40d0230 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f40c406ea60 con 0x7f40c40b8860 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 0x7f40c41f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 0x7f40c41f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49698/0 (socket says 172.21.15.66:49698) 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 -- 172.21.15.66:0/3544064578 learned_addr learned my addr 172.21.15.66:0/3544064578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c37fe640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40b8860 0x7f40c40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c3fff640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40c40d0230 0x7f40c41f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 -- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40b8860 msgr2=0x7f40c40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40b8860 0x7f40c40cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 -- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40c40d0230 msgr2=0x7f40c41f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40c40d0230 0x7f40c41f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 -- 172.21.15.66:0/3544064578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c40ca410 con 0x7f40c40cfbb0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c3fff640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40c40d0230 0x7f40c41f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c37fe640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40b8860 0x7f40c40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c2ffd640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 0x7f40c41f4da0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f40b800d800 tx=0x7f40b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b800b660 con 0x7f40c40cfbb0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b8019070 con 0x7f40c40cfbb0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c40ca6f0 con 0x7f40c40cfbb0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b800ba20 con 0x7f40c40cfbb0 2024-05-10T11:16:31.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.333+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c40cacb0 con 0x7f40c40cfbb0 2024-05-10T11:16:31.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.334+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c406a220 con 0x7f40c40cfbb0 2024-05-10T11:16:31.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.335+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f40b800bbc0 con 0x7f40c40cfbb0 2024-05-10T11:16:31.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.336+0000 7f40abfff640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f40b00762d0 0x7f40b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.336+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5249+0+0 (secure 0 0 0) 0x7f40b8097860 con 0x7f40c40cfbb0 2024-05-10T11:16:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.336+0000 7f40c37fe640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f40b00762d0 0x7f40b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.336+0000 7f40c37fe640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f40b00762d0 0x7f40b0078790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f40b4034000 tx=0x7f40b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:31.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.340+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f40b8061380 con 0x7f40c40cfbb0 2024-05-10T11:16:31.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.531+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f40c4071d90 con 0x7f40c40cfbb0 2024-05-10T11:16:31.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.532+0000 7f40abfff640 1 -- 172.21.15.66:0/3544064578 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f40b8060c80 con 0x7f40c40cfbb0 2024-05-10T11:16:31.532 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:31.532 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:16:31.532 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:16:31.532 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:16:31.533 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:16:31.533 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:31.533 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:16:31.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f40b00762d0 msgr2=0x7f40b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f40b00762d0 0x7f40b0078790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f40b4034000 tx=0x7f40b402e000 comp rx=0 tx=0).stop 2024-05-10T11:16:31.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 msgr2=0x7f40c41f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 0x7f40c41f4da0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f40b800d800 tx=0x7f40b800dcc0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 shutdown_connections 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f40b00762d0 0x7f40b0078790 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40c40d0230 0x7f40c41f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40c40cfbb0 0x7f40c41f4da0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 --2- 172.21.15.66:0/3544064578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40c40b8860 0x7f40c40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 >> 172.21.15.66:0/3544064578 conn(0x7f40c40d2df0 msgr2=0x7f40c4070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 shutdown_connections 2024-05-10T11:16:31.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.534+0000 7f40c9d46640 1 -- 172.21.15.66:0/3544064578 wait complete. 2024-05-10T11:16:31.545 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:16:31.545 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:16:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.653+0000 7f47a83c9640 1 Processor -- start 2024-05-10T11:16:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.653+0000 7f47a83c9640 1 -- start start 2024-05-10T11:16:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.654+0000 7f47a83c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f47a015d2d0 0x7f47a00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.654+0000 7f47a83c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a00d0d60 con 0x7f47a00cff10 2024-05-10T11:16:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.654+0000 7f47a83c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a00d1040 con 0x7f47a00d3920 2024-05-10T11:16:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.654+0000 7f47a83c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f47a00cdd60 con 0x7f47a015d2d0 2024-05-10T11:16:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.654+0000 7f47a6966640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f47a00cff10 0x7f47a00d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44530/0 (socket says 172.21.15.66:44530) 2024-05-10T11:16:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.654+0000 7f47a6966640 1 -- 172.21.15.66:0/1620759953 learned_addr learned my addr 172.21.15.66:0/1620759953 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 --2- 172.21.15.66:0/1620759953 >> v2:172.21.15.190:3300/0 conn(0x7f47a015d2d0 0x7f47a00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3552425852 0 0) 0x7f47a00d0d60 con 0x7f47a00cff10 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4788003520 con 0x7f47a00cff10 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2983148715 0 0) 0x7f4788003520 con 0x7f47a00cff10 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 >> v2:172.21.15.190:3300/0 conn(0x7f47a015d2d0 msgr2=0x7f47a00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 --2- 172.21.15.66:0/1620759953 >> v2:172.21.15.190:3300/0 conn(0x7f47a015d2d0 0x7f47a00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 >> v1:172.21.15.190:6789/0 conn(0x7f47a00d3920 legacy=0x7f47a00ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a00ce040 con 0x7f47a00cff10 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f47900019f0 con 0x7f47a00cff10 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 >> v1:172.21.15.66:6789/0 conn(0x7f47a00cff10 legacy=0x7f47a00d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f4788003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4788004800 0x7f4788004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47880051c0 0x7f478800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00cdd60 con 0x7f47880039b0 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f478800c060 con 0x7f47880051c0 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f478800c260 con 0x7f4788004800 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f4788003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6966640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47880051c0 0x7f478800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a5964640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4788004800 0x7f4788004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 -- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4788004800 msgr2=0x7f4788004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4788004800 0x7f4788004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 -- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47880051c0 msgr2=0x7f478800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47880051c0 0x7f478800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6165640 1 -- 172.21.15.66:0/1620759953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788003520 con 0x7f47880039b0 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6966640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47880051c0 0x7f478800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.655+0000 7f47a6966640 1 -- 172.21.15.66:0/1620759953 reap_dead start 2024-05-10T11:16:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.656+0000 7f47a6165640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f4788003dd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4798009ac0 tx=0x7f4788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839d959faf203127 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.656+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798036070 con 0x7f47880039b0 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.656+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4798031400 con 0x7f47880039b0 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.656+0000 7f47a5163640 1 -- 172.21.15.66:0/1620759953 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798009690 con 0x7f47880039b0 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 -- 172.21.15.66:0/1620759953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 msgr2=0x7f4788003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f4788003dd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4798009ac0 tx=0x7f4788005830 comp rx=0 tx=0).stop 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 -- 172.21.15.66:0/1620759953 shutdown_connections 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1620759953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f4788003dd0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 -- 172.21.15.66:0/1620759953 >> 172.21.15.66:0/1620759953 conn(0x7f47a00d2e00 msgr2=0x7f47a00d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 -- 172.21.15.66:0/1620759953 shutdown_connections 2024-05-10T11:16:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.657+0000 7f47a83c9640 1 -- 172.21.15.66:0/1620759953 wait complete. 2024-05-10T11:16:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.658+0000 7f47a83c9640 1 Processor -- start 2024-05-10T11:16:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.658+0000 7f47a83c9640 1 -- start start 2024-05-10T11:16:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a83c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f47a0150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a83c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47a00b5280 0x7f47a00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a83c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47a00b5700 0x7f47a00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a83c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00cda10 con 0x7f47880039b0 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a83c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f47a015d6b0 con 0x7f47a00b5700 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a83c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f47a00b2760 con 0x7f47a00b5280 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f47a0150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f47a0150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49726/0 (socket says 172.21.15.66:49726) 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 -- 172.21.15.66:0/1427008734 learned_addr learned my addr 172.21.15.66:0/1427008734 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a5964640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47a00b5280 0x7f47a00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6966640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47a00b5700 0x7f47a00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 -- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47a00b5280 msgr2=0x7f47a00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47a00b5280 0x7f47a00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 -- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47a00b5700 msgr2=0x7f47a00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:31.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47a00b5700 0x7f47a00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 -- 172.21.15.66:0/1427008734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a00b3930 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a5964640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47a00b5280 0x7f47a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6966640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47a00b5700 0x7f47a00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.659+0000 7f47a6165640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f47a0150c00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4798034040 tx=0x7f4798004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.660+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479803f020 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.660+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4798037040 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.660+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a00b3c10 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.660+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798036070 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.660+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a00b3510 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.661+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a00cced0 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.661+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4798042020 con 0x7f47880039b0 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.662+0000 7f479effd640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f478c0762d0 0x7f478c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.662+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5249+0+0 (secure 0 0 0) 0x7f47980b73b0 con 0x7f47880039b0 2024-05-10T11:16:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.662+0000 7f47a5964640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f478c0762d0 0x7f478c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.663+0000 7f47a5964640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f478c0762d0 0x7f478c078790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f47a00c6270 tx=0x7f4794009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.666+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f47a00cced0 con 0x7f47880039b0 2024-05-10T11:16:31.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:31.859+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f47a00693f0 con 0x7f47880039b0 2024-05-10T11:16:31.860 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:16:31.863 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:16:32.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.819+0000 7f479effd640 1 -- 172.21.15.66:0/1427008734 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f4798049030 con 0x7f47880039b0 2024-05-10T11:16:32.820 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:16:32.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f478c0762d0 msgr2=0x7f478c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f478c0762d0 0x7f478c078790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f47a00c6270 tx=0x7f4794009040 comp rx=0 tx=0).stop 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 msgr2=0x7f47a0150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f47a0150c00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4798034040 tx=0x7f4798004730 comp rx=0 tx=0).stop 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 shutdown_connections 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f478c0762d0 0x7f478c078790 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47a00b5700 0x7f47a00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47a00b5280 0x7f47a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 --2- 172.21.15.66:0/1427008734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47880039b0 0x7f47a0150c00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 >> 172.21.15.66:0/1427008734 conn(0x7f47a00d2e00 msgr2=0x7f47a0071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 shutdown_connections 2024-05-10T11:16:32.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.823+0000 7f47a83c9640 1 -- 172.21.15.66:0/1427008734 wait complete. 2024-05-10T11:16:32.840 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:16:32.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.956+0000 7f4ea10dc640 1 Processor -- start 2024-05-10T11:16:32.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.956+0000 7f4ea10dc640 1 -- start start 2024-05-10T11:16:32.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.957+0000 7f4ea10dc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 0x7f4e9c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:32.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.957+0000 7f4ea10dc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e9c0cbc90 0x7f4e9c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:32.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.957+0000 7f4ea10dc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9c0cf3d0 con 0x7f4e9c0ceda0 2024-05-10T11:16:32.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.957+0000 7f4ea10dc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c159720 con 0x7f4e9c0cbc90 2024-05-10T11:16:32.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.957+0000 7f4ea10dc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c06df20 con 0x7f4e9c159340 2024-05-10T11:16:32.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 0x7f4e9c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e9c0cbc90 0x7f4e9c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9a59c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f4e9c0ceda0 0x7f4e9c0cb580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:43972/0 (socket says 172.21.15.66:43972) 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e9c0cbc90 0x7f4e9c06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:59402/0 (socket says 172.21.15.66:59402) 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 0x7f4e9c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:43148/0 (socket says 172.21.15.66:43148) 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 -- 172.21.15.66:0/3985917913 learned_addr learned my addr 172.21.15.66:0/3985917913 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 -- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 msgr2=0x7f4e9c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 --2- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 0x7f4e9c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 -- 172.21.15.66:0/3985917913 >> v1:172.21.15.190:6789/0 conn(0x7f4e9c0ceda0 legacy=0x7f4e9c0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9b59e640 1 -- 172.21.15.66:0/3985917913 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c0cf6b0 con 0x7f4e9c0cbc90 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.958+0000 7f4e9ad9d640 1 --2- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 0x7f4e9c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.959+0000 7f4e9b59e640 1 --2- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0cbc90 0x7f4e9c06e3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009e50 tx=0x7f4e9402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece013232294363a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.959+0000 7f4e99d9b640 1 -- 172.21.15.66:0/3985917913 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94036070 con 0x7f4e9c0cbc90 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.959+0000 7f4e99d9b640 1 -- 172.21.15.66:0/3985917913 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e94031600 con 0x7f4e9c0cbc90 2024-05-10T11:16:32.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.959+0000 7f4e99d9b640 1 -- 172.21.15.66:0/3985917913 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940319d0 con 0x7f4e9c0cbc90 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.959+0000 7f4ea10dc640 1 -- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0cbc90 msgr2=0x7f4e9c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.959+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0cbc90 0x7f4e9c06e3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009e50 tx=0x7f4e9402a710 comp rx=0 tx=0).stop 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.960+0000 7f4ea10dc640 1 -- 172.21.15.66:0/3985917913 shutdown_connections 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.960+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0cbc90 0x7f4e9c06e3b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.960+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/3985917913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c159340 0x7f4e9c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.960+0000 7f4ea10dc640 1 -- 172.21.15.66:0/3985917913 >> 172.21.15.66:0/3985917913 conn(0x7f4e9c0d0c90 msgr2=0x7f4e9c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.960+0000 7f4ea10dc640 1 -- 172.21.15.66:0/3985917913 shutdown_connections 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.960+0000 7f4ea10dc640 1 -- 172.21.15.66:0/3985917913 wait complete. 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.961+0000 7f4ea10dc640 1 Processor -- start 2024-05-10T11:16:32.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.961+0000 7f4ea10dc640 1 -- start start 2024-05-10T11:16:32.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4ea10dc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c0cbc90 0x7f4e9c0c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:32.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4ea10dc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0ceda0 0x7f4e9c0c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:32.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4ea10dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 0x7f4e9c151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:32.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4ea10dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c15bfd0 con 0x7f4e9c159340 2024-05-10T11:16:32.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4ea10dc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0cfc70 con 0x7f4e9c0ceda0 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4ea10dc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c06c2c0 con 0x7f4e9c0cbc90 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4e9b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 0x7f4e9c151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4e9ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c0cbc90 0x7f4e9c0c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4e9b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 0x7f4e9c151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49740/0 (socket says 172.21.15.66:49740) 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4e9b59e640 1 -- 172.21.15.66:0/776717965 learned_addr learned my addr 172.21.15.66:0/776717965 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.962+0000 7f4e9a59c640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0ceda0 0x7f4e9c0c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9b59e640 1 -- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c0cbc90 msgr2=0x7f4e9c0c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9b59e640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c0cbc90 0x7f4e9c0c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9b59e640 1 -- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0ceda0 msgr2=0x7f4e9c0c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9b59e640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0ceda0 0x7f4e9c0c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9b59e640 1 -- 172.21.15.66:0/776717965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c15ff60 con 0x7f4e9c159340 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9ad9d640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c0cbc90 0x7f4e9c0c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e9b59e640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 0x7f4e9c151230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009e50 tx=0x7f4e94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:32.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94036050 con 0x7f4e9c159340 2024-05-10T11:16:32.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c0c64b0 con 0x7f4e9c159340 2024-05-10T11:16:32.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e94042070 con 0x7f4e9c159340 2024-05-10T11:16:32.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94009510 con 0x7f4e9c159340 2024-05-10T11:16:32.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.963+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c0c5710 con 0x7f4e9c159340 2024-05-10T11:16:32.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.964+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c06a220 con 0x7f4e9c159340 2024-05-10T11:16:32.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.965+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e94007bf0 con 0x7f4e9c159340 2024-05-10T11:16:32.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.965+0000 7f4e837fe640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e880762d0 0x7f4e88078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:32.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.966+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5619+0+0 (secure 0 0 0) 0x7f4e940b8140 con 0x7f4e9c159340 2024-05-10T11:16:32.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.966+0000 7f4e9ad9d640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e880762d0 0x7f4e88078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:32.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.966+0000 7f4e9ad9d640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e880762d0 0x7f4e88078790 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b800 tx=0x7f4e8c00f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:32.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:32.971+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4e940814b0 con 0x7f4e9c159340 2024-05-10T11:16:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.164+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4e9c0b6c10 con 0x7f4e9c159340 2024-05-10T11:16:33.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.826+0000 7f4e837fe640 1 -- 172.21.15.66:0/776717965 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) ==== 170+0+0 (secure 0 0 0) 0x7f4e940857b0 con 0x7f4e9c159340 2024-05-10T11:16:33.826 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:16:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e880762d0 msgr2=0x7f4e88078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e880762d0 0x7f4e88078790 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b800 tx=0x7f4e8c00f040 comp rx=0 tx=0).stop 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 msgr2=0x7f4e9c151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 0x7f4e9c151230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009e50 tx=0x7f4e94004a40 comp rx=0 tx=0).stop 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 shutdown_connections 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4e880762d0 0x7f4e88078790 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e9c159340 0x7f4e9c151230 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e9c0ceda0 0x7f4e9c0c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 --2- 172.21.15.66:0/776717965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9c0cbc90 0x7f4e9c0c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 >> 172.21.15.66:0/776717965 conn(0x7f4e9c0d0c90 msgr2=0x7f4e9c15a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 shutdown_connections 2024-05-10T11:16:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.829+0000 7f4ea10dc640 1 -- 172.21.15.66:0/776717965 wait complete. 2024-05-10T11:16:33.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:16:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.967+0000 7f7de619d640 1 Processor -- start 2024-05-10T11:16:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.967+0000 7f7de619d640 1 -- start start 2024-05-10T11:16:33.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7de619d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7de015f3b0 0x7f7de0163930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7de619d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de0163e70 con 0x7f7de00d0e90 2024-05-10T11:16:33.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7de619d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de015f790 con 0x7f7de00cfdd0 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7de619d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7de00cf160 con 0x7f7de015f3b0 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7ddffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7de00d0e90 0x7f7de006ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:44532/0 (socket says 172.21.15.66:44532) 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7ddffff640 1 -- 172.21.15.66:0/3801572144 learned_addr learned my addr 172.21.15.66:0/3801572144 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.968+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3801572144 >> v2:172.21.15.190:3300/0 conn(0x7f7de015f3b0 0x7f7de0163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357804399 0 0) 0x7f7dd8001490 con 0x7f7de00d0e90 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc8003520 con 0x7f7de00d0e90 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687522669 0 0) 0x7f7de015f790 con 0x7f7de00cfdd0 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dd8001490 con 0x7f7de00cfdd0 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3142359749 0 0) 0x7f7dc8003520 con 0x7f7de00d0e90 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 >> v2:172.21.15.190:3300/0 conn(0x7f7de015f3b0 msgr2=0x7f7de0163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 --2- 172.21.15.66:0/3801572144 >> v2:172.21.15.190:3300/0 conn(0x7f7de015f3b0 0x7f7de0163930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 >> v1:172.21.15.190:6789/0 conn(0x7f7de00cfdd0 legacy=0x7f7de00d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de00ce550 con 0x7f7de00d0e90 2024-05-10T11:16:33.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f7dd8001bc0 con 0x7f7de00d0e90 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3801572144 >> v2:172.21.15.190:3300/0 conn(0x7f7de015f3b0 0x7f7de0163930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 >> v1:172.21.15.66:6789/0 conn(0x7f7de00d0e90 legacy=0x7f7de006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8003b40 0x7f7dc8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc8004800 0x7f7dc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc80051c0 0x7f7dc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00cf160 con 0x7f7dc8004800 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc800c0f0 con 0x7f7dc8003b40 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc800c2f0 con 0x7f7dc80051c0 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddeffd640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc8004800 0x7f7dc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8003b40 0x7f7dc8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddffff640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc80051c0 0x7f7dc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddeffd640 1 -- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc80051c0 msgr2=0x7f7dc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddeffd640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dc80051c0 0x7f7dc800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddeffd640 1 -- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8003b40 msgr2=0x7f7dc8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddeffd640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8003b40 0x7f7dc8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddffff640 1 -- 172.21.15.66:0/3801572144 reap_dead start 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddeffd640 1 -- 172.21.15.66:0/3801572144 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc8003520 con 0x7f7dc8004800 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.969+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8003b40 0x7f7dc8003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.970+0000 7f7ddeffd640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc8004800 0x7f7dc8004c80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40018d0 tx=0x7f7dc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bde2a98be0706a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.970+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40014f0 con 0x7f7dc8004800 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.970+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40052d0 con 0x7f7dc8004800 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.970+0000 7f7dde7fc640 1 -- 172.21.15.66:0/3801572144 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd402ac40 con 0x7f7dc8004800 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 -- 172.21.15.66:0/3801572144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc8004800 msgr2=0x7f7dc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc8004800 0x7f7dc8004c80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40018d0 tx=0x7f7dc8005830 comp rx=0 tx=0).stop 2024-05-10T11:16:33.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 -- 172.21.15.66:0/3801572144 shutdown_connections 2024-05-10T11:16:33.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 --2- 172.21.15.66:0/3801572144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dc8004800 0x7f7dc8004c80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 -- 172.21.15.66:0/3801572144 >> 172.21.15.66:0/3801572144 conn(0x7f7de00b3c60 msgr2=0x7f7de00b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:33.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 -- 172.21.15.66:0/3801572144 shutdown_connections 2024-05-10T11:16:33.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.971+0000 7f7de619d640 1 -- 172.21.15.66:0/3801572144 wait complete. 2024-05-10T11:16:33.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.972+0000 7f7de619d640 1 Processor -- start 2024-05-10T11:16:33.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.972+0000 7f7de619d640 1 -- start start 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7de619d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8004800 0x7f7de01f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7de619d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7de00b4b10 0x7f7de0146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7de619d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 0x7f7de01f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7de619d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00cedf0 con 0x7f7de01469b0 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7de619d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00ceb10 con 0x7f7dc8004800 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7de619d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7de0163930 con 0x7f7de00b4b10 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 0x7f7de01f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 0x7f7de01f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49764/0 (socket says 172.21.15.66:49764) 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7ddffff640 1 -- 172.21.15.66:0/3013187368 learned_addr learned my addr 172.21.15.66:0/3013187368 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8004800 0x7f7de01f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7ddeffd640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7de00b4b10 0x7f7de0146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.973+0000 7f7ddffff640 1 -- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7de00b4b10 msgr2=0x7f7de0146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7ddffff640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7de00b4b10 0x7f7de0146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7ddffff640 1 -- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8004800 msgr2=0x7f7de01f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7ddffff640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8004800 0x7f7de01f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7ddffff640 1 -- 172.21.15.66:0/3013187368 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de0161160 con 0x7f7de01469b0 2024-05-10T11:16:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8004800 0x7f7de01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7ddffff640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 0x7f7de01f50c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7de0073060 tx=0x7f7dd800aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8007920 con 0x7f7de01469b0 2024-05-10T11:16:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd8018070 con 0x7f7de01469b0 2024-05-10T11:16:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de0161440 con 0x7f7de01469b0 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8013630 con 0x7f7de01469b0 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.974+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de0160e10 con 0x7f7de01469b0 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.975+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de00b4570 con 0x7f7de01469b0 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.975+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7dd80137d0 con 0x7f7de01469b0 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.976+0000 7f7dc7fff640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7dcc0762d0 0x7f7dcc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.976+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6001+0+0 (secure 0 0 0) 0x7f7dd8097e00 con 0x7f7de01469b0 2024-05-10T11:16:33.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.976+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7dcc0762d0 0x7f7dcc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:33.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.977+0000 7f7ddf7fe640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7dcc0762d0 0x7f7dcc078790 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7de01f93e0 tx=0x7f7dd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:33.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:33.981+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7de00b4570 con 0x7f7de01469b0 2024-05-10T11:16:34.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.210+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7de006a220 con 0x7f7de01469b0 2024-05-10T11:16:34.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.828+0000 7f7dc7fff640 1 -- 172.21.15.66:0/3013187368 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v42) ==== 174+0+0 (secure 0 0 0) 0x7f7de0163e70 con 0x7f7de01469b0 2024-05-10T11:16:34.828 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 11 and data pool 12 2024-05-10T11:16:34.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.832+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7dcc0762d0 msgr2=0x7f7dcc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:34.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.832+0000 7f7de619d640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7dcc0762d0 0x7f7dcc078790 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7de01f93e0 tx=0x7f7dd0008040 comp rx=0 tx=0).stop 2024-05-10T11:16:34.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.832+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 msgr2=0x7f7de01f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:34.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.832+0000 7f7de619d640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 0x7f7de01f50c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7de0073060 tx=0x7f7dd800aee0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.833+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 shutdown_connections 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.833+0000 7f7de619d640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7dcc0762d0 0x7f7dcc078790 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.833+0000 7f7de619d640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de01469b0 0x7f7de01f50c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.833+0000 7f7de619d640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7de00b4b10 0x7f7de0146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.833+0000 7f7de619d640 1 --2- 172.21.15.66:0/3013187368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dc8004800 0x7f7de01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.833+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 >> 172.21.15.66:0/3013187368 conn(0x7f7de00b3c60 msgr2=0x7f7de006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:34.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.834+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 shutdown_connections 2024-05-10T11:16:34.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.834+0000 7f7de619d640 1 -- 172.21.15.66:0/3013187368 wait complete. 2024-05-10T11:16:34.867 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:16:34.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.975+0000 7f1a5b464640 1 Processor -- start 2024-05-10T11:16:34.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.975+0000 7f1a5b464640 1 -- start start 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a5b464640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415f3b0 0x7f1a540d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a5b464640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1a5415f790 0x7f1a540d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a5b464640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a540d30b0 con 0x7f1a540d5d30 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a5b464640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1a540d3390 con 0x7f1a5415f790 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a5b464640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1a540c8c80 con 0x7f1a5415f3b0 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59a01640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1a540d5d30 0x7f1a540c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:57352/0 (socket says 172.21.15.66:57352) 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59a01640 1 -- 172.21.15.66:0/2177212592 learned_addr learned my addr 172.21.15.66:0/2177212592 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59200640 1 --2- 172.21.15.66:0/2177212592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415f3b0 0x7f1a540d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a589ff640 1 --2- 172.21.15.66:0/2177212592 >> v2:172.21.15.190:3300/0 conn(0x7f1a5415f790 0x7f1a540d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a53fff640 1 -- 172.21.15.66:0/2177212592 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4074755690 0 0) 0x7f1a540d30b0 con 0x7f1a540d5d30 2024-05-10T11:16:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a53fff640 1 -- 172.21.15.66:0/2177212592 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a3c003520 con 0x7f1a540d5d30 2024-05-10T11:16:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59200640 1 -- 172.21.15.66:0/2177212592 >> v2:172.21.15.190:3300/0 conn(0x7f1a5415f790 msgr2=0x7f1a540d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59200640 1 --2- 172.21.15.66:0/2177212592 >> v2:172.21.15.190:3300/0 conn(0x7f1a5415f790 0x7f1a540d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59200640 1 -- 172.21.15.66:0/2177212592 >> v1:172.21.15.66:6789/0 conn(0x7f1a540d5d30 legacy=0x7f1a540c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.976+0000 7f1a59200640 1 -- 172.21.15.66:0/2177212592 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a540c8f60 con 0x7f1a5415f3b0 2024-05-10T11:16:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.977+0000 7f1a59200640 1 --2- 172.21.15.66:0/2177212592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415f3b0 0x7f1a540d36f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009d90 tx=0x7f1a4c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b7a2847540254c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.977+0000 7f1a53fff640 1 -- 172.21.15.66:0/2177212592 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c007740 con 0x7f1a5415f3b0 2024-05-10T11:16:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.977+0000 7f1a53fff640 1 -- 172.21.15.66:0/2177212592 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0078e0 con 0x7f1a5415f3b0 2024-05-10T11:16:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.977+0000 7f1a53fff640 1 -- 172.21.15.66:0/2177212592 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c007c90 con 0x7f1a5415f3b0 2024-05-10T11:16:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 -- 172.21.15.66:0/2177212592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415f3b0 msgr2=0x7f1a540d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 --2- 172.21.15.66:0/2177212592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415f3b0 0x7f1a540d36f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009d90 tx=0x7f1a4c02a660 comp rx=0 tx=0).stop 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 -- 172.21.15.66:0/2177212592 shutdown_connections 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 --2- 172.21.15.66:0/2177212592 >> v2:172.21.15.190:3300/0 conn(0x7f1a5415f790 0x7f1a540d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 --2- 172.21.15.66:0/2177212592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415f3b0 0x7f1a540d36f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 -- 172.21.15.66:0/2177212592 >> 172.21.15.66:0/2177212592 conn(0x7f1a540d5130 msgr2=0x7f1a540d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 -- 172.21.15.66:0/2177212592 shutdown_connections 2024-05-10T11:16:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.978+0000 7f1a5b464640 1 -- 172.21.15.66:0/2177212592 wait complete. 2024-05-10T11:16:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.979+0000 7f1a5b464640 1 Processor -- start 2024-05-10T11:16:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 -- start start 2024-05-10T11:16:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a540d5d30 0x7f1a54162300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 0x7f1a540cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415c230 0x7f1a54159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a540d0e60 con 0x7f1a5415f3b0 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1a540d0ce0 con 0x7f1a540d5d30 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a5b464640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1a540d0fe0 con 0x7f1a5415c230 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a589ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 0x7f1a540cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a589ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 0x7f1a540cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52076/0 (socket says 172.21.15.66:52076) 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.980+0000 7f1a589ff640 1 -- 172.21.15.66:0/1666460564 learned_addr learned my addr 172.21.15.66:0/1666460564 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a59200640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a540d5d30 0x7f1a54162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a59a01640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415c230 0x7f1a54159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a589ff640 1 -- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415c230 msgr2=0x7f1a54159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a589ff640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415c230 0x7f1a54159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a589ff640 1 -- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a540d5d30 msgr2=0x7f1a54162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a589ff640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a540d5d30 0x7f1a54162300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a589ff640 1 -- 172.21.15.66:0/1666460564 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a54161260 con 0x7f1a5415f3b0 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a589ff640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 0x7f1a540cd400 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e840 tx=0x7f1a4800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48017070 con 0x7f1a5415f3b0 2024-05-10T11:16:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4800c940 con 0x7f1a5415f3b0 2024-05-10T11:16:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800cd10 con 0x7f1a5415f3b0 2024-05-10T11:16:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a54161540 con 0x7f1a5415f3b0 2024-05-10T11:16:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.981+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a54161b00 con 0x7f1a5415f3b0 2024-05-10T11:16:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.982+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5406a220 con 0x7f1a5415f3b0 2024-05-10T11:16:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.983+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a4801a070 con 0x7f1a5415f3b0 2024-05-10T11:16:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.983+0000 7f1a51ffb640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1a400762d0 0x7f1a40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.983+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f1a48097a50 con 0x7f1a5415f3b0 2024-05-10T11:16:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.984+0000 7f1a59200640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1a400762d0 0x7f1a40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.984+0000 7f1a59200640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1a400762d0 0x7f1a40078790 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c034000 tx=0x7f1a4c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:34.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:34.988+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1a480611a0 con 0x7f1a5415f3b0 2024-05-10T11:16:35.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.178+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a541e9ae0 con 0x7f1a5415f3b0 2024-05-10T11:16:35.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.180+0000 7f1a51ffb640 1 -- 172.21.15.66:0/1666460564 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16958 (secure 0 0 0) 0x7f1a48060aa0 con 0x7f1a5415f3b0 2024-05-10T11:16:35.180 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:35.181 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":75,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:16:34.212423+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:16:31.864172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T11:16:33.168965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:16:35.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1a400762d0 msgr2=0x7f1a40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1a400762d0 0x7f1a40078790 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c034000 tx=0x7f1a4c02f000 comp rx=0 tx=0).stop 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 msgr2=0x7f1a540cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 0x7f1a540cd400 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e840 tx=0x7f1a4800ed00 comp rx=0 tx=0).stop 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 shutdown_connections 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1a400762d0 0x7f1a40078790 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a5415c230 0x7f1a54159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5415f3b0 0x7f1a540cd400 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 --2- 172.21.15.66:0/1666460564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a540d5d30 0x7f1a54162300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 >> 172.21.15.66:0/1666460564 conn(0x7f1a540d5130 msgr2=0x7f1a541e9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 shutdown_connections 2024-05-10T11:16:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.182+0000 7f1a5b464640 1 -- 172.21.15.66:0/1666460564 wait complete. 2024-05-10T11:16:35.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:16:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.297+0000 7f831e72b640 1 Processor -- start 2024-05-10T11:16:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831e72b640 1 -- start start 2024-05-10T11:16:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831e72b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f831815f3b0 0x7f83180d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831e72b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83180d5d30 0x7f83180d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831e72b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83180d30b0 con 0x7f831815f790 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831e72b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f83180d3390 con 0x7f83180d5d30 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831e72b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f83180c8c80 con 0x7f831815f3b0 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.298+0000 7f831ccc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83180d5d30 0x7f83180d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f831ccc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83180d5d30 0x7f83180d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52084/0 (socket says 172.21.15.66:52084) 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f831ccc8640 1 -- 172.21.15.66:0/1250284007 learned_addr learned my addr 172.21.15.66:0/1250284007 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f8317fff640 1 --2- 172.21.15.66:0/1250284007 >> v2:172.21.15.190:3300/0 conn(0x7f831815f3b0 0x7f83180d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f831ccc8640 1 -- 172.21.15.66:0/1250284007 >> v2:172.21.15.190:3300/0 conn(0x7f831815f3b0 msgr2=0x7f83180d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f831ccc8640 1 --2- 172.21.15.66:0/1250284007 >> v2:172.21.15.190:3300/0 conn(0x7f831815f3b0 0x7f83180d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f831ccc8640 1 -- 172.21.15.66:0/1250284007 >> v1:172.21.15.190:6789/0 conn(0x7f831815f790 legacy=0x7f83180c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.299+0000 7f831ccc8640 1 -- 172.21.15.66:0/1250284007 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83180c8f60 con 0x7f83180d5d30 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831ccc8640 1 --2- 172.21.15.66:0/1250284007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83180d5d30 0x7f83180d3c30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f831808e820 tx=0x7f831002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24afeb7ea0a9a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f8316ffd640 1 -- 172.21.15.66:0/1250284007 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310036070 con 0x7f83180d5d30 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f8316ffd640 1 -- 172.21.15.66:0/1250284007 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8310031600 con 0x7f83180d5d30 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f8316ffd640 1 -- 172.21.15.66:0/1250284007 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83100319d0 con 0x7f83180d5d30 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 -- 172.21.15.66:0/1250284007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83180d5d30 msgr2=0x7f83180d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 --2- 172.21.15.66:0/1250284007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83180d5d30 0x7f83180d3c30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f831808e820 tx=0x7f831002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 -- 172.21.15.66:0/1250284007 shutdown_connections 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 --2- 172.21.15.66:0/1250284007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83180d5d30 0x7f83180d3c30 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 --2- 172.21.15.66:0/1250284007 >> v2:172.21.15.190:3300/0 conn(0x7f831815f3b0 0x7f83180d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 -- 172.21.15.66:0/1250284007 >> 172.21.15.66:0/1250284007 conn(0x7f83180d5130 msgr2=0x7f83180d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 -- 172.21.15.66:0/1250284007 shutdown_connections 2024-05-10T11:16:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.300+0000 7f831e72b640 1 -- 172.21.15.66:0/1250284007 wait complete. 2024-05-10T11:16:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.301+0000 7f831e72b640 1 Processor -- start 2024-05-10T11:16:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 -- start start 2024-05-10T11:16:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180d5d30 0x7f831814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 0x7f83180b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b3fb0 0x7f831814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83180d0e60 con 0x7f831815f3b0 2024-05-10T11:16:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f83180d0ce0 con 0x7f83180b3fb0 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.302+0000 7f831e72b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f83180d0fe0 con 0x7f83180d5d30 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 0x7f83180b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 0x7f83180b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52098/0 (socket says 172.21.15.66:52098) 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 -- 172.21.15.66:0/2981735868 learned_addr learned my addr 172.21.15.66:0/2981735868 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f831ccc8640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b3fb0 0x7f831814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f8317fff640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180d5d30 0x7f831814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 -- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180d5d30 msgr2=0x7f831814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180d5d30 0x7f831814f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 -- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b3fb0 msgr2=0x7f831814cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b3fb0 0x7f831814cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 -- 172.21.15.66:0/2981735868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831814fdb0 con 0x7f831815f3b0 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f831ccc8640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b3fb0 0x7f831814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f83177fe640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 0x7f83180b3a70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f830c00b3c0 tx=0x7f830c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:35.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c011830 con 0x7f831815f3b0 2024-05-10T11:16:35.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c016070 con 0x7f831815f3b0 2024-05-10T11:16:35.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83180b47f0 con 0x7f831815f3b0 2024-05-10T11:16:35.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c011c10 con 0x7f831815f3b0 2024-05-10T11:16:35.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.303+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83180b4db0 con 0x7f831815f3b0 2024-05-10T11:16:35.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.304+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831806a220 con 0x7f831815f3b0 2024-05-10T11:16:35.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.305+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f830c01b460 con 0x7f831815f3b0 2024-05-10T11:16:35.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.305+0000 7f8314ff9640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8304076300 0x7f83040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.305+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f830c0973b0 con 0x7f831815f3b0 2024-05-10T11:16:35.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.306+0000 7f8317fff640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8304076300 0x7f83040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.306+0000 7f8317fff640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8304076300 0x7f83040787c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8308006fd0 tx=0x7f8308008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:35.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.310+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f830c060b80 con 0x7f831815f3b0 2024-05-10T11:16:35.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-10T11:16:35.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.503+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83180c8760 con 0x7f831815f3b0 2024-05-10T11:16:35.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.504+0000 7f8314ff9640 1 -- 172.21.15.66:0/2981735868 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16958 (secure 0 0 0) 0x7f830c060480 con 0x7f831815f3b0 2024-05-10T11:16:35.505 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:35.505 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":75,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:16:34.212423+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:16:31.864172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T11:16:33.168965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8304076300 msgr2=0x7f83040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8304076300 0x7f83040787c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8308006fd0 tx=0x7f8308008040 comp rx=0 tx=0).stop 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 msgr2=0x7f83180b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 0x7f83180b3a70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f830c00b3c0 tx=0x7f830c00b880 comp rx=0 tx=0).stop 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 shutdown_connections 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8304076300 0x7f83040787c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b3fb0 0x7f831814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831815f3b0 0x7f83180b3a70 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 --2- 172.21.15.66:0/2981735868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180d5d30 0x7f831814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.506+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 >> 172.21.15.66:0/2981735868 conn(0x7f83180d5130 msgr2=0x7f83180ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:35.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.507+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 shutdown_connections 2024-05-10T11:16:35.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.507+0000 7f831e72b640 1 -- 172.21.15.66:0/2981735868 wait complete. 2024-05-10T11:16:35.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:16:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.624+0000 7fd421475640 1 Processor -- start 2024-05-10T11:16:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 -- start start 2024-05-10T11:16:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0cf3e0 0x7fd41c0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd41c0cd500 0x7fd41c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd41c0b2dd0 0x7fd41c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c06e720 con 0x7fd41c0cd500 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c06de80 con 0x7fd41c0b2dd0 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.625+0000 7fd421475640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c06e160 con 0x7fd41c0cf3e0 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd41c0cd500 0x7fd41c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd41c0cd500 0x7fd41c0cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52110/0 (socket says 172.21.15.66:52110) 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 -- 172.21.15.66:0/3681789315 learned_addr learned my addr 172.21.15.66:0/3681789315 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41affd640 1 --2- 172.21.15.66:0/3681789315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0cf3e0 0x7fd41c0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41b7fe640 1 --2- 172.21.15.66:0/3681789315 >> v2:172.21.15.190:3300/0 conn(0x7fd41c0b2dd0 0x7fd41c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 -- 172.21.15.66:0/3681789315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0cf3e0 msgr2=0x7fd41c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 --2- 172.21.15.66:0/3681789315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0cf3e0 0x7fd41c0cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 -- 172.21.15.66:0/3681789315 >> v2:172.21.15.190:3300/0 conn(0x7fd41c0b2dd0 msgr2=0x7fd41c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 --2- 172.21.15.66:0/3681789315 >> v2:172.21.15.190:3300/0 conn(0x7fd41c0b2dd0 0x7fd41c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41a7fc640 1 -- 172.21.15.66:0/3681789315 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c06e440 con 0x7fd41c0cd500 2024-05-10T11:16:35.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.626+0000 7fd41b7fe640 1 --2- 172.21.15.66:0/3681789315 >> v2:172.21.15.190:3300/0 conn(0x7fd41c0b2dd0 0x7fd41c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:35.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd41a7fc640 1 --2- 172.21.15.66:0/3681789315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cfe00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06ee80 tx=0x7fd41002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba90f24119e057ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:35.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd419ffb640 1 -- 172.21.15.66:0/3681789315 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410037070 con 0x7fd41c0cd500 2024-05-10T11:16:35.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd419ffb640 1 -- 172.21.15.66:0/3681789315 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd410032440 con 0x7fd41c0cd500 2024-05-10T11:16:35.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd419ffb640 1 -- 172.21.15.66:0/3681789315 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410032810 con 0x7fd41c0cd500 2024-05-10T11:16:35.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 -- 172.21.15.66:0/3681789315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 msgr2=0x7fd41c0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 --2- 172.21.15.66:0/3681789315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cfe00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06ee80 tx=0x7fd41002a1e0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 -- 172.21.15.66:0/3681789315 shutdown_connections 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 --2- 172.21.15.66:0/3681789315 >> v2:172.21.15.190:3300/0 conn(0x7fd41c0b2dd0 0x7fd41c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 --2- 172.21.15.66:0/3681789315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cfe00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 --2- 172.21.15.66:0/3681789315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0cf3e0 0x7fd41c0cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 -- 172.21.15.66:0/3681789315 >> 172.21.15.66:0/3681789315 conn(0x7fd41c0d2eb0 msgr2=0x7fd41c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 -- 172.21.15.66:0/3681789315 shutdown_connections 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.627+0000 7fd421475640 1 -- 172.21.15.66:0/3681789315 wait complete. 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.629+0000 7fd421475640 1 Processor -- start 2024-05-10T11:16:35.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.629+0000 7fd421475640 1 -- start start 2024-05-10T11:16:35.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.629+0000 7fd421475640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0b2dd0 0x7fd41c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.629+0000 7fd421475640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd421475640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c0cf3e0 0x7fd41c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd421475640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b37a0 con 0x7fd41c0cd500 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd421475640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b4510 con 0x7fd41c0cf3e0 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd421475640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0b3920 con 0x7fd41c0b2dd0 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52120/0 (socket says 172.21.15.66:52120) 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 -- 172.21.15.66:0/1272135800 learned_addr learned my addr 172.21.15.66:0/1272135800 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41b7fe640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c0cf3e0 0x7fd41c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41affd640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0b2dd0 0x7fd41c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 -- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0b2dd0 msgr2=0x7fd41c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0b2dd0 0x7fd41c1533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 -- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c0cf3e0 msgr2=0x7fd41c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c0cf3e0 0x7fd41c15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:35.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 -- 172.21.15.66:0/1272135800 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0cc720 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41b7fe640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c0cf3e0 0x7fd41c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd41a7fc640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cbec0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd410000c00 tx=0x7fd4100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410041070 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41003c870 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c0c7870 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410037040 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.630+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c0c7e30 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.632+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c06a220 con 0x7fd41c0cd500 2024-05-10T11:16:35.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.632+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd410044070 con 0x7fd41c0cd500 2024-05-10T11:16:35.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.633+0000 7fd4037fe640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4080762d0 0x7fd408078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:35.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.633+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd4100b8270 con 0x7fd41c0cd500 2024-05-10T11:16:35.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.633+0000 7fd41affd640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4080762d0 0x7fd408078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:35.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.634+0000 7fd41affd640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4080762d0 0x7fd408078790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd40c006fd0 tx=0x7fd40c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:35.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.637+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd410081a40 con 0x7fd41c0cd500 2024-05-10T11:16:35.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:35.869+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd41c070560 con 0x7fd41c0cd500 2024-05-10T11:16:36.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.863+0000 7fd4037fe640 1 -- 172.21.15.66:0/1272135800 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7fd410081340 con 0x7fd41c0cd500 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4080762d0 msgr2=0x7fd408078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4080762d0 0x7fd408078790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd40c006fd0 tx=0x7fd40c008040 comp rx=0 tx=0).stop 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 msgr2=0x7fd41c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cbec0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd410000c00 tx=0x7fd4100046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 shutdown_connections 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4080762d0 0x7fd408078790 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c0cf3e0 0x7fd41c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd41c0cd500 0x7fd41c0cbec0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 --2- 172.21.15.66:0/1272135800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd41c0b2dd0 0x7fd41c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 >> 172.21.15.66:0/1272135800 conn(0x7fd41c0d2eb0 msgr2=0x7fd41c075920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:36.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 shutdown_connections 2024-05-10T11:16:36.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.866+0000 7fd421475640 1 -- 172.21.15.66:0/1272135800 wait complete. 2024-05-10T11:16:36.880 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:16:36.881 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:16:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.994+0000 7f9599454640 1 Processor -- start 2024-05-10T11:16:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.994+0000 7f9599454640 1 -- start start 2024-05-10T11:16:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9599454640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 0x7f95940d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9599454640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f95940d3950 0x7f95940d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9599454640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95940d4190 con 0x7f9594162ce0 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9599454640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f95940cfc40 con 0x7f95940d3950 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9599454640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f95940d3eb0 con 0x7f9594162900 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9592ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 0x7f95940d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f95937fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f95940d3950 0x7f95940d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9592ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 0x7f95940d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:38652/0 (socket says 172.21.15.66:38652) 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f9592ffd640 1 -- 172.21.15.66:0/221979286 learned_addr learned my addr 172.21.15.66:0/221979286 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.995+0000 7f958bfff640 1 --1- 172.21.15.66:0/221979286 >> v1:172.21.15.190:6789/0 conn(0x7f9594162ce0 0x7f95940b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:57228/0 (socket says 172.21.15.66:57228) 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.996+0000 7f9592ffd640 1 -- 172.21.15.66:0/221979286 >> v2:172.21.15.190:3300/0 conn(0x7f95940d3950 msgr2=0x7f95940d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.996+0000 7f9592ffd640 1 --2- 172.21.15.66:0/221979286 >> v2:172.21.15.190:3300/0 conn(0x7f95940d3950 0x7f95940d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.996+0000 7f9592ffd640 1 -- 172.21.15.66:0/221979286 >> v1:172.21.15.190:6789/0 conn(0x7f9594162ce0 legacy=0x7f95940b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.996+0000 7f9592ffd640 1 -- 172.21.15.66:0/221979286 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95940cfee0 con 0x7f9594162900 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.996+0000 7f95937fe640 1 --2- 172.21.15.66:0/221979286 >> v2:172.21.15.190:3300/0 conn(0x7f95940d3950 0x7f95940d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9592ffd640 1 --2- 172.21.15.66:0/221979286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 0x7f95940d3410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9584009870 tx=0x7f958402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e71c020023225332 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f95927fc640 1 -- 172.21.15.66:0/221979286 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584037070 con 0x7f9594162900 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f95927fc640 1 -- 172.21.15.66:0/221979286 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9584032440 con 0x7f9594162900 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f95927fc640 1 -- 172.21.15.66:0/221979286 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584032810 con 0x7f9594162900 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 -- 172.21.15.66:0/221979286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 msgr2=0x7f95940d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:36.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 --2- 172.21.15.66:0/221979286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 0x7f95940d3410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9584009870 tx=0x7f958402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 -- 172.21.15.66:0/221979286 shutdown_connections 2024-05-10T11:16:36.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 --2- 172.21.15.66:0/221979286 >> v2:172.21.15.190:3300/0 conn(0x7f95940d3950 0x7f95940d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 --2- 172.21.15.66:0/221979286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162900 0x7f95940d3410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:36.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 -- 172.21.15.66:0/221979286 >> 172.21.15.66:0/221979286 conn(0x7f959409e430 msgr2=0x7f95940d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:36.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 -- 172.21.15.66:0/221979286 shutdown_connections 2024-05-10T11:16:36.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.997+0000 7f9599454640 1 -- 172.21.15.66:0/221979286 wait complete. 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 Processor -- start 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 -- start start 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 0x7f95940b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9594162900 0x7f95940ba530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162ce0 0x7f9594155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95940b4300 con 0x7f95940d3950 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f95940b4180 con 0x7f9594162900 2024-05-10T11:16:37.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:36.999+0000 7f9599454640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f95940b4ff0 con 0x7f9594162ce0 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 0x7f95940b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 0x7f95940b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52126/0 (socket says 172.21.15.66:52126) 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 -- 172.21.15.66:0/3022460378 learned_addr learned my addr 172.21.15.66:0/3022460378 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f95937fe640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162ce0 0x7f9594155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f958bfff640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9594162900 0x7f95940ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 -- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162ce0 msgr2=0x7f9594155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162ce0 0x7f9594155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 -- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9594162900 msgr2=0x7f95940ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9594162900 0x7f95940ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 -- 172.21.15.66:0/3022460378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9594155bc0 con 0x7f95940d3950 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f95937fe640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162ce0 0x7f9594155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:37.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f958bfff640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9594162900 0x7f95940ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:37.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9592ffd640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 0x7f95940b7c60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9584009870 tx=0x7f95840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:37.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584041070 con 0x7f95940d3950 2024-05-10T11:16:37.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958403c890 con 0x7f95940d3950 2024-05-10T11:16:37.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95940b8f30 con 0x7f95940d3950 2024-05-10T11:16:37.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584037040 con 0x7f95940d3950 2024-05-10T11:16:37.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.000+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95940b8690 con 0x7f95940d3950 2024-05-10T11:16:37.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.002+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959406a220 con 0x7f95940d3950 2024-05-10T11:16:37.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.002+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9584044070 con 0x7f95940d3950 2024-05-10T11:16:37.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.002+0000 7f958b7fe640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9574076300 0x7f95740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.003+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f95840b8080 con 0x7f95940d3950 2024-05-10T11:16:37.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.003+0000 7f958bfff640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9574076300 0x7f95740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.003+0000 7f958bfff640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9574076300 0x7f95740787c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f957c007fd0 tx=0x7f957c007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:37.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.007+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9594155bc0 con 0x7f95940d3950 2024-05-10T11:16:37.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.236+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f959409e840 con 0x7f95940d3950 2024-05-10T11:16:37.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.870+0000 7f958b7fe640 1 -- 172.21.15.66:0/3022460378 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f95840818e0 con 0x7f95940d3950 2024-05-10T11:16:37.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.872+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9574076300 msgr2=0x7f95740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:37.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.872+0000 7f9599454640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9574076300 0x7f95740787c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f957c007fd0 tx=0x7f957c007d60 comp rx=0 tx=0).stop 2024-05-10T11:16:37.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.872+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 msgr2=0x7f95940b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:37.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.872+0000 7f9599454640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 0x7f95940b7c60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9584009870 tx=0x7f95840046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 shutdown_connections 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9574076300 0x7f95740787c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9594162ce0 0x7f9594155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9594162900 0x7f95940ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 --2- 172.21.15.66:0/3022460378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95940d3950 0x7f95940b7c60 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 >> 172.21.15.66:0/3022460378 conn(0x7f959409e430 msgr2=0x7f95940d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 shutdown_connections 2024-05-10T11:16:37.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.873+0000 7f9599454640 1 -- 172.21.15.66:0/3022460378 wait complete. 2024-05-10T11:16:37.886 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:16:37.886 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:37.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.993+0000 7fe67ebef640 1 Processor -- start 2024-05-10T11:16:37.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.993+0000 7fe67ebef640 1 -- start start 2024-05-10T11:16:37.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67ebef640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6781608b0 0x7fe6780d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67ebef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780d1230 0x7fe6780d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67ebef640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6780b2900 0x7fe6780b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:37.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67ebef640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe678160c90 con 0x7fe6781608b0 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67ebef640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780ce5f0 con 0x7fe6780b2900 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67ebef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780ce8d0 con 0x7fe6780d1230 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6781608b0 0x7fe6780d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6781608b0 0x7fe6780d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52138/0 (socket says 172.21.15.66:52138) 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 -- 172.21.15.66:0/3545946174 learned_addr learned my addr 172.21.15.66:0/3545946174 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe66ffff640 1 --2- 172.21.15.66:0/3545946174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780d1230 0x7fe6780d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67d18c640 1 --2- 172.21.15.66:0/3545946174 >> v2:172.21.15.190:3300/0 conn(0x7fe6780b2900 0x7fe6780b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 -- 172.21.15.66:0/3545946174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780d1230 msgr2=0x7fe6780d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 --2- 172.21.15.66:0/3545946174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780d1230 0x7fe6780d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 -- 172.21.15.66:0/3545946174 >> v2:172.21.15.190:3300/0 conn(0x7fe6780b2900 msgr2=0x7fe6780b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 --2- 172.21.15.66:0/3545946174 >> v2:172.21.15.190:3300/0 conn(0x7fe6780b2900 0x7fe6780b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67c98b640 1 -- 172.21.15.66:0/3545946174 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780cebb0 con 0x7fe6781608b0 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.994+0000 7fe67d18c640 1 --2- 172.21.15.66:0/3545946174 >> v2:172.21.15.190:3300/0 conn(0x7fe6780b2900 0x7fe6780b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:37.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.995+0000 7fe67c98b640 1 --2- 172.21.15.66:0/3545946174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6781608b0 0x7fe6780d0cf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe6780c64b0 tx=0x7fe67402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c91c6197a8d013 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:37.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.995+0000 7fe66f7fe640 1 -- 172.21.15.66:0/3545946174 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674036070 con 0x7fe6781608b0 2024-05-10T11:16:37.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.995+0000 7fe66f7fe640 1 -- 172.21.15.66:0/3545946174 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe674031600 con 0x7fe6781608b0 2024-05-10T11:16:37.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.995+0000 7fe66f7fe640 1 -- 172.21.15.66:0/3545946174 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740319d0 con 0x7fe6781608b0 2024-05-10T11:16:37.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 -- 172.21.15.66:0/3545946174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6781608b0 msgr2=0x7fe6780d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 --2- 172.21.15.66:0/3545946174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6781608b0 0x7fe6780d0cf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe6780c64b0 tx=0x7fe67402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 -- 172.21.15.66:0/3545946174 shutdown_connections 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 --2- 172.21.15.66:0/3545946174 >> v2:172.21.15.190:3300/0 conn(0x7fe6780b2900 0x7fe6780b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 --2- 172.21.15.66:0/3545946174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780d1230 0x7fe6780d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 --2- 172.21.15.66:0/3545946174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6781608b0 0x7fe6780d0cf0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 -- 172.21.15.66:0/3545946174 >> 172.21.15.66:0/3545946174 conn(0x7fe6780d2df0 msgr2=0x7fe6780d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 -- 172.21.15.66:0/3545946174 shutdown_connections 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.996+0000 7fe67ebef640 1 -- 172.21.15.66:0/3545946174 wait complete. 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.997+0000 7fe67ebef640 1 Processor -- start 2024-05-10T11:16:37.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.997+0000 7fe67ebef640 1 -- start start 2024-05-10T11:16:38.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67ebef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b2900 0x7fe6780c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67ebef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 0x7fe6780c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67ebef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6781608b0 0x7fe6780d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67ebef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d1f10 con 0x7fe6780d1230 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67ebef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d1d90 con 0x7fe6781608b0 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67ebef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780b32d0 con 0x7fe6780b2900 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 0x7fe6780c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 0x7fe6780c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52144/0 (socket says 172.21.15.66:52144) 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 -- 172.21.15.66:0/869431199 learned_addr learned my addr 172.21.15.66:0/869431199 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67d18c640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6781608b0 0x7fe6780d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe67c98b640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b2900 0x7fe6780c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 -- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b2900 msgr2=0x7fe6780c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b2900 0x7fe6780c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 -- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6781608b0 msgr2=0x7fe6780d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6781608b0 0x7fe6780d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.998+0000 7fe66ffff640 1 -- 172.21.15.66:0/869431199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67809f0e0 con 0x7fe6780d1230 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.999+0000 7fe66ffff640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 0x7fe6780c98c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe66800d800 tx=0x7fe66800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.999+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800b6c0 con 0x7fe6780d1230 2024-05-10T11:16:38.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.999+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe668019070 con 0x7fe6780d1230 2024-05-10T11:16:38.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.999+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6781f6c00 con 0x7fe6780d1230 2024-05-10T11:16:38.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.999+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800ba80 con 0x7fe6780d1230 2024-05-10T11:16:38.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:37.999+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67809f660 con 0x7fe6780d1230 2024-05-10T11:16:38.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.000+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67806a220 con 0x7fe6780d1230 2024-05-10T11:16:38.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.001+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe66800bc20 con 0x7fe6780d1230 2024-05-10T11:16:38.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.001+0000 7fe66d7fa640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6640762d0 0x7fe664078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.001+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fe668097b10 con 0x7fe6780d1230 2024-05-10T11:16:38.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.002+0000 7fe67c98b640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6640762d0 0x7fe664078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.002+0000 7fe67c98b640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6640762d0 0x7fe664078790 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe674033000 tx=0x7fe674009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.006+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe668060c90 con 0x7fe6780d1230 2024-05-10T11:16:38.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.234+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6780b0a90 con 0x7fe6780d1230 2024-05-10T11:16:38.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.235+0000 7fe66d7fa640 1 -- 172.21.15.66:0/869431199 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5186 (secure 0 0 0) 0x7fe668064f90 con 0x7fe6780d1230 2024-05-10T11:16:38.235 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:38.235 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:37.237701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/1361798984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1361798984},{"type":"v1","addr":"172.21.15.66:6835","nonce":1361798984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6276,"qdb_cluster":[6276]},"id":5}]} 2024-05-10T11:16:38.235 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 46 2024-05-10T11:16:38.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.236+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6640762d0 msgr2=0x7fe664078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.236+0000 7fe67ebef640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6640762d0 0x7fe664078790 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe674033000 tx=0x7fe674009000 comp rx=0 tx=0).stop 2024-05-10T11:16:38.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 msgr2=0x7fe6780c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 0x7fe6780c98c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe66800d800 tx=0x7fe66800dcc0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 shutdown_connections 2024-05-10T11:16:38.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6640762d0 0x7fe664078790 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6781608b0 0x7fe6780d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6780d1230 0x7fe6780c98c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 --2- 172.21.15.66:0/869431199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b2900 0x7fe6780c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 >> 172.21.15.66:0/869431199 conn(0x7fe6780d2df0 msgr2=0x7fe67815f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 shutdown_connections 2024-05-10T11:16:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.237+0000 7fe67ebef640 1 -- 172.21.15.66:0/869431199 wait complete. 2024-05-10T11:16:38.248 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:16:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.351+0000 7f7394938640 1 Processor -- start 2024-05-10T11:16:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.351+0000 7f7394938640 1 -- start start 2024-05-10T11:16:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.352+0000 7f7394938640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f739015f3b0 0x7f73900d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.352+0000 7f7394938640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f739015f790 0x7f73900d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.352+0000 7f7394938640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900d30b0 con 0x7f73900d5d30 2024-05-10T11:16:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.352+0000 7f7394938640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f73900d3390 con 0x7f739015f790 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.352+0000 7f7394938640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f73900c8c80 con 0x7f739015f3b0 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f739015f790 0x7f73900d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f739015f790 0x7f73900d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52160/0 (socket says 172.21.15.66:52160) 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 -- 172.21.15.66:0/3044759191 learned_addr learned my addr 172.21.15.66:0/3044759191 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 -- 172.21.15.66:0/3044759191 >> v2:172.21.15.190:3300/0 conn(0x7f739015f3b0 msgr2=0x7f73900d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738e59c640 1 --2- 172.21.15.66:0/3044759191 >> v2:172.21.15.190:3300/0 conn(0x7f739015f3b0 0x7f73900d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 --2- 172.21.15.66:0/3044759191 >> v2:172.21.15.190:3300/0 conn(0x7f739015f3b0 0x7f73900d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 -- 172.21.15.66:0/3044759191 >> v1:172.21.15.190:6789/0 conn(0x7f73900d5d30 legacy=0x7f73900c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.353+0000 7f738dd9b640 1 -- 172.21.15.66:0/3044759191 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900c8f60 con 0x7f739015f790 2024-05-10T11:16:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.354+0000 7f738dd9b640 1 --2- 172.21.15.66:0/3044759191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f790 0x7f73900d3c30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f739008e820 tx=0x7f738402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3fd95accb23929 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.354+0000 7f738d59a640 1 -- 172.21.15.66:0/3044759191 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384037070 con 0x7f739015f790 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.354+0000 7f738d59a640 1 -- 172.21.15.66:0/3044759191 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7384032440 con 0x7f739015f790 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.354+0000 7f738d59a640 1 -- 172.21.15.66:0/3044759191 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384032810 con 0x7f739015f790 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.354+0000 7f7394938640 1 -- 172.21.15.66:0/3044759191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f790 msgr2=0x7f73900d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.354+0000 7f7394938640 1 --2- 172.21.15.66:0/3044759191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f790 0x7f73900d3c30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f739008e820 tx=0x7f738402a230 comp rx=0 tx=0).stop 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.355+0000 7f7394938640 1 -- 172.21.15.66:0/3044759191 shutdown_connections 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.355+0000 7f7394938640 1 --2- 172.21.15.66:0/3044759191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f790 0x7f73900d3c30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.355+0000 7f7394938640 1 --2- 172.21.15.66:0/3044759191 >> v2:172.21.15.190:3300/0 conn(0x7f739015f3b0 0x7f73900d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.355+0000 7f7394938640 1 -- 172.21.15.66:0/3044759191 >> 172.21.15.66:0/3044759191 conn(0x7f73900d5130 msgr2=0x7f73900d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.355+0000 7f7394938640 1 -- 172.21.15.66:0/3044759191 shutdown_connections 2024-05-10T11:16:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.355+0000 7f7394938640 1 -- 172.21.15.66:0/3044759191 wait complete. 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.356+0000 7f7394938640 1 Processor -- start 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.356+0000 7f7394938640 1 -- start start 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f7394938640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73900d5d30 0x7f73900b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f7394938640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 0x7f73900ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f7394938640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7390152530 0x7f73900c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f7394938640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f73900d0e60 con 0x7f739015f3b0 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f7394938640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f73900d0ce0 con 0x7f73900d5d30 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f7394938640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f73900d0fe0 con 0x7f7390152530 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 0x7f73900ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 0x7f73900ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52164/0 (socket says 172.21.15.66:52164) 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 -- 172.21.15.66:0/22834350 learned_addr learned my addr 172.21.15.66:0/22834350 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738ed9d640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7390152530 0x7f73900c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738e59c640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73900d5d30 0x7f73900b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 -- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7390152530 msgr2=0x7f73900c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7390152530 0x7f73900c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 -- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73900d5d30 msgr2=0x7f73900b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73900d5d30 0x7f73900b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 -- 172.21.15.66:0/22834350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900ce900 con 0x7f739015f3b0 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738ed9d640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7390152530 0x7f73900c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738e59c640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73900d5d30 0x7f73900b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.357+0000 7f738dd9b640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 0x7f73900ce3c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7384000c00 tx=0x7f73840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.358+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384041020 con 0x7f739015f3b0 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.358+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7384030970 con 0x7f739015f3b0 2024-05-10T11:16:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.358+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384037040 con 0x7f739015f3b0 2024-05-10T11:16:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.358+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73900cd4a0 con 0x7f739015f3b0 2024-05-10T11:16:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.358+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73900cda60 con 0x7f739015f3b0 2024-05-10T11:16:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.359+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f739006a220 con 0x7f739015f3b0 2024-05-10T11:16:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.359+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7384044020 con 0x7f739015f3b0 2024-05-10T11:16:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.360+0000 7f737effd640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f73700762d0 0x7f7370078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.360+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f73840b8140 con 0x7f739015f3b0 2024-05-10T11:16:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.360+0000 7f738e59c640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f73700762d0 0x7f7370078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.360+0000 7f738e59c640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f73700762d0 0x7f7370078790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f739006eaf0 tx=0x7f7380008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.364+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f738404b030 con 0x7f739015f3b0 2024-05-10T11:16:38.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.555+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73900baff0 con 0x7f739015f3b0 2024-05-10T11:16:38.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.556+0000 7f737effd640 1 -- 172.21.15.66:0/22834350 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16945 (secure 0 0 0) 0x7f73900ce900 con 0x7f739015f3b0 2024-05-10T11:16:38.557 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:38.557 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:16:35.829250+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:16:31.864172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T11:16:33.168965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:16:38.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.558+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f73700762d0 msgr2=0x7f7370078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.558+0000 7f7394938640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f73700762d0 0x7f7370078790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f739006eaf0 tx=0x7f7380008040 comp rx=0 tx=0).stop 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.558+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 msgr2=0x7f73900ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.558+0000 7f7394938640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 0x7f73900ce3c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7384000c00 tx=0x7f73840046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 shutdown_connections 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f73700762d0 0x7f7370078790 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7390152530 0x7f73900c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f739015f3b0 0x7f73900ce3c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 --2- 172.21.15.66:0/22834350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73900d5d30 0x7f73900b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 >> 172.21.15.66:0/22834350 conn(0x7f73900d5130 msgr2=0x7f73900d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 shutdown_connections 2024-05-10T11:16:38.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.559+0000 7f7394938640 1 -- 172.21.15.66:0/22834350 wait complete. 2024-05-10T11:16:38.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:16:38.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:16:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.674+0000 7f9b5cf24640 1 Processor -- start 2024-05-10T11:16:38.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.674+0000 7f9b5cf24640 1 -- start start 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b5cf24640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f790 0x7f9b580cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b5cf24640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b580d5d30 0x7f9b580d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b5cf24640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b580d30b0 con 0x7f9b5815f3b0 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b5cf24640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9b580d3390 con 0x7f9b580d5d30 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b5cf24640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580c8c80 con 0x7f9b5815f790 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b580d5d30 0x7f9b580d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b580d5d30 0x7f9b580d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52172/0 (socket says 172.21.15.66:52172) 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 -- 172.21.15.66:0/4289461243 learned_addr learned my addr 172.21.15.66:0/4289461243 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b4ffff640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f790 0x7f9b580cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 -- 172.21.15.66:0/4289461243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f790 msgr2=0x7f9b580cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f790 0x7f9b580cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 -- 172.21.15.66:0/4289461243 >> v1:172.21.15.66:6789/0 conn(0x7f9b5815f3b0 legacy=0x7f9b580d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b56d9d640 1 -- 172.21.15.66:0/4289461243 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580c8f60 con 0x7f9b580d5d30 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b55d9b640 1 -- 172.21.15.66:0/4289461243 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828960032 0 0) 0x7f9b580d30b0 con 0x7f9b5815f3b0 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.675+0000 7f9b4ffff640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f790 0x7f9b580cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.676+0000 7f9b56d9d640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b580d5d30 0x7f9b580d0210 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009e50 tx=0x7f9b5002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09158ab6a672cf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.676+0000 7f9b55d9b640 1 -- 172.21.15.66:0/4289461243 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50036070 con 0x7f9b580d5d30 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.676+0000 7f9b55d9b640 1 -- 172.21.15.66:0/4289461243 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50031600 con 0x7f9b580d5d30 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.676+0000 7f9b55d9b640 1 -- 172.21.15.66:0/4289461243 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500319d0 con 0x7f9b580d5d30 2024-05-10T11:16:38.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 -- 172.21.15.66:0/4289461243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b580d5d30 msgr2=0x7f9b580d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b580d5d30 0x7f9b580d0210 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009e50 tx=0x7f9b5002a710 comp rx=0 tx=0).stop 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 -- 172.21.15.66:0/4289461243 shutdown_connections 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b580d5d30 0x7f9b580d0210 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/4289461243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f790 0x7f9b580cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 -- 172.21.15.66:0/4289461243 >> 172.21.15.66:0/4289461243 conn(0x7f9b580d5130 msgr2=0x7f9b580d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 -- 172.21.15.66:0/4289461243 shutdown_connections 2024-05-10T11:16:38.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.677+0000 7f9b5cf24640 1 -- 172.21.15.66:0/4289461243 wait complete. 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.678+0000 7f9b5cf24640 1 Processor -- start 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.678+0000 7f9b5cf24640 1 -- start start 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5cf24640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b580d5d30 0x7f9b58155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5cf24640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f3b0 0x7f9b58154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5cf24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 0x7f9b5815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5cf24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580d3f80 con 0x7f9b581f5770 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5cf24640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580d3e00 con 0x7f9b580d5d30 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5cf24640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580ca770 con 0x7f9b5815f3b0 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 0x7f9b5815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 0x7f9b5815cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52178/0 (socket says 172.21.15.66:52178) 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 -- 172.21.15.66:0/3157740624 learned_addr learned my addr 172.21.15.66:0/3157740624 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:38.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b5659c640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b580d5d30 0x7f9b58155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b4ffff640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f3b0 0x7f9b58154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 -- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f3b0 msgr2=0x7f9b58154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f3b0 0x7f9b58154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 -- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b580d5d30 msgr2=0x7f9b58155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b580d5d30 0x7f9b58155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 -- 172.21.15.66:0/3157740624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b58154b90 con 0x7f9b581f5770 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.679+0000 7f9b56d9d640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 0x7f9b5815cb50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009f70 tx=0x7f9b50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.680+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5003f020 con 0x7f9b581f5770 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.680+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50037040 con 0x7f9b581f5770 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.680+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50036070 con 0x7f9b581f5770 2024-05-10T11:16:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.680+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b581f86d0 con 0x7f9b581f5770 2024-05-10T11:16:38.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.680+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b581f8c90 con 0x7f9b581f5770 2024-05-10T11:16:38.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.681+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b580d4c20 con 0x7f9b581f5770 2024-05-10T11:16:38.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.681+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b50042020 con 0x7f9b581f5770 2024-05-10T11:16:38.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.682+0000 7f9b4effd640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b380762d0 0x7f9b38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:38.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.682+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f9b500b7c00 con 0x7f9b581f5770 2024-05-10T11:16:38.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.682+0000 7f9b5659c640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b380762d0 0x7f9b38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:38.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.683+0000 7f9b5659c640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b380762d0 0x7f9b38078790 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000f60 tx=0x7f9b48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:38.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.687+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9b580d4c20 con 0x7f9b581f5770 2024-05-10T11:16:38.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.873+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b5806a220 con 0x7f9b380762d0 2024-05-10T11:16:38.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.880+0000 7f9b4effd640 1 -- 172.21.15.66:0/3157740624 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250149 (secure 0 0 0) 0x7f9b5806a220 con 0x7f9b380762d0 2024-05-10T11:16:38.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:38.885 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b380762d0 msgr2=0x7f9b38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b380762d0 0x7f9b38078790 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000f60 tx=0x7f9b48009040 comp rx=0 tx=0).stop 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 msgr2=0x7f9b5815cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 0x7f9b5815cb50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009f70 tx=0x7f9b50004a40 comp rx=0 tx=0).stop 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 shutdown_connections 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b380762d0 0x7f9b38078790 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b581f5770 0x7f9b5815cb50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b5815f3b0 0x7f9b58154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 --2- 172.21.15.66:0/3157740624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b580d5d30 0x7f9b58155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 >> 172.21.15.66:0/3157740624 conn(0x7f9b580d5130 msgr2=0x7f9b580d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 shutdown_connections 2024-05-10T11:16:38.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:38.883+0000 7f9b5cf24640 1 -- 172.21.15.66:0/3157740624 wait complete. 2024-05-10T11:16:38.894 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-05-10T11:16:37.744226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":130,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228616,"kb_used_data":8268,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746104,"statfs":{"total":773094113280,"available":772860010496,"internally_reserved":0,"allocated":8466432,"data_stored":4459448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918342"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838725+0000","last_change":"2024-05-10T11:16:33.838725+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838725+0000","last_undegraded":"2024-05-10T11:16:33.838725+0000","last_fullsized":"2024-05-10T11:16:33.838725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090781+0000","last_change":"2024-05-10T11:16:34.857557+0000","last_active":"2024-05-10T11:16:36.090781+0000","last_peered":"2024-05-10T11:16:36.090781+0000","last_clean":"2024-05-10T11:16:36.090781+0000","last_became_active":"2024-05-10T11:16:34.856310+0000","last_became_peered":"2024-05-10T11:16:34.856310+0000","last_unstale":"2024-05-10T11:16:36.090781+0000","last_undegraded":"2024-05-10T11:16:36.090781+0000","last_fullsized":"2024-05-10T11:16:36.090781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:00.497997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834826+0000","last_change":"2024-05-10T11:16:34.863981+0000","last_active":"2024-05-10T11:16:35.834826+0000","last_peered":"2024-05-10T11:16:35.834826+0000","last_clean":"2024-05-10T11:16:35.834826+0000","last_became_active":"2024-05-10T11:16:34.863695+0000","last_became_peered":"2024-05-10T11:16:34.863695+0000","last_unstale":"2024-05-10T11:16:35.834826+0000","last_undegraded":"2024-05-10T11:16:35.834826+0000","last_fullsized":"2024-05-10T11:16:35.834826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:46.500803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591580+0000","last_change":"2024-05-10T11:16:34.847095+0000","last_active":"2024-05-10T11:16:36.591580+0000","last_peered":"2024-05-10T11:16:36.591580+0000","last_clean":"2024-05-10T11:16:36.591580+0000","last_became_active":"2024-05-10T11:16:34.846771+0000","last_became_peered":"2024-05-10T11:16:34.846771+0000","last_unstale":"2024-05-10T11:16:36.591580+0000","last_undegraded":"2024-05-10T11:16:36.591580+0000","last_fullsized":"2024-05-10T11:16:36.591580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:25.224183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832902+0000","last_change":"2024-05-10T11:16:34.853396+0000","last_active":"2024-05-10T11:16:35.832902+0000","last_peered":"2024-05-10T11:16:35.832902+0000","last_clean":"2024-05-10T11:16:35.832902+0000","last_became_active":"2024-05-10T11:16:34.853004+0000","last_became_peered":"2024-05-10T11:16:34.853004+0000","last_unstale":"2024-05-10T11:16:35.832902+0000","last_undegraded":"2024-05-10T11:16:35.832902+0000","last_fullsized":"2024-05-10T11:16:35.832902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:09.722498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591534+0000","last_change":"2024-05-10T11:16:34.843889+0000","last_active":"2024-05-10T11:16:36.591534+0000","last_peered":"2024-05-10T11:16:36.591534+0000","last_clean":"2024-05-10T11:16:36.591534+0000","last_became_active":"2024-05-10T11:16:34.843054+0000","last_became_peered":"2024-05-10T11:16:34.843054+0000","last_unstale":"2024-05-10T11:16:36.591534+0000","last_undegraded":"2024-05-10T11:16:36.591534+0000","last_fullsized":"2024-05-10T11:16:36.591534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835940+0000","last_change":"2024-05-10T11:16:33.835940+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835940+0000","last_undegraded":"2024-05-10T11:16:33.835940+0000","last_fullsized":"2024-05-10T11:16:33.835940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832709+0000","last_change":"2024-05-10T11:16:34.854083+0000","last_active":"2024-05-10T11:16:35.832709+0000","last_peered":"2024-05-10T11:16:35.832709+0000","last_clean":"2024-05-10T11:16:35.832709+0000","last_became_active":"2024-05-10T11:16:34.853826+0000","last_became_peered":"2024-05-10T11:16:34.853826+0000","last_unstale":"2024-05-10T11:16:35.832709+0000","last_undegraded":"2024-05-10T11:16:35.832709+0000","last_fullsized":"2024-05-10T11:16:35.832709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:04.002857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834462+0000","last_change":"2024-05-10T11:16:33.834462+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834462+0000","last_undegraded":"2024-05-10T11:16:33.834462+0000","last_fullsized":"2024-05-10T11:16:33.834462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592763+0000","last_change":"2024-05-10T11:16:34.847152+0000","last_active":"2024-05-10T11:16:36.592763+0000","last_peered":"2024-05-10T11:16:36.592763+0000","last_clean":"2024-05-10T11:16:36.592763+0000","last_became_active":"2024-05-10T11:16:34.846613+0000","last_became_peered":"2024-05-10T11:16:34.846613+0000","last_unstale":"2024-05-10T11:16:36.592763+0000","last_undegraded":"2024-05-10T11:16:36.592763+0000","last_fullsized":"2024-05-10T11:16:36.592763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090713+0000","last_change":"2024-05-10T11:16:34.860674+0000","last_active":"2024-05-10T11:16:36.090713+0000","last_peered":"2024-05-10T11:16:36.090713+0000","last_clean":"2024-05-10T11:16:36.090713+0000","last_became_active":"2024-05-10T11:16:34.855401+0000","last_became_peered":"2024-05-10T11:16:34.855401+0000","last_unstale":"2024-05-10T11:16:36.090713+0000","last_undegraded":"2024-05-10T11:16:36.090713+0000","last_fullsized":"2024-05-10T11:16:36.090713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:37.966718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592638+0000","last_change":"2024-05-10T11:16:34.859258+0000","last_active":"2024-05-10T11:16:36.592638+0000","last_peered":"2024-05-10T11:16:36.592638+0000","last_clean":"2024-05-10T11:16:36.592638+0000","last_became_active":"2024-05-10T11:16:34.858948+0000","last_became_peered":"2024-05-10T11:16:34.858948+0000","last_unstale":"2024-05-10T11:16:36.592638+0000","last_undegraded":"2024-05-10T11:16:36.592638+0000","last_fullsized":"2024-05-10T11:16:36.592638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833033+0000","last_change":"2024-05-10T11:16:34.857125+0000","last_active":"2024-05-10T11:16:35.833033+0000","last_peered":"2024-05-10T11:16:35.833033+0000","last_clean":"2024-05-10T11:16:35.833033+0000","last_became_active":"2024-05-10T11:16:34.856827+0000","last_became_peered":"2024-05-10T11:16:34.856827+0000","last_unstale":"2024-05-10T11:16:35.833033+0000","last_undegraded":"2024-05-10T11:16:35.833033+0000","last_fullsized":"2024-05-10T11:16:35.833033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:43.061696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591465+0000","last_change":"2024-05-10T11:16:34.842679+0000","last_active":"2024-05-10T11:16:36.591465+0000","last_peered":"2024-05-10T11:16:36.591465+0000","last_clean":"2024-05-10T11:16:36.591465+0000","last_became_active":"2024-05-10T11:16:34.842419+0000","last_became_peered":"2024-05-10T11:16:34.842419+0000","last_unstale":"2024-05-10T11:16:36.591465+0000","last_undegraded":"2024-05-10T11:16:36.591465+0000","last_fullsized":"2024-05-10T11:16:36.591465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090384+0000","last_change":"2024-05-10T11:16:34.853761+0000","last_active":"2024-05-10T11:16:36.090384+0000","last_peered":"2024-05-10T11:16:36.090384+0000","last_clean":"2024-05-10T11:16:36.090384+0000","last_became_active":"2024-05-10T11:16:34.853449+0000","last_became_peered":"2024-05-10T11:16:34.853449+0000","last_unstale":"2024-05-10T11:16:36.090384+0000","last_undegraded":"2024-05-10T11:16:36.090384+0000","last_fullsized":"2024-05-10T11:16:36.090384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.839406+0000","last_change":"2024-05-10T11:16:33.839406+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.839406+0000","last_undegraded":"2024-05-10T11:16:33.839406+0000","last_fullsized":"2024-05-10T11:16:33.839406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833123+0000","last_change":"2024-05-10T11:16:34.849207+0000","last_active":"2024-05-10T11:16:35.833123+0000","last_peered":"2024-05-10T11:16:35.833123+0000","last_clean":"2024-05-10T11:16:35.833123+0000","last_became_active":"2024-05-10T11:16:34.848933+0000","last_became_peered":"2024-05-10T11:16:34.848933+0000","last_unstale":"2024-05-10T11:16:35.833123+0000","last_undegraded":"2024-05-10T11:16:35.833123+0000","last_fullsized":"2024-05-10T11:16:35.833123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:55.352398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834879+0000","last_change":"2024-05-10T11:16:34.851758+0000","last_active":"2024-05-10T11:16:35.834879+0000","last_peered":"2024-05-10T11:16:35.834879+0000","last_clean":"2024-05-10T11:16:35.834879+0000","last_became_active":"2024-05-10T11:16:34.851466+0000","last_became_peered":"2024-05-10T11:16:34.851466+0000","last_unstale":"2024-05-10T11:16:35.834879+0000","last_undegraded":"2024-05-10T11:16:35.834879+0000","last_fullsized":"2024-05-10T11:16:35.834879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.700792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591745+0000","last_change":"2024-05-10T11:16:34.846246+0000","last_active":"2024-05-10T11:16:36.591745+0000","last_peered":"2024-05-10T11:16:36.591745+0000","last_clean":"2024-05-10T11:16:36.591745+0000","last_became_active":"2024-05-10T11:16:34.845391+0000","last_became_peered":"2024-05-10T11:16:34.845391+0000","last_unstale":"2024-05-10T11:16:36.591745+0000","last_undegraded":"2024-05-10T11:16:36.591745+0000","last_fullsized":"2024-05-10T11:16:36.591745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833050+0000","last_change":"2024-05-10T11:16:34.860384+0000","last_active":"2024-05-10T11:16:35.833050+0000","last_peered":"2024-05-10T11:16:35.833050+0000","last_clean":"2024-05-10T11:16:35.833050+0000","last_became_active":"2024-05-10T11:16:34.860050+0000","last_became_peered":"2024-05-10T11:16:34.860050+0000","last_unstale":"2024-05-10T11:16:35.833050+0000","last_undegraded":"2024-05-10T11:16:35.833050+0000","last_fullsized":"2024-05-10T11:16:35.833050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:53.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834442+0000","last_change":"2024-05-10T11:16:33.834442+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834442+0000","last_undegraded":"2024-05-10T11:16:33.834442+0000","last_fullsized":"2024-05-10T11:16:33.834442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832837+0000","last_change":"2024-05-10T11:16:34.857747+0000","last_active":"2024-05-10T11:16:35.832837+0000","last_peered":"2024-05-10T11:16:35.832837+0000","last_clean":"2024-05-10T11:16:35.832837+0000","last_became_active":"2024-05-10T11:16:34.857437+0000","last_became_peered":"2024-05-10T11:16:34.857437+0000","last_unstale":"2024-05-10T11:16:35.832837+0000","last_undegraded":"2024-05-10T11:16:35.832837+0000","last_fullsized":"2024-05-10T11:16:35.832837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:14.230378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834080+0000","last_change":"2024-05-10T11:16:33.834080+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834080+0000","last_undegraded":"2024-05-10T11:16:33.834080+0000","last_fullsized":"2024-05-10T11:16:33.834080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090543+0000","last_change":"2024-05-10T11:16:34.845780+0000","last_active":"2024-05-10T11:16:36.090543+0000","last_peered":"2024-05-10T11:16:36.090543+0000","last_clean":"2024-05-10T11:16:36.090543+0000","last_became_active":"2024-05-10T11:16:34.845322+0000","last_became_peered":"2024-05-10T11:16:34.845322+0000","last_unstale":"2024-05-10T11:16:36.090543+0000","last_undegraded":"2024-05-10T11:16:36.090543+0000","last_fullsized":"2024-05-10T11:16:36.090543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:20.443512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090673+0000","last_change":"2024-05-10T11:16:34.854455+0000","last_active":"2024-05-10T11:16:36.090673+0000","last_peered":"2024-05-10T11:16:36.090673+0000","last_clean":"2024-05-10T11:16:36.090673+0000","last_became_active":"2024-05-10T11:16:34.854168+0000","last_became_peered":"2024-05-10T11:16:34.854168+0000","last_unstale":"2024-05-10T11:16:36.090673+0000","last_undegraded":"2024-05-10T11:16:36.090673+0000","last_fullsized":"2024-05-10T11:16:36.090673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:08.765130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592820+0000","last_change":"2024-05-10T11:16:34.849031+0000","last_active":"2024-05-10T11:16:36.592820+0000","last_peered":"2024-05-10T11:16:36.592820+0000","last_clean":"2024-05-10T11:16:36.592820+0000","last_became_active":"2024-05-10T11:16:34.848672+0000","last_became_peered":"2024-05-10T11:16:34.848672+0000","last_unstale":"2024-05-10T11:16:36.592820+0000","last_undegraded":"2024-05-10T11:16:36.592820+0000","last_fullsized":"2024-05-10T11:16:36.592820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.840009+0000","last_change":"2024-05-10T11:16:33.840009+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.840009+0000","last_undegraded":"2024-05-10T11:16:33.840009+0000","last_fullsized":"2024-05-10T11:16:33.840009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:34.856389+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:34.856031+0000","last_became_peered":"2024-05-10T11:16:34.856031+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:45.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090474+0000","last_change":"2024-05-10T11:16:34.846202+0000","last_active":"2024-05-10T11:16:36.090474+0000","last_peered":"2024-05-10T11:16:36.090474+0000","last_clean":"2024-05-10T11:16:36.090474+0000","last_became_active":"2024-05-10T11:16:34.844252+0000","last_became_peered":"2024-05-10T11:16:34.844252+0000","last_unstale":"2024-05-10T11:16:36.090474+0000","last_undegraded":"2024-05-10T11:16:36.090474+0000","last_fullsized":"2024-05-10T11:16:36.090474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.837932+0000","last_change":"2024-05-10T11:16:33.837932+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.837932+0000","last_undegraded":"2024-05-10T11:16:33.837932+0000","last_fullsized":"2024-05-10T11:16:33.837932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834602+0000","last_change":"2024-05-10T11:16:34.851184+0000","last_active":"2024-05-10T11:16:35.834602+0000","last_peered":"2024-05-10T11:16:35.834602+0000","last_clean":"2024-05-10T11:16:35.834602+0000","last_became_active":"2024-05-10T11:16:34.850836+0000","last_became_peered":"2024-05-10T11:16:34.850836+0000","last_unstale":"2024-05-10T11:16:35.834602+0000","last_undegraded":"2024-05-10T11:16:35.834602+0000","last_fullsized":"2024-05-10T11:16:35.834602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:48.282472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838234+0000","last_change":"2024-05-10T11:16:33.838234+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838234+0000","last_undegraded":"2024-05-10T11:16:33.838234+0000","last_fullsized":"2024-05-10T11:16:33.838234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834526+0000","last_change":"2024-05-10T11:16:34.851721+0000","last_active":"2024-05-10T11:16:35.834526+0000","last_peered":"2024-05-10T11:16:35.834526+0000","last_clean":"2024-05-10T11:16:35.834526+0000","last_became_active":"2024-05-10T11:16:34.851415+0000","last_became_peered":"2024-05-10T11:16:34.851415+0000","last_unstale":"2024-05-10T11:16:35.834526+0000","last_undegraded":"2024-05-10T11:16:35.834526+0000","last_fullsized":"2024-05-10T11:16:35.834526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833093+0000","last_change":"2024-05-10T11:16:33.849083+0000","last_active":"2024-05-10T11:16:35.833093+0000","last_peered":"2024-05-10T11:16:35.833093+0000","last_clean":"2024-05-10T11:16:35.833093+0000","last_became_active":"2024-05-10T11:16:33.848804+0000","last_became_peered":"2024-05-10T11:16:33.848804+0000","last_unstale":"2024-05-10T11:16:35.833093+0000","last_undegraded":"2024-05-10T11:16:35.833093+0000","last_fullsized":"2024-05-10T11:16:35.833093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:16.316656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090374+0000","last_change":"2024-05-10T11:16:34.849023+0000","last_active":"2024-05-10T11:16:36.090374+0000","last_peered":"2024-05-10T11:16:36.090374+0000","last_clean":"2024-05-10T11:16:36.090374+0000","last_became_active":"2024-05-10T11:16:34.848690+0000","last_became_peered":"2024-05-10T11:16:34.848690+0000","last_unstale":"2024-05-10T11:16:36.090374+0000","last_undegraded":"2024-05-10T11:16:36.090374+0000","last_fullsized":"2024-05-10T11:16:36.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849850+0000","last_change":"2024-05-10T11:16:33.848383+0000","last_active":"2024-05-10T11:16:33.849850+0000","last_peered":"2024-05-10T11:16:33.849850+0000","last_clean":"2024-05-10T11:16:33.849850+0000","last_became_active":"2024-05-10T11:16:33.847992+0000","last_became_peered":"2024-05-10T11:16:33.847992+0000","last_unstale":"2024-05-10T11:16:33.849850+0000","last_undegraded":"2024-05-10T11:16:33.849850+0000","last_fullsized":"2024-05-10T11:16:33.849850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:52:45.317209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833877+0000","last_change":"2024-05-10T11:16:33.833877+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833877+0000","last_undegraded":"2024-05-10T11:16:33.833877+0000","last_fullsized":"2024-05-10T11:16:33.833877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.855465+0000","last_change":"2024-05-10T11:16:33.851782+0000","last_active":"2024-05-10T11:16:33.855465+0000","last_peered":"2024-05-10T11:16:33.855465+0000","last_clean":"2024-05-10T11:16:33.855465+0000","last_became_active":"2024-05-10T11:16:33.851519+0000","last_became_peered":"2024-05-10T11:16:33.851519+0000","last_unstale":"2024-05-10T11:16:33.855465+0000","last_undegraded":"2024-05-10T11:16:33.855465+0000","last_fullsized":"2024-05-10T11:16:33.855465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:59.419313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833933+0000","last_change":"2024-05-10T11:16:33.833933+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833933+0000","last_undegraded":"2024-05-10T11:16:33.833933+0000","last_fullsized":"2024-05-10T11:16:33.833933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.846451+0000","last_change":"2024-05-10T11:16:33.845477+0000","last_active":"2024-05-10T11:16:33.846451+0000","last_peered":"2024-05-10T11:16:33.846451+0000","last_clean":"2024-05-10T11:16:33.846451+0000","last_became_active":"2024-05-10T11:16:33.845155+0000","last_became_peered":"2024-05-10T11:16:33.845155+0000","last_unstale":"2024-05-10T11:16:33.846451+0000","last_undegraded":"2024-05-10T11:16:33.846451+0000","last_fullsized":"2024-05-10T11:16:33.846451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:03.730186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090601+0000","last_change":"2024-05-10T11:16:34.864666+0000","last_active":"2024-05-10T11:16:36.090601+0000","last_peered":"2024-05-10T11:16:36.090601+0000","last_clean":"2024-05-10T11:16:36.090601+0000","last_became_active":"2024-05-10T11:16:34.864410+0000","last_became_peered":"2024-05-10T11:16:34.864410+0000","last_unstale":"2024-05-10T11:16:36.090601+0000","last_undegraded":"2024-05-10T11:16:36.090601+0000","last_fullsized":"2024-05-10T11:16:36.090601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:56.782670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.845858+0000","last_change":"2024-05-10T11:16:33.844658+0000","last_active":"2024-05-10T11:16:33.845858+0000","last_peered":"2024-05-10T11:16:33.845858+0000","last_clean":"2024-05-10T11:16:33.845858+0000","last_became_active":"2024-05-10T11:16:33.844370+0000","last_became_peered":"2024-05-10T11:16:33.844370+0000","last_unstale":"2024-05-10T11:16:33.845858+0000","last_undegraded":"2024-05-10T11:16:33.845858+0000","last_fullsized":"2024-05-10T11:16:33.845858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:10:44.548947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090787+0000","last_change":"2024-05-10T11:16:34.844211+0000","last_active":"2024-05-10T11:16:36.090787+0000","last_peered":"2024-05-10T11:16:36.090787+0000","last_clean":"2024-05-10T11:16:36.090787+0000","last_became_active":"2024-05-10T11:16:34.843830+0000","last_became_peered":"2024-05-10T11:16:34.843830+0000","last_unstale":"2024-05-10T11:16:36.090787+0000","last_undegraded":"2024-05-10T11:16:36.090787+0000","last_fullsized":"2024-05-10T11:16:36.090787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:52.427590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591559+0000","last_change":"2024-05-10T11:16:33.839972+0000","last_active":"2024-05-10T11:16:36.591559+0000","last_peered":"2024-05-10T11:16:36.591559+0000","last_clean":"2024-05-10T11:16:36.591559+0000","last_became_active":"2024-05-10T11:16:33.839660+0000","last_became_peered":"2024-05-10T11:16:33.839660+0000","last_unstale":"2024-05-10T11:16:36.591559+0000","last_undegraded":"2024-05-10T11:16:36.591559+0000","last_fullsized":"2024-05-10T11:16:36.591559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:34.138529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833956+0000","last_change":"2024-05-10T11:16:33.833956+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833956+0000","last_undegraded":"2024-05-10T11:16:33.833956+0000","last_fullsized":"2024-05-10T11:16:33.833956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090486+0000","last_change":"2024-05-10T11:16:33.849599+0000","last_active":"2024-05-10T11:16:36.090486+0000","last_peered":"2024-05-10T11:16:36.090486+0000","last_clean":"2024-05-10T11:16:36.090486+0000","last_became_active":"2024-05-10T11:16:33.849241+0000","last_became_peered":"2024-05-10T11:16:33.849241+0000","last_unstale":"2024-05-10T11:16:36.090486+0000","last_undegraded":"2024-05-10T11:16:36.090486+0000","last_fullsized":"2024-05-10T11:16:36.090486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:50.691422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838990+0000","last_change":"2024-05-10T11:16:33.838990+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838990+0000","last_undegraded":"2024-05-10T11:16:33.838990+0000","last_fullsized":"2024-05-10T11:16:33.838990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832783+0000","last_change":"2024-05-10T11:16:33.850927+0000","last_active":"2024-05-10T11:16:35.832783+0000","last_peered":"2024-05-10T11:16:35.832783+0000","last_clean":"2024-05-10T11:16:35.832783+0000","last_became_active":"2024-05-10T11:16:33.850620+0000","last_became_peered":"2024-05-10T11:16:33.850620+0000","last_unstale":"2024-05-10T11:16:35.832783+0000","last_undegraded":"2024-05-10T11:16:35.832783+0000","last_fullsized":"2024-05-10T11:16:35.832783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:31.969039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090316+0000","last_change":"2024-05-10T11:16:34.839538+0000","last_active":"2024-05-10T11:16:36.090316+0000","last_peered":"2024-05-10T11:16:36.090316+0000","last_clean":"2024-05-10T11:16:36.090316+0000","last_became_active":"2024-05-10T11:16:34.839244+0000","last_became_peered":"2024-05-10T11:16:34.839244+0000","last_unstale":"2024-05-10T11:16:36.090316+0000","last_undegraded":"2024-05-10T11:16:36.090316+0000","last_fullsized":"2024-05-10T11:16:36.090316+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849187+0000","last_change":"2024-05-10T11:16:33.847120+0000","last_active":"2024-05-10T11:16:33.849187+0000","last_peered":"2024-05-10T11:16:33.849187+0000","last_clean":"2024-05-10T11:16:33.849187+0000","last_became_active":"2024-05-10T11:16:33.846773+0000","last_became_peered":"2024-05-10T11:16:33.846773+0000","last_unstale":"2024-05-10T11:16:33.849187+0000","last_undegraded":"2024-05-10T11:16:33.849187+0000","last_fullsized":"2024-05-10T11:16:33.849187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:00.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591488+0000","last_change":"2024-05-10T11:16:34.843679+0000","last_active":"2024-05-10T11:16:36.591488+0000","last_peered":"2024-05-10T11:16:36.591488+0000","last_clean":"2024-05-10T11:16:36.591488+0000","last_became_active":"2024-05-10T11:16:34.843383+0000","last_became_peered":"2024-05-10T11:16:34.843383+0000","last_unstale":"2024-05-10T11:16:36.591488+0000","last_undegraded":"2024-05-10T11:16:36.591488+0000","last_fullsized":"2024-05-10T11:16:36.591488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:09.348219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592877+0000","last_change":"2024-05-10T11:16:33.841357+0000","last_active":"2024-05-10T11:16:36.592877+0000","last_peered":"2024-05-10T11:16:36.592877+0000","last_clean":"2024-05-10T11:16:36.592877+0000","last_became_active":"2024-05-10T11:16:33.841097+0000","last_became_peered":"2024-05-10T11:16:33.841097+0000","last_unstale":"2024-05-10T11:16:36.592877+0000","last_undegraded":"2024-05-10T11:16:36.592877+0000","last_fullsized":"2024-05-10T11:16:36.592877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591637+0000","last_change":"2024-05-10T11:16:34.859325+0000","last_active":"2024-05-10T11:16:36.591637+0000","last_peered":"2024-05-10T11:16:36.591637+0000","last_clean":"2024-05-10T11:16:36.591637+0000","last_became_active":"2024-05-10T11:16:34.859028+0000","last_became_peered":"2024-05-10T11:16:34.859028+0000","last_unstale":"2024-05-10T11:16:36.591637+0000","last_undegraded":"2024-05-10T11:16:36.591637+0000","last_fullsized":"2024-05-10T11:16:36.591637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833154+0000","last_change":"2024-05-10T11:16:33.850700+0000","last_active":"2024-05-10T11:16:35.833154+0000","last_peered":"2024-05-10T11:16:35.833154+0000","last_clean":"2024-05-10T11:16:35.833154+0000","last_became_active":"2024-05-10T11:16:33.850423+0000","last_became_peered":"2024-05-10T11:16:33.850423+0000","last_unstale":"2024-05-10T11:16:35.833154+0000","last_undegraded":"2024-05-10T11:16:35.833154+0000","last_fullsized":"2024-05-10T11:16:35.833154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:53.739455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834766+0000","last_change":"2024-05-10T11:16:34.863940+0000","last_active":"2024-05-10T11:16:35.834766+0000","last_peered":"2024-05-10T11:16:35.834766+0000","last_clean":"2024-05-10T11:16:35.834766+0000","last_became_active":"2024-05-10T11:16:34.863635+0000","last_became_peered":"2024-05-10T11:16:34.863635+0000","last_unstale":"2024-05-10T11:16:35.834766+0000","last_undegraded":"2024-05-10T11:16:35.834766+0000","last_fullsized":"2024-05-10T11:16:35.834766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:19.129956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.842101+0000","last_change":"2024-05-10T11:16:33.840650+0000","last_active":"2024-05-10T11:16:33.842101+0000","last_peered":"2024-05-10T11:16:33.842101+0000","last_clean":"2024-05-10T11:16:33.842101+0000","last_became_active":"2024-05-10T11:16:33.840327+0000","last_became_peered":"2024-05-10T11:16:33.840327+0000","last_unstale":"2024-05-10T11:16:33.842101+0000","last_undegraded":"2024-05-10T11:16:33.842101+0000","last_fullsized":"2024-05-10T11:16:33.842101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:47.931535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592546+0000","last_change":"2024-05-10T11:16:34.854844+0000","last_active":"2024-05-10T11:16:36.592546+0000","last_peered":"2024-05-10T11:16:36.592546+0000","last_clean":"2024-05-10T11:16:36.592546+0000","last_became_active":"2024-05-10T11:16:34.854522+0000","last_became_peered":"2024-05-10T11:16:34.854522+0000","last_unstale":"2024-05-10T11:16:36.592546+0000","last_undegraded":"2024-05-10T11:16:36.592546+0000","last_fullsized":"2024-05-10T11:16:36.592546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:58.379390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591480+0000","last_change":"2024-05-10T11:16:33.834877+0000","last_active":"2024-05-10T11:16:36.591480+0000","last_peered":"2024-05-10T11:16:36.591480+0000","last_clean":"2024-05-10T11:16:36.591480+0000","last_became_active":"2024-05-10T11:16:33.834597+0000","last_became_peered":"2024-05-10T11:16:33.834597+0000","last_unstale":"2024-05-10T11:16:36.591480+0000","last_undegraded":"2024-05-10T11:16:36.591480+0000","last_fullsized":"2024-05-10T11:16:36.591480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836394+0000","last_change":"2024-05-10T11:16:33.836394+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836394+0000","last_undegraded":"2024-05-10T11:16:33.836394+0000","last_fullsized":"2024-05-10T11:16:33.836394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.855479+0000","last_change":"2024-05-10T11:16:33.852289+0000","last_active":"2024-05-10T11:16:33.855479+0000","last_peered":"2024-05-10T11:16:33.855479+0000","last_clean":"2024-05-10T11:16:33.855479+0000","last_became_active":"2024-05-10T11:16:33.852005+0000","last_became_peered":"2024-05-10T11:16:33.852005+0000","last_unstale":"2024-05-10T11:16:33.855479+0000","last_undegraded":"2024-05-10T11:16:33.855479+0000","last_fullsized":"2024-05-10T11:16:33.855479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:26.675655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836061+0000","last_change":"2024-05-10T11:16:33.836061+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836061+0000","last_undegraded":"2024-05-10T11:16:33.836061+0000","last_fullsized":"2024-05-10T11:16:33.836061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832731+0000","last_change":"2024-05-10T11:16:33.851756+0000","last_active":"2024-05-10T11:16:35.832731+0000","last_peered":"2024-05-10T11:16:35.832731+0000","last_clean":"2024-05-10T11:16:35.832731+0000","last_became_active":"2024-05-10T11:16:33.851459+0000","last_became_peered":"2024-05-10T11:16:33.851459+0000","last_unstale":"2024-05-10T11:16:35.832731+0000","last_undegraded":"2024-05-10T11:16:35.832731+0000","last_fullsized":"2024-05-10T11:16:35.832731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:00.512992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.837011+0000","last_change":"2024-05-10T11:16:33.837011+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.837011+0000","last_undegraded":"2024-05-10T11:16:33.837011+0000","last_fullsized":"2024-05-10T11:16:33.837011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090447+0000","last_change":"2024-05-10T11:16:33.845959+0000","last_active":"2024-05-10T11:16:36.090447+0000","last_peered":"2024-05-10T11:16:36.090447+0000","last_clean":"2024-05-10T11:16:36.090447+0000","last_became_active":"2024-05-10T11:16:33.845331+0000","last_became_peered":"2024-05-10T11:16:33.845331+0000","last_unstale":"2024-05-10T11:16:36.090447+0000","last_undegraded":"2024-05-10T11:16:36.090447+0000","last_fullsized":"2024-05-10T11:16:36.090447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:45.491433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591231+0000","last_change":"2024-05-10T11:16:34.852456+0000","last_active":"2024-05-10T11:16:36.591231+0000","last_peered":"2024-05-10T11:16:36.591231+0000","last_clean":"2024-05-10T11:16:36.591231+0000","last_became_active":"2024-05-10T11:16:34.852136+0000","last_became_peered":"2024-05-10T11:16:34.852136+0000","last_unstale":"2024-05-10T11:16:36.591231+0000","last_undegraded":"2024-05-10T11:16:36.591231+0000","last_fullsized":"2024-05-10T11:16:36.591231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849165+0000","last_change":"2024-05-10T11:16:33.847150+0000","last_active":"2024-05-10T11:16:33.849165+0000","last_peered":"2024-05-10T11:16:33.849165+0000","last_clean":"2024-05-10T11:16:33.849165+0000","last_became_active":"2024-05-10T11:16:33.846903+0000","last_became_peered":"2024-05-10T11:16:33.846903+0000","last_unstale":"2024-05-10T11:16:33.849165+0000","last_undegraded":"2024-05-10T11:16:33.849165+0000","last_fullsized":"2024-05-10T11:16:33.849165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:11.657121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832695+0000","last_change":"2024-05-10T11:16:34.845165+0000","last_active":"2024-05-10T11:16:35.832695+0000","last_peered":"2024-05-10T11:16:35.832695+0000","last_clean":"2024-05-10T11:16:35.832695+0000","last_became_active":"2024-05-10T11:16:34.844886+0000","last_became_peered":"2024-05-10T11:16:34.844886+0000","last_unstale":"2024-05-10T11:16:35.832695+0000","last_undegraded":"2024-05-10T11:16:35.832695+0000","last_fullsized":"2024-05-10T11:16:35.832695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:15.505458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.845224+0000","last_change":"2024-05-10T11:16:33.840287+0000","last_active":"2024-05-10T11:16:33.845224+0000","last_peered":"2024-05-10T11:16:33.845224+0000","last_clean":"2024-05-10T11:16:33.845224+0000","last_became_active":"2024-05-10T11:16:33.840016+0000","last_became_peered":"2024-05-10T11:16:33.840016+0000","last_unstale":"2024-05-10T11:16:33.845224+0000","last_undegraded":"2024-05-10T11:16:33.845224+0000","last_fullsized":"2024-05-10T11:16:33.845224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:21.018784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832710+0000","last_change":"2024-05-10T11:16:34.857683+0000","last_active":"2024-05-10T11:16:35.832710+0000","last_peered":"2024-05-10T11:16:35.832710+0000","last_clean":"2024-05-10T11:16:35.832710+0000","last_became_active":"2024-05-10T11:16:34.857411+0000","last_became_peered":"2024-05-10T11:16:34.857411+0000","last_unstale":"2024-05-10T11:16:35.832710+0000","last_undegraded":"2024-05-10T11:16:35.832710+0000","last_fullsized":"2024-05-10T11:16:35.832710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:04.078921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:33.849638+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:33.849383+0000","last_became_peered":"2024-05-10T11:16:33.849383+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.217874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591483+0000","last_change":"2024-05-10T11:16:34.861019+0000","last_active":"2024-05-10T11:16:36.591483+0000","last_peered":"2024-05-10T11:16:36.591483+0000","last_clean":"2024-05-10T11:16:36.591483+0000","last_became_active":"2024-05-10T11:16:34.860667+0000","last_became_peered":"2024-05-10T11:16:34.860667+0000","last_unstale":"2024-05-10T11:16:36.591483+0000","last_undegraded":"2024-05-10T11:16:36.591483+0000","last_fullsized":"2024-05-10T11:16:36.591483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834612+0000","last_change":"2024-05-10T11:16:33.851897+0000","last_active":"2024-05-10T11:16:35.834612+0000","last_peered":"2024-05-10T11:16:35.834612+0000","last_clean":"2024-05-10T11:16:35.834612+0000","last_became_active":"2024-05-10T11:16:33.851629+0000","last_became_peered":"2024-05-10T11:16:33.851629+0000","last_unstale":"2024-05-10T11:16:35.834612+0000","last_undegraded":"2024-05-10T11:16:35.834612+0000","last_fullsized":"2024-05-10T11:16:35.834612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:02.785863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090623+0000","last_change":"2024-05-10T11:16:34.849709+0000","last_active":"2024-05-10T11:16:36.090623+0000","last_peered":"2024-05-10T11:16:36.090623+0000","last_clean":"2024-05-10T11:16:36.090623+0000","last_became_active":"2024-05-10T11:16:34.849412+0000","last_became_peered":"2024-05-10T11:16:34.849412+0000","last_unstale":"2024-05-10T11:16:36.090623+0000","last_undegraded":"2024-05-10T11:16:36.090623+0000","last_fullsized":"2024-05-10T11:16:36.090623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:09.452662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591486+0000","last_change":"2024-05-10T11:16:33.840818+0000","last_active":"2024-05-10T11:16:36.591486+0000","last_peered":"2024-05-10T11:16:36.591486+0000","last_clean":"2024-05-10T11:16:36.591486+0000","last_became_active":"2024-05-10T11:16:33.840472+0000","last_became_peered":"2024-05-10T11:16:33.840472+0000","last_unstale":"2024-05-10T11:16:36.591486+0000","last_undegraded":"2024-05-10T11:16:36.591486+0000","last_fullsized":"2024-05-10T11:16:36.591486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:36:21.942433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090750+0000","last_change":"2024-05-10T11:16:34.848027+0000","last_active":"2024-05-10T11:16:36.090750+0000","last_peered":"2024-05-10T11:16:36.090750+0000","last_clean":"2024-05-10T11:16:36.090750+0000","last_became_active":"2024-05-10T11:16:34.846208+0000","last_became_peered":"2024-05-10T11:16:34.846208+0000","last_unstale":"2024-05-10T11:16:36.090750+0000","last_undegraded":"2024-05-10T11:16:36.090750+0000","last_fullsized":"2024-05-10T11:16:36.090750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:21.557365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591275+0000","last_change":"2024-05-10T11:16:33.843809+0000","last_active":"2024-05-10T11:16:36.591275+0000","last_peered":"2024-05-10T11:16:36.591275+0000","last_clean":"2024-05-10T11:16:36.591275+0000","last_became_active":"2024-05-10T11:16:33.843314+0000","last_became_peered":"2024-05-10T11:16:33.843314+0000","last_unstale":"2024-05-10T11:16:36.591275+0000","last_undegraded":"2024-05-10T11:16:36.591275+0000","last_fullsized":"2024-05-10T11:16:36.591275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836481+0000","last_change":"2024-05-10T11:16:33.836481+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836481+0000","last_undegraded":"2024-05-10T11:16:33.836481+0000","last_fullsized":"2024-05-10T11:16:33.836481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591160+0000","last_change":"2024-05-10T11:16:33.842957+0000","last_active":"2024-05-10T11:16:36.591160+0000","last_peered":"2024-05-10T11:16:36.591160+0000","last_clean":"2024-05-10T11:16:36.591160+0000","last_became_active":"2024-05-10T11:16:33.842675+0000","last_became_peered":"2024-05-10T11:16:33.842675+0000","last_unstale":"2024-05-10T11:16:36.591160+0000","last_undegraded":"2024-05-10T11:16:36.591160+0000","last_fullsized":"2024-05-10T11:16:36.591160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833230+0000","last_change":"2024-05-10T11:16:33.833230+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833230+0000","last_undegraded":"2024-05-10T11:16:33.833230+0000","last_fullsized":"2024-05-10T11:16:33.833230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592665+0000","last_change":"2024-05-10T11:16:33.839202+0000","last_active":"2024-05-10T11:16:36.592665+0000","last_peered":"2024-05-10T11:16:36.592665+0000","last_clean":"2024-05-10T11:16:36.592665+0000","last_became_active":"2024-05-10T11:16:33.838582+0000","last_became_peered":"2024-05-10T11:16:33.838582+0000","last_unstale":"2024-05-10T11:16:36.592665+0000","last_undegraded":"2024-05-10T11:16:36.592665+0000","last_fullsized":"2024-05-10T11:16:36.592665+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835469+0000","last_change":"2024-05-10T11:16:33.835469+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835469+0000","last_undegraded":"2024-05-10T11:16:33.835469+0000","last_fullsized":"2024-05-10T11:16:33.835469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.837136+0000","last_change":"2024-05-10T11:16:33.850966+0000","last_active":"2024-05-10T11:16:36.837136+0000","last_peered":"2024-05-10T11:16:36.837136+0000","last_clean":"2024-05-10T11:16:36.837136+0000","last_became_active":"2024-05-10T11:16:33.850661+0000","last_became_peered":"2024-05-10T11:16:33.850661+0000","last_unstale":"2024-05-10T11:16:36.837136+0000","last_undegraded":"2024-05-10T11:16:36.837136+0000","last_fullsized":"2024-05-10T11:16:36.837136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833362+0000","last_change":"2024-05-10T11:16:33.833362+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833362+0000","last_undegraded":"2024-05-10T11:16:33.833362+0000","last_fullsized":"2024-05-10T11:16:33.833362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849780+0000","last_change":"2024-05-10T11:16:33.848721+0000","last_active":"2024-05-10T11:16:33.849780+0000","last_peered":"2024-05-10T11:16:33.849780+0000","last_clean":"2024-05-10T11:16:33.849780+0000","last_became_active":"2024-05-10T11:16:33.848429+0000","last_became_peered":"2024-05-10T11:16:33.848429+0000","last_unstale":"2024-05-10T11:16:33.849780+0000","last_undegraded":"2024-05-10T11:16:33.849780+0000","last_fullsized":"2024-05-10T11:16:33.849780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:35.587792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090506+0000","last_change":"2024-05-10T11:16:34.846463+0000","last_active":"2024-05-10T11:16:36.090506+0000","last_peered":"2024-05-10T11:16:36.090506+0000","last_clean":"2024-05-10T11:16:36.090506+0000","last_became_active":"2024-05-10T11:16:34.845916+0000","last_became_peered":"2024-05-10T11:16:34.845916+0000","last_unstale":"2024-05-10T11:16:36.090506+0000","last_undegraded":"2024-05-10T11:16:36.090506+0000","last_fullsized":"2024-05-10T11:16:36.090506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:18.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849749+0000","last_change":"2024-05-10T11:16:33.848344+0000","last_active":"2024-05-10T11:16:33.849749+0000","last_peered":"2024-05-10T11:16:33.849749+0000","last_clean":"2024-05-10T11:16:33.849749+0000","last_became_active":"2024-05-10T11:16:33.848071+0000","last_became_peered":"2024-05-10T11:16:33.848071+0000","last_unstale":"2024-05-10T11:16:33.849749+0000","last_undegraded":"2024-05-10T11:16:33.849749+0000","last_fullsized":"2024-05-10T11:16:33.849749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:47.025785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836200+0000","last_change":"2024-05-10T11:16:33.836200+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836200+0000","last_undegraded":"2024-05-10T11:16:33.836200+0000","last_fullsized":"2024-05-10T11:16:33.836200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.844599+0000","last_change":"2024-05-10T11:16:33.842583+0000","last_active":"2024-05-10T11:16:33.844599+0000","last_peered":"2024-05-10T11:16:33.844599+0000","last_clean":"2024-05-10T11:16:33.844599+0000","last_became_active":"2024-05-10T11:16:33.842298+0000","last_became_peered":"2024-05-10T11:16:33.842298+0000","last_unstale":"2024-05-10T11:16:33.844599+0000","last_undegraded":"2024-05-10T11:16:33.844599+0000","last_fullsized":"2024-05-10T11:16:33.844599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:13.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835379+0000","last_change":"2024-05-10T11:16:33.835379+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835379+0000","last_undegraded":"2024-05-10T11:16:33.835379+0000","last_fullsized":"2024-05-10T11:16:33.835379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832824+0000","last_change":"2024-05-10T11:16:33.851549+0000","last_active":"2024-05-10T11:16:35.832824+0000","last_peered":"2024-05-10T11:16:35.832824+0000","last_clean":"2024-05-10T11:16:35.832824+0000","last_became_active":"2024-05-10T11:16:33.851206+0000","last_became_peered":"2024-05-10T11:16:33.851206+0000","last_unstale":"2024-05-10T11:16:35.832824+0000","last_undegraded":"2024-05-10T11:16:35.832824+0000","last_fullsized":"2024-05-10T11:16:35.832824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:02.953747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834995+0000","last_change":"2024-05-10T11:16:34.863061+0000","last_active":"2024-05-10T11:16:35.834995+0000","last_peered":"2024-05-10T11:16:35.834995+0000","last_clean":"2024-05-10T11:16:35.834995+0000","last_became_active":"2024-05-10T11:16:34.862777+0000","last_became_peered":"2024-05-10T11:16:34.862777+0000","last_unstale":"2024-05-10T11:16:35.834995+0000","last_undegraded":"2024-05-10T11:16:35.834995+0000","last_fullsized":"2024-05-10T11:16:35.834995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:35.147899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.844011+0000","last_change":"2024-05-10T11:16:33.841766+0000","last_active":"2024-05-10T11:16:33.844011+0000","last_peered":"2024-05-10T11:16:33.844011+0000","last_clean":"2024-05-10T11:16:33.844011+0000","last_became_active":"2024-05-10T11:16:33.841421+0000","last_became_peered":"2024-05-10T11:16:33.841421+0000","last_unstale":"2024-05-10T11:16:33.844011+0000","last_undegraded":"2024-05-10T11:16:33.844011+0000","last_fullsized":"2024-05-10T11:16:33.844011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:24.900761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834983+0000","last_change":"2024-05-10T11:16:34.851996+0000","last_active":"2024-05-10T11:16:35.834983+0000","last_peered":"2024-05-10T11:16:35.834983+0000","last_clean":"2024-05-10T11:16:35.834983+0000","last_became_active":"2024-05-10T11:16:34.851659+0000","last_became_peered":"2024-05-10T11:16:34.851659+0000","last_unstale":"2024-05-10T11:16:35.834983+0000","last_undegraded":"2024-05-10T11:16:35.834983+0000","last_fullsized":"2024-05-10T11:16:35.834983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:35.838012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834471+0000","last_change":"2024-05-10T11:16:33.840847+0000","last_active":"2024-05-10T11:16:35.834471+0000","last_peered":"2024-05-10T11:16:35.834471+0000","last_clean":"2024-05-10T11:16:35.834471+0000","last_became_active":"2024-05-10T11:16:33.840336+0000","last_became_peered":"2024-05-10T11:16:33.840336+0000","last_unstale":"2024-05-10T11:16:35.834471+0000","last_undegraded":"2024-05-10T11:16:35.834471+0000","last_fullsized":"2024-05-10T11:16:35.834471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:57.998358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838344+0000","last_change":"2024-05-10T11:16:33.838344+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838344+0000","last_undegraded":"2024-05-10T11:16:33.838344+0000","last_fullsized":"2024-05-10T11:16:33.838344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591763+0000","last_change":"2024-05-10T11:16:33.841956+0000","last_active":"2024-05-10T11:16:36.591763+0000","last_peered":"2024-05-10T11:16:36.591763+0000","last_clean":"2024-05-10T11:16:36.591763+0000","last_became_active":"2024-05-10T11:16:33.841606+0000","last_became_peered":"2024-05-10T11:16:33.841606+0000","last_unstale":"2024-05-10T11:16:36.591763+0000","last_undegraded":"2024-05-10T11:16:36.591763+0000","last_fullsized":"2024-05-10T11:16:36.591763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:56.319173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.841064+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:16:33.841064+0000","last_peered":"2024-05-10T11:16:33.841064+0000","last_clean":"2024-05-10T11:16:33.841064+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:16:33.841064+0000","last_undegraded":"2024-05-10T11:16:33.841064+0000","last_fullsized":"2024-05-10T11:16:33.841064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":988031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":397663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":397663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":418931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":418301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1515520,"data_stored":1008557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":411531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:16:38.899 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:16:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.038+0000 7f3a0f6fc640 1 Processor -- start 2024-05-10T11:16:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.039+0000 7f3a0f6fc640 1 -- start start 2024-05-10T11:16:39.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.039+0000 7f3a0f6fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 0x7f3a0806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.039+0000 7f3a0f6fc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a080c74c0 con 0x7f3a080cf170 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.039+0000 7f3a0f6fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a080c5d10 con 0x7f3a0815b6d0 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.039+0000 7f3a0f6fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3a080cc380 con 0x7f3a0815f830 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f3a0cc97640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3a080cf170 0x7f3a0815f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:57380/0 (socket says 172.21.15.66:57380) 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f3a0cc97640 1 -- 172.21.15.66:0/1494359270 learned_addr learned my addr 172.21.15.66:0/1494359270 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f3a0dc99640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 0x7f3a0806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609852617 0 0) 0x7f3a080c74c0 con 0x7f3a080cf170 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39f4004630 con 0x7f3a080cf170 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2431097573 0 0) 0x7f39f4004630 con 0x7f3a080cf170 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 msgr2=0x7f3a0806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 0x7f3a0806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 >> v1:172.21.15.190:6789/0 conn(0x7f3a0815b6d0 legacy=0x7f3a080c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a080c5ff0 con 0x7f3a080cf170 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f39f8001670 con 0x7f3a080cf170 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 >> v1:172.21.15.66:6789/0 conn(0x7f3a080cf170 legacy=0x7f3a0815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f4004af0 0x7f39f4004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 0x7f39f4005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f39f40062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39f400cc10 con 0x7f39f4005e50 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39f400cdc0 con 0x7f39f4004af0 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39f400cfc0 con 0x7f3a0815f830 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f3a0dc99640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f39f40062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f3a0d498640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f4004af0 0x7f39f4004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.040+0000 7f3a0cc97640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 0x7f39f4005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f3a0dc99640 1 -- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 msgr2=0x7f39f4005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f3a0dc99640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a0815f830 0x7f39f4005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f3a0dc99640 1 -- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f4004af0 msgr2=0x7f39f4004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f3a0dc99640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f4004af0 0x7f39f4004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f3a0dc99640 1 -- 172.21.15.66:0/1494359270 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f4004630 con 0x7f39f4005e50 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f3a0dc99640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f39f40062d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009bd0 tx=0x7f39f4006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5e0c97a7a43c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.041+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00009c10 con 0x7f39f4005e50 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a00030640 con 0x7f39f4005e50 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f39fffff640 1 -- 172.21.15.66:0/1494359270 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00030a30 con 0x7f39f4005e50 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/1494359270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 msgr2=0x7f39f40062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/1494359270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f39f40062d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009bd0 tx=0x7f39f4006940 comp rx=0 tx=0).stop 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0dc99640 1 -- 172.21.15.66:0/1494359270 reap_dead start 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/1494359270 shutdown_connections 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/1494359270 >> 172.21.15.66:0/1494359270 conn(0x7f3a080b2900 msgr2=0x7f3a080b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/1494359270 shutdown_connections 2024-05-10T11:16:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.042+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/1494359270 wait complete. 2024-05-10T11:16:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.043+0000 7f3a0f6fc640 1 Processor -- start 2024-05-10T11:16:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.043+0000 7f3a0f6fc640 1 -- start start 2024-05-10T11:16:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0f6fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f3a080c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0f6fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a080ae790 0x7f3a080c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0f6fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a081f86d0 0x7f3a0815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0f6fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a080c6890 con 0x7f39f4005e50 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0f6fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a080c65b0 con 0x7f3a081f86d0 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0f6fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3a080cd170 con 0x7f3a080ae790 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0d498640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f3a080c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0d498640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f3a080c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52204/0 (socket says 172.21.15.66:52204) 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0d498640 1 -- 172.21.15.66:0/2994123485 learned_addr learned my addr 172.21.15.66:0/2994123485 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0cc97640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a080ae790 0x7f3a080c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.044+0000 7f3a0dc99640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a081f86d0 0x7f3a0815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0d498640 1 -- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a080ae790 msgr2=0x7f3a080c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0d498640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a080ae790 0x7f3a080c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0d498640 1 -- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a081f86d0 msgr2=0x7f3a0815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0d498640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a081f86d0 0x7f3a0815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0d498640 1 -- 172.21.15.66:0/2994123485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a08156750 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0cc97640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a080ae790 0x7f3a080c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0d498640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f3a080c8450 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400f820 tx=0x7f3a0400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040050d0 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a04018070 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a081f8c20 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04005490 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.045+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a081f91e0 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.046+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0806a220 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.047+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3a0400d6d0 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.047+0000 7f39fdffb640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39ec076300 0x7f39ec0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.047+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f3a040975c0 con 0x7f39f4005e50 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.048+0000 7f3a0cc97640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39ec076300 0x7f39ec0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.048+0000 7f3a0cc97640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39ec076300 0x7f39ec0787c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a080aebb0 tx=0x7f39f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.052+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3a04060d90 con 0x7f39f4005e50 2024-05-10T11:16:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.237+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a08157fe0 con 0x7f39ec076300 2024-05-10T11:16:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.244+0000 7f39fdffb640 1 -- 172.21.15.66:0/2994123485 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250149 (secure 0 0 0) 0x7f3a08157fe0 con 0x7f39ec076300 2024-05-10T11:16:39.246 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:39.248 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:16:39.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39ec076300 msgr2=0x7f39ec0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39ec076300 0x7f39ec0787c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a080aebb0 tx=0x7f39f8009040 comp rx=0 tx=0).stop 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 msgr2=0x7f3a080c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f3a080c8450 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400f820 tx=0x7f3a0400fce0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 shutdown_connections 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39ec076300 0x7f39ec0787c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a081f86d0 0x7f3a0815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a080ae790 0x7f3a080c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 --2- 172.21.15.66:0/2994123485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4005e50 0x7f3a080c8450 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 >> 172.21.15.66:0/2994123485 conn(0x7f3a080b2900 msgr2=0x7f3a080b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:39.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 shutdown_connections 2024-05-10T11:16:39.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.247+0000 7f3a0f6fc640 1 -- 172.21.15.66:0/2994123485 wait complete. 2024-05-10T11:16:39.258 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-05-10T11:16:37.744226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":130,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228616,"kb_used_data":8268,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746104,"statfs":{"total":773094113280,"available":772860010496,"internally_reserved":0,"allocated":8466432,"data_stored":4459448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918342"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838725+0000","last_change":"2024-05-10T11:16:33.838725+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838725+0000","last_undegraded":"2024-05-10T11:16:33.838725+0000","last_fullsized":"2024-05-10T11:16:33.838725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090781+0000","last_change":"2024-05-10T11:16:34.857557+0000","last_active":"2024-05-10T11:16:36.090781+0000","last_peered":"2024-05-10T11:16:36.090781+0000","last_clean":"2024-05-10T11:16:36.090781+0000","last_became_active":"2024-05-10T11:16:34.856310+0000","last_became_peered":"2024-05-10T11:16:34.856310+0000","last_unstale":"2024-05-10T11:16:36.090781+0000","last_undegraded":"2024-05-10T11:16:36.090781+0000","last_fullsized":"2024-05-10T11:16:36.090781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:00.497997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834826+0000","last_change":"2024-05-10T11:16:34.863981+0000","last_active":"2024-05-10T11:16:35.834826+0000","last_peered":"2024-05-10T11:16:35.834826+0000","last_clean":"2024-05-10T11:16:35.834826+0000","last_became_active":"2024-05-10T11:16:34.863695+0000","last_became_peered":"2024-05-10T11:16:34.863695+0000","last_unstale":"2024-05-10T11:16:35.834826+0000","last_undegraded":"2024-05-10T11:16:35.834826+0000","last_fullsized":"2024-05-10T11:16:35.834826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:46.500803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591580+0000","last_change":"2024-05-10T11:16:34.847095+0000","last_active":"2024-05-10T11:16:36.591580+0000","last_peered":"2024-05-10T11:16:36.591580+0000","last_clean":"2024-05-10T11:16:36.591580+0000","last_became_active":"2024-05-10T11:16:34.846771+0000","last_became_peered":"2024-05-10T11:16:34.846771+0000","last_unstale":"2024-05-10T11:16:36.591580+0000","last_undegraded":"2024-05-10T11:16:36.591580+0000","last_fullsized":"2024-05-10T11:16:36.591580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:25.224183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832902+0000","last_change":"2024-05-10T11:16:34.853396+0000","last_active":"2024-05-10T11:16:35.832902+0000","last_peered":"2024-05-10T11:16:35.832902+0000","last_clean":"2024-05-10T11:16:35.832902+0000","last_became_active":"2024-05-10T11:16:34.853004+0000","last_became_peered":"2024-05-10T11:16:34.853004+0000","last_unstale":"2024-05-10T11:16:35.832902+0000","last_undegraded":"2024-05-10T11:16:35.832902+0000","last_fullsized":"2024-05-10T11:16:35.832902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:09.722498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591534+0000","last_change":"2024-05-10T11:16:34.843889+0000","last_active":"2024-05-10T11:16:36.591534+0000","last_peered":"2024-05-10T11:16:36.591534+0000","last_clean":"2024-05-10T11:16:36.591534+0000","last_became_active":"2024-05-10T11:16:34.843054+0000","last_became_peered":"2024-05-10T11:16:34.843054+0000","last_unstale":"2024-05-10T11:16:36.591534+0000","last_undegraded":"2024-05-10T11:16:36.591534+0000","last_fullsized":"2024-05-10T11:16:36.591534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835940+0000","last_change":"2024-05-10T11:16:33.835940+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835940+0000","last_undegraded":"2024-05-10T11:16:33.835940+0000","last_fullsized":"2024-05-10T11:16:33.835940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832709+0000","last_change":"2024-05-10T11:16:34.854083+0000","last_active":"2024-05-10T11:16:35.832709+0000","last_peered":"2024-05-10T11:16:35.832709+0000","last_clean":"2024-05-10T11:16:35.832709+0000","last_became_active":"2024-05-10T11:16:34.853826+0000","last_became_peered":"2024-05-10T11:16:34.853826+0000","last_unstale":"2024-05-10T11:16:35.832709+0000","last_undegraded":"2024-05-10T11:16:35.832709+0000","last_fullsized":"2024-05-10T11:16:35.832709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:04.002857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834462+0000","last_change":"2024-05-10T11:16:33.834462+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834462+0000","last_undegraded":"2024-05-10T11:16:33.834462+0000","last_fullsized":"2024-05-10T11:16:33.834462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592763+0000","last_change":"2024-05-10T11:16:34.847152+0000","last_active":"2024-05-10T11:16:36.592763+0000","last_peered":"2024-05-10T11:16:36.592763+0000","last_clean":"2024-05-10T11:16:36.592763+0000","last_became_active":"2024-05-10T11:16:34.846613+0000","last_became_peered":"2024-05-10T11:16:34.846613+0000","last_unstale":"2024-05-10T11:16:36.592763+0000","last_undegraded":"2024-05-10T11:16:36.592763+0000","last_fullsized":"2024-05-10T11:16:36.592763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090713+0000","last_change":"2024-05-10T11:16:34.860674+0000","last_active":"2024-05-10T11:16:36.090713+0000","last_peered":"2024-05-10T11:16:36.090713+0000","last_clean":"2024-05-10T11:16:36.090713+0000","last_became_active":"2024-05-10T11:16:34.855401+0000","last_became_peered":"2024-05-10T11:16:34.855401+0000","last_unstale":"2024-05-10T11:16:36.090713+0000","last_undegraded":"2024-05-10T11:16:36.090713+0000","last_fullsized":"2024-05-10T11:16:36.090713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:37.966718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592638+0000","last_change":"2024-05-10T11:16:34.859258+0000","last_active":"2024-05-10T11:16:36.592638+0000","last_peered":"2024-05-10T11:16:36.592638+0000","last_clean":"2024-05-10T11:16:36.592638+0000","last_became_active":"2024-05-10T11:16:34.858948+0000","last_became_peered":"2024-05-10T11:16:34.858948+0000","last_unstale":"2024-05-10T11:16:36.592638+0000","last_undegraded":"2024-05-10T11:16:36.592638+0000","last_fullsized":"2024-05-10T11:16:36.592638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833033+0000","last_change":"2024-05-10T11:16:34.857125+0000","last_active":"2024-05-10T11:16:35.833033+0000","last_peered":"2024-05-10T11:16:35.833033+0000","last_clean":"2024-05-10T11:16:35.833033+0000","last_became_active":"2024-05-10T11:16:34.856827+0000","last_became_peered":"2024-05-10T11:16:34.856827+0000","last_unstale":"2024-05-10T11:16:35.833033+0000","last_undegraded":"2024-05-10T11:16:35.833033+0000","last_fullsized":"2024-05-10T11:16:35.833033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:43.061696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591465+0000","last_change":"2024-05-10T11:16:34.842679+0000","last_active":"2024-05-10T11:16:36.591465+0000","last_peered":"2024-05-10T11:16:36.591465+0000","last_clean":"2024-05-10T11:16:36.591465+0000","last_became_active":"2024-05-10T11:16:34.842419+0000","last_became_peered":"2024-05-10T11:16:34.842419+0000","last_unstale":"2024-05-10T11:16:36.591465+0000","last_undegraded":"2024-05-10T11:16:36.591465+0000","last_fullsized":"2024-05-10T11:16:36.591465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090384+0000","last_change":"2024-05-10T11:16:34.853761+0000","last_active":"2024-05-10T11:16:36.090384+0000","last_peered":"2024-05-10T11:16:36.090384+0000","last_clean":"2024-05-10T11:16:36.090384+0000","last_became_active":"2024-05-10T11:16:34.853449+0000","last_became_peered":"2024-05-10T11:16:34.853449+0000","last_unstale":"2024-05-10T11:16:36.090384+0000","last_undegraded":"2024-05-10T11:16:36.090384+0000","last_fullsized":"2024-05-10T11:16:36.090384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.839406+0000","last_change":"2024-05-10T11:16:33.839406+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.839406+0000","last_undegraded":"2024-05-10T11:16:33.839406+0000","last_fullsized":"2024-05-10T11:16:33.839406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833123+0000","last_change":"2024-05-10T11:16:34.849207+0000","last_active":"2024-05-10T11:16:35.833123+0000","last_peered":"2024-05-10T11:16:35.833123+0000","last_clean":"2024-05-10T11:16:35.833123+0000","last_became_active":"2024-05-10T11:16:34.848933+0000","last_became_peered":"2024-05-10T11:16:34.848933+0000","last_unstale":"2024-05-10T11:16:35.833123+0000","last_undegraded":"2024-05-10T11:16:35.833123+0000","last_fullsized":"2024-05-10T11:16:35.833123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:55.352398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834879+0000","last_change":"2024-05-10T11:16:34.851758+0000","last_active":"2024-05-10T11:16:35.834879+0000","last_peered":"2024-05-10T11:16:35.834879+0000","last_clean":"2024-05-10T11:16:35.834879+0000","last_became_active":"2024-05-10T11:16:34.851466+0000","last_became_peered":"2024-05-10T11:16:34.851466+0000","last_unstale":"2024-05-10T11:16:35.834879+0000","last_undegraded":"2024-05-10T11:16:35.834879+0000","last_fullsized":"2024-05-10T11:16:35.834879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.700792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591745+0000","last_change":"2024-05-10T11:16:34.846246+0000","last_active":"2024-05-10T11:16:36.591745+0000","last_peered":"2024-05-10T11:16:36.591745+0000","last_clean":"2024-05-10T11:16:36.591745+0000","last_became_active":"2024-05-10T11:16:34.845391+0000","last_became_peered":"2024-05-10T11:16:34.845391+0000","last_unstale":"2024-05-10T11:16:36.591745+0000","last_undegraded":"2024-05-10T11:16:36.591745+0000","last_fullsized":"2024-05-10T11:16:36.591745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833050+0000","last_change":"2024-05-10T11:16:34.860384+0000","last_active":"2024-05-10T11:16:35.833050+0000","last_peered":"2024-05-10T11:16:35.833050+0000","last_clean":"2024-05-10T11:16:35.833050+0000","last_became_active":"2024-05-10T11:16:34.860050+0000","last_became_peered":"2024-05-10T11:16:34.860050+0000","last_unstale":"2024-05-10T11:16:35.833050+0000","last_undegraded":"2024-05-10T11:16:35.833050+0000","last_fullsized":"2024-05-10T11:16:35.833050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:53.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834442+0000","last_change":"2024-05-10T11:16:33.834442+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834442+0000","last_undegraded":"2024-05-10T11:16:33.834442+0000","last_fullsized":"2024-05-10T11:16:33.834442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832837+0000","last_change":"2024-05-10T11:16:34.857747+0000","last_active":"2024-05-10T11:16:35.832837+0000","last_peered":"2024-05-10T11:16:35.832837+0000","last_clean":"2024-05-10T11:16:35.832837+0000","last_became_active":"2024-05-10T11:16:34.857437+0000","last_became_peered":"2024-05-10T11:16:34.857437+0000","last_unstale":"2024-05-10T11:16:35.832837+0000","last_undegraded":"2024-05-10T11:16:35.832837+0000","last_fullsized":"2024-05-10T11:16:35.832837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:14.230378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834080+0000","last_change":"2024-05-10T11:16:33.834080+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834080+0000","last_undegraded":"2024-05-10T11:16:33.834080+0000","last_fullsized":"2024-05-10T11:16:33.834080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090543+0000","last_change":"2024-05-10T11:16:34.845780+0000","last_active":"2024-05-10T11:16:36.090543+0000","last_peered":"2024-05-10T11:16:36.090543+0000","last_clean":"2024-05-10T11:16:36.090543+0000","last_became_active":"2024-05-10T11:16:34.845322+0000","last_became_peered":"2024-05-10T11:16:34.845322+0000","last_unstale":"2024-05-10T11:16:36.090543+0000","last_undegraded":"2024-05-10T11:16:36.090543+0000","last_fullsized":"2024-05-10T11:16:36.090543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:20.443512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090673+0000","last_change":"2024-05-10T11:16:34.854455+0000","last_active":"2024-05-10T11:16:36.090673+0000","last_peered":"2024-05-10T11:16:36.090673+0000","last_clean":"2024-05-10T11:16:36.090673+0000","last_became_active":"2024-05-10T11:16:34.854168+0000","last_became_peered":"2024-05-10T11:16:34.854168+0000","last_unstale":"2024-05-10T11:16:36.090673+0000","last_undegraded":"2024-05-10T11:16:36.090673+0000","last_fullsized":"2024-05-10T11:16:36.090673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:08.765130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592820+0000","last_change":"2024-05-10T11:16:34.849031+0000","last_active":"2024-05-10T11:16:36.592820+0000","last_peered":"2024-05-10T11:16:36.592820+0000","last_clean":"2024-05-10T11:16:36.592820+0000","last_became_active":"2024-05-10T11:16:34.848672+0000","last_became_peered":"2024-05-10T11:16:34.848672+0000","last_unstale":"2024-05-10T11:16:36.592820+0000","last_undegraded":"2024-05-10T11:16:36.592820+0000","last_fullsized":"2024-05-10T11:16:36.592820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.840009+0000","last_change":"2024-05-10T11:16:33.840009+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.840009+0000","last_undegraded":"2024-05-10T11:16:33.840009+0000","last_fullsized":"2024-05-10T11:16:33.840009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:34.856389+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:34.856031+0000","last_became_peered":"2024-05-10T11:16:34.856031+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:45.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090474+0000","last_change":"2024-05-10T11:16:34.846202+0000","last_active":"2024-05-10T11:16:36.090474+0000","last_peered":"2024-05-10T11:16:36.090474+0000","last_clean":"2024-05-10T11:16:36.090474+0000","last_became_active":"2024-05-10T11:16:34.844252+0000","last_became_peered":"2024-05-10T11:16:34.844252+0000","last_unstale":"2024-05-10T11:16:36.090474+0000","last_undegraded":"2024-05-10T11:16:36.090474+0000","last_fullsized":"2024-05-10T11:16:36.090474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.837932+0000","last_change":"2024-05-10T11:16:33.837932+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.837932+0000","last_undegraded":"2024-05-10T11:16:33.837932+0000","last_fullsized":"2024-05-10T11:16:33.837932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834602+0000","last_change":"2024-05-10T11:16:34.851184+0000","last_active":"2024-05-10T11:16:35.834602+0000","last_peered":"2024-05-10T11:16:35.834602+0000","last_clean":"2024-05-10T11:16:35.834602+0000","last_became_active":"2024-05-10T11:16:34.850836+0000","last_became_peered":"2024-05-10T11:16:34.850836+0000","last_unstale":"2024-05-10T11:16:35.834602+0000","last_undegraded":"2024-05-10T11:16:35.834602+0000","last_fullsized":"2024-05-10T11:16:35.834602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:48.282472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838234+0000","last_change":"2024-05-10T11:16:33.838234+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838234+0000","last_undegraded":"2024-05-10T11:16:33.838234+0000","last_fullsized":"2024-05-10T11:16:33.838234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834526+0000","last_change":"2024-05-10T11:16:34.851721+0000","last_active":"2024-05-10T11:16:35.834526+0000","last_peered":"2024-05-10T11:16:35.834526+0000","last_clean":"2024-05-10T11:16:35.834526+0000","last_became_active":"2024-05-10T11:16:34.851415+0000","last_became_peered":"2024-05-10T11:16:34.851415+0000","last_unstale":"2024-05-10T11:16:35.834526+0000","last_undegraded":"2024-05-10T11:16:35.834526+0000","last_fullsized":"2024-05-10T11:16:35.834526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833093+0000","last_change":"2024-05-10T11:16:33.849083+0000","last_active":"2024-05-10T11:16:35.833093+0000","last_peered":"2024-05-10T11:16:35.833093+0000","last_clean":"2024-05-10T11:16:35.833093+0000","last_became_active":"2024-05-10T11:16:33.848804+0000","last_became_peered":"2024-05-10T11:16:33.848804+0000","last_unstale":"2024-05-10T11:16:35.833093+0000","last_undegraded":"2024-05-10T11:16:35.833093+0000","last_fullsized":"2024-05-10T11:16:35.833093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:16.316656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090374+0000","last_change":"2024-05-10T11:16:34.849023+0000","last_active":"2024-05-10T11:16:36.090374+0000","last_peered":"2024-05-10T11:16:36.090374+0000","last_clean":"2024-05-10T11:16:36.090374+0000","last_became_active":"2024-05-10T11:16:34.848690+0000","last_became_peered":"2024-05-10T11:16:34.848690+0000","last_unstale":"2024-05-10T11:16:36.090374+0000","last_undegraded":"2024-05-10T11:16:36.090374+0000","last_fullsized":"2024-05-10T11:16:36.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849850+0000","last_change":"2024-05-10T11:16:33.848383+0000","last_active":"2024-05-10T11:16:33.849850+0000","last_peered":"2024-05-10T11:16:33.849850+0000","last_clean":"2024-05-10T11:16:33.849850+0000","last_became_active":"2024-05-10T11:16:33.847992+0000","last_became_peered":"2024-05-10T11:16:33.847992+0000","last_unstale":"2024-05-10T11:16:33.849850+0000","last_undegraded":"2024-05-10T11:16:33.849850+0000","last_fullsized":"2024-05-10T11:16:33.849850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:52:45.317209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833877+0000","last_change":"2024-05-10T11:16:33.833877+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833877+0000","last_undegraded":"2024-05-10T11:16:33.833877+0000","last_fullsized":"2024-05-10T11:16:33.833877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.855465+0000","last_change":"2024-05-10T11:16:33.851782+0000","last_active":"2024-05-10T11:16:33.855465+0000","last_peered":"2024-05-10T11:16:33.855465+0000","last_clean":"2024-05-10T11:16:33.855465+0000","last_became_active":"2024-05-10T11:16:33.851519+0000","last_became_peered":"2024-05-10T11:16:33.851519+0000","last_unstale":"2024-05-10T11:16:33.855465+0000","last_undegraded":"2024-05-10T11:16:33.855465+0000","last_fullsized":"2024-05-10T11:16:33.855465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:59.419313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833933+0000","last_change":"2024-05-10T11:16:33.833933+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833933+0000","last_undegraded":"2024-05-10T11:16:33.833933+0000","last_fullsized":"2024-05-10T11:16:33.833933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.846451+0000","last_change":"2024-05-10T11:16:33.845477+0000","last_active":"2024-05-10T11:16:33.846451+0000","last_peered":"2024-05-10T11:16:33.846451+0000","last_clean":"2024-05-10T11:16:33.846451+0000","last_became_active":"2024-05-10T11:16:33.845155+0000","last_became_peered":"2024-05-10T11:16:33.845155+0000","last_unstale":"2024-05-10T11:16:33.846451+0000","last_undegraded":"2024-05-10T11:16:33.846451+0000","last_fullsized":"2024-05-10T11:16:33.846451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:03.730186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090601+0000","last_change":"2024-05-10T11:16:34.864666+0000","last_active":"2024-05-10T11:16:36.090601+0000","last_peered":"2024-05-10T11:16:36.090601+0000","last_clean":"2024-05-10T11:16:36.090601+0000","last_became_active":"2024-05-10T11:16:34.864410+0000","last_became_peered":"2024-05-10T11:16:34.864410+0000","last_unstale":"2024-05-10T11:16:36.090601+0000","last_undegraded":"2024-05-10T11:16:36.090601+0000","last_fullsized":"2024-05-10T11:16:36.090601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:56.782670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.845858+0000","last_change":"2024-05-10T11:16:33.844658+0000","last_active":"2024-05-10T11:16:33.845858+0000","last_peered":"2024-05-10T11:16:33.845858+0000","last_clean":"2024-05-10T11:16:33.845858+0000","last_became_active":"2024-05-10T11:16:33.844370+0000","last_became_peered":"2024-05-10T11:16:33.844370+0000","last_unstale":"2024-05-10T11:16:33.845858+0000","last_undegraded":"2024-05-10T11:16:33.845858+0000","last_fullsized":"2024-05-10T11:16:33.845858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:10:44.548947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090787+0000","last_change":"2024-05-10T11:16:34.844211+0000","last_active":"2024-05-10T11:16:36.090787+0000","last_peered":"2024-05-10T11:16:36.090787+0000","last_clean":"2024-05-10T11:16:36.090787+0000","last_became_active":"2024-05-10T11:16:34.843830+0000","last_became_peered":"2024-05-10T11:16:34.843830+0000","last_unstale":"2024-05-10T11:16:36.090787+0000","last_undegraded":"2024-05-10T11:16:36.090787+0000","last_fullsized":"2024-05-10T11:16:36.090787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:52.427590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591559+0000","last_change":"2024-05-10T11:16:33.839972+0000","last_active":"2024-05-10T11:16:36.591559+0000","last_peered":"2024-05-10T11:16:36.591559+0000","last_clean":"2024-05-10T11:16:36.591559+0000","last_became_active":"2024-05-10T11:16:33.839660+0000","last_became_peered":"2024-05-10T11:16:33.839660+0000","last_unstale":"2024-05-10T11:16:36.591559+0000","last_undegraded":"2024-05-10T11:16:36.591559+0000","last_fullsized":"2024-05-10T11:16:36.591559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:34.138529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833956+0000","last_change":"2024-05-10T11:16:33.833956+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833956+0000","last_undegraded":"2024-05-10T11:16:33.833956+0000","last_fullsized":"2024-05-10T11:16:33.833956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090486+0000","last_change":"2024-05-10T11:16:33.849599+0000","last_active":"2024-05-10T11:16:36.090486+0000","last_peered":"2024-05-10T11:16:36.090486+0000","last_clean":"2024-05-10T11:16:36.090486+0000","last_became_active":"2024-05-10T11:16:33.849241+0000","last_became_peered":"2024-05-10T11:16:33.849241+0000","last_unstale":"2024-05-10T11:16:36.090486+0000","last_undegraded":"2024-05-10T11:16:36.090486+0000","last_fullsized":"2024-05-10T11:16:36.090486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:50.691422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838990+0000","last_change":"2024-05-10T11:16:33.838990+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838990+0000","last_undegraded":"2024-05-10T11:16:33.838990+0000","last_fullsized":"2024-05-10T11:16:33.838990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832783+0000","last_change":"2024-05-10T11:16:33.850927+0000","last_active":"2024-05-10T11:16:35.832783+0000","last_peered":"2024-05-10T11:16:35.832783+0000","last_clean":"2024-05-10T11:16:35.832783+0000","last_became_active":"2024-05-10T11:16:33.850620+0000","last_became_peered":"2024-05-10T11:16:33.850620+0000","last_unstale":"2024-05-10T11:16:35.832783+0000","last_undegraded":"2024-05-10T11:16:35.832783+0000","last_fullsized":"2024-05-10T11:16:35.832783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:31.969039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090316+0000","last_change":"2024-05-10T11:16:34.839538+0000","last_active":"2024-05-10T11:16:36.090316+0000","last_peered":"2024-05-10T11:16:36.090316+0000","last_clean":"2024-05-10T11:16:36.090316+0000","last_became_active":"2024-05-10T11:16:34.839244+0000","last_became_peered":"2024-05-10T11:16:34.839244+0000","last_unstale":"2024-05-10T11:16:36.090316+0000","last_undegraded":"2024-05-10T11:16:36.090316+0000","last_fullsized":"2024-05-10T11:16:36.090316+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849187+0000","last_change":"2024-05-10T11:16:33.847120+0000","last_active":"2024-05-10T11:16:33.849187+0000","last_peered":"2024-05-10T11:16:33.849187+0000","last_clean":"2024-05-10T11:16:33.849187+0000","last_became_active":"2024-05-10T11:16:33.846773+0000","last_became_peered":"2024-05-10T11:16:33.846773+0000","last_unstale":"2024-05-10T11:16:33.849187+0000","last_undegraded":"2024-05-10T11:16:33.849187+0000","last_fullsized":"2024-05-10T11:16:33.849187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:00.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591488+0000","last_change":"2024-05-10T11:16:34.843679+0000","last_active":"2024-05-10T11:16:36.591488+0000","last_peered":"2024-05-10T11:16:36.591488+0000","last_clean":"2024-05-10T11:16:36.591488+0000","last_became_active":"2024-05-10T11:16:34.843383+0000","last_became_peered":"2024-05-10T11:16:34.843383+0000","last_unstale":"2024-05-10T11:16:36.591488+0000","last_undegraded":"2024-05-10T11:16:36.591488+0000","last_fullsized":"2024-05-10T11:16:36.591488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:09.348219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592877+0000","last_change":"2024-05-10T11:16:33.841357+0000","last_active":"2024-05-10T11:16:36.592877+0000","last_peered":"2024-05-10T11:16:36.592877+0000","last_clean":"2024-05-10T11:16:36.592877+0000","last_became_active":"2024-05-10T11:16:33.841097+0000","last_became_peered":"2024-05-10T11:16:33.841097+0000","last_unstale":"2024-05-10T11:16:36.592877+0000","last_undegraded":"2024-05-10T11:16:36.592877+0000","last_fullsized":"2024-05-10T11:16:36.592877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591637+0000","last_change":"2024-05-10T11:16:34.859325+0000","last_active":"2024-05-10T11:16:36.591637+0000","last_peered":"2024-05-10T11:16:36.591637+0000","last_clean":"2024-05-10T11:16:36.591637+0000","last_became_active":"2024-05-10T11:16:34.859028+0000","last_became_peered":"2024-05-10T11:16:34.859028+0000","last_unstale":"2024-05-10T11:16:36.591637+0000","last_undegraded":"2024-05-10T11:16:36.591637+0000","last_fullsized":"2024-05-10T11:16:36.591637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833154+0000","last_change":"2024-05-10T11:16:33.850700+0000","last_active":"2024-05-10T11:16:35.833154+0000","last_peered":"2024-05-10T11:16:35.833154+0000","last_clean":"2024-05-10T11:16:35.833154+0000","last_became_active":"2024-05-10T11:16:33.850423+0000","last_became_peered":"2024-05-10T11:16:33.850423+0000","last_unstale":"2024-05-10T11:16:35.833154+0000","last_undegraded":"2024-05-10T11:16:35.833154+0000","last_fullsized":"2024-05-10T11:16:35.833154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:53.739455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834766+0000","last_change":"2024-05-10T11:16:34.863940+0000","last_active":"2024-05-10T11:16:35.834766+0000","last_peered":"2024-05-10T11:16:35.834766+0000","last_clean":"2024-05-10T11:16:35.834766+0000","last_became_active":"2024-05-10T11:16:34.863635+0000","last_became_peered":"2024-05-10T11:16:34.863635+0000","last_unstale":"2024-05-10T11:16:35.834766+0000","last_undegraded":"2024-05-10T11:16:35.834766+0000","last_fullsized":"2024-05-10T11:16:35.834766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:19.129956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.842101+0000","last_change":"2024-05-10T11:16:33.840650+0000","last_active":"2024-05-10T11:16:33.842101+0000","last_peered":"2024-05-10T11:16:33.842101+0000","last_clean":"2024-05-10T11:16:33.842101+0000","last_became_active":"2024-05-10T11:16:33.840327+0000","last_became_peered":"2024-05-10T11:16:33.840327+0000","last_unstale":"2024-05-10T11:16:33.842101+0000","last_undegraded":"2024-05-10T11:16:33.842101+0000","last_fullsized":"2024-05-10T11:16:33.842101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:47.931535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592546+0000","last_change":"2024-05-10T11:16:34.854844+0000","last_active":"2024-05-10T11:16:36.592546+0000","last_peered":"2024-05-10T11:16:36.592546+0000","last_clean":"2024-05-10T11:16:36.592546+0000","last_became_active":"2024-05-10T11:16:34.854522+0000","last_became_peered":"2024-05-10T11:16:34.854522+0000","last_unstale":"2024-05-10T11:16:36.592546+0000","last_undegraded":"2024-05-10T11:16:36.592546+0000","last_fullsized":"2024-05-10T11:16:36.592546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:58.379390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591480+0000","last_change":"2024-05-10T11:16:33.834877+0000","last_active":"2024-05-10T11:16:36.591480+0000","last_peered":"2024-05-10T11:16:36.591480+0000","last_clean":"2024-05-10T11:16:36.591480+0000","last_became_active":"2024-05-10T11:16:33.834597+0000","last_became_peered":"2024-05-10T11:16:33.834597+0000","last_unstale":"2024-05-10T11:16:36.591480+0000","last_undegraded":"2024-05-10T11:16:36.591480+0000","last_fullsized":"2024-05-10T11:16:36.591480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836394+0000","last_change":"2024-05-10T11:16:33.836394+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836394+0000","last_undegraded":"2024-05-10T11:16:33.836394+0000","last_fullsized":"2024-05-10T11:16:33.836394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.855479+0000","last_change":"2024-05-10T11:16:33.852289+0000","last_active":"2024-05-10T11:16:33.855479+0000","last_peered":"2024-05-10T11:16:33.855479+0000","last_clean":"2024-05-10T11:16:33.855479+0000","last_became_active":"2024-05-10T11:16:33.852005+0000","last_became_peered":"2024-05-10T11:16:33.852005+0000","last_unstale":"2024-05-10T11:16:33.855479+0000","last_undegraded":"2024-05-10T11:16:33.855479+0000","last_fullsized":"2024-05-10T11:16:33.855479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:26.675655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836061+0000","last_change":"2024-05-10T11:16:33.836061+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836061+0000","last_undegraded":"2024-05-10T11:16:33.836061+0000","last_fullsized":"2024-05-10T11:16:33.836061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832731+0000","last_change":"2024-05-10T11:16:33.851756+0000","last_active":"2024-05-10T11:16:35.832731+0000","last_peered":"2024-05-10T11:16:35.832731+0000","last_clean":"2024-05-10T11:16:35.832731+0000","last_became_active":"2024-05-10T11:16:33.851459+0000","last_became_peered":"2024-05-10T11:16:33.851459+0000","last_unstale":"2024-05-10T11:16:35.832731+0000","last_undegraded":"2024-05-10T11:16:35.832731+0000","last_fullsized":"2024-05-10T11:16:35.832731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:00.512992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.837011+0000","last_change":"2024-05-10T11:16:33.837011+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.837011+0000","last_undegraded":"2024-05-10T11:16:33.837011+0000","last_fullsized":"2024-05-10T11:16:33.837011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090447+0000","last_change":"2024-05-10T11:16:33.845959+0000","last_active":"2024-05-10T11:16:36.090447+0000","last_peered":"2024-05-10T11:16:36.090447+0000","last_clean":"2024-05-10T11:16:36.090447+0000","last_became_active":"2024-05-10T11:16:33.845331+0000","last_became_peered":"2024-05-10T11:16:33.845331+0000","last_unstale":"2024-05-10T11:16:36.090447+0000","last_undegraded":"2024-05-10T11:16:36.090447+0000","last_fullsized":"2024-05-10T11:16:36.090447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:45.491433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591231+0000","last_change":"2024-05-10T11:16:34.852456+0000","last_active":"2024-05-10T11:16:36.591231+0000","last_peered":"2024-05-10T11:16:36.591231+0000","last_clean":"2024-05-10T11:16:36.591231+0000","last_became_active":"2024-05-10T11:16:34.852136+0000","last_became_peered":"2024-05-10T11:16:34.852136+0000","last_unstale":"2024-05-10T11:16:36.591231+0000","last_undegraded":"2024-05-10T11:16:36.591231+0000","last_fullsized":"2024-05-10T11:16:36.591231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849165+0000","last_change":"2024-05-10T11:16:33.847150+0000","last_active":"2024-05-10T11:16:33.849165+0000","last_peered":"2024-05-10T11:16:33.849165+0000","last_clean":"2024-05-10T11:16:33.849165+0000","last_became_active":"2024-05-10T11:16:33.846903+0000","last_became_peered":"2024-05-10T11:16:33.846903+0000","last_unstale":"2024-05-10T11:16:33.849165+0000","last_undegraded":"2024-05-10T11:16:33.849165+0000","last_fullsized":"2024-05-10T11:16:33.849165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:11.657121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832695+0000","last_change":"2024-05-10T11:16:34.845165+0000","last_active":"2024-05-10T11:16:35.832695+0000","last_peered":"2024-05-10T11:16:35.832695+0000","last_clean":"2024-05-10T11:16:35.832695+0000","last_became_active":"2024-05-10T11:16:34.844886+0000","last_became_peered":"2024-05-10T11:16:34.844886+0000","last_unstale":"2024-05-10T11:16:35.832695+0000","last_undegraded":"2024-05-10T11:16:35.832695+0000","last_fullsized":"2024-05-10T11:16:35.832695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:15.505458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.845224+0000","last_change":"2024-05-10T11:16:33.840287+0000","last_active":"2024-05-10T11:16:33.845224+0000","last_peered":"2024-05-10T11:16:33.845224+0000","last_clean":"2024-05-10T11:16:33.845224+0000","last_became_active":"2024-05-10T11:16:33.840016+0000","last_became_peered":"2024-05-10T11:16:33.840016+0000","last_unstale":"2024-05-10T11:16:33.845224+0000","last_undegraded":"2024-05-10T11:16:33.845224+0000","last_fullsized":"2024-05-10T11:16:33.845224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:21.018784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832710+0000","last_change":"2024-05-10T11:16:34.857683+0000","last_active":"2024-05-10T11:16:35.832710+0000","last_peered":"2024-05-10T11:16:35.832710+0000","last_clean":"2024-05-10T11:16:35.832710+0000","last_became_active":"2024-05-10T11:16:34.857411+0000","last_became_peered":"2024-05-10T11:16:34.857411+0000","last_unstale":"2024-05-10T11:16:35.832710+0000","last_undegraded":"2024-05-10T11:16:35.832710+0000","last_fullsized":"2024-05-10T11:16:35.832710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:04.078921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:33.849638+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:33.849383+0000","last_became_peered":"2024-05-10T11:16:33.849383+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.217874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591483+0000","last_change":"2024-05-10T11:16:34.861019+0000","last_active":"2024-05-10T11:16:36.591483+0000","last_peered":"2024-05-10T11:16:36.591483+0000","last_clean":"2024-05-10T11:16:36.591483+0000","last_became_active":"2024-05-10T11:16:34.860667+0000","last_became_peered":"2024-05-10T11:16:34.860667+0000","last_unstale":"2024-05-10T11:16:36.591483+0000","last_undegraded":"2024-05-10T11:16:36.591483+0000","last_fullsized":"2024-05-10T11:16:36.591483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834612+0000","last_change":"2024-05-10T11:16:33.851897+0000","last_active":"2024-05-10T11:16:35.834612+0000","last_peered":"2024-05-10T11:16:35.834612+0000","last_clean":"2024-05-10T11:16:35.834612+0000","last_became_active":"2024-05-10T11:16:33.851629+0000","last_became_peered":"2024-05-10T11:16:33.851629+0000","last_unstale":"2024-05-10T11:16:35.834612+0000","last_undegraded":"2024-05-10T11:16:35.834612+0000","last_fullsized":"2024-05-10T11:16:35.834612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:02.785863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090623+0000","last_change":"2024-05-10T11:16:34.849709+0000","last_active":"2024-05-10T11:16:36.090623+0000","last_peered":"2024-05-10T11:16:36.090623+0000","last_clean":"2024-05-10T11:16:36.090623+0000","last_became_active":"2024-05-10T11:16:34.849412+0000","last_became_peered":"2024-05-10T11:16:34.849412+0000","last_unstale":"2024-05-10T11:16:36.090623+0000","last_undegraded":"2024-05-10T11:16:36.090623+0000","last_fullsized":"2024-05-10T11:16:36.090623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:09.452662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591486+0000","last_change":"2024-05-10T11:16:33.840818+0000","last_active":"2024-05-10T11:16:36.591486+0000","last_peered":"2024-05-10T11:16:36.591486+0000","last_clean":"2024-05-10T11:16:36.591486+0000","last_became_active":"2024-05-10T11:16:33.840472+0000","last_became_peered":"2024-05-10T11:16:33.840472+0000","last_unstale":"2024-05-10T11:16:36.591486+0000","last_undegraded":"2024-05-10T11:16:36.591486+0000","last_fullsized":"2024-05-10T11:16:36.591486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:36:21.942433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090750+0000","last_change":"2024-05-10T11:16:34.848027+0000","last_active":"2024-05-10T11:16:36.090750+0000","last_peered":"2024-05-10T11:16:36.090750+0000","last_clean":"2024-05-10T11:16:36.090750+0000","last_became_active":"2024-05-10T11:16:34.846208+0000","last_became_peered":"2024-05-10T11:16:34.846208+0000","last_unstale":"2024-05-10T11:16:36.090750+0000","last_undegraded":"2024-05-10T11:16:36.090750+0000","last_fullsized":"2024-05-10T11:16:36.090750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:21.557365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591275+0000","last_change":"2024-05-10T11:16:33.843809+0000","last_active":"2024-05-10T11:16:36.591275+0000","last_peered":"2024-05-10T11:16:36.591275+0000","last_clean":"2024-05-10T11:16:36.591275+0000","last_became_active":"2024-05-10T11:16:33.843314+0000","last_became_peered":"2024-05-10T11:16:33.843314+0000","last_unstale":"2024-05-10T11:16:36.591275+0000","last_undegraded":"2024-05-10T11:16:36.591275+0000","last_fullsized":"2024-05-10T11:16:36.591275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836481+0000","last_change":"2024-05-10T11:16:33.836481+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836481+0000","last_undegraded":"2024-05-10T11:16:33.836481+0000","last_fullsized":"2024-05-10T11:16:33.836481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591160+0000","last_change":"2024-05-10T11:16:33.842957+0000","last_active":"2024-05-10T11:16:36.591160+0000","last_peered":"2024-05-10T11:16:36.591160+0000","last_clean":"2024-05-10T11:16:36.591160+0000","last_became_active":"2024-05-10T11:16:33.842675+0000","last_became_peered":"2024-05-10T11:16:33.842675+0000","last_unstale":"2024-05-10T11:16:36.591160+0000","last_undegraded":"2024-05-10T11:16:36.591160+0000","last_fullsized":"2024-05-10T11:16:36.591160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833230+0000","last_change":"2024-05-10T11:16:33.833230+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833230+0000","last_undegraded":"2024-05-10T11:16:33.833230+0000","last_fullsized":"2024-05-10T11:16:33.833230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592665+0000","last_change":"2024-05-10T11:16:33.839202+0000","last_active":"2024-05-10T11:16:36.592665+0000","last_peered":"2024-05-10T11:16:36.592665+0000","last_clean":"2024-05-10T11:16:36.592665+0000","last_became_active":"2024-05-10T11:16:33.838582+0000","last_became_peered":"2024-05-10T11:16:33.838582+0000","last_unstale":"2024-05-10T11:16:36.592665+0000","last_undegraded":"2024-05-10T11:16:36.592665+0000","last_fullsized":"2024-05-10T11:16:36.592665+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835469+0000","last_change":"2024-05-10T11:16:33.835469+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835469+0000","last_undegraded":"2024-05-10T11:16:33.835469+0000","last_fullsized":"2024-05-10T11:16:33.835469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.837136+0000","last_change":"2024-05-10T11:16:33.850966+0000","last_active":"2024-05-10T11:16:36.837136+0000","last_peered":"2024-05-10T11:16:36.837136+0000","last_clean":"2024-05-10T11:16:36.837136+0000","last_became_active":"2024-05-10T11:16:33.850661+0000","last_became_peered":"2024-05-10T11:16:33.850661+0000","last_unstale":"2024-05-10T11:16:36.837136+0000","last_undegraded":"2024-05-10T11:16:36.837136+0000","last_fullsized":"2024-05-10T11:16:36.837136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833362+0000","last_change":"2024-05-10T11:16:33.833362+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833362+0000","last_undegraded":"2024-05-10T11:16:33.833362+0000","last_fullsized":"2024-05-10T11:16:33.833362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849780+0000","last_change":"2024-05-10T11:16:33.848721+0000","last_active":"2024-05-10T11:16:33.849780+0000","last_peered":"2024-05-10T11:16:33.849780+0000","last_clean":"2024-05-10T11:16:33.849780+0000","last_became_active":"2024-05-10T11:16:33.848429+0000","last_became_peered":"2024-05-10T11:16:33.848429+0000","last_unstale":"2024-05-10T11:16:33.849780+0000","last_undegraded":"2024-05-10T11:16:33.849780+0000","last_fullsized":"2024-05-10T11:16:33.849780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:35.587792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090506+0000","last_change":"2024-05-10T11:16:34.846463+0000","last_active":"2024-05-10T11:16:36.090506+0000","last_peered":"2024-05-10T11:16:36.090506+0000","last_clean":"2024-05-10T11:16:36.090506+0000","last_became_active":"2024-05-10T11:16:34.845916+0000","last_became_peered":"2024-05-10T11:16:34.845916+0000","last_unstale":"2024-05-10T11:16:36.090506+0000","last_undegraded":"2024-05-10T11:16:36.090506+0000","last_fullsized":"2024-05-10T11:16:36.090506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:18.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849749+0000","last_change":"2024-05-10T11:16:33.848344+0000","last_active":"2024-05-10T11:16:33.849749+0000","last_peered":"2024-05-10T11:16:33.849749+0000","last_clean":"2024-05-10T11:16:33.849749+0000","last_became_active":"2024-05-10T11:16:33.848071+0000","last_became_peered":"2024-05-10T11:16:33.848071+0000","last_unstale":"2024-05-10T11:16:33.849749+0000","last_undegraded":"2024-05-10T11:16:33.849749+0000","last_fullsized":"2024-05-10T11:16:33.849749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:47.025785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836200+0000","last_change":"2024-05-10T11:16:33.836200+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836200+0000","last_undegraded":"2024-05-10T11:16:33.836200+0000","last_fullsized":"2024-05-10T11:16:33.836200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.844599+0000","last_change":"2024-05-10T11:16:33.842583+0000","last_active":"2024-05-10T11:16:33.844599+0000","last_peered":"2024-05-10T11:16:33.844599+0000","last_clean":"2024-05-10T11:16:33.844599+0000","last_became_active":"2024-05-10T11:16:33.842298+0000","last_became_peered":"2024-05-10T11:16:33.842298+0000","last_unstale":"2024-05-10T11:16:33.844599+0000","last_undegraded":"2024-05-10T11:16:33.844599+0000","last_fullsized":"2024-05-10T11:16:33.844599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:13.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835379+0000","last_change":"2024-05-10T11:16:33.835379+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835379+0000","last_undegraded":"2024-05-10T11:16:33.835379+0000","last_fullsized":"2024-05-10T11:16:33.835379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832824+0000","last_change":"2024-05-10T11:16:33.851549+0000","last_active":"2024-05-10T11:16:35.832824+0000","last_peered":"2024-05-10T11:16:35.832824+0000","last_clean":"2024-05-10T11:16:35.832824+0000","last_became_active":"2024-05-10T11:16:33.851206+0000","last_became_peered":"2024-05-10T11:16:33.851206+0000","last_unstale":"2024-05-10T11:16:35.832824+0000","last_undegraded":"2024-05-10T11:16:35.832824+0000","last_fullsized":"2024-05-10T11:16:35.832824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:02.953747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834995+0000","last_change":"2024-05-10T11:16:34.863061+0000","last_active":"2024-05-10T11:16:35.834995+0000","last_peered":"2024-05-10T11:16:35.834995+0000","last_clean":"2024-05-10T11:16:35.834995+0000","last_became_active":"2024-05-10T11:16:34.862777+0000","last_became_peered":"2024-05-10T11:16:34.862777+0000","last_unstale":"2024-05-10T11:16:35.834995+0000","last_undegraded":"2024-05-10T11:16:35.834995+0000","last_fullsized":"2024-05-10T11:16:35.834995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:35.147899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.844011+0000","last_change":"2024-05-10T11:16:33.841766+0000","last_active":"2024-05-10T11:16:33.844011+0000","last_peered":"2024-05-10T11:16:33.844011+0000","last_clean":"2024-05-10T11:16:33.844011+0000","last_became_active":"2024-05-10T11:16:33.841421+0000","last_became_peered":"2024-05-10T11:16:33.841421+0000","last_unstale":"2024-05-10T11:16:33.844011+0000","last_undegraded":"2024-05-10T11:16:33.844011+0000","last_fullsized":"2024-05-10T11:16:33.844011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:24.900761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834983+0000","last_change":"2024-05-10T11:16:34.851996+0000","last_active":"2024-05-10T11:16:35.834983+0000","last_peered":"2024-05-10T11:16:35.834983+0000","last_clean":"2024-05-10T11:16:35.834983+0000","last_became_active":"2024-05-10T11:16:34.851659+0000","last_became_peered":"2024-05-10T11:16:34.851659+0000","last_unstale":"2024-05-10T11:16:35.834983+0000","last_undegraded":"2024-05-10T11:16:35.834983+0000","last_fullsized":"2024-05-10T11:16:35.834983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:35.838012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834471+0000","last_change":"2024-05-10T11:16:33.840847+0000","last_active":"2024-05-10T11:16:35.834471+0000","last_peered":"2024-05-10T11:16:35.834471+0000","last_clean":"2024-05-10T11:16:35.834471+0000","last_became_active":"2024-05-10T11:16:33.840336+0000","last_became_peered":"2024-05-10T11:16:33.840336+0000","last_unstale":"2024-05-10T11:16:35.834471+0000","last_undegraded":"2024-05-10T11:16:35.834471+0000","last_fullsized":"2024-05-10T11:16:35.834471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:57.998358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838344+0000","last_change":"2024-05-10T11:16:33.838344+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838344+0000","last_undegraded":"2024-05-10T11:16:33.838344+0000","last_fullsized":"2024-05-10T11:16:33.838344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591763+0000","last_change":"2024-05-10T11:16:33.841956+0000","last_active":"2024-05-10T11:16:36.591763+0000","last_peered":"2024-05-10T11:16:36.591763+0000","last_clean":"2024-05-10T11:16:36.591763+0000","last_became_active":"2024-05-10T11:16:33.841606+0000","last_became_peered":"2024-05-10T11:16:33.841606+0000","last_unstale":"2024-05-10T11:16:36.591763+0000","last_undegraded":"2024-05-10T11:16:36.591763+0000","last_fullsized":"2024-05-10T11:16:36.591763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:56.319173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.841064+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:16:33.841064+0000","last_peered":"2024-05-10T11:16:33.841064+0000","last_clean":"2024-05-10T11:16:33.841064+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:16:33.841064+0000","last_undegraded":"2024-05-10T11:16:33.841064+0000","last_fullsized":"2024-05-10T11:16:33.841064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":988031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":397663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":397663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":418931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":418301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1515520,"data_stored":1008557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":411531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:16:39.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:16:39.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.403+0000 7f144e02a640 1 Processor -- start 2024-05-10T11:16:39.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.403+0000 7f144e02a640 1 -- start start 2024-05-10T11:16:39.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.404+0000 7f144e02a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1448162940 0x7f14480b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.404+0000 7f144e02a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14480d59d0 0x7f14480d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.404+0000 7f144e02a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14480d2d20 con 0x7f14480b47a0 2024-05-10T11:16:39.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.404+0000 7f144e02a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1448162d20 con 0x7f1448162940 2024-05-10T11:16:39.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.404+0000 7f144e02a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14480d3000 con 0x7f14480d59d0 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14480d59d0 0x7f14480d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1448162940 0x7f14480b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1448162940 0x7f14480b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:57712/0 (socket says 172.21.15.66:57712) 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 -- 172.21.15.66:0/2245055081 learned_addr learned my addr 172.21.15.66:0/2245055081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f1447fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f14480b47a0 0x7f1448162f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:57270/0 (socket says 172.21.15.66:57270) 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 -- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14480d59d0 msgr2=0x7f14480d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 --2- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14480d59d0 0x7f14480d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 -- 172.21.15.66:0/2245055081 >> v1:172.21.15.190:6789/0 conn(0x7f14480b47a0 legacy=0x7f1448162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f14477fe640 1 -- 172.21.15.66:0/2245055081 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14480d32e0 con 0x7f1448162940 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.405+0000 7f1446ffd640 1 --2- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14480d59d0 0x7f14480d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.406+0000 7f14477fe640 1 --2- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1448162940 0x7f14480b5e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1438009870 tx=0x7f143802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1417961f60a3d9de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.406+0000 7f14467fc640 1 -- 172.21.15.66:0/2245055081 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438037070 con 0x7f1448162940 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.406+0000 7f14467fc640 1 -- 172.21.15.66:0/2245055081 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1438032440 con 0x7f1448162940 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.406+0000 7f14467fc640 1 -- 172.21.15.66:0/2245055081 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438032810 con 0x7f1448162940 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.406+0000 7f144e02a640 1 -- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1448162940 msgr2=0x7f14480b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.406+0000 7f144e02a640 1 --2- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1448162940 0x7f14480b5e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1438009870 tx=0x7f143802a130 comp rx=0 tx=0).stop 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.407+0000 7f144e02a640 1 -- 172.21.15.66:0/2245055081 shutdown_connections 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.407+0000 7f144e02a640 1 --2- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14480d59d0 0x7f14480d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.407+0000 7f144e02a640 1 --2- 172.21.15.66:0/2245055081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1448162940 0x7f14480b5e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.407+0000 7f144e02a640 1 -- 172.21.15.66:0/2245055081 >> 172.21.15.66:0/2245055081 conn(0x7f144809e380 msgr2=0x7f14480d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.407+0000 7f144e02a640 1 -- 172.21.15.66:0/2245055081 shutdown_connections 2024-05-10T11:16:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.407+0000 7f144e02a640 1 -- 172.21.15.66:0/2245055081 wait complete. 2024-05-10T11:16:39.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.408+0000 7f144e02a640 1 Processor -- start 2024-05-10T11:16:39.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.408+0000 7f144e02a640 1 -- start start 2024-05-10T11:16:39.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14480b47a0 0x7f144814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 0x7f14480b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1448162940 0x7f14480b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14480d2390 con 0x7f14480d59d0 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14480cfc50 con 0x7f14480b47a0 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14480d2510 con 0x7f1448162940 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 0x7f14480b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 0x7f14480b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52214/0 (socket says 172.21.15.66:52214) 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 -- 172.21.15.66:0/2724186520 learned_addr learned my addr 172.21.15.66:0/2724186520 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1447fff640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1448162940 0x7f14480b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f14477fe640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14480b47a0 0x7f144814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 -- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1448162940 msgr2=0x7f14480b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1448162940 0x7f14480b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 -- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14480b47a0 msgr2=0x7f144814f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14480b47a0 0x7f144814f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 -- 172.21.15.66:0/2724186520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14480cf120 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f1446ffd640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 0x7f14480b23e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e960 tx=0x7f143c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c017070 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c00ca00 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14480cf400 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c00cdd0 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.409+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144814f900 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.410+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14480b8880 con 0x7f14480d59d0 2024-05-10T11:16:39.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.411+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f143c01a070 con 0x7f14480d59d0 2024-05-10T11:16:39.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.412+0000 7f142ffff640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14340762d0 0x7f1434078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.412+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f143c097910 con 0x7f14480d59d0 2024-05-10T11:16:39.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.412+0000 7f14477fe640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14340762d0 0x7f1434078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.413+0000 7f14477fe640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14340762d0 0x7f1434078790 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1438034000 tx=0x7f143802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.416+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f143c060a90 con 0x7f14480d59d0 2024-05-10T11:16:39.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.604+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f144806a220 con 0x7f14340762d0 2024-05-10T11:16:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.610+0000 7f142ffff640 1 -- 172.21.15.66:0/2724186520 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250149 (secure 0 0 0) 0x7f144806a220 con 0x7f14340762d0 2024-05-10T11:16:39.613 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:39.615 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:16:39.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14340762d0 msgr2=0x7f1434078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14340762d0 0x7f1434078790 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1438034000 tx=0x7f143802e000 comp rx=0 tx=0).stop 2024-05-10T11:16:39.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 msgr2=0x7f14480b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 0x7f14480b23e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e960 tx=0x7f143c00ee20 comp rx=0 tx=0).stop 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 shutdown_connections 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14340762d0 0x7f1434078790 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1448162940 0x7f14480b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14480d59d0 0x7f14480b23e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 --2- 172.21.15.66:0/2724186520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14480b47a0 0x7f144814f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 >> 172.21.15.66:0/2724186520 conn(0x7f144809e380 msgr2=0x7f14480d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 shutdown_connections 2024-05-10T11:16:39.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.613+0000 7f144e02a640 1 -- 172.21.15.66:0/2724186520 wait complete. 2024-05-10T11:16:39.625 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-05-10T11:16:37.744226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":130,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228616,"kb_used_data":8268,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746104,"statfs":{"total":773094113280,"available":772860010496,"internally_reserved":0,"allocated":8466432,"data_stored":4459448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918342"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838725+0000","last_change":"2024-05-10T11:16:33.838725+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838725+0000","last_undegraded":"2024-05-10T11:16:33.838725+0000","last_fullsized":"2024-05-10T11:16:33.838725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090781+0000","last_change":"2024-05-10T11:16:34.857557+0000","last_active":"2024-05-10T11:16:36.090781+0000","last_peered":"2024-05-10T11:16:36.090781+0000","last_clean":"2024-05-10T11:16:36.090781+0000","last_became_active":"2024-05-10T11:16:34.856310+0000","last_became_peered":"2024-05-10T11:16:34.856310+0000","last_unstale":"2024-05-10T11:16:36.090781+0000","last_undegraded":"2024-05-10T11:16:36.090781+0000","last_fullsized":"2024-05-10T11:16:36.090781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:00.497997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834826+0000","last_change":"2024-05-10T11:16:34.863981+0000","last_active":"2024-05-10T11:16:35.834826+0000","last_peered":"2024-05-10T11:16:35.834826+0000","last_clean":"2024-05-10T11:16:35.834826+0000","last_became_active":"2024-05-10T11:16:34.863695+0000","last_became_peered":"2024-05-10T11:16:34.863695+0000","last_unstale":"2024-05-10T11:16:35.834826+0000","last_undegraded":"2024-05-10T11:16:35.834826+0000","last_fullsized":"2024-05-10T11:16:35.834826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:46.500803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591580+0000","last_change":"2024-05-10T11:16:34.847095+0000","last_active":"2024-05-10T11:16:36.591580+0000","last_peered":"2024-05-10T11:16:36.591580+0000","last_clean":"2024-05-10T11:16:36.591580+0000","last_became_active":"2024-05-10T11:16:34.846771+0000","last_became_peered":"2024-05-10T11:16:34.846771+0000","last_unstale":"2024-05-10T11:16:36.591580+0000","last_undegraded":"2024-05-10T11:16:36.591580+0000","last_fullsized":"2024-05-10T11:16:36.591580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:25.224183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832902+0000","last_change":"2024-05-10T11:16:34.853396+0000","last_active":"2024-05-10T11:16:35.832902+0000","last_peered":"2024-05-10T11:16:35.832902+0000","last_clean":"2024-05-10T11:16:35.832902+0000","last_became_active":"2024-05-10T11:16:34.853004+0000","last_became_peered":"2024-05-10T11:16:34.853004+0000","last_unstale":"2024-05-10T11:16:35.832902+0000","last_undegraded":"2024-05-10T11:16:35.832902+0000","last_fullsized":"2024-05-10T11:16:35.832902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:09.722498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591534+0000","last_change":"2024-05-10T11:16:34.843889+0000","last_active":"2024-05-10T11:16:36.591534+0000","last_peered":"2024-05-10T11:16:36.591534+0000","last_clean":"2024-05-10T11:16:36.591534+0000","last_became_active":"2024-05-10T11:16:34.843054+0000","last_became_peered":"2024-05-10T11:16:34.843054+0000","last_unstale":"2024-05-10T11:16:36.591534+0000","last_undegraded":"2024-05-10T11:16:36.591534+0000","last_fullsized":"2024-05-10T11:16:36.591534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835940+0000","last_change":"2024-05-10T11:16:33.835940+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835940+0000","last_undegraded":"2024-05-10T11:16:33.835940+0000","last_fullsized":"2024-05-10T11:16:33.835940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832709+0000","last_change":"2024-05-10T11:16:34.854083+0000","last_active":"2024-05-10T11:16:35.832709+0000","last_peered":"2024-05-10T11:16:35.832709+0000","last_clean":"2024-05-10T11:16:35.832709+0000","last_became_active":"2024-05-10T11:16:34.853826+0000","last_became_peered":"2024-05-10T11:16:34.853826+0000","last_unstale":"2024-05-10T11:16:35.832709+0000","last_undegraded":"2024-05-10T11:16:35.832709+0000","last_fullsized":"2024-05-10T11:16:35.832709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:04.002857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834462+0000","last_change":"2024-05-10T11:16:33.834462+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834462+0000","last_undegraded":"2024-05-10T11:16:33.834462+0000","last_fullsized":"2024-05-10T11:16:33.834462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592763+0000","last_change":"2024-05-10T11:16:34.847152+0000","last_active":"2024-05-10T11:16:36.592763+0000","last_peered":"2024-05-10T11:16:36.592763+0000","last_clean":"2024-05-10T11:16:36.592763+0000","last_became_active":"2024-05-10T11:16:34.846613+0000","last_became_peered":"2024-05-10T11:16:34.846613+0000","last_unstale":"2024-05-10T11:16:36.592763+0000","last_undegraded":"2024-05-10T11:16:36.592763+0000","last_fullsized":"2024-05-10T11:16:36.592763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090713+0000","last_change":"2024-05-10T11:16:34.860674+0000","last_active":"2024-05-10T11:16:36.090713+0000","last_peered":"2024-05-10T11:16:36.090713+0000","last_clean":"2024-05-10T11:16:36.090713+0000","last_became_active":"2024-05-10T11:16:34.855401+0000","last_became_peered":"2024-05-10T11:16:34.855401+0000","last_unstale":"2024-05-10T11:16:36.090713+0000","last_undegraded":"2024-05-10T11:16:36.090713+0000","last_fullsized":"2024-05-10T11:16:36.090713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:37.966718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592638+0000","last_change":"2024-05-10T11:16:34.859258+0000","last_active":"2024-05-10T11:16:36.592638+0000","last_peered":"2024-05-10T11:16:36.592638+0000","last_clean":"2024-05-10T11:16:36.592638+0000","last_became_active":"2024-05-10T11:16:34.858948+0000","last_became_peered":"2024-05-10T11:16:34.858948+0000","last_unstale":"2024-05-10T11:16:36.592638+0000","last_undegraded":"2024-05-10T11:16:36.592638+0000","last_fullsized":"2024-05-10T11:16:36.592638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833033+0000","last_change":"2024-05-10T11:16:34.857125+0000","last_active":"2024-05-10T11:16:35.833033+0000","last_peered":"2024-05-10T11:16:35.833033+0000","last_clean":"2024-05-10T11:16:35.833033+0000","last_became_active":"2024-05-10T11:16:34.856827+0000","last_became_peered":"2024-05-10T11:16:34.856827+0000","last_unstale":"2024-05-10T11:16:35.833033+0000","last_undegraded":"2024-05-10T11:16:35.833033+0000","last_fullsized":"2024-05-10T11:16:35.833033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:43.061696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591465+0000","last_change":"2024-05-10T11:16:34.842679+0000","last_active":"2024-05-10T11:16:36.591465+0000","last_peered":"2024-05-10T11:16:36.591465+0000","last_clean":"2024-05-10T11:16:36.591465+0000","last_became_active":"2024-05-10T11:16:34.842419+0000","last_became_peered":"2024-05-10T11:16:34.842419+0000","last_unstale":"2024-05-10T11:16:36.591465+0000","last_undegraded":"2024-05-10T11:16:36.591465+0000","last_fullsized":"2024-05-10T11:16:36.591465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090384+0000","last_change":"2024-05-10T11:16:34.853761+0000","last_active":"2024-05-10T11:16:36.090384+0000","last_peered":"2024-05-10T11:16:36.090384+0000","last_clean":"2024-05-10T11:16:36.090384+0000","last_became_active":"2024-05-10T11:16:34.853449+0000","last_became_peered":"2024-05-10T11:16:34.853449+0000","last_unstale":"2024-05-10T11:16:36.090384+0000","last_undegraded":"2024-05-10T11:16:36.090384+0000","last_fullsized":"2024-05-10T11:16:36.090384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.839406+0000","last_change":"2024-05-10T11:16:33.839406+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.839406+0000","last_undegraded":"2024-05-10T11:16:33.839406+0000","last_fullsized":"2024-05-10T11:16:33.839406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833123+0000","last_change":"2024-05-10T11:16:34.849207+0000","last_active":"2024-05-10T11:16:35.833123+0000","last_peered":"2024-05-10T11:16:35.833123+0000","last_clean":"2024-05-10T11:16:35.833123+0000","last_became_active":"2024-05-10T11:16:34.848933+0000","last_became_peered":"2024-05-10T11:16:34.848933+0000","last_unstale":"2024-05-10T11:16:35.833123+0000","last_undegraded":"2024-05-10T11:16:35.833123+0000","last_fullsized":"2024-05-10T11:16:35.833123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:55.352398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834879+0000","last_change":"2024-05-10T11:16:34.851758+0000","last_active":"2024-05-10T11:16:35.834879+0000","last_peered":"2024-05-10T11:16:35.834879+0000","last_clean":"2024-05-10T11:16:35.834879+0000","last_became_active":"2024-05-10T11:16:34.851466+0000","last_became_peered":"2024-05-10T11:16:34.851466+0000","last_unstale":"2024-05-10T11:16:35.834879+0000","last_undegraded":"2024-05-10T11:16:35.834879+0000","last_fullsized":"2024-05-10T11:16:35.834879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.700792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591745+0000","last_change":"2024-05-10T11:16:34.846246+0000","last_active":"2024-05-10T11:16:36.591745+0000","last_peered":"2024-05-10T11:16:36.591745+0000","last_clean":"2024-05-10T11:16:36.591745+0000","last_became_active":"2024-05-10T11:16:34.845391+0000","last_became_peered":"2024-05-10T11:16:34.845391+0000","last_unstale":"2024-05-10T11:16:36.591745+0000","last_undegraded":"2024-05-10T11:16:36.591745+0000","last_fullsized":"2024-05-10T11:16:36.591745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833050+0000","last_change":"2024-05-10T11:16:34.860384+0000","last_active":"2024-05-10T11:16:35.833050+0000","last_peered":"2024-05-10T11:16:35.833050+0000","last_clean":"2024-05-10T11:16:35.833050+0000","last_became_active":"2024-05-10T11:16:34.860050+0000","last_became_peered":"2024-05-10T11:16:34.860050+0000","last_unstale":"2024-05-10T11:16:35.833050+0000","last_undegraded":"2024-05-10T11:16:35.833050+0000","last_fullsized":"2024-05-10T11:16:35.833050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:53.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834442+0000","last_change":"2024-05-10T11:16:33.834442+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834442+0000","last_undegraded":"2024-05-10T11:16:33.834442+0000","last_fullsized":"2024-05-10T11:16:33.834442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832837+0000","last_change":"2024-05-10T11:16:34.857747+0000","last_active":"2024-05-10T11:16:35.832837+0000","last_peered":"2024-05-10T11:16:35.832837+0000","last_clean":"2024-05-10T11:16:35.832837+0000","last_became_active":"2024-05-10T11:16:34.857437+0000","last_became_peered":"2024-05-10T11:16:34.857437+0000","last_unstale":"2024-05-10T11:16:35.832837+0000","last_undegraded":"2024-05-10T11:16:35.832837+0000","last_fullsized":"2024-05-10T11:16:35.832837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:14.230378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.834080+0000","last_change":"2024-05-10T11:16:33.834080+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.834080+0000","last_undegraded":"2024-05-10T11:16:33.834080+0000","last_fullsized":"2024-05-10T11:16:33.834080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090543+0000","last_change":"2024-05-10T11:16:34.845780+0000","last_active":"2024-05-10T11:16:36.090543+0000","last_peered":"2024-05-10T11:16:36.090543+0000","last_clean":"2024-05-10T11:16:36.090543+0000","last_became_active":"2024-05-10T11:16:34.845322+0000","last_became_peered":"2024-05-10T11:16:34.845322+0000","last_unstale":"2024-05-10T11:16:36.090543+0000","last_undegraded":"2024-05-10T11:16:36.090543+0000","last_fullsized":"2024-05-10T11:16:36.090543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:20.443512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090673+0000","last_change":"2024-05-10T11:16:34.854455+0000","last_active":"2024-05-10T11:16:36.090673+0000","last_peered":"2024-05-10T11:16:36.090673+0000","last_clean":"2024-05-10T11:16:36.090673+0000","last_became_active":"2024-05-10T11:16:34.854168+0000","last_became_peered":"2024-05-10T11:16:34.854168+0000","last_unstale":"2024-05-10T11:16:36.090673+0000","last_undegraded":"2024-05-10T11:16:36.090673+0000","last_fullsized":"2024-05-10T11:16:36.090673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:08.765130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592820+0000","last_change":"2024-05-10T11:16:34.849031+0000","last_active":"2024-05-10T11:16:36.592820+0000","last_peered":"2024-05-10T11:16:36.592820+0000","last_clean":"2024-05-10T11:16:36.592820+0000","last_became_active":"2024-05-10T11:16:34.848672+0000","last_became_peered":"2024-05-10T11:16:34.848672+0000","last_unstale":"2024-05-10T11:16:36.592820+0000","last_undegraded":"2024-05-10T11:16:36.592820+0000","last_fullsized":"2024-05-10T11:16:36.592820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.840009+0000","last_change":"2024-05-10T11:16:33.840009+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.840009+0000","last_undegraded":"2024-05-10T11:16:33.840009+0000","last_fullsized":"2024-05-10T11:16:33.840009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:34.856389+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:34.856031+0000","last_became_peered":"2024-05-10T11:16:34.856031+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:45.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090474+0000","last_change":"2024-05-10T11:16:34.846202+0000","last_active":"2024-05-10T11:16:36.090474+0000","last_peered":"2024-05-10T11:16:36.090474+0000","last_clean":"2024-05-10T11:16:36.090474+0000","last_became_active":"2024-05-10T11:16:34.844252+0000","last_became_peered":"2024-05-10T11:16:34.844252+0000","last_unstale":"2024-05-10T11:16:36.090474+0000","last_undegraded":"2024-05-10T11:16:36.090474+0000","last_fullsized":"2024-05-10T11:16:36.090474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.837932+0000","last_change":"2024-05-10T11:16:33.837932+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.837932+0000","last_undegraded":"2024-05-10T11:16:33.837932+0000","last_fullsized":"2024-05-10T11:16:33.837932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834602+0000","last_change":"2024-05-10T11:16:34.851184+0000","last_active":"2024-05-10T11:16:35.834602+0000","last_peered":"2024-05-10T11:16:35.834602+0000","last_clean":"2024-05-10T11:16:35.834602+0000","last_became_active":"2024-05-10T11:16:34.850836+0000","last_became_peered":"2024-05-10T11:16:34.850836+0000","last_unstale":"2024-05-10T11:16:35.834602+0000","last_undegraded":"2024-05-10T11:16:35.834602+0000","last_fullsized":"2024-05-10T11:16:35.834602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:48.282472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838234+0000","last_change":"2024-05-10T11:16:33.838234+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838234+0000","last_undegraded":"2024-05-10T11:16:33.838234+0000","last_fullsized":"2024-05-10T11:16:33.838234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834526+0000","last_change":"2024-05-10T11:16:34.851721+0000","last_active":"2024-05-10T11:16:35.834526+0000","last_peered":"2024-05-10T11:16:35.834526+0000","last_clean":"2024-05-10T11:16:35.834526+0000","last_became_active":"2024-05-10T11:16:34.851415+0000","last_became_peered":"2024-05-10T11:16:34.851415+0000","last_unstale":"2024-05-10T11:16:35.834526+0000","last_undegraded":"2024-05-10T11:16:35.834526+0000","last_fullsized":"2024-05-10T11:16:35.834526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833093+0000","last_change":"2024-05-10T11:16:33.849083+0000","last_active":"2024-05-10T11:16:35.833093+0000","last_peered":"2024-05-10T11:16:35.833093+0000","last_clean":"2024-05-10T11:16:35.833093+0000","last_became_active":"2024-05-10T11:16:33.848804+0000","last_became_peered":"2024-05-10T11:16:33.848804+0000","last_unstale":"2024-05-10T11:16:35.833093+0000","last_undegraded":"2024-05-10T11:16:35.833093+0000","last_fullsized":"2024-05-10T11:16:35.833093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:16.316656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090374+0000","last_change":"2024-05-10T11:16:34.849023+0000","last_active":"2024-05-10T11:16:36.090374+0000","last_peered":"2024-05-10T11:16:36.090374+0000","last_clean":"2024-05-10T11:16:36.090374+0000","last_became_active":"2024-05-10T11:16:34.848690+0000","last_became_peered":"2024-05-10T11:16:34.848690+0000","last_unstale":"2024-05-10T11:16:36.090374+0000","last_undegraded":"2024-05-10T11:16:36.090374+0000","last_fullsized":"2024-05-10T11:16:36.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849850+0000","last_change":"2024-05-10T11:16:33.848383+0000","last_active":"2024-05-10T11:16:33.849850+0000","last_peered":"2024-05-10T11:16:33.849850+0000","last_clean":"2024-05-10T11:16:33.849850+0000","last_became_active":"2024-05-10T11:16:33.847992+0000","last_became_peered":"2024-05-10T11:16:33.847992+0000","last_unstale":"2024-05-10T11:16:33.849850+0000","last_undegraded":"2024-05-10T11:16:33.849850+0000","last_fullsized":"2024-05-10T11:16:33.849850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:52:45.317209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833877+0000","last_change":"2024-05-10T11:16:33.833877+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833877+0000","last_undegraded":"2024-05-10T11:16:33.833877+0000","last_fullsized":"2024-05-10T11:16:33.833877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.855465+0000","last_change":"2024-05-10T11:16:33.851782+0000","last_active":"2024-05-10T11:16:33.855465+0000","last_peered":"2024-05-10T11:16:33.855465+0000","last_clean":"2024-05-10T11:16:33.855465+0000","last_became_active":"2024-05-10T11:16:33.851519+0000","last_became_peered":"2024-05-10T11:16:33.851519+0000","last_unstale":"2024-05-10T11:16:33.855465+0000","last_undegraded":"2024-05-10T11:16:33.855465+0000","last_fullsized":"2024-05-10T11:16:33.855465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:59.419313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833933+0000","last_change":"2024-05-10T11:16:33.833933+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833933+0000","last_undegraded":"2024-05-10T11:16:33.833933+0000","last_fullsized":"2024-05-10T11:16:33.833933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.846451+0000","last_change":"2024-05-10T11:16:33.845477+0000","last_active":"2024-05-10T11:16:33.846451+0000","last_peered":"2024-05-10T11:16:33.846451+0000","last_clean":"2024-05-10T11:16:33.846451+0000","last_became_active":"2024-05-10T11:16:33.845155+0000","last_became_peered":"2024-05-10T11:16:33.845155+0000","last_unstale":"2024-05-10T11:16:33.846451+0000","last_undegraded":"2024-05-10T11:16:33.846451+0000","last_fullsized":"2024-05-10T11:16:33.846451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:03.730186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090601+0000","last_change":"2024-05-10T11:16:34.864666+0000","last_active":"2024-05-10T11:16:36.090601+0000","last_peered":"2024-05-10T11:16:36.090601+0000","last_clean":"2024-05-10T11:16:36.090601+0000","last_became_active":"2024-05-10T11:16:34.864410+0000","last_became_peered":"2024-05-10T11:16:34.864410+0000","last_unstale":"2024-05-10T11:16:36.090601+0000","last_undegraded":"2024-05-10T11:16:36.090601+0000","last_fullsized":"2024-05-10T11:16:36.090601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:56.782670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.845858+0000","last_change":"2024-05-10T11:16:33.844658+0000","last_active":"2024-05-10T11:16:33.845858+0000","last_peered":"2024-05-10T11:16:33.845858+0000","last_clean":"2024-05-10T11:16:33.845858+0000","last_became_active":"2024-05-10T11:16:33.844370+0000","last_became_peered":"2024-05-10T11:16:33.844370+0000","last_unstale":"2024-05-10T11:16:33.845858+0000","last_undegraded":"2024-05-10T11:16:33.845858+0000","last_fullsized":"2024-05-10T11:16:33.845858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:10:44.548947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090787+0000","last_change":"2024-05-10T11:16:34.844211+0000","last_active":"2024-05-10T11:16:36.090787+0000","last_peered":"2024-05-10T11:16:36.090787+0000","last_clean":"2024-05-10T11:16:36.090787+0000","last_became_active":"2024-05-10T11:16:34.843830+0000","last_became_peered":"2024-05-10T11:16:34.843830+0000","last_unstale":"2024-05-10T11:16:36.090787+0000","last_undegraded":"2024-05-10T11:16:36.090787+0000","last_fullsized":"2024-05-10T11:16:36.090787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:52.427590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591559+0000","last_change":"2024-05-10T11:16:33.839972+0000","last_active":"2024-05-10T11:16:36.591559+0000","last_peered":"2024-05-10T11:16:36.591559+0000","last_clean":"2024-05-10T11:16:36.591559+0000","last_became_active":"2024-05-10T11:16:33.839660+0000","last_became_peered":"2024-05-10T11:16:33.839660+0000","last_unstale":"2024-05-10T11:16:36.591559+0000","last_undegraded":"2024-05-10T11:16:36.591559+0000","last_fullsized":"2024-05-10T11:16:36.591559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:34.138529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833956+0000","last_change":"2024-05-10T11:16:33.833956+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833956+0000","last_undegraded":"2024-05-10T11:16:33.833956+0000","last_fullsized":"2024-05-10T11:16:33.833956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090486+0000","last_change":"2024-05-10T11:16:33.849599+0000","last_active":"2024-05-10T11:16:36.090486+0000","last_peered":"2024-05-10T11:16:36.090486+0000","last_clean":"2024-05-10T11:16:36.090486+0000","last_became_active":"2024-05-10T11:16:33.849241+0000","last_became_peered":"2024-05-10T11:16:33.849241+0000","last_unstale":"2024-05-10T11:16:36.090486+0000","last_undegraded":"2024-05-10T11:16:36.090486+0000","last_fullsized":"2024-05-10T11:16:36.090486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:50.691422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838990+0000","last_change":"2024-05-10T11:16:33.838990+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838990+0000","last_undegraded":"2024-05-10T11:16:33.838990+0000","last_fullsized":"2024-05-10T11:16:33.838990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832783+0000","last_change":"2024-05-10T11:16:33.850927+0000","last_active":"2024-05-10T11:16:35.832783+0000","last_peered":"2024-05-10T11:16:35.832783+0000","last_clean":"2024-05-10T11:16:35.832783+0000","last_became_active":"2024-05-10T11:16:33.850620+0000","last_became_peered":"2024-05-10T11:16:33.850620+0000","last_unstale":"2024-05-10T11:16:35.832783+0000","last_undegraded":"2024-05-10T11:16:35.832783+0000","last_fullsized":"2024-05-10T11:16:35.832783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:31.969039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090316+0000","last_change":"2024-05-10T11:16:34.839538+0000","last_active":"2024-05-10T11:16:36.090316+0000","last_peered":"2024-05-10T11:16:36.090316+0000","last_clean":"2024-05-10T11:16:36.090316+0000","last_became_active":"2024-05-10T11:16:34.839244+0000","last_became_peered":"2024-05-10T11:16:34.839244+0000","last_unstale":"2024-05-10T11:16:36.090316+0000","last_undegraded":"2024-05-10T11:16:36.090316+0000","last_fullsized":"2024-05-10T11:16:36.090316+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849187+0000","last_change":"2024-05-10T11:16:33.847120+0000","last_active":"2024-05-10T11:16:33.849187+0000","last_peered":"2024-05-10T11:16:33.849187+0000","last_clean":"2024-05-10T11:16:33.849187+0000","last_became_active":"2024-05-10T11:16:33.846773+0000","last_became_peered":"2024-05-10T11:16:33.846773+0000","last_unstale":"2024-05-10T11:16:33.849187+0000","last_undegraded":"2024-05-10T11:16:33.849187+0000","last_fullsized":"2024-05-10T11:16:33.849187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:00.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591488+0000","last_change":"2024-05-10T11:16:34.843679+0000","last_active":"2024-05-10T11:16:36.591488+0000","last_peered":"2024-05-10T11:16:36.591488+0000","last_clean":"2024-05-10T11:16:36.591488+0000","last_became_active":"2024-05-10T11:16:34.843383+0000","last_became_peered":"2024-05-10T11:16:34.843383+0000","last_unstale":"2024-05-10T11:16:36.591488+0000","last_undegraded":"2024-05-10T11:16:36.591488+0000","last_fullsized":"2024-05-10T11:16:36.591488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:09.348219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592877+0000","last_change":"2024-05-10T11:16:33.841357+0000","last_active":"2024-05-10T11:16:36.592877+0000","last_peered":"2024-05-10T11:16:36.592877+0000","last_clean":"2024-05-10T11:16:36.592877+0000","last_became_active":"2024-05-10T11:16:33.841097+0000","last_became_peered":"2024-05-10T11:16:33.841097+0000","last_unstale":"2024-05-10T11:16:36.592877+0000","last_undegraded":"2024-05-10T11:16:36.592877+0000","last_fullsized":"2024-05-10T11:16:36.592877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591637+0000","last_change":"2024-05-10T11:16:34.859325+0000","last_active":"2024-05-10T11:16:36.591637+0000","last_peered":"2024-05-10T11:16:36.591637+0000","last_clean":"2024-05-10T11:16:36.591637+0000","last_became_active":"2024-05-10T11:16:34.859028+0000","last_became_peered":"2024-05-10T11:16:34.859028+0000","last_unstale":"2024-05-10T11:16:36.591637+0000","last_undegraded":"2024-05-10T11:16:36.591637+0000","last_fullsized":"2024-05-10T11:16:36.591637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833154+0000","last_change":"2024-05-10T11:16:33.850700+0000","last_active":"2024-05-10T11:16:35.833154+0000","last_peered":"2024-05-10T11:16:35.833154+0000","last_clean":"2024-05-10T11:16:35.833154+0000","last_became_active":"2024-05-10T11:16:33.850423+0000","last_became_peered":"2024-05-10T11:16:33.850423+0000","last_unstale":"2024-05-10T11:16:35.833154+0000","last_undegraded":"2024-05-10T11:16:35.833154+0000","last_fullsized":"2024-05-10T11:16:35.833154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:53.739455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834766+0000","last_change":"2024-05-10T11:16:34.863940+0000","last_active":"2024-05-10T11:16:35.834766+0000","last_peered":"2024-05-10T11:16:35.834766+0000","last_clean":"2024-05-10T11:16:35.834766+0000","last_became_active":"2024-05-10T11:16:34.863635+0000","last_became_peered":"2024-05-10T11:16:34.863635+0000","last_unstale":"2024-05-10T11:16:35.834766+0000","last_undegraded":"2024-05-10T11:16:35.834766+0000","last_fullsized":"2024-05-10T11:16:35.834766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:19.129956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.842101+0000","last_change":"2024-05-10T11:16:33.840650+0000","last_active":"2024-05-10T11:16:33.842101+0000","last_peered":"2024-05-10T11:16:33.842101+0000","last_clean":"2024-05-10T11:16:33.842101+0000","last_became_active":"2024-05-10T11:16:33.840327+0000","last_became_peered":"2024-05-10T11:16:33.840327+0000","last_unstale":"2024-05-10T11:16:33.842101+0000","last_undegraded":"2024-05-10T11:16:33.842101+0000","last_fullsized":"2024-05-10T11:16:33.842101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:47.931535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592546+0000","last_change":"2024-05-10T11:16:34.854844+0000","last_active":"2024-05-10T11:16:36.592546+0000","last_peered":"2024-05-10T11:16:36.592546+0000","last_clean":"2024-05-10T11:16:36.592546+0000","last_became_active":"2024-05-10T11:16:34.854522+0000","last_became_peered":"2024-05-10T11:16:34.854522+0000","last_unstale":"2024-05-10T11:16:36.592546+0000","last_undegraded":"2024-05-10T11:16:36.592546+0000","last_fullsized":"2024-05-10T11:16:36.592546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:58.379390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591480+0000","last_change":"2024-05-10T11:16:33.834877+0000","last_active":"2024-05-10T11:16:36.591480+0000","last_peered":"2024-05-10T11:16:36.591480+0000","last_clean":"2024-05-10T11:16:36.591480+0000","last_became_active":"2024-05-10T11:16:33.834597+0000","last_became_peered":"2024-05-10T11:16:33.834597+0000","last_unstale":"2024-05-10T11:16:36.591480+0000","last_undegraded":"2024-05-10T11:16:36.591480+0000","last_fullsized":"2024-05-10T11:16:36.591480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836394+0000","last_change":"2024-05-10T11:16:33.836394+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836394+0000","last_undegraded":"2024-05-10T11:16:33.836394+0000","last_fullsized":"2024-05-10T11:16:33.836394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.855479+0000","last_change":"2024-05-10T11:16:33.852289+0000","last_active":"2024-05-10T11:16:33.855479+0000","last_peered":"2024-05-10T11:16:33.855479+0000","last_clean":"2024-05-10T11:16:33.855479+0000","last_became_active":"2024-05-10T11:16:33.852005+0000","last_became_peered":"2024-05-10T11:16:33.852005+0000","last_unstale":"2024-05-10T11:16:33.855479+0000","last_undegraded":"2024-05-10T11:16:33.855479+0000","last_fullsized":"2024-05-10T11:16:33.855479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:26.675655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836061+0000","last_change":"2024-05-10T11:16:33.836061+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836061+0000","last_undegraded":"2024-05-10T11:16:33.836061+0000","last_fullsized":"2024-05-10T11:16:33.836061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832731+0000","last_change":"2024-05-10T11:16:33.851756+0000","last_active":"2024-05-10T11:16:35.832731+0000","last_peered":"2024-05-10T11:16:35.832731+0000","last_clean":"2024-05-10T11:16:35.832731+0000","last_became_active":"2024-05-10T11:16:33.851459+0000","last_became_peered":"2024-05-10T11:16:33.851459+0000","last_unstale":"2024-05-10T11:16:35.832731+0000","last_undegraded":"2024-05-10T11:16:35.832731+0000","last_fullsized":"2024-05-10T11:16:35.832731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:00.512992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.837011+0000","last_change":"2024-05-10T11:16:33.837011+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.837011+0000","last_undegraded":"2024-05-10T11:16:33.837011+0000","last_fullsized":"2024-05-10T11:16:33.837011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090447+0000","last_change":"2024-05-10T11:16:33.845959+0000","last_active":"2024-05-10T11:16:36.090447+0000","last_peered":"2024-05-10T11:16:36.090447+0000","last_clean":"2024-05-10T11:16:36.090447+0000","last_became_active":"2024-05-10T11:16:33.845331+0000","last_became_peered":"2024-05-10T11:16:33.845331+0000","last_unstale":"2024-05-10T11:16:36.090447+0000","last_undegraded":"2024-05-10T11:16:36.090447+0000","last_fullsized":"2024-05-10T11:16:36.090447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:45.491433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591231+0000","last_change":"2024-05-10T11:16:34.852456+0000","last_active":"2024-05-10T11:16:36.591231+0000","last_peered":"2024-05-10T11:16:36.591231+0000","last_clean":"2024-05-10T11:16:36.591231+0000","last_became_active":"2024-05-10T11:16:34.852136+0000","last_became_peered":"2024-05-10T11:16:34.852136+0000","last_unstale":"2024-05-10T11:16:36.591231+0000","last_undegraded":"2024-05-10T11:16:36.591231+0000","last_fullsized":"2024-05-10T11:16:36.591231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849165+0000","last_change":"2024-05-10T11:16:33.847150+0000","last_active":"2024-05-10T11:16:33.849165+0000","last_peered":"2024-05-10T11:16:33.849165+0000","last_clean":"2024-05-10T11:16:33.849165+0000","last_became_active":"2024-05-10T11:16:33.846903+0000","last_became_peered":"2024-05-10T11:16:33.846903+0000","last_unstale":"2024-05-10T11:16:33.849165+0000","last_undegraded":"2024-05-10T11:16:33.849165+0000","last_fullsized":"2024-05-10T11:16:33.849165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:11.657121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832695+0000","last_change":"2024-05-10T11:16:34.845165+0000","last_active":"2024-05-10T11:16:35.832695+0000","last_peered":"2024-05-10T11:16:35.832695+0000","last_clean":"2024-05-10T11:16:35.832695+0000","last_became_active":"2024-05-10T11:16:34.844886+0000","last_became_peered":"2024-05-10T11:16:34.844886+0000","last_unstale":"2024-05-10T11:16:35.832695+0000","last_undegraded":"2024-05-10T11:16:35.832695+0000","last_fullsized":"2024-05-10T11:16:35.832695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:15.505458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.845224+0000","last_change":"2024-05-10T11:16:33.840287+0000","last_active":"2024-05-10T11:16:33.845224+0000","last_peered":"2024-05-10T11:16:33.845224+0000","last_clean":"2024-05-10T11:16:33.845224+0000","last_became_active":"2024-05-10T11:16:33.840016+0000","last_became_peered":"2024-05-10T11:16:33.840016+0000","last_unstale":"2024-05-10T11:16:33.845224+0000","last_undegraded":"2024-05-10T11:16:33.845224+0000","last_fullsized":"2024-05-10T11:16:33.845224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:21.018784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832710+0000","last_change":"2024-05-10T11:16:34.857683+0000","last_active":"2024-05-10T11:16:35.832710+0000","last_peered":"2024-05-10T11:16:35.832710+0000","last_clean":"2024-05-10T11:16:35.832710+0000","last_became_active":"2024-05-10T11:16:34.857411+0000","last_became_peered":"2024-05-10T11:16:34.857411+0000","last_unstale":"2024-05-10T11:16:35.832710+0000","last_undegraded":"2024-05-10T11:16:35.832710+0000","last_fullsized":"2024-05-10T11:16:35.832710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:04.078921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:33.849638+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:33.849383+0000","last_became_peered":"2024-05-10T11:16:33.849383+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.217874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591483+0000","last_change":"2024-05-10T11:16:34.861019+0000","last_active":"2024-05-10T11:16:36.591483+0000","last_peered":"2024-05-10T11:16:36.591483+0000","last_clean":"2024-05-10T11:16:36.591483+0000","last_became_active":"2024-05-10T11:16:34.860667+0000","last_became_peered":"2024-05-10T11:16:34.860667+0000","last_unstale":"2024-05-10T11:16:36.591483+0000","last_undegraded":"2024-05-10T11:16:36.591483+0000","last_fullsized":"2024-05-10T11:16:36.591483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834612+0000","last_change":"2024-05-10T11:16:33.851897+0000","last_active":"2024-05-10T11:16:35.834612+0000","last_peered":"2024-05-10T11:16:35.834612+0000","last_clean":"2024-05-10T11:16:35.834612+0000","last_became_active":"2024-05-10T11:16:33.851629+0000","last_became_peered":"2024-05-10T11:16:33.851629+0000","last_unstale":"2024-05-10T11:16:35.834612+0000","last_undegraded":"2024-05-10T11:16:35.834612+0000","last_fullsized":"2024-05-10T11:16:35.834612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:02.785863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090623+0000","last_change":"2024-05-10T11:16:34.849709+0000","last_active":"2024-05-10T11:16:36.090623+0000","last_peered":"2024-05-10T11:16:36.090623+0000","last_clean":"2024-05-10T11:16:36.090623+0000","last_became_active":"2024-05-10T11:16:34.849412+0000","last_became_peered":"2024-05-10T11:16:34.849412+0000","last_unstale":"2024-05-10T11:16:36.090623+0000","last_undegraded":"2024-05-10T11:16:36.090623+0000","last_fullsized":"2024-05-10T11:16:36.090623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:09.452662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591486+0000","last_change":"2024-05-10T11:16:33.840818+0000","last_active":"2024-05-10T11:16:36.591486+0000","last_peered":"2024-05-10T11:16:36.591486+0000","last_clean":"2024-05-10T11:16:36.591486+0000","last_became_active":"2024-05-10T11:16:33.840472+0000","last_became_peered":"2024-05-10T11:16:33.840472+0000","last_unstale":"2024-05-10T11:16:36.591486+0000","last_undegraded":"2024-05-10T11:16:36.591486+0000","last_fullsized":"2024-05-10T11:16:36.591486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:36:21.942433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090750+0000","last_change":"2024-05-10T11:16:34.848027+0000","last_active":"2024-05-10T11:16:36.090750+0000","last_peered":"2024-05-10T11:16:36.090750+0000","last_clean":"2024-05-10T11:16:36.090750+0000","last_became_active":"2024-05-10T11:16:34.846208+0000","last_became_peered":"2024-05-10T11:16:34.846208+0000","last_unstale":"2024-05-10T11:16:36.090750+0000","last_undegraded":"2024-05-10T11:16:36.090750+0000","last_fullsized":"2024-05-10T11:16:36.090750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:21.557365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591275+0000","last_change":"2024-05-10T11:16:33.843809+0000","last_active":"2024-05-10T11:16:36.591275+0000","last_peered":"2024-05-10T11:16:36.591275+0000","last_clean":"2024-05-10T11:16:36.591275+0000","last_became_active":"2024-05-10T11:16:33.843314+0000","last_became_peered":"2024-05-10T11:16:33.843314+0000","last_unstale":"2024-05-10T11:16:36.591275+0000","last_undegraded":"2024-05-10T11:16:36.591275+0000","last_fullsized":"2024-05-10T11:16:36.591275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836481+0000","last_change":"2024-05-10T11:16:33.836481+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836481+0000","last_undegraded":"2024-05-10T11:16:33.836481+0000","last_fullsized":"2024-05-10T11:16:33.836481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591160+0000","last_change":"2024-05-10T11:16:33.842957+0000","last_active":"2024-05-10T11:16:36.591160+0000","last_peered":"2024-05-10T11:16:36.591160+0000","last_clean":"2024-05-10T11:16:36.591160+0000","last_became_active":"2024-05-10T11:16:33.842675+0000","last_became_peered":"2024-05-10T11:16:33.842675+0000","last_unstale":"2024-05-10T11:16:36.591160+0000","last_undegraded":"2024-05-10T11:16:36.591160+0000","last_fullsized":"2024-05-10T11:16:36.591160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833230+0000","last_change":"2024-05-10T11:16:33.833230+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833230+0000","last_undegraded":"2024-05-10T11:16:33.833230+0000","last_fullsized":"2024-05-10T11:16:33.833230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592665+0000","last_change":"2024-05-10T11:16:33.839202+0000","last_active":"2024-05-10T11:16:36.592665+0000","last_peered":"2024-05-10T11:16:36.592665+0000","last_clean":"2024-05-10T11:16:36.592665+0000","last_became_active":"2024-05-10T11:16:33.838582+0000","last_became_peered":"2024-05-10T11:16:33.838582+0000","last_unstale":"2024-05-10T11:16:36.592665+0000","last_undegraded":"2024-05-10T11:16:36.592665+0000","last_fullsized":"2024-05-10T11:16:36.592665+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835469+0000","last_change":"2024-05-10T11:16:33.835469+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835469+0000","last_undegraded":"2024-05-10T11:16:33.835469+0000","last_fullsized":"2024-05-10T11:16:33.835469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.837136+0000","last_change":"2024-05-10T11:16:33.850966+0000","last_active":"2024-05-10T11:16:36.837136+0000","last_peered":"2024-05-10T11:16:36.837136+0000","last_clean":"2024-05-10T11:16:36.837136+0000","last_became_active":"2024-05-10T11:16:33.850661+0000","last_became_peered":"2024-05-10T11:16:33.850661+0000","last_unstale":"2024-05-10T11:16:36.837136+0000","last_undegraded":"2024-05-10T11:16:36.837136+0000","last_fullsized":"2024-05-10T11:16:36.837136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.833362+0000","last_change":"2024-05-10T11:16:33.833362+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.833362+0000","last_undegraded":"2024-05-10T11:16:33.833362+0000","last_fullsized":"2024-05-10T11:16:33.833362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849780+0000","last_change":"2024-05-10T11:16:33.848721+0000","last_active":"2024-05-10T11:16:33.849780+0000","last_peered":"2024-05-10T11:16:33.849780+0000","last_clean":"2024-05-10T11:16:33.849780+0000","last_became_active":"2024-05-10T11:16:33.848429+0000","last_became_peered":"2024-05-10T11:16:33.848429+0000","last_unstale":"2024-05-10T11:16:33.849780+0000","last_undegraded":"2024-05-10T11:16:33.849780+0000","last_fullsized":"2024-05-10T11:16:33.849780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:35.587792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090506+0000","last_change":"2024-05-10T11:16:34.846463+0000","last_active":"2024-05-10T11:16:36.090506+0000","last_peered":"2024-05-10T11:16:36.090506+0000","last_clean":"2024-05-10T11:16:36.090506+0000","last_became_active":"2024-05-10T11:16:34.845916+0000","last_became_peered":"2024-05-10T11:16:34.845916+0000","last_unstale":"2024-05-10T11:16:36.090506+0000","last_undegraded":"2024-05-10T11:16:36.090506+0000","last_fullsized":"2024-05-10T11:16:36.090506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:18.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.849749+0000","last_change":"2024-05-10T11:16:33.848344+0000","last_active":"2024-05-10T11:16:33.849749+0000","last_peered":"2024-05-10T11:16:33.849749+0000","last_clean":"2024-05-10T11:16:33.849749+0000","last_became_active":"2024-05-10T11:16:33.848071+0000","last_became_peered":"2024-05-10T11:16:33.848071+0000","last_unstale":"2024-05-10T11:16:33.849749+0000","last_undegraded":"2024-05-10T11:16:33.849749+0000","last_fullsized":"2024-05-10T11:16:33.849749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:47.025785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.836200+0000","last_change":"2024-05-10T11:16:33.836200+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.836200+0000","last_undegraded":"2024-05-10T11:16:33.836200+0000","last_fullsized":"2024-05-10T11:16:33.836200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.844599+0000","last_change":"2024-05-10T11:16:33.842583+0000","last_active":"2024-05-10T11:16:33.844599+0000","last_peered":"2024-05-10T11:16:33.844599+0000","last_clean":"2024-05-10T11:16:33.844599+0000","last_became_active":"2024-05-10T11:16:33.842298+0000","last_became_peered":"2024-05-10T11:16:33.842298+0000","last_unstale":"2024-05-10T11:16:33.844599+0000","last_undegraded":"2024-05-10T11:16:33.844599+0000","last_fullsized":"2024-05-10T11:16:33.844599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:21:13.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.835379+0000","last_change":"2024-05-10T11:16:33.835379+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.835379+0000","last_undegraded":"2024-05-10T11:16:33.835379+0000","last_fullsized":"2024-05-10T11:16:33.835379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832824+0000","last_change":"2024-05-10T11:16:33.851549+0000","last_active":"2024-05-10T11:16:35.832824+0000","last_peered":"2024-05-10T11:16:35.832824+0000","last_clean":"2024-05-10T11:16:35.832824+0000","last_became_active":"2024-05-10T11:16:33.851206+0000","last_became_peered":"2024-05-10T11:16:33.851206+0000","last_unstale":"2024-05-10T11:16:35.832824+0000","last_undegraded":"2024-05-10T11:16:35.832824+0000","last_fullsized":"2024-05-10T11:16:35.832824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:02.953747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834995+0000","last_change":"2024-05-10T11:16:34.863061+0000","last_active":"2024-05-10T11:16:35.834995+0000","last_peered":"2024-05-10T11:16:35.834995+0000","last_clean":"2024-05-10T11:16:35.834995+0000","last_became_active":"2024-05-10T11:16:34.862777+0000","last_became_peered":"2024-05-10T11:16:34.862777+0000","last_unstale":"2024-05-10T11:16:35.834995+0000","last_undegraded":"2024-05-10T11:16:35.834995+0000","last_fullsized":"2024-05-10T11:16:35.834995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:35.147899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.844011+0000","last_change":"2024-05-10T11:16:33.841766+0000","last_active":"2024-05-10T11:16:33.844011+0000","last_peered":"2024-05-10T11:16:33.844011+0000","last_clean":"2024-05-10T11:16:33.844011+0000","last_became_active":"2024-05-10T11:16:33.841421+0000","last_became_peered":"2024-05-10T11:16:33.841421+0000","last_unstale":"2024-05-10T11:16:33.844011+0000","last_undegraded":"2024-05-10T11:16:33.844011+0000","last_fullsized":"2024-05-10T11:16:33.844011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:24.900761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834983+0000","last_change":"2024-05-10T11:16:34.851996+0000","last_active":"2024-05-10T11:16:35.834983+0000","last_peered":"2024-05-10T11:16:35.834983+0000","last_clean":"2024-05-10T11:16:35.834983+0000","last_became_active":"2024-05-10T11:16:34.851659+0000","last_became_peered":"2024-05-10T11:16:34.851659+0000","last_unstale":"2024-05-10T11:16:35.834983+0000","last_undegraded":"2024-05-10T11:16:35.834983+0000","last_fullsized":"2024-05-10T11:16:35.834983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:35.838012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834471+0000","last_change":"2024-05-10T11:16:33.840847+0000","last_active":"2024-05-10T11:16:35.834471+0000","last_peered":"2024-05-10T11:16:35.834471+0000","last_clean":"2024-05-10T11:16:35.834471+0000","last_became_active":"2024-05-10T11:16:33.840336+0000","last_became_peered":"2024-05-10T11:16:33.840336+0000","last_unstale":"2024-05-10T11:16:35.834471+0000","last_undegraded":"2024-05-10T11:16:35.834471+0000","last_fullsized":"2024-05-10T11:16:35.834471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:57.998358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-05-10T11:16:33.838344+0000","last_change":"2024-05-10T11:16:33.838344+0000","last_active":"2024-05-10T11:16:33.821601+0000","last_peered":"2024-05-10T11:16:33.821601+0000","last_clean":"2024-05-10T11:16:33.821601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:16:33.838344+0000","last_undegraded":"2024-05-10T11:16:33.838344+0000","last_fullsized":"2024-05-10T11:16:33.838344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591763+0000","last_change":"2024-05-10T11:16:33.841956+0000","last_active":"2024-05-10T11:16:36.591763+0000","last_peered":"2024-05-10T11:16:36.591763+0000","last_clean":"2024-05-10T11:16:36.591763+0000","last_became_active":"2024-05-10T11:16:33.841606+0000","last_became_peered":"2024-05-10T11:16:33.841606+0000","last_unstale":"2024-05-10T11:16:36.591763+0000","last_undegraded":"2024-05-10T11:16:36.591763+0000","last_fullsized":"2024-05-10T11:16:36.591763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:56.319173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T11:16:33.841064+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:16:33.841064+0000","last_peered":"2024-05-10T11:16:33.841064+0000","last_clean":"2024-05-10T11:16:33.841064+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:16:33.841064+0000","last_undegraded":"2024-05-10T11:16:33.841064+0000","last_fullsized":"2024-05-10T11:16:33.841064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":988031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":397663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":397663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":418931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":418301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1515520,"data_stored":1008557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":411531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.838725+0000', 'last_change': '2024-05-10T11:16:33.838725+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.838725+0000', 'last_undegraded': '2024-05-10T11:16:33.838725+0000', 'last_fullsized': '2024-05-10T11:16:33.838725+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.835940+0000', 'last_change': '2024-05-10T11:16:33.835940+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.835940+0000', 'last_undegraded': '2024-05-10T11:16:33.835940+0000', 'last_fullsized': '2024-05-10T11:16:33.835940+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.834462+0000', 'last_change': '2024-05-10T11:16:33.834462+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.834462+0000', 'last_undegraded': '2024-05-10T11:16:33.834462+0000', 'last_fullsized': '2024-05-10T11:16:33.834462+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.839406+0000', 'last_change': '2024-05-10T11:16:33.839406+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.839406+0000', 'last_undegraded': '2024-05-10T11:16:33.839406+0000', 'last_fullsized': '2024-05-10T11:16:33.839406+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:16:39.629 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.834442+0000', 'last_change': '2024-05-10T11:16:33.834442+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.834442+0000', 'last_undegraded': '2024-05-10T11:16:33.834442+0000', 'last_fullsized': '2024-05-10T11:16:33.834442+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.834080+0000', 'last_change': '2024-05-10T11:16:33.834080+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.834080+0000', 'last_undegraded': '2024-05-10T11:16:33.834080+0000', 'last_fullsized': '2024-05-10T11:16:33.834080+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.840009+0000', 'last_change': '2024-05-10T11:16:33.840009+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.840009+0000', 'last_undegraded': '2024-05-10T11:16:33.840009+0000', 'last_fullsized': '2024-05-10T11:16:33.840009+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.837932+0000', 'last_change': '2024-05-10T11:16:33.837932+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.837932+0000', 'last_undegraded': '2024-05-10T11:16:33.837932+0000', 'last_fullsized': '2024-05-10T11:16:33.837932+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.838234+0000', 'last_change': '2024-05-10T11:16:33.838234+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.838234+0000', 'last_undegraded': '2024-05-10T11:16:33.838234+0000', 'last_fullsized': '2024-05-10T11:16:33.838234+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:16:39.630 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.833877+0000', 'last_change': '2024-05-10T11:16:33.833877+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.833877+0000', 'last_undegraded': '2024-05-10T11:16:33.833877+0000', 'last_fullsized': '2024-05-10T11:16:33.833877+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.833933+0000', 'last_change': '2024-05-10T11:16:33.833933+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.833933+0000', 'last_undegraded': '2024-05-10T11:16:33.833933+0000', 'last_fullsized': '2024-05-10T11:16:33.833933+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.833956+0000', 'last_change': '2024-05-10T11:16:33.833956+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.833956+0000', 'last_undegraded': '2024-05-10T11:16:33.833956+0000', 'last_fullsized': '2024-05-10T11:16:33.833956+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.838990+0000', 'last_change': '2024-05-10T11:16:33.838990+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.838990+0000', 'last_undegraded': '2024-05-10T11:16:33.838990+0000', 'last_fullsized': '2024-05-10T11:16:33.838990+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-05-10T11:16:39.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.836394+0000', 'last_change': '2024-05-10T11:16:33.836394+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.836394+0000', 'last_undegraded': '2024-05-10T11:16:33.836394+0000', 'last_fullsized': '2024-05-10T11:16:33.836394+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.632 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-05-10T11:16:39.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.836061+0000', 'last_change': '2024-05-10T11:16:33.836061+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.836061+0000', 'last_undegraded': '2024-05-10T11:16:33.836061+0000', 'last_fullsized': '2024-05-10T11:16:33.836061+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.632 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-05-10T11:16:39.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.837011+0000', 'last_change': '2024-05-10T11:16:33.837011+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.837011+0000', 'last_undegraded': '2024-05-10T11:16:33.837011+0000', 'last_fullsized': '2024-05-10T11:16:33.837011+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.836481+0000', 'last_change': '2024-05-10T11:16:33.836481+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.836481+0000', 'last_undegraded': '2024-05-10T11:16:33.836481+0000', 'last_fullsized': '2024-05-10T11:16:33.836481+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.833230+0000', 'last_change': '2024-05-10T11:16:33.833230+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.833230+0000', 'last_undegraded': '2024-05-10T11:16:33.833230+0000', 'last_fullsized': '2024-05-10T11:16:33.833230+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.835469+0000', 'last_change': '2024-05-10T11:16:33.835469+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.835469+0000', 'last_undegraded': '2024-05-10T11:16:33.835469+0000', 'last_fullsized': '2024-05-10T11:16:33.835469+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.833362+0000', 'last_change': '2024-05-10T11:16:33.833362+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.833362+0000', 'last_undegraded': '2024-05-10T11:16:33.833362+0000', 'last_fullsized': '2024-05-10T11:16:33.833362+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.836200+0000', 'last_change': '2024-05-10T11:16:33.836200+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.836200+0000', 'last_undegraded': '2024-05-10T11:16:33.836200+0000', 'last_fullsized': '2024-05-10T11:16:33.836200+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-05-10T11:16:39.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.835379+0000', 'last_change': '2024-05-10T11:16:33.835379+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.835379+0000', 'last_undegraded': '2024-05-10T11:16:33.835379+0000', 'last_fullsized': '2024-05-10T11:16:33.835379+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:16:39.634 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-05-10T11:16:39.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:16:33.838344+0000', 'last_change': '2024-05-10T11:16:33.838344+0000', 'last_active': '2024-05-10T11:16:33.821601+0000', 'last_peered': '2024-05-10T11:16:33.821601+0000', 'last_clean': '2024-05-10T11:16:33.821601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:16:33.838344+0000', 'last_undegraded': '2024-05-10T11:16:33.838344+0000', 'last_fullsized': '2024-05-10T11:16:33.838344+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'last_clean_scrub_stamp': '2024-05-10T11:16:33.821601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:16:39.634 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T11:16:39.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.768+0000 7f0c91854640 1 Processor -- start 2024-05-10T11:16:39.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.768+0000 7f0c91854640 1 -- start start 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c91854640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c8c162750 0x7f0c8c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c91854640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0c8c0d5cb0 0x7f0c8c0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c91854640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c162b30 0x7f0c8c0d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c91854640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8c0b4f20 con 0x7f0c8c162750 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c91854640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8c0d0fe0 con 0x7f0c8c0d5cb0 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c91854640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c0b45f0 con 0x7f0c8c162b30 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c8c162750 0x7f0c8c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c8c162750 0x7f0c8c0d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52218/0 (socket says 172.21.15.66:52218) 2024-05-10T11:16:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 -- 172.21.15.66:0/3110977679 learned_addr learned my addr 172.21.15.66:0/3110977679 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8a7fc640 1 --2- 172.21.15.66:0/3110977679 >> v2:172.21.15.190:3300/0 conn(0x7f0c8c0d5cb0 0x7f0c8c0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8b7fe640 1 --2- 172.21.15.66:0/3110977679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c162b30 0x7f0c8c0d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 -- 172.21.15.66:0/3110977679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c162b30 msgr2=0x7f0c8c0d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 --2- 172.21.15.66:0/3110977679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c162b30 0x7f0c8c0d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 -- 172.21.15.66:0/3110977679 >> v2:172.21.15.190:3300/0 conn(0x7f0c8c0d5cb0 msgr2=0x7f0c8c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 --2- 172.21.15.66:0/3110977679 >> v2:172.21.15.190:3300/0 conn(0x7f0c8c0d5cb0 0x7f0c8c0d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.769+0000 7f0c8affd640 1 -- 172.21.15.66:0/3110977679 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0b48d0 con 0x7f0c8c162750 2024-05-10T11:16:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.770+0000 7f0c8affd640 1 --2- 172.21.15.66:0/3110977679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c0d0670 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0b4e90 tx=0x7f0c7c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bed08105da52491 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.770+0000 7f0c89ffb640 1 -- 172.21.15.66:0/3110977679 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c037070 con 0x7f0c8c162750 2024-05-10T11:16:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.770+0000 7f0c89ffb640 1 -- 172.21.15.66:0/3110977679 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c032440 con 0x7f0c8c162750 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.770+0000 7f0c89ffb640 1 -- 172.21.15.66:0/3110977679 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c032810 con 0x7f0c8c162750 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 -- 172.21.15.66:0/3110977679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 msgr2=0x7f0c8c0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 --2- 172.21.15.66:0/3110977679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c0d0670 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0b4e90 tx=0x7f0c7c02a140 comp rx=0 tx=0).stop 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 -- 172.21.15.66:0/3110977679 shutdown_connections 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 --2- 172.21.15.66:0/3110977679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c162b30 0x7f0c8c0d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 --2- 172.21.15.66:0/3110977679 >> v2:172.21.15.190:3300/0 conn(0x7f0c8c0d5cb0 0x7f0c8c0d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 --2- 172.21.15.66:0/3110977679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c0d0670 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 -- 172.21.15.66:0/3110977679 >> 172.21.15.66:0/3110977679 conn(0x7f0c8c09e3b0 msgr2=0x7f0c8c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 -- 172.21.15.66:0/3110977679 shutdown_connections 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.771+0000 7f0c91854640 1 -- 172.21.15.66:0/3110977679 wait complete. 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.772+0000 7f0c91854640 1 Processor -- start 2024-05-10T11:16:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.772+0000 7f0c91854640 1 -- start start 2024-05-10T11:16:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c91854640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c91854640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c8c162b30 0x7f0c8c1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c91854640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c1f5a90 0x7f0c8c14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c91854640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0d0d30 con 0x7f0c8c162750 2024-05-10T11:16:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c91854640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0d0bb0 con 0x7f0c8c162b30 2024-05-10T11:16:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c91854640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c0d1660 con 0x7f0c8c1f5a90 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c1f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52232/0 (socket says 172.21.15.66:52232) 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 -- 172.21.15.66:0/200683339 learned_addr learned my addr 172.21.15.66:0/200683339 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8b7fe640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c1f5a90 0x7f0c8c14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8a7fc640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c8c162b30 0x7f0c8c1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 -- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c1f5a90 msgr2=0x7f0c8c14eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c1f5a90 0x7f0c8c14eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 -- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c8c162b30 msgr2=0x7f0c8c1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c8c162b30 0x7f0c8c1f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.773+0000 7f0c8affd640 1 -- 172.21.15.66:0/200683339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0b8cc0 con 0x7f0c8c162750 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.774+0000 7f0c8affd640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c1f2390 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c02a180 tx=0x7f0c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.774+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c041020 con 0x7f0c8c162750 2024-05-10T11:16:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.774+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0306c0 con 0x7f0c8c162750 2024-05-10T11:16:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.774+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c0b8fa0 con 0x7f0c8c162750 2024-05-10T11:16:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.774+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c037040 con 0x7f0c8c162750 2024-05-10T11:16:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.774+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c0b9560 con 0x7f0c8c162750 2024-05-10T11:16:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.775+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c06a220 con 0x7f0c8c162750 2024-05-10T11:16:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.776+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c7c044020 con 0x7f0c8c162750 2024-05-10T11:16:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.776+0000 7f0c73fff640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c780762d0 0x7f0c78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.776+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f0c7c0b7e70 con 0x7f0c8c162750 2024-05-10T11:16:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.776+0000 7f0c8a7fc640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c780762d0 0x7f0c78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.777+0000 7f0c8a7fc640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c780762d0 0x7f0c78078790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0d4120 tx=0x7f0c80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:39.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:39.780+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0c7c04b030 con 0x7f0c8c162750 2024-05-10T11:16:39.806 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:16:39.806+0000 7fab975fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:16:40.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.046+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0c8c0d1bf0 con 0x7f0c8c162750 2024-05-10T11:16:40.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.046+0000 7f0c73fff640 1 -- 172.21.15.66:0/200683339 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1175 (secure 0 0 0) 0x7f0c7c080ff0 con 0x7f0c8c162750 2024-05-10T11:16:40.047 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:40.047 INFO:teuthology.orchestra.run.smithi066.stdout:{"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":272,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":76,"num_osds":8,"num_up_osds":8,"osd_up_since":1715339538,"num_in_osds":8,"osd_in_since":1715339529,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":238510080,"bytes_avail":772855603200,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":46,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6276}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-05-10T11:15:55.734341+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c780762d0 msgr2=0x7f0c78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c780762d0 0x7f0c78078790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0d4120 tx=0x7f0c80008040 comp rx=0 tx=0).stop 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 msgr2=0x7f0c8c1f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c1f2390 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c02a180 tx=0x7f0c7c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 shutdown_connections 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0c780762d0 0x7f0c78078790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c8c1f5a90 0x7f0c8c14eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c8c162b30 0x7f0c8c1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 --2- 172.21.15.66:0/200683339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c8c162750 0x7f0c8c1f2390 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 >> 172.21.15.66:0/200683339 conn(0x7f0c8c09e3b0 msgr2=0x7f0c8c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 shutdown_connections 2024-05-10T11:16:40.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.048+0000 7f0c91854640 1 -- 172.21.15.66:0/200683339 wait complete. 2024-05-10T11:16:40.059 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T11:16:40.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:16:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.162+0000 7f2a8de54640 1 Processor -- start 2024-05-10T11:16:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.162+0000 7f2a8de54640 1 -- start start 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.163+0000 7f2a8de54640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2a8806fa60 0x7f2a88163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.163+0000 7f2a8de54640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2a880caf50 0x7f2a8815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.163+0000 7f2a8de54640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a88160240 con 0x7f2a8815f730 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.163+0000 7f2a8de54640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2a88163c70 con 0x7f2a880caf50 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.163+0000 7f2a8de54640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2a88160520 con 0x7f2a8806fa60 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a87fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2a880caf50 0x7f2a8815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a86ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2a8815f730 0x7f2a880ca840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:57392/0 (socket says 172.21.15.66:57392) 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a86ffd640 1 -- 172.21.15.66:0/1747732735 learned_addr learned my addr 172.21.15.66:0/1747732735 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a877fe640 1 --2- 172.21.15.66:0/1747732735 >> v2:172.21.15.190:3300/0 conn(0x7f2a8806fa60 0x7f2a88163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a87fff640 1 -- 172.21.15.66:0/1747732735 >> v2:172.21.15.190:3300/0 conn(0x7f2a8806fa60 msgr2=0x7f2a88163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a87fff640 1 --2- 172.21.15.66:0/1747732735 >> v2:172.21.15.190:3300/0 conn(0x7f2a8806fa60 0x7f2a88163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a87fff640 1 -- 172.21.15.66:0/1747732735 >> v1:172.21.15.66:6789/0 conn(0x7f2a8815f730 legacy=0x7f2a880ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.164+0000 7f2a87fff640 1 -- 172.21.15.66:0/1747732735 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a88162f30 con 0x7f2a880caf50 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a87fff640 1 --2- 172.21.15.66:0/1747732735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880caf50 0x7f2a8815fbc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2a880738d0 tx=0x7f2a8002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eeb99b4dfdf589 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a867fc640 1 -- 172.21.15.66:0/1747732735 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80007740 con 0x7f2a880caf50 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a867fc640 1 -- 172.21.15.66:0/1747732735 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a800078e0 con 0x7f2a880caf50 2024-05-10T11:16:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a867fc640 1 -- 172.21.15.66:0/1747732735 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80007cb0 con 0x7f2a880caf50 2024-05-10T11:16:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 -- 172.21.15.66:0/1747732735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880caf50 msgr2=0x7f2a8815fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 --2- 172.21.15.66:0/1747732735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880caf50 0x7f2a8815fbc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2a880738d0 tx=0x7f2a8002a5f0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 -- 172.21.15.66:0/1747732735 shutdown_connections 2024-05-10T11:16:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 --2- 172.21.15.66:0/1747732735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880caf50 0x7f2a8815fbc0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 --2- 172.21.15.66:0/1747732735 >> v2:172.21.15.190:3300/0 conn(0x7f2a8806fa60 0x7f2a88163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 -- 172.21.15.66:0/1747732735 >> 172.21.15.66:0/1747732735 conn(0x7f2a880d1510 msgr2=0x7f2a880d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:40.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 -- 172.21.15.66:0/1747732735 shutdown_connections 2024-05-10T11:16:40.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.165+0000 7f2a8de54640 1 -- 172.21.15.66:0/1747732735 wait complete. 2024-05-10T11:16:40.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 Processor -- start 2024-05-10T11:16:40.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 -- start start 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8806fa60 0x7f2a88146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a880caf50 0x7f2a8815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 0x7f2a88148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8806c560 con 0x7f2a8815f730 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8806eae0 con 0x7f2a880caf50 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.167+0000 7f2a8de54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8806c6e0 con 0x7f2a8806fa60 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 0x7f2a88148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:40.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 0x7f2a88148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52242/0 (socket says 172.21.15.66:52242) 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 -- 172.21.15.66:0/3355346599 learned_addr learned my addr 172.21.15.66:0/3355346599 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a86ffd640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a880caf50 0x7f2a8815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a877fe640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8806fa60 0x7f2a88146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 -- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8806fa60 msgr2=0x7f2a88146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8806fa60 0x7f2a88146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 -- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a880caf50 msgr2=0x7f2a8815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a880caf50 0x7f2a8815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 -- 172.21.15.66:0/3355346599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8815ea90 con 0x7f2a8815f730 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a87fff640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 0x7f2a88148c10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2a8002abe0 tx=0x7f2a80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80040070 con 0x7f2a8815f730 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a80031bc0 con 0x7f2a8815f730 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8815ed70 con 0x7f2a8815f730 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80009450 con 0x7f2a8815f730 2024-05-10T11:16:40.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.168+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a88149150 con 0x7f2a8815f730 2024-05-10T11:16:40.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.169+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8806a220 con 0x7f2a8815f730 2024-05-10T11:16:40.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.170+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2a80039040 con 0x7f2a8815f730 2024-05-10T11:16:40.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.170+0000 7f2a6ffff640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2a740762d0 0x7f2a74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:40.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.171+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f2a800b8eb0 con 0x7f2a8815f730 2024-05-10T11:16:40.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.171+0000 7f2a877fe640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2a740762d0 0x7f2a74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:40.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.171+0000 7f2a877fe640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2a740762d0 0x7f2a74078790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009ad0 tx=0x7f2a78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:40.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.175+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2a80082710 con 0x7f2a8815f730 2024-05-10T11:16:40.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.362+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a8806dcc0 con 0x7f2a740762d0 2024-05-10T11:16:40.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.368+0000 7f2a6ffff640 1 -- 172.21.15.66:0/3355346599 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7f2a8806dcc0 con 0x7f2a740762d0 2024-05-10T11:16:40.371 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:40.372 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2a740762d0 msgr2=0x7f2a74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2a740762d0 0x7f2a74078790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009ad0 tx=0x7f2a78008040 comp rx=0 tx=0).stop 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 msgr2=0x7f2a88148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 0x7f2a88148c10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2a8002abe0 tx=0x7f2a80004a40 comp rx=0 tx=0).stop 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 shutdown_connections 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2a740762d0 0x7f2a74078790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a8815f730 0x7f2a88148c10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a880caf50 0x7f2a8815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 --2- 172.21.15.66:0/3355346599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8806fa60 0x7f2a88146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:40.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 >> 172.21.15.66:0/3355346599 conn(0x7f2a880d1510 msgr2=0x7f2a881621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:40.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 shutdown_connections 2024-05-10T11:16:40.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:40.371+0000 7f2a8de54640 1 -- 172.21.15.66:0/3355346599 wait complete. 2024-05-10T11:16:40.383 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-05-10T11:16:39.744817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232920,"kb_used_data":8412,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754741800,"statfs":{"total":773094113280,"available":772855603200,"internally_reserved":0,"allocated":8613888,"data_stored":4524376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001478"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123443+0000","last_change":"2024-05-10T11:16:34.841901+0000","last_active":"2024-05-10T11:16:36.123443+0000","last_peered":"2024-05-10T11:16:36.123443+0000","last_clean":"2024-05-10T11:16:36.123443+0000","last_became_active":"2024-05-10T11:16:34.841434+0000","last_became_peered":"2024-05-10T11:16:34.841434+0000","last_unstale":"2024-05-10T11:16:36.123443+0000","last_undegraded":"2024-05-10T11:16:36.123443+0000","last_fullsized":"2024-05-10T11:16:36.123443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:22.304197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090781+0000","last_change":"2024-05-10T11:16:34.857557+0000","last_active":"2024-05-10T11:16:36.090781+0000","last_peered":"2024-05-10T11:16:36.090781+0000","last_clean":"2024-05-10T11:16:36.090781+0000","last_became_active":"2024-05-10T11:16:34.856310+0000","last_became_peered":"2024-05-10T11:16:34.856310+0000","last_unstale":"2024-05-10T11:16:36.090781+0000","last_undegraded":"2024-05-10T11:16:36.090781+0000","last_fullsized":"2024-05-10T11:16:36.090781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:00.497997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834826+0000","last_change":"2024-05-10T11:16:34.863981+0000","last_active":"2024-05-10T11:16:35.834826+0000","last_peered":"2024-05-10T11:16:35.834826+0000","last_clean":"2024-05-10T11:16:35.834826+0000","last_became_active":"2024-05-10T11:16:34.863695+0000","last_became_peered":"2024-05-10T11:16:34.863695+0000","last_unstale":"2024-05-10T11:16:35.834826+0000","last_undegraded":"2024-05-10T11:16:35.834826+0000","last_fullsized":"2024-05-10T11:16:35.834826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:46.500803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591580+0000","last_change":"2024-05-10T11:16:34.847095+0000","last_active":"2024-05-10T11:16:36.591580+0000","last_peered":"2024-05-10T11:16:36.591580+0000","last_clean":"2024-05-10T11:16:36.591580+0000","last_became_active":"2024-05-10T11:16:34.846771+0000","last_became_peered":"2024-05-10T11:16:34.846771+0000","last_unstale":"2024-05-10T11:16:36.591580+0000","last_undegraded":"2024-05-10T11:16:36.591580+0000","last_fullsized":"2024-05-10T11:16:36.591580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:25.224183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832902+0000","last_change":"2024-05-10T11:16:34.853396+0000","last_active":"2024-05-10T11:16:35.832902+0000","last_peered":"2024-05-10T11:16:35.832902+0000","last_clean":"2024-05-10T11:16:35.832902+0000","last_became_active":"2024-05-10T11:16:34.853004+0000","last_became_peered":"2024-05-10T11:16:34.853004+0000","last_unstale":"2024-05-10T11:16:35.832902+0000","last_undegraded":"2024-05-10T11:16:35.832902+0000","last_fullsized":"2024-05-10T11:16:35.832902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:09.722498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591534+0000","last_change":"2024-05-10T11:16:34.843889+0000","last_active":"2024-05-10T11:16:36.591534+0000","last_peered":"2024-05-10T11:16:36.591534+0000","last_clean":"2024-05-10T11:16:36.591534+0000","last_became_active":"2024-05-10T11:16:34.843054+0000","last_became_peered":"2024-05-10T11:16:34.843054+0000","last_unstale":"2024-05-10T11:16:36.591534+0000","last_undegraded":"2024-05-10T11:16:36.591534+0000","last_fullsized":"2024-05-10T11:16:36.591534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592173+0000","last_change":"2024-05-10T11:16:34.854832+0000","last_active":"2024-05-10T11:16:36.592173+0000","last_peered":"2024-05-10T11:16:36.592173+0000","last_clean":"2024-05-10T11:16:36.592173+0000","last_became_active":"2024-05-10T11:16:34.854434+0000","last_became_peered":"2024-05-10T11:16:34.854434+0000","last_unstale":"2024-05-10T11:16:36.592173+0000","last_undegraded":"2024-05-10T11:16:36.592173+0000","last_fullsized":"2024-05-10T11:16:36.592173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:30.308887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832709+0000","last_change":"2024-05-10T11:16:34.854083+0000","last_active":"2024-05-10T11:16:35.832709+0000","last_peered":"2024-05-10T11:16:35.832709+0000","last_clean":"2024-05-10T11:16:35.832709+0000","last_became_active":"2024-05-10T11:16:34.853826+0000","last_became_peered":"2024-05-10T11:16:34.853826+0000","last_unstale":"2024-05-10T11:16:35.832709+0000","last_undegraded":"2024-05-10T11:16:35.832709+0000","last_fullsized":"2024-05-10T11:16:35.832709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:04.002857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592722+0000","last_change":"2024-05-10T11:16:34.856367+0000","last_active":"2024-05-10T11:16:36.592722+0000","last_peered":"2024-05-10T11:16:36.592722+0000","last_clean":"2024-05-10T11:16:36.592722+0000","last_became_active":"2024-05-10T11:16:34.855423+0000","last_became_peered":"2024-05-10T11:16:34.855423+0000","last_unstale":"2024-05-10T11:16:36.592722+0000","last_undegraded":"2024-05-10T11:16:36.592722+0000","last_fullsized":"2024-05-10T11:16:36.592722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:13.480229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592763+0000","last_change":"2024-05-10T11:16:34.847152+0000","last_active":"2024-05-10T11:16:36.592763+0000","last_peered":"2024-05-10T11:16:36.592763+0000","last_clean":"2024-05-10T11:16:36.592763+0000","last_became_active":"2024-05-10T11:16:34.846613+0000","last_became_peered":"2024-05-10T11:16:34.846613+0000","last_unstale":"2024-05-10T11:16:36.592763+0000","last_undegraded":"2024-05-10T11:16:36.592763+0000","last_fullsized":"2024-05-10T11:16:36.592763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090713+0000","last_change":"2024-05-10T11:16:34.860674+0000","last_active":"2024-05-10T11:16:36.090713+0000","last_peered":"2024-05-10T11:16:36.090713+0000","last_clean":"2024-05-10T11:16:36.090713+0000","last_became_active":"2024-05-10T11:16:34.855401+0000","last_became_peered":"2024-05-10T11:16:34.855401+0000","last_unstale":"2024-05-10T11:16:36.090713+0000","last_undegraded":"2024-05-10T11:16:36.090713+0000","last_fullsized":"2024-05-10T11:16:36.090713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:37.966718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592638+0000","last_change":"2024-05-10T11:16:34.859258+0000","last_active":"2024-05-10T11:16:36.592638+0000","last_peered":"2024-05-10T11:16:36.592638+0000","last_clean":"2024-05-10T11:16:36.592638+0000","last_became_active":"2024-05-10T11:16:34.858948+0000","last_became_peered":"2024-05-10T11:16:34.858948+0000","last_unstale":"2024-05-10T11:16:36.592638+0000","last_undegraded":"2024-05-10T11:16:36.592638+0000","last_fullsized":"2024-05-10T11:16:36.592638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833033+0000","last_change":"2024-05-10T11:16:34.857125+0000","last_active":"2024-05-10T11:16:35.833033+0000","last_peered":"2024-05-10T11:16:35.833033+0000","last_clean":"2024-05-10T11:16:35.833033+0000","last_became_active":"2024-05-10T11:16:34.856827+0000","last_became_peered":"2024-05-10T11:16:34.856827+0000","last_unstale":"2024-05-10T11:16:35.833033+0000","last_undegraded":"2024-05-10T11:16:35.833033+0000","last_fullsized":"2024-05-10T11:16:35.833033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:43.061696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591465+0000","last_change":"2024-05-10T11:16:34.842679+0000","last_active":"2024-05-10T11:16:36.591465+0000","last_peered":"2024-05-10T11:16:36.591465+0000","last_clean":"2024-05-10T11:16:36.591465+0000","last_became_active":"2024-05-10T11:16:34.842419+0000","last_became_peered":"2024-05-10T11:16:34.842419+0000","last_unstale":"2024-05-10T11:16:36.591465+0000","last_undegraded":"2024-05-10T11:16:36.591465+0000","last_fullsized":"2024-05-10T11:16:36.591465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090384+0000","last_change":"2024-05-10T11:16:34.853761+0000","last_active":"2024-05-10T11:16:36.090384+0000","last_peered":"2024-05-10T11:16:36.090384+0000","last_clean":"2024-05-10T11:16:36.090384+0000","last_became_active":"2024-05-10T11:16:34.853449+0000","last_became_peered":"2024-05-10T11:16:34.853449+0000","last_unstale":"2024-05-10T11:16:36.090384+0000","last_undegraded":"2024-05-10T11:16:36.090384+0000","last_fullsized":"2024-05-10T11:16:36.090384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123213+0000","last_change":"2024-05-10T11:16:34.844774+0000","last_active":"2024-05-10T11:16:36.123213+0000","last_peered":"2024-05-10T11:16:36.123213+0000","last_clean":"2024-05-10T11:16:36.123213+0000","last_became_active":"2024-05-10T11:16:34.844510+0000","last_became_peered":"2024-05-10T11:16:34.844510+0000","last_unstale":"2024-05-10T11:16:36.123213+0000","last_undegraded":"2024-05-10T11:16:36.123213+0000","last_fullsized":"2024-05-10T11:16:36.123213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:39:28.847331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833123+0000","last_change":"2024-05-10T11:16:34.849207+0000","last_active":"2024-05-10T11:16:35.833123+0000","last_peered":"2024-05-10T11:16:35.833123+0000","last_clean":"2024-05-10T11:16:35.833123+0000","last_became_active":"2024-05-10T11:16:34.848933+0000","last_became_peered":"2024-05-10T11:16:34.848933+0000","last_unstale":"2024-05-10T11:16:35.833123+0000","last_undegraded":"2024-05-10T11:16:35.833123+0000","last_fullsized":"2024-05-10T11:16:35.833123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:55.352398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834879+0000","last_change":"2024-05-10T11:16:34.851758+0000","last_active":"2024-05-10T11:16:35.834879+0000","last_peered":"2024-05-10T11:16:35.834879+0000","last_clean":"2024-05-10T11:16:35.834879+0000","last_became_active":"2024-05-10T11:16:34.851466+0000","last_became_peered":"2024-05-10T11:16:34.851466+0000","last_unstale":"2024-05-10T11:16:35.834879+0000","last_undegraded":"2024-05-10T11:16:35.834879+0000","last_fullsized":"2024-05-10T11:16:35.834879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.700792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591745+0000","last_change":"2024-05-10T11:16:34.846246+0000","last_active":"2024-05-10T11:16:36.591745+0000","last_peered":"2024-05-10T11:16:36.591745+0000","last_clean":"2024-05-10T11:16:36.591745+0000","last_became_active":"2024-05-10T11:16:34.845391+0000","last_became_peered":"2024-05-10T11:16:34.845391+0000","last_unstale":"2024-05-10T11:16:36.591745+0000","last_undegraded":"2024-05-10T11:16:36.591745+0000","last_fullsized":"2024-05-10T11:16:36.591745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833050+0000","last_change":"2024-05-10T11:16:34.860384+0000","last_active":"2024-05-10T11:16:35.833050+0000","last_peered":"2024-05-10T11:16:35.833050+0000","last_clean":"2024-05-10T11:16:35.833050+0000","last_became_active":"2024-05-10T11:16:34.860050+0000","last_became_peered":"2024-05-10T11:16:34.860050+0000","last_unstale":"2024-05-10T11:16:35.833050+0000","last_undegraded":"2024-05-10T11:16:35.833050+0000","last_fullsized":"2024-05-10T11:16:35.833050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:53.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591469+0000","last_change":"2024-05-10T11:16:34.864212+0000","last_active":"2024-05-10T11:16:36.591469+0000","last_peered":"2024-05-10T11:16:36.591469+0000","last_clean":"2024-05-10T11:16:36.591469+0000","last_became_active":"2024-05-10T11:16:34.863914+0000","last_became_peered":"2024-05-10T11:16:34.863914+0000","last_unstale":"2024-05-10T11:16:36.591469+0000","last_undegraded":"2024-05-10T11:16:36.591469+0000","last_fullsized":"2024-05-10T11:16:36.591469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:34.993965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832837+0000","last_change":"2024-05-10T11:16:34.857747+0000","last_active":"2024-05-10T11:16:35.832837+0000","last_peered":"2024-05-10T11:16:35.832837+0000","last_clean":"2024-05-10T11:16:35.832837+0000","last_became_active":"2024-05-10T11:16:34.857437+0000","last_became_peered":"2024-05-10T11:16:34.857437+0000","last_unstale":"2024-05-10T11:16:35.832837+0000","last_undegraded":"2024-05-10T11:16:35.832837+0000","last_fullsized":"2024-05-10T11:16:35.832837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:14.230378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592293+0000","last_change":"2024-05-10T11:16:34.849433+0000","last_active":"2024-05-10T11:16:36.592293+0000","last_peered":"2024-05-10T11:16:36.592293+0000","last_clean":"2024-05-10T11:16:36.592293+0000","last_became_active":"2024-05-10T11:16:34.848042+0000","last_became_peered":"2024-05-10T11:16:34.848042+0000","last_unstale":"2024-05-10T11:16:36.592293+0000","last_undegraded":"2024-05-10T11:16:36.592293+0000","last_fullsized":"2024-05-10T11:16:36.592293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:09.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090543+0000","last_change":"2024-05-10T11:16:34.845780+0000","last_active":"2024-05-10T11:16:36.090543+0000","last_peered":"2024-05-10T11:16:36.090543+0000","last_clean":"2024-05-10T11:16:36.090543+0000","last_became_active":"2024-05-10T11:16:34.845322+0000","last_became_peered":"2024-05-10T11:16:34.845322+0000","last_unstale":"2024-05-10T11:16:36.090543+0000","last_undegraded":"2024-05-10T11:16:36.090543+0000","last_fullsized":"2024-05-10T11:16:36.090543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:20.443512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090673+0000","last_change":"2024-05-10T11:16:34.854455+0000","last_active":"2024-05-10T11:16:36.090673+0000","last_peered":"2024-05-10T11:16:36.090673+0000","last_clean":"2024-05-10T11:16:36.090673+0000","last_became_active":"2024-05-10T11:16:34.854168+0000","last_became_peered":"2024-05-10T11:16:34.854168+0000","last_unstale":"2024-05-10T11:16:36.090673+0000","last_undegraded":"2024-05-10T11:16:36.090673+0000","last_fullsized":"2024-05-10T11:16:36.090673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:08.765130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592820+0000","last_change":"2024-05-10T11:16:34.849031+0000","last_active":"2024-05-10T11:16:36.592820+0000","last_peered":"2024-05-10T11:16:36.592820+0000","last_clean":"2024-05-10T11:16:36.592820+0000","last_became_active":"2024-05-10T11:16:34.848672+0000","last_became_peered":"2024-05-10T11:16:34.848672+0000","last_unstale":"2024-05-10T11:16:36.592820+0000","last_undegraded":"2024-05-10T11:16:36.592820+0000","last_fullsized":"2024-05-10T11:16:36.592820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123515+0000","last_change":"2024-05-10T11:16:34.847508+0000","last_active":"2024-05-10T11:16:36.123515+0000","last_peered":"2024-05-10T11:16:36.123515+0000","last_clean":"2024-05-10T11:16:36.123515+0000","last_became_active":"2024-05-10T11:16:34.847216+0000","last_became_peered":"2024-05-10T11:16:34.847216+0000","last_unstale":"2024-05-10T11:16:36.123515+0000","last_undegraded":"2024-05-10T11:16:36.123515+0000","last_fullsized":"2024-05-10T11:16:36.123515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:11.881126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:34.856389+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:34.856031+0000","last_became_peered":"2024-05-10T11:16:34.856031+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:45.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090474+0000","last_change":"2024-05-10T11:16:34.846202+0000","last_active":"2024-05-10T11:16:36.090474+0000","last_peered":"2024-05-10T11:16:36.090474+0000","last_clean":"2024-05-10T11:16:36.090474+0000","last_became_active":"2024-05-10T11:16:34.844252+0000","last_became_peered":"2024-05-10T11:16:34.844252+0000","last_unstale":"2024-05-10T11:16:36.090474+0000","last_undegraded":"2024-05-10T11:16:36.090474+0000","last_fullsized":"2024-05-10T11:16:36.090474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123147+0000","last_change":"2024-05-10T11:16:34.844191+0000","last_active":"2024-05-10T11:16:36.123147+0000","last_peered":"2024-05-10T11:16:36.123147+0000","last_clean":"2024-05-10T11:16:36.123147+0000","last_became_active":"2024-05-10T11:16:34.843927+0000","last_became_peered":"2024-05-10T11:16:34.843927+0000","last_unstale":"2024-05-10T11:16:36.123147+0000","last_undegraded":"2024-05-10T11:16:36.123147+0000","last_fullsized":"2024-05-10T11:16:36.123147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:34.369870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834602+0000","last_change":"2024-05-10T11:16:34.851184+0000","last_active":"2024-05-10T11:16:35.834602+0000","last_peered":"2024-05-10T11:16:35.834602+0000","last_clean":"2024-05-10T11:16:35.834602+0000","last_became_active":"2024-05-10T11:16:34.850836+0000","last_became_peered":"2024-05-10T11:16:34.850836+0000","last_unstale":"2024-05-10T11:16:35.834602+0000","last_undegraded":"2024-05-10T11:16:35.834602+0000","last_fullsized":"2024-05-10T11:16:35.834602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:48.282472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123237+0000","last_change":"2024-05-10T11:16:34.841133+0000","last_active":"2024-05-10T11:16:36.123237+0000","last_peered":"2024-05-10T11:16:36.123237+0000","last_clean":"2024-05-10T11:16:36.123237+0000","last_became_active":"2024-05-10T11:16:34.840859+0000","last_became_peered":"2024-05-10T11:16:34.840859+0000","last_unstale":"2024-05-10T11:16:36.123237+0000","last_undegraded":"2024-05-10T11:16:36.123237+0000","last_fullsized":"2024-05-10T11:16:36.123237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:05.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834526+0000","last_change":"2024-05-10T11:16:34.851721+0000","last_active":"2024-05-10T11:16:35.834526+0000","last_peered":"2024-05-10T11:16:35.834526+0000","last_clean":"2024-05-10T11:16:35.834526+0000","last_became_active":"2024-05-10T11:16:34.851415+0000","last_became_peered":"2024-05-10T11:16:34.851415+0000","last_unstale":"2024-05-10T11:16:35.834526+0000","last_undegraded":"2024-05-10T11:16:35.834526+0000","last_fullsized":"2024-05-10T11:16:35.834526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833093+0000","last_change":"2024-05-10T11:16:33.849083+0000","last_active":"2024-05-10T11:16:35.833093+0000","last_peered":"2024-05-10T11:16:35.833093+0000","last_clean":"2024-05-10T11:16:35.833093+0000","last_became_active":"2024-05-10T11:16:33.848804+0000","last_became_peered":"2024-05-10T11:16:33.848804+0000","last_unstale":"2024-05-10T11:16:35.833093+0000","last_undegraded":"2024-05-10T11:16:35.833093+0000","last_fullsized":"2024-05-10T11:16:35.833093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:16.316656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090374+0000","last_change":"2024-05-10T11:16:34.849023+0000","last_active":"2024-05-10T11:16:36.090374+0000","last_peered":"2024-05-10T11:16:36.090374+0000","last_clean":"2024-05-10T11:16:36.090374+0000","last_became_active":"2024-05-10T11:16:34.848690+0000","last_became_peered":"2024-05-10T11:16:34.848690+0000","last_unstale":"2024-05-10T11:16:36.090374+0000","last_undegraded":"2024-05-10T11:16:36.090374+0000","last_fullsized":"2024-05-10T11:16:36.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123297+0000","last_change":"2024-05-10T11:16:33.848383+0000","last_active":"2024-05-10T11:16:36.123297+0000","last_peered":"2024-05-10T11:16:36.123297+0000","last_clean":"2024-05-10T11:16:36.123297+0000","last_became_active":"2024-05-10T11:16:33.847992+0000","last_became_peered":"2024-05-10T11:16:33.847992+0000","last_unstale":"2024-05-10T11:16:36.123297+0000","last_undegraded":"2024-05-10T11:16:36.123297+0000","last_fullsized":"2024-05-10T11:16:36.123297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:27.043633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591962+0000","last_change":"2024-05-10T11:16:34.846220+0000","last_active":"2024-05-10T11:16:36.591962+0000","last_peered":"2024-05-10T11:16:36.591962+0000","last_clean":"2024-05-10T11:16:36.591962+0000","last_became_active":"2024-05-10T11:16:34.845661+0000","last_became_peered":"2024-05-10T11:16:34.845661+0000","last_unstale":"2024-05-10T11:16:36.591962+0000","last_undegraded":"2024-05-10T11:16:36.591962+0000","last_fullsized":"2024-05-10T11:16:36.591962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:39.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123200+0000","last_change":"2024-05-10T11:16:33.851782+0000","last_active":"2024-05-10T11:16:36.123200+0000","last_peered":"2024-05-10T11:16:36.123200+0000","last_clean":"2024-05-10T11:16:36.123200+0000","last_became_active":"2024-05-10T11:16:33.851519+0000","last_became_peered":"2024-05-10T11:16:33.851519+0000","last_unstale":"2024-05-10T11:16:36.123200+0000","last_undegraded":"2024-05-10T11:16:36.123200+0000","last_fullsized":"2024-05-10T11:16:36.123200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:38:15.306917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591646+0000","last_change":"2024-05-10T11:16:34.864010+0000","last_active":"2024-05-10T11:16:36.591646+0000","last_peered":"2024-05-10T11:16:36.591646+0000","last_clean":"2024-05-10T11:16:36.591646+0000","last_became_active":"2024-05-10T11:16:34.863841+0000","last_became_peered":"2024-05-10T11:16:34.863841+0000","last_unstale":"2024-05-10T11:16:36.591646+0000","last_undegraded":"2024-05-10T11:16:36.591646+0000","last_fullsized":"2024-05-10T11:16:36.591646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:39:21.755947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591988+0000","last_change":"2024-05-10T11:16:33.845477+0000","last_active":"2024-05-10T11:16:36.591988+0000","last_peered":"2024-05-10T11:16:36.591988+0000","last_clean":"2024-05-10T11:16:36.591988+0000","last_became_active":"2024-05-10T11:16:33.845155+0000","last_became_peered":"2024-05-10T11:16:33.845155+0000","last_unstale":"2024-05-10T11:16:36.591988+0000","last_undegraded":"2024-05-10T11:16:36.591988+0000","last_fullsized":"2024-05-10T11:16:36.591988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:23.515944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090601+0000","last_change":"2024-05-10T11:16:34.864666+0000","last_active":"2024-05-10T11:16:36.090601+0000","last_peered":"2024-05-10T11:16:36.090601+0000","last_clean":"2024-05-10T11:16:36.090601+0000","last_became_active":"2024-05-10T11:16:34.864410+0000","last_became_peered":"2024-05-10T11:16:34.864410+0000","last_unstale":"2024-05-10T11:16:36.090601+0000","last_undegraded":"2024-05-10T11:16:36.090601+0000","last_fullsized":"2024-05-10T11:16:36.090601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:56.782670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592520+0000","last_change":"2024-05-10T11:16:33.844658+0000","last_active":"2024-05-10T11:16:36.592520+0000","last_peered":"2024-05-10T11:16:36.592520+0000","last_clean":"2024-05-10T11:16:36.592520+0000","last_became_active":"2024-05-10T11:16:33.844370+0000","last_became_peered":"2024-05-10T11:16:33.844370+0000","last_unstale":"2024-05-10T11:16:36.592520+0000","last_undegraded":"2024-05-10T11:16:36.592520+0000","last_fullsized":"2024-05-10T11:16:36.592520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:00.783500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090787+0000","last_change":"2024-05-10T11:16:34.844211+0000","last_active":"2024-05-10T11:16:36.090787+0000","last_peered":"2024-05-10T11:16:36.090787+0000","last_clean":"2024-05-10T11:16:36.090787+0000","last_became_active":"2024-05-10T11:16:34.843830+0000","last_became_peered":"2024-05-10T11:16:34.843830+0000","last_unstale":"2024-05-10T11:16:36.090787+0000","last_undegraded":"2024-05-10T11:16:36.090787+0000","last_fullsized":"2024-05-10T11:16:36.090787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:52.427590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591559+0000","last_change":"2024-05-10T11:16:33.839972+0000","last_active":"2024-05-10T11:16:36.591559+0000","last_peered":"2024-05-10T11:16:36.591559+0000","last_clean":"2024-05-10T11:16:36.591559+0000","last_became_active":"2024-05-10T11:16:33.839660+0000","last_became_peered":"2024-05-10T11:16:33.839660+0000","last_unstale":"2024-05-10T11:16:36.591559+0000","last_undegraded":"2024-05-10T11:16:36.591559+0000","last_fullsized":"2024-05-10T11:16:36.591559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:34.138529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592885+0000","last_change":"2024-05-10T11:16:34.855057+0000","last_active":"2024-05-10T11:16:36.592885+0000","last_peered":"2024-05-10T11:16:36.592885+0000","last_clean":"2024-05-10T11:16:36.592885+0000","last_became_active":"2024-05-10T11:16:34.854723+0000","last_became_peered":"2024-05-10T11:16:34.854723+0000","last_unstale":"2024-05-10T11:16:36.592885+0000","last_undegraded":"2024-05-10T11:16:36.592885+0000","last_fullsized":"2024-05-10T11:16:36.592885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:21.582156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090486+0000","last_change":"2024-05-10T11:16:33.849599+0000","last_active":"2024-05-10T11:16:36.090486+0000","last_peered":"2024-05-10T11:16:36.090486+0000","last_clean":"2024-05-10T11:16:36.090486+0000","last_became_active":"2024-05-10T11:16:33.849241+0000","last_became_peered":"2024-05-10T11:16:33.849241+0000","last_unstale":"2024-05-10T11:16:36.090486+0000","last_undegraded":"2024-05-10T11:16:36.090486+0000","last_fullsized":"2024-05-10T11:16:36.090486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:50.691422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592087+0000","last_change":"2024-05-10T11:16:34.853007+0000","last_active":"2024-05-10T11:16:36.592087+0000","last_peered":"2024-05-10T11:16:36.592087+0000","last_clean":"2024-05-10T11:16:36.592087+0000","last_became_active":"2024-05-10T11:16:34.849965+0000","last_became_peered":"2024-05-10T11:16:34.849965+0000","last_unstale":"2024-05-10T11:16:36.592087+0000","last_undegraded":"2024-05-10T11:16:36.592087+0000","last_fullsized":"2024-05-10T11:16:36.592087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:00.428683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832783+0000","last_change":"2024-05-10T11:16:33.850927+0000","last_active":"2024-05-10T11:16:35.832783+0000","last_peered":"2024-05-10T11:16:35.832783+0000","last_clean":"2024-05-10T11:16:35.832783+0000","last_became_active":"2024-05-10T11:16:33.850620+0000","last_became_peered":"2024-05-10T11:16:33.850620+0000","last_unstale":"2024-05-10T11:16:35.832783+0000","last_undegraded":"2024-05-10T11:16:35.832783+0000","last_fullsized":"2024-05-10T11:16:35.832783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:31.969039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090316+0000","last_change":"2024-05-10T11:16:34.839538+0000","last_active":"2024-05-10T11:16:36.090316+0000","last_peered":"2024-05-10T11:16:36.090316+0000","last_clean":"2024-05-10T11:16:36.090316+0000","last_became_active":"2024-05-10T11:16:34.839244+0000","last_became_peered":"2024-05-10T11:16:34.839244+0000","last_unstale":"2024-05-10T11:16:36.090316+0000","last_undegraded":"2024-05-10T11:16:36.090316+0000","last_fullsized":"2024-05-10T11:16:36.090316+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123500+0000","last_change":"2024-05-10T11:16:33.847120+0000","last_active":"2024-05-10T11:16:36.123500+0000","last_peered":"2024-05-10T11:16:36.123500+0000","last_clean":"2024-05-10T11:16:36.123500+0000","last_became_active":"2024-05-10T11:16:33.846773+0000","last_became_peered":"2024-05-10T11:16:33.846773+0000","last_unstale":"2024-05-10T11:16:36.123500+0000","last_undegraded":"2024-05-10T11:16:36.123500+0000","last_fullsized":"2024-05-10T11:16:36.123500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:17.506050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591488+0000","last_change":"2024-05-10T11:16:34.843679+0000","last_active":"2024-05-10T11:16:36.591488+0000","last_peered":"2024-05-10T11:16:36.591488+0000","last_clean":"2024-05-10T11:16:36.591488+0000","last_became_active":"2024-05-10T11:16:34.843383+0000","last_became_peered":"2024-05-10T11:16:34.843383+0000","last_unstale":"2024-05-10T11:16:36.591488+0000","last_undegraded":"2024-05-10T11:16:36.591488+0000","last_fullsized":"2024-05-10T11:16:36.591488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:09.348219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592877+0000","last_change":"2024-05-10T11:16:33.841357+0000","last_active":"2024-05-10T11:16:36.592877+0000","last_peered":"2024-05-10T11:16:36.592877+0000","last_clean":"2024-05-10T11:16:36.592877+0000","last_became_active":"2024-05-10T11:16:33.841097+0000","last_became_peered":"2024-05-10T11:16:33.841097+0000","last_unstale":"2024-05-10T11:16:36.592877+0000","last_undegraded":"2024-05-10T11:16:36.592877+0000","last_fullsized":"2024-05-10T11:16:36.592877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591637+0000","last_change":"2024-05-10T11:16:34.859325+0000","last_active":"2024-05-10T11:16:36.591637+0000","last_peered":"2024-05-10T11:16:36.591637+0000","last_clean":"2024-05-10T11:16:36.591637+0000","last_became_active":"2024-05-10T11:16:34.859028+0000","last_became_peered":"2024-05-10T11:16:34.859028+0000","last_unstale":"2024-05-10T11:16:36.591637+0000","last_undegraded":"2024-05-10T11:16:36.591637+0000","last_fullsized":"2024-05-10T11:16:36.591637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833154+0000","last_change":"2024-05-10T11:16:33.850700+0000","last_active":"2024-05-10T11:16:35.833154+0000","last_peered":"2024-05-10T11:16:35.833154+0000","last_clean":"2024-05-10T11:16:35.833154+0000","last_became_active":"2024-05-10T11:16:33.850423+0000","last_became_peered":"2024-05-10T11:16:33.850423+0000","last_unstale":"2024-05-10T11:16:35.833154+0000","last_undegraded":"2024-05-10T11:16:35.833154+0000","last_fullsized":"2024-05-10T11:16:35.833154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:53.739455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834766+0000","last_change":"2024-05-10T11:16:34.863940+0000","last_active":"2024-05-10T11:16:35.834766+0000","last_peered":"2024-05-10T11:16:35.834766+0000","last_clean":"2024-05-10T11:16:35.834766+0000","last_became_active":"2024-05-10T11:16:34.863635+0000","last_became_peered":"2024-05-10T11:16:34.863635+0000","last_unstale":"2024-05-10T11:16:35.834766+0000","last_undegraded":"2024-05-10T11:16:35.834766+0000","last_fullsized":"2024-05-10T11:16:35.834766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:19.129956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"75'6","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592316+0000","last_change":"2024-05-10T11:16:33.840650+0000","last_active":"2024-05-10T11:16:36.592316+0000","last_peered":"2024-05-10T11:16:36.592316+0000","last_clean":"2024-05-10T11:16:36.592316+0000","last_became_active":"2024-05-10T11:16:33.840327+0000","last_became_peered":"2024-05-10T11:16:33.840327+0000","last_unstale":"2024-05-10T11:16:36.592316+0000","last_undegraded":"2024-05-10T11:16:36.592316+0000","last_fullsized":"2024-05-10T11:16:36.592316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:07.459165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592546+0000","last_change":"2024-05-10T11:16:34.854844+0000","last_active":"2024-05-10T11:16:36.592546+0000","last_peered":"2024-05-10T11:16:36.592546+0000","last_clean":"2024-05-10T11:16:36.592546+0000","last_became_active":"2024-05-10T11:16:34.854522+0000","last_became_peered":"2024-05-10T11:16:34.854522+0000","last_unstale":"2024-05-10T11:16:36.592546+0000","last_undegraded":"2024-05-10T11:16:36.592546+0000","last_fullsized":"2024-05-10T11:16:36.592546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:58.379390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591480+0000","last_change":"2024-05-10T11:16:33.834877+0000","last_active":"2024-05-10T11:16:36.591480+0000","last_peered":"2024-05-10T11:16:36.591480+0000","last_clean":"2024-05-10T11:16:36.591480+0000","last_became_active":"2024-05-10T11:16:33.834597+0000","last_became_peered":"2024-05-10T11:16:33.834597+0000","last_unstale":"2024-05-10T11:16:36.591480+0000","last_undegraded":"2024-05-10T11:16:36.591480+0000","last_fullsized":"2024-05-10T11:16:36.591480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591649+0000","last_change":"2024-05-10T11:16:34.854933+0000","last_active":"2024-05-10T11:16:36.591649+0000","last_peered":"2024-05-10T11:16:36.591649+0000","last_clean":"2024-05-10T11:16:36.591649+0000","last_became_active":"2024-05-10T11:16:34.854658+0000","last_became_peered":"2024-05-10T11:16:34.854658+0000","last_unstale":"2024-05-10T11:16:36.591649+0000","last_undegraded":"2024-05-10T11:16:36.591649+0000","last_fullsized":"2024-05-10T11:16:36.591649+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:38:16.316287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123221+0000","last_change":"2024-05-10T11:16:33.852289+0000","last_active":"2024-05-10T11:16:36.123221+0000","last_peered":"2024-05-10T11:16:36.123221+0000","last_clean":"2024-05-10T11:16:36.123221+0000","last_became_active":"2024-05-10T11:16:33.852005+0000","last_became_peered":"2024-05-10T11:16:33.852005+0000","last_unstale":"2024-05-10T11:16:36.123221+0000","last_undegraded":"2024-05-10T11:16:36.123221+0000","last_fullsized":"2024-05-10T11:16:36.123221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:29.299517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592003+0000","last_change":"2024-05-10T11:16:34.844665+0000","last_active":"2024-05-10T11:16:36.592003+0000","last_peered":"2024-05-10T11:16:36.592003+0000","last_clean":"2024-05-10T11:16:36.592003+0000","last_became_active":"2024-05-10T11:16:34.844360+0000","last_became_peered":"2024-05-10T11:16:34.844360+0000","last_unstale":"2024-05-10T11:16:36.592003+0000","last_undegraded":"2024-05-10T11:16:36.592003+0000","last_fullsized":"2024-05-10T11:16:36.592003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:36.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832731+0000","last_change":"2024-05-10T11:16:33.851756+0000","last_active":"2024-05-10T11:16:35.832731+0000","last_peered":"2024-05-10T11:16:35.832731+0000","last_clean":"2024-05-10T11:16:35.832731+0000","last_became_active":"2024-05-10T11:16:33.851459+0000","last_became_peered":"2024-05-10T11:16:33.851459+0000","last_unstale":"2024-05-10T11:16:35.832731+0000","last_undegraded":"2024-05-10T11:16:35.832731+0000","last_fullsized":"2024-05-10T11:16:35.832731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:00.512992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592153+0000","last_change":"2024-05-10T11:16:34.861004+0000","last_active":"2024-05-10T11:16:36.592153+0000","last_peered":"2024-05-10T11:16:36.592153+0000","last_clean":"2024-05-10T11:16:36.592153+0000","last_became_active":"2024-05-10T11:16:34.860699+0000","last_became_peered":"2024-05-10T11:16:34.860699+0000","last_unstale":"2024-05-10T11:16:36.592153+0000","last_undegraded":"2024-05-10T11:16:36.592153+0000","last_fullsized":"2024-05-10T11:16:36.592153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:27.685025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090447+0000","last_change":"2024-05-10T11:16:33.845959+0000","last_active":"2024-05-10T11:16:36.090447+0000","last_peered":"2024-05-10T11:16:36.090447+0000","last_clean":"2024-05-10T11:16:36.090447+0000","last_became_active":"2024-05-10T11:16:33.845331+0000","last_became_peered":"2024-05-10T11:16:33.845331+0000","last_unstale":"2024-05-10T11:16:36.090447+0000","last_undegraded":"2024-05-10T11:16:36.090447+0000","last_fullsized":"2024-05-10T11:16:36.090447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:45.491433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591231+0000","last_change":"2024-05-10T11:16:34.852456+0000","last_active":"2024-05-10T11:16:36.591231+0000","last_peered":"2024-05-10T11:16:36.591231+0000","last_clean":"2024-05-10T11:16:36.591231+0000","last_became_active":"2024-05-10T11:16:34.852136+0000","last_became_peered":"2024-05-10T11:16:34.852136+0000","last_unstale":"2024-05-10T11:16:36.591231+0000","last_undegraded":"2024-05-10T11:16:36.591231+0000","last_fullsized":"2024-05-10T11:16:36.591231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123548+0000","last_change":"2024-05-10T11:16:33.847150+0000","last_active":"2024-05-10T11:16:36.123548+0000","last_peered":"2024-05-10T11:16:36.123548+0000","last_clean":"2024-05-10T11:16:36.123548+0000","last_became_active":"2024-05-10T11:16:33.846903+0000","last_became_peered":"2024-05-10T11:16:33.846903+0000","last_unstale":"2024-05-10T11:16:36.123548+0000","last_undegraded":"2024-05-10T11:16:36.123548+0000","last_fullsized":"2024-05-10T11:16:36.123548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:33:16.225216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832695+0000","last_change":"2024-05-10T11:16:34.845165+0000","last_active":"2024-05-10T11:16:35.832695+0000","last_peered":"2024-05-10T11:16:35.832695+0000","last_clean":"2024-05-10T11:16:35.832695+0000","last_became_active":"2024-05-10T11:16:34.844886+0000","last_became_peered":"2024-05-10T11:16:34.844886+0000","last_unstale":"2024-05-10T11:16:35.832695+0000","last_undegraded":"2024-05-10T11:16:35.832695+0000","last_fullsized":"2024-05-10T11:16:35.832695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:15.505458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592859+0000","last_change":"2024-05-10T11:16:33.840287+0000","last_active":"2024-05-10T11:16:36.592859+0000","last_peered":"2024-05-10T11:16:36.592859+0000","last_clean":"2024-05-10T11:16:36.592859+0000","last_became_active":"2024-05-10T11:16:33.840016+0000","last_became_peered":"2024-05-10T11:16:33.840016+0000","last_unstale":"2024-05-10T11:16:36.592859+0000","last_undegraded":"2024-05-10T11:16:36.592859+0000","last_fullsized":"2024-05-10T11:16:36.592859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:05:27.619307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832710+0000","last_change":"2024-05-10T11:16:34.857683+0000","last_active":"2024-05-10T11:16:35.832710+0000","last_peered":"2024-05-10T11:16:35.832710+0000","last_clean":"2024-05-10T11:16:35.832710+0000","last_became_active":"2024-05-10T11:16:34.857411+0000","last_became_peered":"2024-05-10T11:16:34.857411+0000","last_unstale":"2024-05-10T11:16:35.832710+0000","last_undegraded":"2024-05-10T11:16:35.832710+0000","last_fullsized":"2024-05-10T11:16:35.832710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:04.078921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:33.849638+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:33.849383+0000","last_became_peered":"2024-05-10T11:16:33.849383+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.217874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591483+0000","last_change":"2024-05-10T11:16:34.861019+0000","last_active":"2024-05-10T11:16:36.591483+0000","last_peered":"2024-05-10T11:16:36.591483+0000","last_clean":"2024-05-10T11:16:36.591483+0000","last_became_active":"2024-05-10T11:16:34.860667+0000","last_became_peered":"2024-05-10T11:16:34.860667+0000","last_unstale":"2024-05-10T11:16:36.591483+0000","last_undegraded":"2024-05-10T11:16:36.591483+0000","last_fullsized":"2024-05-10T11:16:36.591483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834612+0000","last_change":"2024-05-10T11:16:33.851897+0000","last_active":"2024-05-10T11:16:35.834612+0000","last_peered":"2024-05-10T11:16:35.834612+0000","last_clean":"2024-05-10T11:16:35.834612+0000","last_became_active":"2024-05-10T11:16:33.851629+0000","last_became_peered":"2024-05-10T11:16:33.851629+0000","last_unstale":"2024-05-10T11:16:35.834612+0000","last_undegraded":"2024-05-10T11:16:35.834612+0000","last_fullsized":"2024-05-10T11:16:35.834612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:02.785863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090623+0000","last_change":"2024-05-10T11:16:34.849709+0000","last_active":"2024-05-10T11:16:36.090623+0000","last_peered":"2024-05-10T11:16:36.090623+0000","last_clean":"2024-05-10T11:16:36.090623+0000","last_became_active":"2024-05-10T11:16:34.849412+0000","last_became_peered":"2024-05-10T11:16:34.849412+0000","last_unstale":"2024-05-10T11:16:36.090623+0000","last_undegraded":"2024-05-10T11:16:36.090623+0000","last_fullsized":"2024-05-10T11:16:36.090623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:09.452662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591486+0000","last_change":"2024-05-10T11:16:33.840818+0000","last_active":"2024-05-10T11:16:36.591486+0000","last_peered":"2024-05-10T11:16:36.591486+0000","last_clean":"2024-05-10T11:16:36.591486+0000","last_became_active":"2024-05-10T11:16:33.840472+0000","last_became_peered":"2024-05-10T11:16:33.840472+0000","last_unstale":"2024-05-10T11:16:36.591486+0000","last_undegraded":"2024-05-10T11:16:36.591486+0000","last_fullsized":"2024-05-10T11:16:36.591486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:36:21.942433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090750+0000","last_change":"2024-05-10T11:16:34.848027+0000","last_active":"2024-05-10T11:16:36.090750+0000","last_peered":"2024-05-10T11:16:36.090750+0000","last_clean":"2024-05-10T11:16:36.090750+0000","last_became_active":"2024-05-10T11:16:34.846208+0000","last_became_peered":"2024-05-10T11:16:34.846208+0000","last_unstale":"2024-05-10T11:16:36.090750+0000","last_undegraded":"2024-05-10T11:16:36.090750+0000","last_fullsized":"2024-05-10T11:16:36.090750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:21.557365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591275+0000","last_change":"2024-05-10T11:16:33.843809+0000","last_active":"2024-05-10T11:16:36.591275+0000","last_peered":"2024-05-10T11:16:36.591275+0000","last_clean":"2024-05-10T11:16:36.591275+0000","last_became_active":"2024-05-10T11:16:33.843314+0000","last_became_peered":"2024-05-10T11:16:33.843314+0000","last_unstale":"2024-05-10T11:16:36.591275+0000","last_undegraded":"2024-05-10T11:16:36.591275+0000","last_fullsized":"2024-05-10T11:16:36.591275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592289+0000","last_change":"2024-05-10T11:16:34.852587+0000","last_active":"2024-05-10T11:16:36.592289+0000","last_peered":"2024-05-10T11:16:36.592289+0000","last_clean":"2024-05-10T11:16:36.592289+0000","last_became_active":"2024-05-10T11:16:34.848206+0000","last_became_peered":"2024-05-10T11:16:34.848206+0000","last_unstale":"2024-05-10T11:16:36.592289+0000","last_undegraded":"2024-05-10T11:16:36.592289+0000","last_fullsized":"2024-05-10T11:16:36.592289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:18.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591160+0000","last_change":"2024-05-10T11:16:33.842957+0000","last_active":"2024-05-10T11:16:36.591160+0000","last_peered":"2024-05-10T11:16:36.591160+0000","last_clean":"2024-05-10T11:16:36.591160+0000","last_became_active":"2024-05-10T11:16:33.842675+0000","last_became_peered":"2024-05-10T11:16:33.842675+0000","last_unstale":"2024-05-10T11:16:36.591160+0000","last_undegraded":"2024-05-10T11:16:36.591160+0000","last_fullsized":"2024-05-10T11:16:36.591160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591790+0000","last_change":"2024-05-10T11:16:34.844506+0000","last_active":"2024-05-10T11:16:36.591790+0000","last_peered":"2024-05-10T11:16:36.591790+0000","last_clean":"2024-05-10T11:16:36.591790+0000","last_became_active":"2024-05-10T11:16:34.844234+0000","last_became_peered":"2024-05-10T11:16:34.844234+0000","last_unstale":"2024-05-10T11:16:36.591790+0000","last_undegraded":"2024-05-10T11:16:36.591790+0000","last_fullsized":"2024-05-10T11:16:36.591790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:48.813843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592665+0000","last_change":"2024-05-10T11:16:33.839202+0000","last_active":"2024-05-10T11:16:36.592665+0000","last_peered":"2024-05-10T11:16:36.592665+0000","last_clean":"2024-05-10T11:16:36.592665+0000","last_became_active":"2024-05-10T11:16:33.838582+0000","last_became_peered":"2024-05-10T11:16:33.838582+0000","last_unstale":"2024-05-10T11:16:36.592665+0000","last_undegraded":"2024-05-10T11:16:36.592665+0000","last_fullsized":"2024-05-10T11:16:36.592665+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592216+0000","last_change":"2024-05-10T11:16:34.861753+0000","last_active":"2024-05-10T11:16:36.592216+0000","last_peered":"2024-05-10T11:16:36.592216+0000","last_clean":"2024-05-10T11:16:36.592216+0000","last_became_active":"2024-05-10T11:16:34.861491+0000","last_became_peered":"2024-05-10T11:16:34.861491+0000","last_unstale":"2024-05-10T11:16:36.592216+0000","last_undegraded":"2024-05-10T11:16:36.592216+0000","last_fullsized":"2024-05-10T11:16:36.592216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:22.427530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.837136+0000","last_change":"2024-05-10T11:16:33.850966+0000","last_active":"2024-05-10T11:16:36.837136+0000","last_peered":"2024-05-10T11:16:36.837136+0000","last_clean":"2024-05-10T11:16:36.837136+0000","last_became_active":"2024-05-10T11:16:33.850661+0000","last_became_peered":"2024-05-10T11:16:33.850661+0000","last_unstale":"2024-05-10T11:16:36.837136+0000","last_undegraded":"2024-05-10T11:16:36.837136+0000","last_fullsized":"2024-05-10T11:16:36.837136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592119+0000","last_change":"2024-05-10T11:16:34.845648+0000","last_active":"2024-05-10T11:16:36.592119+0000","last_peered":"2024-05-10T11:16:36.592119+0000","last_clean":"2024-05-10T11:16:36.592119+0000","last_became_active":"2024-05-10T11:16:34.845374+0000","last_became_peered":"2024-05-10T11:16:34.845374+0000","last_unstale":"2024-05-10T11:16:36.592119+0000","last_undegraded":"2024-05-10T11:16:36.592119+0000","last_fullsized":"2024-05-10T11:16:36.592119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:31.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123574+0000","last_change":"2024-05-10T11:16:33.848721+0000","last_active":"2024-05-10T11:16:36.123574+0000","last_peered":"2024-05-10T11:16:36.123574+0000","last_clean":"2024-05-10T11:16:36.123574+0000","last_became_active":"2024-05-10T11:16:33.848429+0000","last_became_peered":"2024-05-10T11:16:33.848429+0000","last_unstale":"2024-05-10T11:16:36.123574+0000","last_undegraded":"2024-05-10T11:16:36.123574+0000","last_fullsized":"2024-05-10T11:16:36.123574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:45.477319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090506+0000","last_change":"2024-05-10T11:16:34.846463+0000","last_active":"2024-05-10T11:16:36.090506+0000","last_peered":"2024-05-10T11:16:36.090506+0000","last_clean":"2024-05-10T11:16:36.090506+0000","last_became_active":"2024-05-10T11:16:34.845916+0000","last_became_peered":"2024-05-10T11:16:34.845916+0000","last_unstale":"2024-05-10T11:16:36.090506+0000","last_undegraded":"2024-05-10T11:16:36.090506+0000","last_fullsized":"2024-05-10T11:16:36.090506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:18.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123145+0000","last_change":"2024-05-10T11:16:33.848344+0000","last_active":"2024-05-10T11:16:36.123145+0000","last_peered":"2024-05-10T11:16:36.123145+0000","last_clean":"2024-05-10T11:16:36.123145+0000","last_became_active":"2024-05-10T11:16:33.848071+0000","last_became_peered":"2024-05-10T11:16:33.848071+0000","last_unstale":"2024-05-10T11:16:36.123145+0000","last_undegraded":"2024-05-10T11:16:36.123145+0000","last_fullsized":"2024-05-10T11:16:36.123145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:21.418160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591864+0000","last_change":"2024-05-10T11:16:34.861800+0000","last_active":"2024-05-10T11:16:36.591864+0000","last_peered":"2024-05-10T11:16:36.591864+0000","last_clean":"2024-05-10T11:16:36.591864+0000","last_became_active":"2024-05-10T11:16:34.861522+0000","last_became_peered":"2024-05-10T11:16:34.861522+0000","last_unstale":"2024-05-10T11:16:36.591864+0000","last_undegraded":"2024-05-10T11:16:36.591864+0000","last_fullsized":"2024-05-10T11:16:36.591864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:52:46.326579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591651+0000","last_change":"2024-05-10T11:16:33.842583+0000","last_active":"2024-05-10T11:16:36.591651+0000","last_peered":"2024-05-10T11:16:36.591651+0000","last_clean":"2024-05-10T11:16:36.591651+0000","last_became_active":"2024-05-10T11:16:33.842298+0000","last_became_peered":"2024-05-10T11:16:33.842298+0000","last_unstale":"2024-05-10T11:16:36.591651+0000","last_undegraded":"2024-05-10T11:16:36.591651+0000","last_fullsized":"2024-05-10T11:16:36.591651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:21.149766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591766+0000","last_change":"2024-05-10T11:16:34.851644+0000","last_active":"2024-05-10T11:16:36.591766+0000","last_peered":"2024-05-10T11:16:36.591766+0000","last_clean":"2024-05-10T11:16:36.591766+0000","last_became_active":"2024-05-10T11:16:34.851376+0000","last_became_peered":"2024-05-10T11:16:34.851376+0000","last_unstale":"2024-05-10T11:16:36.591766+0000","last_undegraded":"2024-05-10T11:16:36.591766+0000","last_fullsized":"2024-05-10T11:16:36.591766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:48.035155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832824+0000","last_change":"2024-05-10T11:16:33.851549+0000","last_active":"2024-05-10T11:16:35.832824+0000","last_peered":"2024-05-10T11:16:35.832824+0000","last_clean":"2024-05-10T11:16:35.832824+0000","last_became_active":"2024-05-10T11:16:33.851206+0000","last_became_peered":"2024-05-10T11:16:33.851206+0000","last_unstale":"2024-05-10T11:16:35.832824+0000","last_undegraded":"2024-05-10T11:16:35.832824+0000","last_fullsized":"2024-05-10T11:16:35.832824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:02.953747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834995+0000","last_change":"2024-05-10T11:16:34.863061+0000","last_active":"2024-05-10T11:16:35.834995+0000","last_peered":"2024-05-10T11:16:35.834995+0000","last_clean":"2024-05-10T11:16:35.834995+0000","last_became_active":"2024-05-10T11:16:34.862777+0000","last_became_peered":"2024-05-10T11:16:34.862777+0000","last_unstale":"2024-05-10T11:16:35.834995+0000","last_undegraded":"2024-05-10T11:16:35.834995+0000","last_fullsized":"2024-05-10T11:16:35.834995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:35.147899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592297+0000","last_change":"2024-05-10T11:16:33.841766+0000","last_active":"2024-05-10T11:16:36.592297+0000","last_peered":"2024-05-10T11:16:36.592297+0000","last_clean":"2024-05-10T11:16:36.592297+0000","last_became_active":"2024-05-10T11:16:33.841421+0000","last_became_peered":"2024-05-10T11:16:33.841421+0000","last_unstale":"2024-05-10T11:16:36.592297+0000","last_undegraded":"2024-05-10T11:16:36.592297+0000","last_fullsized":"2024-05-10T11:16:36.592297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:22:45.938601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834983+0000","last_change":"2024-05-10T11:16:34.851996+0000","last_active":"2024-05-10T11:16:35.834983+0000","last_peered":"2024-05-10T11:16:35.834983+0000","last_clean":"2024-05-10T11:16:35.834983+0000","last_became_active":"2024-05-10T11:16:34.851659+0000","last_became_peered":"2024-05-10T11:16:34.851659+0000","last_unstale":"2024-05-10T11:16:35.834983+0000","last_undegraded":"2024-05-10T11:16:35.834983+0000","last_fullsized":"2024-05-10T11:16:35.834983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:35.838012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834471+0000","last_change":"2024-05-10T11:16:33.840847+0000","last_active":"2024-05-10T11:16:35.834471+0000","last_peered":"2024-05-10T11:16:35.834471+0000","last_clean":"2024-05-10T11:16:35.834471+0000","last_became_active":"2024-05-10T11:16:33.840336+0000","last_became_peered":"2024-05-10T11:16:33.840336+0000","last_unstale":"2024-05-10T11:16:35.834471+0000","last_undegraded":"2024-05-10T11:16:35.834471+0000","last_fullsized":"2024-05-10T11:16:35.834471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:57.998358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123451+0000","last_change":"2024-05-10T11:16:34.856890+0000","last_active":"2024-05-10T11:16:36.123451+0000","last_peered":"2024-05-10T11:16:36.123451+0000","last_clean":"2024-05-10T11:16:36.123451+0000","last_became_active":"2024-05-10T11:16:34.856662+0000","last_became_peered":"2024-05-10T11:16:34.856662+0000","last_unstale":"2024-05-10T11:16:36.123451+0000","last_undegraded":"2024-05-10T11:16:36.123451+0000","last_fullsized":"2024-05-10T11:16:36.123451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:39:43.839573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591763+0000","last_change":"2024-05-10T11:16:33.841956+0000","last_active":"2024-05-10T11:16:36.591763+0000","last_peered":"2024-05-10T11:16:36.591763+0000","last_clean":"2024-05-10T11:16:36.591763+0000","last_became_active":"2024-05-10T11:16:33.841606+0000","last_became_peered":"2024-05-10T11:16:33.841606+0000","last_unstale":"2024-05-10T11:16:36.591763+0000","last_undegraded":"2024-05-10T11:16:36.591763+0000","last_fullsized":"2024-05-10T11:16:36.591763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:56.319173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":213,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123362+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:16:36.123362+0000","last_peered":"2024-05-10T11:16:36.123362+0000","last_clean":"2024-05-10T11:16:36.123362+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:16:36.123362+0000","last_undegraded":"2024-05-10T11:16:36.123362+0000","last_fullsized":"2024-05-10T11:16:36.123362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1008579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":419801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":419905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":418931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":418301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1515520,"data_stored":1008557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":411531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:16:43.387 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:16:43.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.504+0000 7ff6e66f8640 1 Processor -- start 2024-05-10T11:16:43.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.504+0000 7ff6e66f8640 1 -- start start 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6e66f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6e015f3b0 0x7ff6e00d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6e66f8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff6e015f790 0x7ff6e00d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6e66f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e00d30b0 con 0x7ff6e00d5d30 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6e66f8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e00d3390 con 0x7ff6e015f790 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6e66f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e00c8c80 con 0x7ff6e015f3b0 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff6e015f790 0x7ff6e00d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff6e015f790 0x7ff6e00d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52256/0 (socket says 172.21.15.66:52256) 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 -- 172.21.15.66:0/2672551940 learned_addr learned my addr 172.21.15.66:0/2672551940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:43.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6dffff640 1 --2- 172.21.15.66:0/2672551940 >> v2:172.21.15.190:3300/0 conn(0x7ff6e015f3b0 0x7ff6e00d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 -- 172.21.15.66:0/2672551940 >> v2:172.21.15.190:3300/0 conn(0x7ff6e015f3b0 msgr2=0x7ff6e00d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:43.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 --2- 172.21.15.66:0/2672551940 >> v2:172.21.15.190:3300/0 conn(0x7ff6e015f3b0 0x7ff6e00d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 -- 172.21.15.66:0/2672551940 >> v1:172.21.15.190:6789/0 conn(0x7ff6e00d5d30 legacy=0x7ff6e00c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.505+0000 7ff6df7fe640 1 -- 172.21.15.66:0/2672551940 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e00c8f60 con 0x7ff6e015f790 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.506+0000 7ff6df7fe640 1 --2- 172.21.15.66:0/2672551940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e015f790 0x7ff6e00d3c30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff6e008e820 tx=0x7ff6d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0abee7bacd5c7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.506+0000 7ff6deffd640 1 -- 172.21.15.66:0/2672551940 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4037070 con 0x7ff6e015f790 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.506+0000 7ff6deffd640 1 -- 172.21.15.66:0/2672551940 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4032440 con 0x7ff6e015f790 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.506+0000 7ff6deffd640 1 -- 172.21.15.66:0/2672551940 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4032810 con 0x7ff6e015f790 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2672551940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e015f790 msgr2=0x7ff6e00d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2672551940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e015f790 0x7ff6e00d3c30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff6e008e820 tx=0x7ff6d402a270 comp rx=0 tx=0).stop 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2672551940 shutdown_connections 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2672551940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e015f790 0x7ff6e00d3c30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2672551940 >> v2:172.21.15.190:3300/0 conn(0x7ff6e015f3b0 0x7ff6e00d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2672551940 >> 172.21.15.66:0/2672551940 conn(0x7ff6e00d5130 msgr2=0x7ff6e00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:43.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2672551940 shutdown_connections 2024-05-10T11:16:43.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.507+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2672551940 wait complete. 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.508+0000 7ff6e66f8640 1 Processor -- start 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 -- start start 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6e00d5d30 0x7ff6e0158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6e015f3b0 0x7ff6e015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 0x7ff6e00cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00d0e60 con 0x7ff6e00cecc0 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00d0ce0 con 0x7ff6e015f3b0 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e66f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e00d0fe0 con 0x7ff6e00d5d30 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e4c95640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 0x7ff6e00cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e4c95640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 0x7ff6e00cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52268/0 (socket says 172.21.15.66:52268) 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6e4c95640 1 -- 172.21.15.66:0/2567210336 learned_addr learned my addr 172.21.15.66:0/2567210336 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6dffff640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6e00d5d30 0x7ff6e0158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.509+0000 7ff6df7fe640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6e015f3b0 0x7ff6e015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e4c95640 1 -- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6e00d5d30 msgr2=0x7ff6e0158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e4c95640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6e00d5d30 0x7ff6e0158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e4c95640 1 -- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6e015f3b0 msgr2=0x7ff6e015ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e4c95640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6e015f3b0 0x7ff6e015ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e4c95640 1 -- 172.21.15.66:0/2567210336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e0160bd0 con 0x7ff6e00cecc0 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e4c95640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 0x7ff6e00cce00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c7d0 tx=0x7ff6d800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8003b70 con 0x7ff6e00cecc0 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d8003d30 con 0x7ff6e00cecc0 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800aa90 con 0x7ff6e00cecc0 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e0160eb0 con 0x7ff6e00cecc0 2024-05-10T11:16:43.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.510+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e0161470 con 0x7ff6e00cecc0 2024-05-10T11:16:43.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.511+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e006a220 con 0x7ff6e00cecc0 2024-05-10T11:16:43.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.512+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6d800ac30 con 0x7ff6e00cecc0 2024-05-10T11:16:43.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.513+0000 7ff6dcff9640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff6cc0762d0 0x7ff6cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.513+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7ff6d8097530 con 0x7ff6e00cecc0 2024-05-10T11:16:43.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.513+0000 7ff6dffff640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff6cc0762d0 0x7ff6cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.513+0000 7ff6dffff640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff6cc0762d0 0x7ff6cc078790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0006fd0 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:43.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.517+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff6d80606b0 con 0x7ff6e00cecc0 2024-05-10T11:16:43.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.705+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6e0075ce0 con 0x7ff6cc0762d0 2024-05-10T11:16:43.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.711+0000 7ff6dcff9640 1 -- 172.21.15.66:0/2567210336 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252050 (secure 0 0 0) 0x7ff6e0075ce0 con 0x7ff6cc0762d0 2024-05-10T11:16:43.714 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:43.715 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:16:43.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff6cc0762d0 msgr2=0x7ff6cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff6cc0762d0 0x7ff6cc078790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0006fd0 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2024-05-10T11:16:43.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 msgr2=0x7ff6e00cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 0x7ff6e00cce00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c7d0 tx=0x7ff6d800cc90 comp rx=0 tx=0).stop 2024-05-10T11:16:43.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 shutdown_connections 2024-05-10T11:16:43.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff6cc0762d0 0x7ff6cc078790 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e00cecc0 0x7ff6e00cce00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6e015f3b0 0x7ff6e015ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 --2- 172.21.15.66:0/2567210336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6e00d5d30 0x7ff6e0158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 >> 172.21.15.66:0/2567210336 conn(0x7ff6e00d5130 msgr2=0x7ff6e00d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:43.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 shutdown_connections 2024-05-10T11:16:43.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.714+0000 7ff6e66f8640 1 -- 172.21.15.66:0/2567210336 wait complete. 2024-05-10T11:16:43.726 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-05-10T11:16:41.745365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232936,"kb_used_data":8424,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754741784,"statfs":{"total":773094113280,"available":772855586816,"internally_reserved":0,"allocated":8626176,"data_stored":4531068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.916834"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123443+0000","last_change":"2024-05-10T11:16:34.841901+0000","last_active":"2024-05-10T11:16:36.123443+0000","last_peered":"2024-05-10T11:16:36.123443+0000","last_clean":"2024-05-10T11:16:36.123443+0000","last_became_active":"2024-05-10T11:16:34.841434+0000","last_became_peered":"2024-05-10T11:16:34.841434+0000","last_unstale":"2024-05-10T11:16:36.123443+0000","last_undegraded":"2024-05-10T11:16:36.123443+0000","last_fullsized":"2024-05-10T11:16:36.123443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:22.304197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090781+0000","last_change":"2024-05-10T11:16:34.857557+0000","last_active":"2024-05-10T11:16:36.090781+0000","last_peered":"2024-05-10T11:16:36.090781+0000","last_clean":"2024-05-10T11:16:36.090781+0000","last_became_active":"2024-05-10T11:16:34.856310+0000","last_became_peered":"2024-05-10T11:16:34.856310+0000","last_unstale":"2024-05-10T11:16:36.090781+0000","last_undegraded":"2024-05-10T11:16:36.090781+0000","last_fullsized":"2024-05-10T11:16:36.090781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:00.497997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834826+0000","last_change":"2024-05-10T11:16:34.863981+0000","last_active":"2024-05-10T11:16:35.834826+0000","last_peered":"2024-05-10T11:16:35.834826+0000","last_clean":"2024-05-10T11:16:35.834826+0000","last_became_active":"2024-05-10T11:16:34.863695+0000","last_became_peered":"2024-05-10T11:16:34.863695+0000","last_unstale":"2024-05-10T11:16:35.834826+0000","last_undegraded":"2024-05-10T11:16:35.834826+0000","last_fullsized":"2024-05-10T11:16:35.834826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:46.500803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591580+0000","last_change":"2024-05-10T11:16:34.847095+0000","last_active":"2024-05-10T11:16:36.591580+0000","last_peered":"2024-05-10T11:16:36.591580+0000","last_clean":"2024-05-10T11:16:36.591580+0000","last_became_active":"2024-05-10T11:16:34.846771+0000","last_became_peered":"2024-05-10T11:16:34.846771+0000","last_unstale":"2024-05-10T11:16:36.591580+0000","last_undegraded":"2024-05-10T11:16:36.591580+0000","last_fullsized":"2024-05-10T11:16:36.591580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:25.224183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832902+0000","last_change":"2024-05-10T11:16:34.853396+0000","last_active":"2024-05-10T11:16:35.832902+0000","last_peered":"2024-05-10T11:16:35.832902+0000","last_clean":"2024-05-10T11:16:35.832902+0000","last_became_active":"2024-05-10T11:16:34.853004+0000","last_became_peered":"2024-05-10T11:16:34.853004+0000","last_unstale":"2024-05-10T11:16:35.832902+0000","last_undegraded":"2024-05-10T11:16:35.832902+0000","last_fullsized":"2024-05-10T11:16:35.832902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:09.722498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591534+0000","last_change":"2024-05-10T11:16:34.843889+0000","last_active":"2024-05-10T11:16:36.591534+0000","last_peered":"2024-05-10T11:16:36.591534+0000","last_clean":"2024-05-10T11:16:36.591534+0000","last_became_active":"2024-05-10T11:16:34.843054+0000","last_became_peered":"2024-05-10T11:16:34.843054+0000","last_unstale":"2024-05-10T11:16:36.591534+0000","last_undegraded":"2024-05-10T11:16:36.591534+0000","last_fullsized":"2024-05-10T11:16:36.591534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592173+0000","last_change":"2024-05-10T11:16:34.854832+0000","last_active":"2024-05-10T11:16:36.592173+0000","last_peered":"2024-05-10T11:16:36.592173+0000","last_clean":"2024-05-10T11:16:36.592173+0000","last_became_active":"2024-05-10T11:16:34.854434+0000","last_became_peered":"2024-05-10T11:16:34.854434+0000","last_unstale":"2024-05-10T11:16:36.592173+0000","last_undegraded":"2024-05-10T11:16:36.592173+0000","last_fullsized":"2024-05-10T11:16:36.592173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:30.308887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832709+0000","last_change":"2024-05-10T11:16:34.854083+0000","last_active":"2024-05-10T11:16:35.832709+0000","last_peered":"2024-05-10T11:16:35.832709+0000","last_clean":"2024-05-10T11:16:35.832709+0000","last_became_active":"2024-05-10T11:16:34.853826+0000","last_became_peered":"2024-05-10T11:16:34.853826+0000","last_unstale":"2024-05-10T11:16:35.832709+0000","last_undegraded":"2024-05-10T11:16:35.832709+0000","last_fullsized":"2024-05-10T11:16:35.832709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:04.002857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592722+0000","last_change":"2024-05-10T11:16:34.856367+0000","last_active":"2024-05-10T11:16:36.592722+0000","last_peered":"2024-05-10T11:16:36.592722+0000","last_clean":"2024-05-10T11:16:36.592722+0000","last_became_active":"2024-05-10T11:16:34.855423+0000","last_became_peered":"2024-05-10T11:16:34.855423+0000","last_unstale":"2024-05-10T11:16:36.592722+0000","last_undegraded":"2024-05-10T11:16:36.592722+0000","last_fullsized":"2024-05-10T11:16:36.592722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:13.480229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592763+0000","last_change":"2024-05-10T11:16:34.847152+0000","last_active":"2024-05-10T11:16:36.592763+0000","last_peered":"2024-05-10T11:16:36.592763+0000","last_clean":"2024-05-10T11:16:36.592763+0000","last_became_active":"2024-05-10T11:16:34.846613+0000","last_became_peered":"2024-05-10T11:16:34.846613+0000","last_unstale":"2024-05-10T11:16:36.592763+0000","last_undegraded":"2024-05-10T11:16:36.592763+0000","last_fullsized":"2024-05-10T11:16:36.592763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090713+0000","last_change":"2024-05-10T11:16:34.860674+0000","last_active":"2024-05-10T11:16:36.090713+0000","last_peered":"2024-05-10T11:16:36.090713+0000","last_clean":"2024-05-10T11:16:36.090713+0000","last_became_active":"2024-05-10T11:16:34.855401+0000","last_became_peered":"2024-05-10T11:16:34.855401+0000","last_unstale":"2024-05-10T11:16:36.090713+0000","last_undegraded":"2024-05-10T11:16:36.090713+0000","last_fullsized":"2024-05-10T11:16:36.090713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:37.966718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592638+0000","last_change":"2024-05-10T11:16:34.859258+0000","last_active":"2024-05-10T11:16:36.592638+0000","last_peered":"2024-05-10T11:16:36.592638+0000","last_clean":"2024-05-10T11:16:36.592638+0000","last_became_active":"2024-05-10T11:16:34.858948+0000","last_became_peered":"2024-05-10T11:16:34.858948+0000","last_unstale":"2024-05-10T11:16:36.592638+0000","last_undegraded":"2024-05-10T11:16:36.592638+0000","last_fullsized":"2024-05-10T11:16:36.592638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833033+0000","last_change":"2024-05-10T11:16:34.857125+0000","last_active":"2024-05-10T11:16:35.833033+0000","last_peered":"2024-05-10T11:16:35.833033+0000","last_clean":"2024-05-10T11:16:35.833033+0000","last_became_active":"2024-05-10T11:16:34.856827+0000","last_became_peered":"2024-05-10T11:16:34.856827+0000","last_unstale":"2024-05-10T11:16:35.833033+0000","last_undegraded":"2024-05-10T11:16:35.833033+0000","last_fullsized":"2024-05-10T11:16:35.833033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:43.061696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591465+0000","last_change":"2024-05-10T11:16:34.842679+0000","last_active":"2024-05-10T11:16:36.591465+0000","last_peered":"2024-05-10T11:16:36.591465+0000","last_clean":"2024-05-10T11:16:36.591465+0000","last_became_active":"2024-05-10T11:16:34.842419+0000","last_became_peered":"2024-05-10T11:16:34.842419+0000","last_unstale":"2024-05-10T11:16:36.591465+0000","last_undegraded":"2024-05-10T11:16:36.591465+0000","last_fullsized":"2024-05-10T11:16:36.591465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:19:10.001532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090384+0000","last_change":"2024-05-10T11:16:34.853761+0000","last_active":"2024-05-10T11:16:36.090384+0000","last_peered":"2024-05-10T11:16:36.090384+0000","last_clean":"2024-05-10T11:16:36.090384+0000","last_became_active":"2024-05-10T11:16:34.853449+0000","last_became_peered":"2024-05-10T11:16:34.853449+0000","last_unstale":"2024-05-10T11:16:36.090384+0000","last_undegraded":"2024-05-10T11:16:36.090384+0000","last_fullsized":"2024-05-10T11:16:36.090384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123213+0000","last_change":"2024-05-10T11:16:34.844774+0000","last_active":"2024-05-10T11:16:36.123213+0000","last_peered":"2024-05-10T11:16:36.123213+0000","last_clean":"2024-05-10T11:16:36.123213+0000","last_became_active":"2024-05-10T11:16:34.844510+0000","last_became_peered":"2024-05-10T11:16:34.844510+0000","last_unstale":"2024-05-10T11:16:36.123213+0000","last_undegraded":"2024-05-10T11:16:36.123213+0000","last_fullsized":"2024-05-10T11:16:36.123213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:39:28.847331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833123+0000","last_change":"2024-05-10T11:16:34.849207+0000","last_active":"2024-05-10T11:16:35.833123+0000","last_peered":"2024-05-10T11:16:35.833123+0000","last_clean":"2024-05-10T11:16:35.833123+0000","last_became_active":"2024-05-10T11:16:34.848933+0000","last_became_peered":"2024-05-10T11:16:34.848933+0000","last_unstale":"2024-05-10T11:16:35.833123+0000","last_undegraded":"2024-05-10T11:16:35.833123+0000","last_fullsized":"2024-05-10T11:16:35.833123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:55.352398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834879+0000","last_change":"2024-05-10T11:16:34.851758+0000","last_active":"2024-05-10T11:16:35.834879+0000","last_peered":"2024-05-10T11:16:35.834879+0000","last_clean":"2024-05-10T11:16:35.834879+0000","last_became_active":"2024-05-10T11:16:34.851466+0000","last_became_peered":"2024-05-10T11:16:34.851466+0000","last_unstale":"2024-05-10T11:16:35.834879+0000","last_undegraded":"2024-05-10T11:16:35.834879+0000","last_fullsized":"2024-05-10T11:16:35.834879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.700792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591745+0000","last_change":"2024-05-10T11:16:34.846246+0000","last_active":"2024-05-10T11:16:36.591745+0000","last_peered":"2024-05-10T11:16:36.591745+0000","last_clean":"2024-05-10T11:16:36.591745+0000","last_became_active":"2024-05-10T11:16:34.845391+0000","last_became_peered":"2024-05-10T11:16:34.845391+0000","last_unstale":"2024-05-10T11:16:36.591745+0000","last_undegraded":"2024-05-10T11:16:36.591745+0000","last_fullsized":"2024-05-10T11:16:36.591745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833050+0000","last_change":"2024-05-10T11:16:34.860384+0000","last_active":"2024-05-10T11:16:35.833050+0000","last_peered":"2024-05-10T11:16:35.833050+0000","last_clean":"2024-05-10T11:16:35.833050+0000","last_became_active":"2024-05-10T11:16:34.860050+0000","last_became_peered":"2024-05-10T11:16:34.860050+0000","last_unstale":"2024-05-10T11:16:35.833050+0000","last_undegraded":"2024-05-10T11:16:35.833050+0000","last_fullsized":"2024-05-10T11:16:35.833050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:53.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591469+0000","last_change":"2024-05-10T11:16:34.864212+0000","last_active":"2024-05-10T11:16:36.591469+0000","last_peered":"2024-05-10T11:16:36.591469+0000","last_clean":"2024-05-10T11:16:36.591469+0000","last_became_active":"2024-05-10T11:16:34.863914+0000","last_became_peered":"2024-05-10T11:16:34.863914+0000","last_unstale":"2024-05-10T11:16:36.591469+0000","last_undegraded":"2024-05-10T11:16:36.591469+0000","last_fullsized":"2024-05-10T11:16:36.591469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:34.993965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832837+0000","last_change":"2024-05-10T11:16:34.857747+0000","last_active":"2024-05-10T11:16:35.832837+0000","last_peered":"2024-05-10T11:16:35.832837+0000","last_clean":"2024-05-10T11:16:35.832837+0000","last_became_active":"2024-05-10T11:16:34.857437+0000","last_became_peered":"2024-05-10T11:16:34.857437+0000","last_unstale":"2024-05-10T11:16:35.832837+0000","last_undegraded":"2024-05-10T11:16:35.832837+0000","last_fullsized":"2024-05-10T11:16:35.832837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:14.230378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592293+0000","last_change":"2024-05-10T11:16:34.849433+0000","last_active":"2024-05-10T11:16:36.592293+0000","last_peered":"2024-05-10T11:16:36.592293+0000","last_clean":"2024-05-10T11:16:36.592293+0000","last_became_active":"2024-05-10T11:16:34.848042+0000","last_became_peered":"2024-05-10T11:16:34.848042+0000","last_unstale":"2024-05-10T11:16:36.592293+0000","last_undegraded":"2024-05-10T11:16:36.592293+0000","last_fullsized":"2024-05-10T11:16:36.592293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:09.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090543+0000","last_change":"2024-05-10T11:16:34.845780+0000","last_active":"2024-05-10T11:16:36.090543+0000","last_peered":"2024-05-10T11:16:36.090543+0000","last_clean":"2024-05-10T11:16:36.090543+0000","last_became_active":"2024-05-10T11:16:34.845322+0000","last_became_peered":"2024-05-10T11:16:34.845322+0000","last_unstale":"2024-05-10T11:16:36.090543+0000","last_undegraded":"2024-05-10T11:16:36.090543+0000","last_fullsized":"2024-05-10T11:16:36.090543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:20.443512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090673+0000","last_change":"2024-05-10T11:16:34.854455+0000","last_active":"2024-05-10T11:16:36.090673+0000","last_peered":"2024-05-10T11:16:36.090673+0000","last_clean":"2024-05-10T11:16:36.090673+0000","last_became_active":"2024-05-10T11:16:34.854168+0000","last_became_peered":"2024-05-10T11:16:34.854168+0000","last_unstale":"2024-05-10T11:16:36.090673+0000","last_undegraded":"2024-05-10T11:16:36.090673+0000","last_fullsized":"2024-05-10T11:16:36.090673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:08.765130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592820+0000","last_change":"2024-05-10T11:16:34.849031+0000","last_active":"2024-05-10T11:16:36.592820+0000","last_peered":"2024-05-10T11:16:36.592820+0000","last_clean":"2024-05-10T11:16:36.592820+0000","last_became_active":"2024-05-10T11:16:34.848672+0000","last_became_peered":"2024-05-10T11:16:34.848672+0000","last_unstale":"2024-05-10T11:16:36.592820+0000","last_undegraded":"2024-05-10T11:16:36.592820+0000","last_fullsized":"2024-05-10T11:16:36.592820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123515+0000","last_change":"2024-05-10T11:16:34.847508+0000","last_active":"2024-05-10T11:16:36.123515+0000","last_peered":"2024-05-10T11:16:36.123515+0000","last_clean":"2024-05-10T11:16:36.123515+0000","last_became_active":"2024-05-10T11:16:34.847216+0000","last_became_peered":"2024-05-10T11:16:34.847216+0000","last_unstale":"2024-05-10T11:16:36.123515+0000","last_undegraded":"2024-05-10T11:16:36.123515+0000","last_fullsized":"2024-05-10T11:16:36.123515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:11.881126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:34.856389+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:34.856031+0000","last_became_peered":"2024-05-10T11:16:34.856031+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:45.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090474+0000","last_change":"2024-05-10T11:16:34.846202+0000","last_active":"2024-05-10T11:16:36.090474+0000","last_peered":"2024-05-10T11:16:36.090474+0000","last_clean":"2024-05-10T11:16:36.090474+0000","last_became_active":"2024-05-10T11:16:34.844252+0000","last_became_peered":"2024-05-10T11:16:34.844252+0000","last_unstale":"2024-05-10T11:16:36.090474+0000","last_undegraded":"2024-05-10T11:16:36.090474+0000","last_fullsized":"2024-05-10T11:16:36.090474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:50.994066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123147+0000","last_change":"2024-05-10T11:16:34.844191+0000","last_active":"2024-05-10T11:16:36.123147+0000","last_peered":"2024-05-10T11:16:36.123147+0000","last_clean":"2024-05-10T11:16:36.123147+0000","last_became_active":"2024-05-10T11:16:34.843927+0000","last_became_peered":"2024-05-10T11:16:34.843927+0000","last_unstale":"2024-05-10T11:16:36.123147+0000","last_undegraded":"2024-05-10T11:16:36.123147+0000","last_fullsized":"2024-05-10T11:16:36.123147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:34.369870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834602+0000","last_change":"2024-05-10T11:16:34.851184+0000","last_active":"2024-05-10T11:16:35.834602+0000","last_peered":"2024-05-10T11:16:35.834602+0000","last_clean":"2024-05-10T11:16:35.834602+0000","last_became_active":"2024-05-10T11:16:34.850836+0000","last_became_peered":"2024-05-10T11:16:34.850836+0000","last_unstale":"2024-05-10T11:16:35.834602+0000","last_undegraded":"2024-05-10T11:16:35.834602+0000","last_fullsized":"2024-05-10T11:16:35.834602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:48.282472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123237+0000","last_change":"2024-05-10T11:16:34.841133+0000","last_active":"2024-05-10T11:16:36.123237+0000","last_peered":"2024-05-10T11:16:36.123237+0000","last_clean":"2024-05-10T11:16:36.123237+0000","last_became_active":"2024-05-10T11:16:34.840859+0000","last_became_peered":"2024-05-10T11:16:34.840859+0000","last_unstale":"2024-05-10T11:16:36.123237+0000","last_undegraded":"2024-05-10T11:16:36.123237+0000","last_fullsized":"2024-05-10T11:16:36.123237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:05.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834526+0000","last_change":"2024-05-10T11:16:34.851721+0000","last_active":"2024-05-10T11:16:35.834526+0000","last_peered":"2024-05-10T11:16:35.834526+0000","last_clean":"2024-05-10T11:16:35.834526+0000","last_became_active":"2024-05-10T11:16:34.851415+0000","last_became_peered":"2024-05-10T11:16:34.851415+0000","last_unstale":"2024-05-10T11:16:35.834526+0000","last_undegraded":"2024-05-10T11:16:35.834526+0000","last_fullsized":"2024-05-10T11:16:35.834526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833093+0000","last_change":"2024-05-10T11:16:33.849083+0000","last_active":"2024-05-10T11:16:35.833093+0000","last_peered":"2024-05-10T11:16:35.833093+0000","last_clean":"2024-05-10T11:16:35.833093+0000","last_became_active":"2024-05-10T11:16:33.848804+0000","last_became_peered":"2024-05-10T11:16:33.848804+0000","last_unstale":"2024-05-10T11:16:35.833093+0000","last_undegraded":"2024-05-10T11:16:35.833093+0000","last_fullsized":"2024-05-10T11:16:35.833093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:16.316656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090374+0000","last_change":"2024-05-10T11:16:34.849023+0000","last_active":"2024-05-10T11:16:36.090374+0000","last_peered":"2024-05-10T11:16:36.090374+0000","last_clean":"2024-05-10T11:16:36.090374+0000","last_became_active":"2024-05-10T11:16:34.848690+0000","last_became_peered":"2024-05-10T11:16:34.848690+0000","last_unstale":"2024-05-10T11:16:36.090374+0000","last_undegraded":"2024-05-10T11:16:36.090374+0000","last_fullsized":"2024-05-10T11:16:36.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.038162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123297+0000","last_change":"2024-05-10T11:16:33.848383+0000","last_active":"2024-05-10T11:16:36.123297+0000","last_peered":"2024-05-10T11:16:36.123297+0000","last_clean":"2024-05-10T11:16:36.123297+0000","last_became_active":"2024-05-10T11:16:33.847992+0000","last_became_peered":"2024-05-10T11:16:33.847992+0000","last_unstale":"2024-05-10T11:16:36.123297+0000","last_undegraded":"2024-05-10T11:16:36.123297+0000","last_fullsized":"2024-05-10T11:16:36.123297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:27.043633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591962+0000","last_change":"2024-05-10T11:16:34.846220+0000","last_active":"2024-05-10T11:16:36.591962+0000","last_peered":"2024-05-10T11:16:36.591962+0000","last_clean":"2024-05-10T11:16:36.591962+0000","last_became_active":"2024-05-10T11:16:34.845661+0000","last_became_peered":"2024-05-10T11:16:34.845661+0000","last_unstale":"2024-05-10T11:16:36.591962+0000","last_undegraded":"2024-05-10T11:16:36.591962+0000","last_fullsized":"2024-05-10T11:16:36.591962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:39.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123200+0000","last_change":"2024-05-10T11:16:33.851782+0000","last_active":"2024-05-10T11:16:36.123200+0000","last_peered":"2024-05-10T11:16:36.123200+0000","last_clean":"2024-05-10T11:16:36.123200+0000","last_became_active":"2024-05-10T11:16:33.851519+0000","last_became_peered":"2024-05-10T11:16:33.851519+0000","last_unstale":"2024-05-10T11:16:36.123200+0000","last_undegraded":"2024-05-10T11:16:36.123200+0000","last_fullsized":"2024-05-10T11:16:36.123200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:38:15.306917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591646+0000","last_change":"2024-05-10T11:16:34.864010+0000","last_active":"2024-05-10T11:16:36.591646+0000","last_peered":"2024-05-10T11:16:36.591646+0000","last_clean":"2024-05-10T11:16:36.591646+0000","last_became_active":"2024-05-10T11:16:34.863841+0000","last_became_peered":"2024-05-10T11:16:34.863841+0000","last_unstale":"2024-05-10T11:16:36.591646+0000","last_undegraded":"2024-05-10T11:16:36.591646+0000","last_fullsized":"2024-05-10T11:16:36.591646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:39:21.755947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591988+0000","last_change":"2024-05-10T11:16:33.845477+0000","last_active":"2024-05-10T11:16:36.591988+0000","last_peered":"2024-05-10T11:16:36.591988+0000","last_clean":"2024-05-10T11:16:36.591988+0000","last_became_active":"2024-05-10T11:16:33.845155+0000","last_became_peered":"2024-05-10T11:16:33.845155+0000","last_unstale":"2024-05-10T11:16:36.591988+0000","last_undegraded":"2024-05-10T11:16:36.591988+0000","last_fullsized":"2024-05-10T11:16:36.591988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:23.515944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090601+0000","last_change":"2024-05-10T11:16:34.864666+0000","last_active":"2024-05-10T11:16:36.090601+0000","last_peered":"2024-05-10T11:16:36.090601+0000","last_clean":"2024-05-10T11:16:36.090601+0000","last_became_active":"2024-05-10T11:16:34.864410+0000","last_became_peered":"2024-05-10T11:16:34.864410+0000","last_unstale":"2024-05-10T11:16:36.090601+0000","last_undegraded":"2024-05-10T11:16:36.090601+0000","last_fullsized":"2024-05-10T11:16:36.090601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:56.782670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592520+0000","last_change":"2024-05-10T11:16:33.844658+0000","last_active":"2024-05-10T11:16:36.592520+0000","last_peered":"2024-05-10T11:16:36.592520+0000","last_clean":"2024-05-10T11:16:36.592520+0000","last_became_active":"2024-05-10T11:16:33.844370+0000","last_became_peered":"2024-05-10T11:16:33.844370+0000","last_unstale":"2024-05-10T11:16:36.592520+0000","last_undegraded":"2024-05-10T11:16:36.592520+0000","last_fullsized":"2024-05-10T11:16:36.592520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:00.783500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090787+0000","last_change":"2024-05-10T11:16:34.844211+0000","last_active":"2024-05-10T11:16:36.090787+0000","last_peered":"2024-05-10T11:16:36.090787+0000","last_clean":"2024-05-10T11:16:36.090787+0000","last_became_active":"2024-05-10T11:16:34.843830+0000","last_became_peered":"2024-05-10T11:16:34.843830+0000","last_unstale":"2024-05-10T11:16:36.090787+0000","last_undegraded":"2024-05-10T11:16:36.090787+0000","last_fullsized":"2024-05-10T11:16:36.090787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:52.427590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591559+0000","last_change":"2024-05-10T11:16:33.839972+0000","last_active":"2024-05-10T11:16:36.591559+0000","last_peered":"2024-05-10T11:16:36.591559+0000","last_clean":"2024-05-10T11:16:36.591559+0000","last_became_active":"2024-05-10T11:16:33.839660+0000","last_became_peered":"2024-05-10T11:16:33.839660+0000","last_unstale":"2024-05-10T11:16:36.591559+0000","last_undegraded":"2024-05-10T11:16:36.591559+0000","last_fullsized":"2024-05-10T11:16:36.591559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:34.138529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592885+0000","last_change":"2024-05-10T11:16:34.855057+0000","last_active":"2024-05-10T11:16:36.592885+0000","last_peered":"2024-05-10T11:16:36.592885+0000","last_clean":"2024-05-10T11:16:36.592885+0000","last_became_active":"2024-05-10T11:16:34.854723+0000","last_became_peered":"2024-05-10T11:16:34.854723+0000","last_unstale":"2024-05-10T11:16:36.592885+0000","last_undegraded":"2024-05-10T11:16:36.592885+0000","last_fullsized":"2024-05-10T11:16:36.592885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:21.582156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090486+0000","last_change":"2024-05-10T11:16:33.849599+0000","last_active":"2024-05-10T11:16:36.090486+0000","last_peered":"2024-05-10T11:16:36.090486+0000","last_clean":"2024-05-10T11:16:36.090486+0000","last_became_active":"2024-05-10T11:16:33.849241+0000","last_became_peered":"2024-05-10T11:16:33.849241+0000","last_unstale":"2024-05-10T11:16:36.090486+0000","last_undegraded":"2024-05-10T11:16:36.090486+0000","last_fullsized":"2024-05-10T11:16:36.090486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:50.691422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592087+0000","last_change":"2024-05-10T11:16:34.853007+0000","last_active":"2024-05-10T11:16:36.592087+0000","last_peered":"2024-05-10T11:16:36.592087+0000","last_clean":"2024-05-10T11:16:36.592087+0000","last_became_active":"2024-05-10T11:16:34.849965+0000","last_became_peered":"2024-05-10T11:16:34.849965+0000","last_unstale":"2024-05-10T11:16:36.592087+0000","last_undegraded":"2024-05-10T11:16:36.592087+0000","last_fullsized":"2024-05-10T11:16:36.592087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:00.428683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832783+0000","last_change":"2024-05-10T11:16:33.850927+0000","last_active":"2024-05-10T11:16:35.832783+0000","last_peered":"2024-05-10T11:16:35.832783+0000","last_clean":"2024-05-10T11:16:35.832783+0000","last_became_active":"2024-05-10T11:16:33.850620+0000","last_became_peered":"2024-05-10T11:16:33.850620+0000","last_unstale":"2024-05-10T11:16:35.832783+0000","last_undegraded":"2024-05-10T11:16:35.832783+0000","last_fullsized":"2024-05-10T11:16:35.832783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:31.969039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090316+0000","last_change":"2024-05-10T11:16:34.839538+0000","last_active":"2024-05-10T11:16:36.090316+0000","last_peered":"2024-05-10T11:16:36.090316+0000","last_clean":"2024-05-10T11:16:36.090316+0000","last_became_active":"2024-05-10T11:16:34.839244+0000","last_became_peered":"2024-05-10T11:16:34.839244+0000","last_unstale":"2024-05-10T11:16:36.090316+0000","last_undegraded":"2024-05-10T11:16:36.090316+0000","last_fullsized":"2024-05-10T11:16:36.090316+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123500+0000","last_change":"2024-05-10T11:16:33.847120+0000","last_active":"2024-05-10T11:16:36.123500+0000","last_peered":"2024-05-10T11:16:36.123500+0000","last_clean":"2024-05-10T11:16:36.123500+0000","last_became_active":"2024-05-10T11:16:33.846773+0000","last_became_peered":"2024-05-10T11:16:33.846773+0000","last_unstale":"2024-05-10T11:16:36.123500+0000","last_undegraded":"2024-05-10T11:16:36.123500+0000","last_fullsized":"2024-05-10T11:16:36.123500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:17.506050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591488+0000","last_change":"2024-05-10T11:16:34.843679+0000","last_active":"2024-05-10T11:16:36.591488+0000","last_peered":"2024-05-10T11:16:36.591488+0000","last_clean":"2024-05-10T11:16:36.591488+0000","last_became_active":"2024-05-10T11:16:34.843383+0000","last_became_peered":"2024-05-10T11:16:34.843383+0000","last_unstale":"2024-05-10T11:16:36.591488+0000","last_undegraded":"2024-05-10T11:16:36.591488+0000","last_fullsized":"2024-05-10T11:16:36.591488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:09.348219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592877+0000","last_change":"2024-05-10T11:16:33.841357+0000","last_active":"2024-05-10T11:16:36.592877+0000","last_peered":"2024-05-10T11:16:36.592877+0000","last_clean":"2024-05-10T11:16:36.592877+0000","last_became_active":"2024-05-10T11:16:33.841097+0000","last_became_peered":"2024-05-10T11:16:33.841097+0000","last_unstale":"2024-05-10T11:16:36.592877+0000","last_undegraded":"2024-05-10T11:16:36.592877+0000","last_fullsized":"2024-05-10T11:16:36.592877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591637+0000","last_change":"2024-05-10T11:16:34.859325+0000","last_active":"2024-05-10T11:16:36.591637+0000","last_peered":"2024-05-10T11:16:36.591637+0000","last_clean":"2024-05-10T11:16:36.591637+0000","last_became_active":"2024-05-10T11:16:34.859028+0000","last_became_peered":"2024-05-10T11:16:34.859028+0000","last_unstale":"2024-05-10T11:16:36.591637+0000","last_undegraded":"2024-05-10T11:16:36.591637+0000","last_fullsized":"2024-05-10T11:16:36.591637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:05:35.187679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833154+0000","last_change":"2024-05-10T11:16:33.850700+0000","last_active":"2024-05-10T11:16:35.833154+0000","last_peered":"2024-05-10T11:16:35.833154+0000","last_clean":"2024-05-10T11:16:35.833154+0000","last_became_active":"2024-05-10T11:16:33.850423+0000","last_became_peered":"2024-05-10T11:16:33.850423+0000","last_unstale":"2024-05-10T11:16:35.833154+0000","last_undegraded":"2024-05-10T11:16:35.833154+0000","last_fullsized":"2024-05-10T11:16:35.833154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:53.739455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834766+0000","last_change":"2024-05-10T11:16:34.863940+0000","last_active":"2024-05-10T11:16:35.834766+0000","last_peered":"2024-05-10T11:16:35.834766+0000","last_clean":"2024-05-10T11:16:35.834766+0000","last_became_active":"2024-05-10T11:16:34.863635+0000","last_became_peered":"2024-05-10T11:16:34.863635+0000","last_unstale":"2024-05-10T11:16:35.834766+0000","last_undegraded":"2024-05-10T11:16:35.834766+0000","last_fullsized":"2024-05-10T11:16:35.834766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:19.129956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"75'6","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592316+0000","last_change":"2024-05-10T11:16:33.840650+0000","last_active":"2024-05-10T11:16:36.592316+0000","last_peered":"2024-05-10T11:16:36.592316+0000","last_clean":"2024-05-10T11:16:36.592316+0000","last_became_active":"2024-05-10T11:16:33.840327+0000","last_became_peered":"2024-05-10T11:16:33.840327+0000","last_unstale":"2024-05-10T11:16:36.592316+0000","last_undegraded":"2024-05-10T11:16:36.592316+0000","last_fullsized":"2024-05-10T11:16:36.592316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:07.459165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592546+0000","last_change":"2024-05-10T11:16:34.854844+0000","last_active":"2024-05-10T11:16:36.592546+0000","last_peered":"2024-05-10T11:16:36.592546+0000","last_clean":"2024-05-10T11:16:36.592546+0000","last_became_active":"2024-05-10T11:16:34.854522+0000","last_became_peered":"2024-05-10T11:16:34.854522+0000","last_unstale":"2024-05-10T11:16:36.592546+0000","last_undegraded":"2024-05-10T11:16:36.592546+0000","last_fullsized":"2024-05-10T11:16:36.592546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:58.379390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591480+0000","last_change":"2024-05-10T11:16:33.834877+0000","last_active":"2024-05-10T11:16:36.591480+0000","last_peered":"2024-05-10T11:16:36.591480+0000","last_clean":"2024-05-10T11:16:36.591480+0000","last_became_active":"2024-05-10T11:16:33.834597+0000","last_became_peered":"2024-05-10T11:16:33.834597+0000","last_unstale":"2024-05-10T11:16:36.591480+0000","last_undegraded":"2024-05-10T11:16:36.591480+0000","last_fullsized":"2024-05-10T11:16:36.591480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591649+0000","last_change":"2024-05-10T11:16:34.854933+0000","last_active":"2024-05-10T11:16:36.591649+0000","last_peered":"2024-05-10T11:16:36.591649+0000","last_clean":"2024-05-10T11:16:36.591649+0000","last_became_active":"2024-05-10T11:16:34.854658+0000","last_became_peered":"2024-05-10T11:16:34.854658+0000","last_unstale":"2024-05-10T11:16:36.591649+0000","last_undegraded":"2024-05-10T11:16:36.591649+0000","last_fullsized":"2024-05-10T11:16:36.591649+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:38:16.316287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123221+0000","last_change":"2024-05-10T11:16:33.852289+0000","last_active":"2024-05-10T11:16:36.123221+0000","last_peered":"2024-05-10T11:16:36.123221+0000","last_clean":"2024-05-10T11:16:36.123221+0000","last_became_active":"2024-05-10T11:16:33.852005+0000","last_became_peered":"2024-05-10T11:16:33.852005+0000","last_unstale":"2024-05-10T11:16:36.123221+0000","last_undegraded":"2024-05-10T11:16:36.123221+0000","last_fullsized":"2024-05-10T11:16:36.123221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:29.299517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592003+0000","last_change":"2024-05-10T11:16:34.844665+0000","last_active":"2024-05-10T11:16:36.592003+0000","last_peered":"2024-05-10T11:16:36.592003+0000","last_clean":"2024-05-10T11:16:36.592003+0000","last_became_active":"2024-05-10T11:16:34.844360+0000","last_became_peered":"2024-05-10T11:16:34.844360+0000","last_unstale":"2024-05-10T11:16:36.592003+0000","last_undegraded":"2024-05-10T11:16:36.592003+0000","last_fullsized":"2024-05-10T11:16:36.592003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:36.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832731+0000","last_change":"2024-05-10T11:16:33.851756+0000","last_active":"2024-05-10T11:16:35.832731+0000","last_peered":"2024-05-10T11:16:35.832731+0000","last_clean":"2024-05-10T11:16:35.832731+0000","last_became_active":"2024-05-10T11:16:33.851459+0000","last_became_peered":"2024-05-10T11:16:33.851459+0000","last_unstale":"2024-05-10T11:16:35.832731+0000","last_undegraded":"2024-05-10T11:16:35.832731+0000","last_fullsized":"2024-05-10T11:16:35.832731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:00.512992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592153+0000","last_change":"2024-05-10T11:16:34.861004+0000","last_active":"2024-05-10T11:16:36.592153+0000","last_peered":"2024-05-10T11:16:36.592153+0000","last_clean":"2024-05-10T11:16:36.592153+0000","last_became_active":"2024-05-10T11:16:34.860699+0000","last_became_peered":"2024-05-10T11:16:34.860699+0000","last_unstale":"2024-05-10T11:16:36.592153+0000","last_undegraded":"2024-05-10T11:16:36.592153+0000","last_fullsized":"2024-05-10T11:16:36.592153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:27.685025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090447+0000","last_change":"2024-05-10T11:16:33.845959+0000","last_active":"2024-05-10T11:16:36.090447+0000","last_peered":"2024-05-10T11:16:36.090447+0000","last_clean":"2024-05-10T11:16:36.090447+0000","last_became_active":"2024-05-10T11:16:33.845331+0000","last_became_peered":"2024-05-10T11:16:33.845331+0000","last_unstale":"2024-05-10T11:16:36.090447+0000","last_undegraded":"2024-05-10T11:16:36.090447+0000","last_fullsized":"2024-05-10T11:16:36.090447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:45.491433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591231+0000","last_change":"2024-05-10T11:16:34.852456+0000","last_active":"2024-05-10T11:16:36.591231+0000","last_peered":"2024-05-10T11:16:36.591231+0000","last_clean":"2024-05-10T11:16:36.591231+0000","last_became_active":"2024-05-10T11:16:34.852136+0000","last_became_peered":"2024-05-10T11:16:34.852136+0000","last_unstale":"2024-05-10T11:16:36.591231+0000","last_undegraded":"2024-05-10T11:16:36.591231+0000","last_fullsized":"2024-05-10T11:16:36.591231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:09.064530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123548+0000","last_change":"2024-05-10T11:16:33.847150+0000","last_active":"2024-05-10T11:16:36.123548+0000","last_peered":"2024-05-10T11:16:36.123548+0000","last_clean":"2024-05-10T11:16:36.123548+0000","last_became_active":"2024-05-10T11:16:33.846903+0000","last_became_peered":"2024-05-10T11:16:33.846903+0000","last_unstale":"2024-05-10T11:16:36.123548+0000","last_undegraded":"2024-05-10T11:16:36.123548+0000","last_fullsized":"2024-05-10T11:16:36.123548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:33:16.225216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832695+0000","last_change":"2024-05-10T11:16:34.845165+0000","last_active":"2024-05-10T11:16:35.832695+0000","last_peered":"2024-05-10T11:16:35.832695+0000","last_clean":"2024-05-10T11:16:35.832695+0000","last_became_active":"2024-05-10T11:16:34.844886+0000","last_became_peered":"2024-05-10T11:16:34.844886+0000","last_unstale":"2024-05-10T11:16:35.832695+0000","last_undegraded":"2024-05-10T11:16:35.832695+0000","last_fullsized":"2024-05-10T11:16:35.832695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:15.505458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592859+0000","last_change":"2024-05-10T11:16:33.840287+0000","last_active":"2024-05-10T11:16:36.592859+0000","last_peered":"2024-05-10T11:16:36.592859+0000","last_clean":"2024-05-10T11:16:36.592859+0000","last_became_active":"2024-05-10T11:16:33.840016+0000","last_became_peered":"2024-05-10T11:16:33.840016+0000","last_unstale":"2024-05-10T11:16:36.592859+0000","last_undegraded":"2024-05-10T11:16:36.592859+0000","last_fullsized":"2024-05-10T11:16:36.592859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:05:27.619307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832710+0000","last_change":"2024-05-10T11:16:34.857683+0000","last_active":"2024-05-10T11:16:35.832710+0000","last_peered":"2024-05-10T11:16:35.832710+0000","last_clean":"2024-05-10T11:16:35.832710+0000","last_became_active":"2024-05-10T11:16:34.857411+0000","last_became_peered":"2024-05-10T11:16:34.857411+0000","last_unstale":"2024-05-10T11:16:35.832710+0000","last_undegraded":"2024-05-10T11:16:35.832710+0000","last_fullsized":"2024-05-10T11:16:35.832710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:04.078921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.833215+0000","last_change":"2024-05-10T11:16:33.849638+0000","last_active":"2024-05-10T11:16:35.833215+0000","last_peered":"2024-05-10T11:16:35.833215+0000","last_clean":"2024-05-10T11:16:35.833215+0000","last_became_active":"2024-05-10T11:16:33.849383+0000","last_became_peered":"2024-05-10T11:16:33.849383+0000","last_unstale":"2024-05-10T11:16:35.833215+0000","last_undegraded":"2024-05-10T11:16:35.833215+0000","last_fullsized":"2024-05-10T11:16:35.833215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.217874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591483+0000","last_change":"2024-05-10T11:16:34.861019+0000","last_active":"2024-05-10T11:16:36.591483+0000","last_peered":"2024-05-10T11:16:36.591483+0000","last_clean":"2024-05-10T11:16:36.591483+0000","last_became_active":"2024-05-10T11:16:34.860667+0000","last_became_peered":"2024-05-10T11:16:34.860667+0000","last_unstale":"2024-05-10T11:16:36.591483+0000","last_undegraded":"2024-05-10T11:16:36.591483+0000","last_fullsized":"2024-05-10T11:16:36.591483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:06.736280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834612+0000","last_change":"2024-05-10T11:16:33.851897+0000","last_active":"2024-05-10T11:16:35.834612+0000","last_peered":"2024-05-10T11:16:35.834612+0000","last_clean":"2024-05-10T11:16:35.834612+0000","last_became_active":"2024-05-10T11:16:33.851629+0000","last_became_peered":"2024-05-10T11:16:33.851629+0000","last_unstale":"2024-05-10T11:16:35.834612+0000","last_undegraded":"2024-05-10T11:16:35.834612+0000","last_fullsized":"2024-05-10T11:16:35.834612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:02.785863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090623+0000","last_change":"2024-05-10T11:16:34.849709+0000","last_active":"2024-05-10T11:16:36.090623+0000","last_peered":"2024-05-10T11:16:36.090623+0000","last_clean":"2024-05-10T11:16:36.090623+0000","last_became_active":"2024-05-10T11:16:34.849412+0000","last_became_peered":"2024-05-10T11:16:34.849412+0000","last_unstale":"2024-05-10T11:16:36.090623+0000","last_undegraded":"2024-05-10T11:16:36.090623+0000","last_fullsized":"2024-05-10T11:16:36.090623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:09.452662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591486+0000","last_change":"2024-05-10T11:16:33.840818+0000","last_active":"2024-05-10T11:16:36.591486+0000","last_peered":"2024-05-10T11:16:36.591486+0000","last_clean":"2024-05-10T11:16:36.591486+0000","last_became_active":"2024-05-10T11:16:33.840472+0000","last_became_peered":"2024-05-10T11:16:33.840472+0000","last_unstale":"2024-05-10T11:16:36.591486+0000","last_undegraded":"2024-05-10T11:16:36.591486+0000","last_fullsized":"2024-05-10T11:16:36.591486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:36:21.942433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090750+0000","last_change":"2024-05-10T11:16:34.848027+0000","last_active":"2024-05-10T11:16:36.090750+0000","last_peered":"2024-05-10T11:16:36.090750+0000","last_clean":"2024-05-10T11:16:36.090750+0000","last_became_active":"2024-05-10T11:16:34.846208+0000","last_became_peered":"2024-05-10T11:16:34.846208+0000","last_unstale":"2024-05-10T11:16:36.090750+0000","last_undegraded":"2024-05-10T11:16:36.090750+0000","last_fullsized":"2024-05-10T11:16:36.090750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:21.557365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591275+0000","last_change":"2024-05-10T11:16:33.843809+0000","last_active":"2024-05-10T11:16:36.591275+0000","last_peered":"2024-05-10T11:16:36.591275+0000","last_clean":"2024-05-10T11:16:36.591275+0000","last_became_active":"2024-05-10T11:16:33.843314+0000","last_became_peered":"2024-05-10T11:16:33.843314+0000","last_unstale":"2024-05-10T11:16:36.591275+0000","last_undegraded":"2024-05-10T11:16:36.591275+0000","last_fullsized":"2024-05-10T11:16:36.591275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:04.942342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592289+0000","last_change":"2024-05-10T11:16:34.852587+0000","last_active":"2024-05-10T11:16:36.592289+0000","last_peered":"2024-05-10T11:16:36.592289+0000","last_clean":"2024-05-10T11:16:36.592289+0000","last_became_active":"2024-05-10T11:16:34.848206+0000","last_became_peered":"2024-05-10T11:16:34.848206+0000","last_unstale":"2024-05-10T11:16:36.592289+0000","last_undegraded":"2024-05-10T11:16:36.592289+0000","last_fullsized":"2024-05-10T11:16:36.592289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:18.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591160+0000","last_change":"2024-05-10T11:16:33.842957+0000","last_active":"2024-05-10T11:16:36.591160+0000","last_peered":"2024-05-10T11:16:36.591160+0000","last_clean":"2024-05-10T11:16:36.591160+0000","last_became_active":"2024-05-10T11:16:33.842675+0000","last_became_peered":"2024-05-10T11:16:33.842675+0000","last_unstale":"2024-05-10T11:16:36.591160+0000","last_undegraded":"2024-05-10T11:16:36.591160+0000","last_fullsized":"2024-05-10T11:16:36.591160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:15.036965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591790+0000","last_change":"2024-05-10T11:16:34.844506+0000","last_active":"2024-05-10T11:16:36.591790+0000","last_peered":"2024-05-10T11:16:36.591790+0000","last_clean":"2024-05-10T11:16:36.591790+0000","last_became_active":"2024-05-10T11:16:34.844234+0000","last_became_peered":"2024-05-10T11:16:34.844234+0000","last_unstale":"2024-05-10T11:16:36.591790+0000","last_undegraded":"2024-05-10T11:16:36.591790+0000","last_fullsized":"2024-05-10T11:16:36.591790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:48.813843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592665+0000","last_change":"2024-05-10T11:16:33.839202+0000","last_active":"2024-05-10T11:16:36.592665+0000","last_peered":"2024-05-10T11:16:36.592665+0000","last_clean":"2024-05-10T11:16:36.592665+0000","last_became_active":"2024-05-10T11:16:33.838582+0000","last_became_peered":"2024-05-10T11:16:33.838582+0000","last_unstale":"2024-05-10T11:16:36.592665+0000","last_undegraded":"2024-05-10T11:16:36.592665+0000","last_fullsized":"2024-05-10T11:16:36.592665+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592216+0000","last_change":"2024-05-10T11:16:34.861753+0000","last_active":"2024-05-10T11:16:36.592216+0000","last_peered":"2024-05-10T11:16:36.592216+0000","last_clean":"2024-05-10T11:16:36.592216+0000","last_became_active":"2024-05-10T11:16:34.861491+0000","last_became_peered":"2024-05-10T11:16:34.861491+0000","last_unstale":"2024-05-10T11:16:36.592216+0000","last_undegraded":"2024-05-10T11:16:36.592216+0000","last_fullsized":"2024-05-10T11:16:36.592216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:22.427530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.837136+0000","last_change":"2024-05-10T11:16:33.850966+0000","last_active":"2024-05-10T11:16:36.837136+0000","last_peered":"2024-05-10T11:16:36.837136+0000","last_clean":"2024-05-10T11:16:36.837136+0000","last_became_active":"2024-05-10T11:16:33.850661+0000","last_became_peered":"2024-05-10T11:16:33.850661+0000","last_unstale":"2024-05-10T11:16:36.837136+0000","last_undegraded":"2024-05-10T11:16:36.837136+0000","last_fullsized":"2024-05-10T11:16:36.837136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:34.828643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592119+0000","last_change":"2024-05-10T11:16:34.845648+0000","last_active":"2024-05-10T11:16:36.592119+0000","last_peered":"2024-05-10T11:16:36.592119+0000","last_clean":"2024-05-10T11:16:36.592119+0000","last_became_active":"2024-05-10T11:16:34.845374+0000","last_became_peered":"2024-05-10T11:16:34.845374+0000","last_unstale":"2024-05-10T11:16:36.592119+0000","last_undegraded":"2024-05-10T11:16:36.592119+0000","last_fullsized":"2024-05-10T11:16:36.592119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:31.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123574+0000","last_change":"2024-05-10T11:16:33.848721+0000","last_active":"2024-05-10T11:16:36.123574+0000","last_peered":"2024-05-10T11:16:36.123574+0000","last_clean":"2024-05-10T11:16:36.123574+0000","last_became_active":"2024-05-10T11:16:33.848429+0000","last_became_peered":"2024-05-10T11:16:33.848429+0000","last_unstale":"2024-05-10T11:16:36.123574+0000","last_undegraded":"2024-05-10T11:16:36.123574+0000","last_fullsized":"2024-05-10T11:16:36.123574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:45.477319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.090506+0000","last_change":"2024-05-10T11:16:34.846463+0000","last_active":"2024-05-10T11:16:36.090506+0000","last_peered":"2024-05-10T11:16:36.090506+0000","last_clean":"2024-05-10T11:16:36.090506+0000","last_became_active":"2024-05-10T11:16:34.845916+0000","last_became_peered":"2024-05-10T11:16:34.845916+0000","last_unstale":"2024-05-10T11:16:36.090506+0000","last_undegraded":"2024-05-10T11:16:36.090506+0000","last_fullsized":"2024-05-10T11:16:36.090506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:18.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123145+0000","last_change":"2024-05-10T11:16:33.848344+0000","last_active":"2024-05-10T11:16:36.123145+0000","last_peered":"2024-05-10T11:16:36.123145+0000","last_clean":"2024-05-10T11:16:36.123145+0000","last_became_active":"2024-05-10T11:16:33.848071+0000","last_became_peered":"2024-05-10T11:16:33.848071+0000","last_unstale":"2024-05-10T11:16:36.123145+0000","last_undegraded":"2024-05-10T11:16:36.123145+0000","last_fullsized":"2024-05-10T11:16:36.123145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:21.418160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591864+0000","last_change":"2024-05-10T11:16:34.861800+0000","last_active":"2024-05-10T11:16:36.591864+0000","last_peered":"2024-05-10T11:16:36.591864+0000","last_clean":"2024-05-10T11:16:36.591864+0000","last_became_active":"2024-05-10T11:16:34.861522+0000","last_became_peered":"2024-05-10T11:16:34.861522+0000","last_unstale":"2024-05-10T11:16:36.591864+0000","last_undegraded":"2024-05-10T11:16:36.591864+0000","last_fullsized":"2024-05-10T11:16:36.591864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:52:46.326579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591651+0000","last_change":"2024-05-10T11:16:33.842583+0000","last_active":"2024-05-10T11:16:36.591651+0000","last_peered":"2024-05-10T11:16:36.591651+0000","last_clean":"2024-05-10T11:16:36.591651+0000","last_became_active":"2024-05-10T11:16:33.842298+0000","last_became_peered":"2024-05-10T11:16:33.842298+0000","last_unstale":"2024-05-10T11:16:36.591651+0000","last_undegraded":"2024-05-10T11:16:36.591651+0000","last_fullsized":"2024-05-10T11:16:36.591651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:21.149766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591766+0000","last_change":"2024-05-10T11:16:34.851644+0000","last_active":"2024-05-10T11:16:36.591766+0000","last_peered":"2024-05-10T11:16:36.591766+0000","last_clean":"2024-05-10T11:16:36.591766+0000","last_became_active":"2024-05-10T11:16:34.851376+0000","last_became_peered":"2024-05-10T11:16:34.851376+0000","last_unstale":"2024-05-10T11:16:36.591766+0000","last_undegraded":"2024-05-10T11:16:36.591766+0000","last_fullsized":"2024-05-10T11:16:36.591766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:48.035155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.832824+0000","last_change":"2024-05-10T11:16:33.851549+0000","last_active":"2024-05-10T11:16:35.832824+0000","last_peered":"2024-05-10T11:16:35.832824+0000","last_clean":"2024-05-10T11:16:35.832824+0000","last_became_active":"2024-05-10T11:16:33.851206+0000","last_became_peered":"2024-05-10T11:16:33.851206+0000","last_unstale":"2024-05-10T11:16:35.832824+0000","last_undegraded":"2024-05-10T11:16:35.832824+0000","last_fullsized":"2024-05-10T11:16:35.832824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:02.953747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834995+0000","last_change":"2024-05-10T11:16:34.863061+0000","last_active":"2024-05-10T11:16:35.834995+0000","last_peered":"2024-05-10T11:16:35.834995+0000","last_clean":"2024-05-10T11:16:35.834995+0000","last_became_active":"2024-05-10T11:16:34.862777+0000","last_became_peered":"2024-05-10T11:16:34.862777+0000","last_unstale":"2024-05-10T11:16:35.834995+0000","last_undegraded":"2024-05-10T11:16:35.834995+0000","last_fullsized":"2024-05-10T11:16:35.834995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:37:35.147899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.592297+0000","last_change":"2024-05-10T11:16:33.841766+0000","last_active":"2024-05-10T11:16:36.592297+0000","last_peered":"2024-05-10T11:16:36.592297+0000","last_clean":"2024-05-10T11:16:36.592297+0000","last_became_active":"2024-05-10T11:16:33.841421+0000","last_became_peered":"2024-05-10T11:16:33.841421+0000","last_unstale":"2024-05-10T11:16:36.592297+0000","last_undegraded":"2024-05-10T11:16:36.592297+0000","last_fullsized":"2024-05-10T11:16:36.592297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:22:45.938601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834983+0000","last_change":"2024-05-10T11:16:34.851996+0000","last_active":"2024-05-10T11:16:35.834983+0000","last_peered":"2024-05-10T11:16:35.834983+0000","last_clean":"2024-05-10T11:16:35.834983+0000","last_became_active":"2024-05-10T11:16:34.851659+0000","last_became_peered":"2024-05-10T11:16:34.851659+0000","last_unstale":"2024-05-10T11:16:35.834983+0000","last_undegraded":"2024-05-10T11:16:35.834983+0000","last_fullsized":"2024-05-10T11:16:35.834983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:35.838012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:35.834471+0000","last_change":"2024-05-10T11:16:33.840847+0000","last_active":"2024-05-10T11:16:35.834471+0000","last_peered":"2024-05-10T11:16:35.834471+0000","last_clean":"2024-05-10T11:16:35.834471+0000","last_became_active":"2024-05-10T11:16:33.840336+0000","last_became_peered":"2024-05-10T11:16:33.840336+0000","last_unstale":"2024-05-10T11:16:35.834471+0000","last_undegraded":"2024-05-10T11:16:35.834471+0000","last_fullsized":"2024-05-10T11:16:35.834471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:02:57.998358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123451+0000","last_change":"2024-05-10T11:16:34.856890+0000","last_active":"2024-05-10T11:16:36.123451+0000","last_peered":"2024-05-10T11:16:36.123451+0000","last_clean":"2024-05-10T11:16:36.123451+0000","last_became_active":"2024-05-10T11:16:34.856662+0000","last_became_peered":"2024-05-10T11:16:34.856662+0000","last_unstale":"2024-05-10T11:16:36.123451+0000","last_undegraded":"2024-05-10T11:16:36.123451+0000","last_fullsized":"2024-05-10T11:16:36.123451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:33.821601+0000","last_clean_scrub_stamp":"2024-05-10T11:16:33.821601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:39:43.839573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.591763+0000","last_change":"2024-05-10T11:16:33.841956+0000","last_active":"2024-05-10T11:16:36.591763+0000","last_peered":"2024-05-10T11:16:36.591763+0000","last_clean":"2024-05-10T11:16:36.591763+0000","last_became_active":"2024-05-10T11:16:33.841606+0000","last_became_peered":"2024-05-10T11:16:33.841606+0000","last_unstale":"2024-05-10T11:16:36.591763+0000","last_undegraded":"2024-05-10T11:16:36.591763+0000","last_fullsized":"2024-05-10T11:16:36.591763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:16:32.812231+0000","last_clean_scrub_stamp":"2024-05-10T11:16:32.812231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:56.319173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":213,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T11:16:36.123362+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:16:36.123362+0000","last_peered":"2024-05-10T11:16:36.123362+0000","last_clean":"2024-05-10T11:16:36.123362+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:16:36.123362+0000","last_undegraded":"2024-05-10T11:16:36.123362+0000","last_fullsized":"2024-05-10T11:16:36.123362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1008579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":419801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":419905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":418931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":418301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1515520,"data_stored":1008557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":418223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:16:43.729 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:16:43.730 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:16:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.876+0000 7f069826d640 1 Processor -- start 2024-05-10T11:16:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.876+0000 7f069826d640 1 -- start start 2024-05-10T11:16:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.877+0000 7f069826d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0690162ce0 0x7f06900b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.877+0000 7f069826d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06900b4e20 0x7f06900d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.877+0000 7f069826d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06900d4190 con 0x7f0690162900 2024-05-10T11:16:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.877+0000 7f069826d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f06900cfc40 con 0x7f0690162ce0 2024-05-10T11:16:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.877+0000 7f069826d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f06900d3eb0 con 0x7f06900b4e20 2024-05-10T11:16:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0695808640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0690162ce0 0x7f06900b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f069680a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06900b4e20 0x7f06900d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0696009640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0690162900 0x7f06900d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:57276/0 (socket says 172.21.15.66:57276) 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0696009640 1 -- 172.21.15.66:0/1871841173 learned_addr learned my addr 172.21.15.66:0/1871841173 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0695808640 1 -- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06900b4e20 msgr2=0x7f06900d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0695808640 1 --2- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06900b4e20 0x7f06900d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0695808640 1 -- 172.21.15.66:0/1871841173 >> v1:172.21.15.190:6789/0 conn(0x7f0690162900 legacy=0x7f06900d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0695007640 1 -- 172.21.15.66:0/1871841173 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496464126 0 0) 0x7f0680001490 con 0x7f0690162900 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f0695808640 1 -- 172.21.15.66:0/1871841173 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06900cfee0 con 0x7f0690162ce0 2024-05-10T11:16:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.878+0000 7f069680a640 1 --2- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06900b4e20 0x7f06900d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.879+0000 7f0695808640 1 --2- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162ce0 0x7f06900b48e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f06840097a0 tx=0x7f068402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed52256e22e9e15d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.879+0000 7f0695007640 1 -- 172.21.15.66:0/1871841173 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684037070 con 0x7f0690162ce0 2024-05-10T11:16:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.879+0000 7f0695007640 1 -- 172.21.15.66:0/1871841173 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068402ae50 con 0x7f0690162ce0 2024-05-10T11:16:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.879+0000 7f0695007640 1 -- 172.21.15.66:0/1871841173 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684032660 con 0x7f0690162ce0 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 -- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162ce0 msgr2=0x7f06900b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 --2- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162ce0 0x7f06900b48e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f06840097a0 tx=0x7f068402a100 comp rx=0 tx=0).stop 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 -- 172.21.15.66:0/1871841173 shutdown_connections 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 --2- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06900b4e20 0x7f06900d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 --2- 172.21.15.66:0/1871841173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162ce0 0x7f06900b48e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 -- 172.21.15.66:0/1871841173 >> 172.21.15.66:0/1871841173 conn(0x7f069009e430 msgr2=0x7f06900d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 -- 172.21.15.66:0/1871841173 shutdown_connections 2024-05-10T11:16:43.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.880+0000 7f069826d640 1 -- 172.21.15.66:0/1871841173 wait complete. 2024-05-10T11:16:43.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.881+0000 7f069826d640 1 Processor -- start 2024-05-10T11:16:43.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.881+0000 7f069826d640 1 -- start start 2024-05-10T11:16:43.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069826d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 0x7f069014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069826d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162900 0x7f069006e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069826d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0690162ce0 0x7f06900ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069826d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f06900b4180 con 0x7f06900b4e20 2024-05-10T11:16:43.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069826d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06900d3b20 con 0x7f0690162900 2024-05-10T11:16:43.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069826d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f06900b4300 con 0x7f0690162ce0 2024-05-10T11:16:43.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 0x7f069014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 0x7f069014efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52270/0 (socket says 172.21.15.66:52270) 2024-05-10T11:16:43.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 -- 172.21.15.66:0/2338528084 learned_addr learned my addr 172.21.15.66:0/2338528084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:43.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0695808640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162900 0x7f069006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f069680a640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0690162ce0 0x7f06900ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 -- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0690162ce0 msgr2=0x7f06900ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0690162ce0 0x7f06900ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 -- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162900 msgr2=0x7f069006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:43.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162900 0x7f069006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 -- 172.21.15.66:0/2338528084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06900cdb10 con 0x7f06900b4e20 2024-05-10T11:16:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.882+0000 7f0696009640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 0x7f069014efb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f068000c850 tx=0x7f068000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.883+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680018070 con 0x7f06900b4e20 2024-05-10T11:16:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.883+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068000a640 con 0x7f06900b4e20 2024-05-10T11:16:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.883+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069014f4f0 con 0x7f06900b4e20 2024-05-10T11:16:43.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.883+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068000aa30 con 0x7f06900b4e20 2024-05-10T11:16:43.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.883+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069015ea30 con 0x7f06900b4e20 2024-05-10T11:16:43.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.884+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069006a220 con 0x7f06900b4e20 2024-05-10T11:16:43.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.884+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f068001b070 con 0x7f06900b4e20 2024-05-10T11:16:43.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.885+0000 7f068effd640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f067c0762d0 0x7f067c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:43.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.885+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f0680096c30 con 0x7f06900b4e20 2024-05-10T11:16:43.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.885+0000 7f0695808640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f067c0762d0 0x7f067c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:43.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.886+0000 7f0695808640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f067c0762d0 0x7f067c078790 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0684034000 tx=0x7f068402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:43.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:43.889+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f069014f4f0 con 0x7f06900b4e20 2024-05-10T11:16:44.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.157+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f069009e840 con 0x7f06900b4e20 2024-05-10T11:16:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.159+0000 7f068effd640 1 -- 172.21.15.66:0/2338528084 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f06900cdb10 con 0x7f06900b4e20 2024-05-10T11:16:44.160 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:16:44.160 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:16:44.160 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:16:44.160 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:16:44.160 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:16:44.160 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:16:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f067c0762d0 msgr2=0x7f067c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f067c0762d0 0x7f067c078790 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0684034000 tx=0x7f068402e000 comp rx=0 tx=0).stop 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 msgr2=0x7f069014efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 0x7f069014efb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f068000c850 tx=0x7f068000cc50 comp rx=0 tx=0).stop 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 shutdown_connections 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f067c0762d0 0x7f067c078790 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0690162ce0 0x7f06900ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0690162900 0x7f069006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 --2- 172.21.15.66:0/2338528084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06900b4e20 0x7f069014efb0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 >> 172.21.15.66:0/2338528084 conn(0x7f069009e430 msgr2=0x7f069006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 shutdown_connections 2024-05-10T11:16:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.162+0000 7f069826d640 1 -- 172.21.15.66:0/2338528084 wait complete. 2024-05-10T11:16:44.173 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:44.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.276+0000 7f5985b6a640 1 Processor -- start 2024-05-10T11:16:44.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.276+0000 7f5985b6a640 1 -- start start 2024-05-10T11:16:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f5985b6a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f59800d3d80 0x7f59800b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f5985b6a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59800d59d0 0x7f59800d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f5985b6a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59800d2d20 con 0x7f5980162940 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f5985b6a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5980162d20 con 0x7f59800d59d0 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f5985b6a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f59800d3000 con 0x7f59800d3d80 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59800d59d0 0x7f59800d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59800d59d0 0x7f59800d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52272/0 (socket says 172.21.15.66:52272) 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1904362940 learned_addr learned my addr 172.21.15.66:0/1904362940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597effd640 1 --2- 172.21.15.66:0/1904362940 >> v2:172.21.15.190:3300/0 conn(0x7f59800d3d80 0x7f59800b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1904362940 >> v2:172.21.15.190:3300/0 conn(0x7f59800d3d80 msgr2=0x7f59800b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 --2- 172.21.15.66:0/1904362940 >> v2:172.21.15.190:3300/0 conn(0x7f59800d3d80 0x7f59800b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1904362940 >> v1:172.21.15.190:6789/0 conn(0x7f5980162940 legacy=0x7f59800d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1904362940 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59800d32e0 con 0x7f59800d59d0 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.277+0000 7f597effd640 1 --2- 172.21.15.66:0/1904362940 >> v2:172.21.15.190:3300/0 conn(0x7f59800d3d80 0x7f59800b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:44.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.278+0000 7f597ffff640 1 --2- 172.21.15.66:0/1904362940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d59d0 0x7f59800d01e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f598009eab0 tx=0x7f597802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d30befcc1d4c6db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.278+0000 7f597e7fc640 1 -- 172.21.15.66:0/1904362940 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978036070 con 0x7f59800d59d0 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.278+0000 7f597e7fc640 1 -- 172.21.15.66:0/1904362940 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5978031600 con 0x7f59800d59d0 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.278+0000 7f597e7fc640 1 -- 172.21.15.66:0/1904362940 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59780319d0 con 0x7f59800d59d0 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 -- 172.21.15.66:0/1904362940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d59d0 msgr2=0x7f59800d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 --2- 172.21.15.66:0/1904362940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d59d0 0x7f59800d01e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f598009eab0 tx=0x7f597802a660 comp rx=0 tx=0).stop 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 -- 172.21.15.66:0/1904362940 shutdown_connections 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 --2- 172.21.15.66:0/1904362940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d59d0 0x7f59800d01e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 --2- 172.21.15.66:0/1904362940 >> v2:172.21.15.190:3300/0 conn(0x7f59800d3d80 0x7f59800b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 -- 172.21.15.66:0/1904362940 >> 172.21.15.66:0/1904362940 conn(0x7f598009e380 msgr2=0x7f59800d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 -- 172.21.15.66:0/1904362940 shutdown_connections 2024-05-10T11:16:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.279+0000 7f5985b6a640 1 -- 172.21.15.66:0/1904362940 wait complete. 2024-05-10T11:16:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.280+0000 7f5985b6a640 1 Processor -- start 2024-05-10T11:16:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.280+0000 7f5985b6a640 1 -- start start 2024-05-10T11:16:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f5985b6a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 0x7f59801f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f5985b6a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800d59d0 0x7f59801f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f5985b6a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980162940 0x7f59800b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f5985b6a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59800d2390 con 0x7f59800d3d80 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f5985b6a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f59800cfc50 con 0x7f5980162940 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f5985b6a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f59800d2510 con 0x7f59800d59d0 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 0x7f59801f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 0x7f59801f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52278/0 (socket says 172.21.15.66:52278) 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 -- 172.21.15.66:0/3266109813 learned_addr learned my addr 172.21.15.66:0/3266109813 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597effd640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800d59d0 0x7f59801f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 -- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800d59d0 msgr2=0x7f59801f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597ffff640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980162940 0x7f59800b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800d59d0 0x7f59801f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 -- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980162940 msgr2=0x7f59800b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980162940 0x7f59800b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597f7fe640 1 -- 172.21.15.66:0/3266109813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59800b7e00 con 0x7f59800d3d80 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597effd640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800d59d0 0x7f59801f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.281+0000 7f597ffff640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980162940 0x7f59800b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.282+0000 7f597f7fe640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 0x7f59801f54d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f597000c430 tx=0x7f597000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.282+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970007020 con 0x7f59800d3d80 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.282+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59700071e0 con 0x7f59800d3d80 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.282+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59800b80e0 con 0x7f59800d3d80 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.282+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970007610 con 0x7f59800d3d80 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.282+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59800b8bc0 con 0x7f59800d3d80 2024-05-10T11:16:44.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.283+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598006a220 con 0x7f59800d3d80 2024-05-10T11:16:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.284+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5970019020 con 0x7f59800d3d80 2024-05-10T11:16:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.284+0000 7f5967fff640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f596c076300 0x7f596c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.284+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f5970096f60 con 0x7f59800d3d80 2024-05-10T11:16:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.284+0000 7f597effd640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f596c076300 0x7f596c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:44.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.285+0000 7f597effd640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f596c076300 0x7f596c0787c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5974006fd0 tx=0x7f5974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:44.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.289+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5970060730 con 0x7f59800d3d80 2024-05-10T11:16:44.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.521+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59800d2730 con 0x7f59800d3d80 2024-05-10T11:16:44.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.521+0000 7f5967fff640 1 -- 172.21.15.66:0/3266109813 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5186 (secure 0 0 0) 0x7f5970060030 con 0x7f59800d3d80 2024-05-10T11:16:44.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:44.522 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:37.237701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/1361798984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1361798984},{"type":"v1","addr":"172.21.15.66:6835","nonce":1361798984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6276,"qdb_cluster":[6276]},"id":5}]} 2024-05-10T11:16:44.522 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 46 2024-05-10T11:16:44.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.523+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f596c076300 msgr2=0x7f596c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.523+0000 7f5985b6a640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f596c076300 0x7f596c0787c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5974006fd0 tx=0x7f5974008040 comp rx=0 tx=0).stop 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.523+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 msgr2=0x7f59801f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.523+0000 7f5985b6a640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 0x7f59801f54d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f597000c430 tx=0x7f597000c8f0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 shutdown_connections 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f596c076300 0x7f596c0787c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980162940 0x7f59800b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800d59d0 0x7f59801f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 --2- 172.21.15.66:0/3266109813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800d3d80 0x7f59801f54d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 >> 172.21.15.66:0/3266109813 conn(0x7f598009e380 msgr2=0x7f59800b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 shutdown_connections 2024-05-10T11:16:44.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:44.524+0000 7f5985b6a640 1 -- 172.21.15.66:0/3266109813 wait complete. 2024-05-10T11:16:44.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:16:34.212384+0000', 'modified': '2024-05-10T11:16:37.237701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6276': {'gid': 6276, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6835/1361798984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 1361798984}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 1361798984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6276, 'qdb_cluster': [6276]} 2024-05-10T11:16:44.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:16:44.938 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T11:16:45.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.046+0000 7fef8ae09640 1 Processor -- start 2024-05-10T11:16:45.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.046+0000 7fef8ae09640 1 -- start start 2024-05-10T11:16:45.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef8ae09640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef840d0230 0x7fef840cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef8ae09640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef840cfbb0 0x7fef840ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef8ae09640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8415fc90 con 0x7fef840b8860 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef8ae09640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fef8406ec30 con 0x7fef840d0230 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef8ae09640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fef8406ee50 con 0x7fef840cfbb0 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef840d0230 0x7fef840cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef840d0230 0x7fef840cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57372/0 (socket says 172.21.15.66:57372) 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 -- 172.21.15.66:0/1355289932 learned_addr learned my addr 172.21.15.66:0/1355289932 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef893a6640 1 --2- 172.21.15.66:0/1355289932 >> v2:172.21.15.190:3300/0 conn(0x7fef840cfbb0 0x7fef840ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 -- 172.21.15.66:0/1355289932 >> v2:172.21.15.190:3300/0 conn(0x7fef840cfbb0 msgr2=0x7fef840ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 --2- 172.21.15.66:0/1355289932 >> v2:172.21.15.190:3300/0 conn(0x7fef840cfbb0 0x7fef840ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 -- 172.21.15.66:0/1355289932 >> v1:172.21.15.190:6789/0 conn(0x7fef840b8860 legacy=0x7fef8406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.047+0000 7fef83fff640 1 -- 172.21.15.66:0/1355289932 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef840b8c40 con 0x7fef840d0230 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.048+0000 7fef83fff640 1 --2- 172.21.15.66:0/1355289932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840cf670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fef84073790 tx=0x7fef7002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0ba4164e5856df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.048+0000 7fef837fe640 1 -- 172.21.15.66:0/1355289932 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70037070 con 0x7fef840d0230 2024-05-10T11:16:45.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.048+0000 7fef837fe640 1 -- 172.21.15.66:0/1355289932 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef70032440 con 0x7fef840d0230 2024-05-10T11:16:45.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.048+0000 7fef837fe640 1 -- 172.21.15.66:0/1355289932 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70032810 con 0x7fef840d0230 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 -- 172.21.15.66:0/1355289932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 msgr2=0x7fef840cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 --2- 172.21.15.66:0/1355289932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840cf670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fef84073790 tx=0x7fef7002a210 comp rx=0 tx=0).stop 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 -- 172.21.15.66:0/1355289932 shutdown_connections 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 --2- 172.21.15.66:0/1355289932 >> v2:172.21.15.190:3300/0 conn(0x7fef840cfbb0 0x7fef840ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 --2- 172.21.15.66:0/1355289932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840cf670 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 -- 172.21.15.66:0/1355289932 >> 172.21.15.66:0/1355289932 conn(0x7fef840d2df0 msgr2=0x7fef840d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 -- 172.21.15.66:0/1355289932 shutdown_connections 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.049+0000 7fef8ae09640 1 -- 172.21.15.66:0/1355289932 wait complete. 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.050+0000 7fef8ae09640 1 Processor -- start 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.050+0000 7fef8ae09640 1 -- start start 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef8ae09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef840b8860 0x7fef8415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef8ae09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef840cfbb0 0x7fef841617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef8ae09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef8ae09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef840cdb30 con 0x7fef840d0230 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef8ae09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef840cd850 con 0x7fef840cfbb0 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef8ae09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef840cde10 con 0x7fef840b8860 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57384/0 (socket says 172.21.15.66:57384) 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 -- 172.21.15.66:0/387602442 learned_addr learned my addr 172.21.15.66:0/387602442 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef88ba5640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef840b8860 0x7fef8415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef83fff640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef840cfbb0 0x7fef841617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 -- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef840b8860 msgr2=0x7fef8415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef840b8860 0x7fef8415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 -- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef840cfbb0 msgr2=0x7fef841617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef840cfbb0 0x7fef841617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 -- 172.21.15.66:0/387602442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef84160360 con 0x7fef840d0230 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.051+0000 7fef893a6640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840c8af0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007e70 tx=0x7fef7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.052+0000 7fef817fa640 1 -- 172.21.15.66:0/387602442 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c014620 con 0x7fef840d0230 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.052+0000 7fef817fa640 1 -- 172.21.15.66:0/387602442 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c019070 con 0x7fef840d0230 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.052+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef84160640 con 0x7fef840d0230 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.052+0000 7fef817fa640 1 -- 172.21.15.66:0/387602442 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c014a20 con 0x7fef840d0230 2024-05-10T11:16:45.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.052+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef84160c00 con 0x7fef840d0230 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.054+0000 7fef817fa640 1 -- 172.21.15.66:0/387602442 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef7c014bc0 con 0x7fef840d0230 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.054+0000 7fef817fa640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef680762d0 0x7fef68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.054+0000 7fef817fa640 1 -- 172.21.15.66:0/387602442 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fef7c097e60 con 0x7fef840d0230 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.054+0000 7fef88ba5640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef680762d0 0x7fef68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 Processor -- start 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 -- start start 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef88ba5640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef680762d0 0x7fef68078790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fef78001780 tx=0x7fef78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccda760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05ccdaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccaabb0 0x55c05ccae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c05cc148d0 con 0x55c05ccd8330 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c05cbcdc10 con 0x55c05ccaabb0 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55c05cc10890 con 0x55c05ccd7f50 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef83fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05ccdaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef83fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05ccdaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57392/0 (socket says 172.21.15.66:57392) 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef83fff640 1 -- 172.21.15.66:0/3354351748 learned_addr learned my addr 172.21.15.66:0/3354351748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef893a6640 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccaabb0 0x55c05ccae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.055+0000 7fef88ba5640 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccda760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef83fff640 1 -- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 msgr2=0x55c05ccda760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef83fff640 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccda760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef83fff640 1 -- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccaabb0 msgr2=0x55c05ccae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef83fff640 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccaabb0 0x55c05ccae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef83fff640 1 -- 172.21.15.66:0/3354351748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05cbd55d0 con 0x55c05ccd8330 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef83fff640 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05ccdaca0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fef7002a250 tx=0x7fef7002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ecae7b35b71b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef6e7fc640 1 -- 172.21.15.66:0/3354351748 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70037040 con 0x55c05ccd8330 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef6e7fc640 1 -- 172.21.15.66:0/3354351748 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef700327a0 con 0x55c05ccd8330 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.056+0000 7fef6e7fc640 1 -- 172.21.15.66:0/3354351748 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70032b90 con 0x55c05ccd8330 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 -- 172.21.15.66:0/3354351748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 msgr2=0x55c05ccdaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05ccdaca0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fef7002a250 tx=0x7fef7002c000 comp rx=0 tx=0).stop 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 -- 172.21.15.66:0/3354351748 shutdown_connections 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccaabb0 0x55c05ccae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05ccdaca0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 --2- 172.21.15.66:0/3354351748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccda760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 -- 172.21.15.66:0/3354351748 >> 172.21.15.66:0/3354351748 conn(0x55c05ccace20 msgr2=0x55c05ccf5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 -- 172.21.15.66:0/3354351748 shutdown_connections 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 -- 172.21.15.66:0/3354351748 wait complete. 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.057+0000 7fef8dc04740 1 -- start start 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 Processor -- start 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccfa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccdbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05ccde2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c05ccaffd0 con 0x55c05ccf8310 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c05cbd1760 con 0x55c05ccd7f50 2024-05-10T11:16:45.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55c05ccb02b0 con 0x55c05ccd8330 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef8dc04740 10 client.0 _ll_register_callbacks cb 0x55c05cc0acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.058+0000 7fef893a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05ccde2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05ccde2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57398/0 (socket says 172.21.15.66:57398) 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 -- 172.21.15.66:0/1356993845 learned_addr learned my addr 172.21.15.66:0/1356993845 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef83fff640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccdbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccfa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 -- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 msgr2=0x55c05ccdbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccdbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 -- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 msgr2=0x55c05ccfa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccfa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 -- 172.21.15.66:0/1356993845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05c9262d0 con 0x55c05ccf8310 2024-05-10T11:16:45.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef893a6640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05ccde2d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fef7c05d5d0 tx=0x7fef7c0610a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922598567bd4adf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef637fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef637fe640 1 -- 172.21.15.66:0/1356993845 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c060240 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef637fe640 1 -- 172.21.15.66:0/1356993845 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fef7c0603e0 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef700327a0 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef637fe640 1 -- 172.21.15.66:0/1356993845 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fef7c05c950 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef8dc04740 10 client.6405 fetch_fsmap learned FSMap version 46 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55c05c9f06b0 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.059+0000 7fef637fe640 1 -- 172.21.15.66:0/1356993845 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef700327a0 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef637fe640 1 -- 172.21.15.66:0/1356993845 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 3494+0+0 (secure 0 0 0) 0x7fef7c077070 con 0x55c05ccf8310 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef8dc04740 10 client.6405 fetch_fsmap finished waiting for FSMap version 46 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef8dc04740 10 client.6405 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef8dc04740 20 client.6405 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:45.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd096a0 0x55c05cd09a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef8dc04740 4 client.6405 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 --> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c05cb98760 con 0x55c05cd096a0 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd096a0 0x55c05cd09a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef637fe640 10 client.6405 ms_handle_connect on v2:172.21.15.66:6834/1361798984 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.060+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd096a0 0x55c05cd09a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff94c999842fecd1 server_cookie=4548559f0aba6aa0 in_seq=0 out_seq=0 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef637fe640 1 -- 172.21.15.66:0/1356993845 <== mds.0 v2:172.21.15.66:6834/1361798984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c05cb98760 con 0x55c05cd096a0 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef637fe640 10 client.6405 handle_command_reply: tid=0 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 client.6405 shutdown 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 msgr2=0x55c05ccde2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05ccde2d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fef7c05d5d0 tx=0x7fef7c0610a0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 shutdown_connections 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05ccde2d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccdbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd096a0 0x55c05cd09a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1356993845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccfa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef637fe640 0 client.6405 ms_handle_reset on v2:172.21.15.66:6834/1361798984 2024-05-10T11:16:45.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 >> 172.21.15.66:0/1356993845 conn(0x55c05ccaabb0 msgr2=0x55c05ccda720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 shutdown_connections 2024-05-10T11:16:45.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 1 -- 172.21.15.66:0/1356993845 wait complete. 2024-05-10T11:16:45.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.061+0000 7fef8dc04740 20 client.6405 trim_cache size 0 max 16384 2024-05-10T11:16:45.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.080+0000 7fef8dc04740 1 Processor -- start 2024-05-10T11:16:45.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.080+0000 7fef8dc04740 1 -- start start 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccf8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05cca9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef8dc04740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef84200e70 con 0x55c05ccf8310 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef841f7290 con 0x55c05ccd7f50 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef84200820 con 0x55c05ccd8330 2024-05-10T11:16:45.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05cca9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05cca9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57400/0 (socket says 172.21.15.66:57400) 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 -- 172.21.15.66:0/2531163231 learned_addr learned my addr 172.21.15.66:0/2531163231 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef83fff640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef88ba5640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccf8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 -- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 msgr2=0x55c05ccab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 -- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 msgr2=0x55c05ccf8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.081+0000 7fef893a6640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccf8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef893a6640 1 -- 172.21.15.66:0/2531163231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05cc19b50 con 0x55c05ccf8310 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef83fff640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef88ba5640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccf8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef893a6640 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05cca9c30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009740 tx=0x7fef7c063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b611852d9844133 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef6dffb640 1 -- 172.21.15.66:0/2531163231 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c05cc30 con 0x55c05ccf8310 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef6dffb640 1 -- 172.21.15.66:0/2531163231 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c060240 con 0x55c05ccf8310 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef6dffb640 1 -- 172.21.15.66:0/2531163231 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c07a110 con 0x55c05ccf8310 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 -- 172.21.15.66:0/2531163231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 msgr2=0x55c05cca9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05cca9c30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009740 tx=0x7fef7c063000 comp rx=0 tx=0).stop 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 -- 172.21.15.66:0/2531163231 shutdown_connections 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccf8310 0x55c05cca9c30 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd8330 0x55c05ccab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 --2- 172.21.15.66:0/2531163231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccd7f50 0x55c05ccf8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.082+0000 7fef8dc04740 1 -- 172.21.15.66:0/2531163231 >> 172.21.15.66:0/2531163231 conn(0x55c05ccaabb0 msgr2=0x55c05ccb0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.083+0000 7fef8dc04740 1 -- 172.21.15.66:0/2531163231 shutdown_connections 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.083+0000 7fef8dc04740 1 -- 172.21.15.66:0/2531163231 wait complete. 2024-05-10T11:16:45.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.083+0000 7fef8dc04740 1 -- start start 2024-05-10T11:16:45.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.083+0000 7fef8dc04740 1 Processor -- start 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccf79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05cd770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccf8310 0x55c05cd04b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c05ccf8880 con 0x55c05ccd8330 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c05ccdcc40 con 0x55c05ccf8310 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55c05ccfd840 con 0x55c05ccd7f50 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef8dc04740 10 client.0 _ll_register_callbacks cb 0x7fef7c060930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05cd770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05cd770a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57410/0 (socket says 172.21.15.66:57410) 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 -- 172.21.15.66:0/1332969836 learned_addr learned my addr 172.21.15.66:0/1332969836 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef893a6640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccf8310 0x55c05cd04b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccf79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 -- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 msgr2=0x55c05ccf79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccf79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 -- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccf8310 msgr2=0x55c05cd04b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccf8310 0x55c05cd04b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef83fff640 1 -- 172.21.15.66:0/1332969836 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05ccf5ec0 con 0x55c05ccd8330 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccf79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.084+0000 7fef893a6640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccf8310 0x55c05cd04b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef83fff640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05cd770a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fef7002a250 tx=0x7fef70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411ae97b9742f994 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef637fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef637fe640 1 -- 172.21.15.66:0/1332969836 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7004b070 con 0x55c05ccd8330 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef7c060240 con 0x55c05ccd8330 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef637fe640 1 -- 172.21.15.66:0/1332969836 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fef70003610 con 0x55c05ccd8330 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef637fe640 1 -- 172.21.15.66:0/1332969836 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fef70056050 con 0x55c05ccd8330 2024-05-10T11:16:45.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 10 client.6411 fetch_fsmap learned FSMap version 46 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55c05ccf64e0 con 0x55c05ccd8330 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef637fe640 1 -- 172.21.15.66:0/1332969836 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c060240 con 0x55c05ccd8330 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef637fe640 1 -- 172.21.15.66:0/1332969836 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 3494+0+0 (secure 0 0 0) 0x7fef70059020 con 0x55c05ccd8330 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 10 client.6411 fetch_fsmap finished waiting for FSMap version 46 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 10 client.6411 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 20 client.6411 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd08250 0x55c05cd184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 4 client.6411 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 --> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] -- command(tid 0: {"prefix": "status"}) -- 0x55c05ccfbd30 con 0x55c05cd08250 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.085+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd08250 0x55c05cd184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef637fe640 10 client.6411 ms_handle_connect on v2:172.21.15.66:6834/1361798984 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef88ba5640 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd08250 0x55c05cd184b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636137f8f9c04729 server_cookie=1e496caa53d50981 in_seq=0 out_seq=0 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef637fe640 1 -- 172.21.15.66:0/1332969836 <== mds.0 v2:172.21.15.66:6834/1361798984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c05ccfbd30 con 0x55c05cd08250 2024-05-10T11:16:45.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef637fe640 10 client.6411 handle_command_reply: tid=0 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 client.6411 shutdown 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 msgr2=0x55c05cd770a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05cd770a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fef7002a250 tx=0x7fef70004730 comp rx=0 tx=0).stop 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 shutdown_connections 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:6834/1361798984,v1:172.21.15.66:6835/1361798984] conn(0x55c05cd08250 0x55c05cd184b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c05ccf8310 0x55c05cd04b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c05ccd8330 0x55c05cd770a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef637fe640 0 client.6411 ms_handle_reset on v2:172.21.15.66:6834/1361798984 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 --2- 172.21.15.66:0/1332969836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c05ccd7f50 0x55c05ccf79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 >> 172.21.15.66:0/1332969836 conn(0x55c05ccaabb0 msgr2=0x55c05ccaf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 shutdown_connections 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 1 -- 172.21.15.66:0/1332969836 wait complete. 2024-05-10T11:16:45.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.086+0000 7fef8dc04740 20 client.6411 trim_cache size 0 max 16384 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 6276, 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 10.257686512999999, 2024-05-10T11:16:45.094 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 46, 2024-05-10T11:16:45.095 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 76, 2024-05-10T11:16:45.095 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 76, 2024-05-10T11:16:45.095 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 15.560927519 2024-05-10T11:16:45.095 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef680762d0 msgr2=0x7fef68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef680762d0 0x7fef68078790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fef78001780 tx=0x7fef78009040 comp rx=0 tx=0).stop 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 msgr2=0x7fef840c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840c8af0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007e70 tx=0x7fef7c00e4b0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 shutdown_connections 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef680762d0 0x7fef68078790 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef840d0230 0x7fef840c8af0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef840cfbb0 0x7fef841617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 --2- 172.21.15.66:0/387602442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef840b8860 0x7fef8415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 >> 172.21.15.66:0/387602442 conn(0x7fef840d2df0 msgr2=0x7fef840d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 shutdown_connections 2024-05-10T11:16:45.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.087+0000 7fef8ae09640 1 -- 172.21.15.66:0/387602442 wait complete. 2024-05-10T11:16:45.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:16:45.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.202+0000 7fde10207640 1 Processor -- start 2024-05-10T11:16:45.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.202+0000 7fde10207640 1 -- start start 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde10207640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde080d3980 0x7fde080cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde10207640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde080b43a0 0x7fde080b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde10207640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde080ce590 con 0x7fde0815d650 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde10207640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fde0815da30 con 0x7fde080d3980 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde10207640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fde080d0500 con 0x7fde080b43a0 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde0d7a2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde080d3980 0x7fde080cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde0d7a2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde080d3980 0x7fde080cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57422/0 (socket says 172.21.15.66:57422) 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde0d7a2640 1 -- 172.21.15.66:0/2889552269 learned_addr learned my addr 172.21.15.66:0/2889552269 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.203+0000 7fde0dfa3640 1 --1- 172.21.15.66:0/2889552269 >> v1:172.21.15.66:6789/0 conn(0x7fde0815d650 0x7fde080cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54750/0 (socket says 172.21.15.66:54750) 2024-05-10T11:16:45.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.204+0000 7fde0e7a4640 1 --2- 172.21.15.66:0/2889552269 >> v2:172.21.15.190:3300/0 conn(0x7fde080b43a0 0x7fde080b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.204+0000 7fde0d7a2640 1 -- 172.21.15.66:0/2889552269 >> v2:172.21.15.190:3300/0 conn(0x7fde080b43a0 msgr2=0x7fde080b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:45.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.204+0000 7fde0d7a2640 1 --2- 172.21.15.66:0/2889552269 >> v2:172.21.15.190:3300/0 conn(0x7fde080b43a0 0x7fde080b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.204+0000 7fde0d7a2640 1 -- 172.21.15.66:0/2889552269 >> v1:172.21.15.66:6789/0 conn(0x7fde0815d650 legacy=0x7fde080cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.204+0000 7fde0d7a2640 1 -- 172.21.15.66:0/2889552269 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde080ce810 con 0x7fde080d3980 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.204+0000 7fde0d7a2640 1 --2- 172.21.15.66:0/2889552269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde080d3980 0x7fde080cfc50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fde0806d200 tx=0x7fde0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87ddd11bc85ee3b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde0cfa1640 1 -- 172.21.15.66:0/2889552269 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04037070 con 0x7fde080d3980 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde0cfa1640 1 -- 172.21.15.66:0/2889552269 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde04032440 con 0x7fde080d3980 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde0cfa1640 1 -- 172.21.15.66:0/2889552269 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04032810 con 0x7fde080d3980 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 -- 172.21.15.66:0/2889552269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde080d3980 msgr2=0x7fde080cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 --2- 172.21.15.66:0/2889552269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde080d3980 0x7fde080cfc50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fde0806d200 tx=0x7fde0402a270 comp rx=0 tx=0).stop 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 -- 172.21.15.66:0/2889552269 shutdown_connections 2024-05-10T11:16:45.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 --2- 172.21.15.66:0/2889552269 >> v2:172.21.15.190:3300/0 conn(0x7fde080b43a0 0x7fde080b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 --2- 172.21.15.66:0/2889552269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde080d3980 0x7fde080cfc50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 -- 172.21.15.66:0/2889552269 >> 172.21.15.66:0/2889552269 conn(0x7fde080d2df0 msgr2=0x7fde080d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 -- 172.21.15.66:0/2889552269 shutdown_connections 2024-05-10T11:16:45.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.205+0000 7fde10207640 1 -- 172.21.15.66:0/2889552269 wait complete. 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.206+0000 7fde10207640 1 Processor -- start 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.206+0000 7fde10207640 1 -- start start 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde10207640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde080b43a0 0x7fde0814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde10207640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde080d3980 0x7fde081f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde10207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 0x7fde080703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde10207640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde080d0190 con 0x7fde0815d650 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde10207640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde080cedd0 con 0x7fde080d3980 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde10207640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fde080b26a0 con 0x7fde080b43a0 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde0e7a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 0x7fde080703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde0e7a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 0x7fde080703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57432/0 (socket says 172.21.15.66:57432) 2024-05-10T11:16:45.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde0e7a4640 1 -- 172.21.15.66:0/3615293858 learned_addr learned my addr 172.21.15.66:0/3615293858 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde0dfa3640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde080b43a0 0x7fde0814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.207+0000 7fde0d7a2640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde080d3980 0x7fde081f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde0e7a4640 1 -- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde080b43a0 msgr2=0x7fde0814c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde0e7a4640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde080b43a0 0x7fde0814c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde0e7a4640 1 -- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde080d3980 msgr2=0x7fde081f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde0e7a4640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde080d3980 0x7fde081f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde0e7a4640 1 -- 172.21.15.66:0/3615293858 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0814c9f0 con 0x7fde0815d650 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde0e7a4640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 0x7fde080703f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fde0000efc0 tx=0x7fde0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00018020 con 0x7fde0815d650 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde00014480 con 0x7fde0815d650 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde081f7080 con 0x7fde0815d650 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00014870 con 0x7fde0815d650 2024-05-10T11:16:45.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.208+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde080c92b0 con 0x7fde0815d650 2024-05-10T11:16:45.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.209+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0806a220 con 0x7fde0815d650 2024-05-10T11:16:45.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.210+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde00005d10 con 0x7fde0815d650 2024-05-10T11:16:45.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.210+0000 7fddfe7fc640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddec0762d0 0x7fddec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:45.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.211+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fde00098490 con 0x7fde0815d650 2024-05-10T11:16:45.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.211+0000 7fde0dfa3640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddec0762d0 0x7fddec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:45.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.211+0000 7fde0dfa3640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddec0762d0 0x7fddec078790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fddf8007fd0 tx=0x7fddf8007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:45.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.215+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fde00022030 con 0x7fde0815d650 2024-05-10T11:16:45.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.443+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fde08075140 con 0x7fde0815d650 2024-05-10T11:16:45.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.444+0000 7fddfe7fc640 1 -- 172.21.15.66:0/3615293858 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7fde0814c9f0 con 0x7fde0815d650 2024-05-10T11:16:45.444 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:16:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.445+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddec0762d0 msgr2=0x7fddec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.445+0000 7fde10207640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddec0762d0 0x7fddec078790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fddf8007fd0 tx=0x7fddf8007e80 comp rx=0 tx=0).stop 2024-05-10T11:16:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 msgr2=0x7fde080703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 0x7fde080703f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fde0000efc0 tx=0x7fde0000c490 comp rx=0 tx=0).stop 2024-05-10T11:16:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 shutdown_connections 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddec0762d0 0x7fddec078790 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde0815d650 0x7fde080703f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde080d3980 0x7fde081f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 --2- 172.21.15.66:0/3615293858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde080b43a0 0x7fde0814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 >> 172.21.15.66:0/3615293858 conn(0x7fde080d2df0 msgr2=0x7fde08075a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 shutdown_connections 2024-05-10T11:16:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45.446+0000 7fde10207640 1 -- 172.21.15.66:0/3615293858 wait complete. 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:16:45.457 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:16:45.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:45.457 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:16:45.474 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:16:45.475 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:45.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:45.476 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:16:45.538 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:16:45.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:45.540 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:16:45.597 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:16:45.597 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:16:45.597 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:16:45.597 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:16:45.597 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:16:45.597 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:16:45.597 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:16:45.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:16:45.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:16:45.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:16:45.598 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:16:45.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:16:45.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:16:45.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:45.727 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:16:45.743 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:16:45.743 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:16:45.743 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:16:45.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:45.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:16:45.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:16:45.809 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:45.865 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:16:45.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:16:45.865 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:45.921 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:16:45.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:45.921 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:46.006 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:46.006 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:16:46.006 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:16:46.015 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:46.015 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:16:46.015 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:16:46.015 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:16:46.015 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:16:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:16:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:16:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:16:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:16:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:16:46.021 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:16:46.023 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:16:46.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:46.023 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:46.049 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:16:46.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:16:46.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:16:46.152 INFO:teuthology.orchestra.run.smithi066.stdout:client5480 2024-05-10T11:16:46.152 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:46.152 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:46.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:46.169 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-05-10T11:16:46.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:46.230 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-05-10T11:16:46.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:46.287 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-05-10T11:16:46.344 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:16:46.344 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:16:46.344 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:16:46.344 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:16:46.344 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-05-10T11:16:46.344 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:16:46.452 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:16:46.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:16:46.461 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:46.461 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:46.518 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:46.518 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:46.574 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:16:46.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 Processor -- start 2024-05-10T11:16:46.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 -- start start 2024-05-10T11:16:46.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b7c15f3b0 0x7f1b7c0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:46.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c0d5d30 0x7f1b7c0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c0d30b0 con 0x7f1b7c15f790 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0d3390 con 0x7f1b7c15f3b0 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.718+0000 7f1b81371640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c8c80 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b7c15f3b0 0x7f1b7c0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7a7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1b7c15f790 0x7f1b7c0c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54752/0 (socket says 172.21.15.66:54752) 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7a7fc640 1 -- 172.21.15.66:0/1908248201 learned_addr learned my addr 172.21.15.66:0/1908248201 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b7c15f3b0 0x7f1b7c0d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57434/0 (socket says 172.21.15.66:57434) 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7b7fe640 1 --2- 172.21.15.66:0/1908248201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c0d5d30 0x7f1b7c0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7affd640 1 -- 172.21.15.66:0/1908248201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c0d5d30 msgr2=0x7f1b7c0d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7affd640 1 --2- 172.21.15.66:0/1908248201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c0d5d30 0x7f1b7c0d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7affd640 1 -- 172.21.15.66:0/1908248201 >> v1:172.21.15.66:6789/0 conn(0x7f1b7c15f790 legacy=0x7f1b7c0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b79ffb640 1 -- 172.21.15.66:0/1908248201 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623832968 0 0) 0x7f1b7c0d30b0 con 0x7f1b7c15f790 2024-05-10T11:16:46.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.719+0000 7f1b7affd640 1 -- 172.21.15.66:0/1908248201 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0c8f60 con 0x7f1b7c15f3b0 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b7affd640 1 --2- 172.21.15.66:0/1908248201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c15f3b0 0x7f1b7c0d36f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0097a0 tx=0x7f1b6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afb0a1082b81a11 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b79ffb640 1 -- 172.21.15.66:0/1908248201 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c037070 con 0x7f1b7c15f3b0 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b79ffb640 1 -- 172.21.15.66:0/1908248201 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c032440 con 0x7f1b7c15f3b0 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b79ffb640 1 -- 172.21.15.66:0/1908248201 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c032810 con 0x7f1b7c15f3b0 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 -- 172.21.15.66:0/1908248201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c15f3b0 msgr2=0x7f1b7c0d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 --2- 172.21.15.66:0/1908248201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c15f3b0 0x7f1b7c0d36f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0097a0 tx=0x7f1b6c02a180 comp rx=0 tx=0).stop 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 -- 172.21.15.66:0/1908248201 shutdown_connections 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 --2- 172.21.15.66:0/1908248201 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c0d5d30 0x7f1b7c0d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 --2- 172.21.15.66:0/1908248201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c15f3b0 0x7f1b7c0d36f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 -- 172.21.15.66:0/1908248201 >> 172.21.15.66:0/1908248201 conn(0x7f1b7c0d5130 msgr2=0x7f1b7c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:46.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 -- 172.21.15.66:0/1908248201 shutdown_connections 2024-05-10T11:16:46.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.720+0000 7f1b81371640 1 -- 172.21.15.66:0/1908248201 wait complete. 2024-05-10T11:16:46.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 Processor -- start 2024-05-10T11:16:46.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 -- start start 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 0x7f1b7c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c15f3b0 0x7f1b7c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b7c15b870 0x7f1b7c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0d0e60 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0d0ce0 con 0x7f1b7c15b870 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.722+0000 7f1b81371640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c0d0fe0 con 0x7f1b7c15f3b0 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 0x7f1b7c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 0x7f1b7c1556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57450/0 (socket says 172.21.15.66:57450) 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 -- 172.21.15.66:0/1318858083 learned_addr learned my addr 172.21.15.66:0/1318858083 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:46.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 -- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c15f3b0 msgr2=0x7f1b7c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c15f3b0 0x7f1b7c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 -- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b7c15b870 msgr2=0x7f1b7c156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7b7fe640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b7c15b870 0x7f1b7c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b7c15b870 0x7f1b7c156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 -- 172.21.15.66:0/1318858083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0cc3a0 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b7affd640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 0x7f1b7c1556b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0098c0 tx=0x7f1b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c037040 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c042070 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c0cc680 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c030bb0 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.723+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c0ccc40 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.724+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7c06a220 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.725+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b6c047460 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.725+0000 7f1b637fe640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b680762d0 0x7f1b68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:46.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.726+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f1b6c0b8220 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.726+0000 7f1b7a7fc640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b680762d0 0x7f1b68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:46.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.726+0000 7f1b7a7fc640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b680762d0 0x7f1b68078790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007fd0 tx=0x7f1b70007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:46.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.730+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1b6c032e20 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.934+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b7c0d25e0 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.934+0000 7f1b637fe640 1 -- 172.21.15.66:0/1318858083 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7f1b6c081a80 con 0x7f1b7c0d5d30 2024-05-10T11:16:46.935 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:16:46.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b680762d0 msgr2=0x7f1b68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:46.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b680762d0 0x7f1b68078790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007fd0 tx=0x7f1b70007960 comp rx=0 tx=0).stop 2024-05-10T11:16:46.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 msgr2=0x7f1b7c1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 0x7f1b7c1556b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0098c0 tx=0x7f1b6c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 shutdown_connections 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b680762d0 0x7f1b68078790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b7c15b870 0x7f1b7c156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b7c15f3b0 0x7f1b7c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 --2- 172.21.15.66:0/1318858083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b7c0d5d30 0x7f1b7c1556b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 >> 172.21.15.66:0/1318858083 conn(0x7f1b7c0d5130 msgr2=0x7f1b7c0ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 shutdown_connections 2024-05-10T11:16:46.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:46.937+0000 7f1b81371640 1 -- 172.21.15.66:0/1318858083 wait complete. 2024-05-10T11:16:46.948 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:16:46.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:46.948 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:46.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:16:46.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:46.991 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:16:47.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 Processor -- start 2024-05-10T11:16:47.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 -- start start 2024-05-10T11:16:47.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f51440d5cb0 0x7f51440d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51440d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51440b45f0 con 0x7f5144162750 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f51440b4f20 con 0x7f51440d5cb0 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.192+0000 7f51492d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f51440d0fe0 con 0x7f5144162b30 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51437fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51440d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f51440d5cb0 0x7f51440d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f51440d5cb0 0x7f51440d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:51580/0 (socket says 172.21.15.66:51580) 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 -- 172.21.15.66:0/2521566005 learned_addr learned my addr 172.21.15.66:0/2521566005 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 -- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 msgr2=0x7f51440d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 --2- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51440d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 -- 172.21.15.66:0/2521566005 >> v1:172.21.15.190:6789/0 conn(0x7f5144162750 legacy=0x7f51440d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51427fc640 1 -- 172.21.15.66:0/2521566005 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51440b48d0 con 0x7f51440d5cb0 2024-05-10T11:16:47.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.193+0000 7f51437fe640 1 --2- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51440d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.194+0000 7f51427fc640 1 --2- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51440d5cb0 0x7f51440d3630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f513802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694e4be381790e86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.194+0000 7f5141ffb640 1 -- 172.21.15.66:0/2521566005 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138037070 con 0x7f51440d5cb0 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.194+0000 7f5141ffb640 1 -- 172.21.15.66:0/2521566005 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5138032440 con 0x7f51440d5cb0 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.194+0000 7f5141ffb640 1 -- 172.21.15.66:0/2521566005 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138032810 con 0x7f51440d5cb0 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 -- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51440d5cb0 msgr2=0x7f51440d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 --2- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51440d5cb0 0x7f51440d3630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f513802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 -- 172.21.15.66:0/2521566005 shutdown_connections 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 --2- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51440d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 --2- 172.21.15.66:0/2521566005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51440d5cb0 0x7f51440d3630 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 -- 172.21.15.66:0/2521566005 >> 172.21.15.66:0/2521566005 conn(0x7f514409e3b0 msgr2=0x7f51440d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 -- 172.21.15.66:0/2521566005 shutdown_connections 2024-05-10T11:16:47.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.195+0000 7f51492d1640 1 -- 172.21.15.66:0/2521566005 wait complete. 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.196+0000 7f51492d1640 1 Processor -- start 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.196+0000 7f51492d1640 1 -- start start 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51492d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144162750 0x7f51440cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51492d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51441583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51492d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51440ca550 0x7f51440b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51492d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f51440b53b0 con 0x7f51440ca550 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51492d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f51440d0d80 con 0x7f5144162750 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51492d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f51440b5530 con 0x7f5144162b30 2024-05-10T11:16:47.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51440ca550 0x7f51440b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f5142ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144162750 0x7f51440cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51440ca550 0x7f51440b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57460/0 (socket says 172.21.15.66:57460) 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51437fe640 1 -- 172.21.15.66:0/2909476367 learned_addr learned my addr 172.21.15.66:0/2909476367 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f51427fc640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51441583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f5142ffd640 1 -- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 msgr2=0x7f51441583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f5142ffd640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51441583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f5142ffd640 1 -- 172.21.15.66:0/2909476367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51440ca550 msgr2=0x7f51440b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f5142ffd640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51440ca550 0x7f51440b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.197+0000 7f5142ffd640 1 -- 172.21.15.66:0/2909476367 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51441588e0 con 0x7f5144162750 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.198+0000 7f5142ffd640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144162750 0x7f51440cb680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f513400c370 tx=0x7f513400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.198+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340052d0 con 0x7f5144162750 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.198+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5134005490 con 0x7f5144162750 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.198+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51441590a0 con 0x7f5144162750 2024-05-10T11:16:47.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.198+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134007260 con 0x7f5144162750 2024-05-10T11:16:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.198+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5144159660 con 0x7f5144162750 2024-05-10T11:16:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.199+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514406a220 con 0x7f5144162750 2024-05-10T11:16:47.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.200+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5134007400 con 0x7f5144162750 2024-05-10T11:16:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.200+0000 7f512b7fe640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f51300762d0 0x7f5130078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.201+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f5134097080 con 0x7f5144162750 2024-05-10T11:16:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.201+0000 7f51427fc640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f51300762d0 0x7f5130078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.201+0000 7f51427fc640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f51300762d0 0x7f5130078790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5138034000 tx=0x7f513802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:47.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.204+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5134039020 con 0x7f5144162750 2024-05-10T11:16:47.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.434+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51441f8d80 con 0x7f5144162750 2024-05-10T11:16:47.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.435+0000 7f512b7fe640 1 -- 172.21.15.66:0/2909476367 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5186 (secure 0 0 0) 0x7f5134060160 con 0x7f5144162750 2024-05-10T11:16:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:47.435 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:37.237701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/1361798984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1361798984},{"type":"v1","addr":"172.21.15.66:6835","nonce":1361798984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6276,"qdb_cluster":[6276]},"id":5}]} 2024-05-10T11:16:47.436 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 46 2024-05-10T11:16:47.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f51300762d0 msgr2=0x7f5130078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f51300762d0 0x7f5130078790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5138034000 tx=0x7f513802e000 comp rx=0 tx=0).stop 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144162750 msgr2=0x7f51440cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144162750 0x7f51440cb680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f513400c370 tx=0x7f513400c830 comp rx=0 tx=0).stop 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 shutdown_connections 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f51300762d0 0x7f5130078790 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51440ca550 0x7f51440b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5144162b30 0x7f51441583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 --2- 172.21.15.66:0/2909476367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144162750 0x7f51440cb680 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 >> 172.21.15.66:0/2909476367 conn(0x7f514409e3b0 msgr2=0x7f51440b6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 shutdown_connections 2024-05-10T11:16:47.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.437+0000 7f51492d1640 1 -- 172.21.15.66:0/2909476367 wait complete. 2024-05-10T11:16:47.448 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-10T11:16:47.585 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:16:47.586 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:16:47.586 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:16:47.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.690+0000 7f5321132640 1 Processor -- start 2024-05-10T11:16:47.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.690+0000 7f5321132640 1 -- start start 2024-05-10T11:16:47.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f5321132640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f531c162750 0x7f531c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f5321132640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f531c0d5cb0 0x7f531c0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f5321132640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c0b45f0 con 0x7f531c162b30 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f5321132640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0b4f20 con 0x7f531c162750 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f5321132640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0d0fe0 con 0x7f531c0d5cb0 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f531c162750 0x7f531c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f531c162750 0x7f531c0d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57468/0 (socket says 172.21.15.66:57468) 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 -- 172.21.15.66:0/597816599 learned_addr learned my addr 172.21.15.66:0/597816599 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531a59c640 1 --2- 172.21.15.66:0/597816599 >> v2:172.21.15.190:3300/0 conn(0x7f531c0d5cb0 0x7f531c0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 -- 172.21.15.66:0/597816599 >> v2:172.21.15.190:3300/0 conn(0x7f531c0d5cb0 msgr2=0x7f531c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 --2- 172.21.15.66:0/597816599 >> v2:172.21.15.190:3300/0 conn(0x7f531c0d5cb0 0x7f531c0d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 -- 172.21.15.66:0/597816599 >> v1:172.21.15.190:6789/0 conn(0x7f531c162b30 legacy=0x7f531c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.691+0000 7f531ad9d640 1 -- 172.21.15.66:0/597816599 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0b48d0 con 0x7f531c162750 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.692+0000 7f531ad9d640 1 --2- 172.21.15.66:0/597816599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162750 0x7f531c0d0670 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f531c0b4e90 tx=0x7f530c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d4244a6a19122 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.692+0000 7f5319d9b640 1 -- 172.21.15.66:0/597816599 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c037070 con 0x7f531c162750 2024-05-10T11:16:47.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.692+0000 7f5319d9b640 1 -- 172.21.15.66:0/597816599 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c032440 con 0x7f531c162750 2024-05-10T11:16:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.692+0000 7f5319d9b640 1 -- 172.21.15.66:0/597816599 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c032810 con 0x7f531c162750 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 -- 172.21.15.66:0/597816599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162750 msgr2=0x7f531c0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 --2- 172.21.15.66:0/597816599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162750 0x7f531c0d0670 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f531c0b4e90 tx=0x7f530c02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 -- 172.21.15.66:0/597816599 shutdown_connections 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 --2- 172.21.15.66:0/597816599 >> v2:172.21.15.190:3300/0 conn(0x7f531c0d5cb0 0x7f531c0d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 --2- 172.21.15.66:0/597816599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162750 0x7f531c0d0670 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 -- 172.21.15.66:0/597816599 >> 172.21.15.66:0/597816599 conn(0x7f531c09e3b0 msgr2=0x7f531c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 -- 172.21.15.66:0/597816599 shutdown_connections 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.693+0000 7f5321132640 1 -- 172.21.15.66:0/597816599 wait complete. 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.694+0000 7f5321132640 1 Processor -- start 2024-05-10T11:16:47.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.694+0000 7f5321132640 1 -- start start 2024-05-10T11:16:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f5321132640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f531c162750 0x7f531c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f5321132640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 0x7f531c15d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f5321132640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f531c15da80 0x7f531c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f5321132640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0d0d30 con 0x7f531c162b30 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f5321132640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0d0bb0 con 0x7f531c15da80 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f5321132640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f531c0b63c0 con 0x7f531c162750 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f531a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 0x7f531c15d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f531a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 0x7f531c15d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57480/0 (socket says 172.21.15.66:57480) 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f531a59c640 1 -- 172.21.15.66:0/2411425223 learned_addr learned my addr 172.21.15.66:0/2411425223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f531ad9d640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f531c162750 0x7f531c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.695+0000 7f531b59e640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f531c15da80 0x7f531c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f531a59c640 1 -- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f531c162750 msgr2=0x7f531c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f531a59c640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f531c162750 0x7f531c0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f531a59c640 1 -- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f531c15da80 msgr2=0x7f531c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f531a59c640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f531c15da80 0x7f531c15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f531a59c640 1 -- 172.21.15.66:0/2411425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c15dff0 con 0x7f531c162b30 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f531a59c640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 0x7f531c15d540 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f531000d830 tx=0x7f531000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531000b6c0 con 0x7f531c162b30 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5310019070 con 0x7f531c162b30 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c15e2d0 con 0x7f531c162b30 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531000baa0 con 0x7f531c162b30 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.696+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c157860 con 0x7f531c162b30 2024-05-10T11:16:47.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.697+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c06a220 con 0x7f531c162b30 2024-05-10T11:16:47.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.698+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f531001e460 con 0x7f531c162b30 2024-05-10T11:16:47.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.698+0000 7f53037fe640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f53080762d0 0x7f5308078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:47.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.699+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f5310097db0 con 0x7f531c162b30 2024-05-10T11:16:47.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.699+0000 7f531ad9d640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f53080762d0 0x7f5308078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:47.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.699+0000 7f531ad9d640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f53080762d0 0x7f5308078790 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:47.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.703+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5310061610 con 0x7f531c162b30 2024-05-10T11:16:47.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.933+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f531c0d1aa0 con 0x7f531c162b30 2024-05-10T11:16:47.933 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:16:47.933+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:16:47.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.936+0000 7f53037fe640 1 -- 172.21.15.66:0/2411425223 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7f5310060f10 con 0x7f531c162b30 2024-05-10T11:16:47.937 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:16:47.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f53080762d0 msgr2=0x7f5308078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f53080762d0 0x7f5308078790 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).stop 2024-05-10T11:16:47.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 msgr2=0x7f531c15d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 0x7f531c15d540 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f531000d830 tx=0x7f531000dcf0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 shutdown_connections 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f53080762d0 0x7f5308078790 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f531c15da80 0x7f531c15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f531c162b30 0x7f531c15d540 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 --2- 172.21.15.66:0/2411425223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f531c162750 0x7f531c0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 >> 172.21.15.66:0/2411425223 conn(0x7f531c09e3b0 msgr2=0x7f531c06e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 shutdown_connections 2024-05-10T11:16:47.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:47.939+0000 7f5321132640 1 -- 172.21.15.66:0/2411425223 wait complete. 2024-05-10T11:16:47.943 INFO:tasks.ceph.mds.a.smithi066.stderr: -4621> 2024-05-10T11:16:39.806+0000 7fab975fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:16:47.953 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-05-10T11:16:47.977 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:16:48.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.001+0000 7f7d0ed71f40 1 Processor -- start 2024-05-10T11:16:48.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.001+0000 7f7d0ed71f40 1 -- start start 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0ed71f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 0x55dc10621d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0ed71f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc10624250 0x55dc10627450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0ed71f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624630 0x55dc10625e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0ed71f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dc1059b850 con 0x55dc1059a560 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0ed71f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dc1059b570 con 0x55dc10624250 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0ed71f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dc1059bb30 con 0x55dc10624630 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 0x55dc10621d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 0x55dc10621d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57534/0 (socket says 172.21.15.66:57534) 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 -- 172.21.15.66:0/4003824592 learned_addr learned my addr 172.21.15.66:0/4003824592 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:48.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d07fff640 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc10624250 0x55dc10627450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0d06e640 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624630 0x55dc10625e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 -- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624630 msgr2=0x55dc10625e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624630 0x55dc10625e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 -- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc10624250 msgr2=0x55dc10627450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc10624250 0x55dc10627450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 -- 172.21.15.66:0/4003824592 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc104d6350 con 0x55dc1059a560 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d07fff640 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc10624250 0x55dc10627450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.002+0000 7f7d0c86d640 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 0x55dc10621d40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009760 tx=0x7f7d00009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab655e986acb5a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d06ffd640 1 -- 172.21.15.66:0/4003824592 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00017070 con 0x55dc1059a560 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d06ffd640 1 -- 172.21.15.66:0/4003824592 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d000090d0 con 0x55dc1059a560 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d06ffd640 1 -- 172.21.15.66:0/4003824592 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00006b60 con 0x55dc1059a560 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/4003824592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 msgr2=0x55dc10621d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 0x55dc10621d40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009760 tx=0x7f7d00009c20 comp rx=0 tx=0).stop 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/4003824592 shutdown_connections 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624630 0x55dc10625e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc10624250 0x55dc10627450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/4003824592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc1059a560 0x55dc10621d40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/4003824592 >> 172.21.15.66:0/4003824592 conn(0x55dc1056c7d0 msgr2=0x55dc1056cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/4003824592 shutdown_connections 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.003+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/4003824592 wait complete. 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 Processor -- start 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 -- start start 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc1059a560 0x55dc105989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624250 0x55dc10627430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc10624630 0x55dc10643430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dc10627990 con 0x55dc10624630 2024-05-10T11:16:48.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dc1063b0b0 con 0x55dc1059a560 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.004+0000 7f7d0ed71f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55dc105b6470 con 0x55dc10624250 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc10624630 0x55dc10643430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc10624630 0x55dc10643430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57544/0 (socket says 172.21.15.66:57544) 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 -- 172.21.15.66:0/3256610897 learned_addr learned my addr 172.21.15.66:0/3256610897 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0c86d640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc1059a560 0x55dc105989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d07fff640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624250 0x55dc10627430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 -- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624250 msgr2=0x55dc10627430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55dc10624250 0x55dc10627430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 -- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc1059a560 msgr2=0x55dc105989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc1059a560 0x55dc105989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 -- 172.21.15.66:0/3256610897 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc10643970 con 0x55dc10624630 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0d06e640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc10624630 0x55dc10643430 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800b450 tx=0x7f7d0800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d05ffb640 1 -- 172.21.15.66:0/3256610897 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08017020 con 0x55dc10624630 2024-05-10T11:16:48.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d05ffb640 1 -- 172.21.15.66:0/3256610897 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d08012660 con 0x55dc10624630 2024-05-10T11:16:48.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d05ffb640 1 -- 172.21.15.66:0/3256610897 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08012a50 con 0x55dc10624630 2024-05-10T11:16:48.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc106d1bf0 con 0x55dc10624630 2024-05-10T11:16:48.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.005+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc10642c30 con 0x55dc10624630 2024-05-10T11:16:48.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.007+0000 7f7d05ffb640 1 -- 172.21.15.66:0/3256610897 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d0801a020 con 0x55dc10624630 2024-05-10T11:16:48.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.007+0000 7f7d05ffb640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf0074ce0 0x7f7cf00771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.007+0000 7f7d05ffb640 1 -- 172.21.15.66:0/3256610897 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f7d08096830 con 0x55dc10624630 2024-05-10T11:16:48.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.007+0000 7f7d0c86d640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf0074ce0 0x7f7cf00771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.008+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55dc10625370 0x55dc106dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.008+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77) -- 0x55dc106db4e0 con 0x55dc10625370 2024-05-10T11:16:48.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.008+0000 7f7d07fff640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55dc10625370 0x55dc106dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.008+0000 7f7d07fff640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55dc10625370 0x55dc106dafa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.008+0000 7f7d0c86d640 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf0074ce0 0x7f7cf00771a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7d00015040 tx=0x7f7d0000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d07fff640 1 -- 172.21.15.66:0/3256610897 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v77'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7cf8058030 con 0x55dc10625370 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55dc10625370 msgr2=0x55dc106dafa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55dc10625370 0x55dc106dafa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf0074ce0 msgr2=0x7f7cf00771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7cf0074ce0 0x7f7cf00771a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7d00015040 tx=0x7f7d0000f000 comp rx=0 tx=0).stop 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc10624630 msgr2=0x55dc10643430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 --2- 172.21.15.66:0/3256610897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dc10624630 0x55dc10643430 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800b450 tx=0x7f7d0800b910 comp rx=0 tx=0).stop 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0d06e640 1 -- 172.21.15.66:0/3256610897 reap_dead start 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 shutdown_connections 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 >> 172.21.15.66:0/3256610897 conn(0x55dc1056c7d0 msgr2=0x55dc1056cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:48.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.009+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 shutdown_connections 2024-05-10T11:16:48.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.010+0000 7f7d0ed71f40 1 -- 172.21.15.66:0/3256610897 wait complete. 2024-05-10T11:16:48.015 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T11:16:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.160+0000 7f65b86a0640 1 Processor -- start 2024-05-10T11:16:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.160+0000 7f65b86a0640 1 -- start start 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b86a0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65b00cb580 0x7f65b00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b86a0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65b006e3b0 0x7f65b006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b86a0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b00cf3d0 con 0x7f65b0159340 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b86a0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f65b00cbf20 con 0x7f65b00cb580 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b86a0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f65b0159720 con 0x7f65b006e3b0 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b5c3b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65b00cb580 0x7f65b00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b643c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f65b0159340 0x7f65b00ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54774/0 (socket says 172.21.15.66:54774) 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b643c640 1 -- 172.21.15.66:0/543813440 learned_addr learned my addr 172.21.15.66:0/543813440 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b6c3d640 1 --2- 172.21.15.66:0/543813440 >> v2:172.21.15.190:3300/0 conn(0x7f65b006e3b0 0x7f65b006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b5c3b640 1 -- 172.21.15.66:0/543813440 >> v2:172.21.15.190:3300/0 conn(0x7f65b006e3b0 msgr2=0x7f65b006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b5c3b640 1 --2- 172.21.15.66:0/543813440 >> v2:172.21.15.190:3300/0 conn(0x7f65b006e3b0 0x7f65b006e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b5c3b640 1 -- 172.21.15.66:0/543813440 >> v1:172.21.15.66:6789/0 conn(0x7f65b0159340 legacy=0x7f65b00ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b5c3b640 1 -- 172.21.15.66:0/543813440 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00cf6b0 con 0x7f65b00cb580 2024-05-10T11:16:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.161+0000 7f65b543a640 1 -- 172.21.15.66:0/543813440 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898881933 0 0) 0x7f65b00cf3d0 con 0x7f65b0159340 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.162+0000 7f65b5c3b640 1 --2- 172.21.15.66:0/543813440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b00cb580 0x7f65b00cb9e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f65b00d0c40 tx=0x7f65a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b9622790d1f265 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.162+0000 7f65b543a640 1 -- 172.21.15.66:0/543813440 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0037070 con 0x7f65b00cb580 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.162+0000 7f65b543a640 1 -- 172.21.15.66:0/543813440 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0032440 con 0x7f65b00cb580 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.162+0000 7f65b543a640 1 -- 172.21.15.66:0/543813440 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0032810 con 0x7f65b00cb580 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 -- 172.21.15.66:0/543813440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b00cb580 msgr2=0x7f65b00cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 --2- 172.21.15.66:0/543813440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b00cb580 0x7f65b00cb9e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f65b00d0c40 tx=0x7f65a002a1a0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 -- 172.21.15.66:0/543813440 shutdown_connections 2024-05-10T11:16:48.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 --2- 172.21.15.66:0/543813440 >> v2:172.21.15.190:3300/0 conn(0x7f65b006e3b0 0x7f65b006e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 --2- 172.21.15.66:0/543813440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b00cb580 0x7f65b00cb9e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 -- 172.21.15.66:0/543813440 >> 172.21.15.66:0/543813440 conn(0x7f65b00d0c90 msgr2=0x7f65b00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:48.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 -- 172.21.15.66:0/543813440 shutdown_connections 2024-05-10T11:16:48.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.163+0000 7f65b86a0640 1 -- 172.21.15.66:0/543813440 wait complete. 2024-05-10T11:16:48.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.164+0000 7f65b86a0640 1 Processor -- start 2024-05-10T11:16:48.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.164+0000 7f65b86a0640 1 -- start start 2024-05-10T11:16:48.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b86a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65b006e3b0 0x7f65b015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b86a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b00cb580 0x7f65b01f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b86a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 0x7f65b01f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b86a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00cfc70 con 0x7f65b0159340 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b86a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65b006df20 con 0x7f65b00cb580 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b86a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f65b015bfd0 con 0x7f65b006e3b0 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 0x7f65b01f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 0x7f65b01f5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57568/0 (socket says 172.21.15.66:57568) 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 -- 172.21.15.66:0/2220452419 learned_addr learned my addr 172.21.15.66:0/2220452419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b5c3b640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b00cb580 0x7f65b01f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b643c640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65b006e3b0 0x7f65b015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 -- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65b006e3b0 msgr2=0x7f65b015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65b006e3b0 0x7f65b015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 -- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b00cb580 msgr2=0x7f65b01f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b00cb580 0x7f65b01f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.165+0000 7f65b6c3d640 1 -- 172.21.15.66:0/2220452419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00c7d60 con 0x7f65b0159340 2024-05-10T11:16:48.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.166+0000 7f65b6c3d640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 0x7f65b01f5bf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f65a800ec10 tx=0x7f65a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.166+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a800cd20 con 0x7f65b0159340 2024-05-10T11:16:48.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.166+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a8012430 con 0x7f65b0159340 2024-05-10T11:16:48.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.166+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8012820 con 0x7f65b0159340 2024-05-10T11:16:48.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.166+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00b60a0 con 0x7f65b0159340 2024-05-10T11:16:48.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.166+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b00c8300 con 0x7f65b0159340 2024-05-10T11:16:48.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.167+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b006a220 con 0x7f65b0159340 2024-05-10T11:16:48.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.167+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f65a8021020 con 0x7f65b0159340 2024-05-10T11:16:48.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.168+0000 7f65a6ffd640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65940762d0 0x7f6594078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:48.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.168+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f65a809a210 con 0x7f65b0159340 2024-05-10T11:16:48.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.168+0000 7f65b643c640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65940762d0 0x7f6594078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:48.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.169+0000 7f65b643c640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65940762d0 0x7f6594078790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000f60 tx=0x7f65ac007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:48.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.172+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f65a8056910 con 0x7f65b0159340 2024-05-10T11:16:48.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.403+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f65b0157590 con 0x7f65b0159340 2024-05-10T11:16:48.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.940+0000 7f65a6ffd640 1 -- 172.21.15.66:0/2220452419 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v48) ==== 162+0+0 (secure 0 0 0) 0x7f65a8063990 con 0x7f65b0159340 2024-05-10T11:16:48.941 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T11:16:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.942+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65940762d0 msgr2=0x7f6594078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.942+0000 7f65b86a0640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65940762d0 0x7f6594078790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000f60 tx=0x7f65ac007b50 comp rx=0 tx=0).stop 2024-05-10T11:16:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.942+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 msgr2=0x7f65b01f5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:48.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.942+0000 7f65b86a0640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 0x7f65b01f5bf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f65a800ec10 tx=0x7f65a800c490 comp rx=0 tx=0).stop 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 shutdown_connections 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65940762d0 0x7f6594078790 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65b0159340 0x7f65b01f5bf0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b00cb580 0x7f65b01f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 --2- 172.21.15.66:0/2220452419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65b006e3b0 0x7f65b015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 >> 172.21.15.66:0/2220452419 conn(0x7f65b00d0c90 msgr2=0x7f65b015a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 shutdown_connections 2024-05-10T11:16:48.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:48.943+0000 7f65b86a0640 1 -- 172.21.15.66:0/2220452419 wait complete. 2024-05-10T11:16:48.958 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:49.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.064+0000 7f569ffc1640 1 Processor -- start 2024-05-10T11:16:49.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.064+0000 7f569ffc1640 1 -- start start 2024-05-10T11:16:49.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569ffc1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f569815f4e0 0x7f569806d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569ffc1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56980b0a90 con 0x7f569815f8c0 2024-05-10T11:16:49.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569ffc1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56980b3540 con 0x7f569806e620 2024-05-10T11:16:49.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569ffc1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f56980b23f0 con 0x7f569815f4e0 2024-05-10T11:16:49.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569d55c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f569815f8c0 0x7f569806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54782/0 (socket says 172.21.15.66:54782) 2024-05-10T11:16:49.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569d55c640 1 -- 172.21.15.66:0/1015446326 learned_addr learned my addr 172.21.15.66:0/1015446326 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569dd5d640 1 --2- 172.21.15.66:0/1015446326 >> v2:172.21.15.190:3300/0 conn(0x7f569815f4e0 0x7f569806d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402895077 0 0) 0x7f56980b0a90 con 0x7f569815f8c0 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.065+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5684003520 con 0x7f569815f8c0 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2469807360 0 0) 0x7f5684003520 con 0x7f569815f8c0 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 >> v2:172.21.15.190:3300/0 conn(0x7f569815f4e0 msgr2=0x7f569806d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 --2- 172.21.15.66:0/1015446326 >> v2:172.21.15.190:3300/0 conn(0x7f569815f4e0 0x7f569806d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 >> v1:172.21.15.190:6789/0 conn(0x7f569806e620 legacy=0x7f56980d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56980b3820 con 0x7f569815f8c0 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f5688001670 con 0x7f569815f8c0 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569dd5d640 1 --2- 172.21.15.66:0/1015446326 >> v2:172.21.15.190:3300/0 conn(0x7f569815f4e0 0x7f569806d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 >> v1:172.21.15.66:6789/0 conn(0x7f569815f8c0 legacy=0x7f569806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56840039b0 0x7f5684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56840051c0 0x7f568400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b23f0 con 0x7f5684004800 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f568400c160 con 0x7f56840039b0 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f568400c360 con 0x7f56840051c0 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569d55c640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569dd5d640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56840039b0 0x7f5684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569e55e640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56840051c0 0x7f568400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569d55c640 1 -- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56840051c0 msgr2=0x7f568400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569d55c640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56840051c0 0x7f568400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569d55c640 1 -- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56840039b0 msgr2=0x7f5684003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569d55c640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56840039b0 0x7f5684003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569d55c640 1 -- 172.21.15.66:0/1015446326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5684003520 con 0x7f5684004800 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.066+0000 7f569e55e640 1 -- 172.21.15.66:0/1015446326 reap_dead start 2024-05-10T11:16:49.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.067+0000 7f569d55c640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5684004c80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5698073620 tx=0x7f5684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db2889b3183d209 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.067+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688007d30 con 0x7f5684004800 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.067+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5688005ad0 con 0x7f5684004800 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.067+0000 7f569cd5b640 1 -- 172.21.15.66:0/1015446326 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688007070 con 0x7f5684004800 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 -- 172.21.15.66:0/1015446326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 msgr2=0x7f5684004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5684004c80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5698073620 tx=0x7f5684005830 comp rx=0 tx=0).stop 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 -- 172.21.15.66:0/1015446326 shutdown_connections 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 --2- 172.21.15.66:0/1015446326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5684004c80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 -- 172.21.15.66:0/1015446326 >> 172.21.15.66:0/1015446326 conn(0x7f56980d2df0 msgr2=0x7f56980d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 -- 172.21.15.66:0/1015446326 shutdown_connections 2024-05-10T11:16:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.068+0000 7f569ffc1640 1 -- 172.21.15.66:0/1015446326 wait complete. 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.069+0000 7f569ffc1640 1 Processor -- start 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.069+0000 7f569ffc1640 1 -- start start 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5698152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56980c82b0 0x7f569809efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56980c8730 0x7f569809f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b3de0 con 0x7f5684004800 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b4150 con 0x7f56980c8730 2024-05-10T11:16:49.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f56980b45e0 con 0x7f56980c82b0 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5698152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5698152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57582/0 (socket says 172.21.15.66:57582) 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 -- 172.21.15.66:0/526252192 learned_addr learned my addr 172.21.15.66:0/526252192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569d55c640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56980c82b0 0x7f569809efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569e55e640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56980c8730 0x7f569809f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 -- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56980c82b0 msgr2=0x7f569809efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56980c82b0 0x7f569809efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 -- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56980c8730 msgr2=0x7f569809f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56980c8730 0x7f569809f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 -- 172.21.15.66:0/526252192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56980c8d00 con 0x7f5684004800 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569d55c640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56980c82b0 0x7f569809efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569dd5d640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5698152d00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5694011d00 tx=0x7f569400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:49.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569400fd20 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5694004020 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56980c8fe0 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5694004410 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.070+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569809cff0 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.071+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569806a220 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.072+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5694012040 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.073+0000 7f568e7fc640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f567c076300 0x7f567c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.073+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f5694097df0 con 0x7f5684004800 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.073+0000 7f569d55c640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f567c076300 0x7f567c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:49.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.073+0000 7f569d55c640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f567c076300 0x7f567c0787c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5688032000 tx=0x7f568802d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:49.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.077+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5694019030 con 0x7f5684004800 2024-05-10T11:16:49.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.304+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f569806db30 con 0x7f5684004800 2024-05-10T11:16:49.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.304+0000 7f568e7fc640 1 -- 172.21.15.66:0/526252192 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5177 (secure 0 0 0) 0x7f5694061570 con 0x7f5684004800 2024-05-10T11:16:49.305 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:49.305 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:48.943744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:replay","state_seq":1,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-05-10T11:16:49.305 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 49 2024-05-10T11:16:49.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.306+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f567c076300 msgr2=0x7f567c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.306+0000 7f569ffc1640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f567c076300 0x7f567c0787c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5688032000 tx=0x7f568802d000 comp rx=0 tx=0).stop 2024-05-10T11:16:49.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.306+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 msgr2=0x7f5698152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:49.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.306+0000 7f569ffc1640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5698152d00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5694011d00 tx=0x7f569400f610 comp rx=0 tx=0).stop 2024-05-10T11:16:49.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 shutdown_connections 2024-05-10T11:16:49.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f567c076300 0x7f567c0787c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56980c8730 0x7f569809f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56980c82b0 0x7f569809efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 --2- 172.21.15.66:0/526252192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5684004800 0x7f5698152d00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:49.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 >> 172.21.15.66:0/526252192 conn(0x7f56980d2df0 msgr2=0x7f569815e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:49.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 shutdown_connections 2024-05-10T11:16:49.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:49.307+0000 7f569ffc1640 1 -- 172.21.15.66:0/526252192 wait complete. 2024-05-10T11:16:49.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:16:34.212384+0000', 'modified': '2024-05-10T11:16:48.943744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 77, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6444}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6444': {'gid': 6444, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/629825148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 629825148}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 629825148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:16:49.721 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6444:up:replay 2024-05-10T11:16:50.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:50.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.839+0000 7f8bddb78640 1 Processor -- start 2024-05-10T11:16:50.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.839+0000 7f8bddb78640 1 -- start start 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bddb78640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8bd815f3b0 0x7f8bd80d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bddb78640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8bd80d5d30 0x7f8bd80d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bddb78640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bd80d30b0 con 0x7f8bd815f790 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bddb78640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd80d3390 con 0x7f8bd815f3b0 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bddb78640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd80c8c80 con 0x7f8bd80d5d30 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8bd815f3b0 0x7f8bd80d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8bd815f3b0 0x7f8bd80d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57594/0 (socket says 172.21.15.66:57594) 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 -- 172.21.15.66:0/3803638287 learned_addr learned my addr 172.21.15.66:0/3803638287 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd7fff640 1 --2- 172.21.15.66:0/3803638287 >> v2:172.21.15.190:3300/0 conn(0x7f8bd80d5d30 0x7f8bd80d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:50.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 -- 172.21.15.66:0/3803638287 >> v2:172.21.15.190:3300/0 conn(0x7f8bd80d5d30 msgr2=0x7f8bd80d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:50.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 --2- 172.21.15.66:0/3803638287 >> v2:172.21.15.190:3300/0 conn(0x7f8bd80d5d30 0x7f8bd80d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:50.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 -- 172.21.15.66:0/3803638287 >> v1:172.21.15.66:6789/0 conn(0x7f8bd815f790 legacy=0x7f8bd80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:50.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd77fe640 1 -- 172.21.15.66:0/3803638287 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd80c8f60 con 0x7f8bd815f3b0 2024-05-10T11:16:50.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.840+0000 7f8bd67fc640 1 -- 172.21.15.66:0/3803638287 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579058595 0 0) 0x7f8bd80d30b0 con 0x7f8bd815f790 2024-05-10T11:16:50.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.841+0000 7f8bd77fe640 1 --2- 172.21.15.66:0/3803638287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd815f3b0 0x7f8bd80d36f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8bd808d220 tx=0x7f8bc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3047ec39c2acab97 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.841+0000 7f8bd67fc640 1 -- 172.21.15.66:0/3803638287 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8037070 con 0x7f8bd815f3b0 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.841+0000 7f8bd67fc640 1 -- 172.21.15.66:0/3803638287 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc8032440 con 0x7f8bd815f3b0 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.841+0000 7f8bd67fc640 1 -- 172.21.15.66:0/3803638287 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8032810 con 0x7f8bd815f3b0 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 -- 172.21.15.66:0/3803638287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd815f3b0 msgr2=0x7f8bd80d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 --2- 172.21.15.66:0/3803638287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd815f3b0 0x7f8bd80d36f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8bd808d220 tx=0x7f8bc802a270 comp rx=0 tx=0).stop 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 -- 172.21.15.66:0/3803638287 shutdown_connections 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 --2- 172.21.15.66:0/3803638287 >> v2:172.21.15.190:3300/0 conn(0x7f8bd80d5d30 0x7f8bd80d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 --2- 172.21.15.66:0/3803638287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd815f3b0 0x7f8bd80d36f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 -- 172.21.15.66:0/3803638287 >> 172.21.15.66:0/3803638287 conn(0x7f8bd80d5130 msgr2=0x7f8bd80d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 -- 172.21.15.66:0/3803638287 shutdown_connections 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.842+0000 7f8bddb78640 1 -- 172.21.15.66:0/3803638287 wait complete. 2024-05-10T11:16:50.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.843+0000 7f8bddb78640 1 Processor -- start 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.844+0000 7f8bddb78640 1 -- start start 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.844+0000 7f8bddb78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bd80d5d30 0x7f8bd81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.844+0000 7f8bddb78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bd815f3b0 0x7f8bd81558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.844+0000 7f8bddb78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 0x7f8bd8160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.844+0000 7f8bddb78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80d0e60 con 0x7f8bd8155250 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.844+0000 7f8bddb78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80d0ce0 con 0x7f8bd80d5d30 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bddb78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd80d0fe0 con 0x7f8bd815f3b0 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 0x7f8bd8160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:50.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 0x7f8bd8160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57604/0 (socket says 172.21.15.66:57604) 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 -- 172.21.15.66:0/632939452 learned_addr learned my addr 172.21.15.66:0/632939452 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd77fe640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bd80d5d30 0x7f8bd81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd6ffd640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bd815f3b0 0x7f8bd81558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 -- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bd815f3b0 msgr2=0x7f8bd81558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bd815f3b0 0x7f8bd81558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 -- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bd80d5d30 msgr2=0x7f8bd81545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bd80d5d30 0x7f8bd81545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 -- 172.21.15.66:0/632939452 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd8156180 con 0x7f8bd8155250 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bd7fff640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 0x7f8bd8160bd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009dd0 tx=0x7f8bd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0018020 con 0x7f8bd8155250 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd0014480 con 0x7f8bd8155250 2024-05-10T11:16:50.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd81584b0 con 0x7f8bd8155250 2024-05-10T11:16:50.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0014870 con 0x7f8bd8155250 2024-05-10T11:16:50.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.845+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd8158a70 con 0x7f8bd8155250 2024-05-10T11:16:50.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.847+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd806a220 con 0x7f8bd8155250 2024-05-10T11:16:50.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.847+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8bd0005d10 con 0x7f8bd8155250 2024-05-10T11:16:50.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.848+0000 7f8bbffff640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bc4076300 0x7f8bc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:50.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.848+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f8bd0098460 con 0x7f8bd8155250 2024-05-10T11:16:50.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.848+0000 7f8bd77fe640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bc4076300 0x7f8bc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:50.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.849+0000 7f8bd77fe640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bc4076300 0x7f8bc40787c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8034000 tx=0x7f8bc802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:50.853+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8bd0022030 con 0x7f8bd8155250 2024-05-10T11:16:51.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.086+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bd80c9700 con 0x7f8bd8155250 2024-05-10T11:16:51.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.087+0000 7f8bbffff640 1 -- 172.21.15.66:0/632939452 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5177 (secure 0 0 0) 0x7f8bd0010040 con 0x7f8bd8155250 2024-05-10T11:16:51.087 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:51.087 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:49.958141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-05-10T11:16:51.088 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 51 2024-05-10T11:16:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bc4076300 msgr2=0x7f8bc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bc4076300 0x7f8bc40787c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8034000 tx=0x7f8bc802e000 comp rx=0 tx=0).stop 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 msgr2=0x7f8bd8160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 0x7f8bd8160bd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009dd0 tx=0x7f8bd000c490 comp rx=0 tx=0).stop 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 shutdown_connections 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8bc4076300 0x7f8bc40787c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd8155250 0x7f8bd8160bd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8bd815f3b0 0x7f8bd81558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 --2- 172.21.15.66:0/632939452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bd80d5d30 0x7f8bd81545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 >> 172.21.15.66:0/632939452 conn(0x7f8bd80d5130 msgr2=0x7f8bd80757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 shutdown_connections 2024-05-10T11:16:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:51.089+0000 7f8bddb78640 1 -- 172.21.15.66:0/632939452 wait complete. 2024-05-10T11:16:51.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:16:34.212384+0000', 'modified': '2024-05-10T11:16:49.958141+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 77, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6444}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6444': {'gid': 6444, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.66:6835/629825148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 629825148}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 629825148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:16:51.503 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6444:up:rejoin 2024-05-10T11:16:52.504 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:16:52.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.620+0000 7f1549ff0640 1 Processor -- start 2024-05-10T11:16:52.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.620+0000 7f1549ff0640 1 -- start start 2024-05-10T11:16:52.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1549ff0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1544162750 0x7f15440d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:52.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1549ff0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1544162b30 0x7f15440b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1549ff0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15440b45f0 con 0x7f15440d5cb0 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1549ff0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f15440b4f20 con 0x7f1544162b30 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1549ff0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f15440d0fe0 con 0x7f1544162750 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1543fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1544162b30 0x7f15440b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1542ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f15440d5cb0 0x7f15440d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54812/0 (socket says 172.21.15.66:54812) 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1542ffd640 1 -- 172.21.15.66:0/3353699577 learned_addr learned my addr 172.21.15.66:0/3353699577 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f15437fe640 1 --2- 172.21.15.66:0/3353699577 >> v2:172.21.15.190:3300/0 conn(0x7f1544162750 0x7f15440d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1543fff640 1 -- 172.21.15.66:0/3353699577 >> v2:172.21.15.190:3300/0 conn(0x7f1544162750 msgr2=0x7f15440d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1543fff640 1 --2- 172.21.15.66:0/3353699577 >> v2:172.21.15.190:3300/0 conn(0x7f1544162750 0x7f15440d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1543fff640 1 -- 172.21.15.66:0/3353699577 >> v1:172.21.15.66:6789/0 conn(0x7f15440d5cb0 legacy=0x7f15440d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f15427fc640 1 -- 172.21.15.66:0/3353699577 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975813151 0 0) 0x7f15440b45f0 con 0x7f15440d5cb0 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f1543fff640 1 -- 172.21.15.66:0/3353699577 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440b48d0 con 0x7f1544162b30 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.621+0000 7f15437fe640 1 --2- 172.21.15.66:0/3353699577 >> v2:172.21.15.190:3300/0 conn(0x7f1544162750 0x7f15440d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:52.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.622+0000 7f1543fff640 1 --2- 172.21.15.66:0/3353699577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440b53b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f15440b7c40 tx=0x7f153c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215b26adc9249c2a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:52.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.622+0000 7f15427fc640 1 -- 172.21.15.66:0/3353699577 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c007740 con 0x7f1544162b30 2024-05-10T11:16:52.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.622+0000 7f15427fc640 1 -- 172.21.15.66:0/3353699577 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c0078e0 con 0x7f1544162b30 2024-05-10T11:16:52.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.622+0000 7f15427fc640 1 -- 172.21.15.66:0/3353699577 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c007cb0 con 0x7f1544162b30 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 -- 172.21.15.66:0/3353699577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 msgr2=0x7f15440b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 --2- 172.21.15.66:0/3353699577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440b53b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f15440b7c40 tx=0x7f153c02a5f0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 -- 172.21.15.66:0/3353699577 shutdown_connections 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 --2- 172.21.15.66:0/3353699577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440b53b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 --2- 172.21.15.66:0/3353699577 >> v2:172.21.15.190:3300/0 conn(0x7f1544162750 0x7f15440d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 -- 172.21.15.66:0/3353699577 >> 172.21.15.66:0/3353699577 conn(0x7f154409e3b0 msgr2=0x7f15440d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 -- 172.21.15.66:0/3353699577 shutdown_connections 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.623+0000 7f1549ff0640 1 -- 172.21.15.66:0/3353699577 wait complete. 2024-05-10T11:16:52.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.624+0000 7f1549ff0640 1 Processor -- start 2024-05-10T11:16:52.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.624+0000 7f1549ff0640 1 -- start start 2024-05-10T11:16:52.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1549ff0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1544162750 0x7f15440b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1549ff0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1549ff0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1544157be0 0x7f15441f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1549ff0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15440d0d30 con 0x7f1544162b30 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1549ff0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15440d0bb0 con 0x7f1544162750 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1549ff0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f15440d3d40 con 0x7f1544157be0 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1542ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1542ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440ba1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57624/0 (socket says 172.21.15.66:57624) 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1542ffd640 1 -- 172.21.15.66:0/4054901990 learned_addr learned my addr 172.21.15.66:0/4054901990 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f1543fff640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1544157be0 0x7f15441f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.625+0000 7f15437fe640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1544162750 0x7f15440b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1542ffd640 1 -- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1544157be0 msgr2=0x7f15441f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1542ffd640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1544157be0 0x7f15441f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1542ffd640 1 -- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1544162750 msgr2=0x7f15440b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1542ffd640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1544162750 0x7f15440b9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1542ffd640 1 -- 172.21.15.66:0/4054901990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440b8a10 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1542ffd640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440ba1c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f153800c470 tx=0x7f153800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538018070 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15380074e0 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15440b8cf0 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538004a20 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.626+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15440cc370 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.627+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15440cc570 con 0x7f1544162b30 2024-05-10T11:16:52.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.628+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f153801b070 con 0x7f1544162b30 2024-05-10T11:16:52.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.628+0000 7f152bfff640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15300762d0 0x7f1530078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:52.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.628+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f1538096a60 con 0x7f1544162b30 2024-05-10T11:16:52.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.628+0000 7f15437fe640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15300762d0 0x7f1530078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:52.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.629+0000 7f15437fe640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15300762d0 0x7f1530078790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1534006fd0 tx=0x7f1534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:52.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.633+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f15440cc570 con 0x7f1544162b30 2024-05-10T11:16:52.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.861+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15440b59a0 con 0x7f1544162b30 2024-05-10T11:16:52.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.862+0000 7f152bfff640 1 -- 172.21.15.66:0/4054901990 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5184 (secure 0 0 0) 0x7f1538060270 con 0x7f1544162b30 2024-05-10T11:16:52.863 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:16:52.863 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:51.965511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:16:52.863 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 52 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15300762d0 msgr2=0x7f1530078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15300762d0 0x7f1530078790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1534006fd0 tx=0x7f1534008040 comp rx=0 tx=0).stop 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 msgr2=0x7f15440ba1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440ba1c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f153800c470 tx=0x7f153800c930 comp rx=0 tx=0).stop 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 shutdown_connections 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15300762d0 0x7f1530078790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1544157be0 0x7f15441f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1544162b30 0x7f15440ba1c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 --2- 172.21.15.66:0/4054901990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1544162750 0x7f15440b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 >> 172.21.15.66:0/4054901990 conn(0x7f154409e3b0 msgr2=0x7f154406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 shutdown_connections 2024-05-10T11:16:52.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:52.864+0000 7f1549ff0640 1 -- 172.21.15.66:0/4054901990 wait complete. 2024-05-10T11:16:53.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:16:34.212384+0000', 'modified': '2024-05-10T11:16:51.965511+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 77, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6444}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6444': {'gid': 6444, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6835/629825148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 629825148}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 629825148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6444, 'qdb_cluster': [6444]} 2024-05-10T11:16:53.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:16:53.279 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T11:16:53.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.384+0000 7f35b9787640 1 Processor -- start 2024-05-10T11:16:53.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.384+0000 7f35b9787640 1 -- start start 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b9787640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f35b40d3980 0x7f35b41626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b9787640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35b40d2270 0x7f35b4162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b9787640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40b6160 0x7f35b40b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b9787640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f35b40b5c30 con 0x7f35b40d2270 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b9787640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f35b40b5e80 con 0x7f35b40d3980 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b9787640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35b40d5c50 con 0x7f35b40b6160 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b27fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35b40d2270 0x7f35b4162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b27fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35b40d2270 0x7f35b4162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57626/0 (socket says 172.21.15.66:57626) 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b27fc640 1 -- 172.21.15.66:0/2550229246 learned_addr learned my addr 172.21.15.66:0/2550229246 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b37fe640 1 --2- 172.21.15.66:0/2550229246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40b6160 0x7f35b40b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.385+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/2550229246 >> v2:172.21.15.190:3300/0 conn(0x7f35b40d3980 0x7f35b41626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b27fc640 1 -- 172.21.15.66:0/2550229246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40b6160 msgr2=0x7f35b40b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b27fc640 1 --2- 172.21.15.66:0/2550229246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40b6160 0x7f35b40b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b27fc640 1 -- 172.21.15.66:0/2550229246 >> v2:172.21.15.190:3300/0 conn(0x7f35b40d3980 msgr2=0x7f35b41626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b27fc640 1 --2- 172.21.15.66:0/2550229246 >> v2:172.21.15.190:3300/0 conn(0x7f35b40d3980 0x7f35b41626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b27fc640 1 -- 172.21.15.66:0/2550229246 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b40d5f30 con 0x7f35b40d2270 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/2550229246 >> v2:172.21.15.190:3300/0 conn(0x7f35b40d3980 0x7f35b41626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b27fc640 1 --2- 172.21.15.66:0/2550229246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b4162c00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f35b408e080 tx=0x7f359c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b91e60e20e649a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b1ffb640 1 -- 172.21.15.66:0/2550229246 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c037070 con 0x7f35b40d2270 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b1ffb640 1 -- 172.21.15.66:0/2550229246 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c032440 con 0x7f35b40d2270 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.386+0000 7f35b1ffb640 1 -- 172.21.15.66:0/2550229246 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c032810 con 0x7f35b40d2270 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 -- 172.21.15.66:0/2550229246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 msgr2=0x7f35b4162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 --2- 172.21.15.66:0/2550229246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b4162c00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f35b408e080 tx=0x7f359c02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 -- 172.21.15.66:0/2550229246 shutdown_connections 2024-05-10T11:16:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 --2- 172.21.15.66:0/2550229246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40b6160 0x7f35b40b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 --2- 172.21.15.66:0/2550229246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b4162c00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 --2- 172.21.15.66:0/2550229246 >> v2:172.21.15.190:3300/0 conn(0x7f35b40d3980 0x7f35b41626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 -- 172.21.15.66:0/2550229246 >> 172.21.15.66:0/2550229246 conn(0x7f35b40d5130 msgr2=0x7f35b40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 -- 172.21.15.66:0/2550229246 shutdown_connections 2024-05-10T11:16:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.387+0000 7f35b9787640 1 -- 172.21.15.66:0/2550229246 wait complete. 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.388+0000 7f35b9787640 1 Processor -- start 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.388+0000 7f35b9787640 1 -- start start 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b9787640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b40b6160 0x7f35b40b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b9787640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b41f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b9787640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40d3980 0x7f35b4157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b9787640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40b6890 con 0x7f35b40d2270 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b9787640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40d31f0 con 0x7f35b40b6160 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b9787640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35b40d3d60 con 0x7f35b40d3980 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b41f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b41f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57630/0 (socket says 172.21.15.66:57630) 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b27fc640 1 -- 172.21.15.66:0/1699593795 learned_addr learned my addr 172.21.15.66:0/1699593795 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.389+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b40b6160 0x7f35b40b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b37fe640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40d3980 0x7f35b4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b27fc640 1 -- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40d3980 msgr2=0x7f35b4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40d3980 0x7f35b4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b27fc640 1 -- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b40b6160 msgr2=0x7f35b40b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b40b6160 0x7f35b40b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b27fc640 1 -- 172.21.15.66:0/1699593795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b41f6070 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b41f5b30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f359c02a220 tx=0x7f359c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35ab7fe640 1 -- 172.21.15.66:0/1699593795 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c037040 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35ab7fe640 1 -- 172.21.15.66:0/1699593795 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c042070 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b40b80d0 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35ab7fe640 1 -- 172.21.15.66:0/1699593795 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c030880 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.390+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b40b8690 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.392+0000 7f35ab7fe640 1 -- 172.21.15.66:0/1699593795 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f359c030a20 con 0x7f35b40d2270 2024-05-10T11:16:53.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.392+0000 7f35ab7fe640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3594076300 0x7f35940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.392+0000 7f35ab7fe640 1 -- 172.21.15.66:0/1699593795 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f359c0b7ec0 con 0x7f35b40d2270 2024-05-10T11:16:53.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.393+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3594076300 0x7f35940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.393+0000 7f35bc576740 1 Processor -- start 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.393+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3594076300 0x7f35940787c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f35b40d15a0 tx=0x7f35ac0097f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.393+0000 7f35bc576740 1 -- start start 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18b44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35bc576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b44ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b14bb0 0x55bc18b183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35bc576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc18a7e8d0 con 0x55bc18b42330 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bc18a37c10 con 0x55bc18b41f50 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bc18a7a890 con 0x55bc18b14bb0 2024-05-10T11:16:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b44ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18b44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b44ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57640/0 (socket says 172.21.15.66:57640) 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 -- 172.21.15.66:0/4285971739 learned_addr learned my addr 172.21.15.66:0/4285971739 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18b44760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:51784/0 (socket says 172.21.15.66:51784) 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b37fe640 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b14bb0 0x55bc18b183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 -- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b14bb0 msgr2=0x55bc18b183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b14bb0 0x55bc18b183c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 -- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 msgr2=0x55bc18b44760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18b44760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.394+0000 7f35b27fc640 1 -- 172.21.15.66:0/4285971739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc18a3f5d0 con 0x55bc18b42330 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.395+0000 7f35b27fc640 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b44ca0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f359c07d070 tx=0x7f359c080e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd635ea2182951ee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.395+0000 7f35a8ff9640 1 -- 172.21.15.66:0/4285971739 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c080b00 con 0x55bc18b42330 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.395+0000 7f35a8ff9640 1 -- 172.21.15.66:0/4285971739 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c080ff0 con 0x55bc18b42330 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.395+0000 7f35a8ff9640 1 -- 172.21.15.66:0/4285971739 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c0852f0 con 0x55bc18b42330 2024-05-10T11:16:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.395+0000 7f35bc576740 1 -- 172.21.15.66:0/4285971739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 msgr2=0x55bc18b44ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.395+0000 7f35bc576740 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b44ca0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f359c07d070 tx=0x7f359c080e40 comp rx=0 tx=0).stop 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 -- 172.21.15.66:0/4285971739 shutdown_connections 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b14bb0 0x55bc18b183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b44ca0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 --2- 172.21.15.66:0/4285971739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18b44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 -- 172.21.15.66:0/4285971739 >> 172.21.15.66:0/4285971739 conn(0x55bc18b16e20 msgr2=0x55bc18b5f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 -- 172.21.15.66:0/4285971739 shutdown_connections 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 -- 172.21.15.66:0/4285971739 wait complete. 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 -- start start 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.396+0000 7f35bc576740 1 Processor -- start 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 0x55bc18b39390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b42330 0x55bc18b5baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b5c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc18a37c10 con 0x55bc18b41f50 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bc18a3b760 con 0x55bc18b42330 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bc18a7e8d0 con 0x55bc18b60890 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35bc576740 10 client.0 _ll_register_callbacks cb 0x55bc18a74cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 0x55bc18b39390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 0x55bc18b39390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57652/0 (socket says 172.21.15.66:57652) 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 -- 172.21.15.66:0/329039946 learned_addr learned my addr 172.21.15.66:0/329039946 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b27fc640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b42330 0x55bc18b5baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b37fe640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b5c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 -- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 msgr2=0x55bc18b5c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b5c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 -- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b42330 msgr2=0x55bc18b5baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b42330 0x55bc18b5baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b2ffd640 1 -- 172.21.15.66:0/329039946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc187902d0 con 0x55bc18b41f50 2024-05-10T11:16:53.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.397+0000 7f35b27fc640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b42330 0x55bc18b5baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 0x55bc18b39390 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f35ac015e70 tx=0x7f35ac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969814e3daa91bec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f3591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f3591ffb640 1 -- 172.21.15.66:0/329039946 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac026070 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f3591ffb640 1 -- 172.21.15.66:0/329039946 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f35ac016d80 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f359c080ff0 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f3591ffb640 1 -- 172.21.15.66:0/329039946 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f35ac031050 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 10 client.6498 fetch_fsmap learned FSMap version 52 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55bc1885a6b0 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f3591ffb640 1 -- 172.21.15.66:0/329039946 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c080ff0 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f3591ffb640 1 -- 172.21.15.66:0/329039946 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f35ac034020 con 0x55bc18b41f50 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 10 client.6498 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 10 client.6498 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 20 client.6498 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18b7b820 0x55bc18b7dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 4 client.6498 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc18a02760 con 0x55bc18b7b820 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.398+0000 7f35b27fc640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18b7b820 0x55bc18b7dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f35b27fc640 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18b7b820 0x55bc18b7dc10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f2e3e918d9e9be server_cookie=82c4de6d8abca5d5 in_seq=0 out_seq=0 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f3591ffb640 10 client.6498 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f3591ffb640 1 -- 172.21.15.66:0/329039946 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc18a02760 con 0x55bc18b7b820 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f3591ffb640 10 client.6498 handle_command_reply: tid=0 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f35bc576740 1 client.6498 shutdown 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 msgr2=0x55bc18b39390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.399+0000 7f35bc576740 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 0x55bc18b39390 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f35ac015e70 tx=0x7f35ac004ab0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 shutdown_connections 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18b7b820 0x55bc18b7dc10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b5c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b42330 0x55bc18b5baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f3591ffb640 0 client.6498 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 --2- 172.21.15.66:0/329039946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b41f50 0x55bc18b39390 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 >> 172.21.15.66:0/329039946 conn(0x55bc18b14bb0 msgr2=0x55bc18b1a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 shutdown_connections 2024-05-10T11:16:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 1 -- 172.21.15.66:0/329039946 wait complete. 2024-05-10T11:16:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.400+0000 7f35bc576740 20 client.6498 trim_cache size 0 max 16384 2024-05-10T11:16:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.418+0000 7f35bc576740 1 Processor -- start 2024-05-10T11:16:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.418+0000 7f35bc576740 1 -- start start 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b41f50 0x55bc18b1a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35bc576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b60890 0x55bc18b410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35bc576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4201fe0 con 0x55bc18b42330 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4201020 con 0x55bc18b60890 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35b41f8fb0 con 0x55bc18b41f50 2024-05-10T11:16:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b5f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57668/0 (socket says 172.21.15.66:57668) 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b27fc640 1 -- 172.21.15.66:0/1362234197 learned_addr learned my addr 172.21.15.66:0/1362234197 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b41f50 0x55bc18b1a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b37fe640 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b60890 0x55bc18b410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b27fc640 1 -- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b41f50 msgr2=0x55bc18b1a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.419+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b41f50 0x55bc18b1a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35b27fc640 1 -- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b60890 msgr2=0x55bc18b410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b60890 0x55bc18b410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35b27fc640 1 -- 172.21.15.66:0/1362234197 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc18b48c40 con 0x55bc18b42330 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b5f760 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f359c080f30 tx=0x7f359c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17146b3f1ec89689 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f3593fff640 1 -- 172.21.15.66:0/1362234197 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c0852f0 con 0x55bc18b42330 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f3593fff640 1 -- 172.21.15.66:0/1362234197 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c080ff0 con 0x55bc18b42330 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f3593fff640 1 -- 172.21.15.66:0/1362234197 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c089880 con 0x55bc18b42330 2024-05-10T11:16:53.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 -- 172.21.15.66:0/1362234197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 msgr2=0x55bc18b5f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b5f760 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f359c080f30 tx=0x7f359c048000 comp rx=0 tx=0).stop 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 -- 172.21.15.66:0/1362234197 shutdown_connections 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b60890 0x55bc18b410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b5f760 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 --2- 172.21.15.66:0/1362234197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b41f50 0x55bc18b1a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 -- 172.21.15.66:0/1362234197 >> 172.21.15.66:0/1362234197 conn(0x55bc18b14bb0 msgr2=0x55bc18b3c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 -- 172.21.15.66:0/1362234197 shutdown_connections 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.420+0000 7f35bc576740 1 -- 172.21.15.66:0/1362234197 wait complete. 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.421+0000 7f35bc576740 1 -- start start 2024-05-10T11:16:53.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.421+0000 7f35bc576740 1 Processor -- start 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18bdcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b19dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b1a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc18b3aff0 con 0x55bc18b42330 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4200c40 con 0x55bc18b41f50 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bc18b60dc0 con 0x55bc18b60890 2024-05-10T11:16:53.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 10 client.0 _ll_register_callbacks cb 0x7f35ac009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b19dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b19dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57682/0 (socket says 172.21.15.66:57682) 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 -- 172.21.15.66:0/1612336855 learned_addr learned my addr 172.21.15.66:0/1612336855 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b37fe640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b1a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18bdcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 -- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 msgr2=0x55bc18b1a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b1a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 -- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 msgr2=0x55bc18bdcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18bdcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 -- 172.21.15.66:0/1612336855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc18b62330 con 0x55bc18b42330 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18bdcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35b27fc640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b19dd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f359c080f30 tx=0x7f359c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955c44c463ded30d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f3591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:53.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f3591ffb640 1 -- 172.21.15.66:0/1612336855 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c0852f0 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f3591ffb640 1 -- 172.21.15.66:0/1612336855 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f359c089880 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.422+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f359c080ff0 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f3591ffb640 1 -- 172.21.15.66:0/1612336855 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f359c089a80 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 10 client.6504 fetch_fsmap learned FSMap version 52 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55bc18b6f310 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f3591ffb640 1 -- 172.21.15.66:0/1612336855 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c080ff0 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f3591ffb640 1 -- 172.21.15.66:0/1612336855 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f359c03a070 con 0x55bc18b42330 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 10 client.6504 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 10 client.6504 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 20 client.6504 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18bdd7f0 0x55bc18bddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 4 client.6504 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "status"}) -- 0x55bc18a8c4e0 con 0x55bc18bdd7f0 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18bdd7f0 0x55bc18bddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35b2ffd640 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18bdd7f0 0x55bc18bddbd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb6e345372c0cd0 server_cookie=23eac6a98586d1a3 in_seq=0 out_seq=0 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f3591ffb640 10 client.6504 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f3591ffb640 1 -- 172.21.15.66:0/1612336855 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bc18a8c4e0 con 0x55bc18bdd7f0 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f3591ffb640 10 client.6504 handle_command_reply: tid=0 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.423+0000 7f35bc576740 1 client.6504 shutdown 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 msgr2=0x55bc18b19dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b19dd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f359c080f30 tx=0x7f359c032f90 comp rx=0 tx=0).stop 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 shutdown_connections 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bc18bdd7f0 0x55bc18bddbd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bc18b60890 0x55bc18b1a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc18b42330 0x55bc18b19dd0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f3591ffb640 0 client.6504 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 --2- 172.21.15.66:0/1612336855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc18b41f50 0x55bc18bdcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 >> 172.21.15.66:0/1612336855 conn(0x55bc18b14bb0 msgr2=0x55bc18b3bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 shutdown_connections 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 1 -- 172.21.15.66:0/1612336855 wait complete. 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35bc576740 20 client.6504 trim_cache size 0 max 16384 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 6444, 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 4.4770286539999997, 2024-05-10T11:16:53.431 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 52, 2024-05-10T11:16:53.432 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 77, 2024-05-10T11:16:53.432 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 77, 2024-05-10T11:16:53.432 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 5.4447128810000001 2024-05-10T11:16:53.432 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3594076300 msgr2=0x7f35940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3594076300 0x7f35940787c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f35b40d15a0 tx=0x7f35ac0097f0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 msgr2=0x7f35b41f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b41f5b30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f359c02a220 tx=0x7f359c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 shutdown_connections 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3594076300 0x7f35940787c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b40d3980 0x7f35b4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35b40d2270 0x7f35b41f5b30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 --2- 172.21.15.66:0/1699593795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b40b6160 0x7f35b40b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 >> 172.21.15.66:0/1699593795 conn(0x7f35b40d5130 msgr2=0x7f35b406de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 shutdown_connections 2024-05-10T11:16:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.424+0000 7f35b9787640 1 -- 172.21.15.66:0/1699593795 wait complete. 2024-05-10T11:16:53.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:16:53.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.538+0000 7ff4f9bda640 1 Processor -- start 2024-05-10T11:16:53.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f9bda640 1 -- start start 2024-05-10T11:16:53.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f9bda640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4f40d5d30 0x7ff4f416a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f9bda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f40d30b0 con 0x7ff4f415f790 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f9bda640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f40d3390 con 0x7ff4f415f3b0 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f9bda640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f40c8c80 con 0x7ff4f40d5d30 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f2ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff4f415f790 0x7ff4f40cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54826/0 (socket says 172.21.15.66:54826) 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.539+0000 7ff4f2ffd640 1 -- 172.21.15.66:0/3106938483 learned_addr learned my addr 172.21.15.66:0/3106938483 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.540+0000 7ff4f3fff640 1 --2- 172.21.15.66:0/3106938483 >> v2:172.21.15.190:3300/0 conn(0x7ff4f40d5d30 0x7ff4f416a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.540+0000 7ff4f27fc640 1 -- 172.21.15.66:0/3106938483 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538510207 0 0) 0x7ff4f40d30b0 con 0x7ff4f415f790 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.540+0000 7ff4f27fc640 1 -- 172.21.15.66:0/3106938483 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4e0003520 con 0x7ff4f415f790 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.540+0000 7ff4f3fff640 1 -- 172.21.15.66:0/3106938483 >> v1:172.21.15.190:6789/0 conn(0x7ff4f415f3b0 legacy=0x7ff4f40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.540+0000 7ff4f3fff640 1 -- 172.21.15.66:0/3106938483 >> v1:172.21.15.66:6789/0 conn(0x7ff4f415f790 legacy=0x7ff4f40cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.540+0000 7ff4f3fff640 1 -- 172.21.15.66:0/3106938483 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40c8f60 con 0x7ff4f40d5d30 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.541+0000 7ff4f3fff640 1 --2- 172.21.15.66:0/3106938483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f40d5d30 0x7ff4f416a0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0097a0 tx=0x7ff4ec02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe14fbec2f195a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.541+0000 7ff4f27fc640 1 -- 172.21.15.66:0/3106938483 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec037070 con 0x7ff4f40d5d30 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.541+0000 7ff4f27fc640 1 -- 172.21.15.66:0/3106938483 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec032440 con 0x7ff4f40d5d30 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.541+0000 7ff4f27fc640 1 -- 172.21.15.66:0/3106938483 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0327f0 con 0x7ff4f40d5d30 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.541+0000 7ff4f9bda640 1 -- 172.21.15.66:0/3106938483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f40d5d30 msgr2=0x7ff4f416a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.541+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/3106938483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f40d5d30 0x7ff4f416a0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0097a0 tx=0x7ff4ec02a230 comp rx=0 tx=0).stop 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.542+0000 7ff4f9bda640 1 -- 172.21.15.66:0/3106938483 shutdown_connections 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.542+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/3106938483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f40d5d30 0x7ff4f416a0c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.542+0000 7ff4f9bda640 1 -- 172.21.15.66:0/3106938483 >> 172.21.15.66:0/3106938483 conn(0x7ff4f40d5130 msgr2=0x7ff4f40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.542+0000 7ff4f9bda640 1 -- 172.21.15.66:0/3106938483 shutdown_connections 2024-05-10T11:16:53.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.542+0000 7ff4f9bda640 1 -- 172.21.15.66:0/3106938483 wait complete. 2024-05-10T11:16:53.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.543+0000 7ff4f9bda640 1 Processor -- start 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.543+0000 7ff4f9bda640 1 -- start start 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f9bda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4f40d5d30 0x7ff4f40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f9bda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 0x7ff4f40b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f9bda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f4161e00 0x7ff4f415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f9bda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40d3f80 con 0x7ff4f415f3b0 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f9bda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40d3e00 con 0x7ff4f4161e00 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f9bda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40ca770 con 0x7ff4f40d5d30 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 0x7ff4f40b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 0x7ff4f40b8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57684/0 (socket says 172.21.15.66:57684) 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 -- 172.21.15.66:0/377321943 learned_addr learned my addr 172.21.15.66:0/377321943 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:53.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f3fff640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f4161e00 0x7ff4f415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f37fe640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4f40d5d30 0x7ff4f40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 -- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4f40d5d30 msgr2=0x7ff4f40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4f40d5d30 0x7ff4f40ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 -- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f4161e00 msgr2=0x7ff4f415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f4161e00 0x7ff4f415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 -- 172.21.15.66:0/377321943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40b9e40 con 0x7ff4f415f3b0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4f2ffd640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 0x7ff4f40b8d70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c410 tx=0x7ff4dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc017070 con 0x7ff4f415f3b0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4dc005ce0 con 0x7ff4f415f3b0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.544+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0072d0 con 0x7ff4f415f3b0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.545+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f40b95a0 con 0x7ff4f415f3b0 2024-05-10T11:16:53.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.545+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f40b9b60 con 0x7ff4f415f3b0 2024-05-10T11:16:53.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.546+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f406a220 con 0x7ff4f415f3b0 2024-05-10T11:16:53.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.546+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4dc01a070 con 0x7ff4f415f3b0 2024-05-10T11:16:53.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.547+0000 7ff4ebfff640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff4d40762d0 0x7ff4d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:53.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.547+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff4dc096a50 con 0x7ff4f415f3b0 2024-05-10T11:16:53.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.547+0000 7ff4f37fe640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff4d40762d0 0x7ff4d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:53.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.547+0000 7ff4f37fe640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff4d40762d0 0x7ff4d4078790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4001d40 tx=0x7ff4e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:53.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.551+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff4dc05fb90 con 0x7ff4f415f3b0 2024-05-10T11:16:53.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.781+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff4f40b92b0 con 0x7ff4f415f3b0 2024-05-10T11:16:53.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.782+0000 7ff4ebfff640 1 -- 172.21.15.66:0/377321943 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7ff4dc063e90 con 0x7ff4f415f3b0 2024-05-10T11:16:53.782 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:16:53.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff4d40762d0 msgr2=0x7ff4d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff4d40762d0 0x7ff4d4078790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4001d40 tx=0x7ff4e4009040 comp rx=0 tx=0).stop 2024-05-10T11:16:53.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 msgr2=0x7ff4f40b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 0x7ff4f40b8d70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c410 tx=0x7ff4dc00c8d0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 shutdown_connections 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff4d40762d0 0x7ff4d4078790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4f4161e00 0x7ff4f415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f415f3b0 0x7ff4f40b8d70 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 --2- 172.21.15.66:0/377321943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4f40d5d30 0x7ff4f40ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 >> 172.21.15.66:0/377321943 conn(0x7ff4f40d5130 msgr2=0x7ff4f415e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 shutdown_connections 2024-05-10T11:16:53.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53.784+0000 7ff4f9bda640 1 -- 172.21.15.66:0/377321943 wait complete. 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:16:53.795 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:16:53.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:53.796 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:16:53.812 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:16:53.812 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:53.813 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42480sec preferred_lft 42480sec 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:16:53.814 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:16:53.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:53.815 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:16:53.877 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:16:53.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:53.879 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:16:53.936 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:16:53.936 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:16:53.936 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:16:53.937 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:16:53.937 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:16:53.937 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:16:53.937 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:16:53.937 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:16:53.937 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:16:53.937 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:16:53.937 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:16:53.948 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:16:53.948+0000 7f43332c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:16:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:16:54.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:16:54.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:54.038 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:16:54.054 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:16:54.054 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:16:54.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:16:54.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:54.054 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:16:54.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:16:54.120 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:54.176 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:16:54.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:16:54.176 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:54.232 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:16:54.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:54.232 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:54.317 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:54.317 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:16:54.317 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:16:54.326 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:54.326 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:16:54.326 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:16:54.326 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:16:54.326 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:16:54.336 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:16:54.337 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:16:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:16:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:16:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:16:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:16:54.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:16:54.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:54.339 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:54.364 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:16:54.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:16:54.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:16:54.463 INFO:teuthology.orchestra.run.smithi066.stdout:client5920 2024-05-10T11:16:54.463 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:54.463 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:54.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:54.480 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-05-10T11:16:54.538 INFO:teuthology.orchestra.run.smithi066.stdout:file_undamaged 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> import json 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> import sys 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> try: 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> except OSError as e: 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> sys.exit(e.errno) 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-05-10T11:16:54.539 DEBUG:teuthology.orchestra.run.smithi066:> print(json.dumps( 2024-05-10T11:16:54.540 DEBUG:teuthology.orchestra.run.smithi066:> dict([(a, getattr(s, a)) for a in attrs]), 2024-05-10T11:16:54.540 DEBUG:teuthology.orchestra.run.smithi066:> indent=2)) 2024-05-10T11:16:54.540 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:16:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-05-10T11:16:54.656 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-10T11:16:54.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:54.657 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-05-10T11:16:54.714 INFO:teuthology.orchestra.run.smithi066.stdout:2 2024-05-10T11:16:54.714 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:54.714 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:54.770 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:16:54.770 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:16:54.826 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:16:54.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.971+0000 7f34915c9640 1 Processor -- start 2024-05-10T11:16:54.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.971+0000 7f34915c9640 1 -- start start 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f34915c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f348c0d0230 0x7f348c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f34915c9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f348c0cfbb0 0x7f348c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f34915c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348c15fc90 con 0x7f348c0b8860 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f34915c9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f348c06ec30 con 0x7f348c0cfbb0 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f34915c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f348c06ee50 con 0x7f348c0d0230 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f348c0cfbb0 0x7f348c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f348c0cfbb0 0x7f348c0ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51234/0 (socket says 172.21.15.66:51234) 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 -- 172.21.15.66:0/397241304 learned_addr learned my addr 172.21.15.66:0/397241304 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348a7fc640 1 --2- 172.21.15.66:0/397241304 >> v2:172.21.15.190:3300/0 conn(0x7f348c0d0230 0x7f348c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 -- 172.21.15.66:0/397241304 >> v2:172.21.15.190:3300/0 conn(0x7f348c0d0230 msgr2=0x7f348c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 --2- 172.21.15.66:0/397241304 >> v2:172.21.15.190:3300/0 conn(0x7f348c0d0230 0x7f348c0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:54.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 -- 172.21.15.66:0/397241304 >> v1:172.21.15.190:6789/0 conn(0x7f348c0b8860 legacy=0x7f348c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:54.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.972+0000 7f348b7fe640 1 -- 172.21.15.66:0/397241304 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c0b8c40 con 0x7f348c0cfbb0 2024-05-10T11:16:54.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.973+0000 7f348b7fe640 1 --2- 172.21.15.66:0/397241304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0cfbb0 0x7f348c0ce330 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f348c0b48b0 tx=0x7f348402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df16b12f19575ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.973+0000 7f3489ffb640 1 -- 172.21.15.66:0/397241304 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484036070 con 0x7f348c0cfbb0 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.973+0000 7f3489ffb640 1 -- 172.21.15.66:0/397241304 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3484031600 con 0x7f348c0cfbb0 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.973+0000 7f3489ffb640 1 -- 172.21.15.66:0/397241304 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348402ae60 con 0x7f348c0cfbb0 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.973+0000 7f34915c9640 1 -- 172.21.15.66:0/397241304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0cfbb0 msgr2=0x7f348c0ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.973+0000 7f34915c9640 1 --2- 172.21.15.66:0/397241304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0cfbb0 0x7f348c0ce330 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f348c0b48b0 tx=0x7f348402a680 comp rx=0 tx=0).stop 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.974+0000 7f34915c9640 1 -- 172.21.15.66:0/397241304 shutdown_connections 2024-05-10T11:16:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.974+0000 7f34915c9640 1 --2- 172.21.15.66:0/397241304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0cfbb0 0x7f348c0ce330 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.974+0000 7f34915c9640 1 --2- 172.21.15.66:0/397241304 >> v2:172.21.15.190:3300/0 conn(0x7f348c0d0230 0x7f348c0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.974+0000 7f34915c9640 1 -- 172.21.15.66:0/397241304 >> 172.21.15.66:0/397241304 conn(0x7f348c0d2df0 msgr2=0x7f348c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.974+0000 7f34915c9640 1 -- 172.21.15.66:0/397241304 shutdown_connections 2024-05-10T11:16:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.974+0000 7f34915c9640 1 -- 172.21.15.66:0/397241304 wait complete. 2024-05-10T11:16:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.975+0000 7f34915c9640 1 Processor -- start 2024-05-10T11:16:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.975+0000 7f34915c9640 1 -- start start 2024-05-10T11:16:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 0x7f348c1f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f348c0cfbb0 0x7f348c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f348c0d0230 0x7f348c0c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0cdb30 con 0x7f348c0b8860 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0cd850 con 0x7f348c0cfbb0 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f348c0cde10 con 0x7f348c0d0230 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 0x7f348c1f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 0x7f348c1f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51246/0 (socket says 172.21.15.66:51246) 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 -- 172.21.15.66:0/352220200 learned_addr learned my addr 172.21.15.66:0/352220200 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 -- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f348c0d0230 msgr2=0x7f348c0c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f348c0d0230 0x7f348c0c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 -- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f348c0cfbb0 msgr2=0x7f348c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f348c0cfbb0 0x7f348c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 -- 172.21.15.66:0/352220200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c1f5b80 con 0x7f348c0b8860 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f348affd640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 0x7f348c1f4cc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c460 tx=0x7f347c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c016020 con 0x7f348c0b8860 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347c012870 con 0x7f348c0b8860 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c1f55c0 con 0x7f348c0b8860 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.976+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c012c60 con 0x7f348c0b8860 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.977+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c0c9f60 con 0x7f348c0b8860 2024-05-10T11:16:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.977+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c06a220 con 0x7f348c0b8860 2024-05-10T11:16:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.978+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f347c019020 con 0x7f348c0b8860 2024-05-10T11:16:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.979+0000 7f34737fe640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f34780762d0 0x7f3478078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.979+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f347c0971c0 con 0x7f348c0b8860 2024-05-10T11:16:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.979+0000 7f348a7fc640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f34780762d0 0x7f3478078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.979+0000 7f348a7fc640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f34780762d0 0x7f3478078790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3480006fd0 tx=0x7f3480008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:54.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:54.985+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f347c020070 con 0x7f348c0b8860 2024-05-10T11:16:55.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.187+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f348c075140 con 0x7f348c0b8860 2024-05-10T11:16:55.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.188+0000 7f34737fe640 1 -- 172.21.15.66:0/352220200 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v77) ==== 80+0+122 (secure 0 0 0) 0x7f347c0609d0 con 0x7f348c0b8860 2024-05-10T11:16:55.188 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6835/1361798984 2024-05-11T11:16:47.934721+0000 2024-05-10T11:16:55.188 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6834/1361798984 2024-05-11T11:16:47.934721+0000 2024-05-10T11:16:55.189 INFO:teuthology.orchestra.run.smithi066.stderr:listed 2 entries 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f34780762d0 msgr2=0x7f3478078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f34780762d0 0x7f3478078790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3480006fd0 tx=0x7f3480008040 comp rx=0 tx=0).stop 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 msgr2=0x7f348c1f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 0x7f348c1f4cc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c460 tx=0x7f347c00c920 comp rx=0 tx=0).stop 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 shutdown_connections 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f34780762d0 0x7f3478078790 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f348c0d0230 0x7f348c0c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f348c0cfbb0 0x7f348c0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 --2- 172.21.15.66:0/352220200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c0b8860 0x7f348c1f4cc0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 >> 172.21.15.66:0/352220200 conn(0x7f348c0d2df0 msgr2=0x7f348c0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 shutdown_connections 2024-05-10T11:16:55.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.190+0000 7f34915c9640 1 -- 172.21.15.66:0/352220200 wait complete. 2024-05-10T11:16:55.201 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:16:55.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:55.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:16:55.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:16:55.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:55.230 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:16:55.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:55.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-05-10T11:16:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.433+0000 7f8577cc8640 1 Processor -- start 2024-05-10T11:16:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.433+0000 7f8577cc8640 1 -- start start 2024-05-10T11:16:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8577cc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f857015b7b0 0x7f857006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8577cc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f85700b4c00 0x7f857006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8577cc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8570074260 con 0x7f857015b3d0 2024-05-10T11:16:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8577cc8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8570072cc0 con 0x7f85700b4c00 2024-05-10T11:16:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8577cc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85700720f0 con 0x7f857015b7b0 2024-05-10T11:16:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8575a64640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f857015b3d0 0x7f85700b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54860/0 (socket says 172.21.15.66:54860) 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8576265640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f85700b4c00 0x7f857006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.434+0000 7f8575a64640 1 -- 172.21.15.66:0/1020998372 learned_addr learned my addr 172.21.15.66:0/1020998372 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8575263640 1 --2- 172.21.15.66:0/1020998372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f857015b7b0 0x7f857006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8574a62640 1 -- 172.21.15.66:0/1020998372 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647473492 0 0) 0x7f8570074260 con 0x7f857015b3d0 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8574a62640 1 -- 172.21.15.66:0/1020998372 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f855c003520 con 0x7f857015b3d0 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8576265640 1 -- 172.21.15.66:0/1020998372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f857015b7b0 msgr2=0x7f857006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8576265640 1 --2- 172.21.15.66:0/1020998372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f857015b7b0 0x7f857006ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8576265640 1 -- 172.21.15.66:0/1020998372 >> v1:172.21.15.66:6789/0 conn(0x7f857015b3d0 legacy=0x7f85700b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.435+0000 7f8576265640 1 -- 172.21.15.66:0/1020998372 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857006f700 con 0x7f85700b4c00 2024-05-10T11:16:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8576265640 1 --2- 172.21.15.66:0/1020998372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85700b4c00 0x7f857006f1c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8568009d90 tx=0x7f856802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f020af54232e72ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8574a62640 1 -- 172.21.15.66:0/1020998372 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568007740 con 0x7f85700b4c00 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8574a62640 1 -- 172.21.15.66:0/1020998372 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85680078e0 con 0x7f85700b4c00 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8574a62640 1 -- 172.21.15.66:0/1020998372 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568007cb0 con 0x7f85700b4c00 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 -- 172.21.15.66:0/1020998372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85700b4c00 msgr2=0x7f857006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 --2- 172.21.15.66:0/1020998372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85700b4c00 0x7f857006f1c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8568009d90 tx=0x7f856802a660 comp rx=0 tx=0).stop 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 -- 172.21.15.66:0/1020998372 shutdown_connections 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 --2- 172.21.15.66:0/1020998372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85700b4c00 0x7f857006f1c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 --2- 172.21.15.66:0/1020998372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f857015b7b0 0x7f857006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 -- 172.21.15.66:0/1020998372 >> 172.21.15.66:0/1020998372 conn(0x7f857006c4a0 msgr2=0x7f857006c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 -- 172.21.15.66:0/1020998372 shutdown_connections 2024-05-10T11:16:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.436+0000 7f8577cc8640 1 -- 172.21.15.66:0/1020998372 wait complete. 2024-05-10T11:16:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 Processor -- start 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 -- start start 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85700b4c00 0x7f85701f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f857015b3d0 0x7f857015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 0x7f85700cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8570072950 con 0x7f857015b7b0 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8570072670 con 0x7f857015b3d0 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.438+0000 7f8577cc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85700ade90 con 0x7f85700b4c00 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 0x7f85700cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 0x7f85700cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51270/0 (socket says 172.21.15.66:51270) 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 -- 172.21.15.66:0/696759123 learned_addr learned my addr 172.21.15.66:0/696759123 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8575a64640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85700b4c00 0x7f85701f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8575263640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f857015b3d0 0x7f857015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 -- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85700b4c00 msgr2=0x7f85701f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85700b4c00 0x7f85701f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 -- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f857015b3d0 msgr2=0x7f857015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f857015b3d0 0x7f857015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 -- 172.21.15.66:0/696759123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85700cf9f0 con 0x7f857015b7b0 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8575a64640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85700b4c00 0x7f85701f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8576265640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 0x7f85700cf2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8568009eb0 tx=0x7f8568004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f85667fc640 1 -- 172.21.15.66:0/696759123 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568040070 con 0x7f857015b7b0 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f85667fc640 1 -- 172.21.15.66:0/696759123 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8568031bc0 con 0x7f857015b7b0 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85700cfcd0 con 0x7f857015b7b0 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f85667fc640 1 -- 172.21.15.66:0/696759123 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568009450 con 0x7f857015b7b0 2024-05-10T11:16:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.439+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85701f6230 con 0x7f857015b7b0 2024-05-10T11:16:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.441+0000 7f85667fc640 1 -- 172.21.15.66:0/696759123 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8568039040 con 0x7f857015b7b0 2024-05-10T11:16:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.441+0000 7f85667fc640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f85540762d0 0x7f8554078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.442+0000 7f85667fc640 1 -- 172.21.15.66:0/696759123 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f85680b8ff0 con 0x7f857015b7b0 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.442+0000 7f8575a64640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f85540762d0 0x7f8554078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.442+0000 7f8575a64640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f85540762d0 0x7f8554078790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f856c007fd0 tx=0x7f856c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 Processor -- start 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 -- start start 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d70190 0x5578a9d73f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d47ea0 0x5578a9d70570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9d73340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5578a9cad1c0 con 0x5578a9d70ab0 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5578a9c66ca0 con 0x5578a9d70190 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.443+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5578a9ca9180 con 0x5578a9d47ea0 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9d73340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9d73340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51276/0 (socket says 172.21.15.66:51276) 2024-05-10T11:16:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 -- 172.21.15.66:0/1729022369 learned_addr learned my addr 172.21.15.66:0/1729022369 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8575a64640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d70190 0x5578a9d73f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8575263640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d47ea0 0x5578a9d70570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 -- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d47ea0 msgr2=0x5578a9d70570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d47ea0 0x5578a9d70570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 -- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d70190 msgr2=0x5578a9d73f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d70190 0x5578a9d73f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 -- 172.21.15.66:0/1729022369 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a9c4adb0 con 0x5578a9d70ab0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8575263640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d47ea0 0x5578a9d70570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8575a64640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d70190 0x5578a9d73f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f8576265640 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9d73340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f856807e0b0 tx=0x7f85680817a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acd28249ad99b60 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f85537fe640 1 -- 172.21.15.66:0/1729022369 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568082730 con 0x5578a9d70ab0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f85537fe640 1 -- 172.21.15.66:0/1729022369 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8568082030 con 0x5578a9d70ab0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.444+0000 7f85537fe640 1 -- 172.21.15.66:0/1729022369 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85680824b0 con 0x5578a9d70ab0 2024-05-10T11:16:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 -- 172.21.15.66:0/1729022369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 msgr2=0x5578a9d73340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9d73340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f856807e0b0 tx=0x7f85680817a0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 -- 172.21.15.66:0/1729022369 shutdown_connections 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9d73340 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d47ea0 0x5578a9d70570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 --2- 172.21.15.66:0/1729022369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d70190 0x5578a9d73f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 -- 172.21.15.66:0/1729022369 >> 172.21.15.66:0/1729022369 conn(0x5578a9d45aa0 msgr2=0x5578a9d8e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 -- 172.21.15.66:0/1729022369 shutdown_connections 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 -- 172.21.15.66:0/1729022369 wait complete. 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 -- start start 2024-05-10T11:16:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.445+0000 7f857a9de740 1 Processor -- start 2024-05-10T11:16:55.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5578a9c66ca0 con 0x5578a9d70ab0 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5578a9c33be0 con 0x5578a9d6f350 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5578a9cad1c0 con 0x5578a9d70190 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f857a9de740 10 client.0 _ll_register_callbacks cb 0x5578a9c61810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.446+0000 7f8575263640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51290/0 (socket says 172.21.15.66:51290) 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 -- 172.21.15.66:0/3553250957 learned_addr learned my addr 172.21.15.66:0/3553250957 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575a64640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8576265640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 -- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 msgr2=0x5578a9da33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 -- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 msgr2=0x5578a9da6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 -- 172.21.15.66:0/3553250957 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a9a8aa20 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575a64640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8576265640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8575263640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da5e20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f85600125b0 tx=0x7f8560012a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafd4c710b59aed7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8550ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8550ff9640 1 -- 172.21.15.66:0/3553250957 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560014880 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8550ff9640 1 -- 172.21.15.66:0/3553250957 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f8560014a20 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8568082030 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8550ff9640 1 -- 172.21.15.66:0/3553250957 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8560026050 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f857a9de740 10 client.6531 fetch_fsmap learned FSMap version 52 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5578a997e310 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.447+0000 7f8550ff9640 1 -- 172.21.15.66:0/3553250957 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8568082030 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f8550ff9640 1 -- 172.21.15.66:0/3553250957 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f8560029020 con 0x5578a9d70ab0 2024-05-10T11:16:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f857a9de740 10 client.6531 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f857a9de740 10 client.6531 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f857a9de740 20 client.6531 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f857a9de740 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9d65780 0x5578a9d65b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f857a9de740 4 client.6531 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578a9d0a570 con 0x5578a9d65780 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f8575a64640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9d65780 0x5578a9d65b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f8550ff9640 10 client.6531 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.448+0000 7f8575a64640 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9d65780 0x5578a9d65b90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f553ffc0e63cad1 server_cookie=3e8213ad21ac3c12 in_seq=0 out_seq=0 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f8550ff9640 1 -- 172.21.15.66:0/3553250957 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5578a9d0a570 con 0x5578a9d65780 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f8550ff9640 10 client.6531 handle_command_reply: tid=0 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 client.6531 shutdown 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 msgr2=0x5578a9da5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da5e20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f85600125b0 tx=0x7f8560012a70 comp rx=0 tx=0).stop 2024-05-10T11:16:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 shutdown_connections 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9d65780 0x5578a9d65b90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da5e20 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f8550ff9640 0 client.6531 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 --2- 172.21.15.66:0/3553250957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 >> 172.21.15.66:0/3553250957 conn(0x5578a9d47ea0 msgr2=0x5578a9d48cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 shutdown_connections 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 1 -- 172.21.15.66:0/3553250957 wait complete. 2024-05-10T11:16:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.449+0000 7f857a9de740 20 client.6531 trim_cache size 0 max 16384 2024-05-10T11:16:55.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.467+0000 7f857a9de740 1 Processor -- start 2024-05-10T11:16:55.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.467+0000 7f857a9de740 1 -- start start 2024-05-10T11:16:55.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9d4a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f857a9de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 0x5578a9d6f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70ab0 0x5578a9d90970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f857a9de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f85701fda80 con 0x5578a9d70190 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85701e7710 con 0x5578a9d6f350 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85701e6a70 con 0x5578a9d70ab0 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 0x5578a9d6f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 0x5578a9d6f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51292/0 (socket says 172.21.15.66:51292) 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 -- 172.21.15.66:0/1867699435 learned_addr learned my addr 172.21.15.66:0/1867699435 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 -- 172.21.15.66:0/1867699435 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70ab0 msgr2=0x5578a9d90970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70ab0 0x5578a9d90970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 -- 172.21.15.66:0/1867699435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 msgr2=0x5578a9d4a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9d4a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.468+0000 7f8575263640 1 -- 172.21.15.66:0/1867699435 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a9d65f00 con 0x5578a9d70190 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f8575263640 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 0x5578a9d6f960 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8560008010 tx=0x7f8560017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3ba3d2b813161a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f8552ffd640 1 -- 172.21.15.66:0/1867699435 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560014940 con 0x5578a9d70190 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f8552ffd640 1 -- 172.21.15.66:0/1867699435 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8560005990 con 0x5578a9d70190 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f8552ffd640 1 -- 172.21.15.66:0/1867699435 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560005d80 con 0x5578a9d70190 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 -- 172.21.15.66:0/1867699435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 msgr2=0x5578a9d6f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 0x5578a9d6f960 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8560008010 tx=0x7f8560017000 comp rx=0 tx=0).stop 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 -- 172.21.15.66:0/1867699435 shutdown_connections 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70ab0 0x5578a9d90970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70190 0x5578a9d6f960 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 --2- 172.21.15.66:0/1867699435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9d4a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 -- 172.21.15.66:0/1867699435 >> 172.21.15.66:0/1867699435 conn(0x5578a9d47ea0 msgr2=0x5578a9d42600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 -- 172.21.15.66:0/1867699435 shutdown_connections 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.469+0000 7f857a9de740 1 -- 172.21.15.66:0/1867699435 wait complete. 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.470+0000 7f857a9de740 1 -- start start 2024-05-10T11:16:55.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.470+0000 7f857a9de740 1 Processor -- start 2024-05-10T11:16:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5578a9d670b0 con 0x5578a9d70ab0 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85701e70c0 con 0x5578a9d6f350 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5578a9d736b0 con 0x5578a9d70190 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f857a9de740 10 client.0 _ll_register_callbacks cb 0x7f8560009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51296/0 (socket says 172.21.15.66:51296) 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 -- 172.21.15.66:0/2879092778 learned_addr learned my addr 172.21.15.66:0/2879092778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8575263640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8575a64640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 -- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 msgr2=0x5578a9da5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 -- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 msgr2=0x5578a9da2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 -- 172.21.15.66:0/2879092778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a9aeb1b0 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8576265640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da6270 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f85680b7670 tx=0x7f8568031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2f6088901a8d20 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.471+0000 7f8550ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8550ff9640 1 -- 172.21.15.66:0/2879092778 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568082030 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8550ff9640 1 -- 172.21.15.66:0/2879092778 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f856808ab80 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8560005990 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8550ff9640 1 -- 172.21.15.66:0/2879092778 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8568082730 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 10 client.6537 fetch_fsmap learned FSMap version 52 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5578a9957490 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8550ff9640 1 -- 172.21.15.66:0/2879092778 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8560005990 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8550ff9640 1 -- 172.21.15.66:0/2879092778 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f8568081290 con 0x5578a9d70ab0 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 10 client.6537 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 10 client.6537 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:16:55.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 20 client.6537 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9df6a70 0x5578a9e10a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 4 client.6537 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x5578a9c4b910 con 0x5578a9df6a70 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8575a64640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9df6a70 0x5578a9e10a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8550ff9640 10 client.6537 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.472+0000 7f8575a64640 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9df6a70 0x5578a9e10a80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6b3002b08fe645 server_cookie=f9d39df381031548 in_seq=0 out_seq=0 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f8550ff9640 1 -- 172.21.15.66:0/2879092778 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5578a9c4b910 con 0x5578a9df6a70 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f8550ff9640 10 client.6537 handle_command_reply: tid=0 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 client.6537 shutdown 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 msgr2=0x5578a9da6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da6270 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f85680b7670 tx=0x7f8568031f90 comp rx=0 tx=0).stop 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 shutdown_connections 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x5578a9df6a70 0x5578a9e10a80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5578a9d70ab0 0x5578a9da6270 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f8550ff9640 0 client.6537 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5578a9d70190 0x5578a9da5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 --2- 172.21.15.66:0/2879092778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5578a9d6f350 0x5578a9da2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 >> 172.21.15.66:0/2879092778 conn(0x5578a9d47ea0 msgr2=0x5578a9d8e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 shutdown_connections 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.473+0000 7f857a9de740 1 -- 172.21.15.66:0/2879092778 wait complete. 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f857a9de740 20 client.6537 trim_cache size 0 max 16384 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "9e6aba81-e53b-47a6-bca7-d0bd2133ed12", 2024-05-10T11:16:55.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:16:55.481 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:16:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f85540762d0 msgr2=0x7f8554078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f85540762d0 0x7f8554078790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f856c007fd0 tx=0x7f856c009040 comp rx=0 tx=0).stop 2024-05-10T11:16:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 msgr2=0x7f85700cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 0x7f85700cf2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8568009eb0 tx=0x7f8568004a40 comp rx=0 tx=0).stop 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 shutdown_connections 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f85540762d0 0x7f8554078790 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f857015b7b0 0x7f85700cf2f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f857015b3d0 0x7f857015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 --2- 172.21.15.66:0/696759123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85700b4c00 0x7f85701f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 >> 172.21.15.66:0/696759123 conn(0x7f857006c4a0 msgr2=0x7f857015e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 shutdown_connections 2024-05-10T11:16:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.474+0000 7f8577cc8640 1 -- 172.21.15.66:0/696759123 wait complete. 2024-05-10T11:16:55.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:16:55.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T11:16:55.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.591+0000 7f99e8cda640 1 Processor -- start 2024-05-10T11:16:55.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.591+0000 7f99e8cda640 1 -- start start 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e8cda640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f99e4160870 0x7f99e40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e8cda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f99e40cfcc0 0x7f99e40cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e8cda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e4160c50 con 0x7f99e40cdf90 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e8cda640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f99e40d39d0 con 0x7f99e40cfcc0 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e8cda640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f99e40d3cb0 con 0x7f99e4160870 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99dbfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f99e40cfcc0 0x7f99e40cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e2d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f99e40cdf90 0x7f99e40ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:54864/0 (socket says 172.21.15.66:54864) 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e2d9d640 1 -- 172.21.15.66:0/3926374936 learned_addr learned my addr 172.21.15.66:0/3926374936 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:16:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e259c640 1 --2- 172.21.15.66:0/3926374936 >> v2:172.21.15.190:3300/0 conn(0x7f99e4160870 0x7f99e40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99dbfff640 1 -- 172.21.15.66:0/3926374936 >> v2:172.21.15.190:3300/0 conn(0x7f99e4160870 msgr2=0x7f99e40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99dbfff640 1 --2- 172.21.15.66:0/3926374936 >> v2:172.21.15.190:3300/0 conn(0x7f99e4160870 0x7f99e40cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99dbfff640 1 -- 172.21.15.66:0/3926374936 >> v1:172.21.15.66:6789/0 conn(0x7f99e40cdf90 legacy=0x7f99e40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99dbfff640 1 -- 172.21.15.66:0/3926374936 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e40d1770 con 0x7f99e40cfcc0 2024-05-10T11:16:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.592+0000 7f99e259c640 1 --2- 172.21.15.66:0/3926374936 >> v2:172.21.15.190:3300/0 conn(0x7f99e4160870 0x7f99e40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.593+0000 7f99dbfff640 1 --2- 172.21.15.66:0/3926374936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40cda50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f99e40d2e10 tx=0x7f99cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418a4331325ac8fd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.593+0000 7f99e1d9b640 1 -- 172.21.15.66:0/3926374936 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc037070 con 0x7f99e40cfcc0 2024-05-10T11:16:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.593+0000 7f99e1d9b640 1 -- 172.21.15.66:0/3926374936 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc032440 con 0x7f99e40cfcc0 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.593+0000 7f99e1d9b640 1 -- 172.21.15.66:0/3926374936 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc02ae60 con 0x7f99e40cfcc0 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 -- 172.21.15.66:0/3926374936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 msgr2=0x7f99e40cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 --2- 172.21.15.66:0/3926374936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40cda50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f99e40d2e10 tx=0x7f99cc02a110 comp rx=0 tx=0).stop 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 -- 172.21.15.66:0/3926374936 shutdown_connections 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 --2- 172.21.15.66:0/3926374936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40cda50 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 --2- 172.21.15.66:0/3926374936 >> v2:172.21.15.190:3300/0 conn(0x7f99e4160870 0x7f99e40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 -- 172.21.15.66:0/3926374936 >> 172.21.15.66:0/3926374936 conn(0x7f99e40d2eb0 msgr2=0x7f99e40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 -- 172.21.15.66:0/3926374936 shutdown_connections 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.594+0000 7f99e8cda640 1 -- 172.21.15.66:0/3926374936 wait complete. 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.595+0000 7f99e8cda640 1 Processor -- start 2024-05-10T11:16:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.595+0000 7f99e8cda640 1 -- start start 2024-05-10T11:16:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e8cda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99e40cdf90 0x7f99e40b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e8cda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e8cda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99e4160870 0x7f99e40c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e8cda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40d1460 con 0x7f99e40cfcc0 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e8cda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40d1d30 con 0x7f99e40cdf90 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e8cda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f99e40ceab0 con 0x7f99e4160870 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51314/0 (socket says 172.21.15.66:51314) 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 -- 172.21.15.66:0/212173569 learned_addr learned my addr 172.21.15.66:0/212173569 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99e4160870 0x7f99e40c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e259c640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99e40cdf90 0x7f99e40b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 -- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99e4160870 msgr2=0x7f99e40c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99e4160870 0x7f99e40c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 -- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99e40cdf90 msgr2=0x7f99e40b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99e40cdf90 0x7f99e40b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99dbfff640 1 -- 172.21.15.66:0/212173569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e40c7f60 con 0x7f99e40cfcc0 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.596+0000 7f99e259c640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99e40cdf90 0x7f99e40b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.597+0000 7f99dbfff640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40c7370 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c00 tx=0x7f99cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.597+0000 7f99daffd640 1 -- 172.21.15.66:0/212173569 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc037040 con 0x7f99e40cfcc0 2024-05-10T11:16:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.597+0000 7f99daffd640 1 -- 172.21.15.66:0/212173569 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc042070 con 0x7f99e40cfcc0 2024-05-10T11:16:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.597+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e40c8240 con 0x7f99e40cfcc0 2024-05-10T11:16:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.597+0000 7f99daffd640 1 -- 172.21.15.66:0/212173569 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc030bd0 con 0x7f99e40cfcc0 2024-05-10T11:16:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.597+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e40b70f0 con 0x7f99e40cfcc0 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.598+0000 7f99daffd640 1 -- 172.21.15.66:0/212173569 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f99cc047460 con 0x7f99e40cfcc0 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.599+0000 7f99daffd640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99c40762d0 0x7f99c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.599+0000 7f99daffd640 1 -- 172.21.15.66:0/212173569 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f99cc0b83a0 con 0x7f99e40cfcc0 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.599+0000 7f99e259c640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99c40762d0 0x7f99c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.600+0000 7f99e259c640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99c40762d0 0x7f99c4078790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99d4006fd0 tx=0x7f99d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.600+0000 7f99eb9f7740 1 Processor -- start 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.600+0000 7f99eb9f7740 1 -- start start 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c4fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c52d280 0x56179c52c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52cb40 0x56179c501950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56179c4c9690 con 0x56179c54a160 2024-05-10T11:16:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56179c466f30 con 0x56179c52d280 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56179c41fb20 con 0x56179c52cb40 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c4fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c4fcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51328/0 (socket says 172.21.15.66:51328) 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 -- 172.21.15.66:0/3907125309 learned_addr learned my addr 172.21.15.66:0/3907125309 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99dbfff640 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c52d280 0x56179c52c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52cb40 0x56179c501950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 -- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52cb40 msgr2=0x56179c501950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52cb40 0x56179c501950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 -- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c52d280 msgr2=0x56179c52c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c52d280 0x56179c52c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 -- 172.21.15.66:0/3907125309 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179c417e60 con 0x56179c54a160 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99e259c640 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c4fcaf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f99d400e980 tx=0x7f99d4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85d98a8502f7693 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99c3fff640 1 -- 172.21.15.66:0/3907125309 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4025070 con 0x56179c54a160 2024-05-10T11:16:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99c3fff640 1 -- 172.21.15.66:0/3907125309 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d4015700 con 0x56179c54a160 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.601+0000 7f99c3fff640 1 -- 172.21.15.66:0/3907125309 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d400f040 con 0x56179c54a160 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3907125309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 msgr2=0x56179c4fcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c4fcaf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f99d400e980 tx=0x7f99d4011000 comp rx=0 tx=0).stop 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3907125309 shutdown_connections 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52cb40 0x56179c501950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c52d280 0x56179c52c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3907125309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c4fcaf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3907125309 >> 172.21.15.66:0/3907125309 conn(0x56179c4fed60 msgr2=0x56179c547600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3907125309 shutdown_connections 2024-05-10T11:16:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.602+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3907125309 wait complete. 2024-05-10T11:16:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.603+0000 7f99eb9f7740 1 -- start start 2024-05-10T11:16:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.603+0000 7f99eb9f7740 1 Processor -- start 2024-05-10T11:16:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52d280 0x56179c548b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c52e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c51ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56179c4235e0 con 0x56179c54a160 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56179c462ef0 con 0x56179c51c9a0 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56179c500f10 con 0x56179c52d280 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99eb9f7740 10 client.0 _ll_register_callbacks cb 0x56179c41e320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c52e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c52e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51342/0 (socket says 172.21.15.66:51342) 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 -- 172.21.15.66:0/4119885486 learned_addr learned my addr 172.21.15.66:0/4119885486 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99e259c640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52d280 0x56179c548b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c51ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 -- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52d280 msgr2=0x56179c548b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52d280 0x56179c548b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 -- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 msgr2=0x56179c51ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c51ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 -- 172.21.15.66:0/4119885486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56179c2427d0 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c51ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99dbfff640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c52e180 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f99cc02a150 tx=0x7f99cc080db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf672b651f0a4d5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.604+0000 7f99c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99c17fa640 1 -- 172.21.15.66:0/4119885486 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc081800 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99c17fa640 1 -- 172.21.15.66:0/4119885486 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f99cc089ce0 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99d4015700 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99c17fa640 1 -- 172.21.15.66:0/4119885486 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f99cc0813a0 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 10 client.6552 fetch_fsmap learned FSMap version 52 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x56179c1783f0 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99c17fa640 1 -- 172.21.15.66:0/4119885486 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d4015700 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99c17fa640 1 -- 172.21.15.66:0/4119885486 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f99cc03a030 con 0x56179c54a160 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 10 client.6552 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T11:16:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 10 client.6552 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 20 client.6552 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c53e790 0x56179c53eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 4 client.6552 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56179c474b40 con 0x56179c53e790 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99e259c640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c53e790 0x56179c53eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99c17fa640 10 client.6552 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.605+0000 7f99e259c640 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c53e790 0x56179c53eba0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1001fa5223aaa3c6 server_cookie=bc48686f7a620d0d in_seq=0 out_seq=0 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99c17fa640 1 -- 172.21.15.66:0/4119885486 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56179c474b40 con 0x56179c53e790 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99c17fa640 10 client.6552 handle_command_reply: tid=0 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 client.6552 shutdown 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 msgr2=0x56179c52e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c52e180 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f99cc02a150 tx=0x7f99cc080db0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 shutdown_connections 2024-05-10T11:16:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c53e790 0x56179c53eba0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c51ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c54a160 0x56179c52e180 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/4119885486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c52d280 0x56179c548b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99c17fa640 0 client.6552 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 >> 172.21.15.66:0/4119885486 conn(0x56179c52cb40 msgr2=0x56179c4fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 shutdown_connections 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 1 -- 172.21.15.66:0/4119885486 wait complete. 2024-05-10T11:16:55.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.606+0000 7f99eb9f7740 20 client.6552 trim_cache size 0 max 16384 2024-05-10T11:16:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 Processor -- start 2024-05-10T11:16:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 -- start start 2024-05-10T11:16:55.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c5561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c556710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c54a160 0x56179c547400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99e41ffdf0 con 0x56179c52d280 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f99e41fee70 con 0x56179c51c9a0 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f99e40b5d50 con 0x56179c54a160 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c556710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c556710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51354/0 (socket says 172.21.15.66:51354) 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.625+0000 7f99dbfff640 1 -- 172.21.15.66:0/3841537054 learned_addr learned my addr 172.21.15.66:0/3841537054 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99e259c640 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c5561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c54a160 0x56179c547400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99dbfff640 1 -- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c54a160 msgr2=0x56179c547400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99dbfff640 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c54a160 0x56179c547400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99dbfff640 1 -- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 msgr2=0x56179c5561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99dbfff640 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c5561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99dbfff640 1 -- 172.21.15.66:0/3841537054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179c1380f0 con 0x56179c52d280 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99e259c640 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c5561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99dbfff640 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c556710 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f99cc006a50 tx=0x7f99cc049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf392e138954bca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99c37fe640 1 -- 172.21.15.66:0/3841537054 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0b3020 con 0x56179c52d280 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99c37fe640 1 -- 172.21.15.66:0/3841537054 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc08a170 con 0x56179c52d280 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99c37fe640 1 -- 172.21.15.66:0/3841537054 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc081170 con 0x56179c52d280 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.626+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3841537054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 msgr2=0x56179c556710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c556710 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f99cc006a50 tx=0x7f99cc049000 comp rx=0 tx=0).stop 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3841537054 shutdown_connections 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c54a160 0x56179c547400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c556710 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/3841537054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c51c9a0 0x56179c5561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3841537054 >> 172.21.15.66:0/3841537054 conn(0x56179c52cb40 msgr2=0x56179c53f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3841537054 shutdown_connections 2024-05-10T11:16:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 -- 172.21.15.66:0/3841537054 wait complete. 2024-05-10T11:16:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 -- start start 2024-05-10T11:16:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.627+0000 7f99eb9f7740 1 Processor -- start 2024-05-10T11:16:55.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c51c9a0 0x56179c5b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c53cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c54a160 0x56179c52e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40b63a0 con 0x56179c52d280 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56179c530a70 con 0x56179c54a160 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56179c53da40 con 0x56179c51c9a0 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99eb9f7740 10 client.0 _ll_register_callbacks cb 0x7f99cc006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c53cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c53cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51356/0 (socket says 172.21.15.66:51356) 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99dbfff640 1 -- 172.21.15.66:0/263263259 learned_addr learned my addr 172.21.15.66:0/263263259 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99e259c640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c51c9a0 0x56179c5b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.628+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c54a160 0x56179c52e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99dbfff640 1 -- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c51c9a0 msgr2=0x56179c5b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99dbfff640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c51c9a0 0x56179c5b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99dbfff640 1 -- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c54a160 msgr2=0x56179c52e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99dbfff640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c54a160 0x56179c52e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99dbfff640 1 -- 172.21.15.66:0/263263259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56179c560bd0 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99e2d9d640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c54a160 0x56179c52e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99dbfff640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c53cf90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0810a0 tx=0x7f99cc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f31c8f1de6186a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99c17fa640 1 -- 172.21.15.66:0/263263259 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0b3070 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99c17fa640 1 -- 172.21.15.66:0/263263259 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f99cc089ce0 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99cc08a170 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99c17fa640 1 -- 172.21.15.66:0/263263259 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f99cc07d9f0 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 10 client.6558 fetch_fsmap learned FSMap version 52 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x56179c560bd0 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99c17fa640 1 -- 172.21.15.66:0/263263259 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc08a170 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99c17fa640 1 -- 172.21.15.66:0/263263259 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f99cc045ba0 con 0x56179c52d280 2024-05-10T11:16:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 10 client.6558 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 10 client.6558 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 20 client.6558 populate_metadata read hostname 'smithi066' 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c5606c0 0x56179c5ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 4 client.6558 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56179c46e9b0 con 0x56179c5606c0 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.629+0000 7f99e259c640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c5606c0 0x56179c5ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99c17fa640 10 client.6558 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99e259c640 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c5606c0 0x56179c5ce0d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ee92178dbbaa25 server_cookie=8632004a609d90e in_seq=0 out_seq=0 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99c17fa640 1 -- 172.21.15.66:0/263263259 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56179c46e9b0 con 0x56179c5606c0 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99c17fa640 10 client.6558 handle_command_reply: tid=0 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 client.6558 shutdown 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 msgr2=0x56179c53cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c53cf90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0810a0 tx=0x7f99cc009190 comp rx=0 tx=0).stop 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 shutdown_connections 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x56179c5606c0 0x56179c5ce0d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56179c54a160 0x56179c52e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56179c52d280 0x56179c53cf90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 --2- 172.21.15.66:0/263263259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56179c51c9a0 0x56179c5b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99c17fa640 0 client.6558 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 >> 172.21.15.66:0/263263259 conn(0x56179c52cb40 msgr2=0x56179c52d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 shutdown_connections 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.630+0000 7f99eb9f7740 1 -- 172.21.15.66:0/263263259 wait complete. 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99eb9f7740 20 client.6558 trim_cache size 0 max 16384 2024-05-10T11:16:55.637 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: "9e6aba81-e53b-47a6-bca7-d0bd2133ed12": { 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/subdir", 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "9e6aba81-e53b-47a6-bca7-d0bd2133ed12", 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive" 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:16:55.638 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99c40762d0 msgr2=0x7f99c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99c40762d0 0x7f99c4078790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99d4006fd0 tx=0x7f99d4008040 comp rx=0 tx=0).stop 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 msgr2=0x7f99e40c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40c7370 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c00 tx=0x7f99cc0046c0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 shutdown_connections 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f99c40762d0 0x7f99c4078790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99e4160870 0x7f99e40c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99e40cfcc0 0x7f99e40c7370 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 --2- 172.21.15.66:0/212173569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99e40cdf90 0x7f99e40b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:16:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 >> 172.21.15.66:0/212173569 conn(0x7f99e40d2eb0 msgr2=0x7f99e40d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:16:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 shutdown_connections 2024-05-10T11:16:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:16:55.631+0000 7f99e8cda640 1 -- 172.21.15.66:0/212173569 wait complete. 2024-05-10T11:16:55.642 INFO:tasks.cephfs.filesystem:scrub status for tag:9e6aba81-e53b-47a6-bca7-d0bd2133ed12 - {'path': '/subdir', 'tag': '9e6aba81-e53b-47a6-bca7-d0bd2133ed12', 'options': 'recursive'} 2024-05-10T11:16:58.987 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:16:58.987+0000 7fa7d81b5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T11:17:02.009 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:17:02.012 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:17:25.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:25.644 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T11:17:25.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.763+0000 7ff852d51640 1 Processor -- start 2024-05-10T11:17:25.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.763+0000 7ff852d51640 1 -- start start 2024-05-10T11:17:25.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff852d51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 0x7ff84c0739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff852d51640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff84c073f20 0x7ff84c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff852d51640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c157a40 con 0x7ff84c06c2c0 2024-05-10T11:17:25.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff852d51640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff84c161990 con 0x7ff84c073f20 2024-05-10T11:17:25.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff852d51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c160d80 con 0x7ff84c06df20 2024-05-10T11:17:25.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff84bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 0x7ff84c0739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff8512ee640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff84c073f20 0x7ff84c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff84bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 0x7ff84c0739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:38140/0 (socket says 172.21.15.66:38140) 2024-05-10T11:17:25.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff850aed640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff84c06c2c0 0x7ff84c06c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:46348/0 (socket says 172.21.15.66:46348) 2024-05-10T11:17:25.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff84bfff640 1 -- 172.21.15.66:0/2645291942 learned_addr learned my addr 172.21.15.66:0/2645291942 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff84bfff640 1 -- 172.21.15.66:0/2645291942 >> v2:172.21.15.190:3300/0 conn(0x7ff84c073f20 msgr2=0x7ff84c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff84bfff640 1 --2- 172.21.15.66:0/2645291942 >> v2:172.21.15.190:3300/0 conn(0x7ff84c073f20 0x7ff84c15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.764+0000 7ff84bfff640 1 -- 172.21.15.66:0/2645291942 >> v1:172.21.15.190:6789/0 conn(0x7ff84c06c2c0 legacy=0x7ff84c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.765+0000 7ff84bfff640 1 -- 172.21.15.66:0/2645291942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c161060 con 0x7ff84c06df20 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.765+0000 7ff8512ee640 1 --2- 172.21.15.66:0/2645291942 >> v2:172.21.15.190:3300/0 conn(0x7ff84c073f20 0x7ff84c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.765+0000 7ff84bfff640 1 --2- 172.21.15.66:0/2645291942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 0x7ff84c0739e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff83802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94e5acbf91cc5221 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.765+0000 7ff84b7fe640 1 -- 172.21.15.66:0/2645291942 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838037070 con 0x7ff84c06df20 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff84b7fe640 1 -- 172.21.15.66:0/2645291942 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff838032440 con 0x7ff84c06df20 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff84b7fe640 1 -- 172.21.15.66:0/2645291942 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838032810 con 0x7ff84c06df20 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 -- 172.21.15.66:0/2645291942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 msgr2=0x7ff84c0739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 --2- 172.21.15.66:0/2645291942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 0x7ff84c0739e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff83802a270 comp rx=0 tx=0).stop 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 -- 172.21.15.66:0/2645291942 shutdown_connections 2024-05-10T11:17:25.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 --2- 172.21.15.66:0/2645291942 >> v2:172.21.15.190:3300/0 conn(0x7ff84c073f20 0x7ff84c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 --2- 172.21.15.66:0/2645291942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c06df20 0x7ff84c0739e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 -- 172.21.15.66:0/2645291942 >> 172.21.15.66:0/2645291942 conn(0x7ff84c0d0c90 msgr2=0x7ff84c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 -- 172.21.15.66:0/2645291942 shutdown_connections 2024-05-10T11:17:25.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.766+0000 7ff852d51640 1 -- 172.21.15.66:0/2645291942 wait complete. 2024-05-10T11:17:25.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.768+0000 7ff852d51640 1 Processor -- start 2024-05-10T11:17:25.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.768+0000 7ff852d51640 1 -- start start 2024-05-10T11:17:25.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff852d51640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff84c06c2c0 0x7ff84c15e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff852d51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 0x7ff84c15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff852d51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c073f20 0x7ff84c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff852d51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c0cd440 con 0x7ff84c06df20 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff852d51640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c161620 con 0x7ff84c06c2c0 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff852d51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c072180 con 0x7ff84c073f20 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 0x7ff84c15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 0x7ff84c15c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55908/0 (socket says 172.21.15.66:55908) 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 -- 172.21.15.66:0/1719608947 learned_addr learned my addr 172.21.15.66:0/1719608947 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff850aed640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff84c06c2c0 0x7ff84c15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff8512ee640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c073f20 0x7ff84c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 -- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c073f20 msgr2=0x7ff84c1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c073f20 0x7ff84c1f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 -- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff84c06c2c0 msgr2=0x7ff84c15e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff84c06c2c0 0x7ff84c15e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff84bfff640 1 -- 172.21.15.66:0/1719608947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c15f2c0 con 0x7ff84c06df20 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.769+0000 7ff8512ee640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c073f20 0x7ff84c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.770+0000 7ff84bfff640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 0x7ff84c15c2a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff8380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.770+0000 7ff8497fa640 1 -- 172.21.15.66:0/1719608947 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838041070 con 0x7ff84c06df20 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.770+0000 7ff8497fa640 1 -- 172.21.15.66:0/1719608947 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83803c890 con 0x7ff84c06df20 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.770+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c15f5a0 con 0x7ff84c06df20 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.770+0000 7ff8497fa640 1 -- 172.21.15.66:0/1719608947 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838037040 con 0x7ff84c06df20 2024-05-10T11:17:25.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.770+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c15eeb0 con 0x7ff84c06df20 2024-05-10T11:17:25.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.772+0000 7ff8497fa640 1 -- 172.21.15.66:0/1719608947 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff838044070 con 0x7ff84c06df20 2024-05-10T11:17:25.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.772+0000 7ff8497fa640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff8300762d0 0x7ff830078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.772+0000 7ff8497fa640 1 -- 172.21.15.66:0/1719608947 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff8380b80a0 con 0x7ff84c06df20 2024-05-10T11:17:25.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.772+0000 7ff850aed640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff8300762d0 0x7ff830078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.773+0000 7ff855a6f740 1 Processor -- start 2024-05-10T11:17:25.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.773+0000 7ff855a6f740 1 -- start start 2024-05-10T11:17:25.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.773+0000 7ff850aed640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff8300762d0 0x7ff830078790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff840007fd0 tx=0x7ff840007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e7160 0x564f15199af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151ca280 0x564f151c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 0x564f1519e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff855a6f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564f15166690 con 0x564f151c9b40 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f15103f30 con 0x564f151e7160 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564f150bcb20 con 0x564f151ca280 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 0x564f1519e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 0x564f1519e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55920/0 (socket says 172.21.15.66:55920) 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 -- 172.21.15.66:0/4010806155 learned_addr learned my addr 172.21.15.66:0/4010806155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff84bfff640 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151ca280 0x564f151c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff850aed640 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e7160 0x564f15199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 -- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151ca280 msgr2=0x564f151c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151ca280 0x564f151c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 -- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e7160 msgr2=0x564f15199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e7160 0x564f15199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 -- 172.21.15.66:0/4010806155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f150b4e60 con 0x564f151c9b40 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8512ee640 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 0x564f1519e950 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff8440074f0 tx=0x7ff844009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc561b7c00f73438 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8367fc640 1 -- 172.21.15.66:0/4010806155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84401a020 con 0x564f151c9b40 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8367fc640 1 -- 172.21.15.66:0/4010806155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff844016680 con 0x564f151c9b40 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.774+0000 7ff8367fc640 1 -- 172.21.15.66:0/4010806155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844016a30 con 0x564f151c9b40 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 -- 172.21.15.66:0/4010806155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 msgr2=0x564f1519e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 0x564f1519e950 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff8440074f0 tx=0x7ff844009750 comp rx=0 tx=0).stop 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 -- 172.21.15.66:0/4010806155 shutdown_connections 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151c9b40 0x564f1519e950 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151ca280 0x564f151c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 --2- 172.21.15.66:0/4010806155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e7160 0x564f15199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 -- 172.21.15.66:0/4010806155 >> 172.21.15.66:0/4010806155 conn(0x564f1519bd60 msgr2=0x564f151e4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 -- 172.21.15.66:0/4010806155 shutdown_connections 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.775+0000 7ff855a6f740 1 -- 172.21.15.66:0/4010806155 wait complete. 2024-05-10T11:17:25.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.776+0000 7ff855a6f740 1 -- start start 2024-05-10T11:17:25.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.776+0000 7ff855a6f740 1 Processor -- start 2024-05-10T11:17:25.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564f150c05e0 con 0x564f151ca280 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f150ffef0 con 0x564f151e6400 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564f1519df10 con 0x564f151e7160 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 10 client.0 _ll_register_callbacks cb 0x564f150bb320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55934/0 (socket says 172.21.15.66:55934) 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 -- 172.21.15.66:0/1996172186 learned_addr learned my addr 172.21.15.66:0/1996172186 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff84bfff640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff8512ee640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 -- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 msgr2=0x564f151ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 -- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 msgr2=0x564f151f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 -- 172.21.15.66:0/1996172186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f14edf7d0 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff850aed640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151c8fb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff840001e50 tx=0x7ff840000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8cb0aadf165735 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff82b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff82b7fe640 1 -- 172.21.15.66:0/1996172186 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840026060 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff82b7fe640 1 -- 172.21.15.66:0/1996172186 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff840013e00 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.777+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff844016680 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff82b7fe640 1 -- 172.21.15.66:0/1996172186 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7ff840019070 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 10 client.6567 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x564f14e153f0 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff82b7fe640 1 -- 172.21.15.66:0/1996172186 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff844016680 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff82b7fe640 1 -- 172.21.15.66:0/1996172186 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7ff84001f070 con 0x564f151ca280 2024-05-10T11:17:25.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 10 client.6567 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 10 client.6567 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 20 client.6567 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f151c4d60 0x564f151c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 4 client.6567 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f15111b40 con 0x564f151c4d60 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff84bfff640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f151c4d60 0x564f151c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff82b7fe640 10 client.6567 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.778+0000 7ff84bfff640 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f151c4d60 0x564f151c5210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7803140c4461ea server_cookie=ff72e144207f0377 in_seq=0 out_seq=0 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff82b7fe640 1 -- 172.21.15.66:0/1996172186 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f15111b40 con 0x564f151c4d60 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff82b7fe640 10 client.6567 handle_command_reply: tid=0 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 client.6567 shutdown 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 msgr2=0x564f151c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151c8fb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff840001e50 tx=0x7ff840000bc0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 shutdown_connections 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f151c4d60 0x564f151c5210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff82b7fe640 0 client.6567 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 --2- 172.21.15.66:0/1996172186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151c8fb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 >> 172.21.15.66:0/1996172186 conn(0x564f151c9b40 msgr2=0x564f15199230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 shutdown_connections 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.779+0000 7ff855a6f740 1 -- 172.21.15.66:0/1996172186 wait complete. 2024-05-10T11:17:25.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.780+0000 7ff855a6f740 20 client.6567 trim_cache size 0 max 16384 2024-05-10T11:17:25.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.798+0000 7ff855a6f740 1 Processor -- start 2024-05-10T11:17:25.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.798+0000 7ff855a6f740 1 -- start start 2024-05-10T11:17:25.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff855a6f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c202000 con 0x564f151ca280 2024-05-10T11:17:25.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c201040 con 0x564f151e6400 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0cffc0 con 0x564f151e7160 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151e3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55946/0 (socket says 172.21.15.66:55946) 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 -- 172.21.15.66:0/3156922382 learned_addr learned my addr 172.21.15.66:0/3156922382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff84bfff640 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff8512ee640 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 -- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 msgr2=0x564f151e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 -- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 msgr2=0x564f151e02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151e02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 -- 172.21.15.66:0/3156922382 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f151caae0 con 0x564f151ca280 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff850aed640 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151e3b80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff8400125e0 tx=0x7ff84001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824ec86ffb599195 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.799+0000 7ff835ffb640 1 -- 172.21.15.66:0/3156922382 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840012700 con 0x564f151ca280 2024-05-10T11:17:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff835ffb640 1 -- 172.21.15.66:0/3156922382 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8400129e0 con 0x564f151ca280 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff835ffb640 1 -- 172.21.15.66:0/3156922382 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840012b90 con 0x564f151ca280 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 -- 172.21.15.66:0/3156922382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 msgr2=0x564f151e3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151e3b80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff8400125e0 tx=0x7ff84001f000 comp rx=0 tx=0).stop 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 -- 172.21.15.66:0/3156922382 shutdown_connections 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e7160 0x564f151e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151e6400 0x564f151e02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 --2- 172.21.15.66:0/3156922382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151ca280 0x564f151e3b80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 -- 172.21.15.66:0/3156922382 >> 172.21.15.66:0/3156922382 conn(0x564f151c9b40 msgr2=0x564f151e7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 -- 172.21.15.66:0/3156922382 shutdown_connections 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.800+0000 7ff855a6f740 1 -- 172.21.15.66:0/3156922382 wait complete. 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.801+0000 7ff855a6f740 1 -- start start 2024-05-10T11:17:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.801+0000 7ff855a6f740 1 Processor -- start 2024-05-10T11:17:25.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151ca280 0x564f151c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e6400 0x564f15261a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 0x564f151e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c200a90 con 0x564f151e7160 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f151db260 con 0x564f151ca280 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564f15262700 con 0x564f151e6400 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff855a6f740 10 client.0 _ll_register_callbacks cb 0x7ff840004aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 0x564f151e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 0x564f151e02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55960/0 (socket says 172.21.15.66:55960) 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 -- 172.21.15.66:0/181700997 learned_addr learned my addr 172.21.15.66:0/181700997 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff850aed640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151ca280 0x564f151c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff84bfff640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e6400 0x564f15261a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 -- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e6400 msgr2=0x564f15261a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e6400 0x564f15261a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 -- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151ca280 msgr2=0x564f151c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151ca280 0x564f151c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 -- 172.21.15.66:0/181700997 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f14dd50f0 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff8512ee640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 0x564f151e02d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff844007490 tx=0x7ff844004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ed67f468d335d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff82b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.802+0000 7ff82b7fe640 1 -- 172.21.15.66:0/181700997 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84401a050 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff82b7fe640 1 -- 172.21.15.66:0/181700997 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff844016dc0 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8400129e0 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff82b7fe640 1 -- 172.21.15.66:0/181700997 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7ff844031050 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 10 client.6573 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x564f15262440 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff82b7fe640 1 -- 172.21.15.66:0/181700997 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8400129e0 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff82b7fe640 1 -- 172.21.15.66:0/181700997 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7ff844034020 con 0x564f151e7160 2024-05-10T11:17:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 10 client.6573 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 10 client.6573 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 20 client.6573 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f15261fc0 0x564f151e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 4 client.6573 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f1510b9b0 con 0x564f15261fc0 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.803+0000 7ff850aed640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f15261fc0 0x564f151e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff82b7fe640 10 client.6573 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff850aed640 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f15261fc0 0x564f151e0810 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557c2b7dc0276ab5 server_cookie=44a967e20921fa5b in_seq=0 out_seq=0 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff82b7fe640 1 -- 172.21.15.66:0/181700997 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564f1510b9b0 con 0x564f15261fc0 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff82b7fe640 10 client.6573 handle_command_reply: tid=0 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 client.6573 shutdown 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 msgr2=0x564f151e02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 0x564f151e02d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff844007490 tx=0x7ff844004ab0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 shutdown_connections 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x564f15261fc0 0x564f151e0810 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f151e7160 0x564f151e02d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f151e6400 0x564f15261a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 --2- 172.21.15.66:0/181700997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f151ca280 0x564f151c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff82b7fe640 0 client.6573 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 >> 172.21.15.66:0/181700997 conn(0x564f151c9b40 msgr2=0x564f15194fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 shutdown_connections 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 1 -- 172.21.15.66:0/181700997 wait complete. 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.804+0000 7ff855a6f740 20 client.6573 trim_cache size 0 max 16384 2024-05-10T11:17:25.811 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:17:25.812 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:17:25.812 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:17:25.812 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff8300762d0 msgr2=0x7ff830078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff8300762d0 0x7ff830078790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff840007fd0 tx=0x7ff840007e80 comp rx=0 tx=0).stop 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 msgr2=0x7ff84c15c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 0x7ff84c15c2a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff8380046c0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 shutdown_connections 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff8300762d0 0x7ff830078790 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff84c073f20 0x7ff84c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff84c06df20 0x7ff84c15c2a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 --2- 172.21.15.66:0/1719608947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff84c06c2c0 0x7ff84c15e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 >> 172.21.15.66:0/1719608947 conn(0x7ff84c0d0c90 msgr2=0x7ff84c0b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 shutdown_connections 2024-05-10T11:17:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.805+0000 7ff852d51640 1 -- 172.21.15.66:0/1719608947 wait complete. 2024-05-10T11:17:25.816 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:17:25.816 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:17:25.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.920+0000 7ff74070a640 1 Processor -- start 2024-05-10T11:17:25.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.920+0000 7ff74070a640 1 -- start start 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff74070a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff74070a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff7380c65f0 0x7ff73815d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff74070a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7380c6a80 con 0x7ff73815ce60 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff74070a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff7380cd090 con 0x7ff7380c65f0 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff74070a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380cd370 con 0x7ff7381611e0 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73e4a6640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff73815ce60 0x7ff738160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59196/0 (socket says 172.21.15.66:59196) 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73e4a6640 1 -- 172.21.15.66:0/1843901459 learned_addr learned my addr 172.21.15.66:0/1843901459 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73eca7640 1 --2- 172.21.15.66:0/1843901459 >> v2:172.21.15.66:3300/0 conn(0x7ff7380c65f0 0x7ff73815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73d4a4640 1 -- 172.21.15.66:0/1843901459 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448874488 0 0) 0x7ff734001110 con 0x7ff73815ce60 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73d4a4640 1 -- 172.21.15.66:0/1843901459 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff724003520 con 0x7ff73815ce60 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73dca5640 1 --2- 172.21.15.66:0/1843901459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73eca7640 1 -- 172.21.15.66:0/1843901459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 msgr2=0x7ff7380cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73eca7640 1 --2- 172.21.15.66:0/1843901459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73eca7640 1 -- 172.21.15.66:0/1843901459 >> v1:172.21.15.66:6789/0 conn(0x7ff73815ce60 legacy=0x7ff738160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.921+0000 7ff73eca7640 1 -- 172.21.15.66:0/1843901459 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380cd650 con 0x7ff7380c65f0 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.922+0000 7ff73eca7640 1 --2- 172.21.15.66:0/1843901459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7380c65f0 0x7ff73815d240 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff730009d90 tx=0x7ff73002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4585d27393613dcc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.922+0000 7ff73d4a4640 1 -- 172.21.15.66:0/1843901459 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730031600 con 0x7ff7380c65f0 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.922+0000 7ff73d4a4640 1 -- 172.21.15.66:0/1843901459 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7300317a0 con 0x7ff7380c65f0 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.922+0000 7ff73d4a4640 1 -- 172.21.15.66:0/1843901459 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730031b70 con 0x7ff7380c65f0 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 -- 172.21.15.66:0/1843901459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7380c65f0 msgr2=0x7ff73815d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 --2- 172.21.15.66:0/1843901459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7380c65f0 0x7ff73815d240 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff730009d90 tx=0x7ff73002a5d0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 -- 172.21.15.66:0/1843901459 shutdown_connections 2024-05-10T11:17:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 --2- 172.21.15.66:0/1843901459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7380c65f0 0x7ff73815d240 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 --2- 172.21.15.66:0/1843901459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 -- 172.21.15.66:0/1843901459 >> 172.21.15.66:0/1843901459 conn(0x7ff7380b2900 msgr2=0x7ff7380b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:25.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 -- 172.21.15.66:0/1843901459 shutdown_connections 2024-05-10T11:17:25.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.923+0000 7ff74070a640 1 -- 172.21.15.66:0/1843901459 wait complete. 2024-05-10T11:17:25.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.924+0000 7ff74070a640 1 Processor -- start 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.924+0000 7ff74070a640 1 -- start start 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff74070a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7380c65f0 0x7ff7380b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff74070a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 0x7ff7380d1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff74070a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff74070a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380cde50 con 0x7ff73815ce60 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff74070a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380ccd60 con 0x7ff7380c65f0 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff74070a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380cdfd0 con 0x7ff7381611e0 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 0x7ff7380d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 0x7ff7380d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55980/0 (socket says 172.21.15.66:55980) 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 -- 172.21.15.66:0/3724487404 learned_addr learned my addr 172.21.15.66:0/3724487404 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73e4a6640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7380c65f0 0x7ff7380b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73eca7640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 -- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 msgr2=0x7ff7380c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 -- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7380c65f0 msgr2=0x7ff7380b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7380c65f0 0x7ff7380b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73dca5640 1 -- 172.21.15.66:0/3724487404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73809c320 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.925+0000 7ff73eca7640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.926+0000 7ff73dca5640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 0x7ff7380d1410 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff72800d620 tx=0x7ff72800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.926+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72800b620 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.926+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff728019070 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.926+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73809c600 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.926+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72800ba00 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.926+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73809cbc0 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.927+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73809d000 con 0x7ff73815ce60 2024-05-10T11:17:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.927+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff72800bba0 con 0x7ff73815ce60 2024-05-10T11:17:25.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.928+0000 7ff72effd640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff71c0762d0 0x7ff71c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:25.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.928+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff728097ac0 con 0x7ff73815ce60 2024-05-10T11:17:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.928+0000 7ff73e4a6640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff71c0762d0 0x7ff71c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.929+0000 7ff73e4a6640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff71c0762d0 0x7ff71c078790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff734005880 tx=0x7ff734009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:25.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:25.933+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff7280612d0 con 0x7ff73815ce60 2024-05-10T11:17:26.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.162+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff738074010 con 0x7ff73815ce60 2024-05-10T11:17:26.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.163+0000 7ff72effd640 1 -- 172.21.15.66:0/3724487404 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5184 (secure 0 0 0) 0x7ff728060bd0 con 0x7ff73815ce60 2024-05-10T11:17:26.164 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:17:26.164 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":53,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:16:58.966422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:17:26.164 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 53 2024-05-10T11:17:26.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff71c0762d0 msgr2=0x7ff71c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff71c0762d0 0x7ff71c078790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff734005880 tx=0x7ff734009040 comp rx=0 tx=0).stop 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 msgr2=0x7ff7380d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 0x7ff7380d1410 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff72800d620 tx=0x7ff72800dae0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 shutdown_connections 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff71c0762d0 0x7ff71c078790 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7381611e0 0x7ff7380c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73815ce60 0x7ff7380d1410 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 --2- 172.21.15.66:0/3724487404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7380c65f0 0x7ff7380b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 >> 172.21.15.66:0/3724487404 conn(0x7ff7380b2900 msgr2=0x7ff7380cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 shutdown_connections 2024-05-10T11:17:26.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.165+0000 7ff74070a640 1 -- 172.21.15.66:0/3724487404 wait complete. 2024-05-10T11:17:26.176 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T11:17:26.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.281+0000 7f7ec746b640 1 Processor -- start 2024-05-10T11:17:26.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.281+0000 7f7ec746b640 1 -- start start 2024-05-10T11:17:26.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.282+0000 7f7ec746b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 0x7f7ec00d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.282+0000 7f7ec746b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7ec00d0f10 0x7f7ec00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.282+0000 7f7ec746b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec00d2800 con 0x7f7ec00b54d0 2024-05-10T11:17:26.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.282+0000 7f7ec746b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec00d2ae0 con 0x7f7ec00d0f10 2024-05-10T11:17:26.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.282+0000 7f7ec746b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00d01d0 con 0x7f7ec015f410 2024-05-10T11:17:26.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 0x7f7ec00d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 0x7f7ec00d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:38192/0 (socket says 172.21.15.66:38192) 2024-05-10T11:17:26.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec4a06640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7ec00d0f10 0x7f7ec00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 -- 172.21.15.66:0/2488357560 learned_addr learned my addr 172.21.15.66:0/2488357560 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 -- 172.21.15.66:0/2488357560 >> v2:172.21.15.190:3300/0 conn(0x7f7ec00d0f10 msgr2=0x7f7ec00b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 --2- 172.21.15.66:0/2488357560 >> v2:172.21.15.190:3300/0 conn(0x7f7ec00d0f10 0x7f7ec00b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 -- 172.21.15.66:0/2488357560 >> v1:172.21.15.190:6789/0 conn(0x7f7ec00b54d0 legacy=0x7f7ec00d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.283+0000 7f7ec5207640 1 -- 172.21.15.66:0/2488357560 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec00d04b0 con 0x7f7ec015f410 2024-05-10T11:17:26.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.284+0000 7f7ec5207640 1 --2- 172.21.15.66:0/2488357560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 0x7f7ec00d09d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009870 tx=0x7f7eb002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0be1a285e590bb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.284+0000 7f7ebffff640 1 -- 172.21.15.66:0/2488357560 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0037070 con 0x7f7ec015f410 2024-05-10T11:17:26.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.284+0000 7f7ebffff640 1 -- 172.21.15.66:0/2488357560 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb0032440 con 0x7f7ec015f410 2024-05-10T11:17:26.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.284+0000 7f7ebffff640 1 -- 172.21.15.66:0/2488357560 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0032810 con 0x7f7ec015f410 2024-05-10T11:17:26.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.284+0000 7f7ec746b640 1 -- 172.21.15.66:0/2488357560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 msgr2=0x7f7ec00d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.284+0000 7f7ec746b640 1 --2- 172.21.15.66:0/2488357560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 0x7f7ec00d09d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009870 tx=0x7f7eb002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.285+0000 7f7ec746b640 1 -- 172.21.15.66:0/2488357560 shutdown_connections 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.285+0000 7f7ec746b640 1 --2- 172.21.15.66:0/2488357560 >> v2:172.21.15.190:3300/0 conn(0x7f7ec00d0f10 0x7f7ec00b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.285+0000 7f7ec746b640 1 --2- 172.21.15.66:0/2488357560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec015f410 0x7f7ec00d09d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.285+0000 7f7ec746b640 1 -- 172.21.15.66:0/2488357560 >> 172.21.15.66:0/2488357560 conn(0x7f7ec008ed30 msgr2=0x7f7ec009e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.285+0000 7f7ec746b640 1 -- 172.21.15.66:0/2488357560 shutdown_connections 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.285+0000 7f7ec746b640 1 -- 172.21.15.66:0/2488357560 wait complete. 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.286+0000 7f7ec746b640 1 Processor -- start 2024-05-10T11:17:26.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.286+0000 7f7ec746b640 1 -- start start 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec746b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 0x7f7ec015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec746b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec00d0f10 0x7f7ec015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec746b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ec015f410 0x7f7ec00cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec746b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00cffb0 con 0x7f7ec00b54d0 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec746b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00cfe30 con 0x7f7ec015f410 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec746b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00d3de0 con 0x7f7ec00d0f10 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 0x7f7ec015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 0x7f7ec015e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55990/0 (socket says 172.21.15.66:55990) 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 -- 172.21.15.66:0/3421866512 learned_addr learned my addr 172.21.15.66:0/3421866512 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec00d0f10 0x7f7ec015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ec015f410 0x7f7ec00cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 -- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec00d0f10 msgr2=0x7f7ec015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec00d0f10 0x7f7ec015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 -- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ec015f410 msgr2=0x7f7ec00cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ec015f410 0x7f7ec00cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 -- 172.21.15.66:0/3421866512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec00b8990 con 0x7f7ec00b54d0 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec00d0f10 0x7f7ec015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ec015f410 0x7f7ec00cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.287+0000 7f7ec5207640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 0x7f7ec015e1f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7eb002a200 tx=0x7f7eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.288+0000 7f7ebdffb640 1 -- 172.21.15.66:0/3421866512 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0041030 con 0x7f7ec00b54d0 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.288+0000 7f7ebdffb640 1 -- 172.21.15.66:0/3421866512 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb0030440 con 0x7f7ec00b54d0 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.288+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec00b8c70 con 0x7f7ec00b54d0 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.288+0000 7f7ebdffb640 1 -- 172.21.15.66:0/3421866512 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0037040 con 0x7f7ec00b54d0 2024-05-10T11:17:26.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.288+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec00b9230 con 0x7f7ec00b54d0 2024-05-10T11:17:26.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.290+0000 7f7ebdffb640 1 -- 172.21.15.66:0/3421866512 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7eb0044070 con 0x7f7ec00b54d0 2024-05-10T11:17:26.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.290+0000 7f7ebdffb640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7eac076300 0x7f7eac0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.290+0000 7f7ebdffb640 1 -- 172.21.15.66:0/3421866512 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f7eb00b7e30 con 0x7f7ec00b54d0 2024-05-10T11:17:26.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.290+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7eac076300 0x7f7eac0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.291+0000 7f7eca188740 1 Processor -- start 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.291+0000 7f7eca188740 1 -- start start 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.291+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7eac076300 0x7f7eac0787c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00b9d20 tx=0x7f7eb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7eca188740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a2f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a5eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f0b0 0x55f919a33ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7eca188740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f91991f920 con 0x55f919a7c6d0 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f919994dd0 con 0x55f919a5f7f0 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f9199453e0 con 0x55f919a5f0b0 2024-05-10T11:17:26.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a2f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a2f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55994/0 (socket says 172.21.15.66:55994) 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 -- 172.21.15.66:0/1918890631 learned_addr learned my addr 172.21.15.66:0/1918890631 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a5eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f0b0 0x55f919a33ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 -- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f0b0 msgr2=0x55f919a33ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f0b0 0x55f919a33ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 -- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 msgr2=0x55f919a5eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a5eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 -- 172.21.15.66:0/1918890631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9197767c0 con 0x55f919a7c6d0 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ec5207640 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a2f2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7eb007ce10 tx=0x7f7eb0080820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26b9552e0860b52 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ea6ffd640 1 -- 172.21.15.66:0/1918890631 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0080e10 con 0x55f919a7c6d0 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ea6ffd640 1 -- 172.21.15.66:0/1918890631 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb00851c0 con 0x55f919a7c6d0 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.292+0000 7f7ea6ffd640 1 -- 172.21.15.66:0/1918890631 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0089be0 con 0x55f919a7c6d0 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 -- 172.21.15.66:0/1918890631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 msgr2=0x55f919a2f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a2f2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7eb007ce10 tx=0x7f7eb0080820 comp rx=0 tx=0).stop 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 -- 172.21.15.66:0/1918890631 shutdown_connections 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f0b0 0x55f919a33ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a5eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 --2- 172.21.15.66:0/1918890631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a2f2f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 -- 172.21.15.66:0/1918890631 >> 172.21.15.66:0/1918890631 conn(0x55f919a31560 msgr2=0x55f919a79b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 -- 172.21.15.66:0/1918890631 shutdown_connections 2024-05-10T11:17:26.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.293+0000 7f7eca188740 1 -- 172.21.15.66:0/1918890631 wait complete. 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 -- start start 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 Processor -- start 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f7f0 0x55f919a4c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a8d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a33e10 0x55f919a34290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f91999d440 con 0x55f919a7c6d0 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f919998120 con 0x55f919a33e10 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.294+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f9199a6210 con 0x55f919a5f7f0 2024-05-10T11:17:26.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7eca188740 10 client.0 _ll_register_callbacks cb 0x55f91993d690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a8d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a8d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55996/0 (socket says 172.21.15.66:55996) 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 -- 172.21.15.66:0/662347803 learned_addr learned my addr 172.21.15.66:0/662347803 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec5207640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f7f0 0x55f919a4c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a33e10 0x55f919a34290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 -- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f7f0 msgr2=0x55f919a4c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f7f0 0x55f919a4c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 -- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a33e10 msgr2=0x55f919a34290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a33e10 0x55f919a34290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 -- 172.21.15.66:0/662347803 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9197d6f50 con 0x55f919a7c6d0 2024-05-10T11:17:26.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a33e10 0x55f919a34290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a8d7b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7ec01f8af0 tx=0x7f7eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18013fe99446a73 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7e9ffff640 1 -- 172.21.15.66:0/662347803 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb400f040 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7e9ffff640 1 -- 172.21.15.66:0/662347803 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f7eb4016630 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eb00851c0 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7e9ffff640 1 -- 172.21.15.66:0/662347803 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f7eb4030050 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7eca188740 10 client.6591 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.295+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55f91966a0b0 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7e9ffff640 1 -- 172.21.15.66:0/662347803 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb00851c0 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7e9ffff640 1 -- 172.21.15.66:0/662347803 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f7eb4033020 con 0x55f919a7c6d0 2024-05-10T11:17:26.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7eca188740 10 client.6591 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7eca188740 10 client.6591 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7eca188740 20 client.6591 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7eca188740 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a710f0 0x55f919a714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7eca188740 4 client.6591 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9199a6a20 con 0x55f919a710f0 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7ec5207640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a710f0 0x55f919a714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7e9ffff640 10 client.6591 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.296+0000 7f7ec5207640 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a710f0 0x55f919a714d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf5c6a183b045820 server_cookie=fd43d5126ba7e4c5 in_seq=0 out_seq=0 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7e9ffff640 1 -- 172.21.15.66:0/662347803 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f9199a6a20 con 0x55f919a710f0 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7e9ffff640 10 client.6591 handle_command_reply: tid=0 2024-05-10T11:17:26.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 client.6591 shutdown 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 msgr2=0x55f919a8d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a8d7b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7ec01f8af0 tx=0x7f7eb40046c0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 shutdown_connections 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a710f0 0x55f919a714d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a33e10 0x55f919a34290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7e9ffff640 0 client.6591 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a7c6d0 0x55f919a8d7b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 --2- 172.21.15.66:0/662347803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a5f7f0 0x55f919a4c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 >> 172.21.15.66:0/662347803 conn(0x55f919a5f0b0 msgr2=0x55f919a2ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 shutdown_connections 2024-05-10T11:17:26.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 1 -- 172.21.15.66:0/662347803 wait complete. 2024-05-10T11:17:26.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.297+0000 7f7eca188740 20 client.6591 trim_cache size 0 max 16384 2024-05-10T11:17:26.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.311+0000 7f7eca188740 1 Processor -- start 2024-05-10T11:17:26.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.311+0000 7f7eca188740 1 -- start start 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a33e10 0x55f919a7a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7eca188740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 0x55f919a714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a7c6d0 0x55f919a71a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7eca188740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec02011b0 con 0x55f919a5f7f0 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00a0c10 con 0x55f919a7c6d0 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00a1260 con 0x55f919a33e10 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 0x55f919a714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 0x55f919a714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56012/0 (socket says 172.21.15.66:56012) 2024-05-10T11:17:26.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 -- 172.21.15.66:0/1196911755 learned_addr learned my addr 172.21.15.66:0/1196911755 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec5207640 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a33e10 0x55f919a7a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a7c6d0 0x55f919a71a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 -- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a33e10 msgr2=0x55f919a7a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a33e10 0x55f919a7a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 -- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a7c6d0 msgr2=0x55f919a71a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a7c6d0 0x55f919a71a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 -- 172.21.15.66:0/1196911755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f919a32410 con 0x55f919a5f7f0 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec5207640 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a33e10 0x55f919a7a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 0x55f919a714d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009800 tx=0x7f7eb4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850eda2f0ff3729d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ea67fc640 1 -- 172.21.15.66:0/1196911755 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4009200 con 0x55f919a5f7f0 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ea67fc640 1 -- 172.21.15.66:0/1196911755 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb4039070 con 0x55f919a5f7f0 2024-05-10T11:17:26.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.312+0000 7f7ea67fc640 1 -- 172.21.15.66:0/1196911755 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4016b50 con 0x55f919a5f7f0 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 -- 172.21.15.66:0/1196911755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 msgr2=0x55f919a714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 0x55f919a714d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009800 tx=0x7f7eb4022000 comp rx=0 tx=0).stop 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 -- 172.21.15.66:0/1196911755 shutdown_connections 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a7c6d0 0x55f919a71a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a5f7f0 0x55f919a714d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 --2- 172.21.15.66:0/1196911755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a33e10 0x55f919a7a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 -- 172.21.15.66:0/1196911755 >> 172.21.15.66:0/1196911755 conn(0x55f919a5f0b0 msgr2=0x55f919a60f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 -- 172.21.15.66:0/1196911755 shutdown_connections 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.313+0000 7f7eca188740 1 -- 172.21.15.66:0/1196911755 wait complete. 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.314+0000 7f7eca188740 1 -- start start 2024-05-10T11:17:26.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.314+0000 7f7eca188740 1 Processor -- start 2024-05-10T11:17:26.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 0x55f919a7a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a6ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a7c6d0 0x55f919a348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f919a72000 con 0x55f919a33e10 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f91994ea20 con 0x55f919a5f7f0 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f919a601b0 con 0x55f919a7c6d0 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 10 client.0 _ll_register_callbacks cb 0x7f7eb4004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 0x55f919a7a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 0x55f919a7a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56026/0 (socket says 172.21.15.66:56026) 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 -- 172.21.15.66:0/3644973745 learned_addr learned my addr 172.21.15.66:0/3644973745 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a6ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5a08640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a7c6d0 0x55f919a348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 -- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a7c6d0 msgr2=0x55f919a348d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a7c6d0 0x55f919a348d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 -- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 msgr2=0x55f919a6ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a6ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 -- 172.21.15.66:0/3644973745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f919a8c120 con 0x55f919a33e10 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7ec5207640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 0x55f919a7a930 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009870 tx=0x7f7eb003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4ea9e63bc3e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7e9ffff640 1 -- 172.21.15.66:0/3644973745 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00851c0 con 0x55f919a33e10 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7e9ffff640 1 -- 172.21.15.66:0/3644973745 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f7eb00a2390 con 0x55f919a33e10 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eb4039070 con 0x55f919a33e10 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7e9ffff640 1 -- 172.21.15.66:0/3644973745 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f7eb0089e30 con 0x55f919a33e10 2024-05-10T11:17:26.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 10 client.6597 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.315+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55f919a8c120 con 0x55f919a33e10 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7e9ffff640 1 -- 172.21.15.66:0/3644973745 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb4039070 con 0x55f919a33e10 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7e9ffff640 1 -- 172.21.15.66:0/3644973745 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f7eb004e060 con 0x55f919a33e10 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 10 client.6597 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 10 client.6597 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 20 client.6597 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a71a70 0x55f919a34e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 4 client.6597 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55f9199a0890 con 0x55f919a71a70 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a71a70 0x55f919a34e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7e9ffff640 10 client.6597 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7ec4a06640 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a71a70 0x55f919a34e10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d4755e29795c23 server_cookie=55320e23bdb5e065 in_seq=0 out_seq=0 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7e9ffff640 1 -- 172.21.15.66:0/3644973745 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x55f9199a0890 con 0x55f919a71a70 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7e9ffff640 10 client.6597 handle_command_reply: tid=0 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.316+0000 7f7eca188740 1 client.6597 shutdown 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 msgr2=0x55f919a7a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 0x55f919a7a930 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009870 tx=0x7f7eb003e000 comp rx=0 tx=0).stop 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 shutdown_connections 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f919a71a70 0x55f919a34e10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f919a7c6d0 0x55f919a348d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f919a5f7f0 0x55f919a6ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7e9ffff640 0 client.6597 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 --2- 172.21.15.66:0/3644973745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f919a33e10 0x55f919a7a930 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 >> 172.21.15.66:0/3644973745 conn(0x55f919a5f0b0 msgr2=0x55f919a791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 shutdown_connections 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 1 -- 172.21.15.66:0/3644973745 wait complete. 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7eca188740 20 client.6597 trim_cache size 0 max 16384 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:17:26.325 INFO:teuthology.orchestra.run.smithi066.stdout: "damage_type": "dentry", 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 1373778074, 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627776, 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: "frag": "*", 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: "dname": "file_to_be_damaged", 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_id": "head", 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/subdir/file_to_be_damaged" 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:17:26.326 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:17:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7eac076300 msgr2=0x7f7eac0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7eac076300 0x7f7eac0787c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00b9d20 tx=0x7f7eb4008040 comp rx=0 tx=0).stop 2024-05-10T11:17:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 msgr2=0x7f7ec015e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 0x7f7ec015e1f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7eb002a200 tx=0x7f7eb00046c0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 shutdown_connections 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7eac076300 0x7f7eac0787c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ec015f410 0x7f7ec00cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ec00d0f10 0x7f7ec015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 --2- 172.21.15.66:0/3421866512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ec00b54d0 0x7f7ec015e1f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.317+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 >> 172.21.15.66:0/3421866512 conn(0x7f7ec008ed30 msgr2=0x7f7ec006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.318+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 shutdown_connections 2024-05-10T11:17:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.318+0000 7f7ec746b640 1 -- 172.21.15.66:0/3421866512 wait complete. 2024-05-10T11:17:26.329 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:17:26.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.432+0000 7f775bec8640 1 Processor -- start 2024-05-10T11:17:26.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.432+0000 7f775bec8640 1 -- start start 2024-05-10T11:17:26.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775bec8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77540cfd80 0x7f775416a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775bec8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775415fc90 con 0x7f77540d0230 2024-05-10T11:17:26.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775bec8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77540b8c40 con 0x7f77540b8860 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775bec8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f775406ec30 con 0x7f77540cfd80 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775a465640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77540cfd80 0x7f775416a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f7759463640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f77540d0230 0x7f77540cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59204/0 (socket says 172.21.15.66:59204) 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f7759463640 1 -- 172.21.15.66:0/3231256528 learned_addr learned my addr 172.21.15.66:0/3231256528 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775a465640 1 -- 172.21.15.66:0/3231256528 >> v1:172.21.15.190:6789/0 conn(0x7f77540b8860 legacy=0x7f775406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775a465640 1 -- 172.21.15.66:0/3231256528 >> v1:172.21.15.66:6789/0 conn(0x7f77540d0230 legacy=0x7f77540cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f7758c62640 1 -- 172.21.15.66:0/3231256528 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029014982 0 0) 0x7f775415fc90 con 0x7f77540d0230 2024-05-10T11:17:26.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.433+0000 7f775a465640 1 -- 172.21.15.66:0/3231256528 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77540cd570 con 0x7f77540cfd80 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.434+0000 7f775a465640 1 --2- 172.21.15.66:0/3231256528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540cfd80 0x7f775416a3a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f774c009d90 tx=0x7f774c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aae4bd4c731c12 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.434+0000 7f7758c62640 1 -- 172.21.15.66:0/3231256528 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c007740 con 0x7f77540cfd80 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.434+0000 7f7758c62640 1 -- 172.21.15.66:0/3231256528 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c0078e0 con 0x7f77540cfd80 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.434+0000 7f7758c62640 1 -- 172.21.15.66:0/3231256528 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c007cb0 con 0x7f77540cfd80 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 -- 172.21.15.66:0/3231256528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540cfd80 msgr2=0x7f775416a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 --2- 172.21.15.66:0/3231256528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540cfd80 0x7f775416a3a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f774c009d90 tx=0x7f774c02a660 comp rx=0 tx=0).stop 2024-05-10T11:17:26.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 -- 172.21.15.66:0/3231256528 shutdown_connections 2024-05-10T11:17:26.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 --2- 172.21.15.66:0/3231256528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540cfd80 0x7f775416a3a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 -- 172.21.15.66:0/3231256528 >> 172.21.15.66:0/3231256528 conn(0x7f77540d2df0 msgr2=0x7f77540d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 -- 172.21.15.66:0/3231256528 shutdown_connections 2024-05-10T11:17:26.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.435+0000 7f775bec8640 1 -- 172.21.15.66:0/3231256528 wait complete. 2024-05-10T11:17:26.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.436+0000 7f775bec8640 1 Processor -- start 2024-05-10T11:17:26.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.436+0000 7f775bec8640 1 -- start start 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77540b8860 0x7f77540cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77540cfd80 0x7f7754151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 0x7f7754160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77540cdb30 con 0x7f77540d0230 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f775406ee50 con 0x7f77540cfd80 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77540cde10 con 0x7f77540b8860 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 0x7f7754160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 0x7f7754160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56054/0 (socket says 172.21.15.66:56054) 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 -- 172.21.15.66:0/3580775319 learned_addr learned my addr 172.21.15.66:0/3580775319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f7759463640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77540cfd80 0x7f7754151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f7759c64640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77540b8860 0x7f77540cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 -- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77540b8860 msgr2=0x7f77540cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77540b8860 0x7f77540cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 -- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77540cfd80 msgr2=0x7f7754151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77540cfd80 0x7f7754151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 -- 172.21.15.66:0/3580775319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7754161460 con 0x7f77540d0230 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775a465640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 0x7f7754160a80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f774c009d90 tx=0x7f774c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c040070 con 0x7f77540d0230 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c031c90 con 0x7f77540d0230 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.437+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77540ca0d0 con 0x7f77540d0230 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.438+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c03c640 con 0x7f77540d0230 2024-05-10T11:17:26.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.438+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77540ca690 con 0x7f77540d0230 2024-05-10T11:17:26.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.439+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77540d23c0 con 0x7f77540d0230 2024-05-10T11:17:26.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.439+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f774c039040 con 0x7f77540d0230 2024-05-10T11:17:26.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.440+0000 7f774a7fc640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7738076300 0x7f77380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.440+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f774c0b8f50 con 0x7f77540d0230 2024-05-10T11:17:26.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.440+0000 7f7759c64640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7738076300 0x7f77380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.441+0000 7f7759c64640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7738076300 0x7f77380787c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7750000f60 tx=0x7f7750009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.443+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f77540d23c0 con 0x7f77540d0230 2024-05-10T11:17:26.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.672+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77540c9ec0 con 0x7f77540d0230 2024-05-10T11:17:26.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.672+0000 7f774a7fc640 1 -- 172.21.15.66:0/3580775319 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f774c0821b0 con 0x7f77540d0230 2024-05-10T11:17:26.673 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:17:26.673 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7738076300 msgr2=0x7f77380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7738076300 0x7f77380787c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7750000f60 tx=0x7f7750009040 comp rx=0 tx=0).stop 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 msgr2=0x7f7754160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 0x7f7754160a80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f774c009d90 tx=0x7f774c004a40 comp rx=0 tx=0).stop 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 shutdown_connections 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7738076300 0x7f77380787c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77540d0230 0x7f7754160a80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77540cfd80 0x7f7754151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 --2- 172.21.15.66:0/3580775319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77540b8860 0x7f77540cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 >> 172.21.15.66:0/3580775319 conn(0x7f77540d2df0 msgr2=0x7f77540718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 shutdown_connections 2024-05-10T11:17:26.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.674+0000 7f775bec8640 1 -- 172.21.15.66:0/3580775319 wait complete. 2024-05-10T11:17:26.686 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T11:17:26.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:26.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-05-10T11:17:26.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.794+0000 7f8a9d4e8640 1 Processor -- start 2024-05-10T11:17:26.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.794+0000 7f8a9d4e8640 1 -- start start 2024-05-10T11:17:26.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a9d4e8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a98162990 0x7f8a980b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a9d4e8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a980b5f30 0x7f8a980d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a9d4e8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a980d0830 con 0x7f8a980d1aa0 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a9d4e8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8a980d10d0 con 0x7f8a98162990 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a9d4e8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a980d0b10 con 0x7f8a980b5f30 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a96ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a98162990 0x7f8a980b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a977fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8a980d1aa0 0x7f8a981630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59212/0 (socket says 172.21.15.66:59212) 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a977fe640 1 -- 172.21.15.66:0/3358902766 learned_addr learned my addr 172.21.15.66:0/3358902766 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/3358902766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a980b5f30 0x7f8a980d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a96ffd640 1 -- 172.21.15.66:0/3358902766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a980b5f30 msgr2=0x7f8a980d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3358902766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a980b5f30 0x7f8a980d59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a96ffd640 1 -- 172.21.15.66:0/3358902766 >> v1:172.21.15.66:6789/0 conn(0x7f8a980d1aa0 legacy=0x7f8a981630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.795+0000 7f8a96ffd640 1 -- 172.21.15.66:0/3358902766 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a980d0df0 con 0x7f8a98162990 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.796+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3358902766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a98162990 0x7f8a980b48a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8a880097d0 tx=0x7f8a8802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5006b1ee0efd917b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.796+0000 7f8a967fc640 1 -- 172.21.15.66:0/3358902766 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88037070 con 0x7f8a98162990 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.796+0000 7f8a967fc640 1 -- 172.21.15.66:0/3358902766 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88032440 con 0x7f8a98162990 2024-05-10T11:17:26.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.796+0000 7f8a967fc640 1 -- 172.21.15.66:0/3358902766 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88032810 con 0x7f8a98162990 2024-05-10T11:17:26.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3358902766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a98162990 msgr2=0x7f8a980b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3358902766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a98162990 0x7f8a980b48a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8a880097d0 tx=0x7f8a8802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3358902766 shutdown_connections 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3358902766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a980b5f30 0x7f8a980d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3358902766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a98162990 0x7f8a980b48a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3358902766 >> 172.21.15.66:0/3358902766 conn(0x7f8a9809e3f0 msgr2=0x7f8a980d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3358902766 shutdown_connections 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.797+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3358902766 wait complete. 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.798+0000 7f8a9d4e8640 1 Processor -- start 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.798+0000 7f8a9d4e8640 1 -- start start 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a980b5f30 0x7f8a980c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 0x7f8a9815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a98162990 0x7f8a980ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a980d5ef0 con 0x7f8a980d1aa0 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98162d70 con 0x7f8a980b5f30 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a980d1f30 con 0x7f8a98162990 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 0x7f8a9815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 0x7f8a9815d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56064/0 (socket says 172.21.15.66:56064) 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 -- 172.21.15.66:0/3656728734 learned_addr learned my addr 172.21.15.66:0/3656728734 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 -- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a98162990 msgr2=0x7f8a980ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a98162990 0x7f8a980ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 -- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a980b5f30 msgr2=0x7f8a980c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a980b5f30 0x7f8a980c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 -- 172.21.15.66:0/3656728734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a980cd0b0 con 0x7f8a980d1aa0 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 0x7f8a9815d620 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000d830 tx=0x7f8a8000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8f7fe640 1 -- 172.21.15.66:0/3656728734 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000b6c0 con 0x7f8a980d1aa0 2024-05-10T11:17:26.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8f7fe640 1 -- 172.21.15.66:0/3656728734 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80019070 con 0x7f8a980d1aa0 2024-05-10T11:17:26.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a980cd350 con 0x7f8a980d1aa0 2024-05-10T11:17:26.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a8f7fe640 1 -- 172.21.15.66:0/3656728734 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000ba80 con 0x7f8a980d1aa0 2024-05-10T11:17:26.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.799+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a980cd910 con 0x7f8a980d1aa0 2024-05-10T11:17:26.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.801+0000 7f8a8f7fe640 1 -- 172.21.15.66:0/3656728734 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a8001e460 con 0x7f8a980d1aa0 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.802+0000 7f8a8f7fe640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a780762d0 0x7f8a78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.802+0000 7f8a8f7fe640 1 -- 172.21.15.66:0/3656728734 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f8a80097e30 con 0x7f8a980d1aa0 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.802+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a780762d0 0x7f8a78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.802+0000 7f8aa0208740 1 Processor -- start 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.802+0000 7f8aa0208740 1 -- start start 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a780762d0 0x7f8a78078790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8a88034000 tx=0x7f8a8802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5b68d0 0x55bd6c5b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 0x55bd6c5e1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8aa0208740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd6c51aef0 con 0x55bd6c5e1390 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bd6c4d4010 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bd6c516eb0 con 0x55bd6c5b68d0 2024-05-10T11:17:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 0x55bd6c5e1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 0x55bd6c5e1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56080/0 (socket says 172.21.15.66:56080) 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8a977fe640 1 -- 172.21.15.66:0/1579489668 learned_addr learned my addr 172.21.15.66:0/1579489668 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5b68d0 0x55bd6c5b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.803+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a977fe640 1 -- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5b68d0 msgr2=0x55bd6c5b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a977fe640 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5b68d0 0x55bd6c5b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a977fe640 1 -- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5f2fa0 msgr2=0x55bd6c5b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a977fe640 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a977fe640 1 -- 172.21.15.66:0/1579489668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd6c2f4a50 con 0x55bd6c5e1390 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a977fe640 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 0x55bd6c5e1810 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8a900020c0 tx=0x7f8a9000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce100e73c8281c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a8cff9640 1 -- 172.21.15.66:0/1579489668 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90017070 con 0x55bd6c5e1390 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a8cff9640 1 -- 172.21.15.66:0/1579489668 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a900072d0 con 0x55bd6c5e1390 2024-05-10T11:17:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.804+0000 7f8a8cff9640 1 -- 172.21.15.66:0/1579489668 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007680 con 0x55bd6c5e1390 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 -- 172.21.15.66:0/1579489668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 msgr2=0x55bd6c5e1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 0x55bd6c5e1810 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8a900020c0 tx=0x7f8a9000c4b0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 -- 172.21.15.66:0/1579489668 shutdown_connections 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5e1390 0x55bd6c5e1810 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 --2- 172.21.15.66:0/1579489668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5b68d0 0x55bd6c5b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 -- 172.21.15.66:0/1579489668 >> 172.21.15.66:0/1579489668 conn(0x55bd6c57e3e0 msgr2=0x55bd6c5fc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 -- 172.21.15.66:0/1579489668 shutdown_connections 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 -- 172.21.15.66:0/1579489668 wait complete. 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 -- start start 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.805+0000 7f8aa0208740 1 Processor -- start 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c60c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c6101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd6c4d7b40 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bd6c5deee0 con 0x55bd6c5b68d0 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bd6c60c6a0 con 0x55bd6c5e1390 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8aa0208740 10 client.0 _ll_register_callbacks cb 0x55bd6c4c4b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5fc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56084/0 (socket says 172.21.15.66:56084) 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.806+0000 7f8a977fe640 1 -- 172.21.15.66:0/4159273919 learned_addr learned my addr 172.21.15.66:0/4159273919 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c6101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c60c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a977fe640 1 -- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 msgr2=0x55bd6c6101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a977fe640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c6101e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a977fe640 1 -- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 msgr2=0x55bd6c60c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a977fe640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c60c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a977fe640 1 -- 172.21.15.66:0/4159273919 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd6c1ec3e0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a977fe640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5fc7d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8a90015040 tx=0x7f8a900014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25fc30e508235f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4159273919 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90017040 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4159273919 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f8a90007700 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a900072d0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4159273919 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f8a90007920 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 10 client.6621 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55bd6c3551e0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4159273919 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a900072d0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4159273919 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f8a9001d040 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 10 client.6621 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 10 client.6621 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:26.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 20 client.6621 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5cf660 0x55bd6c5cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 4 client.6621 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.807+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd6c528b00 con 0x55bd6c5cf660 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.808+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5cf660 0x55bd6c5cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.808+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5cf660 0x55bd6c5cfa70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e7237fdbfd8ac7 server_cookie=3679516d53bd4d54 in_seq=0 out_seq=0 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.808+0000 7f8a75ffb640 10 client.6621 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.808+0000 7f8a75ffb640 1 -- 172.21.15.66:0/4159273919 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd6c528b00 con 0x55bd6c5cf660 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.808+0000 7f8a75ffb640 10 client.6621 handle_command_reply: tid=0 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 client.6621 shutdown 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 msgr2=0x55bd6c5fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5fc7d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8a90015040 tx=0x7f8a900014a0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 shutdown_connections 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5cf660 0x55bd6c5cfa70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5fc7d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c6101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8a75ffb640 0 client.6621 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 --2- 172.21.15.66:0/4159273919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c60c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 >> 172.21.15.66:0/4159273919 conn(0x55bd6c57e3e0 msgr2=0x55bd6c5b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 shutdown_connections 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 1 -- 172.21.15.66:0/4159273919 wait complete. 2024-05-10T11:17:26.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.809+0000 7f8aa0208740 20 client.6621 trim_cache size 0 max 16384 2024-05-10T11:17:26.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.827+0000 7f8aa0208740 1 Processor -- start 2024-05-10T11:17:26.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.827+0000 7f8aa0208740 1 -- start start 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c5d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8aa0208740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98201e80 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98200ef0 con 0x55bd6c5b68d0 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a98160bb0 con 0x55bd6c5e1390 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56096/0 (socket says 172.21.15.66:56096) 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 -- 172.21.15.66:0/2854679439 learned_addr learned my addr 172.21.15.66:0/2854679439 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c5d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 -- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 msgr2=0x55bd6c5f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 -- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 msgr2=0x55bd6c5d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c5d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a977fe640 1 -- 172.21.15.66:0/2854679439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd6c1c54a0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.828+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c5d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8a977fe640 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f60e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8a90029040 tx=0x7f8a9001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52183a3021043b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8a77fff640 1 -- 172.21.15.66:0/2854679439 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90034070 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8a77fff640 1 -- 172.21.15.66:0/2854679439 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a90027910 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8a77fff640 1 -- 172.21.15.66:0/2854679439 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90017070 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 -- 172.21.15.66:0/2854679439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 msgr2=0x55bd6c5f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f60e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8a90029040 tx=0x7f8a9001e000 comp rx=0 tx=0).stop 2024-05-10T11:17:26.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 -- 172.21.15.66:0/2854679439 shutdown_connections 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f60e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 --2- 172.21.15.66:0/2854679439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c5d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 -- 172.21.15.66:0/2854679439 >> 172.21.15.66:0/2854679439 conn(0x55bd6c57e3e0 msgr2=0x55bd6c5f8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 -- 172.21.15.66:0/2854679439 shutdown_connections 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.829+0000 7f8aa0208740 1 -- 172.21.15.66:0/2854679439 wait complete. 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.830+0000 7f8aa0208740 1 -- start start 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.830+0000 7f8aa0208740 1 Processor -- start 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c679970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a982008f0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bd6c520170 con 0x55bd6c5b68d0 2024-05-10T11:17:26.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bd6c5df760 con 0x55bd6c5e1390 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 10 client.0 _ll_register_callbacks cb 0x7f8a90015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56102/0 (socket says 172.21.15.66:56102) 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 -- 172.21.15.66:0/3726957388 learned_addr learned my addr 172.21.15.66:0/3726957388 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c679970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 -- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 msgr2=0x55bd6c5f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 -- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 msgr2=0x55bd6c679970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c679970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 -- 172.21.15.66:0/3726957388 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd6c5df550 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a8ffff640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:26.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c679970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a977fe640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f6620 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8a90029010 tx=0x7f8a90001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ebcdf96093507b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a75ffb640 1 -- 172.21.15.66:0/3726957388 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9003d070 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8a75ffb640 1 -- 172.21.15.66:0/3726957388 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f8a900148c0 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.831+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a90027910 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8a75ffb640 1 -- 172.21.15.66:0/3726957388 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f8a90034040 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 10 client.6627 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55bd6c5fb440 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8a75ffb640 1 -- 172.21.15.66:0/3726957388 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a90027910 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8a75ffb640 1 -- 172.21.15.66:0/3726957388 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f8a90040030 con 0x55bd6c5f2fa0 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 10 client.6627 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 10 client.6627 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 20 client.6627 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5b0db0 0x55bd6c5f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 4 client.6627 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x55bd6c522970 con 0x55bd6c5b0db0 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5b0db0 0x55bd6c5f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8a96ffd640 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5b0db0 0x55bd6c5f1d20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9982b9a644f6550 server_cookie=3eb2ecbdaede6c89 in_seq=0 out_seq=0 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.832+0000 7f8a75ffb640 10 client.6627 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8a75ffb640 1 -- 172.21.15.66:0/3726957388 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bd6c522970 con 0x55bd6c5b0db0 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8a75ffb640 10 client.6627 handle_command_reply: tid=0 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 client.6627 shutdown 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 msgr2=0x55bd6c5f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f6620 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8a90029010 tx=0x7f8a90001a40 comp rx=0 tx=0).stop 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 shutdown_connections 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55bd6c5b0db0 0x55bd6c5f1d20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd6c5f2fa0 0x55bd6c5f6620 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bd6c5e1390 0x55bd6c5f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8a75ffb640 0 client.6627 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 --2- 172.21.15.66:0/3726957388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bd6c5b68d0 0x55bd6c679970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 >> 172.21.15.66:0/3726957388 conn(0x55bd6c57e3e0 msgr2=0x55bd6c5fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 shutdown_connections 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 1 -- 172.21.15.66:0/3726957388 wait complete. 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.833+0000 7f8aa0208740 20 client.6627 trim_cache size 0 max 16384 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "6cea6bc0-aa82-4215-8f45-9a63d8009973", 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:17:26.841 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:17:26.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a780762d0 msgr2=0x7f8a78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a780762d0 0x7f8a78078790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8a88034000 tx=0x7f8a8802c000 comp rx=0 tx=0).stop 2024-05-10T11:17:26.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 msgr2=0x7f8a9815d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 0x7f8a9815d620 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000d830 tx=0x7f8a8000dcf0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 shutdown_connections 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a780762d0 0x7f8a78078790 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a98162990 0x7f8a980ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a980d1aa0 0x7f8a9815d620 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 --2- 172.21.15.66:0/3656728734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a980b5f30 0x7f8a980c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 >> 172.21.15.66:0/3656728734 conn(0x7f8a9809e3f0 msgr2=0x7f8a980cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 shutdown_connections 2024-05-10T11:17:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.834+0000 7f8a9d4e8640 1 -- 172.21.15.66:0/3656728734 wait complete. 2024-05-10T11:17:26.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:26.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T11:17:26.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.951+0000 7f84d44d9640 1 Processor -- start 2024-05-10T11:17:26.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.951+0000 7f84d44d9640 1 -- start start 2024-05-10T11:17:26.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.951+0000 7f84d44d9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f84cc0cf3e0 0x7f84cc0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.951+0000 7f84d44d9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f84cc0cd500 0x7f84cc0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d44d9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84cc06e720 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d44d9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f84cc06de80 con 0x7f84cc0cd500 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d44d9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f84cc06e160 con 0x7f84cc0cf3e0 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d1a74640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f84cc0cd500 0x7f84cc0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d2a76640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f84cc0b2dd0 0x7f84cc0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59216/0 (socket says 172.21.15.66:59216) 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d2a76640 1 -- 172.21.15.66:0/815540312 learned_addr learned my addr 172.21.15.66:0/815540312 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d2275640 1 --2- 172.21.15.66:0/815540312 >> v2:172.21.15.190:3300/0 conn(0x7f84cc0cf3e0 0x7f84cc0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d1a74640 1 -- 172.21.15.66:0/815540312 >> v2:172.21.15.190:3300/0 conn(0x7f84cc0cf3e0 msgr2=0x7f84cc0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d1a74640 1 --2- 172.21.15.66:0/815540312 >> v2:172.21.15.190:3300/0 conn(0x7f84cc0cf3e0 0x7f84cc0cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d1a74640 1 -- 172.21.15.66:0/815540312 >> v1:172.21.15.66:6789/0 conn(0x7f84cc0b2dd0 legacy=0x7f84cc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d1a74640 1 -- 172.21.15.66:0/815540312 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc06e440 con 0x7f84cc0cd500 2024-05-10T11:17:26.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d1273640 1 -- 172.21.15.66:0/815540312 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572288165 0 0) 0x7f84cc06e720 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.952+0000 7f84d2275640 1 --2- 172.21.15.66:0/815540312 >> v2:172.21.15.190:3300/0 conn(0x7f84cc0cf3e0 0x7f84cc0cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.953+0000 7f84d1a74640 1 --2- 172.21.15.66:0/815540312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0cd500 0x7f84cc0cfe00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f84cc06fed0 tx=0x7f84c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb6659562b6a5e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.953+0000 7f84d1273640 1 -- 172.21.15.66:0/815540312 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0007740 con 0x7f84cc0cd500 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.953+0000 7f84d1273640 1 -- 172.21.15.66:0/815540312 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c00078e0 con 0x7f84cc0cd500 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.953+0000 7f84d1273640 1 -- 172.21.15.66:0/815540312 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0007cb0 con 0x7f84cc0cd500 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.953+0000 7f84d44d9640 1 -- 172.21.15.66:0/815540312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0cd500 msgr2=0x7f84cc0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.953+0000 7f84d44d9640 1 --2- 172.21.15.66:0/815540312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0cd500 0x7f84cc0cfe00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f84cc06fed0 tx=0x7f84c002a680 comp rx=0 tx=0).stop 2024-05-10T11:17:26.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.954+0000 7f84d44d9640 1 -- 172.21.15.66:0/815540312 shutdown_connections 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.954+0000 7f84d44d9640 1 --2- 172.21.15.66:0/815540312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0cd500 0x7f84cc0cfe00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.954+0000 7f84d44d9640 1 --2- 172.21.15.66:0/815540312 >> v2:172.21.15.190:3300/0 conn(0x7f84cc0cf3e0 0x7f84cc0cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.954+0000 7f84d44d9640 1 -- 172.21.15.66:0/815540312 >> 172.21.15.66:0/815540312 conn(0x7f84cc0d2eb0 msgr2=0x7f84cc0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.954+0000 7f84d44d9640 1 -- 172.21.15.66:0/815540312 shutdown_connections 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.954+0000 7f84d44d9640 1 -- 172.21.15.66:0/815540312 wait complete. 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.955+0000 7f84d44d9640 1 Processor -- start 2024-05-10T11:17:26.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.955+0000 7f84d44d9640 1 -- start start 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 0x7f84cc1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84cc0cd500 0x7f84cc070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84cc0cf3e0 0x7f84cc070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc0d2190 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc0b4510 con 0x7f84cc0cf3e0 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc0d2310 con 0x7f84cc0cd500 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 0x7f84cc1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 0x7f84cc1511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56126/0 (socket says 172.21.15.66:56126) 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 -- 172.21.15.66:0/1360051682 learned_addr learned my addr 172.21.15.66:0/1360051682 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 -- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84cc0cd500 msgr2=0x7f84cc070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84cc0cd500 0x7f84cc070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 -- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84cc0cf3e0 msgr2=0x7f84cc070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84cc0cf3e0 0x7f84cc070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 -- 172.21.15.66:0/1360051682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc0b7580 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d2275640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 0x7f84cc1511e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00d7d0 tx=0x7f84bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84caffd640 1 -- 172.21.15.66:0/1360051682 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc004030 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84caffd640 1 -- 172.21.15.66:0/1360051682 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc0041d0 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc0b7840 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84caffd640 1 -- 172.21.15.66:0/1360051682 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0096a0 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.956+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc0b7e00 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.958+0000 7f84caffd640 1 -- 172.21.15.66:0/1360051682 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84bc009840 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.959+0000 7f84caffd640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84b8076300 0x7f84b80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.959+0000 7f84caffd640 1 -- 172.21.15.66:0/1360051682 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f84bc0979a0 con 0x7f84cc0b2dd0 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.959+0000 7f84d1a74640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84b8076300 0x7f84b80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.960+0000 7f84d1a74640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84b8076300 0x7f84b80787c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f84c0034000 tx=0x7f84c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.960+0000 7f84d71f1740 1 Processor -- start 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.960+0000 7f84d71f1740 1 -- start start 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.960+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd1764af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd1794600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd1794b40 0x555fd1769950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d71f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fd1731690 con 0x555fd1795280 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555fd16cef30 con 0x555fd17b2160 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555fd1687b20 con 0x555fd1794b40 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd1794600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd1794600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56142/0 (socket says 172.21.15.66:56142) 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 -- 172.21.15.66:0/1237882855 learned_addr learned my addr 172.21.15.66:0/1237882855 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d2275640 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd1764af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d2a76640 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd1794b40 0x555fd1769950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 -- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd1794b40 msgr2=0x555fd1769950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd1794b40 0x555fd1769950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 -- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 msgr2=0x555fd1764af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd1764af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 -- 172.21.15.66:0/1237882855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd167fe60 con 0x555fd1795280 2024-05-10T11:17:26.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84d1a74640 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd1794600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f84c002ac70 tx=0x7f84c0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec67350d2622669 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84b3fff640 1 -- 172.21.15.66:0/1237882855 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0049650 con 0x555fd1795280 2024-05-10T11:17:26.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84b3fff640 1 -- 172.21.15.66:0/1237882855 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c0007e80 con 0x555fd1795280 2024-05-10T11:17:26.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.961+0000 7f84b3fff640 1 -- 172.21.15.66:0/1237882855 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0049a30 con 0x555fd1795280 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 -- 172.21.15.66:0/1237882855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 msgr2=0x555fd1794600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd1794600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f84c002ac70 tx=0x7f84c0030000 comp rx=0 tx=0).stop 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 -- 172.21.15.66:0/1237882855 shutdown_connections 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd1794b40 0x555fd1769950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd1794600 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1237882855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd1764af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 -- 172.21.15.66:0/1237882855 >> 172.21.15.66:0/1237882855 conn(0x555fd1766d60 msgr2=0x555fd17af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 -- 172.21.15.66:0/1237882855 shutdown_connections 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.962+0000 7f84d71f1740 1 -- 172.21.15.66:0/1237882855 wait complete. 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.963+0000 7f84d71f1740 1 -- start start 2024-05-10T11:17:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.963+0000 7f84d71f1740 1 Processor -- start 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd17c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1781fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1795770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fd168b5e0 con 0x555fd17b2160 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555fd16caef0 con 0x555fd1795280 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555fd1768f10 con 0x555fd17c2ee0 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d71f1740 10 client.0 _ll_register_callbacks cb 0x555fd1686320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1781fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1781fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56154/0 (socket says 172.21.15.66:56154) 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 -- 172.21.15.66:0/4109227338 learned_addr learned my addr 172.21.15.66:0/4109227338 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d2a76640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1795770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d2275640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd17c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 -- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 msgr2=0x555fd1795770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1795770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 -- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 msgr2=0x555fd17c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd17c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d1a74640 1 -- 172.21.15.66:0/4109227338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd14aa7d0 con 0x555fd17b2160 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.964+0000 7f84d2275640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd17c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d1a74640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1781fa0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f84c0032000 tx=0x7f84c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7e1d8e3197e74d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84b17fa640 1 -- 172.21.15.66:0/4109227338 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c005f060 con 0x555fd17b2160 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84b17fa640 1 -- 172.21.15.66:0/4109227338 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f84c0049b50 con 0x555fd17b2160 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c0007e80 con 0x555fd17b2160 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84b17fa640 1 -- 172.21.15.66:0/4109227338 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f84c0065050 con 0x555fd17b2160 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 10 client.6642 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x555fd13e03f0 con 0x555fd17b2160 2024-05-10T11:17:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84b17fa640 1 -- 172.21.15.66:0/4109227338 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c0007e80 con 0x555fd17b2160 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84b17fa640 1 -- 172.21.15.66:0/4109227338 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f84c0068020 con 0x555fd17b2160 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 10 client.6642 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 10 client.6642 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 20 client.6642 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17c32c0 0x555fd17b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 4 client.6642 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fd16dcb40 con 0x555fd17c32c0 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.965+0000 7f84d2275640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17c32c0 0x555fd17b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84b17fa640 10 client.6642 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84d2275640 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17c32c0 0x555fd17b0d50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535a81fee8b06ccf server_cookie=e8a42be8c1f06b79 in_seq=0 out_seq=0 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84b17fa640 1 -- 172.21.15.66:0/4109227338 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555fd16dcb40 con 0x555fd17c32c0 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84b17fa640 10 client.6642 handle_command_reply: tid=0 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84d71f1740 1 client.6642 shutdown 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 msgr2=0x555fd1781fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.966+0000 7f84d71f1740 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1781fa0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f84c0032000 tx=0x7f84c0004ab0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 shutdown_connections 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17c32c0 0x555fd17b0d50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1795770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1781fa0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 --2- 172.21.15.66:0/4109227338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd17c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84b17fa640 0 client.6642 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 >> 172.21.15.66:0/4109227338 conn(0x555fd1794b40 msgr2=0x555fd1768300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 shutdown_connections 2024-05-10T11:17:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 1 -- 172.21.15.66:0/4109227338 wait complete. 2024-05-10T11:17:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.967+0000 7f84d71f1740 20 client.6642 trim_cache size 0 max 16384 2024-05-10T11:17:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.985+0000 7f84d71f1740 1 Processor -- start 2024-05-10T11:17:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.985+0000 7f84d71f1740 1 -- start start 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.985+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd176a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.985+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd17986e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd17d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d71f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc201cf0 con 0x555fd1795280 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc200dc0 con 0x555fd17b2160 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc0b5140 con 0x555fd17c2ee0 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd176a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd176a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56160/0 (socket says 172.21.15.66:56160) 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 -- 172.21.15.66:0/1363361869 learned_addr learned my addr 172.21.15.66:0/1363361869 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 -- 172.21.15.66:0/1363361869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 msgr2=0x555fd17d37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd17d37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 -- 172.21.15.66:0/1363361869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 msgr2=0x555fd17986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd17986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 -- 172.21.15.66:0/1363361869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd13a00f0 con 0x555fd1795280 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84d2275640 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd176a850 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f84bc05d0a0 tx=0x7f84bc095c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb0adeb8a137f48 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84b37fe640 1 -- 172.21.15.66:0/1363361869 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc069880 con 0x555fd1795280 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84b37fe640 1 -- 172.21.15.66:0/1363361869 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc095e00 con 0x555fd1795280 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.986+0000 7f84b37fe640 1 -- 172.21.15.66:0/1363361869 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc011340 con 0x555fd1795280 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 -- 172.21.15.66:0/1363361869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 msgr2=0x555fd176a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd176a850 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f84bc05d0a0 tx=0x7f84bc095c50 comp rx=0 tx=0).stop 2024-05-10T11:17:26.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 -- 172.21.15.66:0/1363361869 shutdown_connections 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd17d37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd17b2160 0x555fd17986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 --2- 172.21.15.66:0/1363361869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd1795280 0x555fd176a850 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 -- 172.21.15.66:0/1363361869 >> 172.21.15.66:0/1363361869 conn(0x555fd1794b40 msgr2=0x555fd1781db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 -- 172.21.15.66:0/1363361869 shutdown_connections 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 -- 172.21.15.66:0/1363361869 wait complete. 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 -- start start 2024-05-10T11:17:26.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.987+0000 7f84d71f1740 1 Processor -- start 2024-05-10T11:17:26.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd1764460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1790ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1791430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fd176bb80 con 0x555fd17b2160 2024-05-10T11:17:26.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc2007a0 con 0x555fd1795280 2024-05-10T11:17:26.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555fd17b0cf0 con 0x555fd17c2ee0 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d71f1740 10 client.0 _ll_register_callbacks cb 0x7f84bc060880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.988+0000 7f84d1a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1790ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1790ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56162/0 (socket says 172.21.15.66:56162) 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 -- 172.21.15.66:0/3732572393 learned_addr learned my addr 172.21.15.66:0/3732572393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d2275640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd1764460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d2a76640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1791430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 -- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 msgr2=0x555fd1791430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1791430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 -- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 msgr2=0x555fd1764460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd1764460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 -- 172.21.15.66:0/3732572393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd17bc6f0 con 0x555fd17b2160 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d2a76640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1791430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d1a74640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1790ef0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009bd0 tx=0x7f84c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03000b57e756f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84b17fa640 1 -- 172.21.15.66:0/3732572393 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0070060 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84b17fa640 1 -- 172.21.15.66:0/3732572393 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f84c003cc40 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84bc095e00 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84b17fa640 1 -- 172.21.15.66:0/3732572393 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f84c0076050 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d71f1740 10 client.6648 fetch_fsmap learned FSMap version 53 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x555fd17bc180 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.989+0000 7f84b17fa640 1 -- 172.21.15.66:0/3732572393 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc095e00 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84b17fa640 1 -- 172.21.15.66:0/3732572393 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f84c0079020 con 0x555fd17b2160 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 10 client.6648 fetch_fsmap finished waiting for FSMap version 53 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 10 client.6648 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 20 client.6648 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17b0510 0x555fd1793a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 4 client.6648 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:17:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555fd16d69b0 con 0x555fd17b0510 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d2275640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17b0510 0x555fd1793a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d2275640 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17b0510 0x555fd1793a10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a26b577ae0cdacb3 server_cookie=d7981a88a78f343d in_seq=0 out_seq=0 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84b17fa640 10 client.6648 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84b17fa640 1 -- 172.21.15.66:0/3732572393 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x555fd16d69b0 con 0x555fd17b0510 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84b17fa640 10 client.6648 handle_command_reply: tid=0 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 client.6648 shutdown 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 msgr2=0x555fd1790ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1790ef0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009bd0 tx=0x7f84c0004a40 comp rx=0 tx=0).stop 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 shutdown_connections 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x555fd17b0510 0x555fd1793a10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fd17c2ee0 0x555fd1791430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84b17fa640 0 client.6648 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fd17b2160 0x555fd1790ef0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 --2- 172.21.15.66:0/3732572393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fd1795280 0x555fd1764460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 >> 172.21.15.66:0/3732572393 conn(0x555fd1794b40 msgr2=0x555fd1768300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 shutdown_connections 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.990+0000 7f84d71f1740 1 -- 172.21.15.66:0/3732572393 wait complete. 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d71f1740 20 client.6648 trim_cache size 0 max 16384 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stdout: "6cea6bc0-aa82-4215-8f45-9a63d8009973": { 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/subdir", 2024-05-10T11:17:26.998 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "6cea6bc0-aa82-4215-8f45-9a63d8009973", 2024-05-10T11:17:26.999 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair" 2024-05-10T11:17:26.999 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:17:26.999 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:17:26.999 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:17:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84b8076300 msgr2=0x7f84b80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84b8076300 0x7f84b80787c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f84c0034000 tx=0x7f84c002e000 comp rx=0 tx=0).stop 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 msgr2=0x7f84cc1511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 0x7f84cc1511e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00d7d0 tx=0x7f84bc00dc90 comp rx=0 tx=0).stop 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 shutdown_connections 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f84b8076300 0x7f84b80787c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84cc0cf3e0 0x7f84cc070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84cc0cd500 0x7f84cc070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 --2- 172.21.15.66:0/1360051682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84cc0b2dd0 0x7f84cc1511e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 >> 172.21.15.66:0/1360051682 conn(0x7f84cc0d2eb0 msgr2=0x7f84cc0757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 shutdown_connections 2024-05-10T11:17:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:26.991+0000 7f84d44d9640 1 -- 172.21.15.66:0/1360051682 wait complete. 2024-05-10T11:17:27.002 INFO:tasks.cephfs.filesystem:scrub status for tag:6cea6bc0-aa82-4215-8f45-9a63d8009973 - {'path': '/subdir', 'tag': '6cea6bc0-aa82-4215-8f45-9a63d8009973', 'options': 'recursive,repair'} 2024-05-10T11:17:32.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:17:32.098 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:17:57.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:57.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T11:17:57.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.123+0000 7f236bf11640 1 Processor -- start 2024-05-10T11:17:57.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.124+0000 7f236bf11640 1 -- start start 2024-05-10T11:17:57.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.124+0000 7f236bf11640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f236415f410 0x7f23640d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.124+0000 7f236bf11640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640b56a0 0x7f23640d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.124+0000 7f236bf11640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23640d2800 con 0x7f23640d0f10 2024-05-10T11:17:57.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.124+0000 7f236bf11640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f23640d2ae0 con 0x7f236415f410 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.124+0000 7f236bf11640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23640d01d0 con 0x7f23640b56a0 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f236415f410 0x7f23640d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f236415f410 0x7f23640d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33376/0 (socket says 172.21.15.66:33376) 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 -- 172.21.15.66:0/3223643886 learned_addr learned my addr 172.21.15.66:0/3223643886 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f236a4ae640 1 --2- 172.21.15.66:0/3223643886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640b56a0 0x7f23640d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 -- 172.21.15.66:0/3223643886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640b56a0 msgr2=0x7f23640d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 --2- 172.21.15.66:0/3223643886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640b56a0 0x7f23640d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 -- 172.21.15.66:0/3223643886 >> v1:172.21.15.190:6789/0 conn(0x7f23640d0f10 legacy=0x7f23640b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.125+0000 7f2369cad640 1 -- 172.21.15.66:0/3223643886 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23640d04b0 con 0x7f236415f410 2024-05-10T11:17:57.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.126+0000 7f2369cad640 1 --2- 172.21.15.66:0/3223643886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236415f410 0x7f23640d09d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f235c009870 tx=0x7f235c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1584b4ad2109c51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.126+0000 7f2368cab640 1 -- 172.21.15.66:0/3223643886 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c037070 con 0x7f236415f410 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.126+0000 7f2368cab640 1 -- 172.21.15.66:0/3223643886 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c032440 con 0x7f236415f410 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.126+0000 7f2368cab640 1 -- 172.21.15.66:0/3223643886 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c032810 con 0x7f236415f410 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.126+0000 7f236bf11640 1 -- 172.21.15.66:0/3223643886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236415f410 msgr2=0x7f23640d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.126+0000 7f236bf11640 1 --2- 172.21.15.66:0/3223643886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236415f410 0x7f23640d09d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f235c009870 tx=0x7f235c02a1c0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.127+0000 7f236bf11640 1 -- 172.21.15.66:0/3223643886 shutdown_connections 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.127+0000 7f236bf11640 1 --2- 172.21.15.66:0/3223643886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640b56a0 0x7f23640d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.127+0000 7f236bf11640 1 --2- 172.21.15.66:0/3223643886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236415f410 0x7f23640d09d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.127+0000 7f236bf11640 1 -- 172.21.15.66:0/3223643886 >> 172.21.15.66:0/3223643886 conn(0x7f236408ed30 msgr2=0x7f236409e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.127+0000 7f236bf11640 1 -- 172.21.15.66:0/3223643886 shutdown_connections 2024-05-10T11:17:57.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.127+0000 7f236bf11640 1 -- 172.21.15.66:0/3223643886 wait complete. 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.128+0000 7f236bf11640 1 Processor -- start 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.128+0000 7f236bf11640 1 -- start start 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640d0f10 0x7f23640ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236415f410 0x7f23640baae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 0x7f23640b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23640cffb0 con 0x7f236414b0a0 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f23640cfe30 con 0x7f236415f410 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23640d3c10 con 0x7f23640d0f10 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 0x7f23640b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 0x7f23640b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33380/0 (socket says 172.21.15.66:33380) 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 -- 172.21.15.66:0/4180180130 learned_addr learned my addr 172.21.15.66:0/4180180130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f2369cad640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640d0f10 0x7f23640ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f23694ac640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236415f410 0x7f23640baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 -- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640d0f10 msgr2=0x7f23640ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640d0f10 0x7f23640ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 -- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236415f410 msgr2=0x7f23640baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236415f410 0x7f23640baae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 -- 172.21.15.66:0/4180180130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236414b530 con 0x7f236414b0a0 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f23694ac640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236415f410 0x7f23640baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f2369cad640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640d0f10 0x7f23640ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236a4ae640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 0x7f23640b2c30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f235400efc0 tx=0x7f235400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f23627fc640 1 -- 172.21.15.66:0/4180180130 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354018020 con 0x7f236414b0a0 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f23627fc640 1 -- 172.21.15.66:0/4180180130 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2354014480 con 0x7f236414b0a0 2024-05-10T11:17:57.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23640ce900 con 0x7f236414b0a0 2024-05-10T11:17:57.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.129+0000 7f23627fc640 1 -- 172.21.15.66:0/4180180130 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354014870 con 0x7f236414b0a0 2024-05-10T11:17:57.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.130+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23640ceec0 con 0x7f236414b0a0 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.131+0000 7f23627fc640 1 -- 172.21.15.66:0/4180180130 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2354005d10 con 0x7f236414b0a0 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.132+0000 7f23627fc640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23500762d0 0x7f2350078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.132+0000 7f23627fc640 1 -- 172.21.15.66:0/4180180130 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f2354098380 con 0x7f236414b0a0 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.132+0000 7f2369cad640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23500762d0 0x7f2350078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.133+0000 7f2369cad640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23500762d0 0x7f2350078790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f235c034000 tx=0x7f235c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.133+0000 7f236ec21740 1 Processor -- start 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.133+0000 7f236ec21740 1 -- start start 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.133+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adf4160 0x560a5ada6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f236ec21740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5add6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5add6b40 0x560a5adab950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f236ec21740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560a5ad73690 con 0x560a5add7280 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560a5ad10f30 con 0x560a5adf4160 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560a5acc9b20 con 0x560a5add6b40 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5add6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5add6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33388/0 (socket says 172.21.15.66:33388) 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 -- 172.21.15.66:0/3759546595 learned_addr learned my addr 172.21.15.66:0/3759546595 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f2369cad640 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adf4160 0x560a5ada6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f236a4ae640 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5add6b40 0x560a5adab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 -- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5add6b40 msgr2=0x560a5adab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5add6b40 0x560a5adab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 -- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adf4160 msgr2=0x560a5ada6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adf4160 0x560a5ada6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 -- 172.21.15.66:0/3759546595 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a5acc1e60 con 0x560a5add7280 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f2369cad640 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adf4160 0x560a5ada6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f23694ac640 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5add6600 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2358001750 tx=0x7f2358001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eabc16de1b93d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f234b7fe640 1 -- 172.21.15.66:0/3759546595 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358018070 con 0x560a5add7280 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f234b7fe640 1 -- 172.21.15.66:0/3759546595 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235800d730 con 0x560a5add7280 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.134+0000 7f234b7fe640 1 -- 172.21.15.66:0/3759546595 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235800db00 con 0x560a5add7280 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 -- 172.21.15.66:0/3759546595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 msgr2=0x560a5add6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5add6600 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2358001750 tx=0x7f2358001c10 comp rx=0 tx=0).stop 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 -- 172.21.15.66:0/3759546595 shutdown_connections 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5add6b40 0x560a5adab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5add6600 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 --2- 172.21.15.66:0/3759546595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adf4160 0x560a5ada6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 -- 172.21.15.66:0/3759546595 >> 172.21.15.66:0/3759546595 conn(0x560a5ada8d60 msgr2=0x560a5adf1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 -- 172.21.15.66:0/3759546595 shutdown_connections 2024-05-10T11:17:57.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.135+0000 7f236ec21740 1 -- 172.21.15.66:0/3759546595 wait complete. 2024-05-10T11:17:57.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.136+0000 7f236ec21740 1 -- start start 2024-05-10T11:17:57.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.136+0000 7f236ec21740 1 Processor -- start 2024-05-10T11:17:57.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adc6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5add8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560a5accd5e0 con 0x560a5adc4980 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560a5ad0cef0 con 0x560a5add7280 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560a5adaaf10 con 0x560a5adf4160 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236ec21740 10 client.0 _ll_register_callbacks cb 0x560a5acc8320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5add8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5add8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33390/0 (socket says 172.21.15.66:33390) 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 -- 172.21.15.66:0/1430571736 learned_addr learned my addr 172.21.15.66:0/1430571736 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f2369cad640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adc6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f23694ac640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 -- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 msgr2=0x560a5add63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 -- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 msgr2=0x560a5adc6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adc6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 -- 172.21.15.66:0/1430571736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a5aaec7d0 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f236a4ae640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5add8df0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f235400c990 tx=0x7f2354060f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5787944a2e145d6b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f2348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.137+0000 7f2348ff9640 1 -- 172.21.15.66:0/1430571736 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235407a070 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f2348ff9640 1 -- 172.21.15.66:0/1430571736 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f2354096af0 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f235800d730 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f2348ff9640 1 -- 172.21.15.66:0/1430571736 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2354065720 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 10 client.6660 fetch_fsmap learned FSMap version 54 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x560a5aa223f0 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f2348ff9640 1 -- 172.21.15.66:0/1430571736 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235800d730 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f2348ff9640 1 -- 172.21.15.66:0/1430571736 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f2354096150 con 0x560a5adc4980 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 10 client.6660 fetch_fsmap finished waiting for FSMap version 54 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 10 client.6660 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 20 client.6660 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:57.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5adf31c0 0x560a5add45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 4 client.6660 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a5ad1eb40 con 0x560a5adf31c0 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.138+0000 7f2369cad640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5adf31c0 0x560a5add45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f2369cad640 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5adf31c0 0x560a5add45c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa9cbdc3866ca135 server_cookie=902f5cdcea384e53 in_seq=0 out_seq=0 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f2348ff9640 10 client.6660 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f2348ff9640 1 -- 172.21.15.66:0/1430571736 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560a5ad1eb40 con 0x560a5adf31c0 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f2348ff9640 10 client.6660 handle_command_reply: tid=0 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 client.6660 shutdown 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 msgr2=0x560a5add8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5add8df0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f235400c990 tx=0x7f2354060f40 comp rx=0 tx=0).stop 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 shutdown_connections 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5adf31c0 0x560a5add45c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5add8df0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 --2- 172.21.15.66:0/1430571736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adc6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f2348ff9640 0 client.6660 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.139+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 >> 172.21.15.66:0/1430571736 conn(0x560a5add6b40 msgr2=0x560a5ada6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.140+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 shutdown_connections 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.140+0000 7f236ec21740 1 -- 172.21.15.66:0/1430571736 wait complete. 2024-05-10T11:17:57.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.140+0000 7f236ec21740 20 client.6660 trim_cache size 0 max 16384 2024-05-10T11:17:57.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.158+0000 7f236ec21740 1 Processor -- start 2024-05-10T11:17:57.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.158+0000 7f236ec21740 1 -- start start 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f236ec21740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5ae152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adf0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f236ec21740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2364202040 con 0x560a5adc4980 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f23642010a0 con 0x560a5add7280 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f236414c7c0 con 0x560a5adf4160 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5ae152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5ae152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33398/0 (socket says 172.21.15.66:33398) 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 -- 172.21.15.66:0/459885259 learned_addr learned my addr 172.21.15.66:0/459885259 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 -- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 msgr2=0x560a5add45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 -- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 msgr2=0x560a5adf0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f23694ac640 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adf0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adf0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 -- 172.21.15.66:0/459885259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a5ada7ba0 con 0x560a5adc4980 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f23694ac640 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adf0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f2369cad640 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5ae152a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f235c0090b0 tx=0x7f235c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae189350e67fc82f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f234affd640 1 -- 172.21.15.66:0/459885259 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c037040 con 0x560a5adc4980 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f234affd640 1 -- 172.21.15.66:0/459885259 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c032e40 con 0x560a5adc4980 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.159+0000 7f234affd640 1 -- 172.21.15.66:0/459885259 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c04e3d0 con 0x560a5adc4980 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 -- 172.21.15.66:0/459885259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 msgr2=0x560a5ae152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5ae152a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f235c0090b0 tx=0x7f235c02c000 comp rx=0 tx=0).stop 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 -- 172.21.15.66:0/459885259 shutdown_connections 2024-05-10T11:17:57.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5add45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5add7280 0x560a5adf0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 --2- 172.21.15.66:0/459885259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5adc4980 0x560a5ae152a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 -- 172.21.15.66:0/459885259 >> 172.21.15.66:0/459885259 conn(0x560a5add6b40 msgr2=0x560a5add60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 -- 172.21.15.66:0/459885259 shutdown_connections 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 -- 172.21.15.66:0/459885259 wait complete. 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.160+0000 7f236ec21740 1 -- start start 2024-05-10T11:17:57.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.161+0000 7f236ec21740 1 Processor -- start 2024-05-10T11:17:57.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.161+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adc4980 0x560a5add34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5ae6e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5ae6eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2364200a80 con 0x560a5add7280 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560a5adf2730 con 0x560a5adc4980 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560a5adee2c0 con 0x560a5adf4160 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 10 client.0 _ll_register_callbacks cb 0x7f235405da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5ae6e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5ae6e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33410/0 (socket says 172.21.15.66:33410) 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 -- 172.21.15.66:0/3792046763 learned_addr learned my addr 172.21.15.66:0/3792046763 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f2369cad640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adc4980 0x560a5add34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236a4ae640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5ae6eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 -- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 msgr2=0x560a5ae6eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5ae6eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 -- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adc4980 msgr2=0x560a5add34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adc4980 0x560a5add34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 -- 172.21.15.66:0/3792046763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a5a9e20f0 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236a4ae640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5ae6eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f23694ac640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5ae6e610 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2358012000 tx=0x7f2358000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9c0f8bbf11e704 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f2348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f2348ff9640 1 -- 172.21.15.66:0/3792046763 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358025070 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f2348ff9640 1 -- 172.21.15.66:0/3792046763 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f23580067d0 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a5ad189b0 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f2348ff9640 1 -- 172.21.15.66:0/3792046763 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f235802d050 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 10 client.6666 fetch_fsmap learned FSMap version 54 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.162+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x560a5adf1ce0 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2348ff9640 1 -- 172.21.15.66:0/3792046763 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560a5ad189b0 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2348ff9640 1 -- 172.21.15.66:0/3792046763 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f2358030020 con 0x560a5add7280 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 10 client.6666 fetch_fsmap finished waiting for FSMap version 54 2024-05-10T11:17:57.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 10 client.6666 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 20 client.6666 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5ae15980 0x560a5aded4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 4 client.6666 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560a5ac934a0 con 0x560a5ae15980 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2369cad640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5ae15980 0x560a5aded4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2369cad640 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5ae15980 0x560a5aded4e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c62f56ff859a59 server_cookie=c93b4faa04ec640b in_seq=0 out_seq=0 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2348ff9640 10 client.6666 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2348ff9640 1 -- 172.21.15.66:0/3792046763 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560a5ac934a0 con 0x560a5ae15980 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2348ff9640 10 client.6666 handle_command_reply: tid=0 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 client.6666 shutdown 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 msgr2=0x560a5ae6e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5ae6e610 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2358012000 tx=0x7f2358000bc0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 shutdown_connections 2024-05-10T11:17:57.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x560a5ae15980 0x560a5aded4e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560a5adf4160 0x560a5ae6eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560a5add7280 0x560a5ae6e610 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 --2- 172.21.15.66:0/3792046763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560a5adc4980 0x560a5add34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f2348ff9640 0 client.6666 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.163+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 >> 172.21.15.66:0/3792046763 conn(0x560a5add6b40 msgr2=0x560a5add1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 shutdown_connections 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236ec21740 1 -- 172.21.15.66:0/3792046763 wait complete. 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236ec21740 20 client.6666 trim_cache size 0 max 16384 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:17:57.169 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:17:57.170 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:17:57.170 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:17:57.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23500762d0 msgr2=0x7f2350078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23500762d0 0x7f2350078790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f235c034000 tx=0x7f235c02e000 comp rx=0 tx=0).stop 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 msgr2=0x7f23640b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 0x7f23640b2c30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f235400efc0 tx=0x7f235400c490 comp rx=0 tx=0).stop 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 shutdown_connections 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23500762d0 0x7f2350078790 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236414b0a0 0x7f23640b2c30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236415f410 0x7f23640baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 --2- 172.21.15.66:0/4180180130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23640d0f10 0x7f23640ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 >> 172.21.15.66:0/4180180130 conn(0x7f236408ed30 msgr2=0x7f23640759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 shutdown_connections 2024-05-10T11:17:57.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.164+0000 7f236bf11640 1 -- 172.21.15.66:0/4180180130 wait complete. 2024-05-10T11:17:57.175 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:17:57.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:17:57.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.278+0000 7fe453933640 1 Processor -- start 2024-05-10T11:17:57.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.279+0000 7fe453933640 1 -- start start 2024-05-10T11:17:57.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe453933640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe44c06c990 0x7fe44c163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe453933640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe44c15f620 0x7fe44c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe453933640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c0704c0 0x7fe44c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe453933640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe44c06cd70 con 0x7fe44c06c990 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe453933640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe44c163ba0 con 0x7fe44c15f620 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe453933640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c160190 con 0x7fe44c0704c0 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe44c06c990 0x7fe44c163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe44c06c990 0x7fe44c163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33414/0 (socket says 172.21.15.66:33414) 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 -- 172.21.15.66:0/2876550501 learned_addr learned my addr 172.21.15.66:0/2876550501 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe451ed0640 1 --2- 172.21.15.66:0/2876550501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c0704c0 0x7fe44c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe450ece640 1 --2- 172.21.15.66:0/2876550501 >> v2:172.21.15.190:3300/0 conn(0x7fe44c15f620 0x7fe44c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 -- 172.21.15.66:0/2876550501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c0704c0 msgr2=0x7fe44c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 --2- 172.21.15.66:0/2876550501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c0704c0 0x7fe44c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 -- 172.21.15.66:0/2876550501 >> v2:172.21.15.190:3300/0 conn(0x7fe44c15f620 msgr2=0x7fe44c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 --2- 172.21.15.66:0/2876550501 >> v2:172.21.15.190:3300/0 conn(0x7fe44c15f620 0x7fe44c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.280+0000 7fe4516cf640 1 -- 172.21.15.66:0/2876550501 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c160470 con 0x7fe44c06c990 2024-05-10T11:17:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe4516cf640 1 --2- 172.21.15.66:0/2876550501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c06c990 0x7fe44c163660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe44c06e310 tx=0x7fe44802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb6aecd48420f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe43ffff640 1 -- 172.21.15.66:0/2876550501 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448037070 con 0x7fe44c06c990 2024-05-10T11:17:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe43ffff640 1 -- 172.21.15.66:0/2876550501 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe448032440 con 0x7fe44c06c990 2024-05-10T11:17:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe43ffff640 1 -- 172.21.15.66:0/2876550501 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448032810 con 0x7fe44c06c990 2024-05-10T11:17:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 -- 172.21.15.66:0/2876550501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c06c990 msgr2=0x7fe44c163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 --2- 172.21.15.66:0/2876550501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c06c990 0x7fe44c163660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe44c06e310 tx=0x7fe44802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 -- 172.21.15.66:0/2876550501 shutdown_connections 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 --2- 172.21.15.66:0/2876550501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c0704c0 0x7fe44c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 --2- 172.21.15.66:0/2876550501 >> v2:172.21.15.190:3300/0 conn(0x7fe44c15f620 0x7fe44c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 --2- 172.21.15.66:0/2876550501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c06c990 0x7fe44c163660 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.281+0000 7fe453933640 1 -- 172.21.15.66:0/2876550501 >> 172.21.15.66:0/2876550501 conn(0x7fe44c0b3980 msgr2=0x7fe44c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.282+0000 7fe453933640 1 -- 172.21.15.66:0/2876550501 shutdown_connections 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.282+0000 7fe453933640 1 -- 172.21.15.66:0/2876550501 wait complete. 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.283+0000 7fe453933640 1 Processor -- start 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.283+0000 7fe453933640 1 -- start start 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.283+0000 7fe453933640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c06c990 0x7fe44c0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.283+0000 7fe453933640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe44c0704c0 0x7fe44c1f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.283+0000 7fe453933640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 0x7fe44c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe453933640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c070e60 con 0x7fe44c15f620 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe453933640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c163140 con 0x7fe44c0704c0 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe453933640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c073e70 con 0x7fe44c06c990 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 0x7fe44c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 0x7fe44c15c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33420/0 (socket says 172.21.15.66:33420) 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 -- 172.21.15.66:0/3831775301 learned_addr learned my addr 172.21.15.66:0/3831775301 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe4516cf640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c06c990 0x7fe44c0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe450ece640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe44c0704c0 0x7fe44c1f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 -- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c06c990 msgr2=0x7fe44c0b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c06c990 0x7fe44c0b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 -- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe44c0704c0 msgr2=0x7fe44c1f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe44c0704c0 0x7fe44c1f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 -- 172.21.15.66:0/3831775301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c15c8c0 con 0x7fe44c15f620 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe450ece640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe44c0704c0 0x7fe44c1f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe451ed0640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 0x7fe44c15c380 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe444007d20 tx=0x7fe44400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444014420 con 0x7fe44c15f620 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe444019070 con 0x7fe44c15f620 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c1f5480 con 0x7fe44c15f620 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.284+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444014820 con 0x7fe44c15f620 2024-05-10T11:17:57.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.285+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c1f5a40 con 0x7fe44c15f620 2024-05-10T11:17:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.285+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44c1f5c80 con 0x7fe44c15f620 2024-05-10T11:17:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.286+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe4440149c0 con 0x7fe44c15f620 2024-05-10T11:17:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.287+0000 7fe43dffb640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4300762d0 0x7fe430078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.287+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fe444097fb0 con 0x7fe44c15f620 2024-05-10T11:17:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.287+0000 7fe4516cf640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4300762d0 0x7fe430078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.288+0000 7fe4516cf640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4300762d0 0x7fe430078790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe448034000 tx=0x7fe44802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.291+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe444061730 con 0x7fe44c15f620 2024-05-10T11:17:57.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.520+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe44c06a220 con 0x7fe44c15f620 2024-05-10T11:17:57.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.520+0000 7fe43dffb640 1 -- 172.21.15.66:0/3831775301 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5185 (secure 0 0 0) 0x7fe444061030 con 0x7fe44c15f620 2024-05-10T11:17:57.520 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:17:57.520 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:17:30.966170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:17:57.520 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-05-10T11:17:57.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4300762d0 msgr2=0x7fe430078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4300762d0 0x7fe430078790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe448034000 tx=0x7fe44802e000 comp rx=0 tx=0).stop 2024-05-10T11:17:57.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 msgr2=0x7fe44c15c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 0x7fe44c15c380 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe444007d20 tx=0x7fe44400e4b0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 shutdown_connections 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4300762d0 0x7fe430078790 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe44c15f620 0x7fe44c15c380 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe44c0704c0 0x7fe44c1f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 --2- 172.21.15.66:0/3831775301 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe44c06c990 0x7fe44c0b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 >> 172.21.15.66:0/3831775301 conn(0x7fe44c0b3980 msgr2=0x7fe44c0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 shutdown_connections 2024-05-10T11:17:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.523+0000 7fe453933640 1 -- 172.21.15.66:0/3831775301 wait complete. 2024-05-10T11:17:57.533 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T11:17:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 Processor -- start 2024-05-10T11:17:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 -- start start 2024-05-10T11:17:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 0x7fc1080b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc1080cd500 0x7fc1080d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10806e720 con 0x7fc1080cf3e0 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc10806de80 con 0x7fc1080cd500 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.640+0000 7fc10e2a9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc10806e160 con 0x7fc1080cffd0 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 0x7fc1080b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc10c846640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc1080cd500 0x7fc1080d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 0x7fc1080b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:47216/0 (socket says 172.21.15.66:47216) 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 -- 172.21.15.66:0/1006320811 learned_addr learned my addr 172.21.15.66:0/1006320811 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc107fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc1080cf3e0 0x7fc1080cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:35310/0 (socket says 172.21.15.66:35310) 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 -- 172.21.15.66:0/1006320811 >> v2:172.21.15.190:3300/0 conn(0x7fc1080cd500 msgr2=0x7fc1080d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 --2- 172.21.15.66:0/1006320811 >> v2:172.21.15.190:3300/0 conn(0x7fc1080cd500 0x7fc1080d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 -- 172.21.15.66:0/1006320811 >> v1:172.21.15.190:6789/0 conn(0x7fc1080cf3e0 legacy=0x7fc1080cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc106ffd640 1 -- 172.21.15.66:0/1006320811 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160854033 0 0) 0x7fc10806e720 con 0x7fc1080cf3e0 2024-05-10T11:17:57.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.641+0000 7fc1077fe640 1 -- 172.21.15.66:0/1006320811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10806e440 con 0x7fc1080cffd0 2024-05-10T11:17:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.642+0000 7fc1077fe640 1 --2- 172.21.15.66:0/1006320811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 0x7fc1080b3de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009870 tx=0x7fc0f002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c684e104e191b4eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.642+0000 7fc106ffd640 1 -- 172.21.15.66:0/1006320811 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0037070 con 0x7fc1080cffd0 2024-05-10T11:17:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.642+0000 7fc106ffd640 1 -- 172.21.15.66:0/1006320811 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0032440 con 0x7fc1080cffd0 2024-05-10T11:17:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.642+0000 7fc106ffd640 1 -- 172.21.15.66:0/1006320811 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0032810 con 0x7fc1080cffd0 2024-05-10T11:17:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 -- 172.21.15.66:0/1006320811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 msgr2=0x7fc1080b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/1006320811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 0x7fc1080b3de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009870 tx=0x7fc0f002a270 comp rx=0 tx=0).stop 2024-05-10T11:17:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 -- 172.21.15.66:0/1006320811 shutdown_connections 2024-05-10T11:17:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/1006320811 >> v2:172.21.15.190:3300/0 conn(0x7fc1080cd500 0x7fc1080d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/1006320811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cffd0 0x7fc1080b3de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 -- 172.21.15.66:0/1006320811 >> 172.21.15.66:0/1006320811 conn(0x7fc1080d2eb0 msgr2=0x7fc1080d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 -- 172.21.15.66:0/1006320811 shutdown_connections 2024-05-10T11:17:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.643+0000 7fc10e2a9640 1 -- 172.21.15.66:0/1006320811 wait complete. 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.644+0000 7fc10e2a9640 1 Processor -- start 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.644+0000 7fc10e2a9640 1 -- start start 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10e2a9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cd500 0x7fc1081f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10e2a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 0x7fc1080c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10e2a9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1080cffd0 0x7fc1080c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10e2a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080d16c0 con 0x7fc1080cf3e0 2024-05-10T11:17:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10e2a9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080b4510 con 0x7fc1080cffd0 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10e2a9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc1080d1840 con 0x7fc1080cd500 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 0x7fc1080c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 0x7fc1080c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33436/0 (socket says 172.21.15.66:33436) 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 -- 172.21.15.66:0/2777001955 learned_addr learned my addr 172.21.15.66:0/2777001955 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc10c846640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1080cffd0 0x7fc1080c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc107fff640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cd500 0x7fc1081f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 -- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cd500 msgr2=0x7fc1081f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cd500 0x7fc1081f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 -- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1080cffd0 msgr2=0x7fc1080c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1080cffd0 0x7fc1080c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.645+0000 7fc1077fe640 1 -- 172.21.15.66:0/2777001955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1081f48f0 con 0x7fc1080cf3e0 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.646+0000 7fc1077fe640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 0x7fc1080c91e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00090b0 tx=0x7fc0f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.646+0000 7fc104ff9640 1 -- 172.21.15.66:0/2777001955 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0037040 con 0x7fc1080cf3e0 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.646+0000 7fc104ff9640 1 -- 172.21.15.66:0/2777001955 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0004030 con 0x7fc1080cf3e0 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.646+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10815f290 con 0x7fc1080cf3e0 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.646+0000 7fc104ff9640 1 -- 172.21.15.66:0/2777001955 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0004420 con 0x7fc1080cf3e0 2024-05-10T11:17:57.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.646+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1080c6db0 con 0x7fc1080cf3e0 2024-05-10T11:17:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.647+0000 7fc104ff9640 1 -- 172.21.15.66:0/2777001955 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0f003a070 con 0x7fc1080cf3e0 2024-05-10T11:17:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.648+0000 7fc104ff9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0e8076300 0x7fc0e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.648+0000 7fc104ff9640 1 -- 172.21.15.66:0/2777001955 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fc0f00b7c00 con 0x7fc1080cf3e0 2024-05-10T11:17:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.648+0000 7fc107fff640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0e8076300 0x7fc0e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc107fff640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0e8076300 0x7fc0e80787c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8000f60 tx=0x7fc0f8007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 Processor -- start 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 -- start start 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b81182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8147b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81480b0 0x55f9b811cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f9b8008920 con 0x55f9b81656d0 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f9b807ddd0 con 0x55f9b81480b0 2024-05-10T11:17:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.649+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f9b802e3e0 con 0x55f9b81487f0 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b81182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b81182f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33446/0 (socket says 172.21.15.66:33446) 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 -- 172.21.15.66:0/1686844860 learned_addr learned my addr 172.21.15.66:0/1686844860 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc1077fe640 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc10c846640 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81480b0 0x55f9b811cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 -- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 msgr2=0x55f9b8147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 -- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81480b0 msgr2=0x55f9b811cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81480b0 0x55f9b811cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 -- 172.21.15.66:0/1686844860 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b7e5f7c0 con 0x55f9b81656d0 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc10c846640 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81480b0 0x55f9b811cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc107fff640 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b81182f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8001920 tx=0x7fc0f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a128891a53fa39b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc0fdffb640 1 -- 172.21.15.66:0/1686844860 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8026070 con 0x55f9b81656d0 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc0fdffb640 1 -- 172.21.15.66:0/1686844860 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8013b80 con 0x55f9b81656d0 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.650+0000 7fc0fdffb640 1 -- 172.21.15.66:0/1686844860 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8012350 con 0x55f9b81656d0 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 -- 172.21.15.66:0/1686844860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 msgr2=0x55f9b81182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b81182f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8001920 tx=0x7fc0f8013000 comp rx=0 tx=0).stop 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 -- 172.21.15.66:0/1686844860 shutdown_connections 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81480b0 0x55f9b811cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 --2- 172.21.15.66:0/1686844860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b81182f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 -- 172.21.15.66:0/1686844860 >> 172.21.15.66:0/1686844860 conn(0x55f9b811a560 msgr2=0x55f9b8162b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 -- 172.21.15.66:0/1686844860 shutdown_connections 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 -- 172.21.15.66:0/1686844860 wait complete. 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.651+0000 7fc110fc5740 1 -- start start 2024-05-10T11:17:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 Processor -- start 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8149920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b815b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b8131e60 0x55f9b811cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f9b8086440 con 0x55f9b81656d0 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f9b8081120 con 0x55f9b8131e60 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f9b808f210 con 0x55f9b81487f0 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc110fc5740 10 client.0 _ll_register_callbacks cb 0x55f9b8026690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.652+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b815b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33448/0 (socket says 172.21.15.66:33448) 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 -- 172.21.15.66:0/762058639 learned_addr learned my addr 172.21.15.66:0/762058639 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc107fff640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc10c846640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b8131e60 0x55f9b811cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 -- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 msgr2=0x55f9b8149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 -- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b8131e60 msgr2=0x55f9b811cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b8131e60 0x55f9b811cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 -- 172.21.15.66:0/762058639 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b7ebff50 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc1077fe640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b815b030 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc0f007dfa0 tx=0x7fc0f0081350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b576c8743cec5681 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc0e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/762058639 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f004a040 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/762058639 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fc0f0087230 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0f8013b80 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/762058639 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc0f0089390 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc110fc5740 10 client.6681 fetch_fsmap learned FSMap version 54 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55f9b7d530b0 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/762058639 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8013b80 con 0x55f9b81656d0 2024-05-10T11:17:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.653+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/762058639 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fc0f007c6a0 con 0x55f9b81656d0 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc110fc5740 10 client.6681 fetch_fsmap finished waiting for FSMap version 54 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc110fc5740 10 client.6681 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc110fc5740 20 client.6681 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc110fc5740 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b814a830 0x55f9b81345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc110fc5740 4 client.6681 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9b808fa20 con 0x55f9b814a830 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc107fff640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b814a830 0x55f9b81345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc0e6ffd640 10 client.6681 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.654+0000 7fc107fff640 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b814a830 0x55f9b81345e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=217a77ab58a3be11 server_cookie=1af65da35d221912 in_seq=0 out_seq=0 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/762058639 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f9b808fa20 con 0x55f9b814a830 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc0e6ffd640 10 client.6681 handle_command_reply: tid=0 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 client.6681 shutdown 2024-05-10T11:17:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 msgr2=0x55f9b815b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b815b030 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc0f007dfa0 tx=0x7fc0f0081350 comp rx=0 tx=0).stop 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 shutdown_connections 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b814a830 0x55f9b81345e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b8131e60 0x55f9b811cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81656d0 0x55f9b815b030 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc0e6ffd640 0 client.6681 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 --2- 172.21.15.66:0/762058639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 >> 172.21.15.66:0/762058639 conn(0x55f9b81480b0 msgr2=0x55f9b8162b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 shutdown_connections 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 1 -- 172.21.15.66:0/762058639 wait complete. 2024-05-10T11:17:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.655+0000 7fc110fc5740 20 client.6681 trim_cache size 0 max 16384 2024-05-10T11:17:57.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 Processor -- start 2024-05-10T11:17:57.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 -- start start 2024-05-10T11:17:57.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b8131e60 0x55f9b811ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 0x55f9b8166960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc108200d30 con 0x55f9b81487f0 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc108200090 con 0x55f9b81656d0 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc1082006e0 con 0x55f9b8131e60 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.669+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 0x55f9b8166960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 0x55f9b8166960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33464/0 (socket says 172.21.15.66:33464) 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 -- 172.21.15.66:0/4170183189 learned_addr learned my addr 172.21.15.66:0/4170183189 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 -- 172.21.15.66:0/4170183189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b8131e60 msgr2=0x55f9b811ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b8131e60 0x55f9b811ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 -- 172.21.15.66:0/4170183189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 msgr2=0x55f9b8142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 -- 172.21.15.66:0/4170183189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b815ad60 con 0x55f9b81487f0 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc1077fe640 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 0x55f9b8166960 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc0f007d320 tx=0x7fc0f0047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7411eeb63a58238f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc0fd7fa640 1 -- 172.21.15.66:0/4170183189 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f009f070 con 0x55f9b81487f0 2024-05-10T11:17:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc0fd7fa640 1 -- 172.21.15.66:0/4170183189 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0080840 con 0x55f9b81487f0 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc0fd7fa640 1 -- 172.21.15.66:0/4170183189 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f004a040 con 0x55f9b81487f0 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc110fc5740 1 -- 172.21.15.66:0/4170183189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 msgr2=0x55f9b8166960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.670+0000 7fc110fc5740 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 0x55f9b8166960 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc0f007d320 tx=0x7fc0f0047000 comp rx=0 tx=0).stop 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 -- 172.21.15.66:0/4170183189 shutdown_connections 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b81487f0 0x55f9b8166960 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 --2- 172.21.15.66:0/4170183189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b8131e60 0x55f9b811ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 -- 172.21.15.66:0/4170183189 >> 172.21.15.66:0/4170183189 conn(0x55f9b81480b0 msgr2=0x55f9b8162970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 -- 172.21.15.66:0/4170183189 shutdown_connections 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 -- 172.21.15.66:0/4170183189 wait complete. 2024-05-10T11:17:57.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 -- start start 2024-05-10T11:17:57.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.671+0000 7fc110fc5740 1 Processor -- start 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 0x55f9b8149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8185210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8185750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f9b815a960 con 0x55f9b8131e60 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f9b8037a20 con 0x55f9b81656d0 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f9b814ac30 con 0x55f9b81487f0 2024-05-10T11:17:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc110fc5740 10 client.0 _ll_register_callbacks cb 0x7fc0f007d3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 0x55f9b8149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 0x55f9b8149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33480/0 (socket says 172.21.15.66:33480) 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 -- 172.21.15.66:0/197168136 learned_addr learned my addr 172.21.15.66:0/197168136 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc10c846640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8185750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc1077fe640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8185210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 -- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 msgr2=0x55f9b8185210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8185210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 -- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 msgr2=0x55f9b8185750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8185750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.672+0000 7fc107fff640 1 -- 172.21.15.66:0/197168136 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b8112d40 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc107fff640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 0x55f9b8149bb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007470 tx=0x7fc0f8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714df8c3a6d7af7a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc0e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/197168136 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8037060 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/197168136 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fc0f8032360 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0f0080840 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/197168136 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc0f803d050 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 10 client.6687 fetch_fsmap learned FSMap version 54 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55f9b81622f0 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/197168136 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0080840 con 0x55f9b8131e60 2024-05-10T11:17:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/197168136 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fc0f8040020 con 0x55f9b8131e60 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 10 client.6687 fetch_fsmap finished waiting for FSMap version 54 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 10 client.6687 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 20 client.6687 populate_metadata read hostname 'smithi066' 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b8161650 0x55f9b8166090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 4 client.6687 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 --> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55f9b8089890 con 0x55f9b8161650 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.673+0000 7fc1077fe640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b8161650 0x55f9b8166090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc0e6ffd640 10 client.6687 ms_handle_connect on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc1077fe640 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b8161650 0x55f9b8166090 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8aa83bde2ba4e3 server_cookie=98cd23f9a4b7bc8c in_seq=0 out_seq=0 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc0e6ffd640 1 -- 172.21.15.66:0/197168136 <== mds.0 v2:172.21.15.66:6834/629825148 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9b8089890 con 0x55f9b8161650 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc0e6ffd640 10 client.6687 handle_command_reply: tid=0 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 client.6687 shutdown 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 msgr2=0x55f9b8149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 0x55f9b8149bb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007470 tx=0x7fc0f8001080 comp rx=0 tx=0).stop 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 shutdown_connections 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:6834/629825148,v1:172.21.15.66:6835/629825148] conn(0x55f9b8161650 0x55f9b8166090 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9b81656d0 0x55f9b8185750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f9b81487f0 0x55f9b8185210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc0e6ffd640 0 client.6687 ms_handle_reset on v2:172.21.15.66:6834/629825148 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 --2- 172.21.15.66:0/197168136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9b8131e60 0x55f9b8149bb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 >> 172.21.15.66:0/197168136 conn(0x55f9b81480b0 msgr2=0x55f9b8142ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 shutdown_connections 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 1 -- 172.21.15.66:0/197168136 wait complete. 2024-05-10T11:17:57.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.674+0000 7fc110fc5740 20 client.6687 trim_cache size 0 max 16384 2024-05-10T11:17:57.682 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:17:57.682 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0e8076300 msgr2=0x7fc0e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0e8076300 0x7fc0e80787c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8000f60 tx=0x7fc0f8007d50 comp rx=0 tx=0).stop 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 msgr2=0x7fc1080c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 0x7fc1080c91e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00090b0 tx=0x7fc0f00046c0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 shutdown_connections 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0e8076300 0x7fc0e80787c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1080cffd0 0x7fc1080c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1080cf3e0 0x7fc1080c91e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 --2- 172.21.15.66:0/2777001955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1080cd500 0x7fc1081f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 >> 172.21.15.66:0/2777001955 conn(0x7fc1080d2eb0 msgr2=0x7fc1080b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 shutdown_connections 2024-05-10T11:17:57.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.675+0000 7fc10e2a9640 1 -- 172.21.15.66:0/2777001955 wait complete. 2024-05-10T11:17:57.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:17:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.789+0000 7f005f7a4640 1 Processor -- start 2024-05-10T11:17:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.789+0000 7f005f7a4640 1 -- start start 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005f7a4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f005806c990 0x7f0058163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005f7a4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0058070bd0 0x7f005815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005f7a4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0058163ba0 con 0x7f005815f620 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005f7a4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f005806cd70 con 0x7f0058070bd0 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005f7a4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0058160190 con 0x7f005806c990 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005dd41640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0058070bd0 0x7f005815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005cd3f640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f005815f620 0x7f00580704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43308/0 (socket says 172.21.15.66:43308) 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005cd3f640 1 -- 172.21.15.66:0/3321147328 learned_addr learned my addr 172.21.15.66:0/3321147328 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005dd41640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0058070bd0 0x7f005815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33496/0 (socket says 172.21.15.66:33496) 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005d540640 1 --2- 172.21.15.66:0/3321147328 >> v2:172.21.15.190:3300/0 conn(0x7f005806c990 0x7f0058163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005dd41640 1 -- 172.21.15.66:0/3321147328 >> v2:172.21.15.190:3300/0 conn(0x7f005806c990 msgr2=0x7f0058163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005dd41640 1 --2- 172.21.15.66:0/3321147328 >> v2:172.21.15.190:3300/0 conn(0x7f005806c990 0x7f0058163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005dd41640 1 -- 172.21.15.66:0/3321147328 >> v1:172.21.15.66:6789/0 conn(0x7f005815f620 legacy=0x7f00580704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005dd41640 1 -- 172.21.15.66:0/3321147328 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0058160470 con 0x7f0058070bd0 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f004ffff640 1 -- 172.21.15.66:0/3321147328 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625890179 0 0) 0x7f0058163ba0 con 0x7f005815f620 2024-05-10T11:17:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.790+0000 7f005d540640 1 --2- 172.21.15.66:0/3321147328 >> v2:172.21.15.190:3300/0 conn(0x7f005806c990 0x7f0058163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:57.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.791+0000 7f005dd41640 1 --2- 172.21.15.66:0/3321147328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0058070bd0 0x7f005815fab0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f005806cf10 tx=0x7f005002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813034be82ef0aa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.791+0000 7f004ffff640 1 -- 172.21.15.66:0/3321147328 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050007740 con 0x7f0058070bd0 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.791+0000 7f004ffff640 1 -- 172.21.15.66:0/3321147328 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00500078e0 con 0x7f0058070bd0 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.791+0000 7f004ffff640 1 -- 172.21.15.66:0/3321147328 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050007cb0 con 0x7f0058070bd0 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 -- 172.21.15.66:0/3321147328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0058070bd0 msgr2=0x7f005815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 --2- 172.21.15.66:0/3321147328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0058070bd0 0x7f005815fab0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f005806cf10 tx=0x7f005002a680 comp rx=0 tx=0).stop 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 -- 172.21.15.66:0/3321147328 shutdown_connections 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 --2- 172.21.15.66:0/3321147328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0058070bd0 0x7f005815fab0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 --2- 172.21.15.66:0/3321147328 >> v2:172.21.15.190:3300/0 conn(0x7f005806c990 0x7f0058163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 -- 172.21.15.66:0/3321147328 >> 172.21.15.66:0/3321147328 conn(0x7f00580b3980 msgr2=0x7f00580b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 -- 172.21.15.66:0/3321147328 shutdown_connections 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.792+0000 7f005f7a4640 1 -- 172.21.15.66:0/3321147328 wait complete. 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.793+0000 7f005f7a4640 1 Processor -- start 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.793+0000 7f005f7a4640 1 -- start start 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005f7a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 0x7f0058161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005f7a4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0058070bd0 0x7f00581f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005f7a4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005815f620 0x7f00580c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005f7a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0058073e70 con 0x7f005806c990 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005f7a4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0058163140 con 0x7f005815f620 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005f7a4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f00580cf920 con 0x7f0058070bd0 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 0x7f0058161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 0x7f0058161130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33506/0 (socket says 172.21.15.66:33506) 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 -- 172.21.15.66:0/4264599487 learned_addr learned my addr 172.21.15.66:0/4264599487 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005dd41640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005815f620 0x7f00580c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005cd3f640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0058070bd0 0x7f00581f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 -- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0058070bd0 msgr2=0x7f00581f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0058070bd0 0x7f00581f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 -- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005815f620 msgr2=0x7f00580c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:57.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005815f620 0x7f00580c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 -- 172.21.15.66:0/4264599487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580b4790 con 0x7f005806c990 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005dd41640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005815f620 0x7f00580c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005cd3f640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0058070bd0 0x7f00581f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.794+0000 7f005d540640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 0x7f0058161130 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f005400e810 tx=0x7f005400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.795+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005400f040 con 0x7f005806c990 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.795+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0054004030 con 0x7f005806c990 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.795+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00580b4a70 con 0x7f005806c990 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.795+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054004400 con 0x7f005806c990 2024-05-10T11:17:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.795+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00580b5310 con 0x7f005806c990 2024-05-10T11:17:57.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.796+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005806a220 con 0x7f005806c990 2024-05-10T11:17:57.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.797+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f005400c6d0 con 0x7f005806c990 2024-05-10T11:17:57.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.797+0000 7f004dffb640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f003c0762d0 0x7f003c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:57.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.797+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f00540975b0 con 0x7f005806c990 2024-05-10T11:17:57.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.798+0000 7f005cd3f640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f003c0762d0 0x7f003c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:57.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.798+0000 7f005cd3f640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f003c0762d0 0x7f003c078790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f00580ce370 tx=0x7f0048009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:57.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:57.802+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0054017020 con 0x7f005806c990 2024-05-10T11:17:58.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.031+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0058073540 con 0x7f005806c990 2024-05-10T11:17:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.031+0000 7f004dffb640 1 -- 172.21.15.66:0/4264599487 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0054060d30 con 0x7f005806c990 2024-05-10T11:17:58.031 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:17:58.031 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f003c0762d0 msgr2=0x7f003c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f003c0762d0 0x7f003c078790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f00580ce370 tx=0x7f0048009040 comp rx=0 tx=0).stop 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 msgr2=0x7f0058161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 0x7f0058161130 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f005400e810 tx=0x7f005400ecd0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 shutdown_connections 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f003c0762d0 0x7f003c078790 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005815f620 0x7f00580c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0058070bd0 0x7f00581f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 --2- 172.21.15.66:0/4264599487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f005806c990 0x7f0058161130 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 >> 172.21.15.66:0/4264599487 conn(0x7f00580b3980 msgr2=0x7f00580b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:58.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 shutdown_connections 2024-05-10T11:17:58.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.033+0000 7f005f7a4640 1 -- 172.21.15.66:0/4264599487 wait complete. 2024-05-10T11:17:58.043 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T11:17:58.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:17:58.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.150+0000 7f6672bda640 1 Processor -- start 2024-05-10T11:17:58.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.150+0000 7f6672bda640 1 -- start start 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6672bda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f666c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6672bda640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f666c0703c0 0x7f666c070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6672bda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666c06cbe0 con 0x7f666c06edc0 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6672bda640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f666c070d60 con 0x7f666c0703c0 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6672bda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f666c0ce8e0 con 0x7f666c06c2c0 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6671177640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f666c06edc0 0x7f666c06f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43316/0 (socket says 172.21.15.66:43316) 2024-05-10T11:17:58.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6671177640 1 -- 172.21.15.66:0/741628645 learned_addr learned my addr 172.21.15.66:0/741628645 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6670976640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f666c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666bfff640 1 --2- 172.21.15.66:0/741628645 >> v2:172.21.15.190:3300/0 conn(0x7f666c0703c0 0x7f666c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962514590 0 0) 0x7f666c06cbe0 con 0x7f666c06edc0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f665c003520 con 0x7f666c06edc0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 676229134 0 0) 0x7f665c003520 con 0x7f666c06edc0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 msgr2=0x7f666c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f666c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 >> v2:172.21.15.190:3300/0 conn(0x7f666c0703c0 msgr2=0x7f666c070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 --2- 172.21.15.66:0/741628645 >> v2:172.21.15.190:3300/0 conn(0x7f666c0703c0 0x7f666c070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c0cebc0 con 0x7f666c06edc0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f66640019f0 con 0x7f666c06edc0 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f666bfff640 1 --2- 172.21.15.66:0/741628645 >> v2:172.21.15.190:3300/0 conn(0x7f666c0703c0 0x7f666c070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:17:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.151+0000 7f6670976640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f666c06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 >> v1:172.21.15.66:6789/0 conn(0x7f666c06edc0 legacy=0x7f666c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f665c0039b0 0x7f665c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f665c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f666c070d60 con 0x7f665c0039b0 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0ce8e0 con 0x7f665c004d40 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f665c00b9c0 con 0x7f666c06c2c0 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6670976640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f665c0039b0 0x7f665c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6671177640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666bfff640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f665c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6670976640 1 -- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 msgr2=0x7f665c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6670976640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f665c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6670976640 1 -- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f665c004d40 msgr2=0x7f665c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6670976640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6670976640 1 -- 172.21.15.66:0/741628645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c003520 con 0x7f665c0039b0 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f666bfff640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666c06c2c0 0x7f665c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.152+0000 7f6671177640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6670976640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f665c0039b0 0x7f665c003dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6660009c90 tx=0x7f665c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c839959dd83835e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660036070 con 0x7f665c0039b0 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6660031400 con 0x7f665c0039b0 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f666b7fe640 1 -- 172.21.15.66:0/741628645 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660009860 con 0x7f665c0039b0 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6672bda640 1 -- 172.21.15.66:0/741628645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f665c0039b0 msgr2=0x7f665c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6672bda640 1 --2- 172.21.15.66:0/741628645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f665c0039b0 0x7f665c003dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6660009c90 tx=0x7f665c005830 comp rx=0 tx=0).stop 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6671177640 1 -- 172.21.15.66:0/741628645 reap_dead start 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6672bda640 1 -- 172.21.15.66:0/741628645 shutdown_connections 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6672bda640 1 -- 172.21.15.66:0/741628645 >> 172.21.15.66:0/741628645 conn(0x7f666c0b3980 msgr2=0x7f666c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6672bda640 1 -- 172.21.15.66:0/741628645 shutdown_connections 2024-05-10T11:17:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.153+0000 7f6672bda640 1 -- 172.21.15.66:0/741628645 wait complete. 2024-05-10T11:17:58.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.155+0000 7f6672bda640 1 Processor -- start 2024-05-10T11:17:58.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.155+0000 7f6672bda640 1 -- start start 2024-05-10T11:17:58.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f665c0039b0 0x7f666c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666c0b53e0 0x7f666c0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 0x7f666c15ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0cfc70 con 0x7f666c15eb00 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0cf180 con 0x7f666c0b53e0 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f666c15d2a0 con 0x7f665c0039b0 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 0x7f666c15ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 0x7f666c15ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33518/0 (socket says 172.21.15.66:33518) 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 -- 172.21.15.66:0/4130983401 learned_addr learned my addr 172.21.15.66:0/4130983401 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f666bfff640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666c0b53e0 0x7f666c0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6670976640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f665c0039b0 0x7f666c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 -- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f665c0039b0 msgr2=0x7f666c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f665c0039b0 0x7f666c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 -- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666c0b53e0 msgr2=0x7f666c0b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666c0b53e0 0x7f666c0b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 -- 172.21.15.66:0/4130983401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c157d30 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f666bfff640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666c0b53e0 0x7f666c0b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6671177640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 0x7f666c15ef80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6664007960 tx=0x7f666400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666400ed70 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6664014430 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c158010 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664014800 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.156+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c15ad30 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.158+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c06a220 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.158+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f66640149a0 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.159+0000 7f66697fa640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66500762d0 0x7f6650078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.159+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f6664097560 con 0x7f666c15eb00 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.159+0000 7f6670976640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66500762d0 0x7f6650078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:58.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.160+0000 7f6670976640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66500762d0 0x7f6650078790 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6660033000 tx=0x7f6660008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:58.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.163+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6664060d70 con 0x7f666c15eb00 2024-05-10T11:17:58.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.392+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f666c15f4c0 con 0x7f666c15eb00 2024-05-10T11:17:58.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.393+0000 7f66697fa640 1 -- 172.21.15.66:0/4130983401 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) ==== 53+0+73 (secure 0 0 0) 0x7f6664060670 con 0x7f666c15eb00 2024-05-10T11:17:58.392 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66500762d0 msgr2=0x7f6650078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66500762d0 0x7f6650078790 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6660033000 tx=0x7f6660008030 comp rx=0 tx=0).stop 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 msgr2=0x7f666c15ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 0x7f666c15ef80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6664007960 tx=0x7f666400e530 comp rx=0 tx=0).stop 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 shutdown_connections 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f66500762d0 0x7f6650078790 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c15eb00 0x7f666c15ef80 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666c0b53e0 0x7f666c0b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 --2- 172.21.15.66:0/4130983401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f665c0039b0 0x7f666c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 >> 172.21.15.66:0/4130983401 conn(0x7f666c0b3980 msgr2=0x7f666c0b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 shutdown_connections 2024-05-10T11:17:58.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58.395+0000 7f6672bda640 1 -- 172.21.15.66:0/4130983401 wait complete. 2024-05-10T11:17:58.405 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:17:58.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:17:58.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:17:58.405 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:17:58.405 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:17:58.406 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:17:58.406 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:17:58.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:17:58.406 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:17:58.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.406 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:17:58.423 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:17:58.424 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:17:58.425 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:17:58.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.426 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:17:58.490 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:17:58.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.490 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:17:58.547 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:17:58.547 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:17:58.547 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:17:58.547 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:17:58.547 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:17:58.547 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:17:58.547 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:17:58.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:17:58.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:17:58.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:17:58.548 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:17:58.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:17:58.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:17:58.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.677 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:17:58.693 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:17:58.693 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:17:58.694 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:17:58.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.694 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:17:58.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:17:58.760 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:17:58.817 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:17:58.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:17:58.817 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:17:58.873 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:17:58.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.873 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:17:58.958 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:17:58.958 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:17:58.959 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:17:58.967 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:17:58.967 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:17:58.967 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:17:58.967 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:17:58.968 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:17:58.972 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:17:58.972 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:17:58.972 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:17:58.973 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:17:58.974 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:17:58.974 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:17:58.975 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:17:58.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:58.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:17:59.001 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:17:59.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:17:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:17:59.099 INFO:teuthology.orchestra.run.smithi066.stdout:client5663 2024-05-10T11:17:59.099 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:17:59.099 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:17:59.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:59.116 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-05-10T11:17:59.173 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:17:59.173 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-05-10T11:17:59.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 Processor -- start 2024-05-10T11:17:59.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 -- start start 2024-05-10T11:17:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 0x55b51e2c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 0x55b51e2c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e21cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b51e2c4a20 con 0x55b51e237690 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b51e196f50 con 0x55b51e2372b0 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec831af40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b51e235a30 con 0x55b51e218b50 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec5b49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e21cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec5b49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e21cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33532/0 (socket says 172.21.15.66:33532) 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.260+0000 7feec5b49640 1 -- 172.21.15.66:0/3228010973 learned_addr learned my addr 172.21.15.66:0/3228010973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec5b49640 1 -- 172.21.15.66:0/3228010973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 msgr2=0x55b51e2c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec5b49640 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 0x55b51e2c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec5b49640 1 -- 172.21.15.66:0/3228010973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 msgr2=0x55b51e2c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec5b49640 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 0x55b51e2c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec5b49640 1 -- 172.21.15.66:0/3228010973 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51e1eed50 con 0x55b51e237690 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec5b49640 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e21cb50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feec0025c20 tx=0x7feec004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4361874ce26e8d53 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feeb77fe640 1 -- 172.21.15.66:0/3228010973 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0059040 con 0x55b51e237690 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feeb77fe640 1 -- 172.21.15.66:0/3228010973 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec00549f0 con 0x55b51e237690 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feeb77fe640 1 -- 172.21.15.66:0/3228010973 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0054da0 con 0x55b51e237690 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 -- 172.21.15.66:0/3228010973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 msgr2=0x55b51e21cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e21cb50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feec0025c20 tx=0x7feec004e000 comp rx=0 tx=0).stop 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 -- 172.21.15.66:0/3228010973 shutdown_connections 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e21cb50 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 0x55b51e2c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 --2- 172.21.15.66:0/3228010973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 0x55b51e2c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.261+0000 7feec831af40 1 -- 172.21.15.66:0/3228010973 >> 172.21.15.66:0/3228010973 conn(0x55b51e1ee7d0 msgr2=0x55b51e1ece90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.262+0000 7feec831af40 1 -- 172.21.15.66:0/3228010973 shutdown_connections 2024-05-10T11:17:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.262+0000 7feec831af40 1 -- 172.21.15.66:0/3228010973 wait complete. 2024-05-10T11:17:59.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.262+0000 7feec831af40 1 Processor -- start 2024-05-10T11:17:59.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.262+0000 7feec831af40 1 -- start start 2024-05-10T11:17:59.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec831af40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 0x55b51e2b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec831af40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 0x55b51e2c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec831af40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e2b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec831af40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b51e2b8000 con 0x55b51e237690 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec831af40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b51e21c100 con 0x55b51e2372b0 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec831af40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b51e21c350 con 0x55b51e218b50 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e2b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e2b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33548/0 (socket says 172.21.15.66:33548) 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 -- 172.21.15.66:0/1603557152 learned_addr learned my addr 172.21.15.66:0/1603557152 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5348640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 0x55b51e2b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec4b47640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 0x55b51e2c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 -- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 msgr2=0x55b51e2b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b51e218b50 0x55b51e2b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 -- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 msgr2=0x55b51e2c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b51e2372b0 0x55b51e2c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.263+0000 7feec5b49640 1 -- 172.21.15.66:0/1603557152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51e2b3e70 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.264+0000 7feec5b49640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e2b51e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7feec0025c20 tx=0x7feec0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.264+0000 7feeb67fc640 1 -- 172.21.15.66:0/1603557152 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0059040 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.264+0000 7feeb67fc640 1 -- 172.21.15.66:0/1603557152 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec0073070 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.264+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b51e2b3130 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.264+0000 7feeb67fc640 1 -- 172.21.15.66:0/1603557152 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec005c660 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.264+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51e2b6590 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.265+0000 7feeb67fc640 1 -- 172.21.15.66:0/1603557152 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feec006b070 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.266+0000 7feeb67fc640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feea8074ce0 0x7feea80771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.266+0000 7feeb67fc640 1 -- 172.21.15.66:0/1603557152 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7feec00dd500 con 0x55b51e237690 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.266+0000 7feec831af40 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55b51e2c5820 0x55b51e2b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.266+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77) -- 0x55b51e364500 con 0x55b51e2c5820 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.266+0000 7feec5348640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feea8074ce0 0x7feea80771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.266+0000 7feec4b47640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55b51e2c5820 0x55b51e2b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.267+0000 7feec4b47640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55b51e2c5820 0x55b51e2b5c30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.267+0000 7feec5348640 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feea8074ce0 0x7feea80771a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feeb80028d0 tx=0x7feeb8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec4b47640 1 -- 172.21.15.66:0/1603557152 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v77'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7feebc00e540 con 0x55b51e2c5820 2024-05-10T11:17:59.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55b51e2c5820 msgr2=0x55b51e2b5c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55b51e2c5820 0x55b51e2b5c30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feea8074ce0 msgr2=0x7feea80771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feea8074ce0 0x7feea80771a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feeb80028d0 tx=0x7feeb8007040 comp rx=0 tx=0).stop 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 msgr2=0x55b51e2b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 --2- 172.21.15.66:0/1603557152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b51e237690 0x55b51e2b51e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7feec0025c20 tx=0x7feec0002fb0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec5b49640 1 -- 172.21.15.66:0/1603557152 reap_dead start 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 shutdown_connections 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 >> 172.21.15.66:0/1603557152 conn(0x55b51e1ee7d0 msgr2=0x55b51e354920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 shutdown_connections 2024-05-10T11:17:59.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.268+0000 7feec831af40 1 -- 172.21.15.66:0/1603557152 wait complete. 2024-05-10T11:17:59.272 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:17:59.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:17:59.310 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:17:59.356 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:17:59.356 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:17:59.357 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:17:59.357 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:17:59.373 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:17:59.373 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:17:59.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:17:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.575+0000 7f7d8c0d1640 1 Processor -- start 2024-05-10T11:17:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.575+0000 7f7d8c0d1640 1 -- start start 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8c0d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d8415f620 0x7f7d8415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8c0d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d840704c0 0x7f7d84070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8c0d1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d84160190 con 0x7f7d8406c990 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8c0d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8406cd70 con 0x7f7d8415f620 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8c0d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d84160470 con 0x7f7d840704c0 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d89e6d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7d8406c990 0x7f7d84163660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43328/0 (socket says 172.21.15.66:43328) 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d89e6d640 1 -- 172.21.15.66:0/3646739109 learned_addr learned my addr 172.21.15.66:0/3646739109 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8966c640 1 --2- 172.21.15.66:0/3646739109 >> v2:172.21.15.190:3300/0 conn(0x7f7d8415f620 0x7f7d8415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8a66e640 1 --2- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d840704c0 0x7f7d84070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d88e6b640 1 -- 172.21.15.66:0/3646739109 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164306504 0 0) 0x7f7d84160190 con 0x7f7d8406c990 2024-05-10T11:17:59.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d88e6b640 1 -- 172.21.15.66:0/3646739109 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d70003520 con 0x7f7d8406c990 2024-05-10T11:17:59.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8966c640 1 -- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d840704c0 msgr2=0x7f7d84070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:17:59.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8966c640 1 --2- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d840704c0 0x7f7d84070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8966c640 1 -- 172.21.15.66:0/3646739109 >> v1:172.21.15.66:6789/0 conn(0x7f7d8406c990 legacy=0x7f7d84163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d88e6b640 1 -- 172.21.15.66:0/3646739109 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750656181 0 0) 0x7f7d70003520 con 0x7f7d8406c990 2024-05-10T11:17:59.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.576+0000 7f7d8966c640 1 -- 172.21.15.66:0/3646739109 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d84162e60 con 0x7f7d8415f620 2024-05-10T11:17:59.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.577+0000 7f7d8966c640 1 --2- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d8415f620 0x7f7d8415fa80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d780097a0 tx=0x7f7d7802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6208c394d33266 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.577+0000 7f7d88e6b640 1 -- 172.21.15.66:0/3646739109 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78037070 con 0x7f7d8415f620 2024-05-10T11:17:59.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.577+0000 7f7d88e6b640 1 -- 172.21.15.66:0/3646739109 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7802aba0 con 0x7f7d8415f620 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.577+0000 7f7d88e6b640 1 -- 172.21.15.66:0/3646739109 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80001690 con 0x7f7d8415f620 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d8415f620 msgr2=0x7f7d8415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d8415f620 0x7f7d8415fa80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d780097a0 tx=0x7f7d7802a110 comp rx=0 tx=0).stop 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/3646739109 shutdown_connections 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d840704c0 0x7f7d84070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/3646739109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d8415f620 0x7f7d8415fa80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/3646739109 >> 172.21.15.66:0/3646739109 conn(0x7f7d840b3980 msgr2=0x7f7d840b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/3646739109 shutdown_connections 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.578+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/3646739109 wait complete. 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.579+0000 7f7d8c0d1640 1 Processor -- start 2024-05-10T11:17:59.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.579+0000 7f7d8c0d1640 1 -- start start 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8c0d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d8406c990 0x7f7d841606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8c0d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d840704c0 0x7f7d841f9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8c0d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 0x7f7d8415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8c0d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84073e70 con 0x7f7d8415f620 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8c0d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84070e60 con 0x7f7d840704c0 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8c0d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d840cf920 con 0x7f7d8406c990 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 0x7f7d8415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 0x7f7d8415eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33560/0 (socket says 172.21.15.66:33560) 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 -- 172.21.15.66:0/2470373768 learned_addr learned my addr 172.21.15.66:0/2470373768 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:17:59.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8966c640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d840704c0 0x7f7d841f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d89e6d640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d8406c990 0x7f7d841606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 -- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d8406c990 msgr2=0x7f7d841606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d8406c990 0x7f7d841606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 -- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d840704c0 msgr2=0x7f7d841f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.580+0000 7f7d8a66e640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d840704c0 0x7f7d841f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d8a66e640 1 -- 172.21.15.66:0/2470373768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8415f0c0 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d89e6d640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d8406c990 0x7f7d841606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d8a66e640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 0x7f7d8415eb80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00efc0 tx=0x7f7d7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c018020 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c014480 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d84162840 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c014870 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.581+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d841f8590 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.582+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8406a220 con 0x7f7d8415f620 2024-05-10T11:17:59.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.583+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d7c005d10 con 0x7f7d8415f620 2024-05-10T11:17:59.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.583+0000 7f7d767fc640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d68076300 0x7f7d680787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:17:59.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.583+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f7d7c098170 con 0x7f7d8415f620 2024-05-10T11:17:59.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.583+0000 7f7d89e6d640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d68076300 0x7f7d680787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:17:59.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.584+0000 7f7d89e6d640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d68076300 0x7f7d680787c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7d80001800 tx=0x7f7d80001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:17:59.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.587+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7d7c022070 con 0x7f7d8415f620 2024-05-10T11:17:59.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.792+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d840d1640 con 0x7f7d8415f620 2024-05-10T11:17:59.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.792+0000 7f7d767fc640 1 -- 172.21.15.66:0/2470373768 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v77) ==== 80+0+122 (secure 0 0 0) 0x7f7d7c010040 con 0x7f7d8415f620 2024-05-10T11:17:59.792 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6835/1361798984 2024-05-11T11:16:47.934721+0000 2024-05-10T11:17:59.792 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6834/1361798984 2024-05-11T11:16:47.934721+0000 2024-05-10T11:17:59.792 INFO:teuthology.orchestra.run.smithi066.stderr:listed 2 entries 2024-05-10T11:17:59.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d68076300 msgr2=0x7f7d680787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d68076300 0x7f7d680787c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7d80001800 tx=0x7f7d80001630 comp rx=0 tx=0).stop 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 msgr2=0x7f7d8415eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 0x7f7d8415eb80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00efc0 tx=0x7f7d7c00c490 comp rx=0 tx=0).stop 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 shutdown_connections 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7d68076300 0x7f7d680787c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d8415f620 0x7f7d8415eb80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d840704c0 0x7f7d841f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 --2- 172.21.15.66:0/2470373768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d8406c990 0x7f7d841606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 >> 172.21.15.66:0/2470373768 conn(0x7f7d840b3980 msgr2=0x7f7d840d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 shutdown_connections 2024-05-10T11:17:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:17:59.795+0000 7f7d8c0d1640 1 -- 172.21.15.66:0/2470373768 wait complete. 2024-05-10T11:17:59.806 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:17:59.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:59.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:17:59.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:17:59.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:17:59.836 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:17:59.893 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:17:59.893 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:17:59.893 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:17:59.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:17:59.912 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:17:59.913 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:17:59.913 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:17:59.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:17:59.949 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:17:59.949 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:17:59.949 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:17:59.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:17:59.971 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:00.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 Processor -- start 2024-05-10T11:18:00.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 -- start start 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab0815f3b0 0x7fab080d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fab0815f790 0x7fab080d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fab080d30b0 con 0x7fab0815f3b0 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fab080d3390 con 0x7fab0815f790 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.095+0000 7fab0e66d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab080c8c80 con 0x7fab080d5d30 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab0815f3b0 0x7fab080d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab0815f3b0 0x7fab080d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33572/0 (socket says 172.21.15.66:33572) 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 -- 172.21.15.66:0/22351385 learned_addr learned my addr 172.21.15.66:0/22351385 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 -- 172.21.15.66:0/22351385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 msgr2=0x7fab080c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 --2- 172.21.15.66:0/22351385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 -- 172.21.15.66:0/22351385 >> v2:172.21.15.190:3300/0 conn(0x7fab0815f790 msgr2=0x7fab080d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 --2- 172.21.15.66:0/22351385 >> v2:172.21.15.190:3300/0 conn(0x7fab0815f790 0x7fab080d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.096+0000 7fab07fff640 1 -- 172.21.15.66:0/22351385 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab080c8f60 con 0x7fab0815f3b0 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab07fff640 1 --2- 172.21.15.66:0/22351385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab0815f3b0 0x7fab080d36f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fab080c8c00 tx=0x7faaf802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992d04ad506a8b51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab06ffd640 1 -- 172.21.15.66:0/22351385 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8037070 con 0x7fab0815f3b0 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab06ffd640 1 -- 172.21.15.66:0/22351385 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf8032440 con 0x7fab0815f3b0 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab06ffd640 1 -- 172.21.15.66:0/22351385 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8032810 con 0x7fab0815f3b0 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 -- 172.21.15.66:0/22351385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab0815f3b0 msgr2=0x7fab080d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 --2- 172.21.15.66:0/22351385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab0815f3b0 0x7fab080d36f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fab080c8c00 tx=0x7faaf802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 -- 172.21.15.66:0/22351385 shutdown_connections 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 --2- 172.21.15.66:0/22351385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 --2- 172.21.15.66:0/22351385 >> v2:172.21.15.190:3300/0 conn(0x7fab0815f790 0x7fab080d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 --2- 172.21.15.66:0/22351385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab0815f3b0 0x7fab080d36f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 -- 172.21.15.66:0/22351385 >> 172.21.15.66:0/22351385 conn(0x7fab080d5130 msgr2=0x7fab080d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 -- 172.21.15.66:0/22351385 shutdown_connections 2024-05-10T11:18:00.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.097+0000 7fab0e66d640 1 -- 172.21.15.66:0/22351385 wait complete. 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.098+0000 7fab0e66d640 1 Processor -- start 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 -- start start 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab0815f3b0 0x7fab0815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 0x7fab0815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab080c9e20 con 0x7fab081556f0 2024-05-10T11:18:00.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab080c9ca0 con 0x7fab0815f3b0 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.099+0000 7fab0e66d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab080c9fa0 con 0x7fab080d5d30 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 0x7fab0815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 0x7fab0815c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33584/0 (socket says 172.21.15.66:33584) 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 -- 172.21.15.66:0/4146357789 learned_addr learned my addr 172.21.15.66:0/4146357789 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab077fe640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab0815f3b0 0x7fab0815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab07fff640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 -- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 msgr2=0x7fab080b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 -- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab0815f3b0 msgr2=0x7fab0815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab0815f3b0 0x7fab0815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 -- 172.21.15.66:0/4146357789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab080b8620 con 0x7fab081556f0 2024-05-10T11:18:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.100+0000 7fab0cc0a640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 0x7fab0815c420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fab0000b970 tx=0x7fab0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.101+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00019070 con 0x7fab081556f0 2024-05-10T11:18:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.101+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0000cb60 con 0x7fab081556f0 2024-05-10T11:18:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.101+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00014440 con 0x7fab081556f0 2024-05-10T11:18:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.101+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab080ba000 con 0x7fab081556f0 2024-05-10T11:18:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.102+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab080ba5c0 con 0x7fab081556f0 2024-05-10T11:18:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.102+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab080ba7c0 con 0x7fab081556f0 2024-05-10T11:18:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.103+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab0001c070 con 0x7fab081556f0 2024-05-10T11:18:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.104+0000 7fab04ff9640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faaf40762d0 0x7faaf4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.104+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fab000974b0 con 0x7fab081556f0 2024-05-10T11:18:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.104+0000 7fab07fff640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faaf40762d0 0x7faaf4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.105+0000 7fab07fff640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faaf40762d0 0x7faaf4078790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faaf8034000 tx=0x7faaf802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.109+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fab080ba7c0 con 0x7fab081556f0 2024-05-10T11:18:00.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.339+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab0806a220 con 0x7fab081556f0 2024-05-10T11:18:00.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.340+0000 7fab04ff9640 1 -- 172.21.15.66:0/4146357789 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5185 (secure 0 0 0) 0x7fab000605e0 con 0x7fab081556f0 2024-05-10T11:18:00.340 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:00.340 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:17:30.966170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:18:00.340 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faaf40762d0 msgr2=0x7faaf4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faaf40762d0 0x7faaf4078790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faaf8034000 tx=0x7faaf802e000 comp rx=0 tx=0).stop 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 msgr2=0x7fab0815c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 0x7fab0815c420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fab0000b970 tx=0x7fab0000be30 comp rx=0 tx=0).stop 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 shutdown_connections 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faaf40762d0 0x7faaf4078790 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab081556f0 0x7fab0815c420 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab0815f3b0 0x7fab0815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 --2- 172.21.15.66:0/4146357789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab080d5d30 0x7fab080b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 >> 172.21.15.66:0/4146357789 conn(0x7fab080d5130 msgr2=0x7fab0815e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:00.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 shutdown_connections 2024-05-10T11:18:00.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.342+0000 7fab0e66d640 1 -- 172.21.15.66:0/4146357789 wait complete. 2024-05-10T11:18:00.352 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:00.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.457+0000 7fc611d19640 1 Processor -- start 2024-05-10T11:18:00.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.457+0000 7fc611d19640 1 -- start start 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc611d19640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc60c15f8c0 0x7fc60c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc611d19640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60c0b0a90 con 0x7fc60c06e620 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc611d19640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60c0b3540 con 0x7fc60c15f4e0 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc611d19640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc60c0b23f0 con 0x7fc60c15f8c0 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc60affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc60c15f8c0 0x7fc60c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc60bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc60c06e620 0x7fc60c0d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43330/0 (socket says 172.21.15.66:43330) 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc60bfff640 1 -- 172.21.15.66:0/500176284 learned_addr learned my addr 172.21.15.66:0/500176284 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc60affd640 1 -- 172.21.15.66:0/500176284 >> v1:172.21.15.190:6789/0 conn(0x7fc60c15f4e0 legacy=0x7fc60c06d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.458+0000 7fc60affd640 1 -- 172.21.15.66:0/500176284 >> v1:172.21.15.66:6789/0 conn(0x7fc60c06e620 legacy=0x7fc60c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.459+0000 7fc60affd640 1 -- 172.21.15.66:0/500176284 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c0b3820 con 0x7fc60c15f8c0 2024-05-10T11:18:00.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.459+0000 7fc60affd640 1 --2- 172.21.15.66:0/500176284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c15f8c0 0x7fc60c06e0e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc6000097a0 tx=0x7fc60002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95af95721e8f40 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.459+0000 7fc60a7fc640 1 -- 172.21.15.66:0/500176284 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600037070 con 0x7fc60c15f8c0 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.459+0000 7fc60a7fc640 1 -- 172.21.15.66:0/500176284 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600032440 con 0x7fc60c15f8c0 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.459+0000 7fc60a7fc640 1 -- 172.21.15.66:0/500176284 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600032810 con 0x7fc60c15f8c0 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 -- 172.21.15.66:0/500176284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c15f8c0 msgr2=0x7fc60c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 --2- 172.21.15.66:0/500176284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c15f8c0 0x7fc60c06e0e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc6000097a0 tx=0x7fc60002a1a0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 -- 172.21.15.66:0/500176284 shutdown_connections 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 --2- 172.21.15.66:0/500176284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c15f8c0 0x7fc60c06e0e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 -- 172.21.15.66:0/500176284 >> 172.21.15.66:0/500176284 conn(0x7fc60c0d2df0 msgr2=0x7fc60c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 -- 172.21.15.66:0/500176284 shutdown_connections 2024-05-10T11:18:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.460+0000 7fc611d19640 1 -- 172.21.15.66:0/500176284 wait complete. 2024-05-10T11:18:00.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.461+0000 7fc611d19640 1 Processor -- start 2024-05-10T11:18:00.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.461+0000 7fc611d19640 1 -- start start 2024-05-10T11:18:00.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc611d19640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 0x7fc60c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc611d19640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c15f4e0 0x7fc60c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc611d19640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c15f8c0 0x7fc60c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc611d19640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0b3de0 con 0x7fc60c06e620 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc611d19640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0b4150 con 0x7fc60c15f8c0 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc611d19640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc60c0b45e0 con 0x7fc60c15f4e0 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 0x7fc60c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 0x7fc60c155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33602/0 (socket says 172.21.15.66:33602) 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 -- 172.21.15.66:0/1390839115 learned_addr learned my addr 172.21.15.66:0/1390839115 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60bfff640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c15f8c0 0x7fc60c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60affd640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c15f4e0 0x7fc60c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 -- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c15f4e0 msgr2=0x7fc60c0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c15f4e0 0x7fc60c0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 -- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c15f8c0 msgr2=0x7fc60c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c15f8c0 0x7fc60c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.462+0000 7fc60b7fe640 1 -- 172.21.15.66:0/1390839115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c1f9890 con 0x7fc60c06e620 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.463+0000 7fc60b7fe640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 0x7fc60c155130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00c400 tx=0x7fc5fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.463+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0052d0 con 0x7fc60c06e620 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.463+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc005490 con 0x7fc60c06e620 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.463+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c1f8ad0 con 0x7fc60c06e620 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.463+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc007260 con 0x7fc60c06e620 2024-05-10T11:18:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.463+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1f9090 con 0x7fc60c06e620 2024-05-10T11:18:00.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.464+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c06a220 con 0x7fc60c06e620 2024-05-10T11:18:00.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.464+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5fc007400 con 0x7fc60c06e620 2024-05-10T11:18:00.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.465+0000 7fc5f3fff640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc5f80762d0 0x7fc5f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.465+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fc5fc096c30 con 0x7fc60c06e620 2024-05-10T11:18:00.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.465+0000 7fc60affd640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc5f80762d0 0x7fc5f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.466+0000 7fc60affd640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc5f80762d0 0x7fc5f8078790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc600034000 tx=0x7fc60002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.469+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc5fc060440 con 0x7fc60c06e620 2024-05-10T11:18:00.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.699+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc60c0d0e00 con 0x7fc60c06e620 2024-05-10T11:18:00.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.700+0000 7fc5f3fff640 1 -- 172.21.15.66:0/1390839115 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5185 (secure 0 0 0) 0x7fc5fc068430 con 0x7fc60c06e620 2024-05-10T11:18:00.700 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:00.700 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:17:30.966170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:18:00.700 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc5f80762d0 msgr2=0x7fc5f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc5f80762d0 0x7fc5f8078790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc600034000 tx=0x7fc60002e000 comp rx=0 tx=0).stop 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 msgr2=0x7fc60c155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 0x7fc60c155130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00c400 tx=0x7fc5fc00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 shutdown_connections 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc5f80762d0 0x7fc5f8078790 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c15f8c0 0x7fc60c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c15f4e0 0x7fc60c0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 --2- 172.21.15.66:0/1390839115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc60c06e620 0x7fc60c155130 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 >> 172.21.15.66:0/1390839115 conn(0x7fc60c0d2df0 msgr2=0x7fc60c0d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:00.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 shutdown_connections 2024-05-10T11:18:00.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.702+0000 7fc611d19640 1 -- 172.21.15.66:0/1390839115 wait complete. 2024-05-10T11:18:00.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:18:00.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.817+0000 7ff2df304640 1 Processor -- start 2024-05-10T11:18:00.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.817+0000 7ff2df304640 1 -- start start 2024-05-10T11:18:00.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2df304640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2d8162940 0x7ff2d80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2df304640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2d80d3d80 0x7ff2d80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2df304640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d80d2d20 con 0x7ff2d80d59d0 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2df304640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d8162d20 con 0x7ff2d8162940 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2df304640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d80d3000 con 0x7ff2d80d3d80 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dd0a0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2d8162940 0x7ff2d80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dc89f640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff2d80d59d0 0x7ff2d80d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43332/0 (socket says 172.21.15.66:43332) 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dc89f640 1 -- 172.21.15.66:0/4060841148 learned_addr learned my addr 172.21.15.66:0/4060841148 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dd8a1640 1 --2- 172.21.15.66:0/4060841148 >> v2:172.21.15.190:3300/0 conn(0x7ff2d80d3d80 0x7ff2d80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dd0a0640 1 -- 172.21.15.66:0/4060841148 >> v2:172.21.15.190:3300/0 conn(0x7ff2d80d3d80 msgr2=0x7ff2d80d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dd0a0640 1 --2- 172.21.15.66:0/4060841148 >> v2:172.21.15.190:3300/0 conn(0x7ff2d80d3d80 0x7ff2d80d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dd0a0640 1 -- 172.21.15.66:0/4060841148 >> v1:172.21.15.66:6789/0 conn(0x7ff2d80d59d0 legacy=0x7ff2d80d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2dd0a0640 1 -- 172.21.15.66:0/4060841148 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d80d32e0 con 0x7ff2d8162940 2024-05-10T11:18:00.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.818+0000 7ff2cffff640 1 -- 172.21.15.66:0/4060841148 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598434810 0 0) 0x7ff2d80d2d20 con 0x7ff2d80d59d0 2024-05-10T11:18:00.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.819+0000 7ff2dd0a0640 1 --2- 172.21.15.66:0/4060841148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d8162940 0x7ff2d80b5e20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80d5e50 tx=0x7ff2d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6dddd790491e42 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.819+0000 7ff2cffff640 1 -- 172.21.15.66:0/4060841148 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4037070 con 0x7ff2d8162940 2024-05-10T11:18:00.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.819+0000 7ff2cffff640 1 -- 172.21.15.66:0/4060841148 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4032440 con 0x7ff2d8162940 2024-05-10T11:18:00.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.819+0000 7ff2cffff640 1 -- 172.21.15.66:0/4060841148 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d402ae60 con 0x7ff2d8162940 2024-05-10T11:18:00.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 -- 172.21.15.66:0/4060841148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d8162940 msgr2=0x7ff2d80b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 --2- 172.21.15.66:0/4060841148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d8162940 0x7ff2d80b5e20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80d5e50 tx=0x7ff2d402a110 comp rx=0 tx=0).stop 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 -- 172.21.15.66:0/4060841148 shutdown_connections 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 --2- 172.21.15.66:0/4060841148 >> v2:172.21.15.190:3300/0 conn(0x7ff2d80d3d80 0x7ff2d80d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 --2- 172.21.15.66:0/4060841148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d8162940 0x7ff2d80b5e20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 -- 172.21.15.66:0/4060841148 >> 172.21.15.66:0/4060841148 conn(0x7ff2d809e380 msgr2=0x7ff2d80d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 -- 172.21.15.66:0/4060841148 shutdown_connections 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.820+0000 7ff2df304640 1 -- 172.21.15.66:0/4060841148 wait complete. 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.821+0000 7ff2df304640 1 Processor -- start 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.821+0000 7ff2df304640 1 -- start start 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2df304640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d80d3d80 0x7ff2d8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2df304640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 0x7ff2d80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2df304640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d8162940 0x7ff2d80cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2df304640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d80d2390 con 0x7ff2d80d59d0 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2df304640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d80cfc50 con 0x7ff2d8162940 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2df304640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d80d2510 con 0x7ff2d80d3d80 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2dc89f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 0x7ff2d80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2dc89f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 0x7ff2d80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33624/0 (socket says 172.21.15.66:33624) 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2dc89f640 1 -- 172.21.15.66:0/2136676054 learned_addr learned my addr 172.21.15.66:0/2136676054 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2dd0a0640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d80d3d80 0x7ff2d8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.822+0000 7ff2dd8a1640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d8162940 0x7ff2d80cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dc89f640 1 -- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d80d3d80 msgr2=0x7ff2d8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dc89f640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d80d3d80 0x7ff2d8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dc89f640 1 -- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d8162940 msgr2=0x7ff2d80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dc89f640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d8162940 0x7ff2d80cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dc89f640 1 -- 172.21.15.66:0/2136676054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d80c9510 con 0x7ff2d80d59d0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dd0a0640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d80d3d80 0x7ff2d8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2dc89f640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 0x7ff2d80caf10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c4d0 tx=0x7ff2c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8018070 con 0x7ff2d80d59d0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c8007500 con 0x7ff2d80d59d0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d80c97f0 con 0x7ff2d80d59d0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8004a20 con 0x7ff2d80d59d0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.823+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d80c9db0 con 0x7ff2d80d59d0 2024-05-10T11:18:00.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.824+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d80d0da0 con 0x7ff2d80d59d0 2024-05-10T11:18:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.824+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff2c801b070 con 0x7ff2d80d59d0 2024-05-10T11:18:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.825+0000 7ff2cdffb640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2bc0762d0 0x7ff2bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.825+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff2c8096c00 con 0x7ff2d80d59d0 2024-05-10T11:18:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.825+0000 7ff2dd0a0640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2bc0762d0 0x7ff2bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.826+0000 7ff2dd0a0640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2bc0762d0 0x7ff2bc078790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4034000 tx=0x7ff2d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:00.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:00.829+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff2d80d0da0 con 0x7ff2d80d59d0 2024-05-10T11:18:01.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.022+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2d806a220 con 0x7ff2d80d59d0 2024-05-10T11:18:01.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.023+0000 7ff2cdffb640 1 -- 172.21.15.66:0/2136676054 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+17074 (secure 0 0 0) 0x7ff2c809d080 con 0x7ff2d80d59d0 2024-05-10T11:18:01.023 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:01.023 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":77,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:16:47.934742+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:16:31.864172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T11:16:33.168965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/1361798984":"2024-05-11T11:16:47.934721+0000","172.21.15.66:6834/1361798984":"2024-05-11T11:16:47.934721+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2bc0762d0 msgr2=0x7ff2bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2bc0762d0 0x7ff2bc078790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4034000 tx=0x7ff2d402e000 comp rx=0 tx=0).stop 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 msgr2=0x7ff2d80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 0x7ff2d80caf10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c4d0 tx=0x7ff2c800c990 comp rx=0 tx=0).stop 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 shutdown_connections 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2bc0762d0 0x7ff2bc078790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d8162940 0x7ff2d80cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d80d59d0 0x7ff2d80caf10 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.025+0000 7ff2df304640 1 --2- 172.21.15.66:0/2136676054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d80d3d80 0x7ff2d8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.026+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 >> 172.21.15.66:0/2136676054 conn(0x7ff2d809e380 msgr2=0x7ff2d80d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.026+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 shutdown_connections 2024-05-10T11:18:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.026+0000 7ff2df304640 1 -- 172.21.15.66:0/2136676054 wait complete. 2024-05-10T11:18:01.036 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:18:01.036 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:01.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.142+0000 7fc196a20640 1 Processor -- start 2024-05-10T11:18:01.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.142+0000 7fc196a20640 1 -- start start 2024-05-10T11:18:01.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc196a20640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc190162750 0x7fc1900d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc196a20640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc190162b30 0x7fc1900b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc196a20640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1900b45f0 con 0x7fc1900d5cb0 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc196a20640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc1900b4f20 con 0x7fc190162b30 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc196a20640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc1900d0fe0 con 0x7fc190162750 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc190162b30 0x7fc1900b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc190162b30 0x7fc1900b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33630/0 (socket says 172.21.15.66:33630) 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 -- 172.21.15.66:0/142280300 learned_addr learned my addr 172.21.15.66:0/142280300 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc18ffff640 1 --2- 172.21.15.66:0/142280300 >> v2:172.21.15.190:3300/0 conn(0x7fc190162750 0x7fc1900d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 -- 172.21.15.66:0/142280300 >> v2:172.21.15.190:3300/0 conn(0x7fc190162750 msgr2=0x7fc1900d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 --2- 172.21.15.66:0/142280300 >> v2:172.21.15.190:3300/0 conn(0x7fc190162750 0x7fc1900d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 -- 172.21.15.66:0/142280300 >> v1:172.21.15.190:6789/0 conn(0x7fc1900d5cb0 legacy=0x7fc1900d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.143+0000 7fc194fbd640 1 -- 172.21.15.66:0/142280300 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1900b48d0 con 0x7fc190162b30 2024-05-10T11:18:01.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.144+0000 7fc194fbd640 1 --2- 172.21.15.66:0/142280300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900b53b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc1900b7c40 tx=0x7fc18802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4999b086ebc7054 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.144+0000 7fc18effd640 1 -- 172.21.15.66:0/142280300 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188036070 con 0x7fc190162b30 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.144+0000 7fc18effd640 1 -- 172.21.15.66:0/142280300 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188031600 con 0x7fc190162b30 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.144+0000 7fc18effd640 1 -- 172.21.15.66:0/142280300 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880319d0 con 0x7fc190162b30 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 -- 172.21.15.66:0/142280300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 msgr2=0x7fc1900b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 --2- 172.21.15.66:0/142280300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900b53b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc1900b7c40 tx=0x7fc18802a660 comp rx=0 tx=0).stop 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 -- 172.21.15.66:0/142280300 shutdown_connections 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 --2- 172.21.15.66:0/142280300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900b53b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 --2- 172.21.15.66:0/142280300 >> v2:172.21.15.190:3300/0 conn(0x7fc190162750 0x7fc1900d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 -- 172.21.15.66:0/142280300 >> 172.21.15.66:0/142280300 conn(0x7fc19009e3b0 msgr2=0x7fc1900d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 -- 172.21.15.66:0/142280300 shutdown_connections 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.145+0000 7fc196a20640 1 -- 172.21.15.66:0/142280300 wait complete. 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.146+0000 7fc196a20640 1 Processor -- start 2024-05-10T11:18:01.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.146+0000 7fc196a20640 1 -- start start 2024-05-10T11:18:01.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc196a20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc190162750 0x7fc1901550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc196a20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc196a20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1900b8570 0x7fc1900cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc196a20640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc1900d0d30 con 0x7fc190162b30 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc196a20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1900d0bb0 con 0x7fc190162750 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc196a20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc1900d3d40 con 0x7fc1900b8570 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900ba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33634/0 (socket says 172.21.15.66:33634) 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 -- 172.21.15.66:0/885397510 learned_addr learned my addr 172.21.15.66:0/885397510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18ffff640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc190162750 0x7fc1901550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc194fbd640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1900b8570 0x7fc1900cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 -- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1900b8570 msgr2=0x7fc1900cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1900b8570 0x7fc1900cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 -- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc190162750 msgr2=0x7fc1901550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc190162750 0x7fc1901550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18f7fe640 1 -- 172.21.15.66:0/885397510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1900b8d50 con 0x7fc190162b30 2024-05-10T11:18:01.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.147+0000 7fc18ffff640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc190162750 0x7fc1901550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.148+0000 7fc18f7fe640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900ba5c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c3f0 tx=0x7fc18400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.148+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184007020 con 0x7fc190162b30 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.148+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840071c0 con 0x7fc190162b30 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.148+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184007590 con 0x7fc190162b30 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.148+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1900b9030 con 0x7fc190162b30 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.148+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1900b8a00 con 0x7fc190162b30 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.149+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19006a220 con 0x7fc190162b30 2024-05-10T11:18:01.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.149+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc184019020 con 0x7fc190162b30 2024-05-10T11:18:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.150+0000 7fc18cff9640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc17c0762d0 0x7fc17c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.150+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fc184096f80 con 0x7fc190162b30 2024-05-10T11:18:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.150+0000 7fc18ffff640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc17c0762d0 0x7fc17c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.151+0000 7fc18ffff640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc17c0762d0 0x7fc17c078790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc18000a9d0 tx=0x7fc180008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.154+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc184060700 con 0x7fc190162b30 2024-05-10T11:18:01.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.382+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1900b61d0 con 0x7fc190162b30 2024-05-10T11:18:01.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.383+0000 7fc18cff9640 1 -- 172.21.15.66:0/885397510 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5185 (secure 0 0 0) 0x7fc184060000 con 0x7fc190162b30 2024-05-10T11:18:01.383 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:01.383 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:17:30.966170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:18:01.383 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-05-10T11:18:01.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc17c0762d0 msgr2=0x7fc17c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc17c0762d0 0x7fc17c078790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc18000a9d0 tx=0x7fc180008040 comp rx=0 tx=0).stop 2024-05-10T11:18:01.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 msgr2=0x7fc1900ba5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900ba5c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c3f0 tx=0x7fc18400c8b0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 shutdown_connections 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc17c0762d0 0x7fc17c078790 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1900b8570 0x7fc1900cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc190162b30 0x7fc1900ba5c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 --2- 172.21.15.66:0/885397510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc190162750 0x7fc1901550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 >> 172.21.15.66:0/885397510 conn(0x7fc19009e3b0 msgr2=0x7fc1900d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 shutdown_connections 2024-05-10T11:18:01.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.385+0000 7fc196a20640 1 -- 172.21.15.66:0/885397510 wait complete. 2024-05-10T11:18:01.396 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:01.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.501+0000 7fd0b1d46640 1 Processor -- start 2024-05-10T11:18:01.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.501+0000 7fd0b1d46640 1 -- start start 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.501+0000 7fd0b1d46640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd0ac0b8860 0x7fd0ac06e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.501+0000 7fd0b1d46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd0ac0d0230 0x7fd0ac0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0b1d46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0cfbb0 0x7fd0ac0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0b1d46640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ac06ee50 con 0x7fd0ac0b8860 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0b1d46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ac15fc90 con 0x7fd0ac0d0230 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0b1d46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ac0b8c40 con 0x7fd0ac0cfbb0 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd0ac0b8860 0x7fd0ac06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd0ac0b8860 0x7fd0ac06e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33650/0 (socket says 172.21.15.66:33650) 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/4290729320 learned_addr learned my addr 172.21.15.66:0/4290729320 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:01.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0aaffd640 1 --2- 172.21.15.66:0/4290729320 >> v2:172.21.15.190:3300/0 conn(0x7fd0ac0d0230 0x7fd0ac0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0abfff640 1 --2- 172.21.15.66:0/4290729320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0cfbb0 0x7fd0ac0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/4290729320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0cfbb0 msgr2=0x7fd0ac0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 --2- 172.21.15.66:0/4290729320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0cfbb0 0x7fd0ac0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/4290729320 >> v2:172.21.15.190:3300/0 conn(0x7fd0ac0d0230 msgr2=0x7fd0ac0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 --2- 172.21.15.66:0/4290729320 >> v2:172.21.15.190:3300/0 conn(0x7fd0ac0d0230 0x7fd0ac0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/4290729320 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac0cd570 con 0x7fd0ac0b8860 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.502+0000 7fd0aaffd640 1 --2- 172.21.15.66:0/4290729320 >> v2:172.21.15.190:3300/0 conn(0x7fd0ac0d0230 0x7fd0ac0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0ab7fe640 1 --2- 172.21.15.66:0/4290729320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac06e520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b48b0 tx=0x7fd09c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31031672bf95559 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0aa7fc640 1 -- 172.21.15.66:0/4290729320 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c037070 con 0x7fd0ac0b8860 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0aa7fc640 1 -- 172.21.15.66:0/4290729320 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c032440 con 0x7fd0ac0b8860 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0aa7fc640 1 -- 172.21.15.66:0/4290729320 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c032810 con 0x7fd0ac0b8860 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 -- 172.21.15.66:0/4290729320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 msgr2=0x7fd0ac06e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/4290729320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac06e520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b48b0 tx=0x7fd09c02a180 comp rx=0 tx=0).stop 2024-05-10T11:18:01.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 -- 172.21.15.66:0/4290729320 shutdown_connections 2024-05-10T11:18:01.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/4290729320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0cfbb0 0x7fd0ac0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/4290729320 >> v2:172.21.15.190:3300/0 conn(0x7fd0ac0d0230 0x7fd0ac0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/4290729320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac06e520 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.503+0000 7fd0b1d46640 1 -- 172.21.15.66:0/4290729320 >> 172.21.15.66:0/4290729320 conn(0x7fd0ac0d2df0 msgr2=0x7fd0ac0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:01.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.504+0000 7fd0b1d46640 1 -- 172.21.15.66:0/4290729320 shutdown_connections 2024-05-10T11:18:01.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.504+0000 7fd0b1d46640 1 -- 172.21.15.66:0/4290729320 wait complete. 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.505+0000 7fd0b1d46640 1 Processor -- start 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.505+0000 7fd0b1d46640 1 -- start start 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0ac0cfbb0 0x7fd0ac15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0d0230 0x7fd0ac151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac0cde10 con 0x7fd0ac0b8860 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac0cdb30 con 0x7fd0ac0cfbb0 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ac06ea60 con 0x7fd0ac0d0230 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33652/0 (socket says 172.21.15.66:33652) 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/2674547545 learned_addr learned my addr 172.21.15.66:0/2674547545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:01.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0aaffd640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0ac0cfbb0 0x7fd0ac15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0d0230 msgr2=0x7fd0ac151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0d0230 0x7fd0ac151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0ac0cfbb0 msgr2=0x7fd0ac15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0ac0cfbb0 0x7fd0ac15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 -- 172.21.15.66:0/2674547545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac0cb380 con 0x7fd0ac0b8860 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0aaffd640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0ac0cfbb0 0x7fd0ac15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0ab7fe640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac151370 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0097c0 tx=0x7fd09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c041020 con 0x7fd0ac0b8860 2024-05-10T11:18:01.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c0306c0 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ac0cb660 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c037040 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.506+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ac0cbc20 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.507+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ac0cf190 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.508+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd09c044020 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.508+0000 7fd093fff640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0980762d0 0x7fd098078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.509+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fd09c0b7fa0 con 0x7fd0ac0b8860 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.509+0000 7fd0aaffd640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0980762d0 0x7fd098078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.509+0000 7fd0aaffd640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0980762d0 0x7fd098078790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0006fd0 tx=0x7fd0a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.513+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd0ac0cf190 con 0x7fd0ac0b8860 2024-05-10T11:18:01.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.740+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0ac06a220 con 0x7fd0ac0b8860 2024-05-10T11:18:01.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.741+0000 7fd093fff640 1 -- 172.21.15.66:0/2674547545 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5185 (secure 0 0 0) 0x7fd09c04b030 con 0x7fd0ac0b8860 2024-05-10T11:18:01.740 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:01.740 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:16:34.212384+0000","modified":"2024-05-10T11:17:30.966170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.66:6835/629825148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":629825148},{"type":"v1","addr":"172.21.15.66:6835","nonce":629825148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6444,"qdb_cluster":[6444]},"id":5}]} 2024-05-10T11:18:01.740 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-05-10T11:18:01.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0980762d0 msgr2=0x7fd098078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0980762d0 0x7fd098078790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0006fd0 tx=0x7fd0a0008040 comp rx=0 tx=0).stop 2024-05-10T11:18:01.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 msgr2=0x7fd0ac151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac151370 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0097c0 tx=0x7fd09c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 shutdown_connections 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0980762d0 0x7fd098078790 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0ac0d0230 0x7fd0ac151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0ac0cfbb0 0x7fd0ac15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 --2- 172.21.15.66:0/2674547545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0ac0b8860 0x7fd0ac151370 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 >> 172.21.15.66:0/2674547545 conn(0x7fd0ac0d2df0 msgr2=0x7fd0ac0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 shutdown_connections 2024-05-10T11:18:01.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.743+0000 7fd0b1d46640 1 -- 172.21.15.66:0/2674547545 wait complete. 2024-05-10T11:18:01.753 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:18:01.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.859+0000 7fa12f859640 1 Processor -- start 2024-05-10T11:18:01.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.859+0000 7fa12f859640 1 -- start start 2024-05-10T11:18:01.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12f859640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa1280b3170 0x7fa128168100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12f859640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1280ce590 con 0x7fa12815d650 2024-05-10T11:18:01.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12f859640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1280d0500 con 0x7fa1280d3980 2024-05-10T11:18:01.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12f859640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa12815da30 con 0x7fa1280b3170 2024-05-10T11:18:01.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12ddf6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa1280b3170 0x7fa128168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12d5f5640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa12815d650 0x7fa1280cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43336/0 (socket says 172.21.15.66:43336) 2024-05-10T11:18:01.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12d5f5640 1 -- 172.21.15.66:0/816773503 learned_addr learned my addr 172.21.15.66:0/816773503 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:01.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12ddf6640 1 -- 172.21.15.66:0/816773503 >> v1:172.21.15.190:6789/0 conn(0x7fa1280d3980 legacy=0x7fa1280cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:01.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12ddf6640 1 -- 172.21.15.66:0/816773503 >> v1:172.21.15.66:6789/0 conn(0x7fa12815d650 legacy=0x7fa1280cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa11ffff640 1 -- 172.21.15.66:0/816773503 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428430941 0 0) 0x7fa124001110 con 0x7fa12815d650 2024-05-10T11:18:01.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.860+0000 7fa12ddf6640 1 -- 172.21.15.66:0/816773503 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1280ce810 con 0x7fa1280b3170 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.861+0000 7fa12ddf6640 1 --2- 172.21.15.66:0/816773503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1280b3170 0x7fa128168100 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa120009d90 tx=0x7fa12002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce88a4281f834fe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.861+0000 7fa11ffff640 1 -- 172.21.15.66:0/816773503 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120007740 con 0x7fa1280b3170 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.861+0000 7fa11ffff640 1 -- 172.21.15.66:0/816773503 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1200078e0 con 0x7fa1280b3170 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.861+0000 7fa11ffff640 1 -- 172.21.15.66:0/816773503 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120007cb0 con 0x7fa1280b3170 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 -- 172.21.15.66:0/816773503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1280b3170 msgr2=0x7fa128168100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 --2- 172.21.15.66:0/816773503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1280b3170 0x7fa128168100 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa120009d90 tx=0x7fa12002a6a0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 -- 172.21.15.66:0/816773503 shutdown_connections 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 --2- 172.21.15.66:0/816773503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1280b3170 0x7fa128168100 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 -- 172.21.15.66:0/816773503 >> 172.21.15.66:0/816773503 conn(0x7fa1280d2df0 msgr2=0x7fa1280d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 -- 172.21.15.66:0/816773503 shutdown_connections 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.862+0000 7fa12f859640 1 -- 172.21.15.66:0/816773503 wait complete. 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.863+0000 7fa12f859640 1 Processor -- start 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.863+0000 7fa12f859640 1 -- start start 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12f859640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1280b3170 0x7fa128070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12f859640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1280d3980 0x7fa1280b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12f859640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 0x7fa1280b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12f859640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280b43a0 con 0x7fa12815d650 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12f859640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280cedd0 con 0x7fa1280b3170 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12f859640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1280b4520 con 0x7fa1280d3980 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 0x7fa1280b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 0x7fa1280b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33656/0 (socket says 172.21.15.66:33656) 2024-05-10T11:18:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 -- 172.21.15.66:0/154214567 learned_addr learned my addr 172.21.15.66:0/154214567 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12d5f5640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1280b3170 0x7fa128070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12cdf4640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1280d3980 0x7fa1280b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 -- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1280d3980 msgr2=0x7fa1280b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1280d3980 0x7fa1280b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 -- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1280b3170 msgr2=0x7fa128070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1280b3170 0x7fa128070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.864+0000 7fa12ddf6640 1 -- 172.21.15.66:0/154214567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1280b6820 con 0x7fa12815d650 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.865+0000 7fa12ddf6640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 0x7fa1280b7df0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa120009d90 tx=0x7fa120004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.865+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120040070 con 0x7fa12815d650 2024-05-10T11:18:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.865+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120031c90 con 0x7fa12815d650 2024-05-10T11:18:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.865+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12003c640 con 0x7fa12815d650 2024-05-10T11:18:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.865+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1281f63d0 con 0x7fa12815d650 2024-05-10T11:18:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.865+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1281f6990 con 0x7fa12815d650 2024-05-10T11:18:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.866+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1281f6fa0 con 0x7fa12815d650 2024-05-10T11:18:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.867+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa120039040 con 0x7fa12815d650 2024-05-10T11:18:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.867+0000 7fa11dffb640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa10c0762d0 0x7fa10c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.867+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7fa1200b8e40 con 0x7fa12815d650 2024-05-10T11:18:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.867+0000 7fa12d5f5640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa10c0762d0 0x7fa10c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.868+0000 7fa12d5f5640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa10c0762d0 0x7fa10c078790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa124000f60 tx=0x7fa124007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:01.871+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa1280b6820 con 0x7fa12815d650 2024-05-10T11:18:02.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.063+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa12806a220 con 0x7fa12815d650 2024-05-10T11:18:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.064+0000 7fa11dffb640 1 -- 172.21.15.66:0/154214567 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+17074 (secure 0 0 0) 0x7fa120082680 con 0x7fa12815d650 2024-05-10T11:18:02.063 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:02.064 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":77,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:16:47.934742+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:16:31.864172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T11:16:33.168965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/1361798984":"2024-05-11T11:16:47.934721+0000","172.21.15.66:6834/1361798984":"2024-05-11T11:16:47.934721+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa10c0762d0 msgr2=0x7fa10c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa10c0762d0 0x7fa10c078790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa124000f60 tx=0x7fa124007c00 comp rx=0 tx=0).stop 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 msgr2=0x7fa1280b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 0x7fa1280b7df0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa120009d90 tx=0x7fa120004a40 comp rx=0 tx=0).stop 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 shutdown_connections 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa10c0762d0 0x7fa10c078790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa12815d650 0x7fa1280b7df0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1280d3980 0x7fa1280b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 --2- 172.21.15.66:0/154214567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1280b3170 0x7fa128070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 >> 172.21.15.66:0/154214567 conn(0x7fa1280d2df0 msgr2=0x7fa12815c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 shutdown_connections 2024-05-10T11:18:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.066+0000 7fa12f859640 1 -- 172.21.15.66:0/154214567 wait complete. 2024-05-10T11:18:02.077 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:18:02.159 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:18:02.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:18:02.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.183+0000 7f1bc4d4e640 1 Processor -- start 2024-05-10T11:18:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.183+0000 7f1bc4d4e640 1 -- start start 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bc4d4e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1bc00b5520 0x7f1bc00d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bc4d4e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bc4d4e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc00d41f0 con 0x7f1bc00b62e0 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bc4d4e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc00d5c60 con 0x7f1bc00b5520 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bc4d4e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc00d5eb0 con 0x7f1bc00b5900 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bbe59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1bc00b5520 0x7f1bc00d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bbe59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1bc00b5520 0x7f1bc00d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33660/0 (socket says 172.21.15.66:33660) 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bbe59c640 1 -- 172.21.15.66:0/4176139222 learned_addr learned my addr 172.21.15.66:0/4176139222 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.184+0000 7f1bbdd9b640 1 --2- 172.21.15.66:0/4176139222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.185+0000 7f1bbe59c640 1 -- 172.21.15.66:0/4176139222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 msgr2=0x7f1bc00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.185+0000 7f1bbe59c640 1 --2- 172.21.15.66:0/4176139222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.185+0000 7f1bbe59c640 1 -- 172.21.15.66:0/4176139222 >> v1:172.21.15.190:6789/0 conn(0x7f1bc00b62e0 legacy=0x7f1bc00d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.185+0000 7f1bbe59c640 1 -- 172.21.15.66:0/4176139222 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc00d0a30 con 0x7f1bc00b5520 2024-05-10T11:18:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.185+0000 7f1bbe59c640 1 --2- 172.21.15.66:0/4176139222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00d18a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009870 tx=0x7f1bb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d59861f2b9e201 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.185+0000 7f1bbd59a640 1 -- 172.21.15.66:0/4176139222 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0037070 con 0x7f1bc00b5520 2024-05-10T11:18:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bbd59a640 1 -- 172.21.15.66:0/4176139222 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0032440 con 0x7f1bc00b5520 2024-05-10T11:18:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bbd59a640 1 -- 172.21.15.66:0/4176139222 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0032810 con 0x7f1bc00b5520 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/4176139222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 msgr2=0x7f1bc00d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/4176139222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00d18a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009870 tx=0x7f1bb002a270 comp rx=0 tx=0).stop 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/4176139222 shutdown_connections 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/4176139222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/4176139222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00d18a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/4176139222 >> 172.21.15.66:0/4176139222 conn(0x7f1bc00d5170 msgr2=0x7f1bc00d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/4176139222 shutdown_connections 2024-05-10T11:18:02.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.186+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/4176139222 wait complete. 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.188+0000 7f1bc4d4e640 1 Processor -- start 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.188+0000 7f1bc4d4e640 1 -- start start 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bc4d4e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bc4d4e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bc4d4e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bc00b62e0 0x7f1bc00cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bc4d4e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc00b9300 con 0x7f1bc00b5520 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bc4d4e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc00b9180 con 0x7f1bc00b62e0 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bc4d4e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc00b9480 con 0x7f1bc00b5900 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33666/0 (socket says 172.21.15.66:33666) 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 -- 172.21.15.66:0/2225964651 learned_addr learned my addr 172.21.15.66:0/2225964651 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:02.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbdd9b640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbed9d640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bc00b62e0 0x7f1bc00cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 -- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 msgr2=0x7f1bc00cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 -- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bc00b62e0 msgr2=0x7f1bc00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bc00b62e0 0x7f1bc00cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 -- 172.21.15.66:0/2225964651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc0157f20 con 0x7f1bc00b5520 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbed9d640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bc00b62e0 0x7f1bc00cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bbe59c640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00cf090 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0000c00 tx=0x7f1bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.189+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0041020 con 0x7f1bc00b5520 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.190+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb00306c0 con 0x7f1bc00b5520 2024-05-10T11:18:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.190+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc0158200 con 0x7f1bc00b5520 2024-05-10T11:18:02.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.190+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0037040 con 0x7f1bc00b5520 2024-05-10T11:18:02.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.190+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01587c0 con 0x7f1bc00b5520 2024-05-10T11:18:02.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.190+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc00693f0 con 0x7f1bc00b5520 2024-05-10T11:18:02.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.191+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1bb0044020 con 0x7f1bc00b5520 2024-05-10T11:18:02.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.192+0000 7f1bb6ffd640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ba00762d0 0x7f1ba0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.192+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f1bb00b7ec0 con 0x7f1bc00b5520 2024-05-10T11:18:02.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.192+0000 7f1bbdd9b640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ba00762d0 0x7f1ba0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.192+0000 7f1bbdd9b640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ba00762d0 0x7f1ba0078790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1bc01f8370 tx=0x7f1ba8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:02.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.196+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1bb004b030 con 0x7f1bc00b5520 2024-05-10T11:18:02.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.426+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1bc00d2ec0 con 0x7f1bc00b5520 2024-05-10T11:18:02.425 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:18:02.426+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:18:02.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.428+0000 7f1bb6ffd640 1 -- 172.21.15.66:0/2225964651 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) ==== 161+0+0 (secure 0 0 0) 0x7f1bb0081630 con 0x7f1bc00b5520 2024-05-10T11:18:02.427 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ba00762d0 msgr2=0x7f1ba0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ba00762d0 0x7f1ba0078790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1bc01f8370 tx=0x7f1ba8008040 comp rx=0 tx=0).stop 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 msgr2=0x7f1bc00cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00cf090 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0000c00 tx=0x7f1bb00046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 shutdown_connections 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1ba00762d0 0x7f1ba0078790 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bc00b62e0 0x7f1bc00cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bc00b5900 0x7f1bc00cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 --2- 172.21.15.66:0/2225964651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bc00b5520 0x7f1bc00cf090 secure :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0000c00 tx=0x7f1bb00046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.430+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 >> 172.21.15.66:0/2225964651 conn(0x7f1bc00d5170 msgr2=0x7f1bc00b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:02.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.431+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 shutdown_connections 2024-05-10T11:18:02.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.431+0000 7f1bc4d4e640 1 -- 172.21.15.66:0/2225964651 wait complete. 2024-05-10T11:18:02.433 INFO:tasks.ceph.mds.a.smithi066.stderr: -4020> 2024-05-10T11:16:53.948+0000 7f43332c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:18:02.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:18:02.464 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:18:02.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.548+0000 7fa6fc675640 1 Processor -- start 2024-05-10T11:18:02.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.548+0000 7fa6fc675640 1 -- start start 2024-05-10T11:18:02.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fc675640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6f4162900 0x7fa6f40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fc675640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162ce0 0x7fa6f40b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fc675640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6f40d3950 0x7fa6f40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fc675640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa6f40d4190 con 0x7fa6f4162900 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fc675640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa6f40cfc40 con 0x7fa6f40d3950 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fc675640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f40d3eb0 con 0x7fa6f4162ce0 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6f4162900 0x7fa6f40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6f4162900 0x7fa6f40d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33698/0 (socket says 172.21.15.66:33698) 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 -- 172.21.15.66:0/598488022 learned_addr learned my addr 172.21.15.66:0/598488022 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fac12640 1 --2- 172.21.15.66:0/598488022 >> v2:172.21.15.190:3300/0 conn(0x7fa6f40d3950 0x7fa6f40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6f9c10640 1 --2- 172.21.15.66:0/598488022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162ce0 0x7fa6f40b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 -- 172.21.15.66:0/598488022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162ce0 msgr2=0x7fa6f40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 --2- 172.21.15.66:0/598488022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162ce0 0x7fa6f40b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 -- 172.21.15.66:0/598488022 >> v2:172.21.15.190:3300/0 conn(0x7fa6f40d3950 msgr2=0x7fa6f40b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:02.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 --2- 172.21.15.66:0/598488022 >> v2:172.21.15.190:3300/0 conn(0x7fa6f40d3950 0x7fa6f40b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fa411640 1 -- 172.21.15.66:0/598488022 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f40cfee0 con 0x7fa6f4162900 2024-05-10T11:18:02.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.549+0000 7fa6fac12640 1 --2- 172.21.15.66:0/598488022 >> v2:172.21.15.190:3300/0 conn(0x7fa6f40d3950 0x7fa6f40b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:02.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.550+0000 7fa6fa411640 1 --2- 172.21.15.66:0/598488022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f4162900 0x7fa6f40d3410 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa6f408e560 tx=0x7fa6e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a38425abe39d6fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:02.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.550+0000 7fa6f940f640 1 -- 172.21.15.66:0/598488022 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4037070 con 0x7fa6f4162900 2024-05-10T11:18:02.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.550+0000 7fa6f940f640 1 -- 172.21.15.66:0/598488022 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e4032440 con 0x7fa6f4162900 2024-05-10T11:18:02.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.550+0000 7fa6f940f640 1 -- 172.21.15.66:0/598488022 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4032810 con 0x7fa6f4162900 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 -- 172.21.15.66:0/598488022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f4162900 msgr2=0x7fa6f40d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 --2- 172.21.15.66:0/598488022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f4162900 0x7fa6f40d3410 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa6f408e560 tx=0x7fa6e402a140 comp rx=0 tx=0).stop 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 -- 172.21.15.66:0/598488022 shutdown_connections 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 --2- 172.21.15.66:0/598488022 >> v2:172.21.15.190:3300/0 conn(0x7fa6f40d3950 0x7fa6f40b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 --2- 172.21.15.66:0/598488022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162ce0 0x7fa6f40b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 --2- 172.21.15.66:0/598488022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f4162900 0x7fa6f40d3410 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 -- 172.21.15.66:0/598488022 >> 172.21.15.66:0/598488022 conn(0x7fa6f409e430 msgr2=0x7fa6f40d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 -- 172.21.15.66:0/598488022 shutdown_connections 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.551+0000 7fa6fc675640 1 -- 172.21.15.66:0/598488022 wait complete. 2024-05-10T11:18:02.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.552+0000 7fa6fc675640 1 Processor -- start 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.552+0000 7fa6fc675640 1 -- start start 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fc675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 0x7fa6f40b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fc675640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162900 0x7fa6f41f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fc675640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6f4162ce0 0x7fa6f40cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fc675640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40b4300 con 0x7fa6f40d3950 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fc675640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40b4180 con 0x7fa6f4162ce0 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fc675640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f40d09c0 con 0x7fa6f4162900 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 0x7fa6f40b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 0x7fa6f40b9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33702/0 (socket says 172.21.15.66:33702) 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 -- 172.21.15.66:0/1965272941 learned_addr learned my addr 172.21.15.66:0/1965272941 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6f9c10640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162900 0x7fa6f41f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fac12640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6f4162ce0 0x7fa6f40cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 -- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162900 msgr2=0x7fa6f41f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162900 0x7fa6f41f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 -- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6f4162ce0 msgr2=0x7fa6f40cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6f4162ce0 0x7fa6f40cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.553+0000 7fa6fa411640 1 -- 172.21.15.66:0/1965272941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f41f51e0 con 0x7fa6f40d3950 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.554+0000 7fa6fa411640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 0x7fa6f40b9db0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4000c00 tx=0x7fa6e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.554+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4041070 con 0x7fa6f40d3950 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.554+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e403c870 con 0x7fa6f40d3950 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.554+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f41f8c10 con 0x7fa6f40d3950 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.554+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4037040 con 0x7fa6f40d3950 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.554+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f41f94b0 con 0x7fa6f40d3950 2024-05-10T11:18:02.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.555+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f406a220 con 0x7fa6f40d3950 2024-05-10T11:18:02.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.556+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa6e4044070 con 0x7fa6f40d3950 2024-05-10T11:18:02.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.556+0000 7fa6eaffd640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6d80762d0 0x7fa6d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:02.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.556+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6273+0+0 (secure 0 0 0) 0x7fa6e40b8190 con 0x7fa6f40d3950 2024-05-10T11:18:02.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.556+0000 7fa6f9c10640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6d80762d0 0x7fa6d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:02.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.557+0000 7fa6f9c10640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6d80762d0 0x7fa6d8078790 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0006fd0 tx=0x7fa6f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:02.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.561+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa6e4081940 con 0x7fa6f40d3950 2024-05-10T11:18:02.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:02.792+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa6f409e840 con 0x7fa6f40d3950 2024-05-10T11:18:03.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.429+0000 7fa6eaffd640 1 -- 172.21.15.66:0/1965272941 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) ==== 104+0+0 (secure 0 0 0) 0x7fa6e4081240 con 0x7fa6f40d3950 2024-05-10T11:18:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6d80762d0 msgr2=0x7fa6d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6d80762d0 0x7fa6d8078790 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0006fd0 tx=0x7fa6f0008040 comp rx=0 tx=0).stop 2024-05-10T11:18:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 msgr2=0x7fa6f40b9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 0x7fa6f40b9db0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4000c00 tx=0x7fa6e40046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 shutdown_connections 2024-05-10T11:18:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6d80762d0 0x7fa6d8078790 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6f4162ce0 0x7fa6f40cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6f4162900 0x7fa6f41f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 --2- 172.21.15.66:0/1965272941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6f40d3950 0x7fa6f40b9db0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 >> 172.21.15.66:0/1965272941 conn(0x7fa6f409e430 msgr2=0x7fa6f4161c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 shutdown_connections 2024-05-10T11:18:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.432+0000 7fa6fc675640 1 -- 172.21.15.66:0/1965272941 wait complete. 2024-05-10T11:18:03.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:18:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.595+0000 7f793e43f640 1 Processor -- start 2024-05-10T11:18:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.595+0000 7f793e43f640 1 -- start start 2024-05-10T11:18:03.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f793e43f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f79381639a0 0x7f7938070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f793e43f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7938071520 0x7f7938162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f793e43f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79380d2510 con 0x7f793815f370 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f793e43f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7938070220 con 0x7f79381639a0 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f793e43f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7938070500 con 0x7f7938071520 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f792ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f79381639a0 0x7f7938070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f7937fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f793815f370 0x7f79380d1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43354/0 (socket says 172.21.15.66:43354) 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f7937fff640 1 -- 172.21.15.66:0/1609328687 learned_addr learned my addr 172.21.15.66:0/1609328687 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f792ffff640 1 -- 172.21.15.66:0/1609328687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7938071520 msgr2=0x7f7938162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f792ffff640 1 --2- 172.21.15.66:0/1609328687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7938071520 0x7f7938162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f792ffff640 1 -- 172.21.15.66:0/1609328687 >> v1:172.21.15.66:6789/0 conn(0x7f793815f370 legacy=0x7f79380d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f79377fe640 1 -- 172.21.15.66:0/1609328687 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1447782981 0 0) 0x7f79380d2510 con 0x7f793815f370 2024-05-10T11:18:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.596+0000 7f792ffff640 1 -- 172.21.15.66:0/1609328687 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380707e0 con 0x7f79381639a0 2024-05-10T11:18:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.597+0000 7f792ffff640 1 --2- 172.21.15.66:0/1609328687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f7938070fe0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f79200097a0 tx=0x7f792002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236320c4746cade6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.597+0000 7f79377fe640 1 -- 172.21.15.66:0/1609328687 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920037070 con 0x7f79381639a0 2024-05-10T11:18:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.597+0000 7f79377fe640 1 -- 172.21.15.66:0/1609328687 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7920032440 con 0x7f79381639a0 2024-05-10T11:18:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.597+0000 7f79377fe640 1 -- 172.21.15.66:0/1609328687 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920032810 con 0x7f79381639a0 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 -- 172.21.15.66:0/1609328687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 msgr2=0x7f7938070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 --2- 172.21.15.66:0/1609328687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f7938070fe0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f79200097a0 tx=0x7f792002a210 comp rx=0 tx=0).stop 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 -- 172.21.15.66:0/1609328687 shutdown_connections 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 --2- 172.21.15.66:0/1609328687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7938071520 0x7f7938162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 --2- 172.21.15.66:0/1609328687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f7938070fe0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 -- 172.21.15.66:0/1609328687 >> 172.21.15.66:0/1609328687 conn(0x7f79380d2e10 msgr2=0x7f79380d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 -- 172.21.15.66:0/1609328687 shutdown_connections 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.598+0000 7f793e43f640 1 -- 172.21.15.66:0/1609328687 wait complete. 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.599+0000 7f793e43f640 1 Processor -- start 2024-05-10T11:18:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.599+0000 7f793e43f640 1 -- start start 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f793815f370 0x7f79380b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f793815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f793815e040 0x7f7938161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79381634c0 con 0x7f79381639a0 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7938163340 con 0x7f793815e040 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7938163640 con 0x7f793815f370 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f793815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f793815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33718/0 (socket says 172.21.15.66:33718) 2024-05-10T11:18:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 -- 172.21.15.66:0/3145076018 learned_addr learned my addr 172.21.15.66:0/3145076018 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f7937fff640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f793815f370 0x7f79380b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793c9dc640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f793815e040 0x7f7938161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 -- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f793815f370 msgr2=0x7f79380b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f793815f370 0x7f79380b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 -- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f793815e040 msgr2=0x7f7938161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f793815e040 0x7f7938161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 -- 172.21.15.66:0/3145076018 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793815cab0 con 0x7f79381639a0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f792ffff640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f793815c080 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f79200098c0 tx=0x7f79200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920041070 con 0x7f79381639a0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792003c870 con 0x7f79381639a0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.600+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79380b2f70 con 0x7f79381639a0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.601+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920037040 con 0x7f79381639a0 2024-05-10T11:18:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.601+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793809efd0 con 0x7f79381639a0 2024-05-10T11:18:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.601+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793806a220 con 0x7f79381639a0 2024-05-10T11:18:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.602+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7920044070 con 0x7f79381639a0 2024-05-10T11:18:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.603+0000 7f79357fa640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f79180762d0 0x7f7918078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.603+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6273+0+0 (secure 0 0 0) 0x7f79200b83b0 con 0x7f79381639a0 2024-05-10T11:18:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.603+0000 7f7937fff640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f79180762d0 0x7f7918078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.603+0000 7f7937fff640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f79180762d0 0x7f7918078790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7928000f60 tx=0x7f7928007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.607+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7920081ad0 con 0x7f79381639a0 2024-05-10T11:18:03.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:03.796+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f79380a0ab0 con 0x7f79381639a0 2024-05-10T11:18:04.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.436+0000 7f79357fa640 1 -- 172.21.15.66:0/3145076018 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) ==== 181+0+0 (secure 0 0 0) 0x7f79200813d0 con 0x7f79381639a0 2024-05-10T11:18:04.436 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:18:04.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.439+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f79180762d0 msgr2=0x7f7918078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:04.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.439+0000 7f793e43f640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f79180762d0 0x7f7918078790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7928000f60 tx=0x7f7928007c00 comp rx=0 tx=0).stop 2024-05-10T11:18:04.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.439+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 msgr2=0x7f793815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:04.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.439+0000 7f793e43f640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f793815c080 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f79200098c0 tx=0x7f79200046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 shutdown_connections 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f79180762d0 0x7f7918078790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f793815e040 0x7f7938161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79381639a0 0x7f793815c080 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 --2- 172.21.15.66:0/3145076018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f793815f370 0x7f79380b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 >> 172.21.15.66:0/3145076018 conn(0x7f79380d2e10 msgr2=0x7f793806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 shutdown_connections 2024-05-10T11:18:04.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.440+0000 7f793e43f640 1 -- 172.21.15.66:0/3145076018 wait complete. 2024-05-10T11:18:04.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:18:04.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.562+0000 7fa7b68b4640 1 Processor -- start 2024-05-10T11:18:04.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.562+0000 7fa7b68b4640 1 -- start start 2024-05-10T11:18:04.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7b68b4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa7b015d190 0x7fa7b00d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:04.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7b68b4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b00d1e20 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7b68b4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b00ced50 con 0x7fa7b0160cf0 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7b68b4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b00d09e0 con 0x7fa7b015d190 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7affff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa7b015d190 0x7fa7b00d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7af7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa7b00ce5e0 0x7fa7b00d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43358/0 (socket says 172.21.15.66:43358) 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7af7fe640 1 -- 172.21.15.66:0/3555732132 learned_addr learned my addr 172.21.15.66:0/3555732132 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7affff640 1 -- 172.21.15.66:0/3555732132 >> v1:172.21.15.190:6789/0 conn(0x7fa7b0160cf0 legacy=0x7fa7b0161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7aeffd640 1 -- 172.21.15.66:0/3555732132 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144081303 0 0) 0x7fa7b00d1e20 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7affff640 1 -- 172.21.15.66:0/3555732132 >> v1:172.21.15.66:6789/0 conn(0x7fa7b00ce5e0 legacy=0x7fa7b00d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:04.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.563+0000 7fa7affff640 1 -- 172.21.15.66:0/3555732132 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b00d0c30 con 0x7fa7b015d190 2024-05-10T11:18:04.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.564+0000 7fa7affff640 1 --2- 172.21.15.66:0/3555732132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b015d190 0x7fa7b00d3930 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00097a0 tx=0x7fa7a002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841538ef8a4756c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:04.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.564+0000 7fa7aeffd640 1 -- 172.21.15.66:0/3555732132 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0037070 con 0x7fa7b015d190 2024-05-10T11:18:04.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.564+0000 7fa7aeffd640 1 -- 172.21.15.66:0/3555732132 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0032440 con 0x7fa7b015d190 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.564+0000 7fa7aeffd640 1 -- 172.21.15.66:0/3555732132 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0032810 con 0x7fa7b015d190 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 -- 172.21.15.66:0/3555732132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b015d190 msgr2=0x7fa7b00d3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/3555732132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b015d190 0x7fa7b00d3930 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00097a0 tx=0x7fa7a002a230 comp rx=0 tx=0).stop 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 -- 172.21.15.66:0/3555732132 shutdown_connections 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/3555732132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b015d190 0x7fa7b00d3930 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 -- 172.21.15.66:0/3555732132 >> 172.21.15.66:0/3555732132 conn(0x7fa7b00d2e10 msgr2=0x7fa7b00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 -- 172.21.15.66:0/3555732132 shutdown_connections 2024-05-10T11:18:04.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.565+0000 7fa7b68b4640 1 -- 172.21.15.66:0/3555732132 wait complete. 2024-05-10T11:18:04.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.566+0000 7fa7b68b4640 1 Processor -- start 2024-05-10T11:18:04.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.566+0000 7fa7b68b4640 1 -- start start 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b68b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 0x7fa7b00cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b68b4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7b015d190 0x7fa7b014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b68b4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7b0160cf0 0x7fa7b00c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b68b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b015d570 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b68b4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b00d11f0 con 0x7fa7b0160cf0 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b68b4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b00cea30 con 0x7fa7b015d190 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 0x7fa7b00cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 0x7fa7b00cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33724/0 (socket says 172.21.15.66:33724) 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7affff640 1 -- 172.21.15.66:0/2516482664 learned_addr learned my addr 172.21.15.66:0/2516482664 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7af7fe640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7b015d190 0x7fa7b014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.567+0000 7fa7b4e51640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7b0160cf0 0x7fa7b00c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7affff640 1 -- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7b015d190 msgr2=0x7fa7b014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7affff640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7b015d190 0x7fa7b014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7affff640 1 -- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7b0160cf0 msgr2=0x7fa7b00c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7affff640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7b0160cf0 0x7fa7b00c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7affff640 1 -- 172.21.15.66:0/2516482664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b014a4f0 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7affff640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 0x7fa7b00cb740 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0037040 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0042070 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b014a7d0 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0030a70 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.568+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b014ad90 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.569+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b006a220 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.570+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa7a0030c10 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.570+0000 7fa7acff9640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa79c0762d0 0x7fa79c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.570+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5835+0+0 (secure 0 0 0) 0x7fa7a00b8030 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.570+0000 7fa7af7fe640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa79c0762d0 0x7fa79c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.571+0000 7fa7af7fe640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa79c0762d0 0x7fa79c078790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00c9e70 tx=0x7fa7a4007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:04.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.574+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa7a0081240 con 0x7fa7b00ce5e0 2024-05-10T11:18:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:04.767+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa7b015d6f0 con 0x7fa7b00ce5e0 2024-05-10T11:18:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.437+0000 7fa7acff9640 1 -- 172.21.15.66:0/2516482664 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) ==== 169+0+0 (secure 0 0 0) 0x7fa7a0085540 con 0x7fa7b00ce5e0 2024-05-10T11:18:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:18:05.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.441+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa79c0762d0 msgr2=0x7fa79c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.441+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa79c0762d0 0x7fa79c078790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00c9e70 tx=0x7fa7a4007e40 comp rx=0 tx=0).stop 2024-05-10T11:18:05.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.441+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 msgr2=0x7fa7b00cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.441+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 0x7fa7b00cb740 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a00046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.442+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 shutdown_connections 2024-05-10T11:18:05.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.442+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa79c0762d0 0x7fa79c078790 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.442+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7b0160cf0 0x7fa7b00c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.442+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7b015d190 0x7fa7b014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.442+0000 7fa7b68b4640 1 --2- 172.21.15.66:0/2516482664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b00ce5e0 0x7fa7b00cb740 secure :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a00046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.442+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 >> 172.21.15.66:0/2516482664 conn(0x7fa7b00d2e10 msgr2=0x7fa7b0075890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:05.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.443+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 shutdown_connections 2024-05-10T11:18:05.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.443+0000 7fa7b68b4640 1 -- 172.21.15.66:0/2516482664 wait complete. 2024-05-10T11:18:05.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:18:05.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.565+0000 7f4654fc1640 1 Processor -- start 2024-05-10T11:18:05.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.565+0000 7f4654fc1640 1 -- start start 2024-05-10T11:18:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f4654fc1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f465015f410 0x7f46500d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f4654fc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f4654fc1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46500b54d0 0x7f46500d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f4654fc1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f46500d2800 con 0x7f465015f410 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f4654fc1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f46500d2ae0 con 0x7f46500b54d0 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f4654fc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f46500d01d0 con 0x7f46500d0f10 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f464e59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f465015f410 0x7f46500d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.566+0000 7f464e59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f465015f410 0x7f46500d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48712/0 (socket says 172.21.15.66:48712) 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464e59c640 1 -- 172.21.15.66:0/981215000 learned_addr learned my addr 172.21.15.66:0/981215000 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464dd9b640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464e59c640 1 -- 172.21.15.66:0/981215000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 msgr2=0x7f46500b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464ed9d640 1 --2- 172.21.15.66:0/981215000 >> v2:172.21.15.190:3300/0 conn(0x7f46500b54d0 0x7f46500d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464e59c640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464e59c640 1 -- 172.21.15.66:0/981215000 >> v2:172.21.15.190:3300/0 conn(0x7f46500b54d0 msgr2=0x7f46500d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:05.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464e59c640 1 --2- 172.21.15.66:0/981215000 >> v2:172.21.15.190:3300/0 conn(0x7f46500b54d0 0x7f46500d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464e59c640 1 -- 172.21.15.66:0/981215000 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46500d04b0 con 0x7f465015f410 2024-05-10T11:18:05.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464dd9b640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:05.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.567+0000 7f464ed9d640 1 --2- 172.21.15.66:0/981215000 >> v2:172.21.15.190:3300/0 conn(0x7f46500b54d0 0x7f46500d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f464e59c640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f465015f410 0x7f46500d09d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f465006c840 tx=0x7f464802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4daff8f58144edc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f464d59a640 1 -- 172.21.15.66:0/981215000 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648037070 con 0x7f465015f410 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f464d59a640 1 -- 172.21.15.66:0/981215000 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4648032440 con 0x7f465015f410 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f464d59a640 1 -- 172.21.15.66:0/981215000 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648032810 con 0x7f465015f410 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 -- 172.21.15.66:0/981215000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f465015f410 msgr2=0x7f46500d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f465015f410 0x7f46500d09d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f465006c840 tx=0x7f464802a140 comp rx=0 tx=0).stop 2024-05-10T11:18:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 -- 172.21.15.66:0/981215000 shutdown_connections 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 --2- 172.21.15.66:0/981215000 >> v2:172.21.15.190:3300/0 conn(0x7f46500b54d0 0x7f46500d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 --2- 172.21.15.66:0/981215000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f465015f410 0x7f46500d09d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 -- 172.21.15.66:0/981215000 >> 172.21.15.66:0/981215000 conn(0x7f465008ed30 msgr2=0x7f465009e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 -- 172.21.15.66:0/981215000 shutdown_connections 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.568+0000 7f4654fc1640 1 -- 172.21.15.66:0/981215000 wait complete. 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 Processor -- start 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 -- start start 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 0x7f465015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f465015f410 0x7f46500b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f46500cffb0 con 0x7f46500b54d0 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.570+0000 7f4654fc1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f46500cfe30 con 0x7f465015f410 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f4654fc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f46500d3c10 con 0x7f46500d0f10 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 0x7f465015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 0x7f465015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48720/0 (socket says 172.21.15.66:48720) 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 -- 172.21.15.66:0/1420659877 learned_addr learned my addr 172.21.15.66:0/1420659877 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464ed9d640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f465015f410 0x7f46500b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 -- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 msgr2=0x7f46500b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464dd9b640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 -- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f465015f410 msgr2=0x7f46500b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f465015f410 0x7f46500b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 -- 172.21.15.66:0/1420659877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465015cbb0 con 0x7f46500b54d0 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f464e59c640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 0x7f465015c670 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f464802a180 tx=0x7f46480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648037040 con 0x7f46500b54d0 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4648042070 con 0x7f46500b54d0 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46500b9f40 con 0x7f46500b54d0 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648030bb0 con 0x7f46500b54d0 2024-05-10T11:18:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.571+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46500ba500 con 0x7f46500b54d0 2024-05-10T11:18:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.572+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465006a220 con 0x7f46500b54d0 2024-05-10T11:18:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.573+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4648047460 con 0x7f46500b54d0 2024-05-10T11:18:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.574+0000 7f463effd640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46300762d0 0x7f4630078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.574+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7f46480b80d0 con 0x7f46500b54d0 2024-05-10T11:18:05.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.574+0000 7f464dd9b640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46300762d0 0x7f4630078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.574+0000 7f464dd9b640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46300762d0 0x7f4630078790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4644006fd0 tx=0x7f4644008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:05.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.578+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4648081be0 con 0x7f46500b54d0 2024-05-10T11:18:05.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.768+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4650075a60 con 0x7f46500b54d0 2024-05-10T11:18:05.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.771+0000 7f463effd640 1 -- 172.21.15.66:0/1420659877 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f46480814e0 con 0x7f46500b54d0 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46300762d0 msgr2=0x7f4630078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46300762d0 0x7f4630078790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4644006fd0 tx=0x7f4644008040 comp rx=0 tx=0).stop 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 msgr2=0x7f465015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 0x7f465015c670 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f464802a180 tx=0x7f46480046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 shutdown_connections 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46300762d0 0x7f4630078790 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f465015f410 0x7f46500b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500d0f10 0x7f46500b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 --2- 172.21.15.66:0/1420659877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500b54d0 0x7f465015c670 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 >> 172.21.15.66:0/1420659877 conn(0x7f465008ed30 msgr2=0x7f46500b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 shutdown_connections 2024-05-10T11:18:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.773+0000 7f4654fc1640 1 -- 172.21.15.66:0/1420659877 wait complete. 2024-05-10T11:18:05.786 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-05-10T11:18:05.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 Processor -- start 2024-05-10T11:18:05.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 -- start start 2024-05-10T11:18:05.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 0x7fd0440d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd044162b30 0x7fd0440d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0440b45f0 con 0x7fd044162750 2024-05-10T11:18:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd0440b4f20 con 0x7fd044162b30 2024-05-10T11:18:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.892+0000 7fd04aebb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd0440d0fe0 con 0x7fd0440d5cb0 2024-05-10T11:18:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 0x7fd0440d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd049458640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd044162b30 0x7fd0440d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 0x7fd0440d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:39318/0 (socket says 172.21.15.66:39318) 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd048c57640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd044162750 0x7fd0440d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:58712/0 (socket says 172.21.15.66:58712) 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 -- 172.21.15.66:0/2735371405 learned_addr learned my addr 172.21.15.66:0/2735371405 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd0437fe640 1 -- 172.21.15.66:0/2735371405 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639795436 0 0) 0x7fd0440b45f0 con 0x7fd044162750 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd0437fe640 1 -- 172.21.15.66:0/2735371405 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd034003520 con 0x7fd044162750 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 -- 172.21.15.66:0/2735371405 >> v2:172.21.15.190:3300/0 conn(0x7fd044162b30 msgr2=0x7fd0440d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 --2- 172.21.15.66:0/2735371405 >> v2:172.21.15.190:3300/0 conn(0x7fd044162b30 0x7fd0440d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 -- 172.21.15.66:0/2735371405 >> v1:172.21.15.190:6789/0 conn(0x7fd044162750 legacy=0x7fd0440d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd043fff640 1 -- 172.21.15.66:0/2735371405 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0440b48d0 con 0x7fd0440d5cb0 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.893+0000 7fd049458640 1 --2- 172.21.15.66:0/2735371405 >> v2:172.21.15.190:3300/0 conn(0x7fd044162b30 0x7fd0440d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:18:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.894+0000 7fd043fff640 1 --2- 172.21.15.66:0/2735371405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 0x7fd0440d3630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd030009870 tx=0x7fd03002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46374b361779ae3b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.894+0000 7fd0437fe640 1 -- 172.21.15.66:0/2735371405 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030037070 con 0x7fd0440d5cb0 2024-05-10T11:18:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.894+0000 7fd0437fe640 1 -- 172.21.15.66:0/2735371405 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030032440 con 0x7fd0440d5cb0 2024-05-10T11:18:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.894+0000 7fd0437fe640 1 -- 172.21.15.66:0/2735371405 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0300327f0 con 0x7fd0440d5cb0 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 -- 172.21.15.66:0/2735371405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 msgr2=0x7fd0440d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2735371405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 0x7fd0440d3630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd030009870 tx=0x7fd03002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 -- 172.21.15.66:0/2735371405 shutdown_connections 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2735371405 >> v2:172.21.15.190:3300/0 conn(0x7fd044162b30 0x7fd0440d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2735371405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0440d5cb0 0x7fd0440d3630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 -- 172.21.15.66:0/2735371405 >> 172.21.15.66:0/2735371405 conn(0x7fd04409e3b0 msgr2=0x7fd0440d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 -- 172.21.15.66:0/2735371405 shutdown_connections 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.895+0000 7fd04aebb640 1 -- 172.21.15.66:0/2735371405 wait complete. 2024-05-10T11:18:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.896+0000 7fd04aebb640 1 Processor -- start 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.896+0000 7fd04aebb640 1 -- start start 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd04aebb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 0x7fd04415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd04aebb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd044162b30 0x7fd0440b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd04aebb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd044157930 0x7fd04415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd04aebb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440b53b0 con 0x7fd044162750 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd04aebb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440d0d80 con 0x7fd044162b30 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd04aebb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd0440b5530 con 0x7fd044157930 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 0x7fd04415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 0x7fd04415d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48734/0 (socket says 172.21.15.66:48734) 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 -- 172.21.15.66:0/2715436796 learned_addr learned my addr 172.21.15.66:0/2715436796 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd049458640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd044157930 0x7fd04415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd043fff640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd044162b30 0x7fd0440b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 -- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd044157930 msgr2=0x7fd04415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd044157930 0x7fd04415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 -- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd044162b30 msgr2=0x7fd0440b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd044162b30 0x7fd0440b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 -- 172.21.15.66:0/2715436796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04415df10 con 0x7fd044162750 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.897+0000 7fd048c57640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 0x7fd04415d7a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c460 tx=0x7fd03800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.898+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0380074e0 con 0x7fd044162750 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.898+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0380047e0 con 0x7fd044162750 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.898+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038004bd0 con 0x7fd044162750 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.898+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd044159be0 con 0x7fd044162750 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.898+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04415a1a0 con 0x7fd044162750 2024-05-10T11:18:05.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.899+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04406a220 con 0x7fd044162750 2024-05-10T11:18:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.899+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd03801a020 con 0x7fd044162750 2024-05-10T11:18:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.900+0000 7fd0417fa640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0280762d0 0x7fd028078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.900+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7fd038096c00 con 0x7fd044162750 2024-05-10T11:18:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.900+0000 7fd043fff640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0280762d0 0x7fd028078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.901+0000 7fd043fff640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0280762d0 0x7fd028078790 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd030034000 tx=0x7fd03002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:05.904+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd03809d080 con 0x7fd044162750 2024-05-10T11:18:06.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.172+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7fd0440b81b0 con 0x7fd044162750 2024-05-10T11:18:06.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.442+0000 7fd0417fa640 1 -- 172.21.15.66:0/2715436796 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v274) ==== 166+0+0 (secure 0 0 0) 0x7fd038060740 con 0x7fd044162750 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0280762d0 msgr2=0x7fd028078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0280762d0 0x7fd028078790 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd030034000 tx=0x7fd03002e000 comp rx=0 tx=0).stop 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 msgr2=0x7fd04415d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 0x7fd04415d7a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c460 tx=0x7fd03800c860 comp rx=0 tx=0).stop 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 shutdown_connections 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd0280762d0 0x7fd028078790 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd044157930 0x7fd04415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd044162b30 0x7fd0440b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 --2- 172.21.15.66:0/2715436796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd044162750 0x7fd04415d7a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 >> 172.21.15.66:0/2715436796 conn(0x7fd04409e3b0 msgr2=0x7fd04406e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:06.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 shutdown_connections 2024-05-10T11:18:06.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.444+0000 7fd04aebb640 1 -- 172.21.15.66:0/2715436796 wait complete. 2024-05-10T11:18:06.455 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-05-10T11:18:06.455 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-05-10T11:18:06.455 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:18:06.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:18:06.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.560+0000 7fe63702a640 1 Processor -- start 2024-05-10T11:18:06.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.560+0000 7fe63702a640 1 -- start start 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.560+0000 7fe63702a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6300d5d30 0x7fe63016a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.560+0000 7fe63702a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6300d30b0 con 0x7fe63015f3b0 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe63702a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6300d3390 con 0x7fe63015f790 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe63702a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe6300c8c80 con 0x7fe6300d5d30 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe634dc6640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe63015f3b0 0x7fe6300d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52982/0 (socket says 172.21.15.66:52982) 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe634dc6640 1 -- 172.21.15.66:0/702401479 learned_addr learned my addr 172.21.15.66:0/702401479 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449247801 0 0) 0x7fe6300d30b0 con 0x7fe63015f3b0 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe61c003520 con 0x7fe63015f3b0 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe6355c7640 1 --2- 172.21.15.66:0/702401479 >> v2:172.21.15.190:3300/0 conn(0x7fe6300d5d30 0x7fe63016a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3659868587 0 0) 0x7fe61c003520 con 0x7fe63015f3b0 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 >> v2:172.21.15.190:3300/0 conn(0x7fe6300d5d30 msgr2=0x7fe63016a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 --2- 172.21.15.66:0/702401479 >> v2:172.21.15.190:3300/0 conn(0x7fe6300d5d30 0x7fe63016a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 >> v1:172.21.15.190:6789/0 conn(0x7fe63015f790 legacy=0x7fe6300cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6300c8f60 con 0x7fe63015f3b0 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe628001670 con 0x7fe63015f3b0 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 >> v1:172.21.15.66:6789/0 conn(0x7fe63015f3b0 legacy=0x7fe6300d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0039b0 0x7fe61c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe61c004800 0x7fe61c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0051c0 0x7fe61c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6300c8c80 con 0x7fe61c004800 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c00c0f0 con 0x7fe61c0039b0 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c00c2f0 con 0x7fe61c0051c0 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.561+0000 7fe62ffff640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe61c004800 0x7fe61c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe634dc6640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0039b0 0x7fe61c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe6355c7640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0051c0 0x7fe61c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe62ffff640 1 -- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0051c0 msgr2=0x7fe61c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe62ffff640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0051c0 0x7fe61c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe62ffff640 1 -- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0039b0 msgr2=0x7fe61c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe62ffff640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0039b0 0x7fe61c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe6355c7640 1 -- 172.21.15.66:0/702401479 reap_dead start 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe62ffff640 1 -- 172.21.15.66:0/702401479 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c003520 con 0x7fe61c004800 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.562+0000 7fe62ffff640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe61c004800 0x7fe61c004c80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe6300cf730 tx=0x7fe61c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a6a6aae9780311 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620037070 con 0x7fe61c004800 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62002ad10 con 0x7fe61c004800 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe62f7fe640 1 -- 172.21.15.66:0/702401479 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620004080 con 0x7fe61c004800 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 -- 172.21.15.66:0/702401479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe61c004800 msgr2=0x7fe61c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe61c004800 0x7fe61c004c80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe6300cf730 tx=0x7fe61c005830 comp rx=0 tx=0).stop 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 -- 172.21.15.66:0/702401479 shutdown_connections 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 --2- 172.21.15.66:0/702401479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe61c004800 0x7fe61c004c80 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 -- 172.21.15.66:0/702401479 >> 172.21.15.66:0/702401479 conn(0x7fe6300d5130 msgr2=0x7fe6300d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 -- 172.21.15.66:0/702401479 shutdown_connections 2024-05-10T11:18:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.563+0000 7fe63702a640 1 -- 172.21.15.66:0/702401479 wait complete. 2024-05-10T11:18:06.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.564+0000 7fe63702a640 1 Processor -- start 2024-05-10T11:18:06.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.564+0000 7fe63702a640 1 -- start start 2024-05-10T11:18:06.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe63702a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c004800 0x7fe6300ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe63702a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 0x7fe630162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe63702a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6300b9160 0x7fe6300b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe63702a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6300d3870 con 0x7fe6301621e0 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe63702a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe6300d36f0 con 0x7fe6300b9160 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe63702a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe6300d39f0 con 0x7fe61c004800 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe62ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 0x7fe630162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe62ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 0x7fe630162660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48758/0 (socket says 172.21.15.66:48758) 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.565+0000 7fe62ffff640 1 -- 172.21.15.66:0/2205881633 learned_addr learned my addr 172.21.15.66:0/2205881633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe6355c7640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6300b9160 0x7fe6300b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe634dc6640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c004800 0x7fe6300ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62ffff640 1 -- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c004800 msgr2=0x7fe6300ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62ffff640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c004800 0x7fe6300ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62ffff640 1 -- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6300b9160 msgr2=0x7fe6300b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62ffff640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6300b9160 0x7fe6300b95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62ffff640 1 -- 172.21.15.66:0/2205881633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6300b80c0 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62ffff640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 0x7fe630162660 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe62002a7c0 tx=0x7fe620003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620037050 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe620038040 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6300b83a0 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6200078d0 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.566+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6300b8960 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.567+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63006a220 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.568+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe620045020 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.568+0000 7fe62d7fa640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe610076300 0x7fe6100787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.568+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7fe6200b7740 con 0x7fe6301621e0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.569+0000 7fe634dc6640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe610076300 0x7fe6100787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.569+0000 7fe634dc6640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe610076300 0x7fe6100787c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe628001050 tx=0x7fe628009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:06.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.573+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe6200811c0 con 0x7fe6301621e0 2024-05-10T11:18:06.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.766+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe63006e4d0 con 0x7fe6301621e0 2024-05-10T11:18:06.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.767+0000 7fe62d7fa640 1 -- 172.21.15.66:0/2205881633 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+13422 (secure 0 0 0) 0x7fe620080ac0 con 0x7fe6301621e0 2024-05-10T11:18:06.766 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:06.767 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":80,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:18:05.436713+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6834/629825148":"2024-05-11T11:18:02.426956+0000","172.21.15.66:6835/629825148":"2024-05-11T11:18:02.426956+0000","172.21.15.66:6835/1361798984":"2024-05-11T11:16:47.934721+0000","172.21.15.66:6834/1361798984":"2024-05-11T11:16:47.934721+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:18:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe610076300 msgr2=0x7fe6100787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe610076300 0x7fe6100787c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe628001050 tx=0x7fe628009040 comp rx=0 tx=0).stop 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 msgr2=0x7fe630162660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 0x7fe630162660 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe62002a7c0 tx=0x7fe620003a70 comp rx=0 tx=0).stop 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 shutdown_connections 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe610076300 0x7fe6100787c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6300b9160 0x7fe6300b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6301621e0 0x7fe630162660 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 --2- 172.21.15.66:0/2205881633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c004800 0x7fe6300ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 >> 172.21.15.66:0/2205881633 conn(0x7fe6300d5130 msgr2=0x7fe63006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 shutdown_connections 2024-05-10T11:18:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.769+0000 7fe63702a640 1 -- 172.21.15.66:0/2205881633 wait complete. 2024-05-10T11:18:06.780 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:18:06.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:18:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.887+0000 7f6789766640 1 Processor -- start 2024-05-10T11:18:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.887+0000 7f6789766640 1 -- start start 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6789766640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f67840d2d10 0x7f67840d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6789766640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67840d31a0 con 0x7f67840d3df0 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6789766640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67840d41d0 con 0x7f67840d1f50 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6789766640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f67840cfd50 con 0x7f67840d2d10 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f67827fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f67840d2d10 0x7f67840d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6782ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f67840d3df0 0x7f67840b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52996/0 (socket says 172.21.15.66:52996) 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6782ffd640 1 -- 172.21.15.66:0/2905826229 learned_addr learned my addr 172.21.15.66:0/2905826229 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f67827fc640 1 -- 172.21.15.66:0/2905826229 >> v1:172.21.15.190:6789/0 conn(0x7f67840d1f50 legacy=0x7f67840d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f67827fc640 1 -- 172.21.15.66:0/2905826229 >> v1:172.21.15.66:6789/0 conn(0x7f67840d3df0 legacy=0x7f67840b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f67827fc640 1 -- 172.21.15.66:0/2905826229 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67840b54f0 con 0x7f67840d2d10 2024-05-10T11:18:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.888+0000 7f6781ffb640 1 -- 172.21.15.66:0/2905826229 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793076285 0 0) 0x7f67840d31a0 con 0x7f67840d3df0 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.889+0000 7f67827fc640 1 --2- 172.21.15.66:0/2905826229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f67840d1a10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f67780097a0 tx=0x7f677802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75415ca0574ca86a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.889+0000 7f6781ffb640 1 -- 172.21.15.66:0/2905826229 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778037070 con 0x7f67840d2d10 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.889+0000 7f6781ffb640 1 -- 172.21.15.66:0/2905826229 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6778032440 con 0x7f67840d2d10 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.889+0000 7f6781ffb640 1 -- 172.21.15.66:0/2905826229 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778032810 con 0x7f67840d2d10 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 -- 172.21.15.66:0/2905826229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 msgr2=0x7f67840d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 --2- 172.21.15.66:0/2905826229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f67840d1a10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f67780097a0 tx=0x7f677802a230 comp rx=0 tx=0).stop 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 -- 172.21.15.66:0/2905826229 shutdown_connections 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 --2- 172.21.15.66:0/2905826229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f67840d1a10 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 -- 172.21.15.66:0/2905826229 >> 172.21.15.66:0/2905826229 conn(0x7f678409e450 msgr2=0x7f67840d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 -- 172.21.15.66:0/2905826229 shutdown_connections 2024-05-10T11:18:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.890+0000 7f6789766640 1 -- 172.21.15.66:0/2905826229 wait complete. 2024-05-10T11:18:06.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.891+0000 7f6789766640 1 Processor -- start 2024-05-10T11:18:06.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.891+0000 7f6789766640 1 -- start start 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6789766640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67840d1f50 0x7f678414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6789766640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f678406df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6789766640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67840d3df0 0x7f678406e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6789766640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f67840d2380 con 0x7f67840d2d10 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6789766640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f67840b5d90 con 0x7f67840d3df0 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6789766640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67840b5ab0 con 0x7f67840d1f50 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f678406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f678406df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48764/0 (socket says 172.21.15.66:48764) 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 -- 172.21.15.66:0/1539930782 learned_addr learned my addr 172.21.15.66:0/1539930782 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f6782ffd640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67840d1f50 0x7f678414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67837fe640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67840d3df0 0x7f678406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 -- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67840d1f50 msgr2=0x7f678414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67840d1f50 0x7f678414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 -- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67840d3df0 msgr2=0x7f678406e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67840d3df0 0x7f678406e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.892+0000 7f67827fc640 1 -- 172.21.15.66:0/1539930782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67840ba310 con 0x7f67840d2d10 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.893+0000 7f67827fc640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f678406df10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f67780098c0 tx=0x7f67780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.893+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778037040 con 0x7f67840d2d10 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.893+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6778042070 con 0x7f67840d2d10 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.893+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67840ba5f0 con 0x7f67840d2d10 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.893+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778030a70 con 0x7f67840d2d10 2024-05-10T11:18:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.893+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67840babb0 con 0x7f67840d2d10 2024-05-10T11:18:06.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.894+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6784069560 con 0x7f67840d2d10 2024-05-10T11:18:06.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.894+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6778030c10 con 0x7f67840d2d10 2024-05-10T11:18:06.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.895+0000 7f676b7fe640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67700762d0 0x7f6770078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:06.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.895+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7f67780b7ff0 con 0x7f67840d2d10 2024-05-10T11:18:06.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.895+0000 7f6782ffd640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67700762d0 0x7f6770078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:06.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.896+0000 7f6782ffd640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67700762d0 0x7f6770078790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6774000f60 tx=0x7f6774007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:06.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:06.899+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6784069560 con 0x7f67840d2d10 2024-05-10T11:18:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.090+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f678406a220 con 0x7f67840d2d10 2024-05-10T11:18:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.090+0000 7f676b7fe640 1 -- 172.21.15.66:0/1539930782 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f67780819e0 con 0x7f67840d2d10 2024-05-10T11:18:07.090 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67700762d0 msgr2=0x7f6770078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67700762d0 0x7f6770078790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6774000f60 tx=0x7f6774007d00 comp rx=0 tx=0).stop 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 msgr2=0x7f678406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f678406df10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f67780098c0 tx=0x7f67780046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 shutdown_connections 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67700762d0 0x7f6770078790 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67840d3df0 0x7f678406e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67840d2d10 0x7f678406df10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 --2- 172.21.15.66:0/1539930782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67840d1f50 0x7f678414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 >> 172.21.15.66:0/1539930782 conn(0x7f678409e450 msgr2=0x7f67840b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:07.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 shutdown_connections 2024-05-10T11:18:07.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.092+0000 7f6789766640 1 -- 172.21.15.66:0/1539930782 wait complete. 2024-05-10T11:18:07.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-05-10T11:18:07.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.208+0000 7f83ce2f8640 1 Processor -- start 2024-05-10T11:18:07.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.208+0000 7f83ce2f8640 1 -- start start 2024-05-10T11:18:07.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83ce2f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c81598c0 0x7f83c806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:07.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83ce2f8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83c806ec40 0x7f83c80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:07.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83ce2f8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c806f1c0 con 0x7f83c80c71c0 2024-05-10T11:18:07.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83ce2f8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f83c806f4a0 con 0x7f83c806ec40 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83ce2f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f83c806f780 con 0x7f83c81598c0 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83c77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83c806ec40 0x7f83c80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83cc895640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f83c80c71c0 0x7f83c815fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:53010/0 (socket says 172.21.15.66:53010) 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.209+0000 7f83cc895640 1 -- 172.21.15.66:0/26657672 learned_addr learned my addr 172.21.15.66:0/26657672 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c7fff640 1 --2- 172.21.15.66:0/26657672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c81598c0 0x7f83c806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c77fe640 1 -- 172.21.15.66:0/26657672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c81598c0 msgr2=0x7f83c806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c77fe640 1 --2- 172.21.15.66:0/26657672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c81598c0 0x7f83c806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c77fe640 1 -- 172.21.15.66:0/26657672 >> v1:172.21.15.66:6789/0 conn(0x7f83c80c71c0 legacy=0x7f83c815fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c6ffd640 1 -- 172.21.15.66:0/26657672 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281088124 0 0) 0x7f83c806f1c0 con 0x7f83c80c71c0 2024-05-10T11:18:07.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c77fe640 1 -- 172.21.15.66:0/26657672 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c806fa60 con 0x7f83c806ec40 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.210+0000 7f83c77fe640 1 --2- 172.21.15.66:0/26657672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c806ec40 0x7f83c80c6c80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f78a786969b466e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83c6ffd640 1 -- 172.21.15.66:0/26657672 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc037070 con 0x7f83c806ec40 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83c6ffd640 1 -- 172.21.15.66:0/26657672 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc032440 con 0x7f83c806ec40 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83c6ffd640 1 -- 172.21.15.66:0/26657672 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc032810 con 0x7f83c806ec40 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 -- 172.21.15.66:0/26657672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c806ec40 msgr2=0x7f83c80c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/26657672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c806ec40 0x7f83c80c6c80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc02a180 comp rx=0 tx=0).stop 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 -- 172.21.15.66:0/26657672 shutdown_connections 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/26657672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c806ec40 0x7f83c80c6c80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/26657672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c81598c0 0x7f83c806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 -- 172.21.15.66:0/26657672 >> 172.21.15.66:0/26657672 conn(0x7f83c80b2900 msgr2=0x7f83c80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 -- 172.21.15.66:0/26657672 shutdown_connections 2024-05-10T11:18:07.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.211+0000 7f83ce2f8640 1 -- 172.21.15.66:0/26657672 wait complete. 2024-05-10T11:18:07.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.212+0000 7f83ce2f8640 1 Processor -- start 2024-05-10T11:18:07.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 -- start start 2024-05-10T11:18:07.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c806ec40 0x7f83c80cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:07.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 0x7f83c814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:07.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83c81598c0 0x7f83c80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:07.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8159ca0 con 0x7f83c80c71c0 2024-05-10T11:18:07.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f83c815c6e0 con 0x7f83c81598c0 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83ce2f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f83c8159e20 con 0x7f83c806ec40 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.213+0000 7f83c77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 0x7f83c814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 0x7f83c814c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48782/0 (socket says 172.21.15.66:48782) 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 -- 172.21.15.66:0/610908195 learned_addr learned my addr 172.21.15.66:0/610908195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c7fff640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c806ec40 0x7f83c80cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83cc895640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83c81598c0 0x7f83c80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 -- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c806ec40 msgr2=0x7f83c80cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c806ec40 0x7f83c80cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 -- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83c81598c0 msgr2=0x7f83c80b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83c81598c0 0x7f83c80b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 -- 172.21.15.66:0/610908195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c81542f0 con 0x7f83c80c71c0 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83cc895640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83c81598c0 0x7f83c80b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c77fe640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 0x7f83c814c990 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc037050 con 0x7f83c80c71c0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc038040 con 0x7f83c80c71c0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c81545b0 con 0x7f83c80c71c0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc004490 con 0x7f83c80c71c0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.214+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c8154b70 con 0x7f83c80c71c0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.215+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c806a220 con 0x7f83c80c71c0 2024-05-10T11:18:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.216+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83bc03c6d0 con 0x7f83c80c71c0 2024-05-10T11:18:07.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.216+0000 7f83c4ff9640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83b40762d0 0x7f83b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:07.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.216+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7f83bc0b7f10 con 0x7f83c80c71c0 2024-05-10T11:18:07.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.217+0000 7f83c7fff640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83b40762d0 0x7f83b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:07.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.217+0000 7f83c7fff640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83b40762d0 0x7f83b4078790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009ad0 tx=0x7f83b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:07.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.221+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f83bc081990 con 0x7f83c80c71c0 2024-05-10T11:18:07.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:07.488+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f83c80d1530 con 0x7f83c80c71c0 2024-05-10T11:18:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.448+0000 7f83c4ff9640 1 -- 172.21.15.66:0/610908195 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v276) ==== 170+0+0 (secure 0 0 0) 0x7f83bc081290 con 0x7f83c80c71c0 2024-05-10T11:18:08.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.451+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83b40762d0 msgr2=0x7f83b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.451+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83b40762d0 0x7f83b4078790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009ad0 tx=0x7f83b8008040 comp rx=0 tx=0).stop 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.451+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 msgr2=0x7f83c814c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.451+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 0x7f83c814c990 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc0046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 shutdown_connections 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83b40762d0 0x7f83b4078790 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83c81598c0 0x7f83c80b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c80c71c0 0x7f83c814c990 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 --2- 172.21.15.66:0/610908195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c806ec40 0x7f83c80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 >> 172.21.15.66:0/610908195 conn(0x7f83c80b2900 msgr2=0x7f83c80b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 shutdown_connections 2024-05-10T11:18:08.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.452+0000 7f83ce2f8640 1 -- 172.21.15.66:0/610908195 wait complete. 2024-05-10T11:18:08.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:18:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.579+0000 7feff9e85640 1 Processor -- start 2024-05-10T11:18:08.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.579+0000 7feff9e85640 1 -- start start 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff9e85640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162900 0x7feff40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff9e85640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feff4162ce0 0x7feff40b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff9e85640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff40d4190 con 0x7feff40d3950 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff9e85640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7feff40cfc40 con 0x7feff4162ce0 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff9e85640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feff40d3eb0 con 0x7feff4162900 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feff4162ce0 0x7feff40b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feff4162ce0 0x7feff40b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48784/0 (socket says 172.21.15.66:48784) 2024-05-10T11:18:08.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 -- 172.21.15.66:0/1525281993 learned_addr learned my addr 172.21.15.66:0/1525281993 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff37fe640 1 --2- 172.21.15.66:0/1525281993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162900 0x7feff40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 -- 172.21.15.66:0/1525281993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162900 msgr2=0x7feff40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 --2- 172.21.15.66:0/1525281993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162900 0x7feff40d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 -- 172.21.15.66:0/1525281993 >> v1:172.21.15.190:6789/0 conn(0x7feff40d3950 legacy=0x7feff40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.580+0000 7feff2ffd640 1 -- 172.21.15.66:0/1525281993 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff40cfee0 con 0x7feff4162ce0 2024-05-10T11:18:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.581+0000 7feff2ffd640 1 --2- 172.21.15.66:0/1525281993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff4162ce0 0x7feff40b48e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009870 tx=0x7fefe802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe2068c78b39e9e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.581+0000 7feff27fc640 1 -- 172.21.15.66:0/1525281993 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8037070 con 0x7feff4162ce0 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.581+0000 7feff27fc640 1 -- 172.21.15.66:0/1525281993 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe8032440 con 0x7feff4162ce0 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.581+0000 7feff27fc640 1 -- 172.21.15.66:0/1525281993 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8032810 con 0x7feff4162ce0 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 -- 172.21.15.66:0/1525281993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff4162ce0 msgr2=0x7feff40b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 --2- 172.21.15.66:0/1525281993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff4162ce0 0x7feff40b48e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009870 tx=0x7fefe802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 -- 172.21.15.66:0/1525281993 shutdown_connections 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 --2- 172.21.15.66:0/1525281993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff4162ce0 0x7feff40b48e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 --2- 172.21.15.66:0/1525281993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162900 0x7feff40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 -- 172.21.15.66:0/1525281993 >> 172.21.15.66:0/1525281993 conn(0x7feff409e430 msgr2=0x7feff40d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 -- 172.21.15.66:0/1525281993 shutdown_connections 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.582+0000 7feff9e85640 1 -- 172.21.15.66:0/1525281993 wait complete. 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.583+0000 7feff9e85640 1 Processor -- start 2024-05-10T11:18:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.583+0000 7feff9e85640 1 -- start start 2024-05-10T11:18:08.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff9e85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 0x7feff40b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff9e85640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feff4162900 0x7feff415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff9e85640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162ce0 0x7feff415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff9e85640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feff40b4300 con 0x7feff40d3950 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff9e85640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feff40b4180 con 0x7feff4162900 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff9e85640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feff40d10d0 con 0x7feff4162ce0 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 0x7feff40b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 0x7feff40b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48788/0 (socket says 172.21.15.66:48788) 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff37fe640 1 -- 172.21.15.66:0/486182373 learned_addr learned my addr 172.21.15.66:0/486182373 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff2ffd640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feff4162900 0x7feff415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.584+0000 7feff3fff640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162ce0 0x7feff415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff37fe640 1 -- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162ce0 msgr2=0x7feff415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff37fe640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162ce0 0x7feff415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff37fe640 1 -- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feff4162900 msgr2=0x7feff415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff37fe640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feff4162900 0x7feff415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff37fe640 1 -- 172.21.15.66:0/486182373 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff40c8bf0 con 0x7feff40d3950 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff37fe640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 0x7feff40b59f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fefe400e9b0 tx=0x7fefe400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4017070 con 0x7feff40d3950 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe400c9a0 con 0x7feff40d3950 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff40cdd90 con 0x7feff40d3950 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe400cd90 con 0x7feff40d3950 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.585+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff40ce350 con 0x7feff40d3950 2024-05-10T11:18:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.586+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff406a220 con 0x7feff40d3950 2024-05-10T11:18:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.587+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fefe401a070 con 0x7feff40d3950 2024-05-10T11:18:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.587+0000 7fefdbfff640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fefe00762d0 0x7fefe0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.587+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7fefe4097470 con 0x7feff40d3950 2024-05-10T11:18:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.588+0000 7feff2ffd640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fefe00762d0 0x7fefe0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.588+0000 7feff2ffd640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fefe00762d0 0x7fefe0078790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fefe8034000 tx=0x7fefe802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.592+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fefe40608a0 con 0x7feff40d3950 2024-05-10T11:18:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.783+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7feff409e840 con 0x7feff40d3950 2024-05-10T11:18:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.786+0000 7fefdbfff640 1 -- 172.21.15.66:0/486182373 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fefe4064ba0 con 0x7feff40d3950 2024-05-10T11:18:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fefe00762d0 msgr2=0x7fefe0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fefe00762d0 0x7fefe0078790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fefe8034000 tx=0x7fefe802e000 comp rx=0 tx=0).stop 2024-05-10T11:18:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 msgr2=0x7feff40b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 0x7feff40b59f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fefe400e9b0 tx=0x7fefe400ee70 comp rx=0 tx=0).stop 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 shutdown_connections 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fefe00762d0 0x7fefe0078790 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feff4162ce0 0x7feff415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feff4162900 0x7feff415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 --2- 172.21.15.66:0/486182373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feff40d3950 0x7feff40b59f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 >> 172.21.15.66:0/486182373 conn(0x7feff409e430 msgr2=0x7feff4161720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 shutdown_connections 2024-05-10T11:18:08.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:08.788+0000 7feff9e85640 1 -- 172.21.15.66:0/486182373 wait complete. 2024-05-10T11:18:08.798 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:18:08.799 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:18:08.838 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:18:08.899 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:18:08.900 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:18:08.900 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:08.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:18:08.916 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:18:08.916 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:08.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:18:08.935 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:18:08.935 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:08.973 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:18:08.973 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:18:08.973 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:08.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:18:08.992 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:18:08.993 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:09.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.117+0000 7fdc09ebd640 1 Processor -- start 2024-05-10T11:18:09.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.117+0000 7fdc09ebd640 1 -- start start 2024-05-10T11:18:09.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc09ebd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdc04162940 0x7fdc040b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc09ebd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc040d3d80 0x7fdc040d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc09ebd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc040d2d20 con 0x7fdc040d59d0 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc09ebd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fdc04162d20 con 0x7fdc04162940 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc09ebd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdc040d3000 con 0x7fdc040d3d80 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdc04162940 0x7fdc040b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdc04162940 0x7fdc040b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48802/0 (socket says 172.21.15.66:48802) 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 -- 172.21.15.66:0/3583017458 learned_addr learned my addr 172.21.15.66:0/3583017458 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc03fff640 1 --2- 172.21.15.66:0/3583017458 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc040d3d80 0x7fdc040d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 -- 172.21.15.66:0/3583017458 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc040d3d80 msgr2=0x7fdc040d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 --2- 172.21.15.66:0/3583017458 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc040d3d80 0x7fdc040d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 -- 172.21.15.66:0/3583017458 >> v1:172.21.15.190:6789/0 conn(0x7fdc040d59d0 legacy=0x7fdc040d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.118+0000 7fdc037fe640 1 -- 172.21.15.66:0/3583017458 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc040d32e0 con 0x7fdc04162940 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.119+0000 7fdc037fe640 1 --2- 172.21.15.66:0/3583017458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc04162940 0x7fdc040b5e20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009870 tx=0x7fdbf402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f693f16c7b521ded server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:09.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.119+0000 7fdc027fc640 1 -- 172.21.15.66:0/3583017458 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4037070 con 0x7fdc04162940 2024-05-10T11:18:09.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.119+0000 7fdc027fc640 1 -- 172.21.15.66:0/3583017458 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf4032440 con 0x7fdc04162940 2024-05-10T11:18:09.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.119+0000 7fdc027fc640 1 -- 172.21.15.66:0/3583017458 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4032810 con 0x7fdc04162940 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 -- 172.21.15.66:0/3583017458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc04162940 msgr2=0x7fdc040b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/3583017458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc04162940 0x7fdc040b5e20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009870 tx=0x7fdbf402a180 comp rx=0 tx=0).stop 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 -- 172.21.15.66:0/3583017458 shutdown_connections 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/3583017458 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc040d3d80 0x7fdc040d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/3583017458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc04162940 0x7fdc040b5e20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 -- 172.21.15.66:0/3583017458 >> 172.21.15.66:0/3583017458 conn(0x7fdc0409e380 msgr2=0x7fdc040d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 -- 172.21.15.66:0/3583017458 shutdown_connections 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.120+0000 7fdc09ebd640 1 -- 172.21.15.66:0/3583017458 wait complete. 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.121+0000 7fdc09ebd640 1 Processor -- start 2024-05-10T11:18:09.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.121+0000 7fdc09ebd640 1 -- start start 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc09ebd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 0x7fdc040ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc09ebd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc040d59d0 0x7fdc041f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc09ebd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc04162940 0x7fdc04159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc09ebd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc040d2390 con 0x7fdc040d3d80 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc09ebd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdc040cfc50 con 0x7fdc040d59d0 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc09ebd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdc040d2510 con 0x7fdc04162940 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 0x7fdc040ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 0x7fdc040ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48806/0 (socket says 172.21.15.66:48806) 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 -- 172.21.15.66:0/1632297274 learned_addr learned my addr 172.21.15.66:0/1632297274 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc02ffd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc040d59d0 0x7fdc041f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc03fff640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc04162940 0x7fdc04159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 -- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc04162940 msgr2=0x7fdc04159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc04162940 0x7fdc04159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 -- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc040d59d0 msgr2=0x7fdc041f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc040d59d0 0x7fdc041f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.122+0000 7fdc037fe640 1 -- 172.21.15.66:0/1632297274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc041f9240 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.123+0000 7fdc037fe640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 0x7fdc040ceb60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009870 tx=0x7fdbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.123+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4041020 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.123+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf40306c0 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.123+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc041f9520 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.123+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4037040 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.123+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0415a1f0 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.124+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0406a220 con 0x7fdc040d3d80 2024-05-10T11:18:09.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.125+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdbf4044020 con 0x7fdc040d3d80 2024-05-10T11:18:09.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.125+0000 7fdbebfff640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdbf00762d0 0x7fdbf0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.125+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7fdbf40b7cd0 con 0x7fdc040d3d80 2024-05-10T11:18:09.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.125+0000 7fdc02ffd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdbf00762d0 0x7fdbf0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.126+0000 7fdc02ffd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdbf00762d0 0x7fdbf0078790 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdc040b44c0 tx=0x7fdbf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:09.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.129+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdbf404b030 con 0x7fdc040d3d80 2024-05-10T11:18:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.358+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc040d2730 con 0x7fdc040d3d80 2024-05-10T11:18:09.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.358+0000 7fdbebfff640 1 -- 172.21.15.66:0/1632297274 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+3872 (secure 0 0 0) 0x7fdbf4081750 con 0x7fdc040d3d80 2024-05-10T11:18:09.357 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:09.358 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/201085852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":201085852},{"type":"v1","addr":"172.21.15.190:6836","nonce":201085852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3923458119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3923458119},{"type":"v1","addr":"172.21.15.66:6833","nonce":3923458119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2969121362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2969121362},{"type":"v1","addr":"172.21.15.190:6837","nonce":2969121362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1438909937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1438909937},{"type":"v1","addr":"172.21.15.66:6835","nonce":1438909937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[]} 2024-05-10T11:18:09.358 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 56 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdbf00762d0 msgr2=0x7fdbf0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdbf00762d0 0x7fdbf0078790 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdc040b44c0 tx=0x7fdbf8009040 comp rx=0 tx=0).stop 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 msgr2=0x7fdc040ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 0x7fdc040ceb60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009870 tx=0x7fdbf40046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 shutdown_connections 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdbf00762d0 0x7fdbf0078790 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc04162940 0x7fdc04159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc040d59d0 0x7fdc041f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 --2- 172.21.15.66:0/1632297274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc040d3d80 0x7fdc040ceb60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 >> 172.21.15.66:0/1632297274 conn(0x7fdc0409e380 msgr2=0x7fdc040b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:09.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 shutdown_connections 2024-05-10T11:18:09.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.360+0000 7fdc09ebd640 1 -- 172.21.15.66:0/1632297274 wait complete. 2024-05-10T11:18:09.371 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:18:09.371 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:18:09.371 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:18:09.372 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:18:09.372 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:18:09.372 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:18:09.372 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:18:09.372 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:18:09.372 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:18:09.372 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:18:09.373 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:18:09.373 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:18:09.373 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:18:09.373 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:18:09.373 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:18:09.373 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:18:09.381 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:18:09.381 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:18:09.382 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:18:09.382 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:18:09.384 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:18:09.384 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:18:09.385 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:18:09.385 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:18:09.424 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:18:09.425 DEBUG:teuthology.parallel:result is None 2024-05-10T11:18:09.426 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:18:09.426 DEBUG:teuthology.parallel:result is None 2024-05-10T11:18:09.427 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:18:09.427 DEBUG:teuthology.parallel:result is None 2024-05-10T11:18:09.427 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:18:09.428 DEBUG:teuthology.parallel:result is None 2024-05-10T11:18:09.428 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:18:09.504 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:18:09.505 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:18:09.511 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:18:09.511 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:18:09.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.539+0000 7efc724d1640 1 Processor -- start 2024-05-10T11:18:09.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.539+0000 7efc724d1640 1 -- start start 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc724d1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efc6c15f3b0 0x7efc6c0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc724d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efc6c15f790 0x7efc6c0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc724d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6c0d30b0 con 0x7efc6c0d5d30 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc724d1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7efc6c0d3390 con 0x7efc6c15f3b0 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc724d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efc6c0c8c80 con 0x7efc6c15f790 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efc6c15f3b0 0x7efc6c0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efc6c15f3b0 0x7efc6c0d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48850/0 (socket says 172.21.15.66:48850) 2024-05-10T11:18:09.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 -- 172.21.15.66:0/1984307333 learned_addr learned my addr 172.21.15.66:0/1984307333 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:09.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6b7fe640 1 --2- 172.21.15.66:0/1984307333 >> v2:172.21.15.190:3300/0 conn(0x7efc6c15f790 0x7efc6c0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 -- 172.21.15.66:0/1984307333 >> v2:172.21.15.190:3300/0 conn(0x7efc6c15f790 msgr2=0x7efc6c0d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:09.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 --2- 172.21.15.66:0/1984307333 >> v2:172.21.15.190:3300/0 conn(0x7efc6c15f790 0x7efc6c0d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 -- 172.21.15.66:0/1984307333 >> v1:172.21.15.190:6789/0 conn(0x7efc6c0d5d30 legacy=0x7efc6c0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.540+0000 7efc6bfff640 1 -- 172.21.15.66:0/1984307333 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c0c8f60 con 0x7efc6c15f3b0 2024-05-10T11:18:09.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.541+0000 7efc6bfff640 1 --2- 172.21.15.66:0/1984307333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c15f3b0 0x7efc6c0d36f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0c8c00 tx=0x7efc5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b45fb51b1d94ed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.541+0000 7efc6affd640 1 -- 172.21.15.66:0/1984307333 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c037070 con 0x7efc6c15f3b0 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.541+0000 7efc6affd640 1 -- 172.21.15.66:0/1984307333 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c032440 con 0x7efc6c15f3b0 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.541+0000 7efc6affd640 1 -- 172.21.15.66:0/1984307333 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c032810 con 0x7efc6c15f3b0 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 -- 172.21.15.66:0/1984307333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c15f3b0 msgr2=0x7efc6c0d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 --2- 172.21.15.66:0/1984307333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c15f3b0 0x7efc6c0d36f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0c8c00 tx=0x7efc5c02a270 comp rx=0 tx=0).stop 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 -- 172.21.15.66:0/1984307333 shutdown_connections 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 --2- 172.21.15.66:0/1984307333 >> v2:172.21.15.190:3300/0 conn(0x7efc6c15f790 0x7efc6c0d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 --2- 172.21.15.66:0/1984307333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c15f3b0 0x7efc6c0d36f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 -- 172.21.15.66:0/1984307333 >> 172.21.15.66:0/1984307333 conn(0x7efc6c0d5130 msgr2=0x7efc6c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 -- 172.21.15.66:0/1984307333 shutdown_connections 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.542+0000 7efc724d1640 1 -- 172.21.15.66:0/1984307333 wait complete. 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.543+0000 7efc724d1640 1 Processor -- start 2024-05-10T11:18:09.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 -- start start 2024-05-10T11:18:09.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 0x7efc6c0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc6c15f3b0 0x7efc6c1f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc6c1f5980 0x7efc6c1f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c0d0e60 con 0x7efc6c0d5d30 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c0d0ce0 con 0x7efc6c15f3b0 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc724d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efc6c0d0fe0 con 0x7efc6c1f5980 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 0x7efc6c0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 0x7efc6c0d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48862/0 (socket says 172.21.15.66:48862) 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc6bfff640 1 -- 172.21.15.66:0/2902006887 learned_addr learned my addr 172.21.15.66:0/2902006887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc70a6e640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc6c1f5980 0x7efc6c1f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.544+0000 7efc6b7fe640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc6c15f3b0 0x7efc6c1f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc6bfff640 1 -- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc6c1f5980 msgr2=0x7efc6c1f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc6bfff640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc6c1f5980 0x7efc6c1f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc6bfff640 1 -- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc6c15f3b0 msgr2=0x7efc6c1f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc6bfff640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc6c15f3b0 0x7efc6c1f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc6bfff640 1 -- 172.21.15.66:0/2902006887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c1f8f40 con 0x7efc6c0d5d30 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc6bfff640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 0x7efc6c0d15e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000c00 tx=0x7efc5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c037040 con 0x7efc6c0d5d30 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c042070 con 0x7efc6c0d5d30 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c1f4ea0 con 0x7efc6c0d5d30 2024-05-10T11:18:09.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c030880 con 0x7efc6c0d5d30 2024-05-10T11:18:09.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.545+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c1f5460 con 0x7efc6c0d5d30 2024-05-10T11:18:09.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.546+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6c06a220 con 0x7efc6c0d5d30 2024-05-10T11:18:09.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.547+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc5c030a20 con 0x7efc6c0d5d30 2024-05-10T11:18:09.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.547+0000 7efc68ff9640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efc580762d0 0x7efc58078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:09.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.547+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5421+0+0 (secure 0 0 0) 0x7efc5c0b7be0 con 0x7efc6c0d5d30 2024-05-10T11:18:09.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.548+0000 7efc6b7fe640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efc580762d0 0x7efc58078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:09.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.548+0000 7efc6b7fe640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efc580762d0 0x7efc58078790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efc6c1552e0 tx=0x7efc60009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:09.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.552+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efc5c081010 con 0x7efc6c0d5d30 2024-05-10T11:18:09.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:09.758+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efc6c0d2590 con 0x7efc6c0d5d30 2024-05-10T11:18:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.466+0000 7efc68ff9640 1 -- 172.21.15.66:0/2902006887 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) ==== 97+0+0 (secure 0 0 0) 0x7efc5c085310 con 0x7efc6c0d5d30 2024-05-10T11:18:10.466 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efc580762d0 msgr2=0x7efc58078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efc580762d0 0x7efc58078790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efc6c1552e0 tx=0x7efc60009190 comp rx=0 tx=0).stop 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 msgr2=0x7efc6c0d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 0x7efc6c0d15e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000c00 tx=0x7efc5c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 shutdown_connections 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efc580762d0 0x7efc58078790 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc6c1f5980 0x7efc6c1f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc6c15f3b0 0x7efc6c1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 --2- 172.21.15.66:0/2902006887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc6c0d5d30 0x7efc6c0d15e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.469+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 >> 172.21.15.66:0/2902006887 conn(0x7efc6c0d5130 msgr2=0x7efc6c0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.470+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 shutdown_connections 2024-05-10T11:18:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.470+0000 7efc724d1640 1 -- 172.21.15.66:0/2902006887 wait complete. 2024-05-10T11:18:10.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:18:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.595+0000 7f321acb4640 1 Processor -- start 2024-05-10T11:18:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.595+0000 7f321acb4640 1 -- start start 2024-05-10T11:18:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f321acb4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32141598c0 0x7f321406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f321acb4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f321406ec40 0x7f32140c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f321acb4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321406f1c0 con 0x7f32140c71c0 2024-05-10T11:18:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f321acb4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f321406f4a0 con 0x7f321406ec40 2024-05-10T11:18:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f321acb4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f321406f780 con 0x7f32141598c0 2024-05-10T11:18:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f321406ec40 0x7f32140c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f321406ec40 0x7f32140c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48868/0 (socket says 172.21.15.66:48868) 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 -- 172.21.15.66:0/3031230267 learned_addr learned my addr 172.21.15.66:0/3031230267 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3219251640 1 --1- 172.21.15.66:0/3031230267 >> v1:172.21.15.66:6789/0 conn(0x7f32140c71c0 0x7f321415fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:53016/0 (socket says 172.21.15.66:53016) 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3218a50640 1 --2- 172.21.15.66:0/3031230267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32141598c0 0x7f321406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 -- 172.21.15.66:0/3031230267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32141598c0 msgr2=0x7f321406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 --2- 172.21.15.66:0/3031230267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32141598c0 0x7f321406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 -- 172.21.15.66:0/3031230267 >> v1:172.21.15.66:6789/0 conn(0x7f32140c71c0 legacy=0x7f321415fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.596+0000 7f3213fff640 1 -- 172.21.15.66:0/3031230267 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321406fa60 con 0x7f321406ec40 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.597+0000 7f3213fff640 1 --2- 172.21.15.66:0/3031230267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f321406ec40 0x7f32140c6c80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f320000bb10 tx=0x7f320002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa72f9329ac39c20 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.597+0000 7f32137fe640 1 -- 172.21.15.66:0/3031230267 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200036020 con 0x7f321406ec40 2024-05-10T11:18:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.597+0000 7f32137fe640 1 -- 172.21.15.66:0/3031230267 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3200032820 con 0x7f321406ec40 2024-05-10T11:18:10.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.597+0000 7f32137fe640 1 -- 172.21.15.66:0/3031230267 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200032bf0 con 0x7f321406ec40 2024-05-10T11:18:10.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.597+0000 7f321acb4640 1 -- 172.21.15.66:0/3031230267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f321406ec40 msgr2=0x7f32140c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.597+0000 7f321acb4640 1 --2- 172.21.15.66:0/3031230267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f321406ec40 0x7f32140c6c80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f320000bb10 tx=0x7f320002c920 comp rx=0 tx=0).stop 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.598+0000 7f321acb4640 1 -- 172.21.15.66:0/3031230267 shutdown_connections 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.598+0000 7f321acb4640 1 --2- 172.21.15.66:0/3031230267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f321406ec40 0x7f32140c6c80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.598+0000 7f321acb4640 1 --2- 172.21.15.66:0/3031230267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32141598c0 0x7f321406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.598+0000 7f321acb4640 1 -- 172.21.15.66:0/3031230267 >> 172.21.15.66:0/3031230267 conn(0x7f32140b2900 msgr2=0x7f32140b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.598+0000 7f321acb4640 1 -- 172.21.15.66:0/3031230267 shutdown_connections 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.598+0000 7f321acb4640 1 -- 172.21.15.66:0/3031230267 wait complete. 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.599+0000 7f321acb4640 1 Processor -- start 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.599+0000 7f321acb4640 1 -- start start 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f321acb4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f321406ec40 0x7f32140cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f321acb4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32140c71c0 0x7f3214072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f321acb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 0x7f3214155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f321acb4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3214159ca0 con 0x7f32141598c0 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f321acb4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f321415c6e0 con 0x7f32140c71c0 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f321acb4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3214159e20 con 0x7f321406ec40 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 0x7f3214155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 0x7f3214155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48870/0 (socket says 172.21.15.66:48870) 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 -- 172.21.15.66:0/450524384 learned_addr learned my addr 172.21.15.66:0/450524384 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3213fff640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32140c71c0 0x7f3214072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3218a50640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f321406ec40 0x7f32140cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 -- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f321406ec40 msgr2=0x7f32140cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f321406ec40 0x7f32140cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 -- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32140c71c0 msgr2=0x7f3214072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32140c71c0 0x7f3214072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 -- 172.21.15.66:0/450524384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32140ae230 con 0x7f32141598c0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3213fff640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32140c71c0 0x7f3214072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.600+0000 7f3219251640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 0x7f3214155e00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c780 tx=0x7f320c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.601+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c017070 con 0x7f32141598c0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.601+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c00a640 con 0x7f32141598c0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.601+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3214071f90 con 0x7f32141598c0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.601+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c00aa30 con 0x7f32141598c0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.601+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32140cdf80 con 0x7f32141598c0 2024-05-10T11:18:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.602+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321406a220 con 0x7f32141598c0 2024-05-10T11:18:10.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.602+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f320c01a070 con 0x7f32141598c0 2024-05-10T11:18:10.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.603+0000 7f32117fa640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31f80762d0 0x7f31f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.603+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5249+0+0 (secure 0 0 0) 0x7f320c096920 con 0x7f32141598c0 2024-05-10T11:18:10.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.603+0000 7f3218a50640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31f80762d0 0x7f31f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.603+0000 7f3218a50640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31f80762d0 0x7f31f8078790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3208006fd0 tx=0x7f3208008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.607+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f320c05fe80 con 0x7f32141598c0 2024-05-10T11:18:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.872+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f32140b2670 con 0x7f32141598c0 2024-05-10T11:18:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.872+0000 7f32117fa640 1 -- 172.21.15.66:0/450524384 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f320c064180 con 0x7f32141598c0 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:18:10.872 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:18:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.875 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.877 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.878 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.878 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.878 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:18:10.878 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.879 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:18:10.881 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow r", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:18:10.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.883 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:18:10.884 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:10.885 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:18:10.886 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:18:10.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31f80762d0 msgr2=0x7f31f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31f80762d0 0x7f31f8078790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3208006fd0 tx=0x7f3208008040 comp rx=0 tx=0).stop 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 msgr2=0x7f3214155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 0x7f3214155e00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c780 tx=0x7f320c00cc40 comp rx=0 tx=0).stop 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 shutdown_connections 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f31f80762d0 0x7f31f8078790 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32141598c0 0x7f3214155e00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32140c71c0 0x7f3214072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 --2- 172.21.15.66:0/450524384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f321406ec40 0x7f32140cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 >> 172.21.15.66:0/450524384 conn(0x7f32140b2900 msgr2=0x7f32140b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 shutdown_connections 2024-05-10T11:18:10.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.874+0000 7f321acb4640 1 -- 172.21.15.66:0/450524384 wait complete. 2024-05-10T11:18:10.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:18:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.993+0000 7efdbeb9d640 1 Processor -- start 2024-05-10T11:18:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.993+0000 7efdbeb9d640 1 -- start start 2024-05-10T11:18:10.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbeb9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162750 0x7efdb80d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbeb9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efdb8162b30 0x7efdb80b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbeb9d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80b45f0 con 0x7efdb80d5cb0 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbeb9d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efdb80b4f20 con 0x7efdb8162b30 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbeb9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efdb80d0fe0 con 0x7efdb8162750 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbc939640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162750 0x7efdb80d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbd13a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efdb8162b30 0x7efdb80b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbd13a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efdb8162b30 0x7efdb80b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:45206/0 (socket says 172.21.15.66:45206) 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbd13a640 1 -- 172.21.15.66:0/1435907459 learned_addr learned my addr 172.21.15.66:0/1435907459 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdaffff640 1 --1- 172.21.15.66:0/1435907459 >> v1:172.21.15.190:6789/0 conn(0x7efdb80d5cb0 0x7efdb80d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:58798/0 (socket says 172.21.15.66:58798) 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbd13a640 1 -- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162750 msgr2=0x7efdb80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbd13a640 1 --2- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162750 0x7efdb80d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.994+0000 7efdbd13a640 1 -- 172.21.15.66:0/1435907459 >> v1:172.21.15.190:6789/0 conn(0x7efdb80d5cb0 legacy=0x7efdb80d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.995+0000 7efdbd13a640 1 -- 172.21.15.66:0/1435907459 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80b48d0 con 0x7efdb8162b30 2024-05-10T11:18:10.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.995+0000 7efdbd13a640 1 --2- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162b30 0x7efdb80b53b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009e50 tx=0x7efdb002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35080968714f420 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:10.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.995+0000 7efdaf7fe640 1 -- 172.21.15.66:0/1435907459 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0036070 con 0x7efdb8162b30 2024-05-10T11:18:10.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.995+0000 7efdaf7fe640 1 -- 172.21.15.66:0/1435907459 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0031600 con 0x7efdb8162b30 2024-05-10T11:18:10.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.995+0000 7efdaf7fe640 1 -- 172.21.15.66:0/1435907459 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb00319d0 con 0x7efdb8162b30 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 -- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162b30 msgr2=0x7efdb80b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162b30 0x7efdb80b53b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009e50 tx=0x7efdb002a680 comp rx=0 tx=0).stop 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 -- 172.21.15.66:0/1435907459 shutdown_connections 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162b30 0x7efdb80b53b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/1435907459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162750 0x7efdb80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 -- 172.21.15.66:0/1435907459 >> 172.21.15.66:0/1435907459 conn(0x7efdb809e3b0 msgr2=0x7efdb80d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 -- 172.21.15.66:0/1435907459 shutdown_connections 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.996+0000 7efdbeb9d640 1 -- 172.21.15.66:0/1435907459 wait complete. 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.997+0000 7efdbeb9d640 1 Processor -- start 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.997+0000 7efdbeb9d640 1 -- start start 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbeb9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162750 0x7efdb81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbeb9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162b30 0x7efdb80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbeb9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 0x7efdb80b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbeb9d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efdb80d0d30 con 0x7efdb80b8c90 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbeb9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efdb80d0bb0 con 0x7efdb8162750 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbeb9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efdb80d3d40 con 0x7efdb8162b30 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbd13a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 0x7efdb80b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbd13a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 0x7efdb80b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48874/0 (socket says 172.21.15.66:48874) 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbd13a640 1 -- 172.21.15.66:0/857916642 learned_addr learned my addr 172.21.15.66:0/857916642 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdaffff640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162b30 0x7efdb80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.998+0000 7efdbc939640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162750 0x7efdb81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbd13a640 1 -- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162b30 msgr2=0x7efdb80cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbd13a640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162b30 0x7efdb80cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbd13a640 1 -- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162750 msgr2=0x7efdb81578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbd13a640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162750 0x7efdb81578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbd13a640 1 -- 172.21.15.66:0/857916642 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb8157e00 con 0x7efdb80b8c90 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbd13a640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 0x7efdb80b34a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009e50 tx=0x7efdb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0036050 con 0x7efdb80b8c90 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0042070 con 0x7efdb80b8c90 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb80b9200 con 0x7efdb80b8c90 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0009510 con 0x7efdb80b8c90 2024-05-10T11:18:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:10.999+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb80b97c0 con 0x7efdb80b8c90 2024-05-10T11:18:11.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.000+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb806a220 con 0x7efdb80b8c90 2024-05-10T11:18:11.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.001+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efdb0007bf0 con 0x7efdb80b8c90 2024-05-10T11:18:11.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.001+0000 7efdad7fa640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efda40762d0 0x7efda4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.001+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5249+0+0 (secure 0 0 0) 0x7efdb00b8250 con 0x7efdb80b8c90 2024-05-10T11:18:11.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.001+0000 7efdbc939640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efda40762d0 0x7efda4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.002+0000 7efdbc939640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efda40762d0 0x7efda4078790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efdb81f8430 tx=0x7efdb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:11.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.005+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efdb0081cf0 con 0x7efdb80b8c90 2024-05-10T11:18:11.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.197+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efdb80b5aa0 con 0x7efdb80b8c90 2024-05-10T11:18:11.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.197+0000 7efdad7fa640 1 -- 172.21.15.66:0/857916642 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) ==== 84+0+65 (secure 0 0 0) 0x7efdb00815f0 con 0x7efdb80b8c90 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:11.197 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efda40762d0 msgr2=0x7efda4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efda40762d0 0x7efda4078790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efdb81f8430 tx=0x7efdb4008040 comp rx=0 tx=0).stop 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 msgr2=0x7efdb80b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 0x7efdb80b34a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009e50 tx=0x7efdb0004a40 comp rx=0 tx=0).stop 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 shutdown_connections 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efda40762d0 0x7efda4078790 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdb80b8c90 0x7efdb80b34a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8162b30 0x7efdb80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 --2- 172.21.15.66:0/857916642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb8162750 0x7efdb81578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 >> 172.21.15.66:0/857916642 conn(0x7efdb809e3b0 msgr2=0x7efdb80d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:11.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 shutdown_connections 2024-05-10T11:18:11.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.199+0000 7efdbeb9d640 1 -- 172.21.15.66:0/857916642 wait complete. 2024-05-10T11:18:11.210 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:18:11.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:18:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.318+0000 7ff0bf3f9640 1 Processor -- start 2024-05-10T11:18:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.318+0000 7ff0bf3f9640 1 -- start start 2024-05-10T11:18:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bf3f9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0b8159920 0x7ff0b8072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bf3f9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0b80d1540 0x7ff0b815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bf3f9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b815fa80 con 0x7ff0b80b41a0 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bf3f9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b815fd60 con 0x7ff0b8159920 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bf3f9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b8160040 con 0x7ff0b80d1540 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0b8159920 0x7ff0b8072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0b8159920 0x7ff0b8072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48888/0 (socket says 172.21.15.66:48888) 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 -- 172.21.15.66:0/1620228796 learned_addr learned my addr 172.21.15.66:0/1620228796 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd996640 1 --2- 172.21.15.66:0/1620228796 >> v2:172.21.15.190:3300/0 conn(0x7ff0b80d1540 0x7ff0b815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 -- 172.21.15.66:0/1620228796 >> v2:172.21.15.190:3300/0 conn(0x7ff0b80d1540 msgr2=0x7ff0b815c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 --2- 172.21.15.66:0/1620228796 >> v2:172.21.15.190:3300/0 conn(0x7ff0b80d1540 0x7ff0b815c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 -- 172.21.15.66:0/1620228796 >> v1:172.21.15.66:6789/0 conn(0x7ff0b80b41a0 legacy=0x7ff0b80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd195640 1 -- 172.21.15.66:0/1620228796 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b8160320 con 0x7ff0b8159920 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.319+0000 7ff0bd996640 1 --2- 172.21.15.66:0/1620228796 >> v2:172.21.15.190:3300/0 conn(0x7ff0b80d1540 0x7ff0b815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.320+0000 7ff0bd195640 1 --2- 172.21.15.66:0/1620228796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b8159920 0x7ff0b8072ef0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4009870 tx=0x7ff0b402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74699203ac70025 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.320+0000 7ff0affff640 1 -- 172.21.15.66:0/1620228796 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4037070 con 0x7ff0b8159920 2024-05-10T11:18:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.320+0000 7ff0affff640 1 -- 172.21.15.66:0/1620228796 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4032440 con 0x7ff0b8159920 2024-05-10T11:18:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.320+0000 7ff0affff640 1 -- 172.21.15.66:0/1620228796 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4032810 con 0x7ff0b8159920 2024-05-10T11:18:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1620228796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b8159920 msgr2=0x7ff0b8072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1620228796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b8159920 0x7ff0b8072ef0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4009870 tx=0x7ff0b402a210 comp rx=0 tx=0).stop 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1620228796 shutdown_connections 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1620228796 >> v2:172.21.15.190:3300/0 conn(0x7ff0b80d1540 0x7ff0b815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1620228796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b8159920 0x7ff0b8072ef0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1620228796 >> 172.21.15.66:0/1620228796 conn(0x7ff0b806c4a0 msgr2=0x7ff0b806c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1620228796 shutdown_connections 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.321+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1620228796 wait complete. 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.322+0000 7ff0bf3f9640 1 Processor -- start 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.322+0000 7ff0bf3f9640 1 -- start start 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bf3f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 0x7ff0b815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bf3f9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80d1540 0x7ff0b81f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bf3f9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8159920 0x7ff0b81e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bf3f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80b3db0 con 0x7ff0b80b41a0 2024-05-10T11:18:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bf3f9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b81608e0 con 0x7ff0b80d1540 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bf3f9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b80b4620 con 0x7ff0b8159920 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 0x7ff0b815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 0x7ff0b815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48904/0 (socket says 172.21.15.66:48904) 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 -- 172.21.15.66:0/1306489492 learned_addr learned my addr 172.21.15.66:0/1306489492 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd996640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8159920 0x7ff0b81e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bc994640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80d1540 0x7ff0b81f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 -- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8159920 msgr2=0x7ff0b81e7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8159920 0x7ff0b81e7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 -- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80d1540 msgr2=0x7ff0b81f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80d1540 0x7ff0b81f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 -- 172.21.15.66:0/1306489492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b81f64f0 con 0x7ff0b80b41a0 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd996640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8159920 0x7ff0b81e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bc994640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80d1540 0x7ff0b81f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0bd195640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 0x7ff0b815d150 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000c00 tx=0x7ff0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.323+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4037040 con 0x7ff0b80b41a0 2024-05-10T11:18:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.324+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4042070 con 0x7ff0b80b41a0 2024-05-10T11:18:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.324+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b81f67d0 con 0x7ff0b80b41a0 2024-05-10T11:18:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.324+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4030bd0 con 0x7ff0b80b41a0 2024-05-10T11:18:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.324+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b81e8130 con 0x7ff0b80b41a0 2024-05-10T11:18:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.325+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b806a220 con 0x7ff0b80b41a0 2024-05-10T11:18:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.325+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff0b4047460 con 0x7ff0b80b41a0 2024-05-10T11:18:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.326+0000 7ff0adffb640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff09c0762d0 0x7ff09c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.326+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5249+0+0 (secure 0 0 0) 0x7ff0b40b8050 con 0x7ff0b80b41a0 2024-05-10T11:18:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.326+0000 7ff0bc994640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff09c0762d0 0x7ff09c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.327+0000 7ff0bc994640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff09c0762d0 0x7ff09c078790 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80af430 tx=0x7ff0a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.330+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff0b4081c00 con 0x7ff0b80b41a0 2024-05-10T11:18:11.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:11.525+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff0b8072aa0 con 0x7ff0b80b41a0 2024-05-10T11:18:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.469+0000 7ff0adffb640 1 -- 172.21.15.66:0/1306489492 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) ==== 138+0+0 (secure 0 0 0) 0x7ff0b4081500 con 0x7ff0b80b41a0 2024-05-10T11:18:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff09c0762d0 msgr2=0x7ff09c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff09c0762d0 0x7ff09c078790 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80af430 tx=0x7ff0a8009040 comp rx=0 tx=0).stop 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 msgr2=0x7ff0b815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 0x7ff0b815d150 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000c00 tx=0x7ff0b40046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 shutdown_connections 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff09c0762d0 0x7ff09c078790 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8159920 0x7ff0b81e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80d1540 0x7ff0b81f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 --2- 172.21.15.66:0/1306489492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b80b41a0 0x7ff0b815d150 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 >> 172.21.15.66:0/1306489492 conn(0x7ff0b806c4a0 msgr2=0x7ff0b80ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 shutdown_connections 2024-05-10T11:18:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.472+0000 7ff0bf3f9640 1 -- 172.21.15.66:0/1306489492 wait complete. 2024-05-10T11:18:12.489 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:18:12.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.607+0000 7ff123746640 1 Processor -- start 2024-05-10T11:18:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.607+0000 7ff123746640 1 -- start start 2024-05-10T11:18:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.608+0000 7ff123746640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff11c162900 0x7ff11c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.608+0000 7ff123746640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0d3950 0x7ff11c0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.608+0000 7ff123746640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c0d4190 con 0x7ff11c162ce0 2024-05-10T11:18:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.608+0000 7ff123746640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff11c0cfc40 con 0x7ff11c162900 2024-05-10T11:18:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.608+0000 7ff123746640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0d3eb0 con 0x7ff11c0d3950 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.608+0000 7ff121ce3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0d3950 0x7ff11c0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff1214e2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff11c162900 0x7ff11c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff121ce3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0d3950 0x7ff11c0d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:39452/0 (socket says 172.21.15.66:39452) 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff121ce3640 1 -- 172.21.15.66:0/917056415 learned_addr learned my addr 172.21.15.66:0/917056415 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff120ce1640 1 --1- 172.21.15.66:0/917056415 >> v1:172.21.15.190:6789/0 conn(0x7ff11c162ce0 0x7ff11c0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:58804/0 (socket says 172.21.15.66:58804) 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff1214e2640 1 -- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0d3950 msgr2=0x7ff11c0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff1214e2640 1 --2- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0d3950 0x7ff11c0d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff1214e2640 1 -- 172.21.15.66:0/917056415 >> v1:172.21.15.190:6789/0 conn(0x7ff11c162ce0 legacy=0x7ff11c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.609+0000 7ff1214e2640 1 -- 172.21.15.66:0/917056415 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c0cfee0 con 0x7ff11c162900 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff1214e2640 1 --2- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162900 0x7ff11c0d3410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1180097a0 tx=0x7ff11802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1c4f8ee6e69271 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff113fff640 1 -- 172.21.15.66:0/917056415 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118037070 con 0x7ff11c162900 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff113fff640 1 -- 172.21.15.66:0/917056415 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11802ae50 con 0x7ff11c162900 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff113fff640 1 -- 172.21.15.66:0/917056415 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118032660 con 0x7ff11c162900 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff123746640 1 -- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162900 msgr2=0x7ff11c0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff123746640 1 --2- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162900 0x7ff11c0d3410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1180097a0 tx=0x7ff11802a100 comp rx=0 tx=0).stop 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff123746640 1 -- 172.21.15.66:0/917056415 shutdown_connections 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff123746640 1 --2- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0d3950 0x7ff11c0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff123746640 1 --2- 172.21.15.66:0/917056415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162900 0x7ff11c0d3410 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.610+0000 7ff123746640 1 -- 172.21.15.66:0/917056415 >> 172.21.15.66:0/917056415 conn(0x7ff11c09e430 msgr2=0x7ff11c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.611+0000 7ff123746640 1 -- 172.21.15.66:0/917056415 shutdown_connections 2024-05-10T11:18:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.611+0000 7ff123746640 1 -- 172.21.15.66:0/917056415 wait complete. 2024-05-10T11:18:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 Processor -- start 2024-05-10T11:18:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 -- start start 2024-05-10T11:18:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 0x7ff11c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c162900 0x7ff11c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162ce0 0x7ff11c1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0b4300 con 0x7ff11c0d3950 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0b4180 con 0x7ff11c162ce0 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.612+0000 7ff123746640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0b4ff0 con 0x7ff11c162900 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 0x7ff11c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 0x7ff11c15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48908/0 (socket says 172.21.15.66:48908) 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 -- 172.21.15.66:0/2992443670 learned_addr learned my addr 172.21.15.66:0/2992443670 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff121ce3640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162ce0 0x7ff11c1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff120ce1640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c162900 0x7ff11c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 -- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c162900 msgr2=0x7ff11c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c162900 0x7ff11c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 -- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162ce0 msgr2=0x7ff11c1f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162ce0 0x7ff11c1f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 -- 172.21.15.66:0/2992443670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c0b7c60 con 0x7ff11c0d3950 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff1214e2640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 0x7ff11c15d120 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098c0 tx=0x7ff1180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118041030 con 0x7ff11c0d3950 2024-05-10T11:18:12.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11802ac50 con 0x7ff11c0d3950 2024-05-10T11:18:12.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c1f5b10 con 0x7ff11c0d3950 2024-05-10T11:18:12.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.613+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118037040 con 0x7ff11c0d3950 2024-05-10T11:18:12.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.614+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c1f60d0 con 0x7ff11c0d3950 2024-05-10T11:18:12.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.615+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c06a220 con 0x7ff11c0d3950 2024-05-10T11:18:12.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.615+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff118044070 con 0x7ff11c0d3950 2024-05-10T11:18:12.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.616+0000 7ff111ffb640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1000762d0 0x7ff100078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:12.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.616+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5619+0+0 (secure 0 0 0) 0x7ff1180b7a10 con 0x7ff11c0d3950 2024-05-10T11:18:12.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.616+0000 7ff120ce1640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1000762d0 0x7ff100078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:12.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.617+0000 7ff120ce1640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1000762d0 0x7ff100078790 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff11c15cee0 tx=0x7ff10c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.621+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff118080d80 con 0x7ff11c0d3950 2024-05-10T11:18:12.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:12.811+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff11c15fe20 con 0x7ff11c0d3950 2024-05-10T11:18:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.472+0000 7ff111ffb640 1 -- 172.21.15.66:0/2992443670 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7ff11802ae20 con 0x7ff11c0d3950 2024-05-10T11:18:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1000762d0 msgr2=0x7ff100078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1000762d0 0x7ff100078790 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff11c15cee0 tx=0x7ff10c007e80 comp rx=0 tx=0).stop 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 msgr2=0x7ff11c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 0x7ff11c15d120 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098c0 tx=0x7ff1180046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 shutdown_connections 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff1000762d0 0x7ff100078790 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c162ce0 0x7ff11c1f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c162900 0x7ff11c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 --2- 172.21.15.66:0/2992443670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff11c0d3950 0x7ff11c15d120 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 >> 172.21.15.66:0/2992443670 conn(0x7ff11c09e430 msgr2=0x7ff11c15e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 shutdown_connections 2024-05-10T11:18:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.474+0000 7ff123746640 1 -- 172.21.15.66:0/2992443670 wait complete. 2024-05-10T11:18:13.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:18:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.611+0000 7fcecbc64640 1 Processor -- start 2024-05-10T11:18:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.611+0000 7fcecbc64640 1 -- start start 2024-05-10T11:18:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.612+0000 7fcecbc64640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcec40d0e90 0x7fcec416a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.612+0000 7fcecbc64640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec415f790 con 0x7fcec40cfdd0 2024-05-10T11:18:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.612+0000 7fcecbc64640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec40ce550 con 0x7fcec415f3b0 2024-05-10T11:18:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.612+0000 7fcecbc64640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcec40cf160 con 0x7fcec40d0e90 2024-05-10T11:18:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.612+0000 7fcec91ff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fcec40cfdd0 0x7fcec40d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:53038/0 (socket says 172.21.15.66:53038) 2024-05-10T11:18:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.612+0000 7fcec91ff640 1 -- 172.21.15.66:0/1336027313 learned_addr learned my addr 172.21.15.66:0/1336027313 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fceca201640 1 --2- 172.21.15.66:0/1336027313 >> v2:172.21.15.190:3300/0 conn(0x7fcec40d0e90 0x7fcec416a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:13.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703098688 0 0) 0x7fcec415f790 con 0x7fcec40cfdd0 2024-05-10T11:18:13.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceb0003520 con 0x7fcec40cfdd0 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6037710 0 0) 0x7fcec40ce550 con 0x7fcec415f3b0 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec415f790 con 0x7fcec415f3b0 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2731922306 0 0) 0x7fceb0003520 con 0x7fcec40cfdd0 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fceca201640 1 -- 172.21.15.66:0/1336027313 >> v1:172.21.15.190:6789/0 conn(0x7fcec415f3b0 legacy=0x7fcec4163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fceca201640 1 -- 172.21.15.66:0/1336027313 >> v1:172.21.15.66:6789/0 conn(0x7fcec40cfdd0 legacy=0x7fcec40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.613+0000 7fceca201640 1 -- 172.21.15.66:0/1336027313 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40ce830 con 0x7fcec40d0e90 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.614+0000 7fceca201640 1 --2- 172.21.15.66:0/1336027313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40d0e90 0x7fcec416a0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fceac0097a0 tx=0x7fceac02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1822629112610b52 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.614+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac037070 con 0x7fcec40d0e90 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.614+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac02abc0 con 0x7fcec40d0e90 2024-05-10T11:18:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.614+0000 7fcec89fe640 1 -- 172.21.15.66:0/1336027313 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc001670 con 0x7fcec40d0e90 2024-05-10T11:18:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 -- 172.21.15.66:0/1336027313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40d0e90 msgr2=0x7fcec416a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 --2- 172.21.15.66:0/1336027313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40d0e90 0x7fcec416a0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fceac0097a0 tx=0x7fceac02a130 comp rx=0 tx=0).stop 2024-05-10T11:18:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 -- 172.21.15.66:0/1336027313 shutdown_connections 2024-05-10T11:18:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 --2- 172.21.15.66:0/1336027313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40d0e90 0x7fcec416a0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 -- 172.21.15.66:0/1336027313 >> 172.21.15.66:0/1336027313 conn(0x7fcec40b3c60 msgr2=0x7fcec40b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 -- 172.21.15.66:0/1336027313 shutdown_connections 2024-05-10T11:18:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.615+0000 7fcecbc64640 1 -- 172.21.15.66:0/1336027313 wait complete. 2024-05-10T11:18:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.616+0000 7fcecbc64640 1 Processor -- start 2024-05-10T11:18:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.616+0000 7fcecbc64640 1 -- start start 2024-05-10T11:18:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcecbc64640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40cfdd0 0x7fcec414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcecbc64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 0x7fcec4159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcecbc64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcec415f3b0 0x7fcec4159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcecbc64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcec406de40 con 0x7fcec40d0e90 2024-05-10T11:18:13.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcecbc64640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcec40cedf0 con 0x7fcec40cfdd0 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcecbc64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcec406dfc0 con 0x7fcec415f3b0 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 0x7fcec4159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 0x7fcec4159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48918/0 (socket says 172.21.15.66:48918) 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 -- 172.21.15.66:0/3746663789 learned_addr learned my addr 172.21.15.66:0/3746663789 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec9a00640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40cfdd0 0x7fcec414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fceca201640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcec415f3b0 0x7fcec4159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 -- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcec415f3b0 msgr2=0x7fcec4159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcec415f3b0 0x7fcec4159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 -- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40cfdd0 msgr2=0x7fcec414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40cfdd0 0x7fcec414b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.617+0000 7fcec91ff640 1 -- 172.21.15.66:0/3746663789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40c7c90 con 0x7fcec40d0e90 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.618+0000 7fcec91ff640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 0x7fcec4159600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c520 tx=0x7fcebc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.618+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc017070 con 0x7fcec40d0e90 2024-05-10T11:18:13.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.618+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc005ce0 con 0x7fcec40d0e90 2024-05-10T11:18:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.618+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec40c7f70 con 0x7fcec40d0e90 2024-05-10T11:18:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.618+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0072b0 con 0x7fcec40d0e90 2024-05-10T11:18:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.618+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec414c520 con 0x7fcec40d0e90 2024-05-10T11:18:13.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.619+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec406a220 con 0x7fcec40d0e90 2024-05-10T11:18:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.620+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcebc01a070 con 0x7fcec40d0e90 2024-05-10T11:18:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.620+0000 7fcec27fc640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcea40762d0 0x7fcea4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.620+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6001+0+0 (secure 0 0 0) 0x7fcebc096e00 con 0x7fcec40d0e90 2024-05-10T11:18:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.620+0000 7fcec9a00640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcea40762d0 0x7fcea4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:13.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.621+0000 7fcec9a00640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcea40762d0 0x7fcea4078790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fceb4001560 tx=0x7fceb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.624+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcebc021080 con 0x7fcec40d0e90 2024-05-10T11:18:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:13.858+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcec4069ec0 con 0x7fcec40d0e90 2024-05-10T11:18:14.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.493+0000 7fcec27fc640 1 -- 172.21.15.66:0/3746663789 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v59) ==== 174+0+0 (secure 0 0 0) 0x7fcebc060630 con 0x7fcec40d0e90 2024-05-10T11:18:14.496 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 13 and data pool 14 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcea40762d0 msgr2=0x7fcea4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcea40762d0 0x7fcea4078790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fceb4001560 tx=0x7fceb4009040 comp rx=0 tx=0).stop 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 msgr2=0x7fcec4159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 0x7fcec4159600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c520 tx=0x7fcebc00c920 comp rx=0 tx=0).stop 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 shutdown_connections 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcea40762d0 0x7fcea4078790 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcec415f3b0 0x7fcec4159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec40d0e90 0x7fcec4159600 secure :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c520 tx=0x7fcebc00c920 comp rx=0 tx=0).stop 2024-05-10T11:18:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 --2- 172.21.15.66:0/3746663789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcec40cfdd0 0x7fcec414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.497+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 >> 172.21.15.66:0/3746663789 conn(0x7fcec40b3c60 msgr2=0x7fcec40af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:14.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.502+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 shutdown_connections 2024-05-10T11:18:14.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.502+0000 7fcecbc64640 1 -- 172.21.15.66:0/3746663789 wait complete. 2024-05-10T11:18:14.527 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:18:14.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.637+0000 7f1756719640 1 Processor -- start 2024-05-10T11:18:14.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.637+0000 7f1756719640 1 -- start start 2024-05-10T11:18:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f1756719640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f175015f3b0 0x7f17500d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f1756719640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17500d30b0 con 0x7f17500d5d30 2024-05-10T11:18:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f1756719640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17500d3390 con 0x7f175015f790 2024-05-10T11:18:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f1756719640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f17500c8c80 con 0x7f175015f3b0 2024-05-10T11:18:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f174ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f175015f3b0 0x7f17500d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f174ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f175015f3b0 0x7f17500d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36000/0 (socket says 172.21.15.66:36000) 2024-05-10T11:18:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f174ffff640 1 -- 172.21.15.66:0/3031001125 learned_addr learned my addr 172.21.15.66:0/3031001125 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f174ffff640 1 -- 172.21.15.66:0/3031001125 >> v1:172.21.15.190:6789/0 conn(0x7f175015f790 legacy=0x7f17500c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f174ffff640 1 -- 172.21.15.66:0/3031001125 >> v1:172.21.15.66:6789/0 conn(0x7f17500d5d30 legacy=0x7f17500d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.638+0000 7f174ffff640 1 -- 172.21.15.66:0/3031001125 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17500c8f60 con 0x7f175015f3b0 2024-05-10T11:18:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.639+0000 7f174ffff640 1 --2- 172.21.15.66:0/3031001125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f17500d36f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1740009870 tx=0x7f174002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7560b55e6c3c74 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.639+0000 7f174f7fe640 1 -- 172.21.15.66:0/3031001125 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740037070 con 0x7f175015f3b0 2024-05-10T11:18:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.639+0000 7f174f7fe640 1 -- 172.21.15.66:0/3031001125 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740032440 con 0x7f175015f3b0 2024-05-10T11:18:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.639+0000 7f174f7fe640 1 -- 172.21.15.66:0/3031001125 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740032810 con 0x7f175015f3b0 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.639+0000 7f1756719640 1 -- 172.21.15.66:0/3031001125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 msgr2=0x7f17500d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.639+0000 7f1756719640 1 --2- 172.21.15.66:0/3031001125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f17500d36f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1740009870 tx=0x7f174002a2a0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.640+0000 7f1756719640 1 -- 172.21.15.66:0/3031001125 shutdown_connections 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.640+0000 7f1756719640 1 --2- 172.21.15.66:0/3031001125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f17500d36f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.640+0000 7f1756719640 1 -- 172.21.15.66:0/3031001125 >> 172.21.15.66:0/3031001125 conn(0x7f17500d5130 msgr2=0x7f17500d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.640+0000 7f1756719640 1 -- 172.21.15.66:0/3031001125 shutdown_connections 2024-05-10T11:18:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.640+0000 7f1756719640 1 -- 172.21.15.66:0/3031001125 wait complete. 2024-05-10T11:18:14.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.641+0000 7f1756719640 1 Processor -- start 2024-05-10T11:18:14.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.641+0000 7f1756719640 1 -- start start 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.641+0000 7f1756719640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17500d5d30 0x7f175014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.641+0000 7f1756719640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f175014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1756719640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1750151830 0x7f175006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1756719640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f17500d3db0 con 0x7f175015f3b0 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1756719640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f17500d3c30 con 0x7f17500d5d30 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1756719640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17500d3f30 con 0x7f1750151830 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f175014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f175014dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36002/0 (socket says 172.21.15.66:36002) 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 -- 172.21.15.66:0/2352571017 learned_addr learned my addr 172.21.15.66:0/2352571017 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f174ffff640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17500d5d30 0x7f175014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1754cb6640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1750151830 0x7f175006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 -- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1750151830 msgr2=0x7f175006d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1750151830 0x7f175006d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 -- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17500d5d30 msgr2=0x7f175014b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17500d5d30 0x7f175014b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 -- 172.21.15.66:0/2352571017 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175014bd10 con 0x7f175015f3b0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1754cb6640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1750151830 0x7f175006d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1747fff640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f175014dca0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f173800c400 tx=0x7f173800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738011790 con 0x7f175015f3b0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1738017070 con 0x7f175015f3b0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738011bb0 con 0x7f175015f3b0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175014e5c0 con 0x7f175015f3b0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.642+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175014bf80 con 0x7f175015f3b0 2024-05-10T11:18:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.643+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175014b980 con 0x7f175015f3b0 2024-05-10T11:18:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.644+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f173801c460 con 0x7f175015f3b0 2024-05-10T11:18:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.645+0000 7f174d7fa640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17300762d0 0x7f1730078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.645+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f1738097520 con 0x7f175015f3b0 2024-05-10T11:18:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.645+0000 7f174ffff640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17300762d0 0x7f1730078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.645+0000 7f174ffff640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17300762d0 0x7f1730078790 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1740034000 tx=0x7f174002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:14.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.649+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1738060cf0 con 0x7f175015f3b0 2024-05-10T11:18:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.841+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f175006e520 con 0x7f175015f3b0 2024-05-10T11:18:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.842+0000 7f174d7fa640 1 -- 172.21.15.66:0/2352571017 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16898 (secure 0 0 0) 0x7f17380605f0 con 0x7f175015f3b0 2024-05-10T11:18:14.841 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:14.842 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":87,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:18:13.858850+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:18:11.529408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T11:18:12.815066+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17300762d0 msgr2=0x7f1730078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17300762d0 0x7f1730078790 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1740034000 tx=0x7f174002e000 comp rx=0 tx=0).stop 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 msgr2=0x7f175014dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f175014dca0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f173800c400 tx=0x7f173800c8c0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 shutdown_connections 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f17300762d0 0x7f1730078790 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1750151830 0x7f175006d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f175015f3b0 0x7f175014dca0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 --2- 172.21.15.66:0/2352571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17500d5d30 0x7f175014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 >> 172.21.15.66:0/2352571017 conn(0x7f17500d5130 msgr2=0x7f17500c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 shutdown_connections 2024-05-10T11:18:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.844+0000 7f1756719640 1 -- 172.21.15.66:0/2352571017 wait complete. 2024-05-10T11:18:14.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:18:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.959+0000 7fe703699640 1 Processor -- start 2024-05-10T11:18:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.960+0000 7fe703699640 1 -- start start 2024-05-10T11:18:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.960+0000 7fe703699640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6fc15f3b0 0x7fe6fc0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.960+0000 7fe703699640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc15f790 0x7fe6fc0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.960+0000 7fe703699640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc0d30b0 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.960+0000 7fe703699640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0d3390 con 0x7fe6fc15f3b0 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.960+0000 7fe703699640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc0c8c80 con 0x7fe6fc15f790 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6fc15f3b0 0x7fe6fc0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6fc15f3b0 0x7fe6fc0d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36004/0 (socket says 172.21.15.66:36004) 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 -- 172.21.15.66:0/2956164188 learned_addr learned my addr 172.21.15.66:0/2956164188 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe700c34640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc15f790 0x7fe6fc0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 -- 172.21.15.66:0/2956164188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc15f790 msgr2=0x7fe6fc0d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc15f790 0x7fe6fc0d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 -- 172.21.15.66:0/2956164188 >> v1:172.21.15.190:6789/0 conn(0x7fe6fc0d5d30 legacy=0x7fe6fc0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe701435640 1 -- 172.21.15.66:0/2956164188 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc0c8f60 con 0x7fe6fc15f3b0 2024-05-10T11:18:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.961+0000 7fe700c34640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc15f790 0x7fe6fc0d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe701435640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc0d36f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009870 tx=0x7fe6ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513933fa40238fd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe6fbfff640 1 -- 172.21.15.66:0/2956164188 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec037070 con 0x7fe6fc15f3b0 2024-05-10T11:18:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe6fbfff640 1 -- 172.21.15.66:0/2956164188 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec032440 con 0x7fe6fc15f3b0 2024-05-10T11:18:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe6fbfff640 1 -- 172.21.15.66:0/2956164188 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec032810 con 0x7fe6fc15f3b0 2024-05-10T11:18:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 -- 172.21.15.66:0/2956164188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc15f3b0 msgr2=0x7fe6fc0d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc0d36f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009870 tx=0x7fe6ec02a270 comp rx=0 tx=0).stop 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 -- 172.21.15.66:0/2956164188 shutdown_connections 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc15f790 0x7fe6fc0d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 --2- 172.21.15.66:0/2956164188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc0d36f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 -- 172.21.15.66:0/2956164188 >> 172.21.15.66:0/2956164188 conn(0x7fe6fc0d5130 msgr2=0x7fe6fc0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 -- 172.21.15.66:0/2956164188 shutdown_connections 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.962+0000 7fe703699640 1 -- 172.21.15.66:0/2956164188 wait complete. 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 Processor -- start 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 -- start start 2024-05-10T11:18:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 0x7fe6fc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc1f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc154550 0x7fe6fc161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc0d0e60 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc0d0ce0 con 0x7fe6fc15f3b0 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe703699640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc0d0fe0 con 0x7fe6fc154550 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe701435640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 0x7fe6fc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe701435640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 0x7fe6fc0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36014/0 (socket says 172.21.15.66:36014) 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.964+0000 7fe701435640 1 -- 172.21.15.66:0/2483960559 learned_addr learned my addr 172.21.15.66:0/2483960559 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe700c34640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc1f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701c36640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc154550 0x7fe6fc161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701435640 1 -- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc154550 msgr2=0x7fe6fc161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701435640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc154550 0x7fe6fc161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701435640 1 -- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6fc15f3b0 msgr2=0x7fe6fc1f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701435640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc1f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701435640 1 -- 172.21.15.66:0/2483960559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc1f89f0 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe701435640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 0x7fe6fc0cef10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec02a2b0 tx=0x7fe6ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec041020 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0306c0 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc1f8cd0 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec037040 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.965+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc156a90 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.966+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc06a220 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.967+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe6ec044020 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.967+0000 7fe6f9ffb640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6e80762d0 0x7fe6e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.967+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fe6ec0b7f40 con 0x7fe6fc0d5d30 2024-05-10T11:18:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.968+0000 7fe700c34640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6e80762d0 0x7fe6e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.968+0000 7fe700c34640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6e80762d0 0x7fe6e8078790 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc161e10 tx=0x7fe6f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:14.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:14.972+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe6ec04b030 con 0x7fe6fc0d5d30 2024-05-10T11:18:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.164+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6fc0d3b00 con 0x7fe6fc0d5d30 2024-05-10T11:18:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.165+0000 7fe6f9ffb640 1 -- 172.21.15.66:0/2483960559 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16898 (secure 0 0 0) 0x7fe6ec0817a0 con 0x7fe6fc0d5d30 2024-05-10T11:18:15.164 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:15.165 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":87,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:18:13.858850+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:18:11.529408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T11:18:12.815066+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6e80762d0 msgr2=0x7fe6e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6e80762d0 0x7fe6e8078790 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc161e10 tx=0x7fe6f0008040 comp rx=0 tx=0).stop 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 msgr2=0x7fe6fc0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 0x7fe6fc0cef10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec02a2b0 tx=0x7fe6ec0046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 shutdown_connections 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe6e80762d0 0x7fe6e8078790 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6fc154550 0x7fe6fc161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6fc15f3b0 0x7fe6fc1f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 --2- 172.21.15.66:0/2483960559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc0d5d30 0x7fe6fc0cef10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 >> 172.21.15.66:0/2483960559 conn(0x7fe6fc0d5130 msgr2=0x7fe6fc0ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 shutdown_connections 2024-05-10T11:18:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.167+0000 7fe703699640 1 -- 172.21.15.66:0/2483960559 wait complete. 2024-05-10T11:18:15.178 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:18:15.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.286+0000 7fe4651f0640 1 Processor -- start 2024-05-10T11:18:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.286+0000 7fe4651f0640 1 -- start start 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe4651f0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe4600d3df0 0x7fe4600d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe4651f0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4600b4aa0 0x7fe4600d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe4651f0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4600d41d0 con 0x7fe4600b4f30 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe4651f0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe4600cfd50 con 0x7fe4600d3df0 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe4651f0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe4600b5d90 con 0x7fe4600b4aa0 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe4600d3df0 0x7fe4600d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe4600d3df0 0x7fe4600d2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36024/0 (socket says 172.21.15.66:36024) 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 -- 172.21.15.66:0/1923024730 learned_addr learned my addr 172.21.15.66:0/1923024730 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 -- 172.21.15.66:0/1923024730 >> v2:172.21.15.190:3300/0 conn(0x7fe4600b4aa0 msgr2=0x7fe4600d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:15.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45e59c640 1 --2- 172.21.15.66:0/1923024730 >> v2:172.21.15.190:3300/0 conn(0x7fe4600b4aa0 0x7fe4600d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:15.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 --2- 172.21.15.66:0/1923024730 >> v2:172.21.15.190:3300/0 conn(0x7fe4600b4aa0 0x7fe4600d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 -- 172.21.15.66:0/1923024730 >> v1:172.21.15.66:6789/0 conn(0x7fe4600b4f30 legacy=0x7fe4600d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:15.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.287+0000 7fe45ed9d640 1 -- 172.21.15.66:0/1923024730 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4600b54f0 con 0x7fe4600d3df0 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.288+0000 7fe45ed9d640 1 --2- 172.21.15.66:0/1923024730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600d3df0 0x7fe4600d2d10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe46009eae0 tx=0x7fe45002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec51d0cbad8241dd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.288+0000 7fe45dd9b640 1 -- 172.21.15.66:0/1923024730 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450036070 con 0x7fe4600d3df0 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.288+0000 7fe45dd9b640 1 -- 172.21.15.66:0/1923024730 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe450031600 con 0x7fe4600d3df0 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.288+0000 7fe45dd9b640 1 -- 172.21.15.66:0/1923024730 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500319d0 con 0x7fe4600d3df0 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 -- 172.21.15.66:0/1923024730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600d3df0 msgr2=0x7fe4600d2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 --2- 172.21.15.66:0/1923024730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600d3df0 0x7fe4600d2d10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe46009eae0 tx=0x7fe45002a730 comp rx=0 tx=0).stop 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 -- 172.21.15.66:0/1923024730 shutdown_connections 2024-05-10T11:18:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 --2- 172.21.15.66:0/1923024730 >> v2:172.21.15.190:3300/0 conn(0x7fe4600b4aa0 0x7fe4600d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 --2- 172.21.15.66:0/1923024730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600d3df0 0x7fe4600d2d10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 -- 172.21.15.66:0/1923024730 >> 172.21.15.66:0/1923024730 conn(0x7fe46009e450 msgr2=0x7fe4600d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:15.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 -- 172.21.15.66:0/1923024730 shutdown_connections 2024-05-10T11:18:15.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.289+0000 7fe4651f0640 1 -- 172.21.15.66:0/1923024730 wait complete. 2024-05-10T11:18:15.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.290+0000 7fe4651f0640 1 Processor -- start 2024-05-10T11:18:15.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 -- start start 2024-05-10T11:18:15.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 0x7fe460160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:15.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4600b4f30 0x7fe4601f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:15.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4600d3df0 0x7fe4600cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:15.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe4600cff80 con 0x7fe4600b4aa0 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4600b5ab0 con 0x7fe4600d3df0 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe4651f0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe4600b6120 con 0x7fe4600b4f30 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe45ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 0x7fe460160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe45ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 0x7fe460160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36032/0 (socket says 172.21.15.66:36032) 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.291+0000 7fe45ed9d640 1 -- 172.21.15.66:0/2409889548 learned_addr learned my addr 172.21.15.66:0/2409889548 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45f59e640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4600d3df0 0x7fe4600cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45e59c640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4600b4f30 0x7fe4601f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45ed9d640 1 -- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4600b4f30 msgr2=0x7fe4601f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45ed9d640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4600b4f30 0x7fe4601f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45ed9d640 1 -- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4600d3df0 msgr2=0x7fe4600cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45ed9d640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4600d3df0 0x7fe4600cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45ed9d640 1 -- 172.21.15.66:0/2409889548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4601e93a0 con 0x7fe4600b4aa0 2024-05-10T11:18:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45f59e640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4600d3df0 0x7fe4600cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe45ed9d640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 0x7fe460160030 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe450000f80 tx=0x7fe450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450036050 con 0x7fe4600b4aa0 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe450042070 con 0x7fe4600b4aa0 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4601e9680 con 0x7fe4600b4aa0 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450009510 con 0x7fe4600b4aa0 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.292+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4601e9c40 con 0x7fe4600b4aa0 2024-05-10T11:18:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.293+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46006a220 con 0x7fe4600b4aa0 2024-05-10T11:18:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.294+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe450007c70 con 0x7fe4600b4aa0 2024-05-10T11:18:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.294+0000 7fe4477fe640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe44c076300 0x7fe44c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.295+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fe4500b85d0 con 0x7fe4600b4aa0 2024-05-10T11:18:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.295+0000 7fe45e59c640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe44c076300 0x7fe44c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.295+0000 7fe45e59c640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe44c076300 0x7fe44c0787c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe454006fd0 tx=0x7fe454008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:15.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.299+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe450081e30 con 0x7fe4600b4aa0 2024-05-10T11:18:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:15.539+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe4600d27c0 con 0x7fe4600b4aa0 2024-05-10T11:18:16.467 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-05-10T11:18:16.468+0000 7f4791098640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:18:16.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.505+0000 7fe4477fe640 1 -- 172.21.15.66:0/2409889548 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) ==== 118+0+0 (secure 0 0 0) 0x7fe450081730 con 0x7fe4600b4aa0 2024-05-10T11:18:16.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.508+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe44c076300 msgr2=0x7fe44c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:16.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.508+0000 7fe4651f0640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe44c076300 0x7fe44c0787c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe454006fd0 tx=0x7fe454008040 comp rx=0 tx=0).stop 2024-05-10T11:18:16.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 msgr2=0x7fe460160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:16.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 0x7fe460160030 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe450000f80 tx=0x7fe450004a40 comp rx=0 tx=0).stop 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 shutdown_connections 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe44c076300 0x7fe44c0787c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4600d3df0 0x7fe4600cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4600b4f30 0x7fe4601f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 --2- 172.21.15.66:0/2409889548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4600b4aa0 0x7fe460160030 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 >> 172.21.15.66:0/2409889548 conn(0x7fe46009e450 msgr2=0x7fe4600b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 shutdown_connections 2024-05-10T11:18:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.509+0000 7fe4651f0640 1 -- 172.21.15.66:0/2409889548 wait complete. 2024-05-10T11:18:16.523 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:18:16.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:18:16.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.636+0000 7ff9d4922640 1 Processor -- start 2024-05-10T11:18:16.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.636+0000 7ff9d4922640 1 -- start start 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9d4922640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff9d00cffd0 0x7ff9d00b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9d4922640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9d00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9d4922640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d006e720 con 0x7ff9d00cf3e0 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9d4922640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d006de80 con 0x7ff9d00cffd0 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9d4922640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d006e160 con 0x7ff9d00cd500 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9ce59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff9d00cf3e0 0x7ff9d00cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:42590/0 (socket says 172.21.15.66:42590) 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9ce59c640 1 -- 172.21.15.66:0/1134523426 learned_addr learned my addr 172.21.15.66:0/1134523426 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/1134523426 >> v2:172.21.15.190:3300/0 conn(0x7ff9d00cffd0 0x7ff9d00b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9ced9d640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9d00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166551547 0 0) 0x7ff9d006e720 con 0x7ff9d00cf3e0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b8003520 con 0x7ff9d00cf3e0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 193953742 0 0) 0x7ff9b8003520 con 0x7ff9d00cf3e0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 msgr2=0x7ff9d00d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9d00d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 >> v2:172.21.15.190:3300/0 conn(0x7ff9d00cffd0 msgr2=0x7ff9d00b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 --2- 172.21.15.66:0/1134523426 >> v2:172.21.15.190:3300/0 conn(0x7ff9d00cffd0 0x7ff9d00b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d006e440 con 0x7ff9d00cf3e0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/1134523426 >> v2:172.21.15.190:3300/0 conn(0x7ff9d00cffd0 0x7ff9d00b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7ff9c00019f0 con 0x7ff9d00cf3e0 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 >> v1:172.21.15.66:6789/0 conn(0x7ff9d00cf3e0 legacy=0x7ff9d00cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9b80039b0 0x7ff9b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.637+0000 7ff9cd59a640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b8004d40 0x7ff9b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d006de80 con 0x7ff9b80039b0 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d006e160 con 0x7ff9b8004d40 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b800b9c0 con 0x7ff9d00cd500 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9b80039b0 0x7ff9b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ced9d640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b8004d40 0x7ff9b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ce59c640 1 -- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 msgr2=0x7ff9b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ce59c640 1 -- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b8004d40 msgr2=0x7ff9b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b8004d40 0x7ff9b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ce59c640 1 -- 172.21.15.66:0/1134523426 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b8003520 con 0x7ff9b80039b0 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9d00cd500 0x7ff9b8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.638+0000 7ff9ced9d640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b8004d40 0x7ff9b80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9b80039b0 0x7ff9b8003dd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000a8a0 tx=0x7ff9b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f724ad1f3536833 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000a4c0 con 0x7ff9b80039b0 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c002f070 con 0x7ff9b80039b0 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9cd59a640 1 -- 172.21.15.66:0/1134523426 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c002bd30 con 0x7ff9b80039b0 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9d4922640 1 -- 172.21.15.66:0/1134523426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9b80039b0 msgr2=0x7ff9b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9d4922640 1 --2- 172.21.15.66:0/1134523426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9b80039b0 0x7ff9b8003dd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000a8a0 tx=0x7ff9b8005830 comp rx=0 tx=0).stop 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9ced9d640 1 -- 172.21.15.66:0/1134523426 reap_dead start 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9d4922640 1 -- 172.21.15.66:0/1134523426 shutdown_connections 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9d4922640 1 -- 172.21.15.66:0/1134523426 >> 172.21.15.66:0/1134523426 conn(0x7ff9d00d2eb0 msgr2=0x7ff9d00d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9d4922640 1 -- 172.21.15.66:0/1134523426 shutdown_connections 2024-05-10T11:18:16.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.639+0000 7ff9d4922640 1 -- 172.21.15.66:0/1134523426 wait complete. 2024-05-10T11:18:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.641+0000 7ff9d4922640 1 Processor -- start 2024-05-10T11:18:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.641+0000 7ff9d4922640 1 -- start start 2024-05-10T11:18:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9b80039b0 0x7ff9d01f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 0x7ff9d00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9d00c9310 0x7ff9d00b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00d1180 con 0x7ff9d00c8e90 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00b4510 con 0x7ff9d00c9310 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d00d1300 con 0x7ff9b80039b0 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 0x7ff9d00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 0x7ff9d00b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36052/0 (socket says 172.21.15.66:36052) 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 -- 172.21.15.66:0/3331403598 learned_addr learned my addr 172.21.15.66:0/3331403598 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 -- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9b80039b0 msgr2=0x7ff9d01f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9b80039b0 0x7ff9d01f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9ced9d640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9d00c9310 0x7ff9d00b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9b80039b0 0x7ff9d01f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 -- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9d00c9310 msgr2=0x7ff9d00b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9d00c9310 0x7ff9d00b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 -- 172.21.15.66:0/3331403598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d01f5ac0 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9ced9d640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9d00c9310 0x7ff9d00b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9cdd9b640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 0x7ff9d00b78d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4011860 tx=0x7ff9c4011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400fbd0 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c400fd70 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4015660 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d00cbcc0 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.642+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d00cc240 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.643+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d006a220 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.644+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9c4015800 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.645+0000 7ff9beffd640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9b0076300 0x7ff9b00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.645+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7ff9c40982f0 con 0x7ff9d00c8e90 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.645+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9b0076300 0x7ff9b00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.645+0000 7ff9ce59c640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9b0076300 0x7ff9b00787c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0033000 tx=0x7ff9c0007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.649+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff9d01f5ac0 con 0x7ff9d00c8e90 2024-05-10T11:18:16.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:16.880+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff9d00d0550 con 0x7ff9d00c8e90 2024-05-10T11:18:17.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.509+0000 7ff9beffd640 1 -- 172.21.15.66:0/3331403598 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) ==== 122+0+0 (secure 0 0 0) 0x7ff9c4019030 con 0x7ff9d00c8e90 2024-05-10T11:18:17.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9b0076300 msgr2=0x7ff9b00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9b0076300 0x7ff9b00787c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0033000 tx=0x7ff9c0007000 comp rx=0 tx=0).stop 2024-05-10T11:18:17.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 msgr2=0x7ff9d00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 0x7ff9d00b78d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4011860 tx=0x7ff9c4011d20 comp rx=0 tx=0).stop 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 shutdown_connections 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9b0076300 0x7ff9b00787c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9d00c9310 0x7ff9d00b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d00c8e90 0x7ff9d00b78d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 --2- 172.21.15.66:0/3331403598 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9b80039b0 0x7ff9d01f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.511+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 >> 172.21.15.66:0/3331403598 conn(0x7ff9d00d2eb0 msgr2=0x7ff9d006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.512+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 shutdown_connections 2024-05-10T11:18:17.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.512+0000 7ff9d4922640 1 -- 172.21.15.66:0/3331403598 wait complete. 2024-05-10T11:18:17.525 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:18:17.526 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:17.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.636+0000 7f8a87254640 1 Processor -- start 2024-05-10T11:18:17.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.636+0000 7f8a87254640 1 -- start start 2024-05-10T11:18:17.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a87254640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a801611e0 0x7f8a800cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a87254640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a800c6a80 con 0x7f8a8015ce60 2024-05-10T11:18:17.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a87254640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a800cd090 con 0x7f8a800c65f0 2024-05-10T11:18:17.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a87254640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8a800cd370 con 0x7f8a801611e0 2024-05-10T11:18:17.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a84ff0640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8a8015ce60 0x7f8a80160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:42604/0 (socket says 172.21.15.66:42604) 2024-05-10T11:18:17.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a84ff0640 1 -- 172.21.15.66:0/528523689 learned_addr learned my addr 172.21.15.66:0/528523689 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/528523689 >> v2:172.21.15.190:3300/0 conn(0x7f8a801611e0 0x7f8a800cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110773184 0 0) 0x7f8a68001110 con 0x7f8a8015ce60 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a6c003520 con 0x7f8a8015ce60 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1829915217 0 0) 0x7f8a6c003520 con 0x7f8a8015ce60 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 >> v2:172.21.15.190:3300/0 conn(0x7f8a801611e0 msgr2=0x7f8a800cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 --2- 172.21.15.66:0/528523689 >> v2:172.21.15.190:3300/0 conn(0x7f8a801611e0 0x7f8a800cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 >> v1:172.21.15.190:6789/0 conn(0x7f8a800c65f0 legacy=0x7f8a8015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a800cd650 con 0x7f8a8015ce60 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f8a68001840 con 0x7f8a8015ce60 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 >> v1:172.21.15.66:6789/0 conn(0x7f8a8015ce60 legacy=0x7f8a80160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c0039b0 0x7f8a6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.637+0000 7f8a7f7fe640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004800 0x7f8a6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7f7fe640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c0051c0 0x7f8a6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800cd370 con 0x7f8a6c004800 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c00c160 con 0x7f8a6c0039b0 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c00c360 con 0x7f8a6c0051c0 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004800 0x7f8a6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a84ff0640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c0039b0 0x7f8a6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a857f1640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c0051c0 0x7f8a6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7ffff640 1 -- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c0051c0 msgr2=0x7f8a6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c0051c0 0x7f8a6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7ffff640 1 -- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c0039b0 msgr2=0x7f8a6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c0039b0 0x7f8a6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a7ffff640 1 -- 172.21.15.66:0/528523689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c003520 con 0x7f8a6c004800 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.638+0000 7f8a857f1640 1 -- 172.21.15.66:0/528523689 reap_dead start 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004800 0x7f8a6c004c80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009fc0 tx=0x7f8a6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6e4744105a1e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:17.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70034020 con 0x7f8a6c004800 2024-05-10T11:18:17.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a700305f0 con 0x7f8a6c004800 2024-05-10T11:18:17.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a7f7fe640 1 -- 172.21.15.66:0/528523689 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70009c10 con 0x7f8a6c004800 2024-05-10T11:18:17.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 -- 172.21.15.66:0/528523689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004800 msgr2=0x7f8a6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004800 0x7f8a6c004c80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009fc0 tx=0x7f8a6c005830 comp rx=0 tx=0).stop 2024-05-10T11:18:17.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 -- 172.21.15.66:0/528523689 shutdown_connections 2024-05-10T11:18:17.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 --2- 172.21.15.66:0/528523689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a6c004800 0x7f8a6c004c80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 -- 172.21.15.66:0/528523689 >> 172.21.15.66:0/528523689 conn(0x7f8a800b2900 msgr2=0x7f8a800b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:17.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 -- 172.21.15.66:0/528523689 shutdown_connections 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.639+0000 7f8a87254640 1 -- 172.21.15.66:0/528523689 wait complete. 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.641+0000 7f8a87254640 1 Processor -- start 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.641+0000 7f8a87254640 1 -- start start 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004800 0x7f8a801476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a800d04d0 0x7f8a800af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 0x7f8a8015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800cde50 con 0x7f8a800af880 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800ccd60 con 0x7f8a800d04d0 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a800cdfd0 con 0x7f8a6c004800 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 0x7f8a8015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 0x7f8a8015a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36084/0 (socket says 172.21.15.66:36084) 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 -- 172.21.15.66:0/1877000228 learned_addr learned my addr 172.21.15.66:0/1877000228 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:17.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a84ff0640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004800 0x7f8a801476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 -- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004800 msgr2=0x7f8a801476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a800d04d0 0x7f8a800af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004800 0x7f8a801476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 -- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a800d04d0 msgr2=0x7f8a800af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a800d04d0 0x7f8a800af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 -- 172.21.15.66:0/1877000228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8009d840 con 0x7f8a800af880 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a84ff0640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004800 0x7f8a801476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a7ffff640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a800d04d0 0x7f8a800af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a857f1640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 0x7f8a8015a450 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8a800c7030 tx=0x7f8a7800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78019070 con 0x7f8a800af880 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a780052e0 con 0x7f8a800af880 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8009db20 con 0x7f8a800af880 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78003830 con 0x7f8a800af880 2024-05-10T11:18:17.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.642+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8009e0e0 con 0x7f8a800af880 2024-05-10T11:18:17.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.644+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a800afd00 con 0x7f8a800af880 2024-05-10T11:18:17.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.644+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a7801c070 con 0x7f8a800af880 2024-05-10T11:18:17.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.645+0000 7f8a7d7fa640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a600762d0 0x7f8a60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:17.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.645+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f8a78096ad0 con 0x7f8a800af880 2024-05-10T11:18:17.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.645+0000 7f8a84ff0640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a600762d0 0x7f8a60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:17.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.645+0000 7f8a84ff0640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a600762d0 0x7f8a60078790 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8a68007fd0 tx=0x7f8a68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:17.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.649+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8a780602a0 con 0x7f8a800af880 2024-05-10T11:18:17.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.882+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a8006a220 con 0x7f8a800af880 2024-05-10T11:18:17.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.882+0000 7f8a7d7fa640 1 -- 172.21.15.66:0/1877000228 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5186 (secure 0 0 0) 0x7f8a7805fba0 con 0x7f8a800af880 2024-05-10T11:18:17.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:17.883 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6867,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:16.882525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6873},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6873":{"gid":6873,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/1519468735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1519468735},{"type":"v1","addr":"172.21.15.190:6837","nonce":1519468735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873]},"id":6}]} 2024-05-10T11:18:17.883 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-05-10T11:18:17.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a600762d0 msgr2=0x7f8a60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a600762d0 0x7f8a60078790 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8a68007fd0 tx=0x7f8a68009040 comp rx=0 tx=0).stop 2024-05-10T11:18:17.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 msgr2=0x7f8a8015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:17.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 0x7f8a8015a450 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8a800c7030 tx=0x7f8a7800e820 comp rx=0 tx=0).stop 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 shutdown_connections 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8a600762d0 0x7f8a60078790 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800af880 0x7f8a8015a450 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a800d04d0 0x7f8a800af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 --2- 172.21.15.66:0/1877000228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c004800 0x7f8a801476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 >> 172.21.15.66:0/1877000228 conn(0x7f8a800b2900 msgr2=0x7f8a800cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 shutdown_connections 2024-05-10T11:18:17.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:17.885+0000 7f8a87254640 1 -- 172.21.15.66:0/1877000228 wait complete. 2024-05-10T11:18:17.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:18:18.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.000+0000 7faa0c06b640 1 Processor -- start 2024-05-10T11:18:18.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.000+0000 7faa0c06b640 1 -- start start 2024-05-10T11:18:18.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa0c06b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faa040d5cb0 0x7faa040d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa0c06b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162b30 0x7faa040d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa0c06b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa040b45f0 con 0x7faa04162750 2024-05-10T11:18:18.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa0c06b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7faa040b4f20 con 0x7faa040d5cb0 2024-05-10T11:18:18.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa0c06b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faa040d0fe0 con 0x7faa04162b30 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faa040d5cb0 0x7faa040d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faa040d5cb0 0x7faa040d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36092/0 (socket says 172.21.15.66:36092) 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 -- 172.21.15.66:0/761672062 learned_addr learned my addr 172.21.15.66:0/761672062 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09e07640 1 --1- 172.21.15.66:0/761672062 >> v1:172.21.15.66:6789/0 conn(0x7faa04162750 0x7faa040d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:42614/0 (socket says 172.21.15.66:42614) 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa0a608640 1 --2- 172.21.15.66:0/761672062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162b30 0x7faa040d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 -- 172.21.15.66:0/761672062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162b30 msgr2=0x7faa040d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 --2- 172.21.15.66:0/761672062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162b30 0x7faa040d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 -- 172.21.15.66:0/761672062 >> v1:172.21.15.66:6789/0 conn(0x7faa04162750 legacy=0x7faa040d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.001+0000 7faa09606640 1 -- 172.21.15.66:0/761672062 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa040b48d0 con 0x7faa040d5cb0 2024-05-10T11:18:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.002+0000 7faa09606640 1 --2- 172.21.15.66:0/761672062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa040d5cb0 0x7faa040d3630 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f570c9eda9fc73b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.002+0000 7faa08e05640 1 -- 172.21.15.66:0/761672062 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037070 con 0x7faa040d5cb0 2024-05-10T11:18:18.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.002+0000 7faa08e05640 1 -- 172.21.15.66:0/761672062 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4032440 con 0x7faa040d5cb0 2024-05-10T11:18:18.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.002+0000 7faa08e05640 1 -- 172.21.15.66:0/761672062 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4032810 con 0x7faa040d5cb0 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 -- 172.21.15.66:0/761672062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa040d5cb0 msgr2=0x7faa040d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 --2- 172.21.15.66:0/761672062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa040d5cb0 0x7faa040d3630 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 -- 172.21.15.66:0/761672062 shutdown_connections 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 --2- 172.21.15.66:0/761672062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162b30 0x7faa040d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 --2- 172.21.15.66:0/761672062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa040d5cb0 0x7faa040d3630 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 -- 172.21.15.66:0/761672062 >> 172.21.15.66:0/761672062 conn(0x7faa0409e3b0 msgr2=0x7faa040d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 -- 172.21.15.66:0/761672062 shutdown_connections 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.003+0000 7faa0c06b640 1 -- 172.21.15.66:0/761672062 wait complete. 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.004+0000 7faa0c06b640 1 Processor -- start 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.004+0000 7faa0c06b640 1 -- start start 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0c06b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162750 0x7faa040c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0c06b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 0x7faa040cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0c06b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa040ce520 0x7faa040ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0c06b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa040b53b0 con 0x7faa04162b30 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0c06b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa040d0d80 con 0x7faa040ce520 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0c06b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faa040b5530 con 0x7faa04162750 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 0x7faa040cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 0x7faa040cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36100/0 (socket says 172.21.15.66:36100) 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 -- 172.21.15.66:0/1476327939 learned_addr learned my addr 172.21.15.66:0/1476327939 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09e07640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162750 0x7faa040c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0a608640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa040ce520 0x7faa040ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 -- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162750 msgr2=0x7faa040c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162750 0x7faa040c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 -- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa040ce520 msgr2=0x7faa040ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa040ce520 0x7faa040ba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 -- 172.21.15.66:0/1476327939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa04157910 con 0x7faa04162b30 2024-05-10T11:18:18.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09e07640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162750 0x7faa040c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa0a608640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa040ce520 0x7faa040ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7faa09606640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 0x7faa040cdfe0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.005+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4041020 con 0x7faa04162b30 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.006+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f40306c0 con 0x7faa04162b30 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.006+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037040 con 0x7faa04162b30 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.006+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa040ceaa0 con 0x7faa04162b30 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.006+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa040b99f0 con 0x7faa04162b30 2024-05-10T11:18:18.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.007+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0406a220 con 0x7faa04162b30 2024-05-10T11:18:18.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.007+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa9f4044020 con 0x7faa04162b30 2024-05-10T11:18:18.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.008+0000 7fa9fa7fc640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9e80762d0 0x7fa9e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.008+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fa9f40b7f80 con 0x7faa04162b30 2024-05-10T11:18:18.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.008+0000 7faa09e07640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9e80762d0 0x7fa9e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.008+0000 7faa09e07640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9e80762d0 0x7fa9e8078790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faa040ca710 tx=0x7faa00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.012+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa9f404b030 con 0x7faa04162b30 2024-05-10T11:18:18.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.204+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa040d1690 con 0x7faa04162b30 2024-05-10T11:18:18.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.206+0000 7fa9fa7fc640 1 -- 172.21.15.66:0/1476327939 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16885 (secure 0 0 0) 0x7fa9f4081750 con 0x7faa04162b30 2024-05-10T11:18:18.207 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:18.207 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":88,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:18:15.493068+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:18:11.529408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T11:18:12.815066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:18:18.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9e80762d0 msgr2=0x7fa9e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9e80762d0 0x7fa9e8078790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faa040ca710 tx=0x7faa00009040 comp rx=0 tx=0).stop 2024-05-10T11:18:18.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 msgr2=0x7faa040cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 0x7faa040cdfe0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f40046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 shutdown_connections 2024-05-10T11:18:18.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9e80762d0 0x7fa9e8078790 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa040ce520 0x7faa040ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa04162b30 0x7faa040cdfe0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 --2- 172.21.15.66:0/1476327939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa04162750 0x7faa040c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 >> 172.21.15.66:0/1476327939 conn(0x7faa0409e3b0 msgr2=0x7faa0406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:18.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 shutdown_connections 2024-05-10T11:18:18.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.208+0000 7faa0c06b640 1 -- 172.21.15.66:0/1476327939 wait complete. 2024-05-10T11:18:18.220 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:18:18.220 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:18:18.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.323+0000 7ff80dea0640 1 Processor -- start 2024-05-10T11:18:18.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.323+0000 7ff80dea0640 1 -- start start 2024-05-10T11:18:18.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff80dea0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff808163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff80dea0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff80815f620 0x7ff80815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff80dea0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8080704c0 0x7ff808070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff80dea0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff80806cd70 con 0x7ff8080704c0 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff80dea0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff808163ba0 con 0x7ff80815f620 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff80dea0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff808160190 con 0x7ff80806c990 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8080704c0 0x7ff808070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8080704c0 0x7ff808070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36116/0 (socket says 172.21.15.66:36116) 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 -- 172.21.15.66:0/2374214824 learned_addr learned my addr 172.21.15.66:0/2374214824 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff806ffd640 1 --2- 172.21.15.66:0/2374214824 >> v2:172.21.15.190:3300/0 conn(0x7ff80815f620 0x7ff80815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 -- 172.21.15.66:0/2374214824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 msgr2=0x7ff808163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff8077fe640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff808163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff808163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 -- 172.21.15.66:0/2374214824 >> v2:172.21.15.190:3300/0 conn(0x7ff80815f620 msgr2=0x7ff80815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 --2- 172.21.15.66:0/2374214824 >> v2:172.21.15.190:3300/0 conn(0x7ff80815f620 0x7ff80815fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff807fff640 1 -- 172.21.15.66:0/2374214824 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff808160470 con 0x7ff8080704c0 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.324+0000 7ff806ffd640 1 --2- 172.21.15.66:0/2374214824 >> v2:172.21.15.190:3300/0 conn(0x7ff80815f620 0x7ff80815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.325+0000 7ff8077fe640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff808163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.325+0000 7ff807fff640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8080704c0 0x7ff808070920 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff80806e400 tx=0x7ff80002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803920a2cc38e58a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.325+0000 7ff8067fc640 1 -- 172.21.15.66:0/2374214824 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800036070 con 0x7ff8080704c0 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.325+0000 7ff8067fc640 1 -- 172.21.15.66:0/2374214824 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff800031600 con 0x7ff8080704c0 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.325+0000 7ff8067fc640 1 -- 172.21.15.66:0/2374214824 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8000319d0 con 0x7ff8080704c0 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 -- 172.21.15.66:0/2374214824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8080704c0 msgr2=0x7ff808070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8080704c0 0x7ff808070920 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff80806e400 tx=0x7ff80002a6a0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 -- 172.21.15.66:0/2374214824 shutdown_connections 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8080704c0 0x7ff808070920 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 --2- 172.21.15.66:0/2374214824 >> v2:172.21.15.190:3300/0 conn(0x7ff80815f620 0x7ff80815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 --2- 172.21.15.66:0/2374214824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff808163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 -- 172.21.15.66:0/2374214824 >> 172.21.15.66:0/2374214824 conn(0x7ff8080b3980 msgr2=0x7ff8080b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:18.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 -- 172.21.15.66:0/2374214824 shutdown_connections 2024-05-10T11:18:18.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.326+0000 7ff80dea0640 1 -- 172.21.15.66:0/2374214824 wait complete. 2024-05-10T11:18:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.327+0000 7ff80dea0640 1 Processor -- start 2024-05-10T11:18:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.327+0000 7ff80dea0640 1 -- start start 2024-05-10T11:18:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff80dea0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff80814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff80dea0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8080704c0 0x7ff8080b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff80dea0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 0x7ff8080c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff80dea0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff808070e60 con 0x7ff80815f620 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff80dea0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff808163140 con 0x7ff8080704c0 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff80dea0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff808073e70 con 0x7ff80806c990 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff807fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 0x7ff8080c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff807fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 0x7ff8080c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36120/0 (socket says 172.21.15.66:36120) 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff807fff640 1 -- 172.21.15.66:0/163485568 learned_addr learned my addr 172.21.15.66:0/163485568 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff806ffd640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8080704c0 0x7ff8080b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.328+0000 7ff8077fe640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff80814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff807fff640 1 -- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 msgr2=0x7ff80814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff807fff640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff80814e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff807fff640 1 -- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8080704c0 msgr2=0x7ff8080b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff807fff640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8080704c0 0x7ff8080b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff807fff640 1 -- 172.21.15.66:0/163485568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8080b4930 con 0x7ff80815f620 2024-05-10T11:18:18.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff807fff640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 0x7ff8080c73b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff80002ac90 tx=0x7ff800004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80003f020 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff800037040 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8080b4c10 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800036070 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.329+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8080b51d0 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.330+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8080b53d0 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.331+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff800042020 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.331+0000 7ff7effff640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff7f40762d0 0x7ff7f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.331+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7ff8000b7ce0 con 0x7ff80815f620 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.332+0000 7ff8077fe640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff7f40762d0 0x7ff7f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.332+0000 7ff8077fe640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff7f40762d0 0x7ff7f4078790 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a980 tx=0x7ff7f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.336+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff8080b53d0 con 0x7ff80815f620 2024-05-10T11:18:18.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.524+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff80806a220 con 0x7ff7f40762d0 2024-05-10T11:18:18.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.530+0000 7ff7effff640 1 -- 172.21.15.66:0/163485568 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250215 (secure 0 0 0) 0x7ff80806a220 con 0x7ff7f40762d0 2024-05-10T11:18:18.533 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:18.535 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:18:18.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff7f40762d0 msgr2=0x7ff7f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff7f40762d0 0x7ff7f4078790 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a980 tx=0x7ff7f8008040 comp rx=0 tx=0).stop 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 msgr2=0x7ff8080c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 0x7ff8080c73b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff80002ac90 tx=0x7ff800004a40 comp rx=0 tx=0).stop 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 shutdown_connections 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff7f40762d0 0x7ff7f4078790 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff80815f620 0x7ff8080c73b0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8080704c0 0x7ff8080b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 --2- 172.21.15.66:0/163485568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff80806c990 0x7ff80814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 >> 172.21.15.66:0/163485568 conn(0x7ff8080b3980 msgr2=0x7ff8080d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 shutdown_connections 2024-05-10T11:18:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.533+0000 7ff80dea0640 1 -- 172.21.15.66:0/163485568 wait complete. 2024-05-10T11:18:18.545 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-05-10T11:18:17.771038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":120,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254840,"kb_used_data":9532,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719880,"statfs":{"total":773094113280,"available":772833157120,"internally_reserved":0,"allocated":9760768,"data_stored":5082251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.297458"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590129+0000","last_change":"2024-05-10T11:18:14.504149+0000","last_active":"2024-05-10T11:18:15.590129+0000","last_peered":"2024-05-10T11:18:15.590129+0000","last_clean":"2024-05-10T11:18:15.590129+0000","last_became_active":"2024-05-10T11:18:14.503828+0000","last_became_peered":"2024-05-10T11:18:14.503828+0000","last_unstale":"2024-05-10T11:18:15.590129+0000","last_undegraded":"2024-05-10T11:18:15.590129+0000","last_fullsized":"2024-05-10T11:18:15.590129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504194+0000","last_change":"2024-05-10T11:18:14.505657+0000","last_active":"2024-05-10T11:18:15.504194+0000","last_peered":"2024-05-10T11:18:15.504194+0000","last_clean":"2024-05-10T11:18:15.504194+0000","last_became_active":"2024-05-10T11:18:14.505269+0000","last_became_peered":"2024-05-10T11:18:14.505269+0000","last_unstale":"2024-05-10T11:18:15.504194+0000","last_undegraded":"2024-05-10T11:18:15.504194+0000","last_fullsized":"2024-05-10T11:18:15.504194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:25.863275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589626+0000","last_change":"2024-05-10T11:18:14.502679+0000","last_active":"2024-05-10T11:18:15.589626+0000","last_peered":"2024-05-10T11:18:15.589626+0000","last_clean":"2024-05-10T11:18:15.589626+0000","last_became_active":"2024-05-10T11:18:14.502382+0000","last_became_peered":"2024-05-10T11:18:14.502382+0000","last_unstale":"2024-05-10T11:18:15.589626+0000","last_undegraded":"2024-05-10T11:18:15.589626+0000","last_fullsized":"2024-05-10T11:18:15.589626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590425+0000","last_change":"2024-05-10T11:18:14.505319+0000","last_active":"2024-05-10T11:18:15.590425+0000","last_peered":"2024-05-10T11:18:15.590425+0000","last_clean":"2024-05-10T11:18:15.590425+0000","last_became_active":"2024-05-10T11:18:14.504964+0000","last_became_peered":"2024-05-10T11:18:14.504964+0000","last_unstale":"2024-05-10T11:18:15.590425+0000","last_undegraded":"2024-05-10T11:18:15.590425+0000","last_fullsized":"2024-05-10T11:18:15.590425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.482266+0000","last_change":"2024-05-10T11:18:13.482266+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.482266+0000","last_undegraded":"2024-05-10T11:18:13.482266+0000","last_fullsized":"2024-05-10T11:18:13.482266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589202+0000","last_change":"2024-05-10T11:18:14.510117+0000","last_active":"2024-05-10T11:18:15.589202+0000","last_peered":"2024-05-10T11:18:15.589202+0000","last_clean":"2024-05-10T11:18:15.589202+0000","last_became_active":"2024-05-10T11:18:14.509816+0000","last_became_peered":"2024-05-10T11:18:14.509816+0000","last_unstale":"2024-05-10T11:18:15.589202+0000","last_undegraded":"2024-05-10T11:18:15.589202+0000","last_fullsized":"2024-05-10T11:18:15.589202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:24.104590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480100+0000","last_change":"2024-05-10T11:18:13.480100+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480100+0000","last_undegraded":"2024-05-10T11:18:13.480100+0000","last_fullsized":"2024-05-10T11:18:13.480100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588832+0000","last_change":"2024-05-10T11:18:14.496569+0000","last_active":"2024-05-10T11:18:15.588832+0000","last_peered":"2024-05-10T11:18:15.588832+0000","last_clean":"2024-05-10T11:18:15.588832+0000","last_became_active":"2024-05-10T11:18:14.494250+0000","last_became_peered":"2024-05-10T11:18:14.494250+0000","last_unstale":"2024-05-10T11:18:15.588832+0000","last_undegraded":"2024-05-10T11:18:15.588832+0000","last_fullsized":"2024-05-10T11:18:15.588832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:47.808143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.482263+0000","last_change":"2024-05-10T11:18:13.482263+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.482263+0000","last_undegraded":"2024-05-10T11:18:13.482263+0000","last_fullsized":"2024-05-10T11:18:13.482263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500560+0000","last_change":"2024-05-10T11:18:14.509973+0000","last_active":"2024-05-10T11:18:15.500560+0000","last_peered":"2024-05-10T11:18:15.500560+0000","last_clean":"2024-05-10T11:18:15.500560+0000","last_became_active":"2024-05-10T11:18:14.509543+0000","last_became_peered":"2024-05-10T11:18:14.509543+0000","last_unstale":"2024-05-10T11:18:15.500560+0000","last_undegraded":"2024-05-10T11:18:15.500560+0000","last_fullsized":"2024-05-10T11:18:15.500560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:01.778938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481935+0000","last_change":"2024-05-10T11:18:13.481935+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481935+0000","last_undegraded":"2024-05-10T11:18:13.481935+0000","last_fullsized":"2024-05-10T11:18:13.481935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500601+0000","last_change":"2024-05-10T11:18:14.515247+0000","last_active":"2024-05-10T11:18:15.500601+0000","last_peered":"2024-05-10T11:18:15.500601+0000","last_clean":"2024-05-10T11:18:15.500601+0000","last_became_active":"2024-05-10T11:18:14.514931+0000","last_became_peered":"2024-05-10T11:18:14.514931+0000","last_unstale":"2024-05-10T11:18:15.500601+0000","last_undegraded":"2024-05-10T11:18:15.500601+0000","last_fullsized":"2024-05-10T11:18:15.500601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:59.852003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590206+0000","last_change":"2024-05-10T11:18:14.495959+0000","last_active":"2024-05-10T11:18:15.590206+0000","last_peered":"2024-05-10T11:18:15.590206+0000","last_clean":"2024-05-10T11:18:15.590206+0000","last_became_active":"2024-05-10T11:18:14.494391+0000","last_became_peered":"2024-05-10T11:18:14.494391+0000","last_unstale":"2024-05-10T11:18:15.590206+0000","last_undegraded":"2024-05-10T11:18:15.590206+0000","last_fullsized":"2024-05-10T11:18:15.590206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:10.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481095+0000","last_change":"2024-05-10T11:18:13.481095+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481095+0000","last_undegraded":"2024-05-10T11:18:13.481095+0000","last_fullsized":"2024-05-10T11:18:13.481095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589287+0000","last_change":"2024-05-10T11:18:14.500781+0000","last_active":"2024-05-10T11:18:15.589287+0000","last_peered":"2024-05-10T11:18:15.589287+0000","last_clean":"2024-05-10T11:18:15.589287+0000","last_became_active":"2024-05-10T11:18:14.500434+0000","last_became_peered":"2024-05-10T11:18:14.500434+0000","last_unstale":"2024-05-10T11:18:15.589287+0000","last_undegraded":"2024-05-10T11:18:15.589287+0000","last_fullsized":"2024-05-10T11:18:15.589287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:51.953240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589304+0000","last_change":"2024-05-10T11:18:14.511780+0000","last_active":"2024-05-10T11:18:15.589304+0000","last_peered":"2024-05-10T11:18:15.589304+0000","last_clean":"2024-05-10T11:18:15.589304+0000","last_became_active":"2024-05-10T11:18:14.510880+0000","last_became_peered":"2024-05-10T11:18:14.510880+0000","last_unstale":"2024-05-10T11:18:15.589304+0000","last_undegraded":"2024-05-10T11:18:15.589304+0000","last_fullsized":"2024-05-10T11:18:15.589304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:54:34.155865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589852+0000","last_change":"2024-05-10T11:18:14.499725+0000","last_active":"2024-05-10T11:18:15.589852+0000","last_peered":"2024-05-10T11:18:15.589852+0000","last_clean":"2024-05-10T11:18:15.589852+0000","last_became_active":"2024-05-10T11:18:14.499366+0000","last_became_peered":"2024-05-10T11:18:14.499366+0000","last_unstale":"2024-05-10T11:18:15.589852+0000","last_undegraded":"2024-05-10T11:18:15.589852+0000","last_fullsized":"2024-05-10T11:18:15.589852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:43.303098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589057+0000","last_change":"2024-05-10T11:18:14.506434+0000","last_active":"2024-05-10T11:18:15.589057+0000","last_peered":"2024-05-10T11:18:15.589057+0000","last_clean":"2024-05-10T11:18:15.589057+0000","last_became_active":"2024-05-10T11:18:14.506161+0000","last_became_peered":"2024-05-10T11:18:14.506161+0000","last_unstale":"2024-05-10T11:18:15.589057+0000","last_undegraded":"2024-05-10T11:18:15.589057+0000","last_fullsized":"2024-05-10T11:18:15.589057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481104+0000","last_change":"2024-05-10T11:18:13.481104+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481104+0000","last_undegraded":"2024-05-10T11:18:13.481104+0000","last_fullsized":"2024-05-10T11:18:13.481104+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590428+0000","last_change":"2024-05-10T11:18:14.500701+0000","last_active":"2024-05-10T11:18:15.590428+0000","last_peered":"2024-05-10T11:18:15.590428+0000","last_clean":"2024-05-10T11:18:15.590428+0000","last_became_active":"2024-05-10T11:18:14.500377+0000","last_became_peered":"2024-05-10T11:18:14.500377+0000","last_unstale":"2024-05-10T11:18:15.590428+0000","last_undegraded":"2024-05-10T11:18:15.590428+0000","last_fullsized":"2024-05-10T11:18:15.590428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480592+0000","last_change":"2024-05-10T11:18:13.480592+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480592+0000","last_undegraded":"2024-05-10T11:18:13.480592+0000","last_fullsized":"2024-05-10T11:18:13.480592+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480133+0000","last_change":"2024-05-10T11:18:13.480133+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480133+0000","last_undegraded":"2024-05-10T11:18:13.480133+0000","last_fullsized":"2024-05-10T11:18:13.480133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476134+0000","last_change":"2024-05-10T11:18:13.476134+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476134+0000","last_undegraded":"2024-05-10T11:18:13.476134+0000","last_fullsized":"2024-05-10T11:18:13.476134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589152+0000","last_change":"2024-05-10T11:18:14.496012+0000","last_active":"2024-05-10T11:18:15.589152+0000","last_peered":"2024-05-10T11:18:15.589152+0000","last_clean":"2024-05-10T11:18:15.589152+0000","last_became_active":"2024-05-10T11:18:14.495715+0000","last_became_peered":"2024-05-10T11:18:14.495715+0000","last_unstale":"2024-05-10T11:18:15.589152+0000","last_undegraded":"2024-05-10T11:18:15.589152+0000","last_fullsized":"2024-05-10T11:18:15.589152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.509349+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.509077+0000","last_became_peered":"2024-05-10T11:18:14.509077+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.479522+0000","last_change":"2024-05-10T11:18:13.479522+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.479522+0000","last_undegraded":"2024-05-10T11:18:13.479522+0000","last_fullsized":"2024-05-10T11:18:13.479522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500648+0000","last_change":"2024-05-10T11:18:14.515113+0000","last_active":"2024-05-10T11:18:15.500648+0000","last_peered":"2024-05-10T11:18:15.500648+0000","last_clean":"2024-05-10T11:18:15.500648+0000","last_became_active":"2024-05-10T11:18:14.514824+0000","last_became_peered":"2024-05-10T11:18:14.514824+0000","last_unstale":"2024-05-10T11:18:15.500648+0000","last_undegraded":"2024-05-10T11:18:15.500648+0000","last_fullsized":"2024-05-10T11:18:15.500648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:48.996486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590608+0000","last_change":"2024-05-10T11:18:14.512508+0000","last_active":"2024-05-10T11:18:15.590608+0000","last_peered":"2024-05-10T11:18:15.590608+0000","last_clean":"2024-05-10T11:18:15.590608+0000","last_became_active":"2024-05-10T11:18:14.512218+0000","last_became_peered":"2024-05-10T11:18:14.512218+0000","last_unstale":"2024-05-10T11:18:15.590608+0000","last_undegraded":"2024-05-10T11:18:15.590608+0000","last_fullsized":"2024-05-10T11:18:15.590608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480635+0000","last_change":"2024-05-10T11:18:13.480635+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480635+0000","last_undegraded":"2024-05-10T11:18:13.480635+0000","last_fullsized":"2024-05-10T11:18:13.480635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.479341+0000","last_change":"2024-05-10T11:18:13.479341+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.479341+0000","last_undegraded":"2024-05-10T11:18:13.479341+0000","last_fullsized":"2024-05-10T11:18:13.479341+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503674+0000","last_change":"2024-05-10T11:18:14.507356+0000","last_active":"2024-05-10T11:18:15.503674+0000","last_peered":"2024-05-10T11:18:15.503674+0000","last_clean":"2024-05-10T11:18:15.503674+0000","last_became_active":"2024-05-10T11:18:14.507037+0000","last_became_peered":"2024-05-10T11:18:14.507037+0000","last_unstale":"2024-05-10T11:18:15.503674+0000","last_undegraded":"2024-05-10T11:18:15.503674+0000","last_fullsized":"2024-05-10T11:18:15.503674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589362+0000","last_change":"2024-05-10T11:18:14.511137+0000","last_active":"2024-05-10T11:18:15.589362+0000","last_peered":"2024-05-10T11:18:15.589362+0000","last_clean":"2024-05-10T11:18:15.589362+0000","last_became_active":"2024-05-10T11:18:14.510460+0000","last_became_peered":"2024-05-10T11:18:14.510460+0000","last_unstale":"2024-05-10T11:18:15.589362+0000","last_undegraded":"2024-05-10T11:18:15.589362+0000","last_fullsized":"2024-05-10T11:18:15.589362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:45.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588999+0000","last_change":"2024-05-10T11:18:14.509145+0000","last_active":"2024-05-10T11:18:15.588999+0000","last_peered":"2024-05-10T11:18:15.588999+0000","last_clean":"2024-05-10T11:18:15.588999+0000","last_became_active":"2024-05-10T11:18:14.507612+0000","last_became_peered":"2024-05-10T11:18:14.507612+0000","last_unstale":"2024-05-10T11:18:15.588999+0000","last_undegraded":"2024-05-10T11:18:15.588999+0000","last_fullsized":"2024-05-10T11:18:15.588999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:59.817611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490686+0000","last_change":"2024-05-10T11:18:13.489312+0000","last_active":"2024-05-10T11:18:13.490686+0000","last_peered":"2024-05-10T11:18:13.490686+0000","last_clean":"2024-05-10T11:18:13.490686+0000","last_became_active":"2024-05-10T11:18:13.489055+0000","last_became_peered":"2024-05-10T11:18:13.489055+0000","last_unstale":"2024-05-10T11:18:13.490686+0000","last_undegraded":"2024-05-10T11:18:13.490686+0000","last_fullsized":"2024-05-10T11:18:13.490686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:05.647628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589488+0000","last_change":"2024-05-10T11:18:14.506891+0000","last_active":"2024-05-10T11:18:15.589488+0000","last_peered":"2024-05-10T11:18:15.589488+0000","last_clean":"2024-05-10T11:18:15.589488+0000","last_became_active":"2024-05-10T11:18:14.506604+0000","last_became_peered":"2024-05-10T11:18:14.506604+0000","last_unstale":"2024-05-10T11:18:15.589488+0000","last_undegraded":"2024-05-10T11:18:15.589488+0000","last_fullsized":"2024-05-10T11:18:15.589488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:46.769438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494187+0000","last_change":"2024-05-10T11:18:13.487405+0000","last_active":"2024-05-10T11:18:13.494187+0000","last_peered":"2024-05-10T11:18:13.494187+0000","last_clean":"2024-05-10T11:18:13.494187+0000","last_became_active":"2024-05-10T11:18:13.487122+0000","last_became_peered":"2024-05-10T11:18:13.487122+0000","last_unstale":"2024-05-10T11:18:13.494187+0000","last_undegraded":"2024-05-10T11:18:13.494187+0000","last_fullsized":"2024-05-10T11:18:13.494187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:00.910751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481049+0000","last_change":"2024-05-10T11:18:13.481049+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481049+0000","last_undegraded":"2024-05-10T11:18:13.481049+0000","last_fullsized":"2024-05-10T11:18:13.481049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494227+0000","last_change":"2024-05-10T11:18:13.491023+0000","last_active":"2024-05-10T11:18:13.494227+0000","last_peered":"2024-05-10T11:18:13.494227+0000","last_clean":"2024-05-10T11:18:13.494227+0000","last_became_active":"2024-05-10T11:18:13.490750+0000","last_became_peered":"2024-05-10T11:18:13.490750+0000","last_unstale":"2024-05-10T11:18:13.494227+0000","last_undegraded":"2024-05-10T11:18:13.494227+0000","last_fullsized":"2024-05-10T11:18:13.494227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:04.210949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.517446+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.517158+0000","last_became_peered":"2024-05-10T11:18:14.517158+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:59.932591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.497192+0000","last_change":"2024-05-10T11:18:13.496226+0000","last_active":"2024-05-10T11:18:13.497192+0000","last_peered":"2024-05-10T11:18:13.497192+0000","last_clean":"2024-05-10T11:18:13.497192+0000","last_became_active":"2024-05-10T11:18:13.495965+0000","last_became_peered":"2024-05-10T11:18:13.495965+0000","last_unstale":"2024-05-10T11:18:13.497192+0000","last_undegraded":"2024-05-10T11:18:13.497192+0000","last_fullsized":"2024-05-10T11:18:13.497192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:13.594607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588902+0000","last_change":"2024-05-10T11:18:14.502176+0000","last_active":"2024-05-10T11:18:15.588902+0000","last_peered":"2024-05-10T11:18:15.588902+0000","last_clean":"2024-05-10T11:18:15.588902+0000","last_became_active":"2024-05-10T11:18:14.501901+0000","last_became_peered":"2024-05-10T11:18:14.501901+0000","last_unstale":"2024-05-10T11:18:15.588902+0000","last_undegraded":"2024-05-10T11:18:15.588902+0000","last_fullsized":"2024-05-10T11:18:15.588902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:22.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494241+0000","last_change":"2024-05-10T11:18:13.489468+0000","last_active":"2024-05-10T11:18:13.494241+0000","last_peered":"2024-05-10T11:18:13.494241+0000","last_clean":"2024-05-10T11:18:13.494241+0000","last_became_active":"2024-05-10T11:18:13.489197+0000","last_became_peered":"2024-05-10T11:18:13.489197+0000","last_unstale":"2024-05-10T11:18:13.494241+0000","last_undegraded":"2024-05-10T11:18:13.494241+0000","last_fullsized":"2024-05-10T11:18:13.494241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:15:38.738963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.475557+0000","last_change":"2024-05-10T11:18:13.475557+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.475557+0000","last_undegraded":"2024-05-10T11:18:13.475557+0000","last_fullsized":"2024-05-10T11:18:13.475557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589863+0000","last_change":"2024-05-10T11:18:13.499705+0000","last_active":"2024-05-10T11:18:15.589863+0000","last_peered":"2024-05-10T11:18:15.589863+0000","last_clean":"2024-05-10T11:18:15.589863+0000","last_became_active":"2024-05-10T11:18:13.499448+0000","last_became_peered":"2024-05-10T11:18:13.499448+0000","last_unstale":"2024-05-10T11:18:15.589863+0000","last_undegraded":"2024-05-10T11:18:15.589863+0000","last_fullsized":"2024-05-10T11:18:15.589863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:22.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589016+0000","last_change":"2024-05-10T11:18:14.510528+0000","last_active":"2024-05-10T11:18:15.589016+0000","last_peered":"2024-05-10T11:18:15.589016+0000","last_clean":"2024-05-10T11:18:15.589016+0000","last_became_active":"2024-05-10T11:18:14.510212+0000","last_became_peered":"2024-05-10T11:18:14.510212+0000","last_unstale":"2024-05-10T11:18:15.589016+0000","last_undegraded":"2024-05-10T11:18:15.589016+0000","last_fullsized":"2024-05-10T11:18:15.589016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.308953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589373+0000","last_change":"2024-05-10T11:18:13.484546+0000","last_active":"2024-05-10T11:18:15.589373+0000","last_peered":"2024-05-10T11:18:15.589373+0000","last_clean":"2024-05-10T11:18:15.589373+0000","last_became_active":"2024-05-10T11:18:13.484252+0000","last_became_peered":"2024-05-10T11:18:13.484252+0000","last_unstale":"2024-05-10T11:18:15.589373+0000","last_undegraded":"2024-05-10T11:18:15.589373+0000","last_fullsized":"2024-05-10T11:18:15.589373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:23.840058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590407+0000","last_change":"2024-05-10T11:18:14.502695+0000","last_active":"2024-05-10T11:18:15.590407+0000","last_peered":"2024-05-10T11:18:15.590407+0000","last_clean":"2024-05-10T11:18:15.590407+0000","last_became_active":"2024-05-10T11:18:14.502130+0000","last_became_peered":"2024-05-10T11:18:14.502130+0000","last_unstale":"2024-05-10T11:18:15.590407+0000","last_undegraded":"2024-05-10T11:18:15.590407+0000","last_fullsized":"2024-05-10T11:18:15.590407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494827+0000","last_change":"2024-05-10T11:18:13.492663+0000","last_active":"2024-05-10T11:18:13.494827+0000","last_peered":"2024-05-10T11:18:13.494827+0000","last_clean":"2024-05-10T11:18:13.494827+0000","last_became_active":"2024-05-10T11:18:13.492415+0000","last_became_peered":"2024-05-10T11:18:13.492415+0000","last_unstale":"2024-05-10T11:18:13.494827+0000","last_undegraded":"2024-05-10T11:18:13.494827+0000","last_fullsized":"2024-05-10T11:18:13.494827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:11.795689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478825+0000","last_change":"2024-05-10T11:18:13.478825+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478825+0000","last_undegraded":"2024-05-10T11:18:13.478825+0000","last_fullsized":"2024-05-10T11:18:13.478825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504114+0000","last_change":"2024-05-10T11:18:13.489382+0000","last_active":"2024-05-10T11:18:15.504114+0000","last_peered":"2024-05-10T11:18:15.504114+0000","last_clean":"2024-05-10T11:18:15.504114+0000","last_became_active":"2024-05-10T11:18:13.489117+0000","last_became_peered":"2024-05-10T11:18:13.489117+0000","last_unstale":"2024-05-10T11:18:15.504114+0000","last_undegraded":"2024-05-10T11:18:15.504114+0000","last_fullsized":"2024-05-10T11:18:15.504114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:58.559240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480549+0000","last_change":"2024-05-10T11:18:13.480549+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480549+0000","last_undegraded":"2024-05-10T11:18:13.480549+0000","last_fullsized":"2024-05-10T11:18:13.480549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:13.496483+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:13.496161+0000","last_became_peered":"2024-05-10T11:18:13.496161+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589755+0000","last_change":"2024-05-10T11:18:14.505565+0000","last_active":"2024-05-10T11:18:15.589755+0000","last_peered":"2024-05-10T11:18:15.589755+0000","last_clean":"2024-05-10T11:18:15.589755+0000","last_became_active":"2024-05-10T11:18:14.504514+0000","last_became_peered":"2024-05-10T11:18:14.504514+0000","last_unstale":"2024-05-10T11:18:15.589755+0000","last_undegraded":"2024-05-10T11:18:15.589755+0000","last_fullsized":"2024-05-10T11:18:15.589755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.496840+0000","last_change":"2024-05-10T11:18:13.492466+0000","last_active":"2024-05-10T11:18:13.496840+0000","last_peered":"2024-05-10T11:18:13.496840+0000","last_clean":"2024-05-10T11:18:13.496840+0000","last_became_active":"2024-05-10T11:18:13.492210+0000","last_became_peered":"2024-05-10T11:18:13.492210+0000","last_unstale":"2024-05-10T11:18:13.496840+0000","last_undegraded":"2024-05-10T11:18:13.496840+0000","last_fullsized":"2024-05-10T11:18:13.496840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590683+0000","last_change":"2024-05-10T11:18:14.506980+0000","last_active":"2024-05-10T11:18:15.590683+0000","last_peered":"2024-05-10T11:18:15.590683+0000","last_clean":"2024-05-10T11:18:15.590683+0000","last_became_active":"2024-05-10T11:18:14.506669+0000","last_became_peered":"2024-05-10T11:18:14.506669+0000","last_unstale":"2024-05-10T11:18:15.590683+0000","last_undegraded":"2024-05-10T11:18:15.590683+0000","last_fullsized":"2024-05-10T11:18:15.590683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589688+0000","last_change":"2024-05-10T11:18:13.491065+0000","last_active":"2024-05-10T11:18:15.589688+0000","last_peered":"2024-05-10T11:18:15.589688+0000","last_clean":"2024-05-10T11:18:15.589688+0000","last_became_active":"2024-05-10T11:18:13.490740+0000","last_became_peered":"2024-05-10T11:18:13.490740+0000","last_unstale":"2024-05-10T11:18:15.589688+0000","last_undegraded":"2024-05-10T11:18:15.589688+0000","last_fullsized":"2024-05-10T11:18:15.589688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:17.665658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588979+0000","last_change":"2024-05-10T11:18:14.492654+0000","last_active":"2024-05-10T11:18:15.588979+0000","last_peered":"2024-05-10T11:18:15.588979+0000","last_clean":"2024-05-10T11:18:15.588979+0000","last_became_active":"2024-05-10T11:18:14.492328+0000","last_became_peered":"2024-05-10T11:18:14.492328+0000","last_unstale":"2024-05-10T11:18:15.588979+0000","last_undegraded":"2024-05-10T11:18:15.588979+0000","last_fullsized":"2024-05-10T11:18:15.588979+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:24:34.509745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494959+0000","last_change":"2024-05-10T11:18:13.493293+0000","last_active":"2024-05-10T11:18:13.494959+0000","last_peered":"2024-05-10T11:18:13.494959+0000","last_clean":"2024-05-10T11:18:13.494959+0000","last_became_active":"2024-05-10T11:18:13.493029+0000","last_became_peered":"2024-05-10T11:18:13.493029+0000","last_unstale":"2024-05-10T11:18:13.494959+0000","last_undegraded":"2024-05-10T11:18:13.494959+0000","last_fullsized":"2024-05-10T11:18:13.494959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:48.659582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478374+0000","last_change":"2024-05-10T11:18:13.478374+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478374+0000","last_undegraded":"2024-05-10T11:18:13.478374+0000","last_fullsized":"2024-05-10T11:18:13.478374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589062+0000","last_change":"2024-05-10T11:18:13.491930+0000","last_active":"2024-05-10T11:18:15.589062+0000","last_peered":"2024-05-10T11:18:15.589062+0000","last_clean":"2024-05-10T11:18:15.589062+0000","last_became_active":"2024-05-10T11:18:13.491576+0000","last_became_peered":"2024-05-10T11:18:13.491576+0000","last_unstale":"2024-05-10T11:18:15.589062+0000","last_undegraded":"2024-05-10T11:18:15.589062+0000","last_fullsized":"2024-05-10T11:18:15.589062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:20.216601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500392+0000","last_change":"2024-05-10T11:18:14.512578+0000","last_active":"2024-05-10T11:18:15.500392+0000","last_peered":"2024-05-10T11:18:15.500392+0000","last_clean":"2024-05-10T11:18:15.500392+0000","last_became_active":"2024-05-10T11:18:14.512273+0000","last_became_peered":"2024-05-10T11:18:14.512273+0000","last_unstale":"2024-05-10T11:18:15.500392+0000","last_undegraded":"2024-05-10T11:18:15.500392+0000","last_fullsized":"2024-05-10T11:18:15.500392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:16.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589418+0000","last_change":"2024-05-10T11:18:13.494933+0000","last_active":"2024-05-10T11:18:15.589418+0000","last_peered":"2024-05-10T11:18:15.589418+0000","last_clean":"2024-05-10T11:18:15.589418+0000","last_became_active":"2024-05-10T11:18:13.494632+0000","last_became_peered":"2024-05-10T11:18:13.494632+0000","last_unstale":"2024-05-10T11:18:15.589418+0000","last_undegraded":"2024-05-10T11:18:15.589418+0000","last_fullsized":"2024-05-10T11:18:15.589418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.988757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500556+0000","last_change":"2024-05-10T11:18:14.512697+0000","last_active":"2024-05-10T11:18:15.500556+0000","last_peered":"2024-05-10T11:18:15.500556+0000","last_clean":"2024-05-10T11:18:15.500556+0000","last_became_active":"2024-05-10T11:18:14.512424+0000","last_became_peered":"2024-05-10T11:18:14.512424+0000","last_unstale":"2024-05-10T11:18:15.500556+0000","last_undegraded":"2024-05-10T11:18:15.500556+0000","last_fullsized":"2024-05-10T11:18:15.500556+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:16.972744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589019+0000","last_change":"2024-05-10T11:18:13.499748+0000","last_active":"2024-05-10T11:18:15.589019+0000","last_peered":"2024-05-10T11:18:15.589019+0000","last_clean":"2024-05-10T11:18:15.589019+0000","last_became_active":"2024-05-10T11:18:13.499424+0000","last_became_peered":"2024-05-10T11:18:13.499424+0000","last_unstale":"2024-05-10T11:18:15.589019+0000","last_undegraded":"2024-05-10T11:18:15.589019+0000","last_fullsized":"2024-05-10T11:18:15.589019+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:45.777827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589632+0000","last_change":"2024-05-10T11:18:14.509330+0000","last_active":"2024-05-10T11:18:15.589632+0000","last_peered":"2024-05-10T11:18:15.589632+0000","last_clean":"2024-05-10T11:18:15.589632+0000","last_became_active":"2024-05-10T11:18:14.507243+0000","last_became_peered":"2024-05-10T11:18:14.507243+0000","last_unstale":"2024-05-10T11:18:15.589632+0000","last_undegraded":"2024-05-10T11:18:15.589632+0000","last_fullsized":"2024-05-10T11:18:15.589632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:16.911693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.486282+0000","last_change":"2024-05-10T11:18:13.484923+0000","last_active":"2024-05-10T11:18:13.486282+0000","last_peered":"2024-05-10T11:18:13.486282+0000","last_clean":"2024-05-10T11:18:13.486282+0000","last_became_active":"2024-05-10T11:18:13.484625+0000","last_became_peered":"2024-05-10T11:18:13.484625+0000","last_unstale":"2024-05-10T11:18:13.486282+0000","last_undegraded":"2024-05-10T11:18:13.486282+0000","last_fullsized":"2024-05-10T11:18:13.486282+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:57:04.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.475691+0000","last_change":"2024-05-10T11:18:13.475691+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.475691+0000","last_undegraded":"2024-05-10T11:18:13.475691+0000","last_fullsized":"2024-05-10T11:18:13.475691+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490572+0000","last_change":"2024-05-10T11:18:13.488650+0000","last_active":"2024-05-10T11:18:13.490572+0000","last_peered":"2024-05-10T11:18:13.490572+0000","last_clean":"2024-05-10T11:18:13.490572+0000","last_became_active":"2024-05-10T11:18:13.488336+0000","last_became_peered":"2024-05-10T11:18:13.488336+0000","last_unstale":"2024-05-10T11:18:13.490572+0000","last_undegraded":"2024-05-10T11:18:13.490572+0000","last_fullsized":"2024-05-10T11:18:13.490572+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:45.519599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478379+0000","last_change":"2024-05-10T11:18:13.478379+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478379+0000","last_undegraded":"2024-05-10T11:18:13.478379+0000","last_fullsized":"2024-05-10T11:18:13.478379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.496770+0000","last_change":"2024-05-10T11:18:13.491192+0000","last_active":"2024-05-10T11:18:13.496770+0000","last_peered":"2024-05-10T11:18:13.496770+0000","last_clean":"2024-05-10T11:18:13.496770+0000","last_became_active":"2024-05-10T11:18:13.490839+0000","last_became_peered":"2024-05-10T11:18:13.490839+0000","last_unstale":"2024-05-10T11:18:13.496770+0000","last_undegraded":"2024-05-10T11:18:13.496770+0000","last_fullsized":"2024-05-10T11:18:13.496770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:11.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589466+0000","last_change":"2024-05-10T11:18:14.509377+0000","last_active":"2024-05-10T11:18:15.589466+0000","last_peered":"2024-05-10T11:18:15.589466+0000","last_clean":"2024-05-10T11:18:15.589466+0000","last_became_active":"2024-05-10T11:18:14.506328+0000","last_became_peered":"2024-05-10T11:18:14.506328+0000","last_unstale":"2024-05-10T11:18:15.589466+0000","last_undegraded":"2024-05-10T11:18:15.589466+0000","last_fullsized":"2024-05-10T11:18:15.589466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:12.639237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503705+0000","last_change":"2024-05-10T11:18:13.487719+0000","last_active":"2024-05-10T11:18:15.503705+0000","last_peered":"2024-05-10T11:18:15.503705+0000","last_clean":"2024-05-10T11:18:15.503705+0000","last_became_active":"2024-05-10T11:18:13.486232+0000","last_became_peered":"2024-05-10T11:18:13.486232+0000","last_unstale":"2024-05-10T11:18:15.503705+0000","last_undegraded":"2024-05-10T11:18:15.503705+0000","last_fullsized":"2024-05-10T11:18:15.503705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503636+0000","last_change":"2024-05-10T11:18:14.501099+0000","last_active":"2024-05-10T11:18:15.503636+0000","last_peered":"2024-05-10T11:18:15.503636+0000","last_clean":"2024-05-10T11:18:15.503636+0000","last_became_active":"2024-05-10T11:18:14.500491+0000","last_became_peered":"2024-05-10T11:18:14.500491+0000","last_unstale":"2024-05-10T11:18:15.503636+0000","last_undegraded":"2024-05-10T11:18:15.503636+0000","last_fullsized":"2024-05-10T11:18:15.503636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500360+0000","last_change":"2024-05-10T11:18:13.496261+0000","last_active":"2024-05-10T11:18:15.500360+0000","last_peered":"2024-05-10T11:18:15.500360+0000","last_clean":"2024-05-10T11:18:15.500360+0000","last_became_active":"2024-05-10T11:18:13.496010+0000","last_became_peered":"2024-05-10T11:18:13.496010+0000","last_unstale":"2024-05-10T11:18:15.500360+0000","last_undegraded":"2024-05-10T11:18:15.500360+0000","last_fullsized":"2024-05-10T11:18:15.500360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:25.142075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503941+0000","last_change":"2024-05-10T11:18:14.508367+0000","last_active":"2024-05-10T11:18:15.503941+0000","last_peered":"2024-05-10T11:18:15.503941+0000","last_clean":"2024-05-10T11:18:15.503941+0000","last_became_active":"2024-05-10T11:18:14.508114+0000","last_became_peered":"2024-05-10T11:18:14.508114+0000","last_unstale":"2024-05-10T11:18:15.503941+0000","last_undegraded":"2024-05-10T11:18:15.503941+0000","last_fullsized":"2024-05-10T11:18:15.503941+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503746+0000","last_change":"2024-05-10T11:18:13.493893+0000","last_active":"2024-05-10T11:18:15.503746+0000","last_peered":"2024-05-10T11:18:15.503746+0000","last_clean":"2024-05-10T11:18:15.503746+0000","last_became_active":"2024-05-10T11:18:13.493661+0000","last_became_peered":"2024-05-10T11:18:13.493661+0000","last_unstale":"2024-05-10T11:18:15.503746+0000","last_undegraded":"2024-05-10T11:18:15.503746+0000","last_fullsized":"2024-05-10T11:18:15.503746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:21.825243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589340+0000","last_change":"2024-05-10T11:18:14.508876+0000","last_active":"2024-05-10T11:18:15.589340+0000","last_peered":"2024-05-10T11:18:15.589340+0000","last_clean":"2024-05-10T11:18:15.589340+0000","last_became_active":"2024-05-10T11:18:14.508599+0000","last_became_peered":"2024-05-10T11:18:14.508599+0000","last_unstale":"2024-05-10T11:18:15.589340+0000","last_undegraded":"2024-05-10T11:18:15.589340+0000","last_fullsized":"2024-05-10T11:18:15.589340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:49.671324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500251+0000","last_change":"2024-05-10T11:18:13.488510+0000","last_active":"2024-05-10T11:18:15.500251+0000","last_peered":"2024-05-10T11:18:15.500251+0000","last_clean":"2024-05-10T11:18:15.500251+0000","last_became_active":"2024-05-10T11:18:13.488224+0000","last_became_peered":"2024-05-10T11:18:13.488224+0000","last_unstale":"2024-05-10T11:18:15.500251+0000","last_undegraded":"2024-05-10T11:18:15.500251+0000","last_fullsized":"2024-05-10T11:18:15.500251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:57.771228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476649+0000","last_change":"2024-05-10T11:18:13.476649+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476649+0000","last_undegraded":"2024-05-10T11:18:13.476649+0000","last_fullsized":"2024-05-10T11:18:13.476649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490496+0000","last_change":"2024-05-10T11:18:13.486115+0000","last_active":"2024-05-10T11:18:13.490496+0000","last_peered":"2024-05-10T11:18:13.490496+0000","last_clean":"2024-05-10T11:18:13.490496+0000","last_became_active":"2024-05-10T11:18:13.485827+0000","last_became_peered":"2024-05-10T11:18:13.485827+0000","last_unstale":"2024-05-10T11:18:13.490496+0000","last_undegraded":"2024-05-10T11:18:13.490496+0000","last_fullsized":"2024-05-10T11:18:13.490496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:15.763069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589621+0000","last_change":"2024-05-10T11:18:14.508776+0000","last_active":"2024-05-10T11:18:15.589621+0000","last_peered":"2024-05-10T11:18:15.589621+0000","last_clean":"2024-05-10T11:18:15.589621+0000","last_became_active":"2024-05-10T11:18:14.507883+0000","last_became_peered":"2024-05-10T11:18:14.507883+0000","last_unstale":"2024-05-10T11:18:15.589621+0000","last_undegraded":"2024-05-10T11:18:15.589621+0000","last_fullsized":"2024-05-10T11:18:15.589621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:41:09.728598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.491174+0000","last_change":"2024-05-10T11:18:13.486261+0000","last_active":"2024-05-10T11:18:13.491174+0000","last_peered":"2024-05-10T11:18:13.491174+0000","last_clean":"2024-05-10T11:18:13.491174+0000","last_became_active":"2024-05-10T11:18:13.485612+0000","last_became_peered":"2024-05-10T11:18:13.485612+0000","last_unstale":"2024-05-10T11:18:13.491174+0000","last_undegraded":"2024-05-10T11:18:13.491174+0000","last_fullsized":"2024-05-10T11:18:13.491174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:26.233985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589573+0000","last_change":"2024-05-10T11:18:14.503515+0000","last_active":"2024-05-10T11:18:15.589573+0000","last_peered":"2024-05-10T11:18:15.589573+0000","last_clean":"2024-05-10T11:18:15.589573+0000","last_became_active":"2024-05-10T11:18:14.503224+0000","last_became_peered":"2024-05-10T11:18:14.503224+0000","last_unstale":"2024-05-10T11:18:15.589573+0000","last_undegraded":"2024-05-10T11:18:15.589573+0000","last_fullsized":"2024-05-10T11:18:15.589573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:32.860740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.491326+0000","last_change":"2024-05-10T11:18:13.486384+0000","last_active":"2024-05-10T11:18:13.491326+0000","last_peered":"2024-05-10T11:18:13.491326+0000","last_clean":"2024-05-10T11:18:13.491326+0000","last_became_active":"2024-05-10T11:18:13.486083+0000","last_became_peered":"2024-05-10T11:18:13.486083+0000","last_unstale":"2024-05-10T11:18:13.491326+0000","last_undegraded":"2024-05-10T11:18:13.491326+0000","last_fullsized":"2024-05-10T11:18:13.491326+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:09.025915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.505472+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.505178+0000","last_became_peered":"2024-05-10T11:18:14.505178+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:05.754282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.486356+0000","last_change":"2024-05-10T11:18:13.485497+0000","last_active":"2024-05-10T11:18:13.486356+0000","last_peered":"2024-05-10T11:18:13.486356+0000","last_clean":"2024-05-10T11:18:13.486356+0000","last_became_active":"2024-05-10T11:18:13.484458+0000","last_became_peered":"2024-05-10T11:18:13.484458+0000","last_unstale":"2024-05-10T11:18:13.486356+0000","last_undegraded":"2024-05-10T11:18:13.486356+0000","last_fullsized":"2024-05-10T11:18:13.486356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:04.621280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500292+0000","last_change":"2024-05-10T11:18:14.505021+0000","last_active":"2024-05-10T11:18:15.500292+0000","last_peered":"2024-05-10T11:18:15.500292+0000","last_clean":"2024-05-10T11:18:15.500292+0000","last_became_active":"2024-05-10T11:18:14.504766+0000","last_became_peered":"2024-05-10T11:18:14.504766+0000","last_unstale":"2024-05-10T11:18:15.500292+0000","last_undegraded":"2024-05-10T11:18:15.500292+0000","last_fullsized":"2024-05-10T11:18:15.500292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590044+0000","last_change":"2024-05-10T11:18:13.492021+0000","last_active":"2024-05-10T11:18:15.590044+0000","last_peered":"2024-05-10T11:18:15.590044+0000","last_clean":"2024-05-10T11:18:15.590044+0000","last_became_active":"2024-05-10T11:18:13.491360+0000","last_became_peered":"2024-05-10T11:18:13.491360+0000","last_unstale":"2024-05-10T11:18:15.590044+0000","last_undegraded":"2024-05-10T11:18:15.590044+0000","last_fullsized":"2024-05-10T11:18:15.590044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:04.747286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589257+0000","last_change":"2024-05-10T11:18:14.492959+0000","last_active":"2024-05-10T11:18:15.589257+0000","last_peered":"2024-05-10T11:18:15.589257+0000","last_clean":"2024-05-10T11:18:15.589257+0000","last_became_active":"2024-05-10T11:18:14.492664+0000","last_became_peered":"2024-05-10T11:18:14.492664+0000","last_unstale":"2024-05-10T11:18:15.589257+0000","last_undegraded":"2024-05-10T11:18:15.589257+0000","last_fullsized":"2024-05-10T11:18:15.589257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504029+0000","last_change":"2024-05-10T11:18:13.487280+0000","last_active":"2024-05-10T11:18:15.504029+0000","last_peered":"2024-05-10T11:18:15.504029+0000","last_clean":"2024-05-10T11:18:15.504029+0000","last_became_active":"2024-05-10T11:18:13.487022+0000","last_became_peered":"2024-05-10T11:18:13.487022+0000","last_unstale":"2024-05-10T11:18:15.504029+0000","last_undegraded":"2024-05-10T11:18:15.504029+0000","last_fullsized":"2024-05-10T11:18:15.504029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:46.801147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476079+0000","last_change":"2024-05-10T11:18:13.476079+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476079+0000","last_undegraded":"2024-05-10T11:18:13.476079+0000","last_fullsized":"2024-05-10T11:18:13.476079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.485770+0000","last_change":"2024-05-10T11:18:13.484685+0000","last_active":"2024-05-10T11:18:13.485770+0000","last_peered":"2024-05-10T11:18:13.485770+0000","last_clean":"2024-05-10T11:18:13.485770+0000","last_became_active":"2024-05-10T11:18:13.484358+0000","last_became_peered":"2024-05-10T11:18:13.484358+0000","last_unstale":"2024-05-10T11:18:13.485770+0000","last_undegraded":"2024-05-10T11:18:13.485770+0000","last_fullsized":"2024-05-10T11:18:13.485770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:52.982560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590001+0000","last_change":"2024-05-10T11:18:14.509858+0000","last_active":"2024-05-10T11:18:15.590001+0000","last_peered":"2024-05-10T11:18:15.590001+0000","last_clean":"2024-05-10T11:18:15.590001+0000","last_became_active":"2024-05-10T11:18:14.509560+0000","last_became_peered":"2024-05-10T11:18:14.509560+0000","last_unstale":"2024-05-10T11:18:15.590001+0000","last_undegraded":"2024-05-10T11:18:15.590001+0000","last_fullsized":"2024-05-10T11:18:15.590001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:22.114478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494200+0000","last_change":"2024-05-10T11:18:13.490373+0000","last_active":"2024-05-10T11:18:13.494200+0000","last_peered":"2024-05-10T11:18:13.494200+0000","last_clean":"2024-05-10T11:18:13.494200+0000","last_became_active":"2024-05-10T11:18:13.490094+0000","last_became_peered":"2024-05-10T11:18:13.490094+0000","last_unstale":"2024-05-10T11:18:13.494200+0000","last_undegraded":"2024-05-10T11:18:13.494200+0000","last_fullsized":"2024-05-10T11:18:13.494200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481647+0000","last_change":"2024-05-10T11:18:13.481647+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481647+0000","last_undegraded":"2024-05-10T11:18:13.481647+0000","last_fullsized":"2024-05-10T11:18:13.481647+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590498+0000","last_change":"2024-05-10T11:18:13.495136+0000","last_active":"2024-05-10T11:18:15.590498+0000","last_peered":"2024-05-10T11:18:15.590498+0000","last_clean":"2024-05-10T11:18:15.590498+0000","last_became_active":"2024-05-10T11:18:13.494834+0000","last_became_peered":"2024-05-10T11:18:13.494834+0000","last_unstale":"2024-05-10T11:18:15.590498+0000","last_undegraded":"2024-05-10T11:18:15.590498+0000","last_fullsized":"2024-05-10T11:18:15.590498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:09.195125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.481528+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:18:13.481528+0000","last_peered":"2024-05-10T11:18:13.481528+0000","last_clean":"2024-05-10T11:18:13.481528+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:18:13.481528+0000","last_undegraded":"2024-05-10T11:18:13.481528+0000","last_fullsized":"2024-05-10T11:18:13.481528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1069097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":478729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":478729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":492658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1695744,"data_stored":1085274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:18:18.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:18:18.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.689+0000 7f81cba08640 1 Processor -- start 2024-05-10T11:18:18.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.689+0000 7f81cba08640 1 -- start start 2024-05-10T11:18:18.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81cba08640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81c415ce60 0x7f81c40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81cba08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c40c65f0 0x7f81c4160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81cba08640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c40c6a30 con 0x7f81c4161010 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81cba08640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f81c4161480 con 0x7f81c415ce60 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81cba08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f81c40cd090 con 0x7f81c40c65f0 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81c415ce60 0x7f81c40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81c415ce60 0x7f81c40cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36134/0 (socket says 172.21.15.66:36134) 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 -- 172.21.15.66:0/244512318 learned_addr learned my addr 172.21.15.66:0/244512318 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 -- 172.21.15.66:0/244512318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c40c65f0 msgr2=0x7f81c4160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c8fa3640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c40c65f0 0x7f81c4160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c40c65f0 0x7f81c4160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 -- 172.21.15.66:0/244512318 >> v1:172.21.15.190:6789/0 conn(0x7f81c4161010 legacy=0x7f81c40add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c97a4640 1 -- 172.21.15.66:0/244512318 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c40cd370 con 0x7f81c415ce60 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.690+0000 7f81c8fa3640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c40c65f0 0x7f81c4160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.691+0000 7f81c97a4640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c415ce60 0x7f81c40cb300 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009e50 tx=0x7f81c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e87f60c86373ebc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.691+0000 7f81bbfff640 1 -- 172.21.15.66:0/244512318 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0036070 con 0x7f81c415ce60 2024-05-10T11:18:18.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.691+0000 7f81bbfff640 1 -- 172.21.15.66:0/244512318 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0031600 con 0x7f81c415ce60 2024-05-10T11:18:18.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.691+0000 7f81bbfff640 1 -- 172.21.15.66:0/244512318 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c00319d0 con 0x7f81c415ce60 2024-05-10T11:18:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 -- 172.21.15.66:0/244512318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c415ce60 msgr2=0x7f81c40cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c415ce60 0x7f81c40cb300 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009e50 tx=0x7f81c002a680 comp rx=0 tx=0).stop 2024-05-10T11:18:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 -- 172.21.15.66:0/244512318 shutdown_connections 2024-05-10T11:18:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c40c65f0 0x7f81c4160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 --2- 172.21.15.66:0/244512318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c415ce60 0x7f81c40cb300 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 -- 172.21.15.66:0/244512318 >> 172.21.15.66:0/244512318 conn(0x7f81c40b2900 msgr2=0x7f81c40b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 -- 172.21.15.66:0/244512318 shutdown_connections 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.692+0000 7f81cba08640 1 -- 172.21.15.66:0/244512318 wait complete. 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.693+0000 7f81cba08640 1 Processor -- start 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.693+0000 7f81cba08640 1 -- start start 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 0x7f81c406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c415ce60 0x7f81c406f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81c4161010 0x7f81c4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81c40ccd60 con 0x7f81c40c65f0 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f81c40cd930 con 0x7f81c4161010 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f81c415e250 con 0x7f81c415ce60 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 0x7f81c406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 0x7f81c406e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36138/0 (socket says 172.21.15.66:36138) 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 -- 172.21.15.66:0/669657940 learned_addr learned my addr 172.21.15.66:0/669657940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c9fa5640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81c4161010 0x7f81c4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c8fa3640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c415ce60 0x7f81c406f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 -- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c415ce60 msgr2=0x7f81c406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c415ce60 0x7f81c406f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 -- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81c4161010 msgr2=0x7f81c4156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81c4161010 0x7f81c4156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 -- 172.21.15.66:0/669657940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c406fdc0 con 0x7f81c40c65f0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c9fa5640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81c4161010 0x7f81c4156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81c97a4640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 0x7f81c406e830 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f81c0034040 tx=0x7f81c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0036050 con 0x7f81c40c65f0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0042070 con 0x7f81c40c65f0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.694+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c40c7eb0 con 0x7f81c40c65f0 2024-05-10T11:18:18.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.695+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0009510 con 0x7f81c40c65f0 2024-05-10T11:18:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.695+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c40c8150 con 0x7f81c40c65f0 2024-05-10T11:18:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.696+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c406a220 con 0x7f81c40c65f0 2024-05-10T11:18:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.696+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f81c0007c50 con 0x7f81c40c65f0 2024-05-10T11:18:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.697+0000 7f81b9ffb640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81a80762d0 0x7f81a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.697+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f81c00b86a0 con 0x7f81c40c65f0 2024-05-10T11:18:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.697+0000 7f81c8fa3640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81a80762d0 0x7f81a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.697+0000 7f81c8fa3640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81a80762d0 0x7f81a8078790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f81c4158df0 tx=0x7f81b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:18.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.701+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f81c0081f00 con 0x7f81c40c65f0 2024-05-10T11:18:18.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.886+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81c40c7300 con 0x7f81a80762d0 2024-05-10T11:18:18.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.893+0000 7f81b9ffb640 1 -- 172.21.15.66:0/669657940 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250215 (secure 0 0 0) 0x7f81c40c7300 con 0x7f81a80762d0 2024-05-10T11:18:18.898 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:18:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81a80762d0 msgr2=0x7f81a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81a80762d0 0x7f81a8078790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f81c4158df0 tx=0x7f81b4008040 comp rx=0 tx=0).stop 2024-05-10T11:18:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 msgr2=0x7f81c406e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 0x7f81c406e830 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f81c0034040 tx=0x7f81c0004a40 comp rx=0 tx=0).stop 2024-05-10T11:18:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 shutdown_connections 2024-05-10T11:18:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f81a80762d0 0x7f81a8078790 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81c4161010 0x7f81c4156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81c415ce60 0x7f81c406f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 --2- 172.21.15.66:0/669657940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81c40c65f0 0x7f81c406e830 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.895+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 >> 172.21.15.66:0/669657940 conn(0x7f81c40b2900 msgr2=0x7f81c40cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.896+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 shutdown_connections 2024-05-10T11:18:18.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:18.896+0000 7f81cba08640 1 -- 172.21.15.66:0/669657940 wait complete. 2024-05-10T11:18:18.907 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-05-10T11:18:17.771038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":120,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254840,"kb_used_data":9532,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719880,"statfs":{"total":773094113280,"available":772833157120,"internally_reserved":0,"allocated":9760768,"data_stored":5082251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.297458"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590129+0000","last_change":"2024-05-10T11:18:14.504149+0000","last_active":"2024-05-10T11:18:15.590129+0000","last_peered":"2024-05-10T11:18:15.590129+0000","last_clean":"2024-05-10T11:18:15.590129+0000","last_became_active":"2024-05-10T11:18:14.503828+0000","last_became_peered":"2024-05-10T11:18:14.503828+0000","last_unstale":"2024-05-10T11:18:15.590129+0000","last_undegraded":"2024-05-10T11:18:15.590129+0000","last_fullsized":"2024-05-10T11:18:15.590129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504194+0000","last_change":"2024-05-10T11:18:14.505657+0000","last_active":"2024-05-10T11:18:15.504194+0000","last_peered":"2024-05-10T11:18:15.504194+0000","last_clean":"2024-05-10T11:18:15.504194+0000","last_became_active":"2024-05-10T11:18:14.505269+0000","last_became_peered":"2024-05-10T11:18:14.505269+0000","last_unstale":"2024-05-10T11:18:15.504194+0000","last_undegraded":"2024-05-10T11:18:15.504194+0000","last_fullsized":"2024-05-10T11:18:15.504194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:25.863275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589626+0000","last_change":"2024-05-10T11:18:14.502679+0000","last_active":"2024-05-10T11:18:15.589626+0000","last_peered":"2024-05-10T11:18:15.589626+0000","last_clean":"2024-05-10T11:18:15.589626+0000","last_became_active":"2024-05-10T11:18:14.502382+0000","last_became_peered":"2024-05-10T11:18:14.502382+0000","last_unstale":"2024-05-10T11:18:15.589626+0000","last_undegraded":"2024-05-10T11:18:15.589626+0000","last_fullsized":"2024-05-10T11:18:15.589626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590425+0000","last_change":"2024-05-10T11:18:14.505319+0000","last_active":"2024-05-10T11:18:15.590425+0000","last_peered":"2024-05-10T11:18:15.590425+0000","last_clean":"2024-05-10T11:18:15.590425+0000","last_became_active":"2024-05-10T11:18:14.504964+0000","last_became_peered":"2024-05-10T11:18:14.504964+0000","last_unstale":"2024-05-10T11:18:15.590425+0000","last_undegraded":"2024-05-10T11:18:15.590425+0000","last_fullsized":"2024-05-10T11:18:15.590425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.482266+0000","last_change":"2024-05-10T11:18:13.482266+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.482266+0000","last_undegraded":"2024-05-10T11:18:13.482266+0000","last_fullsized":"2024-05-10T11:18:13.482266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589202+0000","last_change":"2024-05-10T11:18:14.510117+0000","last_active":"2024-05-10T11:18:15.589202+0000","last_peered":"2024-05-10T11:18:15.589202+0000","last_clean":"2024-05-10T11:18:15.589202+0000","last_became_active":"2024-05-10T11:18:14.509816+0000","last_became_peered":"2024-05-10T11:18:14.509816+0000","last_unstale":"2024-05-10T11:18:15.589202+0000","last_undegraded":"2024-05-10T11:18:15.589202+0000","last_fullsized":"2024-05-10T11:18:15.589202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:24.104590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480100+0000","last_change":"2024-05-10T11:18:13.480100+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480100+0000","last_undegraded":"2024-05-10T11:18:13.480100+0000","last_fullsized":"2024-05-10T11:18:13.480100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588832+0000","last_change":"2024-05-10T11:18:14.496569+0000","last_active":"2024-05-10T11:18:15.588832+0000","last_peered":"2024-05-10T11:18:15.588832+0000","last_clean":"2024-05-10T11:18:15.588832+0000","last_became_active":"2024-05-10T11:18:14.494250+0000","last_became_peered":"2024-05-10T11:18:14.494250+0000","last_unstale":"2024-05-10T11:18:15.588832+0000","last_undegraded":"2024-05-10T11:18:15.588832+0000","last_fullsized":"2024-05-10T11:18:15.588832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:47.808143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.482263+0000","last_change":"2024-05-10T11:18:13.482263+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.482263+0000","last_undegraded":"2024-05-10T11:18:13.482263+0000","last_fullsized":"2024-05-10T11:18:13.482263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500560+0000","last_change":"2024-05-10T11:18:14.509973+0000","last_active":"2024-05-10T11:18:15.500560+0000","last_peered":"2024-05-10T11:18:15.500560+0000","last_clean":"2024-05-10T11:18:15.500560+0000","last_became_active":"2024-05-10T11:18:14.509543+0000","last_became_peered":"2024-05-10T11:18:14.509543+0000","last_unstale":"2024-05-10T11:18:15.500560+0000","last_undegraded":"2024-05-10T11:18:15.500560+0000","last_fullsized":"2024-05-10T11:18:15.500560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:01.778938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481935+0000","last_change":"2024-05-10T11:18:13.481935+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481935+0000","last_undegraded":"2024-05-10T11:18:13.481935+0000","last_fullsized":"2024-05-10T11:18:13.481935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500601+0000","last_change":"2024-05-10T11:18:14.515247+0000","last_active":"2024-05-10T11:18:15.500601+0000","last_peered":"2024-05-10T11:18:15.500601+0000","last_clean":"2024-05-10T11:18:15.500601+0000","last_became_active":"2024-05-10T11:18:14.514931+0000","last_became_peered":"2024-05-10T11:18:14.514931+0000","last_unstale":"2024-05-10T11:18:15.500601+0000","last_undegraded":"2024-05-10T11:18:15.500601+0000","last_fullsized":"2024-05-10T11:18:15.500601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:59.852003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590206+0000","last_change":"2024-05-10T11:18:14.495959+0000","last_active":"2024-05-10T11:18:15.590206+0000","last_peered":"2024-05-10T11:18:15.590206+0000","last_clean":"2024-05-10T11:18:15.590206+0000","last_became_active":"2024-05-10T11:18:14.494391+0000","last_became_peered":"2024-05-10T11:18:14.494391+0000","last_unstale":"2024-05-10T11:18:15.590206+0000","last_undegraded":"2024-05-10T11:18:15.590206+0000","last_fullsized":"2024-05-10T11:18:15.590206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:10.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481095+0000","last_change":"2024-05-10T11:18:13.481095+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481095+0000","last_undegraded":"2024-05-10T11:18:13.481095+0000","last_fullsized":"2024-05-10T11:18:13.481095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589287+0000","last_change":"2024-05-10T11:18:14.500781+0000","last_active":"2024-05-10T11:18:15.589287+0000","last_peered":"2024-05-10T11:18:15.589287+0000","last_clean":"2024-05-10T11:18:15.589287+0000","last_became_active":"2024-05-10T11:18:14.500434+0000","last_became_peered":"2024-05-10T11:18:14.500434+0000","last_unstale":"2024-05-10T11:18:15.589287+0000","last_undegraded":"2024-05-10T11:18:15.589287+0000","last_fullsized":"2024-05-10T11:18:15.589287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:51.953240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589304+0000","last_change":"2024-05-10T11:18:14.511780+0000","last_active":"2024-05-10T11:18:15.589304+0000","last_peered":"2024-05-10T11:18:15.589304+0000","last_clean":"2024-05-10T11:18:15.589304+0000","last_became_active":"2024-05-10T11:18:14.510880+0000","last_became_peered":"2024-05-10T11:18:14.510880+0000","last_unstale":"2024-05-10T11:18:15.589304+0000","last_undegraded":"2024-05-10T11:18:15.589304+0000","last_fullsized":"2024-05-10T11:18:15.589304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:54:34.155865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589852+0000","last_change":"2024-05-10T11:18:14.499725+0000","last_active":"2024-05-10T11:18:15.589852+0000","last_peered":"2024-05-10T11:18:15.589852+0000","last_clean":"2024-05-10T11:18:15.589852+0000","last_became_active":"2024-05-10T11:18:14.499366+0000","last_became_peered":"2024-05-10T11:18:14.499366+0000","last_unstale":"2024-05-10T11:18:15.589852+0000","last_undegraded":"2024-05-10T11:18:15.589852+0000","last_fullsized":"2024-05-10T11:18:15.589852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:43.303098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589057+0000","last_change":"2024-05-10T11:18:14.506434+0000","last_active":"2024-05-10T11:18:15.589057+0000","last_peered":"2024-05-10T11:18:15.589057+0000","last_clean":"2024-05-10T11:18:15.589057+0000","last_became_active":"2024-05-10T11:18:14.506161+0000","last_became_peered":"2024-05-10T11:18:14.506161+0000","last_unstale":"2024-05-10T11:18:15.589057+0000","last_undegraded":"2024-05-10T11:18:15.589057+0000","last_fullsized":"2024-05-10T11:18:15.589057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481104+0000","last_change":"2024-05-10T11:18:13.481104+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481104+0000","last_undegraded":"2024-05-10T11:18:13.481104+0000","last_fullsized":"2024-05-10T11:18:13.481104+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590428+0000","last_change":"2024-05-10T11:18:14.500701+0000","last_active":"2024-05-10T11:18:15.590428+0000","last_peered":"2024-05-10T11:18:15.590428+0000","last_clean":"2024-05-10T11:18:15.590428+0000","last_became_active":"2024-05-10T11:18:14.500377+0000","last_became_peered":"2024-05-10T11:18:14.500377+0000","last_unstale":"2024-05-10T11:18:15.590428+0000","last_undegraded":"2024-05-10T11:18:15.590428+0000","last_fullsized":"2024-05-10T11:18:15.590428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480592+0000","last_change":"2024-05-10T11:18:13.480592+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480592+0000","last_undegraded":"2024-05-10T11:18:13.480592+0000","last_fullsized":"2024-05-10T11:18:13.480592+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480133+0000","last_change":"2024-05-10T11:18:13.480133+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480133+0000","last_undegraded":"2024-05-10T11:18:13.480133+0000","last_fullsized":"2024-05-10T11:18:13.480133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476134+0000","last_change":"2024-05-10T11:18:13.476134+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476134+0000","last_undegraded":"2024-05-10T11:18:13.476134+0000","last_fullsized":"2024-05-10T11:18:13.476134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589152+0000","last_change":"2024-05-10T11:18:14.496012+0000","last_active":"2024-05-10T11:18:15.589152+0000","last_peered":"2024-05-10T11:18:15.589152+0000","last_clean":"2024-05-10T11:18:15.589152+0000","last_became_active":"2024-05-10T11:18:14.495715+0000","last_became_peered":"2024-05-10T11:18:14.495715+0000","last_unstale":"2024-05-10T11:18:15.589152+0000","last_undegraded":"2024-05-10T11:18:15.589152+0000","last_fullsized":"2024-05-10T11:18:15.589152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.509349+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.509077+0000","last_became_peered":"2024-05-10T11:18:14.509077+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.479522+0000","last_change":"2024-05-10T11:18:13.479522+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.479522+0000","last_undegraded":"2024-05-10T11:18:13.479522+0000","last_fullsized":"2024-05-10T11:18:13.479522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500648+0000","last_change":"2024-05-10T11:18:14.515113+0000","last_active":"2024-05-10T11:18:15.500648+0000","last_peered":"2024-05-10T11:18:15.500648+0000","last_clean":"2024-05-10T11:18:15.500648+0000","last_became_active":"2024-05-10T11:18:14.514824+0000","last_became_peered":"2024-05-10T11:18:14.514824+0000","last_unstale":"2024-05-10T11:18:15.500648+0000","last_undegraded":"2024-05-10T11:18:15.500648+0000","last_fullsized":"2024-05-10T11:18:15.500648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:48.996486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590608+0000","last_change":"2024-05-10T11:18:14.512508+0000","last_active":"2024-05-10T11:18:15.590608+0000","last_peered":"2024-05-10T11:18:15.590608+0000","last_clean":"2024-05-10T11:18:15.590608+0000","last_became_active":"2024-05-10T11:18:14.512218+0000","last_became_peered":"2024-05-10T11:18:14.512218+0000","last_unstale":"2024-05-10T11:18:15.590608+0000","last_undegraded":"2024-05-10T11:18:15.590608+0000","last_fullsized":"2024-05-10T11:18:15.590608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480635+0000","last_change":"2024-05-10T11:18:13.480635+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480635+0000","last_undegraded":"2024-05-10T11:18:13.480635+0000","last_fullsized":"2024-05-10T11:18:13.480635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.479341+0000","last_change":"2024-05-10T11:18:13.479341+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.479341+0000","last_undegraded":"2024-05-10T11:18:13.479341+0000","last_fullsized":"2024-05-10T11:18:13.479341+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503674+0000","last_change":"2024-05-10T11:18:14.507356+0000","last_active":"2024-05-10T11:18:15.503674+0000","last_peered":"2024-05-10T11:18:15.503674+0000","last_clean":"2024-05-10T11:18:15.503674+0000","last_became_active":"2024-05-10T11:18:14.507037+0000","last_became_peered":"2024-05-10T11:18:14.507037+0000","last_unstale":"2024-05-10T11:18:15.503674+0000","last_undegraded":"2024-05-10T11:18:15.503674+0000","last_fullsized":"2024-05-10T11:18:15.503674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589362+0000","last_change":"2024-05-10T11:18:14.511137+0000","last_active":"2024-05-10T11:18:15.589362+0000","last_peered":"2024-05-10T11:18:15.589362+0000","last_clean":"2024-05-10T11:18:15.589362+0000","last_became_active":"2024-05-10T11:18:14.510460+0000","last_became_peered":"2024-05-10T11:18:14.510460+0000","last_unstale":"2024-05-10T11:18:15.589362+0000","last_undegraded":"2024-05-10T11:18:15.589362+0000","last_fullsized":"2024-05-10T11:18:15.589362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:45.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588999+0000","last_change":"2024-05-10T11:18:14.509145+0000","last_active":"2024-05-10T11:18:15.588999+0000","last_peered":"2024-05-10T11:18:15.588999+0000","last_clean":"2024-05-10T11:18:15.588999+0000","last_became_active":"2024-05-10T11:18:14.507612+0000","last_became_peered":"2024-05-10T11:18:14.507612+0000","last_unstale":"2024-05-10T11:18:15.588999+0000","last_undegraded":"2024-05-10T11:18:15.588999+0000","last_fullsized":"2024-05-10T11:18:15.588999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:59.817611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490686+0000","last_change":"2024-05-10T11:18:13.489312+0000","last_active":"2024-05-10T11:18:13.490686+0000","last_peered":"2024-05-10T11:18:13.490686+0000","last_clean":"2024-05-10T11:18:13.490686+0000","last_became_active":"2024-05-10T11:18:13.489055+0000","last_became_peered":"2024-05-10T11:18:13.489055+0000","last_unstale":"2024-05-10T11:18:13.490686+0000","last_undegraded":"2024-05-10T11:18:13.490686+0000","last_fullsized":"2024-05-10T11:18:13.490686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:05.647628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589488+0000","last_change":"2024-05-10T11:18:14.506891+0000","last_active":"2024-05-10T11:18:15.589488+0000","last_peered":"2024-05-10T11:18:15.589488+0000","last_clean":"2024-05-10T11:18:15.589488+0000","last_became_active":"2024-05-10T11:18:14.506604+0000","last_became_peered":"2024-05-10T11:18:14.506604+0000","last_unstale":"2024-05-10T11:18:15.589488+0000","last_undegraded":"2024-05-10T11:18:15.589488+0000","last_fullsized":"2024-05-10T11:18:15.589488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:46.769438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494187+0000","last_change":"2024-05-10T11:18:13.487405+0000","last_active":"2024-05-10T11:18:13.494187+0000","last_peered":"2024-05-10T11:18:13.494187+0000","last_clean":"2024-05-10T11:18:13.494187+0000","last_became_active":"2024-05-10T11:18:13.487122+0000","last_became_peered":"2024-05-10T11:18:13.487122+0000","last_unstale":"2024-05-10T11:18:13.494187+0000","last_undegraded":"2024-05-10T11:18:13.494187+0000","last_fullsized":"2024-05-10T11:18:13.494187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:00.910751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481049+0000","last_change":"2024-05-10T11:18:13.481049+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481049+0000","last_undegraded":"2024-05-10T11:18:13.481049+0000","last_fullsized":"2024-05-10T11:18:13.481049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494227+0000","last_change":"2024-05-10T11:18:13.491023+0000","last_active":"2024-05-10T11:18:13.494227+0000","last_peered":"2024-05-10T11:18:13.494227+0000","last_clean":"2024-05-10T11:18:13.494227+0000","last_became_active":"2024-05-10T11:18:13.490750+0000","last_became_peered":"2024-05-10T11:18:13.490750+0000","last_unstale":"2024-05-10T11:18:13.494227+0000","last_undegraded":"2024-05-10T11:18:13.494227+0000","last_fullsized":"2024-05-10T11:18:13.494227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:04.210949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.517446+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.517158+0000","last_became_peered":"2024-05-10T11:18:14.517158+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:59.932591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.497192+0000","last_change":"2024-05-10T11:18:13.496226+0000","last_active":"2024-05-10T11:18:13.497192+0000","last_peered":"2024-05-10T11:18:13.497192+0000","last_clean":"2024-05-10T11:18:13.497192+0000","last_became_active":"2024-05-10T11:18:13.495965+0000","last_became_peered":"2024-05-10T11:18:13.495965+0000","last_unstale":"2024-05-10T11:18:13.497192+0000","last_undegraded":"2024-05-10T11:18:13.497192+0000","last_fullsized":"2024-05-10T11:18:13.497192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:13.594607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588902+0000","last_change":"2024-05-10T11:18:14.502176+0000","last_active":"2024-05-10T11:18:15.588902+0000","last_peered":"2024-05-10T11:18:15.588902+0000","last_clean":"2024-05-10T11:18:15.588902+0000","last_became_active":"2024-05-10T11:18:14.501901+0000","last_became_peered":"2024-05-10T11:18:14.501901+0000","last_unstale":"2024-05-10T11:18:15.588902+0000","last_undegraded":"2024-05-10T11:18:15.588902+0000","last_fullsized":"2024-05-10T11:18:15.588902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:22.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494241+0000","last_change":"2024-05-10T11:18:13.489468+0000","last_active":"2024-05-10T11:18:13.494241+0000","last_peered":"2024-05-10T11:18:13.494241+0000","last_clean":"2024-05-10T11:18:13.494241+0000","last_became_active":"2024-05-10T11:18:13.489197+0000","last_became_peered":"2024-05-10T11:18:13.489197+0000","last_unstale":"2024-05-10T11:18:13.494241+0000","last_undegraded":"2024-05-10T11:18:13.494241+0000","last_fullsized":"2024-05-10T11:18:13.494241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:15:38.738963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.475557+0000","last_change":"2024-05-10T11:18:13.475557+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.475557+0000","last_undegraded":"2024-05-10T11:18:13.475557+0000","last_fullsized":"2024-05-10T11:18:13.475557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589863+0000","last_change":"2024-05-10T11:18:13.499705+0000","last_active":"2024-05-10T11:18:15.589863+0000","last_peered":"2024-05-10T11:18:15.589863+0000","last_clean":"2024-05-10T11:18:15.589863+0000","last_became_active":"2024-05-10T11:18:13.499448+0000","last_became_peered":"2024-05-10T11:18:13.499448+0000","last_unstale":"2024-05-10T11:18:15.589863+0000","last_undegraded":"2024-05-10T11:18:15.589863+0000","last_fullsized":"2024-05-10T11:18:15.589863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:22.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589016+0000","last_change":"2024-05-10T11:18:14.510528+0000","last_active":"2024-05-10T11:18:15.589016+0000","last_peered":"2024-05-10T11:18:15.589016+0000","last_clean":"2024-05-10T11:18:15.589016+0000","last_became_active":"2024-05-10T11:18:14.510212+0000","last_became_peered":"2024-05-10T11:18:14.510212+0000","last_unstale":"2024-05-10T11:18:15.589016+0000","last_undegraded":"2024-05-10T11:18:15.589016+0000","last_fullsized":"2024-05-10T11:18:15.589016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.308953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589373+0000","last_change":"2024-05-10T11:18:13.484546+0000","last_active":"2024-05-10T11:18:15.589373+0000","last_peered":"2024-05-10T11:18:15.589373+0000","last_clean":"2024-05-10T11:18:15.589373+0000","last_became_active":"2024-05-10T11:18:13.484252+0000","last_became_peered":"2024-05-10T11:18:13.484252+0000","last_unstale":"2024-05-10T11:18:15.589373+0000","last_undegraded":"2024-05-10T11:18:15.589373+0000","last_fullsized":"2024-05-10T11:18:15.589373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:23.840058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590407+0000","last_change":"2024-05-10T11:18:14.502695+0000","last_active":"2024-05-10T11:18:15.590407+0000","last_peered":"2024-05-10T11:18:15.590407+0000","last_clean":"2024-05-10T11:18:15.590407+0000","last_became_active":"2024-05-10T11:18:14.502130+0000","last_became_peered":"2024-05-10T11:18:14.502130+0000","last_unstale":"2024-05-10T11:18:15.590407+0000","last_undegraded":"2024-05-10T11:18:15.590407+0000","last_fullsized":"2024-05-10T11:18:15.590407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494827+0000","last_change":"2024-05-10T11:18:13.492663+0000","last_active":"2024-05-10T11:18:13.494827+0000","last_peered":"2024-05-10T11:18:13.494827+0000","last_clean":"2024-05-10T11:18:13.494827+0000","last_became_active":"2024-05-10T11:18:13.492415+0000","last_became_peered":"2024-05-10T11:18:13.492415+0000","last_unstale":"2024-05-10T11:18:13.494827+0000","last_undegraded":"2024-05-10T11:18:13.494827+0000","last_fullsized":"2024-05-10T11:18:13.494827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:11.795689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478825+0000","last_change":"2024-05-10T11:18:13.478825+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478825+0000","last_undegraded":"2024-05-10T11:18:13.478825+0000","last_fullsized":"2024-05-10T11:18:13.478825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504114+0000","last_change":"2024-05-10T11:18:13.489382+0000","last_active":"2024-05-10T11:18:15.504114+0000","last_peered":"2024-05-10T11:18:15.504114+0000","last_clean":"2024-05-10T11:18:15.504114+0000","last_became_active":"2024-05-10T11:18:13.489117+0000","last_became_peered":"2024-05-10T11:18:13.489117+0000","last_unstale":"2024-05-10T11:18:15.504114+0000","last_undegraded":"2024-05-10T11:18:15.504114+0000","last_fullsized":"2024-05-10T11:18:15.504114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:58.559240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480549+0000","last_change":"2024-05-10T11:18:13.480549+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480549+0000","last_undegraded":"2024-05-10T11:18:13.480549+0000","last_fullsized":"2024-05-10T11:18:13.480549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:13.496483+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:13.496161+0000","last_became_peered":"2024-05-10T11:18:13.496161+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589755+0000","last_change":"2024-05-10T11:18:14.505565+0000","last_active":"2024-05-10T11:18:15.589755+0000","last_peered":"2024-05-10T11:18:15.589755+0000","last_clean":"2024-05-10T11:18:15.589755+0000","last_became_active":"2024-05-10T11:18:14.504514+0000","last_became_peered":"2024-05-10T11:18:14.504514+0000","last_unstale":"2024-05-10T11:18:15.589755+0000","last_undegraded":"2024-05-10T11:18:15.589755+0000","last_fullsized":"2024-05-10T11:18:15.589755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.496840+0000","last_change":"2024-05-10T11:18:13.492466+0000","last_active":"2024-05-10T11:18:13.496840+0000","last_peered":"2024-05-10T11:18:13.496840+0000","last_clean":"2024-05-10T11:18:13.496840+0000","last_became_active":"2024-05-10T11:18:13.492210+0000","last_became_peered":"2024-05-10T11:18:13.492210+0000","last_unstale":"2024-05-10T11:18:13.496840+0000","last_undegraded":"2024-05-10T11:18:13.496840+0000","last_fullsized":"2024-05-10T11:18:13.496840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590683+0000","last_change":"2024-05-10T11:18:14.506980+0000","last_active":"2024-05-10T11:18:15.590683+0000","last_peered":"2024-05-10T11:18:15.590683+0000","last_clean":"2024-05-10T11:18:15.590683+0000","last_became_active":"2024-05-10T11:18:14.506669+0000","last_became_peered":"2024-05-10T11:18:14.506669+0000","last_unstale":"2024-05-10T11:18:15.590683+0000","last_undegraded":"2024-05-10T11:18:15.590683+0000","last_fullsized":"2024-05-10T11:18:15.590683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589688+0000","last_change":"2024-05-10T11:18:13.491065+0000","last_active":"2024-05-10T11:18:15.589688+0000","last_peered":"2024-05-10T11:18:15.589688+0000","last_clean":"2024-05-10T11:18:15.589688+0000","last_became_active":"2024-05-10T11:18:13.490740+0000","last_became_peered":"2024-05-10T11:18:13.490740+0000","last_unstale":"2024-05-10T11:18:15.589688+0000","last_undegraded":"2024-05-10T11:18:15.589688+0000","last_fullsized":"2024-05-10T11:18:15.589688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:17.665658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588979+0000","last_change":"2024-05-10T11:18:14.492654+0000","last_active":"2024-05-10T11:18:15.588979+0000","last_peered":"2024-05-10T11:18:15.588979+0000","last_clean":"2024-05-10T11:18:15.588979+0000","last_became_active":"2024-05-10T11:18:14.492328+0000","last_became_peered":"2024-05-10T11:18:14.492328+0000","last_unstale":"2024-05-10T11:18:15.588979+0000","last_undegraded":"2024-05-10T11:18:15.588979+0000","last_fullsized":"2024-05-10T11:18:15.588979+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:24:34.509745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494959+0000","last_change":"2024-05-10T11:18:13.493293+0000","last_active":"2024-05-10T11:18:13.494959+0000","last_peered":"2024-05-10T11:18:13.494959+0000","last_clean":"2024-05-10T11:18:13.494959+0000","last_became_active":"2024-05-10T11:18:13.493029+0000","last_became_peered":"2024-05-10T11:18:13.493029+0000","last_unstale":"2024-05-10T11:18:13.494959+0000","last_undegraded":"2024-05-10T11:18:13.494959+0000","last_fullsized":"2024-05-10T11:18:13.494959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:48.659582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478374+0000","last_change":"2024-05-10T11:18:13.478374+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478374+0000","last_undegraded":"2024-05-10T11:18:13.478374+0000","last_fullsized":"2024-05-10T11:18:13.478374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589062+0000","last_change":"2024-05-10T11:18:13.491930+0000","last_active":"2024-05-10T11:18:15.589062+0000","last_peered":"2024-05-10T11:18:15.589062+0000","last_clean":"2024-05-10T11:18:15.589062+0000","last_became_active":"2024-05-10T11:18:13.491576+0000","last_became_peered":"2024-05-10T11:18:13.491576+0000","last_unstale":"2024-05-10T11:18:15.589062+0000","last_undegraded":"2024-05-10T11:18:15.589062+0000","last_fullsized":"2024-05-10T11:18:15.589062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:20.216601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500392+0000","last_change":"2024-05-10T11:18:14.512578+0000","last_active":"2024-05-10T11:18:15.500392+0000","last_peered":"2024-05-10T11:18:15.500392+0000","last_clean":"2024-05-10T11:18:15.500392+0000","last_became_active":"2024-05-10T11:18:14.512273+0000","last_became_peered":"2024-05-10T11:18:14.512273+0000","last_unstale":"2024-05-10T11:18:15.500392+0000","last_undegraded":"2024-05-10T11:18:15.500392+0000","last_fullsized":"2024-05-10T11:18:15.500392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:16.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589418+0000","last_change":"2024-05-10T11:18:13.494933+0000","last_active":"2024-05-10T11:18:15.589418+0000","last_peered":"2024-05-10T11:18:15.589418+0000","last_clean":"2024-05-10T11:18:15.589418+0000","last_became_active":"2024-05-10T11:18:13.494632+0000","last_became_peered":"2024-05-10T11:18:13.494632+0000","last_unstale":"2024-05-10T11:18:15.589418+0000","last_undegraded":"2024-05-10T11:18:15.589418+0000","last_fullsized":"2024-05-10T11:18:15.589418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.988757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500556+0000","last_change":"2024-05-10T11:18:14.512697+0000","last_active":"2024-05-10T11:18:15.500556+0000","last_peered":"2024-05-10T11:18:15.500556+0000","last_clean":"2024-05-10T11:18:15.500556+0000","last_became_active":"2024-05-10T11:18:14.512424+0000","last_became_peered":"2024-05-10T11:18:14.512424+0000","last_unstale":"2024-05-10T11:18:15.500556+0000","last_undegraded":"2024-05-10T11:18:15.500556+0000","last_fullsized":"2024-05-10T11:18:15.500556+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:16.972744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589019+0000","last_change":"2024-05-10T11:18:13.499748+0000","last_active":"2024-05-10T11:18:15.589019+0000","last_peered":"2024-05-10T11:18:15.589019+0000","last_clean":"2024-05-10T11:18:15.589019+0000","last_became_active":"2024-05-10T11:18:13.499424+0000","last_became_peered":"2024-05-10T11:18:13.499424+0000","last_unstale":"2024-05-10T11:18:15.589019+0000","last_undegraded":"2024-05-10T11:18:15.589019+0000","last_fullsized":"2024-05-10T11:18:15.589019+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:45.777827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589632+0000","last_change":"2024-05-10T11:18:14.509330+0000","last_active":"2024-05-10T11:18:15.589632+0000","last_peered":"2024-05-10T11:18:15.589632+0000","last_clean":"2024-05-10T11:18:15.589632+0000","last_became_active":"2024-05-10T11:18:14.507243+0000","last_became_peered":"2024-05-10T11:18:14.507243+0000","last_unstale":"2024-05-10T11:18:15.589632+0000","last_undegraded":"2024-05-10T11:18:15.589632+0000","last_fullsized":"2024-05-10T11:18:15.589632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:16.911693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.486282+0000","last_change":"2024-05-10T11:18:13.484923+0000","last_active":"2024-05-10T11:18:13.486282+0000","last_peered":"2024-05-10T11:18:13.486282+0000","last_clean":"2024-05-10T11:18:13.486282+0000","last_became_active":"2024-05-10T11:18:13.484625+0000","last_became_peered":"2024-05-10T11:18:13.484625+0000","last_unstale":"2024-05-10T11:18:13.486282+0000","last_undegraded":"2024-05-10T11:18:13.486282+0000","last_fullsized":"2024-05-10T11:18:13.486282+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:57:04.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.475691+0000","last_change":"2024-05-10T11:18:13.475691+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.475691+0000","last_undegraded":"2024-05-10T11:18:13.475691+0000","last_fullsized":"2024-05-10T11:18:13.475691+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490572+0000","last_change":"2024-05-10T11:18:13.488650+0000","last_active":"2024-05-10T11:18:13.490572+0000","last_peered":"2024-05-10T11:18:13.490572+0000","last_clean":"2024-05-10T11:18:13.490572+0000","last_became_active":"2024-05-10T11:18:13.488336+0000","last_became_peered":"2024-05-10T11:18:13.488336+0000","last_unstale":"2024-05-10T11:18:13.490572+0000","last_undegraded":"2024-05-10T11:18:13.490572+0000","last_fullsized":"2024-05-10T11:18:13.490572+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:45.519599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478379+0000","last_change":"2024-05-10T11:18:13.478379+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478379+0000","last_undegraded":"2024-05-10T11:18:13.478379+0000","last_fullsized":"2024-05-10T11:18:13.478379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.496770+0000","last_change":"2024-05-10T11:18:13.491192+0000","last_active":"2024-05-10T11:18:13.496770+0000","last_peered":"2024-05-10T11:18:13.496770+0000","last_clean":"2024-05-10T11:18:13.496770+0000","last_became_active":"2024-05-10T11:18:13.490839+0000","last_became_peered":"2024-05-10T11:18:13.490839+0000","last_unstale":"2024-05-10T11:18:13.496770+0000","last_undegraded":"2024-05-10T11:18:13.496770+0000","last_fullsized":"2024-05-10T11:18:13.496770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:11.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589466+0000","last_change":"2024-05-10T11:18:14.509377+0000","last_active":"2024-05-10T11:18:15.589466+0000","last_peered":"2024-05-10T11:18:15.589466+0000","last_clean":"2024-05-10T11:18:15.589466+0000","last_became_active":"2024-05-10T11:18:14.506328+0000","last_became_peered":"2024-05-10T11:18:14.506328+0000","last_unstale":"2024-05-10T11:18:15.589466+0000","last_undegraded":"2024-05-10T11:18:15.589466+0000","last_fullsized":"2024-05-10T11:18:15.589466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:12.639237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503705+0000","last_change":"2024-05-10T11:18:13.487719+0000","last_active":"2024-05-10T11:18:15.503705+0000","last_peered":"2024-05-10T11:18:15.503705+0000","last_clean":"2024-05-10T11:18:15.503705+0000","last_became_active":"2024-05-10T11:18:13.486232+0000","last_became_peered":"2024-05-10T11:18:13.486232+0000","last_unstale":"2024-05-10T11:18:15.503705+0000","last_undegraded":"2024-05-10T11:18:15.503705+0000","last_fullsized":"2024-05-10T11:18:15.503705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503636+0000","last_change":"2024-05-10T11:18:14.501099+0000","last_active":"2024-05-10T11:18:15.503636+0000","last_peered":"2024-05-10T11:18:15.503636+0000","last_clean":"2024-05-10T11:18:15.503636+0000","last_became_active":"2024-05-10T11:18:14.500491+0000","last_became_peered":"2024-05-10T11:18:14.500491+0000","last_unstale":"2024-05-10T11:18:15.503636+0000","last_undegraded":"2024-05-10T11:18:15.503636+0000","last_fullsized":"2024-05-10T11:18:15.503636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500360+0000","last_change":"2024-05-10T11:18:13.496261+0000","last_active":"2024-05-10T11:18:15.500360+0000","last_peered":"2024-05-10T11:18:15.500360+0000","last_clean":"2024-05-10T11:18:15.500360+0000","last_became_active":"2024-05-10T11:18:13.496010+0000","last_became_peered":"2024-05-10T11:18:13.496010+0000","last_unstale":"2024-05-10T11:18:15.500360+0000","last_undegraded":"2024-05-10T11:18:15.500360+0000","last_fullsized":"2024-05-10T11:18:15.500360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:25.142075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503941+0000","last_change":"2024-05-10T11:18:14.508367+0000","last_active":"2024-05-10T11:18:15.503941+0000","last_peered":"2024-05-10T11:18:15.503941+0000","last_clean":"2024-05-10T11:18:15.503941+0000","last_became_active":"2024-05-10T11:18:14.508114+0000","last_became_peered":"2024-05-10T11:18:14.508114+0000","last_unstale":"2024-05-10T11:18:15.503941+0000","last_undegraded":"2024-05-10T11:18:15.503941+0000","last_fullsized":"2024-05-10T11:18:15.503941+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503746+0000","last_change":"2024-05-10T11:18:13.493893+0000","last_active":"2024-05-10T11:18:15.503746+0000","last_peered":"2024-05-10T11:18:15.503746+0000","last_clean":"2024-05-10T11:18:15.503746+0000","last_became_active":"2024-05-10T11:18:13.493661+0000","last_became_peered":"2024-05-10T11:18:13.493661+0000","last_unstale":"2024-05-10T11:18:15.503746+0000","last_undegraded":"2024-05-10T11:18:15.503746+0000","last_fullsized":"2024-05-10T11:18:15.503746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:21.825243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589340+0000","last_change":"2024-05-10T11:18:14.508876+0000","last_active":"2024-05-10T11:18:15.589340+0000","last_peered":"2024-05-10T11:18:15.589340+0000","last_clean":"2024-05-10T11:18:15.589340+0000","last_became_active":"2024-05-10T11:18:14.508599+0000","last_became_peered":"2024-05-10T11:18:14.508599+0000","last_unstale":"2024-05-10T11:18:15.589340+0000","last_undegraded":"2024-05-10T11:18:15.589340+0000","last_fullsized":"2024-05-10T11:18:15.589340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:49.671324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500251+0000","last_change":"2024-05-10T11:18:13.488510+0000","last_active":"2024-05-10T11:18:15.500251+0000","last_peered":"2024-05-10T11:18:15.500251+0000","last_clean":"2024-05-10T11:18:15.500251+0000","last_became_active":"2024-05-10T11:18:13.488224+0000","last_became_peered":"2024-05-10T11:18:13.488224+0000","last_unstale":"2024-05-10T11:18:15.500251+0000","last_undegraded":"2024-05-10T11:18:15.500251+0000","last_fullsized":"2024-05-10T11:18:15.500251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:57.771228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476649+0000","last_change":"2024-05-10T11:18:13.476649+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476649+0000","last_undegraded":"2024-05-10T11:18:13.476649+0000","last_fullsized":"2024-05-10T11:18:13.476649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490496+0000","last_change":"2024-05-10T11:18:13.486115+0000","last_active":"2024-05-10T11:18:13.490496+0000","last_peered":"2024-05-10T11:18:13.490496+0000","last_clean":"2024-05-10T11:18:13.490496+0000","last_became_active":"2024-05-10T11:18:13.485827+0000","last_became_peered":"2024-05-10T11:18:13.485827+0000","last_unstale":"2024-05-10T11:18:13.490496+0000","last_undegraded":"2024-05-10T11:18:13.490496+0000","last_fullsized":"2024-05-10T11:18:13.490496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:15.763069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589621+0000","last_change":"2024-05-10T11:18:14.508776+0000","last_active":"2024-05-10T11:18:15.589621+0000","last_peered":"2024-05-10T11:18:15.589621+0000","last_clean":"2024-05-10T11:18:15.589621+0000","last_became_active":"2024-05-10T11:18:14.507883+0000","last_became_peered":"2024-05-10T11:18:14.507883+0000","last_unstale":"2024-05-10T11:18:15.589621+0000","last_undegraded":"2024-05-10T11:18:15.589621+0000","last_fullsized":"2024-05-10T11:18:15.589621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:41:09.728598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.491174+0000","last_change":"2024-05-10T11:18:13.486261+0000","last_active":"2024-05-10T11:18:13.491174+0000","last_peered":"2024-05-10T11:18:13.491174+0000","last_clean":"2024-05-10T11:18:13.491174+0000","last_became_active":"2024-05-10T11:18:13.485612+0000","last_became_peered":"2024-05-10T11:18:13.485612+0000","last_unstale":"2024-05-10T11:18:13.491174+0000","last_undegraded":"2024-05-10T11:18:13.491174+0000","last_fullsized":"2024-05-10T11:18:13.491174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:26.233985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589573+0000","last_change":"2024-05-10T11:18:14.503515+0000","last_active":"2024-05-10T11:18:15.589573+0000","last_peered":"2024-05-10T11:18:15.589573+0000","last_clean":"2024-05-10T11:18:15.589573+0000","last_became_active":"2024-05-10T11:18:14.503224+0000","last_became_peered":"2024-05-10T11:18:14.503224+0000","last_unstale":"2024-05-10T11:18:15.589573+0000","last_undegraded":"2024-05-10T11:18:15.589573+0000","last_fullsized":"2024-05-10T11:18:15.589573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:32.860740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.491326+0000","last_change":"2024-05-10T11:18:13.486384+0000","last_active":"2024-05-10T11:18:13.491326+0000","last_peered":"2024-05-10T11:18:13.491326+0000","last_clean":"2024-05-10T11:18:13.491326+0000","last_became_active":"2024-05-10T11:18:13.486083+0000","last_became_peered":"2024-05-10T11:18:13.486083+0000","last_unstale":"2024-05-10T11:18:13.491326+0000","last_undegraded":"2024-05-10T11:18:13.491326+0000","last_fullsized":"2024-05-10T11:18:13.491326+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:09.025915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.505472+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.505178+0000","last_became_peered":"2024-05-10T11:18:14.505178+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:05.754282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.486356+0000","last_change":"2024-05-10T11:18:13.485497+0000","last_active":"2024-05-10T11:18:13.486356+0000","last_peered":"2024-05-10T11:18:13.486356+0000","last_clean":"2024-05-10T11:18:13.486356+0000","last_became_active":"2024-05-10T11:18:13.484458+0000","last_became_peered":"2024-05-10T11:18:13.484458+0000","last_unstale":"2024-05-10T11:18:13.486356+0000","last_undegraded":"2024-05-10T11:18:13.486356+0000","last_fullsized":"2024-05-10T11:18:13.486356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:04.621280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500292+0000","last_change":"2024-05-10T11:18:14.505021+0000","last_active":"2024-05-10T11:18:15.500292+0000","last_peered":"2024-05-10T11:18:15.500292+0000","last_clean":"2024-05-10T11:18:15.500292+0000","last_became_active":"2024-05-10T11:18:14.504766+0000","last_became_peered":"2024-05-10T11:18:14.504766+0000","last_unstale":"2024-05-10T11:18:15.500292+0000","last_undegraded":"2024-05-10T11:18:15.500292+0000","last_fullsized":"2024-05-10T11:18:15.500292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590044+0000","last_change":"2024-05-10T11:18:13.492021+0000","last_active":"2024-05-10T11:18:15.590044+0000","last_peered":"2024-05-10T11:18:15.590044+0000","last_clean":"2024-05-10T11:18:15.590044+0000","last_became_active":"2024-05-10T11:18:13.491360+0000","last_became_peered":"2024-05-10T11:18:13.491360+0000","last_unstale":"2024-05-10T11:18:15.590044+0000","last_undegraded":"2024-05-10T11:18:15.590044+0000","last_fullsized":"2024-05-10T11:18:15.590044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:04.747286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589257+0000","last_change":"2024-05-10T11:18:14.492959+0000","last_active":"2024-05-10T11:18:15.589257+0000","last_peered":"2024-05-10T11:18:15.589257+0000","last_clean":"2024-05-10T11:18:15.589257+0000","last_became_active":"2024-05-10T11:18:14.492664+0000","last_became_peered":"2024-05-10T11:18:14.492664+0000","last_unstale":"2024-05-10T11:18:15.589257+0000","last_undegraded":"2024-05-10T11:18:15.589257+0000","last_fullsized":"2024-05-10T11:18:15.589257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504029+0000","last_change":"2024-05-10T11:18:13.487280+0000","last_active":"2024-05-10T11:18:15.504029+0000","last_peered":"2024-05-10T11:18:15.504029+0000","last_clean":"2024-05-10T11:18:15.504029+0000","last_became_active":"2024-05-10T11:18:13.487022+0000","last_became_peered":"2024-05-10T11:18:13.487022+0000","last_unstale":"2024-05-10T11:18:15.504029+0000","last_undegraded":"2024-05-10T11:18:15.504029+0000","last_fullsized":"2024-05-10T11:18:15.504029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:46.801147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476079+0000","last_change":"2024-05-10T11:18:13.476079+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476079+0000","last_undegraded":"2024-05-10T11:18:13.476079+0000","last_fullsized":"2024-05-10T11:18:13.476079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.485770+0000","last_change":"2024-05-10T11:18:13.484685+0000","last_active":"2024-05-10T11:18:13.485770+0000","last_peered":"2024-05-10T11:18:13.485770+0000","last_clean":"2024-05-10T11:18:13.485770+0000","last_became_active":"2024-05-10T11:18:13.484358+0000","last_became_peered":"2024-05-10T11:18:13.484358+0000","last_unstale":"2024-05-10T11:18:13.485770+0000","last_undegraded":"2024-05-10T11:18:13.485770+0000","last_fullsized":"2024-05-10T11:18:13.485770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:52.982560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590001+0000","last_change":"2024-05-10T11:18:14.509858+0000","last_active":"2024-05-10T11:18:15.590001+0000","last_peered":"2024-05-10T11:18:15.590001+0000","last_clean":"2024-05-10T11:18:15.590001+0000","last_became_active":"2024-05-10T11:18:14.509560+0000","last_became_peered":"2024-05-10T11:18:14.509560+0000","last_unstale":"2024-05-10T11:18:15.590001+0000","last_undegraded":"2024-05-10T11:18:15.590001+0000","last_fullsized":"2024-05-10T11:18:15.590001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:22.114478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494200+0000","last_change":"2024-05-10T11:18:13.490373+0000","last_active":"2024-05-10T11:18:13.494200+0000","last_peered":"2024-05-10T11:18:13.494200+0000","last_clean":"2024-05-10T11:18:13.494200+0000","last_became_active":"2024-05-10T11:18:13.490094+0000","last_became_peered":"2024-05-10T11:18:13.490094+0000","last_unstale":"2024-05-10T11:18:13.494200+0000","last_undegraded":"2024-05-10T11:18:13.494200+0000","last_fullsized":"2024-05-10T11:18:13.494200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481647+0000","last_change":"2024-05-10T11:18:13.481647+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481647+0000","last_undegraded":"2024-05-10T11:18:13.481647+0000","last_fullsized":"2024-05-10T11:18:13.481647+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590498+0000","last_change":"2024-05-10T11:18:13.495136+0000","last_active":"2024-05-10T11:18:15.590498+0000","last_peered":"2024-05-10T11:18:15.590498+0000","last_clean":"2024-05-10T11:18:15.590498+0000","last_became_active":"2024-05-10T11:18:13.494834+0000","last_became_peered":"2024-05-10T11:18:13.494834+0000","last_unstale":"2024-05-10T11:18:15.590498+0000","last_undegraded":"2024-05-10T11:18:15.590498+0000","last_fullsized":"2024-05-10T11:18:15.590498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:09.195125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.481528+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:18:13.481528+0000","last_peered":"2024-05-10T11:18:13.481528+0000","last_clean":"2024-05-10T11:18:13.481528+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:18:13.481528+0000","last_undegraded":"2024-05-10T11:18:13.481528+0000","last_fullsized":"2024-05-10T11:18:13.481528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1069097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":478729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":478729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":492658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1695744,"data_stored":1085274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:18:18.953 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:18:19.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.057+0000 7fc01cd89640 1 Processor -- start 2024-05-10T11:18:19.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.057+0000 7fc01cd89640 1 -- start start 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01cd89640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0180d0230 0x7fc0180cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01cd89640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc01815fc90 con 0x7fc0180b8860 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01cd89640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0180b8c40 con 0x7fc0180cfbb0 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01cd89640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc01806ec30 con 0x7fc0180d0230 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01659c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc0180b8860 0x7fc01806e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:42630/0 (socket says 172.21.15.66:42630) 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01659c640 1 -- 172.21.15.66:0/679934397 learned_addr learned my addr 172.21.15.66:0/679934397 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc015d9b640 1 --2- 172.21.15.66:0/679934397 >> v2:172.21.15.190:3300/0 conn(0x7fc0180d0230 0x7fc0180cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375639596 0 0) 0x7fc01815fc90 con 0x7fc0180b8860 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.058+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc004003520 con 0x7fc0180b8860 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 798643773 0 0) 0x7fc004003520 con 0x7fc0180b8860 2024-05-10T11:18:19.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 >> v2:172.21.15.190:3300/0 conn(0x7fc0180d0230 msgr2=0x7fc0180cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 --2- 172.21.15.66:0/679934397 >> v2:172.21.15.190:3300/0 conn(0x7fc0180d0230 0x7fc0180cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 >> v1:172.21.15.190:6789/0 conn(0x7fc0180cfbb0 legacy=0x7fc0180ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0180cd570 con 0x7fc0180b8860 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fc0100019f0 con 0x7fc0180b8860 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 >> v1:172.21.15.66:6789/0 conn(0x7fc0180b8860 legacy=0x7fc01806e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0040039b0 0x7fc004003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc004004800 0x7fc004004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0040051c0 0x7fc00400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc01806ec30 con 0x7fc0040039b0 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc00400c160 con 0x7fc004004800 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc00400c360 con 0x7fc0040051c0 2024-05-10T11:18:19.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01659c640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0040039b0 0x7fc004003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc015d9b640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc004004800 0x7fc004004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc016d9d640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0040051c0 0x7fc00400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01659c640 1 -- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0040051c0 msgr2=0x7fc00400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01659c640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0040051c0 0x7fc00400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01659c640 1 -- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc004004800 msgr2=0x7fc004004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01659c640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc004004800 0x7fc004004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc01659c640 1 -- 172.21.15.66:0/679934397 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc004003520 con 0x7fc0040039b0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.059+0000 7fc016d9d640 1 -- 172.21.15.66:0/679934397 reap_dead start 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.060+0000 7fc01659c640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0040039b0 0x7fc004003dd0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc01000a850 tx=0x7fc004005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38110c0c6e189dec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.060+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01000a4a0 con 0x7fc0040039b0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.060+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01002f070 con 0x7fc0040039b0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.060+0000 7fc01559a640 1 -- 172.21.15.66:0/679934397 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01002bd20 con 0x7fc0040039b0 2024-05-10T11:18:19.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 -- 172.21.15.66:0/679934397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0040039b0 msgr2=0x7fc004003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0040039b0 0x7fc004003dd0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc01000a850 tx=0x7fc004005830 comp rx=0 tx=0).stop 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 -- 172.21.15.66:0/679934397 shutdown_connections 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 --2- 172.21.15.66:0/679934397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0040039b0 0x7fc004003dd0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 -- 172.21.15.66:0/679934397 >> 172.21.15.66:0/679934397 conn(0x7fc0180d2df0 msgr2=0x7fc0180d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 -- 172.21.15.66:0/679934397 shutdown_connections 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.061+0000 7fc01cd89640 1 -- 172.21.15.66:0/679934397 wait complete. 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.062+0000 7fc01cd89640 1 Processor -- start 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.062+0000 7fc01cd89640 1 -- start start 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01cd89640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0040039b0 0x7fc018159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01cd89640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc018159b30 0x7fc018159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01cd89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 0x7fc01815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01cd89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc0180cdb30 con 0x7fc01815c3b0 2024-05-10T11:18:19.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01cd89640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc01806ee50 con 0x7fc0040039b0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01cd89640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc0180cde10 con 0x7fc018159b30 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 0x7fc01815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 0x7fc01815c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36154/0 (socket says 172.21.15.66:36154) 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 -- 172.21.15.66:0/1680600958 learned_addr learned my addr 172.21.15.66:0/1680600958 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc01659c640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0040039b0 0x7fc018159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc015d9b640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc018159b30 0x7fc018159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 -- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc018159b30 msgr2=0x7fc018159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc018159b30 0x7fc018159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 -- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0040039b0 msgr2=0x7fc018159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.063+0000 7fc016d9d640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0040039b0 0x7fc018159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc016d9d640 1 -- 172.21.15.66:0/1680600958 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01815a5b0 con 0x7fc01815c3b0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc016d9d640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 0x7fc01815c830 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc01806ff80 tx=0x7fc00800e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008019070 con 0x7fc01815c3b0 2024-05-10T11:18:19.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0080050d0 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01815a890 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0080054a0 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.064+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01815ae50 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.065+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01806a220 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.066+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc00801c070 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.066+0000 7fc00effd640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbff8076470 0x7fbff8078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.066+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fc008096960 con 0x7fc01815c3b0 2024-05-10T11:18:19.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.067+0000 7fc01659c640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbff8076470 0x7fbff8078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.067+0000 7fc01659c640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbff8076470 0x7fbff8078930 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc010033000 tx=0x7fc010009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.071+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc00805fae0 con 0x7fc01815c3b0 2024-05-10T11:18:19.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.258+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0180d1e20 con 0x7fbff8076470 2024-05-10T11:18:19.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.265+0000 7fc00effd640 1 -- 172.21.15.66:0/1680600958 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250215 (secure 0 0 0) 0x7fc0180d1e20 con 0x7fbff8076470 2024-05-10T11:18:19.270 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:19.271 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:18:19.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbff8076470 msgr2=0x7fbff8078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbff8076470 0x7fbff8078930 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc010033000 tx=0x7fc010009030 comp rx=0 tx=0).stop 2024-05-10T11:18:19.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 msgr2=0x7fc01815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 0x7fc01815c830 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc01806ff80 tx=0x7fc00800e760 comp rx=0 tx=0).stop 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 shutdown_connections 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbff8076470 0x7fbff8078930 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc01815c3b0 0x7fc01815c830 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc018159b30 0x7fc018159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 --2- 172.21.15.66:0/1680600958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0040039b0 0x7fc018159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 >> 172.21.15.66:0/1680600958 conn(0x7fc0180d2df0 msgr2=0x7fc0180ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 shutdown_connections 2024-05-10T11:18:19.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.268+0000 7fc01cd89640 1 -- 172.21.15.66:0/1680600958 wait complete. 2024-05-10T11:18:19.280 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-05-10T11:18:17.771038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":120,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254840,"kb_used_data":9532,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719880,"statfs":{"total":773094113280,"available":772833157120,"internally_reserved":0,"allocated":9760768,"data_stored":5082251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.297458"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590129+0000","last_change":"2024-05-10T11:18:14.504149+0000","last_active":"2024-05-10T11:18:15.590129+0000","last_peered":"2024-05-10T11:18:15.590129+0000","last_clean":"2024-05-10T11:18:15.590129+0000","last_became_active":"2024-05-10T11:18:14.503828+0000","last_became_peered":"2024-05-10T11:18:14.503828+0000","last_unstale":"2024-05-10T11:18:15.590129+0000","last_undegraded":"2024-05-10T11:18:15.590129+0000","last_fullsized":"2024-05-10T11:18:15.590129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504194+0000","last_change":"2024-05-10T11:18:14.505657+0000","last_active":"2024-05-10T11:18:15.504194+0000","last_peered":"2024-05-10T11:18:15.504194+0000","last_clean":"2024-05-10T11:18:15.504194+0000","last_became_active":"2024-05-10T11:18:14.505269+0000","last_became_peered":"2024-05-10T11:18:14.505269+0000","last_unstale":"2024-05-10T11:18:15.504194+0000","last_undegraded":"2024-05-10T11:18:15.504194+0000","last_fullsized":"2024-05-10T11:18:15.504194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:25.863275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589626+0000","last_change":"2024-05-10T11:18:14.502679+0000","last_active":"2024-05-10T11:18:15.589626+0000","last_peered":"2024-05-10T11:18:15.589626+0000","last_clean":"2024-05-10T11:18:15.589626+0000","last_became_active":"2024-05-10T11:18:14.502382+0000","last_became_peered":"2024-05-10T11:18:14.502382+0000","last_unstale":"2024-05-10T11:18:15.589626+0000","last_undegraded":"2024-05-10T11:18:15.589626+0000","last_fullsized":"2024-05-10T11:18:15.589626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590425+0000","last_change":"2024-05-10T11:18:14.505319+0000","last_active":"2024-05-10T11:18:15.590425+0000","last_peered":"2024-05-10T11:18:15.590425+0000","last_clean":"2024-05-10T11:18:15.590425+0000","last_became_active":"2024-05-10T11:18:14.504964+0000","last_became_peered":"2024-05-10T11:18:14.504964+0000","last_unstale":"2024-05-10T11:18:15.590425+0000","last_undegraded":"2024-05-10T11:18:15.590425+0000","last_fullsized":"2024-05-10T11:18:15.590425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.482266+0000","last_change":"2024-05-10T11:18:13.482266+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.482266+0000","last_undegraded":"2024-05-10T11:18:13.482266+0000","last_fullsized":"2024-05-10T11:18:13.482266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589202+0000","last_change":"2024-05-10T11:18:14.510117+0000","last_active":"2024-05-10T11:18:15.589202+0000","last_peered":"2024-05-10T11:18:15.589202+0000","last_clean":"2024-05-10T11:18:15.589202+0000","last_became_active":"2024-05-10T11:18:14.509816+0000","last_became_peered":"2024-05-10T11:18:14.509816+0000","last_unstale":"2024-05-10T11:18:15.589202+0000","last_undegraded":"2024-05-10T11:18:15.589202+0000","last_fullsized":"2024-05-10T11:18:15.589202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:24.104590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480100+0000","last_change":"2024-05-10T11:18:13.480100+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480100+0000","last_undegraded":"2024-05-10T11:18:13.480100+0000","last_fullsized":"2024-05-10T11:18:13.480100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588832+0000","last_change":"2024-05-10T11:18:14.496569+0000","last_active":"2024-05-10T11:18:15.588832+0000","last_peered":"2024-05-10T11:18:15.588832+0000","last_clean":"2024-05-10T11:18:15.588832+0000","last_became_active":"2024-05-10T11:18:14.494250+0000","last_became_peered":"2024-05-10T11:18:14.494250+0000","last_unstale":"2024-05-10T11:18:15.588832+0000","last_undegraded":"2024-05-10T11:18:15.588832+0000","last_fullsized":"2024-05-10T11:18:15.588832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:47.808143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.482263+0000","last_change":"2024-05-10T11:18:13.482263+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.482263+0000","last_undegraded":"2024-05-10T11:18:13.482263+0000","last_fullsized":"2024-05-10T11:18:13.482263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500560+0000","last_change":"2024-05-10T11:18:14.509973+0000","last_active":"2024-05-10T11:18:15.500560+0000","last_peered":"2024-05-10T11:18:15.500560+0000","last_clean":"2024-05-10T11:18:15.500560+0000","last_became_active":"2024-05-10T11:18:14.509543+0000","last_became_peered":"2024-05-10T11:18:14.509543+0000","last_unstale":"2024-05-10T11:18:15.500560+0000","last_undegraded":"2024-05-10T11:18:15.500560+0000","last_fullsized":"2024-05-10T11:18:15.500560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:01.778938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481935+0000","last_change":"2024-05-10T11:18:13.481935+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481935+0000","last_undegraded":"2024-05-10T11:18:13.481935+0000","last_fullsized":"2024-05-10T11:18:13.481935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500601+0000","last_change":"2024-05-10T11:18:14.515247+0000","last_active":"2024-05-10T11:18:15.500601+0000","last_peered":"2024-05-10T11:18:15.500601+0000","last_clean":"2024-05-10T11:18:15.500601+0000","last_became_active":"2024-05-10T11:18:14.514931+0000","last_became_peered":"2024-05-10T11:18:14.514931+0000","last_unstale":"2024-05-10T11:18:15.500601+0000","last_undegraded":"2024-05-10T11:18:15.500601+0000","last_fullsized":"2024-05-10T11:18:15.500601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:59.852003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590206+0000","last_change":"2024-05-10T11:18:14.495959+0000","last_active":"2024-05-10T11:18:15.590206+0000","last_peered":"2024-05-10T11:18:15.590206+0000","last_clean":"2024-05-10T11:18:15.590206+0000","last_became_active":"2024-05-10T11:18:14.494391+0000","last_became_peered":"2024-05-10T11:18:14.494391+0000","last_unstale":"2024-05-10T11:18:15.590206+0000","last_undegraded":"2024-05-10T11:18:15.590206+0000","last_fullsized":"2024-05-10T11:18:15.590206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:10.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481095+0000","last_change":"2024-05-10T11:18:13.481095+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481095+0000","last_undegraded":"2024-05-10T11:18:13.481095+0000","last_fullsized":"2024-05-10T11:18:13.481095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589287+0000","last_change":"2024-05-10T11:18:14.500781+0000","last_active":"2024-05-10T11:18:15.589287+0000","last_peered":"2024-05-10T11:18:15.589287+0000","last_clean":"2024-05-10T11:18:15.589287+0000","last_became_active":"2024-05-10T11:18:14.500434+0000","last_became_peered":"2024-05-10T11:18:14.500434+0000","last_unstale":"2024-05-10T11:18:15.589287+0000","last_undegraded":"2024-05-10T11:18:15.589287+0000","last_fullsized":"2024-05-10T11:18:15.589287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:51.953240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589304+0000","last_change":"2024-05-10T11:18:14.511780+0000","last_active":"2024-05-10T11:18:15.589304+0000","last_peered":"2024-05-10T11:18:15.589304+0000","last_clean":"2024-05-10T11:18:15.589304+0000","last_became_active":"2024-05-10T11:18:14.510880+0000","last_became_peered":"2024-05-10T11:18:14.510880+0000","last_unstale":"2024-05-10T11:18:15.589304+0000","last_undegraded":"2024-05-10T11:18:15.589304+0000","last_fullsized":"2024-05-10T11:18:15.589304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:54:34.155865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589852+0000","last_change":"2024-05-10T11:18:14.499725+0000","last_active":"2024-05-10T11:18:15.589852+0000","last_peered":"2024-05-10T11:18:15.589852+0000","last_clean":"2024-05-10T11:18:15.589852+0000","last_became_active":"2024-05-10T11:18:14.499366+0000","last_became_peered":"2024-05-10T11:18:14.499366+0000","last_unstale":"2024-05-10T11:18:15.589852+0000","last_undegraded":"2024-05-10T11:18:15.589852+0000","last_fullsized":"2024-05-10T11:18:15.589852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:43.303098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589057+0000","last_change":"2024-05-10T11:18:14.506434+0000","last_active":"2024-05-10T11:18:15.589057+0000","last_peered":"2024-05-10T11:18:15.589057+0000","last_clean":"2024-05-10T11:18:15.589057+0000","last_became_active":"2024-05-10T11:18:14.506161+0000","last_became_peered":"2024-05-10T11:18:14.506161+0000","last_unstale":"2024-05-10T11:18:15.589057+0000","last_undegraded":"2024-05-10T11:18:15.589057+0000","last_fullsized":"2024-05-10T11:18:15.589057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481104+0000","last_change":"2024-05-10T11:18:13.481104+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481104+0000","last_undegraded":"2024-05-10T11:18:13.481104+0000","last_fullsized":"2024-05-10T11:18:13.481104+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590428+0000","last_change":"2024-05-10T11:18:14.500701+0000","last_active":"2024-05-10T11:18:15.590428+0000","last_peered":"2024-05-10T11:18:15.590428+0000","last_clean":"2024-05-10T11:18:15.590428+0000","last_became_active":"2024-05-10T11:18:14.500377+0000","last_became_peered":"2024-05-10T11:18:14.500377+0000","last_unstale":"2024-05-10T11:18:15.590428+0000","last_undegraded":"2024-05-10T11:18:15.590428+0000","last_fullsized":"2024-05-10T11:18:15.590428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480592+0000","last_change":"2024-05-10T11:18:13.480592+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480592+0000","last_undegraded":"2024-05-10T11:18:13.480592+0000","last_fullsized":"2024-05-10T11:18:13.480592+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480133+0000","last_change":"2024-05-10T11:18:13.480133+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480133+0000","last_undegraded":"2024-05-10T11:18:13.480133+0000","last_fullsized":"2024-05-10T11:18:13.480133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476134+0000","last_change":"2024-05-10T11:18:13.476134+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476134+0000","last_undegraded":"2024-05-10T11:18:13.476134+0000","last_fullsized":"2024-05-10T11:18:13.476134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589152+0000","last_change":"2024-05-10T11:18:14.496012+0000","last_active":"2024-05-10T11:18:15.589152+0000","last_peered":"2024-05-10T11:18:15.589152+0000","last_clean":"2024-05-10T11:18:15.589152+0000","last_became_active":"2024-05-10T11:18:14.495715+0000","last_became_peered":"2024-05-10T11:18:14.495715+0000","last_unstale":"2024-05-10T11:18:15.589152+0000","last_undegraded":"2024-05-10T11:18:15.589152+0000","last_fullsized":"2024-05-10T11:18:15.589152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.509349+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.509077+0000","last_became_peered":"2024-05-10T11:18:14.509077+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.479522+0000","last_change":"2024-05-10T11:18:13.479522+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.479522+0000","last_undegraded":"2024-05-10T11:18:13.479522+0000","last_fullsized":"2024-05-10T11:18:13.479522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500648+0000","last_change":"2024-05-10T11:18:14.515113+0000","last_active":"2024-05-10T11:18:15.500648+0000","last_peered":"2024-05-10T11:18:15.500648+0000","last_clean":"2024-05-10T11:18:15.500648+0000","last_became_active":"2024-05-10T11:18:14.514824+0000","last_became_peered":"2024-05-10T11:18:14.514824+0000","last_unstale":"2024-05-10T11:18:15.500648+0000","last_undegraded":"2024-05-10T11:18:15.500648+0000","last_fullsized":"2024-05-10T11:18:15.500648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:48.996486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590608+0000","last_change":"2024-05-10T11:18:14.512508+0000","last_active":"2024-05-10T11:18:15.590608+0000","last_peered":"2024-05-10T11:18:15.590608+0000","last_clean":"2024-05-10T11:18:15.590608+0000","last_became_active":"2024-05-10T11:18:14.512218+0000","last_became_peered":"2024-05-10T11:18:14.512218+0000","last_unstale":"2024-05-10T11:18:15.590608+0000","last_undegraded":"2024-05-10T11:18:15.590608+0000","last_fullsized":"2024-05-10T11:18:15.590608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480635+0000","last_change":"2024-05-10T11:18:13.480635+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480635+0000","last_undegraded":"2024-05-10T11:18:13.480635+0000","last_fullsized":"2024-05-10T11:18:13.480635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.479341+0000","last_change":"2024-05-10T11:18:13.479341+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.479341+0000","last_undegraded":"2024-05-10T11:18:13.479341+0000","last_fullsized":"2024-05-10T11:18:13.479341+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503674+0000","last_change":"2024-05-10T11:18:14.507356+0000","last_active":"2024-05-10T11:18:15.503674+0000","last_peered":"2024-05-10T11:18:15.503674+0000","last_clean":"2024-05-10T11:18:15.503674+0000","last_became_active":"2024-05-10T11:18:14.507037+0000","last_became_peered":"2024-05-10T11:18:14.507037+0000","last_unstale":"2024-05-10T11:18:15.503674+0000","last_undegraded":"2024-05-10T11:18:15.503674+0000","last_fullsized":"2024-05-10T11:18:15.503674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589362+0000","last_change":"2024-05-10T11:18:14.511137+0000","last_active":"2024-05-10T11:18:15.589362+0000","last_peered":"2024-05-10T11:18:15.589362+0000","last_clean":"2024-05-10T11:18:15.589362+0000","last_became_active":"2024-05-10T11:18:14.510460+0000","last_became_peered":"2024-05-10T11:18:14.510460+0000","last_unstale":"2024-05-10T11:18:15.589362+0000","last_undegraded":"2024-05-10T11:18:15.589362+0000","last_fullsized":"2024-05-10T11:18:15.589362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:45.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588999+0000","last_change":"2024-05-10T11:18:14.509145+0000","last_active":"2024-05-10T11:18:15.588999+0000","last_peered":"2024-05-10T11:18:15.588999+0000","last_clean":"2024-05-10T11:18:15.588999+0000","last_became_active":"2024-05-10T11:18:14.507612+0000","last_became_peered":"2024-05-10T11:18:14.507612+0000","last_unstale":"2024-05-10T11:18:15.588999+0000","last_undegraded":"2024-05-10T11:18:15.588999+0000","last_fullsized":"2024-05-10T11:18:15.588999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:59.817611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490686+0000","last_change":"2024-05-10T11:18:13.489312+0000","last_active":"2024-05-10T11:18:13.490686+0000","last_peered":"2024-05-10T11:18:13.490686+0000","last_clean":"2024-05-10T11:18:13.490686+0000","last_became_active":"2024-05-10T11:18:13.489055+0000","last_became_peered":"2024-05-10T11:18:13.489055+0000","last_unstale":"2024-05-10T11:18:13.490686+0000","last_undegraded":"2024-05-10T11:18:13.490686+0000","last_fullsized":"2024-05-10T11:18:13.490686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:05.647628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589488+0000","last_change":"2024-05-10T11:18:14.506891+0000","last_active":"2024-05-10T11:18:15.589488+0000","last_peered":"2024-05-10T11:18:15.589488+0000","last_clean":"2024-05-10T11:18:15.589488+0000","last_became_active":"2024-05-10T11:18:14.506604+0000","last_became_peered":"2024-05-10T11:18:14.506604+0000","last_unstale":"2024-05-10T11:18:15.589488+0000","last_undegraded":"2024-05-10T11:18:15.589488+0000","last_fullsized":"2024-05-10T11:18:15.589488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:46.769438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494187+0000","last_change":"2024-05-10T11:18:13.487405+0000","last_active":"2024-05-10T11:18:13.494187+0000","last_peered":"2024-05-10T11:18:13.494187+0000","last_clean":"2024-05-10T11:18:13.494187+0000","last_became_active":"2024-05-10T11:18:13.487122+0000","last_became_peered":"2024-05-10T11:18:13.487122+0000","last_unstale":"2024-05-10T11:18:13.494187+0000","last_undegraded":"2024-05-10T11:18:13.494187+0000","last_fullsized":"2024-05-10T11:18:13.494187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:00.910751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481049+0000","last_change":"2024-05-10T11:18:13.481049+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481049+0000","last_undegraded":"2024-05-10T11:18:13.481049+0000","last_fullsized":"2024-05-10T11:18:13.481049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494227+0000","last_change":"2024-05-10T11:18:13.491023+0000","last_active":"2024-05-10T11:18:13.494227+0000","last_peered":"2024-05-10T11:18:13.494227+0000","last_clean":"2024-05-10T11:18:13.494227+0000","last_became_active":"2024-05-10T11:18:13.490750+0000","last_became_peered":"2024-05-10T11:18:13.490750+0000","last_unstale":"2024-05-10T11:18:13.494227+0000","last_undegraded":"2024-05-10T11:18:13.494227+0000","last_fullsized":"2024-05-10T11:18:13.494227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:04.210949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.517446+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.517158+0000","last_became_peered":"2024-05-10T11:18:14.517158+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:59.932591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.497192+0000","last_change":"2024-05-10T11:18:13.496226+0000","last_active":"2024-05-10T11:18:13.497192+0000","last_peered":"2024-05-10T11:18:13.497192+0000","last_clean":"2024-05-10T11:18:13.497192+0000","last_became_active":"2024-05-10T11:18:13.495965+0000","last_became_peered":"2024-05-10T11:18:13.495965+0000","last_unstale":"2024-05-10T11:18:13.497192+0000","last_undegraded":"2024-05-10T11:18:13.497192+0000","last_fullsized":"2024-05-10T11:18:13.497192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:13.594607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588902+0000","last_change":"2024-05-10T11:18:14.502176+0000","last_active":"2024-05-10T11:18:15.588902+0000","last_peered":"2024-05-10T11:18:15.588902+0000","last_clean":"2024-05-10T11:18:15.588902+0000","last_became_active":"2024-05-10T11:18:14.501901+0000","last_became_peered":"2024-05-10T11:18:14.501901+0000","last_unstale":"2024-05-10T11:18:15.588902+0000","last_undegraded":"2024-05-10T11:18:15.588902+0000","last_fullsized":"2024-05-10T11:18:15.588902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:22.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494241+0000","last_change":"2024-05-10T11:18:13.489468+0000","last_active":"2024-05-10T11:18:13.494241+0000","last_peered":"2024-05-10T11:18:13.494241+0000","last_clean":"2024-05-10T11:18:13.494241+0000","last_became_active":"2024-05-10T11:18:13.489197+0000","last_became_peered":"2024-05-10T11:18:13.489197+0000","last_unstale":"2024-05-10T11:18:13.494241+0000","last_undegraded":"2024-05-10T11:18:13.494241+0000","last_fullsized":"2024-05-10T11:18:13.494241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:15:38.738963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.475557+0000","last_change":"2024-05-10T11:18:13.475557+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.475557+0000","last_undegraded":"2024-05-10T11:18:13.475557+0000","last_fullsized":"2024-05-10T11:18:13.475557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589863+0000","last_change":"2024-05-10T11:18:13.499705+0000","last_active":"2024-05-10T11:18:15.589863+0000","last_peered":"2024-05-10T11:18:15.589863+0000","last_clean":"2024-05-10T11:18:15.589863+0000","last_became_active":"2024-05-10T11:18:13.499448+0000","last_became_peered":"2024-05-10T11:18:13.499448+0000","last_unstale":"2024-05-10T11:18:15.589863+0000","last_undegraded":"2024-05-10T11:18:15.589863+0000","last_fullsized":"2024-05-10T11:18:15.589863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:22.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589016+0000","last_change":"2024-05-10T11:18:14.510528+0000","last_active":"2024-05-10T11:18:15.589016+0000","last_peered":"2024-05-10T11:18:15.589016+0000","last_clean":"2024-05-10T11:18:15.589016+0000","last_became_active":"2024-05-10T11:18:14.510212+0000","last_became_peered":"2024-05-10T11:18:14.510212+0000","last_unstale":"2024-05-10T11:18:15.589016+0000","last_undegraded":"2024-05-10T11:18:15.589016+0000","last_fullsized":"2024-05-10T11:18:15.589016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.308953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589373+0000","last_change":"2024-05-10T11:18:13.484546+0000","last_active":"2024-05-10T11:18:15.589373+0000","last_peered":"2024-05-10T11:18:15.589373+0000","last_clean":"2024-05-10T11:18:15.589373+0000","last_became_active":"2024-05-10T11:18:13.484252+0000","last_became_peered":"2024-05-10T11:18:13.484252+0000","last_unstale":"2024-05-10T11:18:15.589373+0000","last_undegraded":"2024-05-10T11:18:15.589373+0000","last_fullsized":"2024-05-10T11:18:15.589373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:23.840058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590407+0000","last_change":"2024-05-10T11:18:14.502695+0000","last_active":"2024-05-10T11:18:15.590407+0000","last_peered":"2024-05-10T11:18:15.590407+0000","last_clean":"2024-05-10T11:18:15.590407+0000","last_became_active":"2024-05-10T11:18:14.502130+0000","last_became_peered":"2024-05-10T11:18:14.502130+0000","last_unstale":"2024-05-10T11:18:15.590407+0000","last_undegraded":"2024-05-10T11:18:15.590407+0000","last_fullsized":"2024-05-10T11:18:15.590407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494827+0000","last_change":"2024-05-10T11:18:13.492663+0000","last_active":"2024-05-10T11:18:13.494827+0000","last_peered":"2024-05-10T11:18:13.494827+0000","last_clean":"2024-05-10T11:18:13.494827+0000","last_became_active":"2024-05-10T11:18:13.492415+0000","last_became_peered":"2024-05-10T11:18:13.492415+0000","last_unstale":"2024-05-10T11:18:13.494827+0000","last_undegraded":"2024-05-10T11:18:13.494827+0000","last_fullsized":"2024-05-10T11:18:13.494827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:11.795689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478825+0000","last_change":"2024-05-10T11:18:13.478825+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478825+0000","last_undegraded":"2024-05-10T11:18:13.478825+0000","last_fullsized":"2024-05-10T11:18:13.478825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504114+0000","last_change":"2024-05-10T11:18:13.489382+0000","last_active":"2024-05-10T11:18:15.504114+0000","last_peered":"2024-05-10T11:18:15.504114+0000","last_clean":"2024-05-10T11:18:15.504114+0000","last_became_active":"2024-05-10T11:18:13.489117+0000","last_became_peered":"2024-05-10T11:18:13.489117+0000","last_unstale":"2024-05-10T11:18:15.504114+0000","last_undegraded":"2024-05-10T11:18:15.504114+0000","last_fullsized":"2024-05-10T11:18:15.504114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:58.559240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.480549+0000","last_change":"2024-05-10T11:18:13.480549+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.480549+0000","last_undegraded":"2024-05-10T11:18:13.480549+0000","last_fullsized":"2024-05-10T11:18:13.480549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:13.496483+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:13.496161+0000","last_became_peered":"2024-05-10T11:18:13.496161+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589755+0000","last_change":"2024-05-10T11:18:14.505565+0000","last_active":"2024-05-10T11:18:15.589755+0000","last_peered":"2024-05-10T11:18:15.589755+0000","last_clean":"2024-05-10T11:18:15.589755+0000","last_became_active":"2024-05-10T11:18:14.504514+0000","last_became_peered":"2024-05-10T11:18:14.504514+0000","last_unstale":"2024-05-10T11:18:15.589755+0000","last_undegraded":"2024-05-10T11:18:15.589755+0000","last_fullsized":"2024-05-10T11:18:15.589755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.496840+0000","last_change":"2024-05-10T11:18:13.492466+0000","last_active":"2024-05-10T11:18:13.496840+0000","last_peered":"2024-05-10T11:18:13.496840+0000","last_clean":"2024-05-10T11:18:13.496840+0000","last_became_active":"2024-05-10T11:18:13.492210+0000","last_became_peered":"2024-05-10T11:18:13.492210+0000","last_unstale":"2024-05-10T11:18:13.496840+0000","last_undegraded":"2024-05-10T11:18:13.496840+0000","last_fullsized":"2024-05-10T11:18:13.496840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590683+0000","last_change":"2024-05-10T11:18:14.506980+0000","last_active":"2024-05-10T11:18:15.590683+0000","last_peered":"2024-05-10T11:18:15.590683+0000","last_clean":"2024-05-10T11:18:15.590683+0000","last_became_active":"2024-05-10T11:18:14.506669+0000","last_became_peered":"2024-05-10T11:18:14.506669+0000","last_unstale":"2024-05-10T11:18:15.590683+0000","last_undegraded":"2024-05-10T11:18:15.590683+0000","last_fullsized":"2024-05-10T11:18:15.590683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589688+0000","last_change":"2024-05-10T11:18:13.491065+0000","last_active":"2024-05-10T11:18:15.589688+0000","last_peered":"2024-05-10T11:18:15.589688+0000","last_clean":"2024-05-10T11:18:15.589688+0000","last_became_active":"2024-05-10T11:18:13.490740+0000","last_became_peered":"2024-05-10T11:18:13.490740+0000","last_unstale":"2024-05-10T11:18:15.589688+0000","last_undegraded":"2024-05-10T11:18:15.589688+0000","last_fullsized":"2024-05-10T11:18:15.589688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:17.665658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588979+0000","last_change":"2024-05-10T11:18:14.492654+0000","last_active":"2024-05-10T11:18:15.588979+0000","last_peered":"2024-05-10T11:18:15.588979+0000","last_clean":"2024-05-10T11:18:15.588979+0000","last_became_active":"2024-05-10T11:18:14.492328+0000","last_became_peered":"2024-05-10T11:18:14.492328+0000","last_unstale":"2024-05-10T11:18:15.588979+0000","last_undegraded":"2024-05-10T11:18:15.588979+0000","last_fullsized":"2024-05-10T11:18:15.588979+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:24:34.509745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494959+0000","last_change":"2024-05-10T11:18:13.493293+0000","last_active":"2024-05-10T11:18:13.494959+0000","last_peered":"2024-05-10T11:18:13.494959+0000","last_clean":"2024-05-10T11:18:13.494959+0000","last_became_active":"2024-05-10T11:18:13.493029+0000","last_became_peered":"2024-05-10T11:18:13.493029+0000","last_unstale":"2024-05-10T11:18:13.494959+0000","last_undegraded":"2024-05-10T11:18:13.494959+0000","last_fullsized":"2024-05-10T11:18:13.494959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:48.659582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478374+0000","last_change":"2024-05-10T11:18:13.478374+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478374+0000","last_undegraded":"2024-05-10T11:18:13.478374+0000","last_fullsized":"2024-05-10T11:18:13.478374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589062+0000","last_change":"2024-05-10T11:18:13.491930+0000","last_active":"2024-05-10T11:18:15.589062+0000","last_peered":"2024-05-10T11:18:15.589062+0000","last_clean":"2024-05-10T11:18:15.589062+0000","last_became_active":"2024-05-10T11:18:13.491576+0000","last_became_peered":"2024-05-10T11:18:13.491576+0000","last_unstale":"2024-05-10T11:18:15.589062+0000","last_undegraded":"2024-05-10T11:18:15.589062+0000","last_fullsized":"2024-05-10T11:18:15.589062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:20.216601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500392+0000","last_change":"2024-05-10T11:18:14.512578+0000","last_active":"2024-05-10T11:18:15.500392+0000","last_peered":"2024-05-10T11:18:15.500392+0000","last_clean":"2024-05-10T11:18:15.500392+0000","last_became_active":"2024-05-10T11:18:14.512273+0000","last_became_peered":"2024-05-10T11:18:14.512273+0000","last_unstale":"2024-05-10T11:18:15.500392+0000","last_undegraded":"2024-05-10T11:18:15.500392+0000","last_fullsized":"2024-05-10T11:18:15.500392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:16.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589418+0000","last_change":"2024-05-10T11:18:13.494933+0000","last_active":"2024-05-10T11:18:15.589418+0000","last_peered":"2024-05-10T11:18:15.589418+0000","last_clean":"2024-05-10T11:18:15.589418+0000","last_became_active":"2024-05-10T11:18:13.494632+0000","last_became_peered":"2024-05-10T11:18:13.494632+0000","last_unstale":"2024-05-10T11:18:15.589418+0000","last_undegraded":"2024-05-10T11:18:15.589418+0000","last_fullsized":"2024-05-10T11:18:15.589418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.988757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500556+0000","last_change":"2024-05-10T11:18:14.512697+0000","last_active":"2024-05-10T11:18:15.500556+0000","last_peered":"2024-05-10T11:18:15.500556+0000","last_clean":"2024-05-10T11:18:15.500556+0000","last_became_active":"2024-05-10T11:18:14.512424+0000","last_became_peered":"2024-05-10T11:18:14.512424+0000","last_unstale":"2024-05-10T11:18:15.500556+0000","last_undegraded":"2024-05-10T11:18:15.500556+0000","last_fullsized":"2024-05-10T11:18:15.500556+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:16.972744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589019+0000","last_change":"2024-05-10T11:18:13.499748+0000","last_active":"2024-05-10T11:18:15.589019+0000","last_peered":"2024-05-10T11:18:15.589019+0000","last_clean":"2024-05-10T11:18:15.589019+0000","last_became_active":"2024-05-10T11:18:13.499424+0000","last_became_peered":"2024-05-10T11:18:13.499424+0000","last_unstale":"2024-05-10T11:18:15.589019+0000","last_undegraded":"2024-05-10T11:18:15.589019+0000","last_fullsized":"2024-05-10T11:18:15.589019+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:45.777827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589632+0000","last_change":"2024-05-10T11:18:14.509330+0000","last_active":"2024-05-10T11:18:15.589632+0000","last_peered":"2024-05-10T11:18:15.589632+0000","last_clean":"2024-05-10T11:18:15.589632+0000","last_became_active":"2024-05-10T11:18:14.507243+0000","last_became_peered":"2024-05-10T11:18:14.507243+0000","last_unstale":"2024-05-10T11:18:15.589632+0000","last_undegraded":"2024-05-10T11:18:15.589632+0000","last_fullsized":"2024-05-10T11:18:15.589632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:16.911693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.486282+0000","last_change":"2024-05-10T11:18:13.484923+0000","last_active":"2024-05-10T11:18:13.486282+0000","last_peered":"2024-05-10T11:18:13.486282+0000","last_clean":"2024-05-10T11:18:13.486282+0000","last_became_active":"2024-05-10T11:18:13.484625+0000","last_became_peered":"2024-05-10T11:18:13.484625+0000","last_unstale":"2024-05-10T11:18:13.486282+0000","last_undegraded":"2024-05-10T11:18:13.486282+0000","last_fullsized":"2024-05-10T11:18:13.486282+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:57:04.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.475691+0000","last_change":"2024-05-10T11:18:13.475691+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.475691+0000","last_undegraded":"2024-05-10T11:18:13.475691+0000","last_fullsized":"2024-05-10T11:18:13.475691+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490572+0000","last_change":"2024-05-10T11:18:13.488650+0000","last_active":"2024-05-10T11:18:13.490572+0000","last_peered":"2024-05-10T11:18:13.490572+0000","last_clean":"2024-05-10T11:18:13.490572+0000","last_became_active":"2024-05-10T11:18:13.488336+0000","last_became_peered":"2024-05-10T11:18:13.488336+0000","last_unstale":"2024-05-10T11:18:13.490572+0000","last_undegraded":"2024-05-10T11:18:13.490572+0000","last_fullsized":"2024-05-10T11:18:13.490572+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:45.519599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.478379+0000","last_change":"2024-05-10T11:18:13.478379+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.478379+0000","last_undegraded":"2024-05-10T11:18:13.478379+0000","last_fullsized":"2024-05-10T11:18:13.478379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.496770+0000","last_change":"2024-05-10T11:18:13.491192+0000","last_active":"2024-05-10T11:18:13.496770+0000","last_peered":"2024-05-10T11:18:13.496770+0000","last_clean":"2024-05-10T11:18:13.496770+0000","last_became_active":"2024-05-10T11:18:13.490839+0000","last_became_peered":"2024-05-10T11:18:13.490839+0000","last_unstale":"2024-05-10T11:18:13.496770+0000","last_undegraded":"2024-05-10T11:18:13.496770+0000","last_fullsized":"2024-05-10T11:18:13.496770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:11.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589466+0000","last_change":"2024-05-10T11:18:14.509377+0000","last_active":"2024-05-10T11:18:15.589466+0000","last_peered":"2024-05-10T11:18:15.589466+0000","last_clean":"2024-05-10T11:18:15.589466+0000","last_became_active":"2024-05-10T11:18:14.506328+0000","last_became_peered":"2024-05-10T11:18:14.506328+0000","last_unstale":"2024-05-10T11:18:15.589466+0000","last_undegraded":"2024-05-10T11:18:15.589466+0000","last_fullsized":"2024-05-10T11:18:15.589466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:12.639237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503705+0000","last_change":"2024-05-10T11:18:13.487719+0000","last_active":"2024-05-10T11:18:15.503705+0000","last_peered":"2024-05-10T11:18:15.503705+0000","last_clean":"2024-05-10T11:18:15.503705+0000","last_became_active":"2024-05-10T11:18:13.486232+0000","last_became_peered":"2024-05-10T11:18:13.486232+0000","last_unstale":"2024-05-10T11:18:15.503705+0000","last_undegraded":"2024-05-10T11:18:15.503705+0000","last_fullsized":"2024-05-10T11:18:15.503705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503636+0000","last_change":"2024-05-10T11:18:14.501099+0000","last_active":"2024-05-10T11:18:15.503636+0000","last_peered":"2024-05-10T11:18:15.503636+0000","last_clean":"2024-05-10T11:18:15.503636+0000","last_became_active":"2024-05-10T11:18:14.500491+0000","last_became_peered":"2024-05-10T11:18:14.500491+0000","last_unstale":"2024-05-10T11:18:15.503636+0000","last_undegraded":"2024-05-10T11:18:15.503636+0000","last_fullsized":"2024-05-10T11:18:15.503636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500360+0000","last_change":"2024-05-10T11:18:13.496261+0000","last_active":"2024-05-10T11:18:15.500360+0000","last_peered":"2024-05-10T11:18:15.500360+0000","last_clean":"2024-05-10T11:18:15.500360+0000","last_became_active":"2024-05-10T11:18:13.496010+0000","last_became_peered":"2024-05-10T11:18:13.496010+0000","last_unstale":"2024-05-10T11:18:15.500360+0000","last_undegraded":"2024-05-10T11:18:15.500360+0000","last_fullsized":"2024-05-10T11:18:15.500360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:25.142075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503941+0000","last_change":"2024-05-10T11:18:14.508367+0000","last_active":"2024-05-10T11:18:15.503941+0000","last_peered":"2024-05-10T11:18:15.503941+0000","last_clean":"2024-05-10T11:18:15.503941+0000","last_became_active":"2024-05-10T11:18:14.508114+0000","last_became_peered":"2024-05-10T11:18:14.508114+0000","last_unstale":"2024-05-10T11:18:15.503941+0000","last_undegraded":"2024-05-10T11:18:15.503941+0000","last_fullsized":"2024-05-10T11:18:15.503941+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503746+0000","last_change":"2024-05-10T11:18:13.493893+0000","last_active":"2024-05-10T11:18:15.503746+0000","last_peered":"2024-05-10T11:18:15.503746+0000","last_clean":"2024-05-10T11:18:15.503746+0000","last_became_active":"2024-05-10T11:18:13.493661+0000","last_became_peered":"2024-05-10T11:18:13.493661+0000","last_unstale":"2024-05-10T11:18:15.503746+0000","last_undegraded":"2024-05-10T11:18:15.503746+0000","last_fullsized":"2024-05-10T11:18:15.503746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:21.825243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589340+0000","last_change":"2024-05-10T11:18:14.508876+0000","last_active":"2024-05-10T11:18:15.589340+0000","last_peered":"2024-05-10T11:18:15.589340+0000","last_clean":"2024-05-10T11:18:15.589340+0000","last_became_active":"2024-05-10T11:18:14.508599+0000","last_became_peered":"2024-05-10T11:18:14.508599+0000","last_unstale":"2024-05-10T11:18:15.589340+0000","last_undegraded":"2024-05-10T11:18:15.589340+0000","last_fullsized":"2024-05-10T11:18:15.589340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:49.671324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500251+0000","last_change":"2024-05-10T11:18:13.488510+0000","last_active":"2024-05-10T11:18:15.500251+0000","last_peered":"2024-05-10T11:18:15.500251+0000","last_clean":"2024-05-10T11:18:15.500251+0000","last_became_active":"2024-05-10T11:18:13.488224+0000","last_became_peered":"2024-05-10T11:18:13.488224+0000","last_unstale":"2024-05-10T11:18:15.500251+0000","last_undegraded":"2024-05-10T11:18:15.500251+0000","last_fullsized":"2024-05-10T11:18:15.500251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:57.771228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476649+0000","last_change":"2024-05-10T11:18:13.476649+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476649+0000","last_undegraded":"2024-05-10T11:18:13.476649+0000","last_fullsized":"2024-05-10T11:18:13.476649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.490496+0000","last_change":"2024-05-10T11:18:13.486115+0000","last_active":"2024-05-10T11:18:13.490496+0000","last_peered":"2024-05-10T11:18:13.490496+0000","last_clean":"2024-05-10T11:18:13.490496+0000","last_became_active":"2024-05-10T11:18:13.485827+0000","last_became_peered":"2024-05-10T11:18:13.485827+0000","last_unstale":"2024-05-10T11:18:13.490496+0000","last_undegraded":"2024-05-10T11:18:13.490496+0000","last_fullsized":"2024-05-10T11:18:13.490496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:15.763069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589621+0000","last_change":"2024-05-10T11:18:14.508776+0000","last_active":"2024-05-10T11:18:15.589621+0000","last_peered":"2024-05-10T11:18:15.589621+0000","last_clean":"2024-05-10T11:18:15.589621+0000","last_became_active":"2024-05-10T11:18:14.507883+0000","last_became_peered":"2024-05-10T11:18:14.507883+0000","last_unstale":"2024-05-10T11:18:15.589621+0000","last_undegraded":"2024-05-10T11:18:15.589621+0000","last_fullsized":"2024-05-10T11:18:15.589621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:41:09.728598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.491174+0000","last_change":"2024-05-10T11:18:13.486261+0000","last_active":"2024-05-10T11:18:13.491174+0000","last_peered":"2024-05-10T11:18:13.491174+0000","last_clean":"2024-05-10T11:18:13.491174+0000","last_became_active":"2024-05-10T11:18:13.485612+0000","last_became_peered":"2024-05-10T11:18:13.485612+0000","last_unstale":"2024-05-10T11:18:13.491174+0000","last_undegraded":"2024-05-10T11:18:13.491174+0000","last_fullsized":"2024-05-10T11:18:13.491174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:26.233985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589573+0000","last_change":"2024-05-10T11:18:14.503515+0000","last_active":"2024-05-10T11:18:15.589573+0000","last_peered":"2024-05-10T11:18:15.589573+0000","last_clean":"2024-05-10T11:18:15.589573+0000","last_became_active":"2024-05-10T11:18:14.503224+0000","last_became_peered":"2024-05-10T11:18:14.503224+0000","last_unstale":"2024-05-10T11:18:15.589573+0000","last_undegraded":"2024-05-10T11:18:15.589573+0000","last_fullsized":"2024-05-10T11:18:15.589573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:32.860740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.491326+0000","last_change":"2024-05-10T11:18:13.486384+0000","last_active":"2024-05-10T11:18:13.491326+0000","last_peered":"2024-05-10T11:18:13.491326+0000","last_clean":"2024-05-10T11:18:13.491326+0000","last_became_active":"2024-05-10T11:18:13.486083+0000","last_became_peered":"2024-05-10T11:18:13.486083+0000","last_unstale":"2024-05-10T11:18:13.491326+0000","last_undegraded":"2024-05-10T11:18:13.491326+0000","last_fullsized":"2024-05-10T11:18:13.491326+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:09.025915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.505472+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.505178+0000","last_became_peered":"2024-05-10T11:18:14.505178+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:05.754282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.486356+0000","last_change":"2024-05-10T11:18:13.485497+0000","last_active":"2024-05-10T11:18:13.486356+0000","last_peered":"2024-05-10T11:18:13.486356+0000","last_clean":"2024-05-10T11:18:13.486356+0000","last_became_active":"2024-05-10T11:18:13.484458+0000","last_became_peered":"2024-05-10T11:18:13.484458+0000","last_unstale":"2024-05-10T11:18:13.486356+0000","last_undegraded":"2024-05-10T11:18:13.486356+0000","last_fullsized":"2024-05-10T11:18:13.486356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:04.621280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500292+0000","last_change":"2024-05-10T11:18:14.505021+0000","last_active":"2024-05-10T11:18:15.500292+0000","last_peered":"2024-05-10T11:18:15.500292+0000","last_clean":"2024-05-10T11:18:15.500292+0000","last_became_active":"2024-05-10T11:18:14.504766+0000","last_became_peered":"2024-05-10T11:18:14.504766+0000","last_unstale":"2024-05-10T11:18:15.500292+0000","last_undegraded":"2024-05-10T11:18:15.500292+0000","last_fullsized":"2024-05-10T11:18:15.500292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590044+0000","last_change":"2024-05-10T11:18:13.492021+0000","last_active":"2024-05-10T11:18:15.590044+0000","last_peered":"2024-05-10T11:18:15.590044+0000","last_clean":"2024-05-10T11:18:15.590044+0000","last_became_active":"2024-05-10T11:18:13.491360+0000","last_became_peered":"2024-05-10T11:18:13.491360+0000","last_unstale":"2024-05-10T11:18:15.590044+0000","last_undegraded":"2024-05-10T11:18:15.590044+0000","last_fullsized":"2024-05-10T11:18:15.590044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:04.747286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589257+0000","last_change":"2024-05-10T11:18:14.492959+0000","last_active":"2024-05-10T11:18:15.589257+0000","last_peered":"2024-05-10T11:18:15.589257+0000","last_clean":"2024-05-10T11:18:15.589257+0000","last_became_active":"2024-05-10T11:18:14.492664+0000","last_became_peered":"2024-05-10T11:18:14.492664+0000","last_unstale":"2024-05-10T11:18:15.589257+0000","last_undegraded":"2024-05-10T11:18:15.589257+0000","last_fullsized":"2024-05-10T11:18:15.589257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504029+0000","last_change":"2024-05-10T11:18:13.487280+0000","last_active":"2024-05-10T11:18:15.504029+0000","last_peered":"2024-05-10T11:18:15.504029+0000","last_clean":"2024-05-10T11:18:15.504029+0000","last_became_active":"2024-05-10T11:18:13.487022+0000","last_became_peered":"2024-05-10T11:18:13.487022+0000","last_unstale":"2024-05-10T11:18:15.504029+0000","last_undegraded":"2024-05-10T11:18:15.504029+0000","last_fullsized":"2024-05-10T11:18:15.504029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:46.801147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.476079+0000","last_change":"2024-05-10T11:18:13.476079+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.476079+0000","last_undegraded":"2024-05-10T11:18:13.476079+0000","last_fullsized":"2024-05-10T11:18:13.476079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.485770+0000","last_change":"2024-05-10T11:18:13.484685+0000","last_active":"2024-05-10T11:18:13.485770+0000","last_peered":"2024-05-10T11:18:13.485770+0000","last_clean":"2024-05-10T11:18:13.485770+0000","last_became_active":"2024-05-10T11:18:13.484358+0000","last_became_peered":"2024-05-10T11:18:13.484358+0000","last_unstale":"2024-05-10T11:18:13.485770+0000","last_undegraded":"2024-05-10T11:18:13.485770+0000","last_fullsized":"2024-05-10T11:18:13.485770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:52.982560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590001+0000","last_change":"2024-05-10T11:18:14.509858+0000","last_active":"2024-05-10T11:18:15.590001+0000","last_peered":"2024-05-10T11:18:15.590001+0000","last_clean":"2024-05-10T11:18:15.590001+0000","last_became_active":"2024-05-10T11:18:14.509560+0000","last_became_peered":"2024-05-10T11:18:14.509560+0000","last_unstale":"2024-05-10T11:18:15.590001+0000","last_undegraded":"2024-05-10T11:18:15.590001+0000","last_fullsized":"2024-05-10T11:18:15.590001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:22.114478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.494200+0000","last_change":"2024-05-10T11:18:13.490373+0000","last_active":"2024-05-10T11:18:13.494200+0000","last_peered":"2024-05-10T11:18:13.494200+0000","last_clean":"2024-05-10T11:18:13.494200+0000","last_became_active":"2024-05-10T11:18:13.490094+0000","last_became_peered":"2024-05-10T11:18:13.490094+0000","last_unstale":"2024-05-10T11:18:13.494200+0000","last_undegraded":"2024-05-10T11:18:13.494200+0000","last_fullsized":"2024-05-10T11:18:13.494200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-10T11:18:13.481647+0000","last_change":"2024-05-10T11:18:13.481647+0000","last_active":"2024-05-10T11:18:13.469868+0000","last_peered":"2024-05-10T11:18:13.469868+0000","last_clean":"2024-05-10T11:18:13.469868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:18:13.481647+0000","last_undegraded":"2024-05-10T11:18:13.481647+0000","last_fullsized":"2024-05-10T11:18:13.481647+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590498+0000","last_change":"2024-05-10T11:18:13.495136+0000","last_active":"2024-05-10T11:18:15.590498+0000","last_peered":"2024-05-10T11:18:15.590498+0000","last_clean":"2024-05-10T11:18:15.590498+0000","last_became_active":"2024-05-10T11:18:13.494834+0000","last_became_peered":"2024-05-10T11:18:13.494834+0000","last_unstale":"2024-05-10T11:18:15.590498+0000","last_undegraded":"2024-05-10T11:18:15.590498+0000","last_fullsized":"2024-05-10T11:18:15.590498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:09.195125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T11:18:13.481528+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:18:13.481528+0000","last_peered":"2024-05-10T11:18:13.481528+0000","last_clean":"2024-05-10T11:18:13.481528+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:18:13.481528+0000","last_undegraded":"2024-05-10T11:18:13.481528+0000","last_fullsized":"2024-05-10T11:18:13.481528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1069097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":478729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":478729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":492658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1695744,"data_stored":1085274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:18:19.283 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3b is not active+clean 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.482266+0000', 'last_change': '2024-05-10T11:18:13.482266+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.482266+0000', 'last_undegraded': '2024-05-10T11:18:13.482266+0000', 'last_fullsized': '2024-05-10T11:18:13.482266+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:PG 14.39 is not active+clean 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.480100+0000', 'last_change': '2024-05-10T11:18:13.480100+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.480100+0000', 'last_undegraded': '2024-05-10T11:18:13.480100+0000', 'last_fullsized': '2024-05-10T11:18:13.480100+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:PG 14.37 is not active+clean 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.482263+0000', 'last_change': '2024-05-10T11:18:13.482263+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.482263+0000', 'last_undegraded': '2024-05-10T11:18:13.482263+0000', 'last_fullsized': '2024-05-10T11:18:13.482263+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:PG 14.35 is not active+clean 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.481935+0000', 'last_change': '2024-05-10T11:18:13.481935+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.481935+0000', 'last_undegraded': '2024-05-10T11:18:13.481935+0000', 'last_fullsized': '2024-05-10T11:18:13.481935+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:PG 14.32 is not active+clean 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.481095+0000', 'last_change': '2024-05-10T11:18:13.481095+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.481095+0000', 'last_undegraded': '2024-05-10T11:18:13.481095+0000', 'last_fullsized': '2024-05-10T11:18:13.481095+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.284 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2d is not active+clean 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.481104+0000', 'last_change': '2024-05-10T11:18:13.481104+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.481104+0000', 'last_undegraded': '2024-05-10T11:18:13.481104+0000', 'last_fullsized': '2024-05-10T11:18:13.481104+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2b is not active+clean 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.480592+0000', 'last_change': '2024-05-10T11:18:13.480592+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.480592+0000', 'last_undegraded': '2024-05-10T11:18:13.480592+0000', 'last_fullsized': '2024-05-10T11:18:13.480592+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2a is not active+clean 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.480133+0000', 'last_change': '2024-05-10T11:18:13.480133+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.480133+0000', 'last_undegraded': '2024-05-10T11:18:13.480133+0000', 'last_fullsized': '2024-05-10T11:18:13.480133+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:PG 14.29 is not active+clean 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.476134+0000', 'last_change': '2024-05-10T11:18:13.476134+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.476134+0000', 'last_undegraded': '2024-05-10T11:18:13.476134+0000', 'last_fullsized': '2024-05-10T11:18:13.476134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:PG 14.26 is not active+clean 2024-05-10T11:18:19.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.479522+0000', 'last_change': '2024-05-10T11:18:13.479522+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.479522+0000', 'last_undegraded': '2024-05-10T11:18:13.479522+0000', 'last_fullsized': '2024-05-10T11:18:13.479522+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:PG 14.23 is not active+clean 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.480635+0000', 'last_change': '2024-05-10T11:18:13.480635+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.480635+0000', 'last_undegraded': '2024-05-10T11:18:13.480635+0000', 'last_fullsized': '2024-05-10T11:18:13.480635+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:PG 14.22 is not active+clean 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.479341+0000', 'last_change': '2024-05-10T11:18:13.479341+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.479341+0000', 'last_undegraded': '2024-05-10T11:18:13.479341+0000', 'last_fullsized': '2024-05-10T11:18:13.479341+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1e is not active+clean 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.481049+0000', 'last_change': '2024-05-10T11:18:13.481049+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.481049+0000', 'last_undegraded': '2024-05-10T11:18:13.481049+0000', 'last_fullsized': '2024-05-10T11:18:13.481049+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:PG 14.19 is not active+clean 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.475557+0000', 'last_change': '2024-05-10T11:18:13.475557+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.475557+0000', 'last_undegraded': '2024-05-10T11:18:13.475557+0000', 'last_fullsized': '2024-05-10T11:18:13.475557+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:PG 14.14 is not active+clean 2024-05-10T11:18:19.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.478825+0000', 'last_change': '2024-05-10T11:18:13.478825+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.478825+0000', 'last_undegraded': '2024-05-10T11:18:13.478825+0000', 'last_fullsized': '2024-05-10T11:18:13.478825+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:PG 14.15 is not active+clean 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.480549+0000', 'last_change': '2024-05-10T11:18:13.480549+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.480549+0000', 'last_undegraded': '2024-05-10T11:18:13.480549+0000', 'last_fullsized': '2024-05-10T11:18:13.480549+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:PG 14.11 is not active+clean 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.478374+0000', 'last_change': '2024-05-10T11:18:13.478374+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.478374+0000', 'last_undegraded': '2024-05-10T11:18:13.478374+0000', 'last_fullsized': '2024-05-10T11:18:13.478374+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:PG 14.d is not active+clean 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.475691+0000', 'last_change': '2024-05-10T11:18:13.475691+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.475691+0000', 'last_undegraded': '2024-05-10T11:18:13.475691+0000', 'last_fullsized': '2024-05-10T11:18:13.475691+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:PG 14.e is not active+clean 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.478379+0000', 'last_change': '2024-05-10T11:18:13.478379+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.478379+0000', 'last_undegraded': '2024-05-10T11:18:13.478379+0000', 'last_fullsized': '2024-05-10T11:18:13.478379+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:PG 14.4 is not active+clean 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.476649+0000', 'last_change': '2024-05-10T11:18:13.476649+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.476649+0000', 'last_undegraded': '2024-05-10T11:18:13.476649+0000', 'last_fullsized': '2024-05-10T11:18:13.476649+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:18:19.287 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2 is not active+clean 2024-05-10T11:18:19.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.476079+0000', 'last_change': '2024-05-10T11:18:13.476079+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.476079+0000', 'last_undegraded': '2024-05-10T11:18:13.476079+0000', 'last_fullsized': '2024-05-10T11:18:13.476079+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T11:18:19.288 INFO:tasks.ceph.ceph_manager.ceph:PG 14.f is not active+clean 2024-05-10T11:18:19.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-10T11:18:13.481647+0000', 'last_change': '2024-05-10T11:18:13.481647+0000', 'last_active': '2024-05-10T11:18:13.469868+0000', 'last_peered': '2024-05-10T11:18:13.469868+0000', 'last_clean': '2024-05-10T11:18:13.469868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T11:18:13.481647+0000', 'last_undegraded': '2024-05-10T11:18:13.481647+0000', 'last_fullsized': '2024-05-10T11:18:13.481647+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'last_clean_scrub_stamp': '2024-05-10T11:18:13.469868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T11:18:19.288 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T11:18:19.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.423+0000 7fa07cc99640 1 Processor -- start 2024-05-10T11:18:19.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.423+0000 7fa07cc99640 1 -- start start 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa07cc99640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa07815f4e0 0x7fa07806d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa07cc99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0780d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa07cc99640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0780b0a90 con 0x7fa07815f8c0 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa07cc99640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa0780b23f0 con 0x7fa07815f4e0 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa07cc99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780b4150 con 0x7fa07806e620 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa076d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0780d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa07659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa07815f4e0 0x7fa07806d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa076d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0780d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:36436/0 (socket says 172.21.15.66:36436) 2024-05-10T11:18:19.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa076d9d640 1 -- 172.21.15.66:0/1953809985 learned_addr learned my addr 172.21.15.66:0/1953809985 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:19.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.424+0000 7fa06ffff640 1 --1- 172.21.15.66:0/1953809985 >> v1:172.21.15.190:6789/0 conn(0x7fa07815f8c0 0x7fa07806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:56866/0 (socket says 172.21.15.66:56866) 2024-05-10T11:18:19.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa076d9d640 1 -- 172.21.15.66:0/1953809985 >> v2:172.21.15.190:3300/0 conn(0x7fa07815f4e0 msgr2=0x7fa07806d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:19.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa076d9d640 1 --2- 172.21.15.66:0/1953809985 >> v2:172.21.15.190:3300/0 conn(0x7fa07815f4e0 0x7fa07806d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa076d9d640 1 -- 172.21.15.66:0/1953809985 >> v1:172.21.15.190:6789/0 conn(0x7fa07815f8c0 legacy=0x7fa07806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa076d9d640 1 -- 172.21.15.66:0/1953809985 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0780b3540 con 0x7fa07806e620 2024-05-10T11:18:19.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa07659c640 1 --2- 172.21.15.66:0/1953809985 >> v2:172.21.15.190:3300/0 conn(0x7fa07815f4e0 0x7fa07806d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa076d9d640 1 --2- 172.21.15.66:0/1953809985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0780d0cf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa070009e50 tx=0x7fa07002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20213d504bfc4d61 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.425+0000 7fa075d9b640 1 -- 172.21.15.66:0/1953809985 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070036070 con 0x7fa07806e620 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa075d9b640 1 -- 172.21.15.66:0/1953809985 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070031600 con 0x7fa07806e620 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa075d9b640 1 -- 172.21.15.66:0/1953809985 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700319d0 con 0x7fa07806e620 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 -- 172.21.15.66:0/1953809985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 msgr2=0x7fa0780d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 --2- 172.21.15.66:0/1953809985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0780d0cf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa070009e50 tx=0x7fa07002a680 comp rx=0 tx=0).stop 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 -- 172.21.15.66:0/1953809985 shutdown_connections 2024-05-10T11:18:19.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 --2- 172.21.15.66:0/1953809985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0780d0cf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 --2- 172.21.15.66:0/1953809985 >> v2:172.21.15.190:3300/0 conn(0x7fa07815f4e0 0x7fa07806d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 -- 172.21.15.66:0/1953809985 >> 172.21.15.66:0/1953809985 conn(0x7fa0780d2df0 msgr2=0x7fa0780d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:19.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 -- 172.21.15.66:0/1953809985 shutdown_connections 2024-05-10T11:18:19.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.426+0000 7fa07cc99640 1 -- 172.21.15.66:0/1953809985 wait complete. 2024-05-10T11:18:19.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.427+0000 7fa07cc99640 1 Processor -- start 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.427+0000 7fa07cc99640 1 -- start start 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07cc99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0781f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07cc99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 0x7fa0780c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07cc99640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07815f8c0 0x7fa078152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07cc99640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780b3de0 con 0x7fa07815f4e0 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07cc99640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780b3b00 con 0x7fa07815f8c0 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07cc99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780b45e0 con 0x7fa07806e620 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 0x7fa0780c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 0x7fa0780c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36170/0 (socket says 172.21.15.66:36170) 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa06ffff640 1 -- 172.21.15.66:0/418086414 learned_addr learned my addr 172.21.15.66:0/418086414 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa07659c640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0781f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.428+0000 7fa076d9d640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07815f8c0 0x7fa078152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06ffff640 1 -- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 msgr2=0x7fa0781f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06ffff640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0781f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06ffff640 1 -- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07815f8c0 msgr2=0x7fa078152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06ffff640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07815f8c0 0x7fa078152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06ffff640 1 -- 172.21.15.66:0/418086414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07815b630 con 0x7fa07815f4e0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06ffff640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 0x7fa0780c9120 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c3a0 tx=0x7fa06000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600074e0 con 0x7fa07815f4e0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa060007680 con 0x7fa07815f4e0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060004a00 con 0x7fa07815f4e0 2024-05-10T11:18:19.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07815b910 con 0x7fa07815f4e0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.429+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0781f4b40 con 0x7fa07815f4e0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.430+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07806a220 con 0x7fa07815f4e0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.431+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa06001a020 con 0x7fa07815f4e0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.431+0000 7fa06effd640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0580762d0 0x7fa058078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.432+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fa060096d70 con 0x7fa07815f4e0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.432+0000 7fa07659c640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0580762d0 0x7fa058078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.432+0000 7fa07659c640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0580762d0 0x7fa058078790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa068009560 tx=0x7fa068009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.436+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa06005ff80 con 0x7fa07815f4e0 2024-05-10T11:18:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.701+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa07815e800 con 0x7fa07815f4e0 2024-05-10T11:18:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.702+0000 7fa06effd640 1 -- 172.21.15.66:0/418086414 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1260 (secure 0 0 0) 0x7fa060064280 con 0x7fa07815f4e0 2024-05-10T11:18:19.704 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:19.704 INFO:teuthology.orchestra.run.smithi066.stdout:{"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":372,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":88,"num_osds":8,"num_up_osds":8,"osd_up_since":1715339538,"num_in_osds":8,"osd_in_since":1715339529,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":75},{"state_name":"creating+peering","count":22}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":591980,"bytes_used":260956160,"bytes_avail":772833157120,"bytes_total":773094113280,"inactive_pgs_ratio":0.22680412232875824,"write_bytes_sec":579,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":63,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":6873}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-05-10T11:17:39.761459+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T11:18:19.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.703+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0580762d0 msgr2=0x7fa058078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.703+0000 7fa07cc99640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0580762d0 0x7fa058078790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa068009560 tx=0x7fa068009190 comp rx=0 tx=0).stop 2024-05-10T11:18:19.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.703+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 msgr2=0x7fa0780c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.703+0000 7fa07cc99640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 0x7fa0780c9120 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c3a0 tx=0x7fa06000c860 comp rx=0 tx=0).stop 2024-05-10T11:18:19.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 shutdown_connections 2024-05-10T11:18:19.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0580762d0 0x7fa058078790 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07815f8c0 0x7fa078152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa07815f4e0 0x7fa0780c9120 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 --2- 172.21.15.66:0/418086414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa07806e620 0x7fa0781f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 >> 172.21.15.66:0/418086414 conn(0x7fa0780d2df0 msgr2=0x7fa078070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 shutdown_connections 2024-05-10T11:18:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.704+0000 7fa07cc99640 1 -- 172.21.15.66:0/418086414 wait complete. 2024-05-10T11:18:19.717 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T11:18:19.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:18:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.821+0000 7f16e6245640 1 Processor -- start 2024-05-10T11:18:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.821+0000 7f16e6245640 1 -- start start 2024-05-10T11:18:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16e6245640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00c6c80 0x7f16e00c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16e6245640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16e00cee40 0x7f16e00cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16e6245640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e006f1c0 con 0x7f16e01598c0 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16e6245640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f16e00c7620 con 0x7f16e00cee40 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16e6245640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f16e006f4a0 con 0x7f16e00c6c80 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16dffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16e00cee40 0x7f16e00cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16dffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16e00cee40 0x7f16e00cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36184/0 (socket says 172.21.15.66:36184) 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.822+0000 7f16dffff640 1 -- 172.21.15.66:0/1246697844 learned_addr learned my addr 172.21.15.66:0/1246697844 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16deffd640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00c6c80 0x7f16e00c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16dffff640 1 -- 172.21.15.66:0/1246697844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00c6c80 msgr2=0x7f16e00c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16dffff640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00c6c80 0x7f16e00c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16dffff640 1 -- 172.21.15.66:0/1246697844 >> v1:172.21.15.190:6789/0 conn(0x7f16e01598c0 legacy=0x7f16e006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16dffff640 1 -- 172.21.15.66:0/1246697844 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e006f780 con 0x7f16e00cee40 2024-05-10T11:18:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16deffd640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00c6c80 0x7f16e00c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.823+0000 7f16dffff640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00cee40 0x7f16e00cf2d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009e50 tx=0x7f16d802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dd16b7088ba3cf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16de7fc640 1 -- 172.21.15.66:0/1246697844 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d8036070 con 0x7f16e00cee40 2024-05-10T11:18:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16de7fc640 1 -- 172.21.15.66:0/1246697844 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d8031600 con 0x7f16e00cee40 2024-05-10T11:18:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16de7fc640 1 -- 172.21.15.66:0/1246697844 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80319d0 con 0x7f16e00cee40 2024-05-10T11:18:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 -- 172.21.15.66:0/1246697844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00cee40 msgr2=0x7f16e00cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00cee40 0x7f16e00cf2d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009e50 tx=0x7f16d802a710 comp rx=0 tx=0).stop 2024-05-10T11:18:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 -- 172.21.15.66:0/1246697844 shutdown_connections 2024-05-10T11:18:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00cee40 0x7f16e00cf2d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 --2- 172.21.15.66:0/1246697844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00c6c80 0x7f16e00c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 -- 172.21.15.66:0/1246697844 >> 172.21.15.66:0/1246697844 conn(0x7f16e00b2900 msgr2=0x7f16e00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 -- 172.21.15.66:0/1246697844 shutdown_connections 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.824+0000 7f16e6245640 1 -- 172.21.15.66:0/1246697844 wait complete. 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.825+0000 7f16e6245640 1 Processor -- start 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 -- start start 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 0x7f16e00c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00cee40 0x7f16e0156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16e01598c0 0x7f16e0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16e015c6e0 con 0x7f16e00c6c80 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00ce920 con 0x7f16e01598c0 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16e6245640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f16e006ee10 con 0x7f16e00cee40 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16df7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 0x7f16e00c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16df7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 0x7f16e00c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36194/0 (socket says 172.21.15.66:36194) 2024-05-10T11:18:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.826+0000 7f16df7fe640 1 -- 172.21.15.66:0/681711523 learned_addr learned my addr 172.21.15.66:0/681711523 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16dffff640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16e01598c0 0x7f16e0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16deffd640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00cee40 0x7f16e0156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16df7fe640 1 -- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00cee40 msgr2=0x7f16e0156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16df7fe640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00cee40 0x7f16e0156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16df7fe640 1 -- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16e01598c0 msgr2=0x7f16e0159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:19.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16df7fe640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16e01598c0 0x7f16e0159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16df7fe640 1 -- 172.21.15.66:0/681711523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e00cc120 con 0x7f16e00c6c80 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16df7fe640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 0x7f16e00c7d80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c3c0 tx=0x7f16d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d00052d0 con 0x7f16e00c6c80 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d0005490 con 0x7f16e00c6c80 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0007260 con 0x7f16e00c6c80 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e00cc400 con 0x7f16e00c6c80 2024-05-10T11:18:19.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.827+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e00cc9c0 con 0x7f16e00c6c80 2024-05-10T11:18:19.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.828+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e006a220 con 0x7f16e00c6c80 2024-05-10T11:18:19.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.829+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16d0007400 con 0x7f16e00c6c80 2024-05-10T11:18:19.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.830+0000 7f16c7fff640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16cc076300 0x7f16cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:19.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.830+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f16d0096b70 con 0x7f16e00c6c80 2024-05-10T11:18:19.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.830+0000 7f16deffd640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16cc076300 0x7f16cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.830+0000 7f16deffd640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16cc076300 0x7f16cc0787c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f16e01f8a70 tx=0x7f16d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:19.834+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f16d005fcf0 con 0x7f16e00c6c80 2024-05-10T11:18:20.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.027+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16e0074240 con 0x7f16cc076300 2024-05-10T11:18:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.034+0000 7f16c7fff640 1 -- 172.21.15.66:0/681711523 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7f16e0074240 con 0x7f16cc076300 2024-05-10T11:18:20.038 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16cc076300 msgr2=0x7f16cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16cc076300 0x7f16cc0787c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f16e01f8a70 tx=0x7f16d4008040 comp rx=0 tx=0).stop 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 msgr2=0x7f16e00c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 0x7f16e00c7d80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c3c0 tx=0x7f16d000c880 comp rx=0 tx=0).stop 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 shutdown_connections 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16cc076300 0x7f16cc0787c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16e01598c0 0x7f16e0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16e00cee40 0x7f16e0156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:20.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 --2- 172.21.15.66:0/681711523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16e00c6c80 0x7f16e00c7d80 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:20.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 >> 172.21.15.66:0/681711523 conn(0x7f16e00b2900 msgr2=0x7f16e00b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:20.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 shutdown_connections 2024-05-10T11:18:20.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:20.037+0000 7f16e6245640 1 -- 172.21.15.66:0/681711523 wait complete. 2024-05-10T11:18:20.048 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-05-10T11:18:19.771650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254944,"kb_used_data":9640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719776,"statfs":{"total":773094113280,"available":772833050624,"internally_reserved":0,"allocated":9871360,"data_stored":5126260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.298169"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590129+0000","last_change":"2024-05-10T11:18:14.504149+0000","last_active":"2024-05-10T11:18:15.590129+0000","last_peered":"2024-05-10T11:18:15.590129+0000","last_clean":"2024-05-10T11:18:15.590129+0000","last_became_active":"2024-05-10T11:18:14.503828+0000","last_became_peered":"2024-05-10T11:18:14.503828+0000","last_unstale":"2024-05-10T11:18:15.590129+0000","last_undegraded":"2024-05-10T11:18:15.590129+0000","last_fullsized":"2024-05-10T11:18:15.590129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504194+0000","last_change":"2024-05-10T11:18:14.505657+0000","last_active":"2024-05-10T11:18:15.504194+0000","last_peered":"2024-05-10T11:18:15.504194+0000","last_clean":"2024-05-10T11:18:15.504194+0000","last_became_active":"2024-05-10T11:18:14.505269+0000","last_became_peered":"2024-05-10T11:18:14.505269+0000","last_unstale":"2024-05-10T11:18:15.504194+0000","last_undegraded":"2024-05-10T11:18:15.504194+0000","last_fullsized":"2024-05-10T11:18:15.504194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:25.863275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589626+0000","last_change":"2024-05-10T11:18:14.502679+0000","last_active":"2024-05-10T11:18:15.589626+0000","last_peered":"2024-05-10T11:18:15.589626+0000","last_clean":"2024-05-10T11:18:15.589626+0000","last_became_active":"2024-05-10T11:18:14.502382+0000","last_became_peered":"2024-05-10T11:18:14.502382+0000","last_unstale":"2024-05-10T11:18:15.589626+0000","last_undegraded":"2024-05-10T11:18:15.589626+0000","last_fullsized":"2024-05-10T11:18:15.589626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590425+0000","last_change":"2024-05-10T11:18:14.505319+0000","last_active":"2024-05-10T11:18:15.590425+0000","last_peered":"2024-05-10T11:18:15.590425+0000","last_clean":"2024-05-10T11:18:15.590425+0000","last_became_active":"2024-05-10T11:18:14.504964+0000","last_became_peered":"2024-05-10T11:18:14.504964+0000","last_unstale":"2024-05-10T11:18:15.590425+0000","last_undegraded":"2024-05-10T11:18:15.590425+0000","last_fullsized":"2024-05-10T11:18:15.590425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500652+0000","last_change":"2024-05-10T11:18:14.507407+0000","last_active":"2024-05-10T11:18:15.500652+0000","last_peered":"2024-05-10T11:18:15.500652+0000","last_clean":"2024-05-10T11:18:15.500652+0000","last_became_active":"2024-05-10T11:18:14.502885+0000","last_became_peered":"2024-05-10T11:18:14.502885+0000","last_unstale":"2024-05-10T11:18:15.500652+0000","last_undegraded":"2024-05-10T11:18:15.500652+0000","last_fullsized":"2024-05-10T11:18:15.500652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:32.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589202+0000","last_change":"2024-05-10T11:18:14.510117+0000","last_active":"2024-05-10T11:18:15.589202+0000","last_peered":"2024-05-10T11:18:15.589202+0000","last_clean":"2024-05-10T11:18:15.589202+0000","last_became_active":"2024-05-10T11:18:14.509816+0000","last_became_peered":"2024-05-10T11:18:14.509816+0000","last_unstale":"2024-05-10T11:18:15.589202+0000","last_undegraded":"2024-05-10T11:18:15.589202+0000","last_fullsized":"2024-05-10T11:18:15.589202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:24.104590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589757+0000","last_change":"2024-05-10T11:18:14.496651+0000","last_active":"2024-05-10T11:18:15.589757+0000","last_peered":"2024-05-10T11:18:15.589757+0000","last_clean":"2024-05-10T11:18:15.589757+0000","last_became_active":"2024-05-10T11:18:14.496393+0000","last_became_peered":"2024-05-10T11:18:14.496393+0000","last_unstale":"2024-05-10T11:18:15.589757+0000","last_undegraded":"2024-05-10T11:18:15.589757+0000","last_fullsized":"2024-05-10T11:18:15.589757+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:52.135649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588832+0000","last_change":"2024-05-10T11:18:14.496569+0000","last_active":"2024-05-10T11:18:15.588832+0000","last_peered":"2024-05-10T11:18:15.588832+0000","last_clean":"2024-05-10T11:18:15.588832+0000","last_became_active":"2024-05-10T11:18:14.494250+0000","last_became_peered":"2024-05-10T11:18:14.494250+0000","last_unstale":"2024-05-10T11:18:15.588832+0000","last_undegraded":"2024-05-10T11:18:15.588832+0000","last_fullsized":"2024-05-10T11:18:15.588832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:47.808143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501031+0000","last_change":"2024-05-10T11:18:14.506686+0000","last_active":"2024-05-10T11:18:15.501031+0000","last_peered":"2024-05-10T11:18:15.501031+0000","last_clean":"2024-05-10T11:18:15.501031+0000","last_became_active":"2024-05-10T11:18:14.506421+0000","last_became_peered":"2024-05-10T11:18:14.506421+0000","last_unstale":"2024-05-10T11:18:15.501031+0000","last_undegraded":"2024-05-10T11:18:15.501031+0000","last_fullsized":"2024-05-10T11:18:15.501031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:05.217944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500560+0000","last_change":"2024-05-10T11:18:14.509973+0000","last_active":"2024-05-10T11:18:15.500560+0000","last_peered":"2024-05-10T11:18:15.500560+0000","last_clean":"2024-05-10T11:18:15.500560+0000","last_became_active":"2024-05-10T11:18:14.509543+0000","last_became_peered":"2024-05-10T11:18:14.509543+0000","last_unstale":"2024-05-10T11:18:15.500560+0000","last_undegraded":"2024-05-10T11:18:15.500560+0000","last_fullsized":"2024-05-10T11:18:15.500560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:01.778938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501070+0000","last_change":"2024-05-10T11:18:14.517047+0000","last_active":"2024-05-10T11:18:15.501070+0000","last_peered":"2024-05-10T11:18:15.501070+0000","last_clean":"2024-05-10T11:18:15.501070+0000","last_became_active":"2024-05-10T11:18:14.516884+0000","last_became_peered":"2024-05-10T11:18:14.516884+0000","last_unstale":"2024-05-10T11:18:15.501070+0000","last_undegraded":"2024-05-10T11:18:15.501070+0000","last_fullsized":"2024-05-10T11:18:15.501070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:12.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500601+0000","last_change":"2024-05-10T11:18:14.515247+0000","last_active":"2024-05-10T11:18:15.500601+0000","last_peered":"2024-05-10T11:18:15.500601+0000","last_clean":"2024-05-10T11:18:15.500601+0000","last_became_active":"2024-05-10T11:18:14.514931+0000","last_became_peered":"2024-05-10T11:18:14.514931+0000","last_unstale":"2024-05-10T11:18:15.500601+0000","last_undegraded":"2024-05-10T11:18:15.500601+0000","last_fullsized":"2024-05-10T11:18:15.500601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:59.852003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590206+0000","last_change":"2024-05-10T11:18:14.495959+0000","last_active":"2024-05-10T11:18:15.590206+0000","last_peered":"2024-05-10T11:18:15.590206+0000","last_clean":"2024-05-10T11:18:15.590206+0000","last_became_active":"2024-05-10T11:18:14.494391+0000","last_became_peered":"2024-05-10T11:18:14.494391+0000","last_unstale":"2024-05-10T11:18:15.590206+0000","last_undegraded":"2024-05-10T11:18:15.590206+0000","last_fullsized":"2024-05-10T11:18:15.590206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:10.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500565+0000","last_change":"2024-05-10T11:18:14.502477+0000","last_active":"2024-05-10T11:18:15.500565+0000","last_peered":"2024-05-10T11:18:15.500565+0000","last_clean":"2024-05-10T11:18:15.500565+0000","last_became_active":"2024-05-10T11:18:14.502214+0000","last_became_peered":"2024-05-10T11:18:14.502214+0000","last_unstale":"2024-05-10T11:18:15.500565+0000","last_undegraded":"2024-05-10T11:18:15.500565+0000","last_fullsized":"2024-05-10T11:18:15.500565+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:36.046820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589287+0000","last_change":"2024-05-10T11:18:14.500781+0000","last_active":"2024-05-10T11:18:15.589287+0000","last_peered":"2024-05-10T11:18:15.589287+0000","last_clean":"2024-05-10T11:18:15.589287+0000","last_became_active":"2024-05-10T11:18:14.500434+0000","last_became_peered":"2024-05-10T11:18:14.500434+0000","last_unstale":"2024-05-10T11:18:15.589287+0000","last_undegraded":"2024-05-10T11:18:15.589287+0000","last_fullsized":"2024-05-10T11:18:15.589287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:51.953240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589304+0000","last_change":"2024-05-10T11:18:14.511780+0000","last_active":"2024-05-10T11:18:15.589304+0000","last_peered":"2024-05-10T11:18:15.589304+0000","last_clean":"2024-05-10T11:18:15.589304+0000","last_became_active":"2024-05-10T11:18:14.510880+0000","last_became_peered":"2024-05-10T11:18:14.510880+0000","last_unstale":"2024-05-10T11:18:15.589304+0000","last_undegraded":"2024-05-10T11:18:15.589304+0000","last_fullsized":"2024-05-10T11:18:15.589304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:54:34.155865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589852+0000","last_change":"2024-05-10T11:18:14.499725+0000","last_active":"2024-05-10T11:18:15.589852+0000","last_peered":"2024-05-10T11:18:15.589852+0000","last_clean":"2024-05-10T11:18:15.589852+0000","last_became_active":"2024-05-10T11:18:14.499366+0000","last_became_peered":"2024-05-10T11:18:14.499366+0000","last_unstale":"2024-05-10T11:18:15.589852+0000","last_undegraded":"2024-05-10T11:18:15.589852+0000","last_fullsized":"2024-05-10T11:18:15.589852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:43.303098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589057+0000","last_change":"2024-05-10T11:18:14.506434+0000","last_active":"2024-05-10T11:18:15.589057+0000","last_peered":"2024-05-10T11:18:15.589057+0000","last_clean":"2024-05-10T11:18:15.589057+0000","last_became_active":"2024-05-10T11:18:14.506161+0000","last_became_peered":"2024-05-10T11:18:14.506161+0000","last_unstale":"2024-05-10T11:18:15.589057+0000","last_undegraded":"2024-05-10T11:18:15.589057+0000","last_fullsized":"2024-05-10T11:18:15.589057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501277+0000","last_change":"2024-05-10T11:18:14.506233+0000","last_active":"2024-05-10T11:18:15.501277+0000","last_peered":"2024-05-10T11:18:15.501277+0000","last_clean":"2024-05-10T11:18:15.501277+0000","last_became_active":"2024-05-10T11:18:14.505921+0000","last_became_peered":"2024-05-10T11:18:14.505921+0000","last_unstale":"2024-05-10T11:18:15.501277+0000","last_undegraded":"2024-05-10T11:18:15.501277+0000","last_fullsized":"2024-05-10T11:18:15.501277+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:20.272885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590428+0000","last_change":"2024-05-10T11:18:14.500701+0000","last_active":"2024-05-10T11:18:15.590428+0000","last_peered":"2024-05-10T11:18:15.590428+0000","last_clean":"2024-05-10T11:18:15.590428+0000","last_became_active":"2024-05-10T11:18:14.500377+0000","last_became_peered":"2024-05-10T11:18:14.500377+0000","last_unstale":"2024-05-10T11:18:15.590428+0000","last_undegraded":"2024-05-10T11:18:15.590428+0000","last_fullsized":"2024-05-10T11:18:15.590428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500739+0000","last_change":"2024-05-10T11:18:14.497653+0000","last_active":"2024-05-10T11:18:15.500739+0000","last_peered":"2024-05-10T11:18:15.500739+0000","last_clean":"2024-05-10T11:18:15.500739+0000","last_became_active":"2024-05-10T11:18:14.497394+0000","last_became_peered":"2024-05-10T11:18:14.497394+0000","last_unstale":"2024-05-10T11:18:15.500739+0000","last_undegraded":"2024-05-10T11:18:15.500739+0000","last_fullsized":"2024-05-10T11:18:15.500739+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:53.764973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500753+0000","last_change":"2024-05-10T11:18:14.506233+0000","last_active":"2024-05-10T11:18:15.500753+0000","last_peered":"2024-05-10T11:18:15.500753+0000","last_clean":"2024-05-10T11:18:15.500753+0000","last_became_active":"2024-05-10T11:18:14.505966+0000","last_became_peered":"2024-05-10T11:18:14.505966+0000","last_unstale":"2024-05-10T11:18:15.500753+0000","last_undegraded":"2024-05-10T11:18:15.500753+0000","last_fullsized":"2024-05-10T11:18:15.500753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:16.770065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589696+0000","last_change":"2024-05-10T11:18:14.504605+0000","last_active":"2024-05-10T11:18:15.589696+0000","last_peered":"2024-05-10T11:18:15.589696+0000","last_clean":"2024-05-10T11:18:15.589696+0000","last_became_active":"2024-05-10T11:18:14.502983+0000","last_became_peered":"2024-05-10T11:18:14.502983+0000","last_unstale":"2024-05-10T11:18:15.589696+0000","last_undegraded":"2024-05-10T11:18:15.589696+0000","last_fullsized":"2024-05-10T11:18:15.589696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:53.764973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589152+0000","last_change":"2024-05-10T11:18:14.496012+0000","last_active":"2024-05-10T11:18:15.589152+0000","last_peered":"2024-05-10T11:18:15.589152+0000","last_clean":"2024-05-10T11:18:15.589152+0000","last_became_active":"2024-05-10T11:18:14.495715+0000","last_became_peered":"2024-05-10T11:18:14.495715+0000","last_unstale":"2024-05-10T11:18:15.589152+0000","last_undegraded":"2024-05-10T11:18:15.589152+0000","last_fullsized":"2024-05-10T11:18:15.589152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.509349+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.509077+0000","last_became_peered":"2024-05-10T11:18:14.509077+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500597+0000","last_change":"2024-05-10T11:18:14.508504+0000","last_active":"2024-05-10T11:18:15.500597+0000","last_peered":"2024-05-10T11:18:15.500597+0000","last_clean":"2024-05-10T11:18:15.500597+0000","last_became_active":"2024-05-10T11:18:14.507702+0000","last_became_peered":"2024-05-10T11:18:14.507702+0000","last_unstale":"2024-05-10T11:18:15.500597+0000","last_undegraded":"2024-05-10T11:18:15.500597+0000","last_fullsized":"2024-05-10T11:18:15.500597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:42.535740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500648+0000","last_change":"2024-05-10T11:18:14.515113+0000","last_active":"2024-05-10T11:18:15.500648+0000","last_peered":"2024-05-10T11:18:15.500648+0000","last_clean":"2024-05-10T11:18:15.500648+0000","last_became_active":"2024-05-10T11:18:14.514824+0000","last_became_peered":"2024-05-10T11:18:14.514824+0000","last_unstale":"2024-05-10T11:18:15.500648+0000","last_undegraded":"2024-05-10T11:18:15.500648+0000","last_fullsized":"2024-05-10T11:18:15.500648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:48.996486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590608+0000","last_change":"2024-05-10T11:18:14.512508+0000","last_active":"2024-05-10T11:18:15.590608+0000","last_peered":"2024-05-10T11:18:15.590608+0000","last_clean":"2024-05-10T11:18:15.590608+0000","last_became_active":"2024-05-10T11:18:14.512218+0000","last_became_peered":"2024-05-10T11:18:14.512218+0000","last_unstale":"2024-05-10T11:18:15.590608+0000","last_undegraded":"2024-05-10T11:18:15.590608+0000","last_fullsized":"2024-05-10T11:18:15.590608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590014+0000","last_change":"2024-05-10T11:18:14.505322+0000","last_active":"2024-05-10T11:18:15.590014+0000","last_peered":"2024-05-10T11:18:15.590014+0000","last_clean":"2024-05-10T11:18:15.590014+0000","last_became_active":"2024-05-10T11:18:14.505030+0000","last_became_peered":"2024-05-10T11:18:14.505030+0000","last_unstale":"2024-05-10T11:18:15.590014+0000","last_undegraded":"2024-05-10T11:18:15.590014+0000","last_fullsized":"2024-05-10T11:18:15.590014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:04.508357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501070+0000","last_change":"2024-05-10T11:18:14.506912+0000","last_active":"2024-05-10T11:18:15.501070+0000","last_peered":"2024-05-10T11:18:15.501070+0000","last_clean":"2024-05-10T11:18:15.501070+0000","last_became_active":"2024-05-10T11:18:14.506641+0000","last_became_peered":"2024-05-10T11:18:14.506641+0000","last_unstale":"2024-05-10T11:18:15.501070+0000","last_undegraded":"2024-05-10T11:18:15.501070+0000","last_fullsized":"2024-05-10T11:18:15.501070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:49.666578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503674+0000","last_change":"2024-05-10T11:18:14.507356+0000","last_active":"2024-05-10T11:18:15.503674+0000","last_peered":"2024-05-10T11:18:15.503674+0000","last_clean":"2024-05-10T11:18:15.503674+0000","last_became_active":"2024-05-10T11:18:14.507037+0000","last_became_peered":"2024-05-10T11:18:14.507037+0000","last_unstale":"2024-05-10T11:18:15.503674+0000","last_undegraded":"2024-05-10T11:18:15.503674+0000","last_fullsized":"2024-05-10T11:18:15.503674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589362+0000","last_change":"2024-05-10T11:18:14.511137+0000","last_active":"2024-05-10T11:18:15.589362+0000","last_peered":"2024-05-10T11:18:15.589362+0000","last_clean":"2024-05-10T11:18:15.589362+0000","last_became_active":"2024-05-10T11:18:14.510460+0000","last_became_peered":"2024-05-10T11:18:14.510460+0000","last_unstale":"2024-05-10T11:18:15.589362+0000","last_undegraded":"2024-05-10T11:18:15.589362+0000","last_fullsized":"2024-05-10T11:18:15.589362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:45.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588999+0000","last_change":"2024-05-10T11:18:14.509145+0000","last_active":"2024-05-10T11:18:15.588999+0000","last_peered":"2024-05-10T11:18:15.588999+0000","last_clean":"2024-05-10T11:18:15.588999+0000","last_became_active":"2024-05-10T11:18:14.507612+0000","last_became_peered":"2024-05-10T11:18:14.507612+0000","last_unstale":"2024-05-10T11:18:15.588999+0000","last_undegraded":"2024-05-10T11:18:15.588999+0000","last_fullsized":"2024-05-10T11:18:15.588999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:59.817611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589537+0000","last_change":"2024-05-10T11:18:13.489312+0000","last_active":"2024-05-10T11:18:15.589537+0000","last_peered":"2024-05-10T11:18:15.589537+0000","last_clean":"2024-05-10T11:18:15.589537+0000","last_became_active":"2024-05-10T11:18:13.489055+0000","last_became_peered":"2024-05-10T11:18:13.489055+0000","last_unstale":"2024-05-10T11:18:15.589537+0000","last_undegraded":"2024-05-10T11:18:15.589537+0000","last_fullsized":"2024-05-10T11:18:15.589537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:59.209454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589488+0000","last_change":"2024-05-10T11:18:14.506891+0000","last_active":"2024-05-10T11:18:15.589488+0000","last_peered":"2024-05-10T11:18:15.589488+0000","last_clean":"2024-05-10T11:18:15.589488+0000","last_became_active":"2024-05-10T11:18:14.506604+0000","last_became_peered":"2024-05-10T11:18:14.506604+0000","last_unstale":"2024-05-10T11:18:15.589488+0000","last_undegraded":"2024-05-10T11:18:15.589488+0000","last_fullsized":"2024-05-10T11:18:15.589488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:46.769438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501006+0000","last_change":"2024-05-10T11:18:13.487405+0000","last_active":"2024-05-10T11:18:15.501006+0000","last_peered":"2024-05-10T11:18:15.501006+0000","last_clean":"2024-05-10T11:18:15.501006+0000","last_became_active":"2024-05-10T11:18:13.487122+0000","last_became_peered":"2024-05-10T11:18:13.487122+0000","last_unstale":"2024-05-10T11:18:15.501006+0000","last_undegraded":"2024-05-10T11:18:15.501006+0000","last_fullsized":"2024-05-10T11:18:15.501006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:32.602387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589810+0000","last_change":"2024-05-10T11:18:14.495250+0000","last_active":"2024-05-10T11:18:15.589810+0000","last_peered":"2024-05-10T11:18:15.589810+0000","last_clean":"2024-05-10T11:18:15.589810+0000","last_became_active":"2024-05-10T11:18:14.494969+0000","last_became_peered":"2024-05-10T11:18:14.494969+0000","last_unstale":"2024-05-10T11:18:15.589810+0000","last_undegraded":"2024-05-10T11:18:15.589810+0000","last_fullsized":"2024-05-10T11:18:15.589810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:55.067128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589777+0000","last_change":"2024-05-10T11:18:13.491023+0000","last_active":"2024-05-10T11:18:15.589777+0000","last_peered":"2024-05-10T11:18:15.589777+0000","last_clean":"2024-05-10T11:18:15.589777+0000","last_became_active":"2024-05-10T11:18:13.490750+0000","last_became_peered":"2024-05-10T11:18:13.490750+0000","last_unstale":"2024-05-10T11:18:15.589777+0000","last_undegraded":"2024-05-10T11:18:15.589777+0000","last_fullsized":"2024-05-10T11:18:15.589777+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.680606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.517446+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.517158+0000","last_became_peered":"2024-05-10T11:18:14.517158+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:59.932591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589704+0000","last_change":"2024-05-10T11:18:13.496226+0000","last_active":"2024-05-10T11:18:15.589704+0000","last_peered":"2024-05-10T11:18:15.589704+0000","last_clean":"2024-05-10T11:18:15.589704+0000","last_became_active":"2024-05-10T11:18:13.495965+0000","last_became_peered":"2024-05-10T11:18:13.495965+0000","last_unstale":"2024-05-10T11:18:15.589704+0000","last_undegraded":"2024-05-10T11:18:15.589704+0000","last_fullsized":"2024-05-10T11:18:15.589704+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:41.108794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588902+0000","last_change":"2024-05-10T11:18:14.502176+0000","last_active":"2024-05-10T11:18:15.588902+0000","last_peered":"2024-05-10T11:18:15.588902+0000","last_clean":"2024-05-10T11:18:15.588902+0000","last_became_active":"2024-05-10T11:18:14.501901+0000","last_became_peered":"2024-05-10T11:18:14.501901+0000","last_unstale":"2024-05-10T11:18:15.588902+0000","last_undegraded":"2024-05-10T11:18:15.588902+0000","last_fullsized":"2024-05-10T11:18:15.588902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:22.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500770+0000","last_change":"2024-05-10T11:18:13.489468+0000","last_active":"2024-05-10T11:18:15.500770+0000","last_peered":"2024-05-10T11:18:15.500770+0000","last_clean":"2024-05-10T11:18:15.500770+0000","last_became_active":"2024-05-10T11:18:13.489197+0000","last_became_peered":"2024-05-10T11:18:13.489197+0000","last_unstale":"2024-05-10T11:18:15.500770+0000","last_undegraded":"2024-05-10T11:18:15.500770+0000","last_fullsized":"2024-05-10T11:18:15.500770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:02:08.288741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589429+0000","last_change":"2024-05-10T11:18:14.511588+0000","last_active":"2024-05-10T11:18:15.589429+0000","last_peered":"2024-05-10T11:18:15.589429+0000","last_clean":"2024-05-10T11:18:15.589429+0000","last_became_active":"2024-05-10T11:18:14.510951+0000","last_became_peered":"2024-05-10T11:18:14.510951+0000","last_unstale":"2024-05-10T11:18:15.589429+0000","last_undegraded":"2024-05-10T11:18:15.589429+0000","last_fullsized":"2024-05-10T11:18:15.589429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:42.535740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589863+0000","last_change":"2024-05-10T11:18:13.499705+0000","last_active":"2024-05-10T11:18:15.589863+0000","last_peered":"2024-05-10T11:18:15.589863+0000","last_clean":"2024-05-10T11:18:15.589863+0000","last_became_active":"2024-05-10T11:18:13.499448+0000","last_became_peered":"2024-05-10T11:18:13.499448+0000","last_unstale":"2024-05-10T11:18:15.589863+0000","last_undegraded":"2024-05-10T11:18:15.589863+0000","last_fullsized":"2024-05-10T11:18:15.589863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:22.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589016+0000","last_change":"2024-05-10T11:18:14.510528+0000","last_active":"2024-05-10T11:18:15.589016+0000","last_peered":"2024-05-10T11:18:15.589016+0000","last_clean":"2024-05-10T11:18:15.589016+0000","last_became_active":"2024-05-10T11:18:14.510212+0000","last_became_peered":"2024-05-10T11:18:14.510212+0000","last_unstale":"2024-05-10T11:18:15.589016+0000","last_undegraded":"2024-05-10T11:18:15.589016+0000","last_fullsized":"2024-05-10T11:18:15.589016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.308953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589373+0000","last_change":"2024-05-10T11:18:13.484546+0000","last_active":"2024-05-10T11:18:15.589373+0000","last_peered":"2024-05-10T11:18:15.589373+0000","last_clean":"2024-05-10T11:18:15.589373+0000","last_became_active":"2024-05-10T11:18:13.484252+0000","last_became_peered":"2024-05-10T11:18:13.484252+0000","last_unstale":"2024-05-10T11:18:15.589373+0000","last_undegraded":"2024-05-10T11:18:15.589373+0000","last_fullsized":"2024-05-10T11:18:15.589373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:23.840058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590407+0000","last_change":"2024-05-10T11:18:14.502695+0000","last_active":"2024-05-10T11:18:15.590407+0000","last_peered":"2024-05-10T11:18:15.590407+0000","last_clean":"2024-05-10T11:18:15.590407+0000","last_became_active":"2024-05-10T11:18:14.502130+0000","last_became_peered":"2024-05-10T11:18:14.502130+0000","last_unstale":"2024-05-10T11:18:15.590407+0000","last_undegraded":"2024-05-10T11:18:15.590407+0000","last_fullsized":"2024-05-10T11:18:15.590407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589385+0000","last_change":"2024-05-10T11:18:13.492663+0000","last_active":"2024-05-10T11:18:15.589385+0000","last_peered":"2024-05-10T11:18:15.589385+0000","last_clean":"2024-05-10T11:18:15.589385+0000","last_became_active":"2024-05-10T11:18:13.492415+0000","last_became_peered":"2024-05-10T11:18:13.492415+0000","last_unstale":"2024-05-10T11:18:15.589385+0000","last_undegraded":"2024-05-10T11:18:15.589385+0000","last_fullsized":"2024-05-10T11:18:15.589385+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:19.265889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501030+0000","last_change":"2024-05-10T11:18:14.498480+0000","last_active":"2024-05-10T11:18:15.501030+0000","last_peered":"2024-05-10T11:18:15.501030+0000","last_clean":"2024-05-10T11:18:15.501030+0000","last_became_active":"2024-05-10T11:18:14.498153+0000","last_became_peered":"2024-05-10T11:18:14.498153+0000","last_unstale":"2024-05-10T11:18:15.501030+0000","last_undegraded":"2024-05-10T11:18:15.501030+0000","last_fullsized":"2024-05-10T11:18:15.501030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:46.526595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504114+0000","last_change":"2024-05-10T11:18:13.489382+0000","last_active":"2024-05-10T11:18:15.504114+0000","last_peered":"2024-05-10T11:18:15.504114+0000","last_clean":"2024-05-10T11:18:15.504114+0000","last_became_active":"2024-05-10T11:18:13.489117+0000","last_became_peered":"2024-05-10T11:18:13.489117+0000","last_unstale":"2024-05-10T11:18:15.504114+0000","last_undegraded":"2024-05-10T11:18:15.504114+0000","last_fullsized":"2024-05-10T11:18:15.504114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:58.559240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589738+0000","last_change":"2024-05-10T11:18:14.499498+0000","last_active":"2024-05-10T11:18:15.589738+0000","last_peered":"2024-05-10T11:18:15.589738+0000","last_clean":"2024-05-10T11:18:15.589738+0000","last_became_active":"2024-05-10T11:18:14.499218+0000","last_became_peered":"2024-05-10T11:18:14.499218+0000","last_unstale":"2024-05-10T11:18:15.589738+0000","last_undegraded":"2024-05-10T11:18:15.589738+0000","last_fullsized":"2024-05-10T11:18:15.589738+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:39:05.943451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:13.496483+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:13.496161+0000","last_became_peered":"2024-05-10T11:18:13.496161+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589755+0000","last_change":"2024-05-10T11:18:14.505565+0000","last_active":"2024-05-10T11:18:15.589755+0000","last_peered":"2024-05-10T11:18:15.589755+0000","last_clean":"2024-05-10T11:18:15.589755+0000","last_became_active":"2024-05-10T11:18:14.504514+0000","last_became_peered":"2024-05-10T11:18:14.504514+0000","last_unstale":"2024-05-10T11:18:15.589755+0000","last_undegraded":"2024-05-10T11:18:15.589755+0000","last_fullsized":"2024-05-10T11:18:15.589755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501301+0000","last_change":"2024-05-10T11:18:13.492466+0000","last_active":"2024-05-10T11:18:15.501301+0000","last_peered":"2024-05-10T11:18:15.501301+0000","last_clean":"2024-05-10T11:18:15.501301+0000","last_became_active":"2024-05-10T11:18:13.492210+0000","last_became_peered":"2024-05-10T11:18:13.492210+0000","last_unstale":"2024-05-10T11:18:15.501301+0000","last_undegraded":"2024-05-10T11:18:15.501301+0000","last_fullsized":"2024-05-10T11:18:15.501301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:21.208295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590683+0000","last_change":"2024-05-10T11:18:14.506980+0000","last_active":"2024-05-10T11:18:15.590683+0000","last_peered":"2024-05-10T11:18:15.590683+0000","last_clean":"2024-05-10T11:18:15.590683+0000","last_became_active":"2024-05-10T11:18:14.506669+0000","last_became_peered":"2024-05-10T11:18:14.506669+0000","last_unstale":"2024-05-10T11:18:15.590683+0000","last_undegraded":"2024-05-10T11:18:15.590683+0000","last_fullsized":"2024-05-10T11:18:15.590683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589688+0000","last_change":"2024-05-10T11:18:13.491065+0000","last_active":"2024-05-10T11:18:15.589688+0000","last_peered":"2024-05-10T11:18:15.589688+0000","last_clean":"2024-05-10T11:18:15.589688+0000","last_became_active":"2024-05-10T11:18:13.490740+0000","last_became_peered":"2024-05-10T11:18:13.490740+0000","last_unstale":"2024-05-10T11:18:15.589688+0000","last_undegraded":"2024-05-10T11:18:15.589688+0000","last_fullsized":"2024-05-10T11:18:15.589688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:17.665658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588979+0000","last_change":"2024-05-10T11:18:14.492654+0000","last_active":"2024-05-10T11:18:15.588979+0000","last_peered":"2024-05-10T11:18:15.588979+0000","last_clean":"2024-05-10T11:18:15.588979+0000","last_became_active":"2024-05-10T11:18:14.492328+0000","last_became_peered":"2024-05-10T11:18:14.492328+0000","last_unstale":"2024-05-10T11:18:15.588979+0000","last_undegraded":"2024-05-10T11:18:15.588979+0000","last_fullsized":"2024-05-10T11:18:15.588979+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:24:34.509745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589511+0000","last_change":"2024-05-10T11:18:13.493293+0000","last_active":"2024-05-10T11:18:15.589511+0000","last_peered":"2024-05-10T11:18:15.589511+0000","last_clean":"2024-05-10T11:18:15.589511+0000","last_became_active":"2024-05-10T11:18:13.493029+0000","last_became_peered":"2024-05-10T11:18:13.493029+0000","last_unstale":"2024-05-10T11:18:15.589511+0000","last_undegraded":"2024-05-10T11:18:15.589511+0000","last_fullsized":"2024-05-10T11:18:15.589511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:44.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500411+0000","last_change":"2024-05-10T11:18:14.503214+0000","last_active":"2024-05-10T11:18:15.500411+0000","last_peered":"2024-05-10T11:18:15.500411+0000","last_clean":"2024-05-10T11:18:15.500411+0000","last_became_active":"2024-05-10T11:18:14.502959+0000","last_became_peered":"2024-05-10T11:18:14.502959+0000","last_unstale":"2024-05-10T11:18:15.500411+0000","last_undegraded":"2024-05-10T11:18:15.500411+0000","last_fullsized":"2024-05-10T11:18:15.500411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:47.159472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589062+0000","last_change":"2024-05-10T11:18:13.491930+0000","last_active":"2024-05-10T11:18:15.589062+0000","last_peered":"2024-05-10T11:18:15.589062+0000","last_clean":"2024-05-10T11:18:15.589062+0000","last_became_active":"2024-05-10T11:18:13.491576+0000","last_became_peered":"2024-05-10T11:18:13.491576+0000","last_unstale":"2024-05-10T11:18:15.589062+0000","last_undegraded":"2024-05-10T11:18:15.589062+0000","last_fullsized":"2024-05-10T11:18:15.589062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:20.216601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500392+0000","last_change":"2024-05-10T11:18:14.512578+0000","last_active":"2024-05-10T11:18:15.500392+0000","last_peered":"2024-05-10T11:18:15.500392+0000","last_clean":"2024-05-10T11:18:15.500392+0000","last_became_active":"2024-05-10T11:18:14.512273+0000","last_became_peered":"2024-05-10T11:18:14.512273+0000","last_unstale":"2024-05-10T11:18:15.500392+0000","last_undegraded":"2024-05-10T11:18:15.500392+0000","last_fullsized":"2024-05-10T11:18:15.500392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:16.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589418+0000","last_change":"2024-05-10T11:18:13.494933+0000","last_active":"2024-05-10T11:18:15.589418+0000","last_peered":"2024-05-10T11:18:15.589418+0000","last_clean":"2024-05-10T11:18:15.589418+0000","last_became_active":"2024-05-10T11:18:13.494632+0000","last_became_peered":"2024-05-10T11:18:13.494632+0000","last_unstale":"2024-05-10T11:18:15.589418+0000","last_undegraded":"2024-05-10T11:18:15.589418+0000","last_fullsized":"2024-05-10T11:18:15.589418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.988757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500556+0000","last_change":"2024-05-10T11:18:14.512697+0000","last_active":"2024-05-10T11:18:15.500556+0000","last_peered":"2024-05-10T11:18:15.500556+0000","last_clean":"2024-05-10T11:18:15.500556+0000","last_became_active":"2024-05-10T11:18:14.512424+0000","last_became_peered":"2024-05-10T11:18:14.512424+0000","last_unstale":"2024-05-10T11:18:15.500556+0000","last_undegraded":"2024-05-10T11:18:15.500556+0000","last_fullsized":"2024-05-10T11:18:15.500556+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:16.972744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589019+0000","last_change":"2024-05-10T11:18:13.499748+0000","last_active":"2024-05-10T11:18:15.589019+0000","last_peered":"2024-05-10T11:18:15.589019+0000","last_clean":"2024-05-10T11:18:15.589019+0000","last_became_active":"2024-05-10T11:18:13.499424+0000","last_became_peered":"2024-05-10T11:18:13.499424+0000","last_unstale":"2024-05-10T11:18:15.589019+0000","last_undegraded":"2024-05-10T11:18:15.589019+0000","last_fullsized":"2024-05-10T11:18:15.589019+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:45.777827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589632+0000","last_change":"2024-05-10T11:18:14.509330+0000","last_active":"2024-05-10T11:18:15.589632+0000","last_peered":"2024-05-10T11:18:15.589632+0000","last_clean":"2024-05-10T11:18:15.589632+0000","last_became_active":"2024-05-10T11:18:14.507243+0000","last_became_peered":"2024-05-10T11:18:14.507243+0000","last_unstale":"2024-05-10T11:18:15.589632+0000","last_undegraded":"2024-05-10T11:18:15.589632+0000","last_fullsized":"2024-05-10T11:18:15.589632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:16.911693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589662+0000","last_change":"2024-05-10T11:18:13.484923+0000","last_active":"2024-05-10T11:18:15.589662+0000","last_peered":"2024-05-10T11:18:15.589662+0000","last_clean":"2024-05-10T11:18:15.589662+0000","last_became_active":"2024-05-10T11:18:13.484625+0000","last_became_peered":"2024-05-10T11:18:13.484625+0000","last_unstale":"2024-05-10T11:18:15.589662+0000","last_undegraded":"2024-05-10T11:18:15.589662+0000","last_fullsized":"2024-05-10T11:18:15.589662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:39:53.863227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589576+0000","last_change":"2024-05-10T11:18:14.506481+0000","last_active":"2024-05-10T11:18:15.589576+0000","last_peered":"2024-05-10T11:18:15.589576+0000","last_clean":"2024-05-10T11:18:15.589576+0000","last_became_active":"2024-05-10T11:18:14.506204+0000","last_became_peered":"2024-05-10T11:18:14.506204+0000","last_unstale":"2024-05-10T11:18:15.589576+0000","last_undegraded":"2024-05-10T11:18:15.589576+0000","last_fullsized":"2024-05-10T11:18:15.589576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:32.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589820+0000","last_change":"2024-05-10T11:18:13.488650+0000","last_active":"2024-05-10T11:18:15.589820+0000","last_peered":"2024-05-10T11:18:15.589820+0000","last_clean":"2024-05-10T11:18:15.589820+0000","last_became_active":"2024-05-10T11:18:13.488336+0000","last_became_peered":"2024-05-10T11:18:13.488336+0000","last_unstale":"2024-05-10T11:18:15.589820+0000","last_undegraded":"2024-05-10T11:18:15.589820+0000","last_fullsized":"2024-05-10T11:18:15.589820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:28:16.815536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500965+0000","last_change":"2024-05-10T11:18:14.501454+0000","last_active":"2024-05-10T11:18:15.500965+0000","last_peered":"2024-05-10T11:18:15.500965+0000","last_clean":"2024-05-10T11:18:15.500965+0000","last_became_active":"2024-05-10T11:18:14.501179+0000","last_became_peered":"2024-05-10T11:18:14.501179+0000","last_unstale":"2024-05-10T11:18:15.500965+0000","last_undegraded":"2024-05-10T11:18:15.500965+0000","last_fullsized":"2024-05-10T11:18:15.500965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:50.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501379+0000","last_change":"2024-05-10T11:18:13.491192+0000","last_active":"2024-05-10T11:18:15.501379+0000","last_peered":"2024-05-10T11:18:15.501379+0000","last_clean":"2024-05-10T11:18:15.501379+0000","last_became_active":"2024-05-10T11:18:13.490839+0000","last_became_peered":"2024-05-10T11:18:13.490839+0000","last_unstale":"2024-05-10T11:18:15.501379+0000","last_undegraded":"2024-05-10T11:18:15.501379+0000","last_fullsized":"2024-05-10T11:18:15.501379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:52.982560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589466+0000","last_change":"2024-05-10T11:18:14.509377+0000","last_active":"2024-05-10T11:18:15.589466+0000","last_peered":"2024-05-10T11:18:15.589466+0000","last_clean":"2024-05-10T11:18:15.589466+0000","last_became_active":"2024-05-10T11:18:14.506328+0000","last_became_peered":"2024-05-10T11:18:14.506328+0000","last_unstale":"2024-05-10T11:18:15.589466+0000","last_undegraded":"2024-05-10T11:18:15.589466+0000","last_fullsized":"2024-05-10T11:18:15.589466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:12.639237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503705+0000","last_change":"2024-05-10T11:18:13.487719+0000","last_active":"2024-05-10T11:18:15.503705+0000","last_peered":"2024-05-10T11:18:15.503705+0000","last_clean":"2024-05-10T11:18:15.503705+0000","last_became_active":"2024-05-10T11:18:13.486232+0000","last_became_peered":"2024-05-10T11:18:13.486232+0000","last_unstale":"2024-05-10T11:18:15.503705+0000","last_undegraded":"2024-05-10T11:18:15.503705+0000","last_fullsized":"2024-05-10T11:18:15.503705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503636+0000","last_change":"2024-05-10T11:18:14.501099+0000","last_active":"2024-05-10T11:18:15.503636+0000","last_peered":"2024-05-10T11:18:15.503636+0000","last_clean":"2024-05-10T11:18:15.503636+0000","last_became_active":"2024-05-10T11:18:14.500491+0000","last_became_peered":"2024-05-10T11:18:14.500491+0000","last_unstale":"2024-05-10T11:18:15.503636+0000","last_undegraded":"2024-05-10T11:18:15.503636+0000","last_fullsized":"2024-05-10T11:18:15.503636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500360+0000","last_change":"2024-05-10T11:18:13.496261+0000","last_active":"2024-05-10T11:18:15.500360+0000","last_peered":"2024-05-10T11:18:15.500360+0000","last_clean":"2024-05-10T11:18:15.500360+0000","last_became_active":"2024-05-10T11:18:13.496010+0000","last_became_peered":"2024-05-10T11:18:13.496010+0000","last_unstale":"2024-05-10T11:18:15.500360+0000","last_undegraded":"2024-05-10T11:18:15.500360+0000","last_fullsized":"2024-05-10T11:18:15.500360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:25.142075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503941+0000","last_change":"2024-05-10T11:18:14.508367+0000","last_active":"2024-05-10T11:18:15.503941+0000","last_peered":"2024-05-10T11:18:15.503941+0000","last_clean":"2024-05-10T11:18:15.503941+0000","last_became_active":"2024-05-10T11:18:14.508114+0000","last_became_peered":"2024-05-10T11:18:14.508114+0000","last_unstale":"2024-05-10T11:18:15.503941+0000","last_undegraded":"2024-05-10T11:18:15.503941+0000","last_fullsized":"2024-05-10T11:18:15.503941+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503746+0000","last_change":"2024-05-10T11:18:13.493893+0000","last_active":"2024-05-10T11:18:15.503746+0000","last_peered":"2024-05-10T11:18:15.503746+0000","last_clean":"2024-05-10T11:18:15.503746+0000","last_became_active":"2024-05-10T11:18:13.493661+0000","last_became_peered":"2024-05-10T11:18:13.493661+0000","last_unstale":"2024-05-10T11:18:15.503746+0000","last_undegraded":"2024-05-10T11:18:15.503746+0000","last_fullsized":"2024-05-10T11:18:15.503746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:21.825243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589340+0000","last_change":"2024-05-10T11:18:14.508876+0000","last_active":"2024-05-10T11:18:15.589340+0000","last_peered":"2024-05-10T11:18:15.589340+0000","last_clean":"2024-05-10T11:18:15.589340+0000","last_became_active":"2024-05-10T11:18:14.508599+0000","last_became_peered":"2024-05-10T11:18:14.508599+0000","last_unstale":"2024-05-10T11:18:15.589340+0000","last_undegraded":"2024-05-10T11:18:15.589340+0000","last_fullsized":"2024-05-10T11:18:15.589340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:49.671324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500251+0000","last_change":"2024-05-10T11:18:13.488510+0000","last_active":"2024-05-10T11:18:15.500251+0000","last_peered":"2024-05-10T11:18:15.500251+0000","last_clean":"2024-05-10T11:18:15.500251+0000","last_became_active":"2024-05-10T11:18:13.488224+0000","last_became_peered":"2024-05-10T11:18:13.488224+0000","last_unstale":"2024-05-10T11:18:15.500251+0000","last_undegraded":"2024-05-10T11:18:15.500251+0000","last_fullsized":"2024-05-10T11:18:15.500251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:57.771228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:14.501699+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:14.501427+0000","last_became_peered":"2024-05-10T11:18:14.501427+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:16.770065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589955+0000","last_change":"2024-05-10T11:18:13.486115+0000","last_active":"2024-05-10T11:18:15.589955+0000","last_peered":"2024-05-10T11:18:15.589955+0000","last_clean":"2024-05-10T11:18:15.589955+0000","last_became_active":"2024-05-10T11:18:13.485827+0000","last_became_peered":"2024-05-10T11:18:13.485827+0000","last_unstale":"2024-05-10T11:18:15.589955+0000","last_undegraded":"2024-05-10T11:18:15.589955+0000","last_fullsized":"2024-05-10T11:18:15.589955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:25.005139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589621+0000","last_change":"2024-05-10T11:18:14.508776+0000","last_active":"2024-05-10T11:18:15.589621+0000","last_peered":"2024-05-10T11:18:15.589621+0000","last_clean":"2024-05-10T11:18:15.589621+0000","last_became_active":"2024-05-10T11:18:14.507883+0000","last_became_peered":"2024-05-10T11:18:14.507883+0000","last_unstale":"2024-05-10T11:18:15.589621+0000","last_undegraded":"2024-05-10T11:18:15.589621+0000","last_fullsized":"2024-05-10T11:18:15.589621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:41:09.728598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501211+0000","last_change":"2024-05-10T11:18:13.486261+0000","last_active":"2024-05-10T11:18:15.501211+0000","last_peered":"2024-05-10T11:18:15.501211+0000","last_clean":"2024-05-10T11:18:15.501211+0000","last_became_active":"2024-05-10T11:18:13.485612+0000","last_became_peered":"2024-05-10T11:18:13.485612+0000","last_unstale":"2024-05-10T11:18:15.501211+0000","last_undegraded":"2024-05-10T11:18:15.501211+0000","last_fullsized":"2024-05-10T11:18:15.501211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:10.012519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589573+0000","last_change":"2024-05-10T11:18:14.503515+0000","last_active":"2024-05-10T11:18:15.589573+0000","last_peered":"2024-05-10T11:18:15.589573+0000","last_clean":"2024-05-10T11:18:15.589573+0000","last_became_active":"2024-05-10T11:18:14.503224+0000","last_became_peered":"2024-05-10T11:18:14.503224+0000","last_unstale":"2024-05-10T11:18:15.589573+0000","last_undegraded":"2024-05-10T11:18:15.589573+0000","last_fullsized":"2024-05-10T11:18:15.589573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:32.860740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501403+0000","last_change":"2024-05-10T11:18:13.486384+0000","last_active":"2024-05-10T11:18:15.501403+0000","last_peered":"2024-05-10T11:18:15.501403+0000","last_clean":"2024-05-10T11:18:15.501403+0000","last_became_active":"2024-05-10T11:18:13.486083+0000","last_became_peered":"2024-05-10T11:18:13.486083+0000","last_unstale":"2024-05-10T11:18:15.501403+0000","last_undegraded":"2024-05-10T11:18:15.501403+0000","last_fullsized":"2024-05-10T11:18:15.501403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:57:04.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.505472+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.505178+0000","last_became_peered":"2024-05-10T11:18:14.505178+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:05.754282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589830+0000","last_change":"2024-05-10T11:18:13.485497+0000","last_active":"2024-05-10T11:18:15.589830+0000","last_peered":"2024-05-10T11:18:15.589830+0000","last_clean":"2024-05-10T11:18:15.589830+0000","last_became_active":"2024-05-10T11:18:13.484458+0000","last_became_peered":"2024-05-10T11:18:13.484458+0000","last_unstale":"2024-05-10T11:18:15.589830+0000","last_undegraded":"2024-05-10T11:18:15.589830+0000","last_fullsized":"2024-05-10T11:18:15.589830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:24.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500292+0000","last_change":"2024-05-10T11:18:14.505021+0000","last_active":"2024-05-10T11:18:15.500292+0000","last_peered":"2024-05-10T11:18:15.500292+0000","last_clean":"2024-05-10T11:18:15.500292+0000","last_became_active":"2024-05-10T11:18:14.504766+0000","last_became_peered":"2024-05-10T11:18:14.504766+0000","last_unstale":"2024-05-10T11:18:15.500292+0000","last_undegraded":"2024-05-10T11:18:15.500292+0000","last_fullsized":"2024-05-10T11:18:15.500292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590044+0000","last_change":"2024-05-10T11:18:13.492021+0000","last_active":"2024-05-10T11:18:15.590044+0000","last_peered":"2024-05-10T11:18:15.590044+0000","last_clean":"2024-05-10T11:18:15.590044+0000","last_became_active":"2024-05-10T11:18:13.491360+0000","last_became_peered":"2024-05-10T11:18:13.491360+0000","last_unstale":"2024-05-10T11:18:15.590044+0000","last_undegraded":"2024-05-10T11:18:15.590044+0000","last_fullsized":"2024-05-10T11:18:15.590044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:04.747286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589257+0000","last_change":"2024-05-10T11:18:14.492959+0000","last_active":"2024-05-10T11:18:15.589257+0000","last_peered":"2024-05-10T11:18:15.589257+0000","last_clean":"2024-05-10T11:18:15.589257+0000","last_became_active":"2024-05-10T11:18:14.492664+0000","last_became_peered":"2024-05-10T11:18:14.492664+0000","last_unstale":"2024-05-10T11:18:15.589257+0000","last_undegraded":"2024-05-10T11:18:15.589257+0000","last_fullsized":"2024-05-10T11:18:15.589257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504029+0000","last_change":"2024-05-10T11:18:13.487280+0000","last_active":"2024-05-10T11:18:15.504029+0000","last_peered":"2024-05-10T11:18:15.504029+0000","last_clean":"2024-05-10T11:18:15.504029+0000","last_became_active":"2024-05-10T11:18:13.487022+0000","last_became_peered":"2024-05-10T11:18:13.487022+0000","last_unstale":"2024-05-10T11:18:15.504029+0000","last_undegraded":"2024-05-10T11:18:15.504029+0000","last_fullsized":"2024-05-10T11:18:15.504029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:46.801147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589295+0000","last_change":"2024-05-10T11:18:14.507864+0000","last_active":"2024-05-10T11:18:15.589295+0000","last_peered":"2024-05-10T11:18:15.589295+0000","last_clean":"2024-05-10T11:18:15.589295+0000","last_became_active":"2024-05-10T11:18:14.507238+0000","last_became_peered":"2024-05-10T11:18:14.507238+0000","last_unstale":"2024-05-10T11:18:15.589295+0000","last_undegraded":"2024-05-10T11:18:15.589295+0000","last_fullsized":"2024-05-10T11:18:15.589295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:36.046820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589540+0000","last_change":"2024-05-10T11:18:13.484685+0000","last_active":"2024-05-10T11:18:15.589540+0000","last_peered":"2024-05-10T11:18:15.589540+0000","last_clean":"2024-05-10T11:18:15.589540+0000","last_became_active":"2024-05-10T11:18:13.484358+0000","last_became_peered":"2024-05-10T11:18:13.484358+0000","last_unstale":"2024-05-10T11:18:15.589540+0000","last_undegraded":"2024-05-10T11:18:15.589540+0000","last_fullsized":"2024-05-10T11:18:15.589540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:06.024110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590001+0000","last_change":"2024-05-10T11:18:14.509858+0000","last_active":"2024-05-10T11:18:15.590001+0000","last_peered":"2024-05-10T11:18:15.590001+0000","last_clean":"2024-05-10T11:18:15.590001+0000","last_became_active":"2024-05-10T11:18:14.509560+0000","last_became_peered":"2024-05-10T11:18:14.509560+0000","last_unstale":"2024-05-10T11:18:15.590001+0000","last_undegraded":"2024-05-10T11:18:15.590001+0000","last_fullsized":"2024-05-10T11:18:15.590001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:22.114478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589426+0000","last_change":"2024-05-10T11:18:13.490373+0000","last_active":"2024-05-10T11:18:15.589426+0000","last_peered":"2024-05-10T11:18:15.589426+0000","last_clean":"2024-05-10T11:18:15.589426+0000","last_became_active":"2024-05-10T11:18:13.490094+0000","last_became_peered":"2024-05-10T11:18:13.490094+0000","last_unstale":"2024-05-10T11:18:15.589426+0000","last_undegraded":"2024-05-10T11:18:15.589426+0000","last_fullsized":"2024-05-10T11:18:15.589426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:02:31.935203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.498690+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.497818+0000","last_became_peered":"2024-05-10T11:18:14.497818+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:34.589373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590498+0000","last_change":"2024-05-10T11:18:13.495136+0000","last_active":"2024-05-10T11:18:15.590498+0000","last_peered":"2024-05-10T11:18:15.590498+0000","last_clean":"2024-05-10T11:18:15.590498+0000","last_became_active":"2024-05-10T11:18:13.494834+0000","last_became_peered":"2024-05-10T11:18:13.494834+0000","last_unstale":"2024-05-10T11:18:15.590498+0000","last_undegraded":"2024-05-10T11:18:15.590498+0000","last_fullsized":"2024-05-10T11:18:15.590498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:09.195125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":235,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589552+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:18:15.589552+0000","last_peered":"2024-05-10T11:18:15.589552+0000","last_clean":"2024-05-10T11:18:15.589552+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:18:15.589552+0000","last_undegraded":"2024-05-10T11:18:15.589552+0000","last_fullsized":"2024-05-10T11:18:15.589552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1679360,"data_stored":1083012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":494804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":492748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":492658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1695744,"data_stored":1085274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:18:23.054 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:18:23.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.171+0000 7f2ea3820640 1 Processor -- start 2024-05-10T11:18:23.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.171+0000 7f2ea3820640 1 -- start start 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea3820640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e9c162750 0x7f2e9c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea3820640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e9c162b30 0x7f2e9c0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea3820640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c0b45f0 con 0x7f2e9c0d5cb0 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea3820640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9c0b4f20 con 0x7f2e9c162750 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea3820640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9c0d0fe0 con 0x7f2e9c162b30 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e9c162750 0x7f2e9c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e9c162750 0x7f2e9c0d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36210/0 (socket says 172.21.15.66:36210) 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 -- 172.21.15.66:0/3463335938 learned_addr learned my addr 172.21.15.66:0/3463335938 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 -- 172.21.15.66:0/3463335938 >> v2:172.21.15.190:3300/0 conn(0x7f2e9c162b30 msgr2=0x7f2e9c0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 --2- 172.21.15.66:0/3463335938 >> v2:172.21.15.190:3300/0 conn(0x7f2e9c162b30 0x7f2e9c0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 -- 172.21.15.66:0/3463335938 >> v1:172.21.15.190:6789/0 conn(0x7f2e9c0d5cb0 legacy=0x7f2e9c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.172+0000 7f2ea15bc640 1 -- 172.21.15.66:0/3463335938 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c0b48d0 con 0x7f2e9c162750 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.173+0000 7f2ea15bc640 1 --2- 172.21.15.66:0/3463335938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162750 0x7f2e9c0d0670 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0d32c0 tx=0x7f2e9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb403b86ff0b1de1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.173+0000 7f2e93fff640 1 -- 172.21.15.66:0/3463335938 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98037070 con 0x7f2e9c162750 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.173+0000 7f2e93fff640 1 -- 172.21.15.66:0/3463335938 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98032440 con 0x7f2e9c162750 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.173+0000 7f2e93fff640 1 -- 172.21.15.66:0/3463335938 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98032810 con 0x7f2e9c162750 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 -- 172.21.15.66:0/3463335938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162750 msgr2=0x7f2e9c0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 --2- 172.21.15.66:0/3463335938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162750 0x7f2e9c0d0670 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0d32c0 tx=0x7f2e9802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 -- 172.21.15.66:0/3463335938 shutdown_connections 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 --2- 172.21.15.66:0/3463335938 >> v2:172.21.15.190:3300/0 conn(0x7f2e9c162b30 0x7f2e9c0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 --2- 172.21.15.66:0/3463335938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162750 0x7f2e9c0d0670 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 -- 172.21.15.66:0/3463335938 >> 172.21.15.66:0/3463335938 conn(0x7f2e9c09e3b0 msgr2=0x7f2e9c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:23.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 -- 172.21.15.66:0/3463335938 shutdown_connections 2024-05-10T11:18:23.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.174+0000 7f2ea3820640 1 -- 172.21.15.66:0/3463335938 wait complete. 2024-05-10T11:18:23.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.175+0000 7f2ea3820640 1 Processor -- start 2024-05-10T11:18:23.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.175+0000 7f2ea3820640 1 -- start start 2024-05-10T11:18:23.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea3820640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9c162750 0x7f2e9c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea3820640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 0x7f2e9c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea3820640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e9c1f7f20 0x7f2e9c1f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea3820640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c0d0d30 con 0x7f2e9c162b30 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea3820640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c0d0bb0 con 0x7f2e9c1f7f20 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea3820640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9c0d3d40 con 0x7f2e9c162750 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 0x7f2e9c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 0x7f2e9c15d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36226/0 (socket says 172.21.15.66:36226) 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 -- 172.21.15.66:0/2835198261 learned_addr learned my addr 172.21.15.66:0/2835198261 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea1dbd640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e9c1f7f20 0x7f2e9c1f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea15bc640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9c162750 0x7f2e9c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 -- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9c162750 msgr2=0x7f2e9c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9c162750 0x7f2e9c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 -- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e9c1f7f20 msgr2=0x7f2e9c1f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e9c1f7f20 0x7f2e9c1f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea0dbb640 1 -- 172.21.15.66:0/2835198261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c15d980 con 0x7f2e9c162b30 2024-05-10T11:18:23.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.176+0000 7f2ea1dbd640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e9c1f7f20 0x7f2e9c1f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:23.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.177+0000 7f2ea0dbb640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 0x7f2e9c15d440 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c420 tx=0x7f2e8c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.177+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c017070 con 0x7f2e9c162b30 2024-05-10T11:18:23.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.177+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0035f0 con 0x7f2e9c162b30 2024-05-10T11:18:23.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.177+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0039e0 con 0x7f2e9c162b30 2024-05-10T11:18:23.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.177+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c15cdf0 con 0x7f2e9c162b30 2024-05-10T11:18:23.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.177+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9c0ce410 con 0x7f2e9c162b30 2024-05-10T11:18:23.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.178+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c06a220 con 0x7f2e9c162b30 2024-05-10T11:18:23.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.179+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e8c01a070 con 0x7f2e9c162b30 2024-05-10T11:18:23.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.179+0000 7f2e91ffb640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.179+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f2e8c096920 con 0x7f2e9c162b30 2024-05-10T11:18:23.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.179+0000 7f2ea15bc640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.180+0000 7f2ea15bc640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e98034000 tx=0x7f2e9802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.184+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2e8c05fb30 con 0x7f2e9c162b30 2024-05-10T11:18:23.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.371+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e9c0b6650 con 0x7f2e80076300 2024-05-10T11:18:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.377+0000 7f2e91ffb640 1 -- 172.21.15.66:0/2835198261 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252051 (secure 0 0 0) 0x7f2e9c0b6650 con 0x7f2e80076300 2024-05-10T11:18:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:23.383 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:18:23.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 msgr2=0x7f2e800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e98034000 tx=0x7f2e9802e000 comp rx=0 tx=0).stop 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 msgr2=0x7f2e9c15d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 0x7f2e9c15d440 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c420 tx=0x7f2e8c00c8e0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 shutdown_connections 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e9c1f7f20 0x7f2e9c1f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c162b30 0x7f2e9c15d440 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 --2- 172.21.15.66:0/2835198261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9c162750 0x7f2e9c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 >> 172.21.15.66:0/2835198261 conn(0x7f2e9c09e3b0 msgr2=0x7f2e9c06e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 shutdown_connections 2024-05-10T11:18:23.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.380+0000 7f2ea3820640 1 -- 172.21.15.66:0/2835198261 wait complete. 2024-05-10T11:18:23.392 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-05-10T11:18:21.772344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254944,"kb_used_data":9640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719776,"statfs":{"total":773094113280,"available":772833050624,"internally_reserved":0,"allocated":9871360,"data_stored":5126260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002195"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590129+0000","last_change":"2024-05-10T11:18:14.504149+0000","last_active":"2024-05-10T11:18:15.590129+0000","last_peered":"2024-05-10T11:18:15.590129+0000","last_clean":"2024-05-10T11:18:15.590129+0000","last_became_active":"2024-05-10T11:18:14.503828+0000","last_became_peered":"2024-05-10T11:18:14.503828+0000","last_unstale":"2024-05-10T11:18:15.590129+0000","last_undegraded":"2024-05-10T11:18:15.590129+0000","last_fullsized":"2024-05-10T11:18:15.590129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504194+0000","last_change":"2024-05-10T11:18:14.505657+0000","last_active":"2024-05-10T11:18:15.504194+0000","last_peered":"2024-05-10T11:18:15.504194+0000","last_clean":"2024-05-10T11:18:15.504194+0000","last_became_active":"2024-05-10T11:18:14.505269+0000","last_became_peered":"2024-05-10T11:18:14.505269+0000","last_unstale":"2024-05-10T11:18:15.504194+0000","last_undegraded":"2024-05-10T11:18:15.504194+0000","last_fullsized":"2024-05-10T11:18:15.504194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:25.863275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589626+0000","last_change":"2024-05-10T11:18:14.502679+0000","last_active":"2024-05-10T11:18:15.589626+0000","last_peered":"2024-05-10T11:18:15.589626+0000","last_clean":"2024-05-10T11:18:15.589626+0000","last_became_active":"2024-05-10T11:18:14.502382+0000","last_became_peered":"2024-05-10T11:18:14.502382+0000","last_unstale":"2024-05-10T11:18:15.589626+0000","last_undegraded":"2024-05-10T11:18:15.589626+0000","last_fullsized":"2024-05-10T11:18:15.589626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590425+0000","last_change":"2024-05-10T11:18:14.505319+0000","last_active":"2024-05-10T11:18:15.590425+0000","last_peered":"2024-05-10T11:18:15.590425+0000","last_clean":"2024-05-10T11:18:15.590425+0000","last_became_active":"2024-05-10T11:18:14.504964+0000","last_became_peered":"2024-05-10T11:18:14.504964+0000","last_unstale":"2024-05-10T11:18:15.590425+0000","last_undegraded":"2024-05-10T11:18:15.590425+0000","last_fullsized":"2024-05-10T11:18:15.590425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500652+0000","last_change":"2024-05-10T11:18:14.507407+0000","last_active":"2024-05-10T11:18:15.500652+0000","last_peered":"2024-05-10T11:18:15.500652+0000","last_clean":"2024-05-10T11:18:15.500652+0000","last_became_active":"2024-05-10T11:18:14.502885+0000","last_became_peered":"2024-05-10T11:18:14.502885+0000","last_unstale":"2024-05-10T11:18:15.500652+0000","last_undegraded":"2024-05-10T11:18:15.500652+0000","last_fullsized":"2024-05-10T11:18:15.500652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:32.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589202+0000","last_change":"2024-05-10T11:18:14.510117+0000","last_active":"2024-05-10T11:18:15.589202+0000","last_peered":"2024-05-10T11:18:15.589202+0000","last_clean":"2024-05-10T11:18:15.589202+0000","last_became_active":"2024-05-10T11:18:14.509816+0000","last_became_peered":"2024-05-10T11:18:14.509816+0000","last_unstale":"2024-05-10T11:18:15.589202+0000","last_undegraded":"2024-05-10T11:18:15.589202+0000","last_fullsized":"2024-05-10T11:18:15.589202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:24.104590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589757+0000","last_change":"2024-05-10T11:18:14.496651+0000","last_active":"2024-05-10T11:18:15.589757+0000","last_peered":"2024-05-10T11:18:15.589757+0000","last_clean":"2024-05-10T11:18:15.589757+0000","last_became_active":"2024-05-10T11:18:14.496393+0000","last_became_peered":"2024-05-10T11:18:14.496393+0000","last_unstale":"2024-05-10T11:18:15.589757+0000","last_undegraded":"2024-05-10T11:18:15.589757+0000","last_fullsized":"2024-05-10T11:18:15.589757+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:52.135649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588832+0000","last_change":"2024-05-10T11:18:14.496569+0000","last_active":"2024-05-10T11:18:15.588832+0000","last_peered":"2024-05-10T11:18:15.588832+0000","last_clean":"2024-05-10T11:18:15.588832+0000","last_became_active":"2024-05-10T11:18:14.494250+0000","last_became_peered":"2024-05-10T11:18:14.494250+0000","last_unstale":"2024-05-10T11:18:15.588832+0000","last_undegraded":"2024-05-10T11:18:15.588832+0000","last_fullsized":"2024-05-10T11:18:15.588832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:47.808143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501031+0000","last_change":"2024-05-10T11:18:14.506686+0000","last_active":"2024-05-10T11:18:15.501031+0000","last_peered":"2024-05-10T11:18:15.501031+0000","last_clean":"2024-05-10T11:18:15.501031+0000","last_became_active":"2024-05-10T11:18:14.506421+0000","last_became_peered":"2024-05-10T11:18:14.506421+0000","last_unstale":"2024-05-10T11:18:15.501031+0000","last_undegraded":"2024-05-10T11:18:15.501031+0000","last_fullsized":"2024-05-10T11:18:15.501031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:05.217944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500560+0000","last_change":"2024-05-10T11:18:14.509973+0000","last_active":"2024-05-10T11:18:15.500560+0000","last_peered":"2024-05-10T11:18:15.500560+0000","last_clean":"2024-05-10T11:18:15.500560+0000","last_became_active":"2024-05-10T11:18:14.509543+0000","last_became_peered":"2024-05-10T11:18:14.509543+0000","last_unstale":"2024-05-10T11:18:15.500560+0000","last_undegraded":"2024-05-10T11:18:15.500560+0000","last_fullsized":"2024-05-10T11:18:15.500560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:01.778938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501070+0000","last_change":"2024-05-10T11:18:14.517047+0000","last_active":"2024-05-10T11:18:15.501070+0000","last_peered":"2024-05-10T11:18:15.501070+0000","last_clean":"2024-05-10T11:18:15.501070+0000","last_became_active":"2024-05-10T11:18:14.516884+0000","last_became_peered":"2024-05-10T11:18:14.516884+0000","last_unstale":"2024-05-10T11:18:15.501070+0000","last_undegraded":"2024-05-10T11:18:15.501070+0000","last_fullsized":"2024-05-10T11:18:15.501070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:12.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500601+0000","last_change":"2024-05-10T11:18:14.515247+0000","last_active":"2024-05-10T11:18:15.500601+0000","last_peered":"2024-05-10T11:18:15.500601+0000","last_clean":"2024-05-10T11:18:15.500601+0000","last_became_active":"2024-05-10T11:18:14.514931+0000","last_became_peered":"2024-05-10T11:18:14.514931+0000","last_unstale":"2024-05-10T11:18:15.500601+0000","last_undegraded":"2024-05-10T11:18:15.500601+0000","last_fullsized":"2024-05-10T11:18:15.500601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:59.852003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590206+0000","last_change":"2024-05-10T11:18:14.495959+0000","last_active":"2024-05-10T11:18:15.590206+0000","last_peered":"2024-05-10T11:18:15.590206+0000","last_clean":"2024-05-10T11:18:15.590206+0000","last_became_active":"2024-05-10T11:18:14.494391+0000","last_became_peered":"2024-05-10T11:18:14.494391+0000","last_unstale":"2024-05-10T11:18:15.590206+0000","last_undegraded":"2024-05-10T11:18:15.590206+0000","last_fullsized":"2024-05-10T11:18:15.590206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:10.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500565+0000","last_change":"2024-05-10T11:18:14.502477+0000","last_active":"2024-05-10T11:18:15.500565+0000","last_peered":"2024-05-10T11:18:15.500565+0000","last_clean":"2024-05-10T11:18:15.500565+0000","last_became_active":"2024-05-10T11:18:14.502214+0000","last_became_peered":"2024-05-10T11:18:14.502214+0000","last_unstale":"2024-05-10T11:18:15.500565+0000","last_undegraded":"2024-05-10T11:18:15.500565+0000","last_fullsized":"2024-05-10T11:18:15.500565+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:36.046820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589287+0000","last_change":"2024-05-10T11:18:14.500781+0000","last_active":"2024-05-10T11:18:15.589287+0000","last_peered":"2024-05-10T11:18:15.589287+0000","last_clean":"2024-05-10T11:18:15.589287+0000","last_became_active":"2024-05-10T11:18:14.500434+0000","last_became_peered":"2024-05-10T11:18:14.500434+0000","last_unstale":"2024-05-10T11:18:15.589287+0000","last_undegraded":"2024-05-10T11:18:15.589287+0000","last_fullsized":"2024-05-10T11:18:15.589287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:51.953240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589304+0000","last_change":"2024-05-10T11:18:14.511780+0000","last_active":"2024-05-10T11:18:15.589304+0000","last_peered":"2024-05-10T11:18:15.589304+0000","last_clean":"2024-05-10T11:18:15.589304+0000","last_became_active":"2024-05-10T11:18:14.510880+0000","last_became_peered":"2024-05-10T11:18:14.510880+0000","last_unstale":"2024-05-10T11:18:15.589304+0000","last_undegraded":"2024-05-10T11:18:15.589304+0000","last_fullsized":"2024-05-10T11:18:15.589304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:54:34.155865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589852+0000","last_change":"2024-05-10T11:18:14.499725+0000","last_active":"2024-05-10T11:18:15.589852+0000","last_peered":"2024-05-10T11:18:15.589852+0000","last_clean":"2024-05-10T11:18:15.589852+0000","last_became_active":"2024-05-10T11:18:14.499366+0000","last_became_peered":"2024-05-10T11:18:14.499366+0000","last_unstale":"2024-05-10T11:18:15.589852+0000","last_undegraded":"2024-05-10T11:18:15.589852+0000","last_fullsized":"2024-05-10T11:18:15.589852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:43.303098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589057+0000","last_change":"2024-05-10T11:18:14.506434+0000","last_active":"2024-05-10T11:18:15.589057+0000","last_peered":"2024-05-10T11:18:15.589057+0000","last_clean":"2024-05-10T11:18:15.589057+0000","last_became_active":"2024-05-10T11:18:14.506161+0000","last_became_peered":"2024-05-10T11:18:14.506161+0000","last_unstale":"2024-05-10T11:18:15.589057+0000","last_undegraded":"2024-05-10T11:18:15.589057+0000","last_fullsized":"2024-05-10T11:18:15.589057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501277+0000","last_change":"2024-05-10T11:18:14.506233+0000","last_active":"2024-05-10T11:18:15.501277+0000","last_peered":"2024-05-10T11:18:15.501277+0000","last_clean":"2024-05-10T11:18:15.501277+0000","last_became_active":"2024-05-10T11:18:14.505921+0000","last_became_peered":"2024-05-10T11:18:14.505921+0000","last_unstale":"2024-05-10T11:18:15.501277+0000","last_undegraded":"2024-05-10T11:18:15.501277+0000","last_fullsized":"2024-05-10T11:18:15.501277+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:20.272885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590428+0000","last_change":"2024-05-10T11:18:14.500701+0000","last_active":"2024-05-10T11:18:15.590428+0000","last_peered":"2024-05-10T11:18:15.590428+0000","last_clean":"2024-05-10T11:18:15.590428+0000","last_became_active":"2024-05-10T11:18:14.500377+0000","last_became_peered":"2024-05-10T11:18:14.500377+0000","last_unstale":"2024-05-10T11:18:15.590428+0000","last_undegraded":"2024-05-10T11:18:15.590428+0000","last_fullsized":"2024-05-10T11:18:15.590428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500739+0000","last_change":"2024-05-10T11:18:14.497653+0000","last_active":"2024-05-10T11:18:15.500739+0000","last_peered":"2024-05-10T11:18:15.500739+0000","last_clean":"2024-05-10T11:18:15.500739+0000","last_became_active":"2024-05-10T11:18:14.497394+0000","last_became_peered":"2024-05-10T11:18:14.497394+0000","last_unstale":"2024-05-10T11:18:15.500739+0000","last_undegraded":"2024-05-10T11:18:15.500739+0000","last_fullsized":"2024-05-10T11:18:15.500739+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:53.764973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500753+0000","last_change":"2024-05-10T11:18:14.506233+0000","last_active":"2024-05-10T11:18:15.500753+0000","last_peered":"2024-05-10T11:18:15.500753+0000","last_clean":"2024-05-10T11:18:15.500753+0000","last_became_active":"2024-05-10T11:18:14.505966+0000","last_became_peered":"2024-05-10T11:18:14.505966+0000","last_unstale":"2024-05-10T11:18:15.500753+0000","last_undegraded":"2024-05-10T11:18:15.500753+0000","last_fullsized":"2024-05-10T11:18:15.500753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:16.770065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589696+0000","last_change":"2024-05-10T11:18:14.504605+0000","last_active":"2024-05-10T11:18:15.589696+0000","last_peered":"2024-05-10T11:18:15.589696+0000","last_clean":"2024-05-10T11:18:15.589696+0000","last_became_active":"2024-05-10T11:18:14.502983+0000","last_became_peered":"2024-05-10T11:18:14.502983+0000","last_unstale":"2024-05-10T11:18:15.589696+0000","last_undegraded":"2024-05-10T11:18:15.589696+0000","last_fullsized":"2024-05-10T11:18:15.589696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:53.764973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589152+0000","last_change":"2024-05-10T11:18:14.496012+0000","last_active":"2024-05-10T11:18:15.589152+0000","last_peered":"2024-05-10T11:18:15.589152+0000","last_clean":"2024-05-10T11:18:15.589152+0000","last_became_active":"2024-05-10T11:18:14.495715+0000","last_became_peered":"2024-05-10T11:18:14.495715+0000","last_unstale":"2024-05-10T11:18:15.589152+0000","last_undegraded":"2024-05-10T11:18:15.589152+0000","last_fullsized":"2024-05-10T11:18:15.589152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:34:10.559229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.509349+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.509077+0000","last_became_peered":"2024-05-10T11:18:14.509077+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500597+0000","last_change":"2024-05-10T11:18:14.508504+0000","last_active":"2024-05-10T11:18:15.500597+0000","last_peered":"2024-05-10T11:18:15.500597+0000","last_clean":"2024-05-10T11:18:15.500597+0000","last_became_active":"2024-05-10T11:18:14.507702+0000","last_became_peered":"2024-05-10T11:18:14.507702+0000","last_unstale":"2024-05-10T11:18:15.500597+0000","last_undegraded":"2024-05-10T11:18:15.500597+0000","last_fullsized":"2024-05-10T11:18:15.500597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:42.535740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500648+0000","last_change":"2024-05-10T11:18:14.515113+0000","last_active":"2024-05-10T11:18:15.500648+0000","last_peered":"2024-05-10T11:18:15.500648+0000","last_clean":"2024-05-10T11:18:15.500648+0000","last_became_active":"2024-05-10T11:18:14.514824+0000","last_became_peered":"2024-05-10T11:18:14.514824+0000","last_unstale":"2024-05-10T11:18:15.500648+0000","last_undegraded":"2024-05-10T11:18:15.500648+0000","last_fullsized":"2024-05-10T11:18:15.500648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:48.996486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590608+0000","last_change":"2024-05-10T11:18:14.512508+0000","last_active":"2024-05-10T11:18:15.590608+0000","last_peered":"2024-05-10T11:18:15.590608+0000","last_clean":"2024-05-10T11:18:15.590608+0000","last_became_active":"2024-05-10T11:18:14.512218+0000","last_became_peered":"2024-05-10T11:18:14.512218+0000","last_unstale":"2024-05-10T11:18:15.590608+0000","last_undegraded":"2024-05-10T11:18:15.590608+0000","last_fullsized":"2024-05-10T11:18:15.590608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590014+0000","last_change":"2024-05-10T11:18:14.505322+0000","last_active":"2024-05-10T11:18:15.590014+0000","last_peered":"2024-05-10T11:18:15.590014+0000","last_clean":"2024-05-10T11:18:15.590014+0000","last_became_active":"2024-05-10T11:18:14.505030+0000","last_became_peered":"2024-05-10T11:18:14.505030+0000","last_unstale":"2024-05-10T11:18:15.590014+0000","last_undegraded":"2024-05-10T11:18:15.590014+0000","last_fullsized":"2024-05-10T11:18:15.590014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:04.508357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501070+0000","last_change":"2024-05-10T11:18:14.506912+0000","last_active":"2024-05-10T11:18:15.501070+0000","last_peered":"2024-05-10T11:18:15.501070+0000","last_clean":"2024-05-10T11:18:15.501070+0000","last_became_active":"2024-05-10T11:18:14.506641+0000","last_became_peered":"2024-05-10T11:18:14.506641+0000","last_unstale":"2024-05-10T11:18:15.501070+0000","last_undegraded":"2024-05-10T11:18:15.501070+0000","last_fullsized":"2024-05-10T11:18:15.501070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:49.666578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503674+0000","last_change":"2024-05-10T11:18:14.507356+0000","last_active":"2024-05-10T11:18:15.503674+0000","last_peered":"2024-05-10T11:18:15.503674+0000","last_clean":"2024-05-10T11:18:15.503674+0000","last_became_active":"2024-05-10T11:18:14.507037+0000","last_became_peered":"2024-05-10T11:18:14.507037+0000","last_unstale":"2024-05-10T11:18:15.503674+0000","last_undegraded":"2024-05-10T11:18:15.503674+0000","last_fullsized":"2024-05-10T11:18:15.503674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:40.541720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589362+0000","last_change":"2024-05-10T11:18:14.511137+0000","last_active":"2024-05-10T11:18:15.589362+0000","last_peered":"2024-05-10T11:18:15.589362+0000","last_clean":"2024-05-10T11:18:15.589362+0000","last_became_active":"2024-05-10T11:18:14.510460+0000","last_became_peered":"2024-05-10T11:18:14.510460+0000","last_unstale":"2024-05-10T11:18:15.589362+0000","last_undegraded":"2024-05-10T11:18:15.589362+0000","last_fullsized":"2024-05-10T11:18:15.589362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:45.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588999+0000","last_change":"2024-05-10T11:18:14.509145+0000","last_active":"2024-05-10T11:18:15.588999+0000","last_peered":"2024-05-10T11:18:15.588999+0000","last_clean":"2024-05-10T11:18:15.588999+0000","last_became_active":"2024-05-10T11:18:14.507612+0000","last_became_peered":"2024-05-10T11:18:14.507612+0000","last_unstale":"2024-05-10T11:18:15.588999+0000","last_undegraded":"2024-05-10T11:18:15.588999+0000","last_fullsized":"2024-05-10T11:18:15.588999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:59.817611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589537+0000","last_change":"2024-05-10T11:18:13.489312+0000","last_active":"2024-05-10T11:18:15.589537+0000","last_peered":"2024-05-10T11:18:15.589537+0000","last_clean":"2024-05-10T11:18:15.589537+0000","last_became_active":"2024-05-10T11:18:13.489055+0000","last_became_peered":"2024-05-10T11:18:13.489055+0000","last_unstale":"2024-05-10T11:18:15.589537+0000","last_undegraded":"2024-05-10T11:18:15.589537+0000","last_fullsized":"2024-05-10T11:18:15.589537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:59.209454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589488+0000","last_change":"2024-05-10T11:18:14.506891+0000","last_active":"2024-05-10T11:18:15.589488+0000","last_peered":"2024-05-10T11:18:15.589488+0000","last_clean":"2024-05-10T11:18:15.589488+0000","last_became_active":"2024-05-10T11:18:14.506604+0000","last_became_peered":"2024-05-10T11:18:14.506604+0000","last_unstale":"2024-05-10T11:18:15.589488+0000","last_undegraded":"2024-05-10T11:18:15.589488+0000","last_fullsized":"2024-05-10T11:18:15.589488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:46.769438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501006+0000","last_change":"2024-05-10T11:18:13.487405+0000","last_active":"2024-05-10T11:18:15.501006+0000","last_peered":"2024-05-10T11:18:15.501006+0000","last_clean":"2024-05-10T11:18:15.501006+0000","last_became_active":"2024-05-10T11:18:13.487122+0000","last_became_peered":"2024-05-10T11:18:13.487122+0000","last_unstale":"2024-05-10T11:18:15.501006+0000","last_undegraded":"2024-05-10T11:18:15.501006+0000","last_fullsized":"2024-05-10T11:18:15.501006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:32.602387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589810+0000","last_change":"2024-05-10T11:18:14.495250+0000","last_active":"2024-05-10T11:18:15.589810+0000","last_peered":"2024-05-10T11:18:15.589810+0000","last_clean":"2024-05-10T11:18:15.589810+0000","last_became_active":"2024-05-10T11:18:14.494969+0000","last_became_peered":"2024-05-10T11:18:14.494969+0000","last_unstale":"2024-05-10T11:18:15.589810+0000","last_undegraded":"2024-05-10T11:18:15.589810+0000","last_fullsized":"2024-05-10T11:18:15.589810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:55.067128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589777+0000","last_change":"2024-05-10T11:18:13.491023+0000","last_active":"2024-05-10T11:18:15.589777+0000","last_peered":"2024-05-10T11:18:15.589777+0000","last_clean":"2024-05-10T11:18:15.589777+0000","last_became_active":"2024-05-10T11:18:13.490750+0000","last_became_peered":"2024-05-10T11:18:13.490750+0000","last_unstale":"2024-05-10T11:18:15.589777+0000","last_undegraded":"2024-05-10T11:18:15.589777+0000","last_fullsized":"2024-05-10T11:18:15.589777+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.680606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.517446+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.517158+0000","last_became_peered":"2024-05-10T11:18:14.517158+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:59.932591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589704+0000","last_change":"2024-05-10T11:18:13.496226+0000","last_active":"2024-05-10T11:18:15.589704+0000","last_peered":"2024-05-10T11:18:15.589704+0000","last_clean":"2024-05-10T11:18:15.589704+0000","last_became_active":"2024-05-10T11:18:13.495965+0000","last_became_peered":"2024-05-10T11:18:13.495965+0000","last_unstale":"2024-05-10T11:18:15.589704+0000","last_undegraded":"2024-05-10T11:18:15.589704+0000","last_fullsized":"2024-05-10T11:18:15.589704+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:41.108794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588902+0000","last_change":"2024-05-10T11:18:14.502176+0000","last_active":"2024-05-10T11:18:15.588902+0000","last_peered":"2024-05-10T11:18:15.588902+0000","last_clean":"2024-05-10T11:18:15.588902+0000","last_became_active":"2024-05-10T11:18:14.501901+0000","last_became_peered":"2024-05-10T11:18:14.501901+0000","last_unstale":"2024-05-10T11:18:15.588902+0000","last_undegraded":"2024-05-10T11:18:15.588902+0000","last_fullsized":"2024-05-10T11:18:15.588902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:22.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500770+0000","last_change":"2024-05-10T11:18:13.489468+0000","last_active":"2024-05-10T11:18:15.500770+0000","last_peered":"2024-05-10T11:18:15.500770+0000","last_clean":"2024-05-10T11:18:15.500770+0000","last_became_active":"2024-05-10T11:18:13.489197+0000","last_became_peered":"2024-05-10T11:18:13.489197+0000","last_unstale":"2024-05-10T11:18:15.500770+0000","last_undegraded":"2024-05-10T11:18:15.500770+0000","last_fullsized":"2024-05-10T11:18:15.500770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:02:08.288741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589429+0000","last_change":"2024-05-10T11:18:14.511588+0000","last_active":"2024-05-10T11:18:15.589429+0000","last_peered":"2024-05-10T11:18:15.589429+0000","last_clean":"2024-05-10T11:18:15.589429+0000","last_became_active":"2024-05-10T11:18:14.510951+0000","last_became_peered":"2024-05-10T11:18:14.510951+0000","last_unstale":"2024-05-10T11:18:15.589429+0000","last_undegraded":"2024-05-10T11:18:15.589429+0000","last_fullsized":"2024-05-10T11:18:15.589429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:42.535740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589863+0000","last_change":"2024-05-10T11:18:13.499705+0000","last_active":"2024-05-10T11:18:15.589863+0000","last_peered":"2024-05-10T11:18:15.589863+0000","last_clean":"2024-05-10T11:18:15.589863+0000","last_became_active":"2024-05-10T11:18:13.499448+0000","last_became_peered":"2024-05-10T11:18:13.499448+0000","last_unstale":"2024-05-10T11:18:15.589863+0000","last_undegraded":"2024-05-10T11:18:15.589863+0000","last_fullsized":"2024-05-10T11:18:15.589863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:22.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589016+0000","last_change":"2024-05-10T11:18:14.510528+0000","last_active":"2024-05-10T11:18:15.589016+0000","last_peered":"2024-05-10T11:18:15.589016+0000","last_clean":"2024-05-10T11:18:15.589016+0000","last_became_active":"2024-05-10T11:18:14.510212+0000","last_became_peered":"2024-05-10T11:18:14.510212+0000","last_unstale":"2024-05-10T11:18:15.589016+0000","last_undegraded":"2024-05-10T11:18:15.589016+0000","last_fullsized":"2024-05-10T11:18:15.589016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:40.308953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589373+0000","last_change":"2024-05-10T11:18:13.484546+0000","last_active":"2024-05-10T11:18:15.589373+0000","last_peered":"2024-05-10T11:18:15.589373+0000","last_clean":"2024-05-10T11:18:15.589373+0000","last_became_active":"2024-05-10T11:18:13.484252+0000","last_became_peered":"2024-05-10T11:18:13.484252+0000","last_unstale":"2024-05-10T11:18:15.589373+0000","last_undegraded":"2024-05-10T11:18:15.589373+0000","last_fullsized":"2024-05-10T11:18:15.589373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:23.840058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590407+0000","last_change":"2024-05-10T11:18:14.502695+0000","last_active":"2024-05-10T11:18:15.590407+0000","last_peered":"2024-05-10T11:18:15.590407+0000","last_clean":"2024-05-10T11:18:15.590407+0000","last_became_active":"2024-05-10T11:18:14.502130+0000","last_became_peered":"2024-05-10T11:18:14.502130+0000","last_unstale":"2024-05-10T11:18:15.590407+0000","last_undegraded":"2024-05-10T11:18:15.590407+0000","last_fullsized":"2024-05-10T11:18:15.590407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:01.186141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589385+0000","last_change":"2024-05-10T11:18:13.492663+0000","last_active":"2024-05-10T11:18:15.589385+0000","last_peered":"2024-05-10T11:18:15.589385+0000","last_clean":"2024-05-10T11:18:15.589385+0000","last_became_active":"2024-05-10T11:18:13.492415+0000","last_became_peered":"2024-05-10T11:18:13.492415+0000","last_unstale":"2024-05-10T11:18:15.589385+0000","last_undegraded":"2024-05-10T11:18:15.589385+0000","last_fullsized":"2024-05-10T11:18:15.589385+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:19.265889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501030+0000","last_change":"2024-05-10T11:18:14.498480+0000","last_active":"2024-05-10T11:18:15.501030+0000","last_peered":"2024-05-10T11:18:15.501030+0000","last_clean":"2024-05-10T11:18:15.501030+0000","last_became_active":"2024-05-10T11:18:14.498153+0000","last_became_peered":"2024-05-10T11:18:14.498153+0000","last_unstale":"2024-05-10T11:18:15.501030+0000","last_undegraded":"2024-05-10T11:18:15.501030+0000","last_fullsized":"2024-05-10T11:18:15.501030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:46.526595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504114+0000","last_change":"2024-05-10T11:18:13.489382+0000","last_active":"2024-05-10T11:18:15.504114+0000","last_peered":"2024-05-10T11:18:15.504114+0000","last_clean":"2024-05-10T11:18:15.504114+0000","last_became_active":"2024-05-10T11:18:13.489117+0000","last_became_peered":"2024-05-10T11:18:13.489117+0000","last_unstale":"2024-05-10T11:18:15.504114+0000","last_undegraded":"2024-05-10T11:18:15.504114+0000","last_fullsized":"2024-05-10T11:18:15.504114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:58.559240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589738+0000","last_change":"2024-05-10T11:18:14.499498+0000","last_active":"2024-05-10T11:18:15.589738+0000","last_peered":"2024-05-10T11:18:15.589738+0000","last_clean":"2024-05-10T11:18:15.589738+0000","last_became_active":"2024-05-10T11:18:14.499218+0000","last_became_peered":"2024-05-10T11:18:14.499218+0000","last_unstale":"2024-05-10T11:18:15.589738+0000","last_undegraded":"2024-05-10T11:18:15.589738+0000","last_fullsized":"2024-05-10T11:18:15.589738+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:39:05.943451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:13.496483+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:13.496161+0000","last_became_peered":"2024-05-10T11:18:13.496161+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589755+0000","last_change":"2024-05-10T11:18:14.505565+0000","last_active":"2024-05-10T11:18:15.589755+0000","last_peered":"2024-05-10T11:18:15.589755+0000","last_clean":"2024-05-10T11:18:15.589755+0000","last_became_active":"2024-05-10T11:18:14.504514+0000","last_became_peered":"2024-05-10T11:18:14.504514+0000","last_unstale":"2024-05-10T11:18:15.589755+0000","last_undegraded":"2024-05-10T11:18:15.589755+0000","last_fullsized":"2024-05-10T11:18:15.589755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501301+0000","last_change":"2024-05-10T11:18:13.492466+0000","last_active":"2024-05-10T11:18:15.501301+0000","last_peered":"2024-05-10T11:18:15.501301+0000","last_clean":"2024-05-10T11:18:15.501301+0000","last_became_active":"2024-05-10T11:18:13.492210+0000","last_became_peered":"2024-05-10T11:18:13.492210+0000","last_unstale":"2024-05-10T11:18:15.501301+0000","last_undegraded":"2024-05-10T11:18:15.501301+0000","last_fullsized":"2024-05-10T11:18:15.501301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:21.208295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590683+0000","last_change":"2024-05-10T11:18:14.506980+0000","last_active":"2024-05-10T11:18:15.590683+0000","last_peered":"2024-05-10T11:18:15.590683+0000","last_clean":"2024-05-10T11:18:15.590683+0000","last_became_active":"2024-05-10T11:18:14.506669+0000","last_became_peered":"2024-05-10T11:18:14.506669+0000","last_unstale":"2024-05-10T11:18:15.590683+0000","last_undegraded":"2024-05-10T11:18:15.590683+0000","last_fullsized":"2024-05-10T11:18:15.590683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589688+0000","last_change":"2024-05-10T11:18:13.491065+0000","last_active":"2024-05-10T11:18:15.589688+0000","last_peered":"2024-05-10T11:18:15.589688+0000","last_clean":"2024-05-10T11:18:15.589688+0000","last_became_active":"2024-05-10T11:18:13.490740+0000","last_became_peered":"2024-05-10T11:18:13.490740+0000","last_unstale":"2024-05-10T11:18:15.589688+0000","last_undegraded":"2024-05-10T11:18:15.589688+0000","last_fullsized":"2024-05-10T11:18:15.589688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:17.665658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.588979+0000","last_change":"2024-05-10T11:18:14.492654+0000","last_active":"2024-05-10T11:18:15.588979+0000","last_peered":"2024-05-10T11:18:15.588979+0000","last_clean":"2024-05-10T11:18:15.588979+0000","last_became_active":"2024-05-10T11:18:14.492328+0000","last_became_peered":"2024-05-10T11:18:14.492328+0000","last_unstale":"2024-05-10T11:18:15.588979+0000","last_undegraded":"2024-05-10T11:18:15.588979+0000","last_fullsized":"2024-05-10T11:18:15.588979+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:24:34.509745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589511+0000","last_change":"2024-05-10T11:18:13.493293+0000","last_active":"2024-05-10T11:18:15.589511+0000","last_peered":"2024-05-10T11:18:15.589511+0000","last_clean":"2024-05-10T11:18:15.589511+0000","last_became_active":"2024-05-10T11:18:13.493029+0000","last_became_peered":"2024-05-10T11:18:13.493029+0000","last_unstale":"2024-05-10T11:18:15.589511+0000","last_undegraded":"2024-05-10T11:18:15.589511+0000","last_fullsized":"2024-05-10T11:18:15.589511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:44.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500411+0000","last_change":"2024-05-10T11:18:14.503214+0000","last_active":"2024-05-10T11:18:15.500411+0000","last_peered":"2024-05-10T11:18:15.500411+0000","last_clean":"2024-05-10T11:18:15.500411+0000","last_became_active":"2024-05-10T11:18:14.502959+0000","last_became_peered":"2024-05-10T11:18:14.502959+0000","last_unstale":"2024-05-10T11:18:15.500411+0000","last_undegraded":"2024-05-10T11:18:15.500411+0000","last_fullsized":"2024-05-10T11:18:15.500411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:47.159472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589062+0000","last_change":"2024-05-10T11:18:13.491930+0000","last_active":"2024-05-10T11:18:15.589062+0000","last_peered":"2024-05-10T11:18:15.589062+0000","last_clean":"2024-05-10T11:18:15.589062+0000","last_became_active":"2024-05-10T11:18:13.491576+0000","last_became_peered":"2024-05-10T11:18:13.491576+0000","last_unstale":"2024-05-10T11:18:15.589062+0000","last_undegraded":"2024-05-10T11:18:15.589062+0000","last_fullsized":"2024-05-10T11:18:15.589062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:20.216601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500392+0000","last_change":"2024-05-10T11:18:14.512578+0000","last_active":"2024-05-10T11:18:15.500392+0000","last_peered":"2024-05-10T11:18:15.500392+0000","last_clean":"2024-05-10T11:18:15.500392+0000","last_became_active":"2024-05-10T11:18:14.512273+0000","last_became_peered":"2024-05-10T11:18:14.512273+0000","last_unstale":"2024-05-10T11:18:15.500392+0000","last_undegraded":"2024-05-10T11:18:15.500392+0000","last_fullsized":"2024-05-10T11:18:15.500392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:16.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589418+0000","last_change":"2024-05-10T11:18:13.494933+0000","last_active":"2024-05-10T11:18:15.589418+0000","last_peered":"2024-05-10T11:18:15.589418+0000","last_clean":"2024-05-10T11:18:15.589418+0000","last_became_active":"2024-05-10T11:18:13.494632+0000","last_became_peered":"2024-05-10T11:18:13.494632+0000","last_unstale":"2024-05-10T11:18:15.589418+0000","last_undegraded":"2024-05-10T11:18:15.589418+0000","last_fullsized":"2024-05-10T11:18:15.589418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.988757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500556+0000","last_change":"2024-05-10T11:18:14.512697+0000","last_active":"2024-05-10T11:18:15.500556+0000","last_peered":"2024-05-10T11:18:15.500556+0000","last_clean":"2024-05-10T11:18:15.500556+0000","last_became_active":"2024-05-10T11:18:14.512424+0000","last_became_peered":"2024-05-10T11:18:14.512424+0000","last_unstale":"2024-05-10T11:18:15.500556+0000","last_undegraded":"2024-05-10T11:18:15.500556+0000","last_fullsized":"2024-05-10T11:18:15.500556+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:16.972744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589019+0000","last_change":"2024-05-10T11:18:13.499748+0000","last_active":"2024-05-10T11:18:15.589019+0000","last_peered":"2024-05-10T11:18:15.589019+0000","last_clean":"2024-05-10T11:18:15.589019+0000","last_became_active":"2024-05-10T11:18:13.499424+0000","last_became_peered":"2024-05-10T11:18:13.499424+0000","last_unstale":"2024-05-10T11:18:15.589019+0000","last_undegraded":"2024-05-10T11:18:15.589019+0000","last_fullsized":"2024-05-10T11:18:15.589019+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:45.777827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589632+0000","last_change":"2024-05-10T11:18:14.509330+0000","last_active":"2024-05-10T11:18:15.589632+0000","last_peered":"2024-05-10T11:18:15.589632+0000","last_clean":"2024-05-10T11:18:15.589632+0000","last_became_active":"2024-05-10T11:18:14.507243+0000","last_became_peered":"2024-05-10T11:18:14.507243+0000","last_unstale":"2024-05-10T11:18:15.589632+0000","last_undegraded":"2024-05-10T11:18:15.589632+0000","last_fullsized":"2024-05-10T11:18:15.589632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:16.911693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589662+0000","last_change":"2024-05-10T11:18:13.484923+0000","last_active":"2024-05-10T11:18:15.589662+0000","last_peered":"2024-05-10T11:18:15.589662+0000","last_clean":"2024-05-10T11:18:15.589662+0000","last_became_active":"2024-05-10T11:18:13.484625+0000","last_became_peered":"2024-05-10T11:18:13.484625+0000","last_unstale":"2024-05-10T11:18:15.589662+0000","last_undegraded":"2024-05-10T11:18:15.589662+0000","last_fullsized":"2024-05-10T11:18:15.589662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:39:53.863227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589576+0000","last_change":"2024-05-10T11:18:14.506481+0000","last_active":"2024-05-10T11:18:15.589576+0000","last_peered":"2024-05-10T11:18:15.589576+0000","last_clean":"2024-05-10T11:18:15.589576+0000","last_became_active":"2024-05-10T11:18:14.506204+0000","last_became_peered":"2024-05-10T11:18:14.506204+0000","last_unstale":"2024-05-10T11:18:15.589576+0000","last_undegraded":"2024-05-10T11:18:15.589576+0000","last_fullsized":"2024-05-10T11:18:15.589576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:32.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589820+0000","last_change":"2024-05-10T11:18:13.488650+0000","last_active":"2024-05-10T11:18:15.589820+0000","last_peered":"2024-05-10T11:18:15.589820+0000","last_clean":"2024-05-10T11:18:15.589820+0000","last_became_active":"2024-05-10T11:18:13.488336+0000","last_became_peered":"2024-05-10T11:18:13.488336+0000","last_unstale":"2024-05-10T11:18:15.589820+0000","last_undegraded":"2024-05-10T11:18:15.589820+0000","last_fullsized":"2024-05-10T11:18:15.589820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:28:16.815536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500965+0000","last_change":"2024-05-10T11:18:14.501454+0000","last_active":"2024-05-10T11:18:15.500965+0000","last_peered":"2024-05-10T11:18:15.500965+0000","last_clean":"2024-05-10T11:18:15.500965+0000","last_became_active":"2024-05-10T11:18:14.501179+0000","last_became_peered":"2024-05-10T11:18:14.501179+0000","last_unstale":"2024-05-10T11:18:15.500965+0000","last_undegraded":"2024-05-10T11:18:15.500965+0000","last_fullsized":"2024-05-10T11:18:15.500965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:50.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501379+0000","last_change":"2024-05-10T11:18:13.491192+0000","last_active":"2024-05-10T11:18:15.501379+0000","last_peered":"2024-05-10T11:18:15.501379+0000","last_clean":"2024-05-10T11:18:15.501379+0000","last_became_active":"2024-05-10T11:18:13.490839+0000","last_became_peered":"2024-05-10T11:18:13.490839+0000","last_unstale":"2024-05-10T11:18:15.501379+0000","last_undegraded":"2024-05-10T11:18:15.501379+0000","last_fullsized":"2024-05-10T11:18:15.501379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:52.982560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589466+0000","last_change":"2024-05-10T11:18:14.509377+0000","last_active":"2024-05-10T11:18:15.589466+0000","last_peered":"2024-05-10T11:18:15.589466+0000","last_clean":"2024-05-10T11:18:15.589466+0000","last_became_active":"2024-05-10T11:18:14.506328+0000","last_became_peered":"2024-05-10T11:18:14.506328+0000","last_unstale":"2024-05-10T11:18:15.589466+0000","last_undegraded":"2024-05-10T11:18:15.589466+0000","last_fullsized":"2024-05-10T11:18:15.589466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:12.639237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503705+0000","last_change":"2024-05-10T11:18:13.487719+0000","last_active":"2024-05-10T11:18:15.503705+0000","last_peered":"2024-05-10T11:18:15.503705+0000","last_clean":"2024-05-10T11:18:15.503705+0000","last_became_active":"2024-05-10T11:18:13.486232+0000","last_became_peered":"2024-05-10T11:18:13.486232+0000","last_unstale":"2024-05-10T11:18:15.503705+0000","last_undegraded":"2024-05-10T11:18:15.503705+0000","last_fullsized":"2024-05-10T11:18:15.503705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:46:46.194162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503636+0000","last_change":"2024-05-10T11:18:14.501099+0000","last_active":"2024-05-10T11:18:15.503636+0000","last_peered":"2024-05-10T11:18:15.503636+0000","last_clean":"2024-05-10T11:18:15.503636+0000","last_became_active":"2024-05-10T11:18:14.500491+0000","last_became_peered":"2024-05-10T11:18:14.500491+0000","last_unstale":"2024-05-10T11:18:15.503636+0000","last_undegraded":"2024-05-10T11:18:15.503636+0000","last_fullsized":"2024-05-10T11:18:15.503636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:47.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500360+0000","last_change":"2024-05-10T11:18:13.496261+0000","last_active":"2024-05-10T11:18:15.500360+0000","last_peered":"2024-05-10T11:18:15.500360+0000","last_clean":"2024-05-10T11:18:15.500360+0000","last_became_active":"2024-05-10T11:18:13.496010+0000","last_became_peered":"2024-05-10T11:18:13.496010+0000","last_unstale":"2024-05-10T11:18:15.500360+0000","last_undegraded":"2024-05-10T11:18:15.500360+0000","last_fullsized":"2024-05-10T11:18:15.500360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:12:25.142075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503941+0000","last_change":"2024-05-10T11:18:14.508367+0000","last_active":"2024-05-10T11:18:15.503941+0000","last_peered":"2024-05-10T11:18:15.503941+0000","last_clean":"2024-05-10T11:18:15.503941+0000","last_became_active":"2024-05-10T11:18:14.508114+0000","last_became_peered":"2024-05-10T11:18:14.508114+0000","last_unstale":"2024-05-10T11:18:15.503941+0000","last_undegraded":"2024-05-10T11:18:15.503941+0000","last_fullsized":"2024-05-10T11:18:15.503941+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:18.672654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503746+0000","last_change":"2024-05-10T11:18:13.493893+0000","last_active":"2024-05-10T11:18:15.503746+0000","last_peered":"2024-05-10T11:18:15.503746+0000","last_clean":"2024-05-10T11:18:15.503746+0000","last_became_active":"2024-05-10T11:18:13.493661+0000","last_became_peered":"2024-05-10T11:18:13.493661+0000","last_unstale":"2024-05-10T11:18:15.503746+0000","last_undegraded":"2024-05-10T11:18:15.503746+0000","last_fullsized":"2024-05-10T11:18:15.503746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:21.825243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589340+0000","last_change":"2024-05-10T11:18:14.508876+0000","last_active":"2024-05-10T11:18:15.589340+0000","last_peered":"2024-05-10T11:18:15.589340+0000","last_clean":"2024-05-10T11:18:15.589340+0000","last_became_active":"2024-05-10T11:18:14.508599+0000","last_became_peered":"2024-05-10T11:18:14.508599+0000","last_unstale":"2024-05-10T11:18:15.589340+0000","last_undegraded":"2024-05-10T11:18:15.589340+0000","last_fullsized":"2024-05-10T11:18:15.589340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:49.671324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500251+0000","last_change":"2024-05-10T11:18:13.488510+0000","last_active":"2024-05-10T11:18:15.500251+0000","last_peered":"2024-05-10T11:18:15.500251+0000","last_clean":"2024-05-10T11:18:15.500251+0000","last_became_active":"2024-05-10T11:18:13.488224+0000","last_became_peered":"2024-05-10T11:18:13.488224+0000","last_unstale":"2024-05-10T11:18:15.500251+0000","last_undegraded":"2024-05-10T11:18:15.500251+0000","last_fullsized":"2024-05-10T11:18:15.500251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:57.771228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589800+0000","last_change":"2024-05-10T11:18:14.501699+0000","last_active":"2024-05-10T11:18:15.589800+0000","last_peered":"2024-05-10T11:18:15.589800+0000","last_clean":"2024-05-10T11:18:15.589800+0000","last_became_active":"2024-05-10T11:18:14.501427+0000","last_became_peered":"2024-05-10T11:18:14.501427+0000","last_unstale":"2024-05-10T11:18:15.589800+0000","last_undegraded":"2024-05-10T11:18:15.589800+0000","last_fullsized":"2024-05-10T11:18:15.589800+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:59:16.770065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589955+0000","last_change":"2024-05-10T11:18:13.486115+0000","last_active":"2024-05-10T11:18:15.589955+0000","last_peered":"2024-05-10T11:18:15.589955+0000","last_clean":"2024-05-10T11:18:15.589955+0000","last_became_active":"2024-05-10T11:18:13.485827+0000","last_became_peered":"2024-05-10T11:18:13.485827+0000","last_unstale":"2024-05-10T11:18:15.589955+0000","last_undegraded":"2024-05-10T11:18:15.589955+0000","last_fullsized":"2024-05-10T11:18:15.589955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:25.005139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589621+0000","last_change":"2024-05-10T11:18:14.508776+0000","last_active":"2024-05-10T11:18:15.589621+0000","last_peered":"2024-05-10T11:18:15.589621+0000","last_clean":"2024-05-10T11:18:15.589621+0000","last_became_active":"2024-05-10T11:18:14.507883+0000","last_became_peered":"2024-05-10T11:18:14.507883+0000","last_unstale":"2024-05-10T11:18:15.589621+0000","last_undegraded":"2024-05-10T11:18:15.589621+0000","last_fullsized":"2024-05-10T11:18:15.589621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:41:09.728598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501211+0000","last_change":"2024-05-10T11:18:13.486261+0000","last_active":"2024-05-10T11:18:15.501211+0000","last_peered":"2024-05-10T11:18:15.501211+0000","last_clean":"2024-05-10T11:18:15.501211+0000","last_became_active":"2024-05-10T11:18:13.485612+0000","last_became_peered":"2024-05-10T11:18:13.485612+0000","last_unstale":"2024-05-10T11:18:15.501211+0000","last_undegraded":"2024-05-10T11:18:15.501211+0000","last_fullsized":"2024-05-10T11:18:15.501211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:10.012519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589573+0000","last_change":"2024-05-10T11:18:14.503515+0000","last_active":"2024-05-10T11:18:15.589573+0000","last_peered":"2024-05-10T11:18:15.589573+0000","last_clean":"2024-05-10T11:18:15.589573+0000","last_became_active":"2024-05-10T11:18:14.503224+0000","last_became_peered":"2024-05-10T11:18:14.503224+0000","last_unstale":"2024-05-10T11:18:15.589573+0000","last_undegraded":"2024-05-10T11:18:15.589573+0000","last_fullsized":"2024-05-10T11:18:15.589573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:32.860740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.501403+0000","last_change":"2024-05-10T11:18:13.486384+0000","last_active":"2024-05-10T11:18:15.501403+0000","last_peered":"2024-05-10T11:18:15.501403+0000","last_clean":"2024-05-10T11:18:15.501403+0000","last_became_active":"2024-05-10T11:18:13.486083+0000","last_became_peered":"2024-05-10T11:18:13.486083+0000","last_unstale":"2024-05-10T11:18:15.501403+0000","last_undegraded":"2024-05-10T11:18:15.501403+0000","last_fullsized":"2024-05-10T11:18:15.501403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:57:04.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.503986+0000","last_change":"2024-05-10T11:18:14.505472+0000","last_active":"2024-05-10T11:18:15.503986+0000","last_peered":"2024-05-10T11:18:15.503986+0000","last_clean":"2024-05-10T11:18:15.503986+0000","last_became_active":"2024-05-10T11:18:14.505178+0000","last_became_peered":"2024-05-10T11:18:14.505178+0000","last_unstale":"2024-05-10T11:18:15.503986+0000","last_undegraded":"2024-05-10T11:18:15.503986+0000","last_fullsized":"2024-05-10T11:18:15.503986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:05.754282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589830+0000","last_change":"2024-05-10T11:18:13.485497+0000","last_active":"2024-05-10T11:18:15.589830+0000","last_peered":"2024-05-10T11:18:15.589830+0000","last_clean":"2024-05-10T11:18:15.589830+0000","last_became_active":"2024-05-10T11:18:13.484458+0000","last_became_peered":"2024-05-10T11:18:13.484458+0000","last_unstale":"2024-05-10T11:18:15.589830+0000","last_undegraded":"2024-05-10T11:18:15.589830+0000","last_fullsized":"2024-05-10T11:18:15.589830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:24.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.500292+0000","last_change":"2024-05-10T11:18:14.505021+0000","last_active":"2024-05-10T11:18:15.500292+0000","last_peered":"2024-05-10T11:18:15.500292+0000","last_clean":"2024-05-10T11:18:15.500292+0000","last_became_active":"2024-05-10T11:18:14.504766+0000","last_became_peered":"2024-05-10T11:18:14.504766+0000","last_unstale":"2024-05-10T11:18:15.500292+0000","last_undegraded":"2024-05-10T11:18:15.500292+0000","last_fullsized":"2024-05-10T11:18:15.500292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590044+0000","last_change":"2024-05-10T11:18:13.492021+0000","last_active":"2024-05-10T11:18:15.590044+0000","last_peered":"2024-05-10T11:18:15.590044+0000","last_clean":"2024-05-10T11:18:15.590044+0000","last_became_active":"2024-05-10T11:18:13.491360+0000","last_became_peered":"2024-05-10T11:18:13.491360+0000","last_unstale":"2024-05-10T11:18:15.590044+0000","last_undegraded":"2024-05-10T11:18:15.590044+0000","last_fullsized":"2024-05-10T11:18:15.590044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:04.747286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589257+0000","last_change":"2024-05-10T11:18:14.492959+0000","last_active":"2024-05-10T11:18:15.589257+0000","last_peered":"2024-05-10T11:18:15.589257+0000","last_clean":"2024-05-10T11:18:15.589257+0000","last_became_active":"2024-05-10T11:18:14.492664+0000","last_became_peered":"2024-05-10T11:18:14.492664+0000","last_unstale":"2024-05-10T11:18:15.589257+0000","last_undegraded":"2024-05-10T11:18:15.589257+0000","last_fullsized":"2024-05-10T11:18:15.589257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:43.612123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.504029+0000","last_change":"2024-05-10T11:18:13.487280+0000","last_active":"2024-05-10T11:18:15.504029+0000","last_peered":"2024-05-10T11:18:15.504029+0000","last_clean":"2024-05-10T11:18:15.504029+0000","last_became_active":"2024-05-10T11:18:13.487022+0000","last_became_peered":"2024-05-10T11:18:13.487022+0000","last_unstale":"2024-05-10T11:18:15.504029+0000","last_undegraded":"2024-05-10T11:18:15.504029+0000","last_fullsized":"2024-05-10T11:18:15.504029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:13:46.801147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589295+0000","last_change":"2024-05-10T11:18:14.507864+0000","last_active":"2024-05-10T11:18:15.589295+0000","last_peered":"2024-05-10T11:18:15.589295+0000","last_clean":"2024-05-10T11:18:15.589295+0000","last_became_active":"2024-05-10T11:18:14.507238+0000","last_became_peered":"2024-05-10T11:18:14.507238+0000","last_unstale":"2024-05-10T11:18:15.589295+0000","last_undegraded":"2024-05-10T11:18:15.589295+0000","last_fullsized":"2024-05-10T11:18:15.589295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:36.046820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589540+0000","last_change":"2024-05-10T11:18:13.484685+0000","last_active":"2024-05-10T11:18:15.589540+0000","last_peered":"2024-05-10T11:18:15.589540+0000","last_clean":"2024-05-10T11:18:15.589540+0000","last_became_active":"2024-05-10T11:18:13.484358+0000","last_became_peered":"2024-05-10T11:18:13.484358+0000","last_unstale":"2024-05-10T11:18:15.589540+0000","last_undegraded":"2024-05-10T11:18:15.589540+0000","last_fullsized":"2024-05-10T11:18:15.589540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:06.024110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590001+0000","last_change":"2024-05-10T11:18:14.509858+0000","last_active":"2024-05-10T11:18:15.590001+0000","last_peered":"2024-05-10T11:18:15.590001+0000","last_clean":"2024-05-10T11:18:15.590001+0000","last_became_active":"2024-05-10T11:18:14.509560+0000","last_became_peered":"2024-05-10T11:18:14.509560+0000","last_unstale":"2024-05-10T11:18:15.590001+0000","last_undegraded":"2024-05-10T11:18:15.590001+0000","last_fullsized":"2024-05-10T11:18:15.590001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:22.114478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589426+0000","last_change":"2024-05-10T11:18:13.490373+0000","last_active":"2024-05-10T11:18:15.589426+0000","last_peered":"2024-05-10T11:18:15.589426+0000","last_clean":"2024-05-10T11:18:15.589426+0000","last_became_active":"2024-05-10T11:18:13.490094+0000","last_became_peered":"2024-05-10T11:18:13.490094+0000","last_unstale":"2024-05-10T11:18:15.589426+0000","last_undegraded":"2024-05-10T11:18:15.589426+0000","last_fullsized":"2024-05-10T11:18:15.589426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:02:31.935203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589840+0000","last_change":"2024-05-10T11:18:14.498690+0000","last_active":"2024-05-10T11:18:15.589840+0000","last_peered":"2024-05-10T11:18:15.589840+0000","last_clean":"2024-05-10T11:18:15.589840+0000","last_became_active":"2024-05-10T11:18:14.497818+0000","last_became_peered":"2024-05-10T11:18:14.497818+0000","last_unstale":"2024-05-10T11:18:15.589840+0000","last_undegraded":"2024-05-10T11:18:15.589840+0000","last_fullsized":"2024-05-10T11:18:15.589840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:13.469868+0000","last_clean_scrub_stamp":"2024-05-10T11:18:13.469868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:34.589373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.590498+0000","last_change":"2024-05-10T11:18:13.495136+0000","last_active":"2024-05-10T11:18:15.590498+0000","last_peered":"2024-05-10T11:18:15.590498+0000","last_clean":"2024-05-10T11:18:15.590498+0000","last_became_active":"2024-05-10T11:18:13.494834+0000","last_became_peered":"2024-05-10T11:18:13.494834+0000","last_unstale":"2024-05-10T11:18:15.590498+0000","last_undegraded":"2024-05-10T11:18:15.590498+0000","last_fullsized":"2024-05-10T11:18:15.590498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:18:12.462872+0000","last_clean_scrub_stamp":"2024-05-10T11:18:12.462872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:09.195125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":235,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T11:18:15.589552+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:18:15.589552+0000","last_peered":"2024-05-10T11:18:15.589552+0000","last_clean":"2024-05-10T11:18:15.589552+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:18:15.589552+0000","last_undegraded":"2024-05-10T11:18:15.589552+0000","last_fullsized":"2024-05-10T11:18:15.589552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1679360,"data_stored":1083012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":494804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":492748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":492658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1695744,"data_stored":1085274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":492588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:18:23.396 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:18:23.396 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:18:23.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.542+0000 7f510d623640 1 Processor -- start 2024-05-10T11:18:23.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.542+0000 7f510d623640 1 -- start start 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f510d623640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f51080d3df0 0x7f51080d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f510d623640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f51080b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f510d623640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080d41d0 con 0x7f51080d1a10 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f510d623640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f51080cfd50 con 0x7f51080d3df0 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f510d623640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f51080b5d90 con 0x7f51080b4aa0 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f51077fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f51080d1a10 0x7f51080d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:42632/0 (socket says 172.21.15.66:42632) 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.543+0000 7f51077fe640 1 -- 172.21.15.66:0/2786749597 learned_addr learned my addr 172.21.15.66:0/2786749597 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587476076 0 0) 0x7f51080d41d0 con 0x7f51080d1a10 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5106ffd640 1 --2- 172.21.15.66:0/2786749597 >> v2:172.21.15.190:3300/0 conn(0x7f51080d3df0 0x7f51080d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f4003520 con 0x7f51080d1a10 2024-05-10T11:18:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f51080b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3180901197 0 0) 0x7f50f4003520 con 0x7f51080d1a10 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 msgr2=0x7f51080b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f51080b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 >> v2:172.21.15.190:3300/0 conn(0x7f51080d3df0 msgr2=0x7f51080d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 --2- 172.21.15.66:0/2786749597 >> v2:172.21.15.190:3300/0 conn(0x7f51080d3df0 0x7f51080d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080b54f0 con 0x7f51080d1a10 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f5100001670 con 0x7f51080d1a10 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 >> v1:172.21.15.66:6789/0 conn(0x7f51080d1a10 legacy=0x7f51080d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50f40039b0 0x7f50f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f50f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50f4004d40 0x7f50f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b5d90 con 0x7f50f40039b0 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50f400b9c0 con 0x7f50f4004d40 2024-05-10T11:18:23.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50f400bb40 con 0x7f51080b4aa0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f50f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51077fe640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50f4004d40 0x7f50f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 -- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50f4004d40 msgr2=0x7f50f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50f4004d40 0x7f50f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 -- 172.21.15.66:0/2786749597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50f40039b0 msgr2=0x7f50f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50f40039b0 0x7f50f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.544+0000 7f51067fc640 1 -- 172.21.15.66:0/2786749597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f4003520 con 0x7f51080b4aa0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.545+0000 7f51067fc640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f50f4004800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009ac0 tx=0x7f50f4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952d22e737eaf1fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.545+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0036070 con 0x7f51080b4aa0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.545+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0031400 con 0x7f51080b4aa0 2024-05-10T11:18:23.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.545+0000 7f5105ffb640 1 -- 172.21.15.66:0/2786749597 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0009690 con 0x7f51080b4aa0 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f510d623640 1 -- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 msgr2=0x7f50f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f510d623640 1 --2- 172.21.15.66:0/2786749597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51080b4aa0 0x7f50f4004800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009ac0 tx=0x7f50f4005830 comp rx=0 tx=0).stop 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f51077fe640 1 -- 172.21.15.66:0/2786749597 reap_dead start 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f510d623640 1 -- 172.21.15.66:0/2786749597 shutdown_connections 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f510d623640 1 -- 172.21.15.66:0/2786749597 >> 172.21.15.66:0/2786749597 conn(0x7f510809e450 msgr2=0x7f51080d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f510d623640 1 -- 172.21.15.66:0/2786749597 shutdown_connections 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.546+0000 7f510d623640 1 -- 172.21.15.66:0/2786749597 wait complete. 2024-05-10T11:18:23.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.547+0000 7f510d623640 1 Processor -- start 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.547+0000 7f510d623640 1 -- start start 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f510d623640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 0x7f510814e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f510d623640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f510814e680 0x7f51080c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f510d623640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51080ca030 0x7f51080ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f510d623640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f51080cff80 con 0x7f51080b4aa0 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f510d623640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b5ab0 con 0x7f51080ca030 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f510d623640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f51080b6120 con 0x7f510814e680 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 0x7f510814e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 0x7f510814e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36258/0 (socket says 172.21.15.66:36258) 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 -- 172.21.15.66:0/3354392620 learned_addr learned my addr 172.21.15.66:0/3354392620 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f51077fe640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51080ca030 0x7f51080ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f51067fc640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f510814e680 0x7f51080c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 -- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f510814e680 msgr2=0x7f51080c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f510814e680 0x7f51080c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 -- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51080ca030 msgr2=0x7f51080ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.548+0000 7f5106ffd640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51080ca030 0x7f51080ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f5106ffd640 1 -- 172.21.15.66:0/3354392620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5108158960 con 0x7f51080b4aa0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f5106ffd640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 0x7f510814e140 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009db0 tx=0x7f50f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8018020 con 0x7f51080b4aa0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8014480 con 0x7f51080b4aa0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510815bc50 con 0x7f51080b4aa0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8014870 con 0x7f51080b4aa0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.549+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51080b81e0 con 0x7f51080b4aa0 2024-05-10T11:18:23.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.550+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51080b7cf0 con 0x7f51080b4aa0 2024-05-10T11:18:23.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.550+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50f8005d10 con 0x7f51080b4aa0 2024-05-10T11:18:23.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.551+0000 7f50ff7fe640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50e8076300 0x7f50e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.551+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f50f80981a0 con 0x7f51080b4aa0 2024-05-10T11:18:23.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.551+0000 7f51067fc640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50e8076300 0x7f50e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.552+0000 7f51067fc640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50e8076300 0x7f50e80787c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009ac0 tx=0x7f50f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.555+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f50f8022070 con 0x7f51080b4aa0 2024-05-10T11:18:23.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.831+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f51080d27c0 con 0x7f51080b4aa0 2024-05-10T11:18:23.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.832+0000 7f50ff7fe640 1 -- 172.21.15.66:0/3354392620 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f50f8010040 con 0x7f51080b4aa0 2024-05-10T11:18:23.833 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:18:23.833 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:18:23.833 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:18:23.833 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:18:23.833 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:18:23.833 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.834+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50e8076300 msgr2=0x7f50e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.834+0000 7f510d623640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50e8076300 0x7f50e80787c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009ac0 tx=0x7f50f0008030 comp rx=0 tx=0).stop 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.834+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 msgr2=0x7f510814e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.834+0000 7f510d623640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 0x7f510814e140 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009db0 tx=0x7f50f800c490 comp rx=0 tx=0).stop 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.834+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 shutdown_connections 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50e8076300 0x7f50e80787c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51080ca030 0x7f51080ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f510814e680 0x7f51080c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 --2- 172.21.15.66:0/3354392620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51080b4aa0 0x7f510814e140 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 >> 172.21.15.66:0/3354392620 conn(0x7f510809e450 msgr2=0x7f51080d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:23.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 shutdown_connections 2024-05-10T11:18:23.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.835+0000 7f510d623640 1 -- 172.21.15.66:0/3354392620 wait complete. 2024-05-10T11:18:23.846 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:23.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.950+0000 7fc4a5093640 1 Processor -- start 2024-05-10T11:18:23.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.950+0000 7fc4a5093640 1 -- start start 2024-05-10T11:18:23.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.950+0000 7fc4a5093640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 0x7fc4a00c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc4a5093640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a00cd090 con 0x7fc4a01611e0 2024-05-10T11:18:23.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc4a5093640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a00cd370 con 0x7fc4a015ce60 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc4a5093640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a00cb790 con 0x7fc4a00cb300 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49e59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc4a01611e0 0x7fc4a015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:42648/0 (socket says 172.21.15.66:42648) 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49e59c640 1 -- 172.21.15.66:0/4200413122 learned_addr learned my addr 172.21.15.66:0/4200413122 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808918292 0 0) 0x7fc4a00cd090 con 0x7fc4a01611e0 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc488003520 con 0x7fc4a01611e0 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49f59e640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 0x7fc4a00c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4206790732 0 0) 0x7fc488003520 con 0x7fc4a01611e0 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 msgr2=0x7fc4a00c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 0x7fc4a00c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 >> v1:172.21.15.190:6789/0 conn(0x7fc4a015ce60 legacy=0x7fc4a0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a00cd650 con 0x7fc4a01611e0 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fc494001670 con 0x7fc4a01611e0 2024-05-10T11:18:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 >> v1:172.21.15.66:6789/0 conn(0x7fc4a01611e0 legacy=0x7fc4a015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 0x7fc4880039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc488004010 0x7fc488004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc48800bbd0 con 0x7fc488004d40 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc48800bd80 con 0x7fc488004010 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc48800bf80 con 0x7fc4a00cb300 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49f59e640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49ed9d640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 0x7fc4880039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.951+0000 7fc49e59c640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc488004010 0x7fc488004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.952+0000 7fc49f59e640 1 -- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 msgr2=0x7fc4880039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.952+0000 7fc49f59e640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a00cb300 0x7fc4880039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.952+0000 7fc49f59e640 1 -- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc488004010 msgr2=0x7fc488004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.952+0000 7fc49f59e640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc488004010 0x7fc488004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.952+0000 7fc49f59e640 1 -- 172.21.15.66:0/4200413122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc488003520 con 0x7fc488004d40 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.952+0000 7fc49f59e640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4880051c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc498007360 tx=0x7fc488005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328d1af4d195e0f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498009be0 con 0x7fc488004d40 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498036600 con 0x7fc488004d40 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc49dd9b640 1 -- 172.21.15.66:0/4200413122 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4980369d0 con 0x7fc488004d40 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc4a5093640 1 -- 172.21.15.66:0/4200413122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 msgr2=0x7fc4880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc4a5093640 1 --2- 172.21.15.66:0/4200413122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4880051c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc498007360 tx=0x7fc488005830 comp rx=0 tx=0).stop 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc49f59e640 1 -- 172.21.15.66:0/4200413122 reap_dead start 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc4a5093640 1 -- 172.21.15.66:0/4200413122 shutdown_connections 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc4a5093640 1 -- 172.21.15.66:0/4200413122 >> 172.21.15.66:0/4200413122 conn(0x7fc4a00b2900 msgr2=0x7fc4a00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc4a5093640 1 -- 172.21.15.66:0/4200413122 shutdown_connections 2024-05-10T11:18:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.953+0000 7fc4a5093640 1 -- 172.21.15.66:0/4200413122 wait complete. 2024-05-10T11:18:23.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 Processor -- start 2024-05-10T11:18:23.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 -- start start 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4a01f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4a00d15e0 0x7fc4a0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a009e440 0x7fc4a009e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00cde50 con 0x7fc488004d40 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00ccd60 con 0x7fc4a00d15e0 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.955+0000 7fc4a5093640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a00cdfd0 con 0x7fc4a009e440 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4a01f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4a01f29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36274/0 (socket says 172.21.15.66:36274) 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 -- 172.21.15.66:0/2864295536 learned_addr learned my addr 172.21.15.66:0/2864295536 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49e59c640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4a00d15e0 0x7fc4a0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49f59e640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a009e440 0x7fc4a009e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 -- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a009e440 msgr2=0x7fc4a009e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a009e440 0x7fc4a009e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 -- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4a00d15e0 msgr2=0x7fc4a0157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4a00d15e0 0x7fc4a0157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 -- 172.21.15.66:0/2864295536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a00ca7b0 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49e59c640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4a00d15e0 0x7fc4a0157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc49ed9d640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4a01f29e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc49000f820 tx=0x7fc49000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4900050d0 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc490018070 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490005490 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a01f3110 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.956+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a01f36d0 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.957+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a006a220 con 0x7fc488004d40 2024-05-10T11:18:23.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.958+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc49000d650 con 0x7fc488004d40 2024-05-10T11:18:23.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.958+0000 7fc4877fe640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc48c076300 0x7fc48c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:23.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.959+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fc4900974f0 con 0x7fc488004d40 2024-05-10T11:18:23.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.959+0000 7fc49e59c640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc48c076300 0x7fc48c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:23.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.959+0000 7fc49e59c640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc48c076300 0x7fc48c0787c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00b0400 tx=0x7fc494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:23.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:23.963+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc490060cc0 con 0x7fc488004d40 2024-05-10T11:18:24.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.193+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a00b2eb0 con 0x7fc488004d40 2024-05-10T11:18:24.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.194+0000 7fc4877fe640 1 -- 172.21.15.66:0/2864295536 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5186 (secure 0 0 0) 0x7fc4900605c0 con 0x7fc488004d40 2024-05-10T11:18:24.194 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:24.194 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6867,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:16.882525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6873},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6873":{"gid":6873,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/1519468735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1519468735},{"type":"v1","addr":"172.21.15.190:6837","nonce":1519468735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873]},"id":6}]} 2024-05-10T11:18:24.195 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-05-10T11:18:24.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc48c076300 msgr2=0x7fc48c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc48c076300 0x7fc48c0787c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00b0400 tx=0x7fc494009040 comp rx=0 tx=0).stop 2024-05-10T11:18:24.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 msgr2=0x7fc4a01f29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4a01f29e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc49000f820 tx=0x7fc49000fce0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 shutdown_connections 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc48c076300 0x7fc48c0787c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4a009e440 0x7fc4a009e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4a00d15e0 0x7fc4a0157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 --2- 172.21.15.66:0/2864295536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc488004d40 0x7fc4a01f29e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 >> 172.21.15.66:0/2864295536 conn(0x7fc4a00b2900 msgr2=0x7fc4a015eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 shutdown_connections 2024-05-10T11:18:24.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.196+0000 7fc4a5093640 1 -- 172.21.15.66:0/2864295536 wait complete. 2024-05-10T11:18:24.610 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:18:16.882525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6873}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6873': {'gid': 6873, 'name': 'd', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.190:6837/1519468735', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6835', 'nonce': 1519468735}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 1519468735}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6873, 'qdb_cluster': [6873]} 2024-05-10T11:18:24.610 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:18:24.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-10T11:18:24.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.718+0000 7f5ae0215640 1 Processor -- start 2024-05-10T11:18:24.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.718+0000 7f5ae0215640 1 -- start start 2024-05-10T11:18:24.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ae0215640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5ad81598c0 0x7f5ad806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ae0215640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad806ec40 0x7f5ad80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ae0215640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5ad80c71c0 0x7f5ad815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ae0215640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad806f1c0 con 0x7f5ad80c71c0 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ae0215640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad806f4a0 con 0x7f5ad81598c0 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ae0215640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad806f780 con 0x7f5ad806ec40 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5ad80c71c0 0x7f5ad815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5ad80c71c0 0x7f5ad815fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41334/0 (socket says 172.21.15.66:41334) 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 -- 172.21.15.66:0/856950184 learned_addr learned my addr 172.21.15.66:0/856950184 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 -- 172.21.15.66:0/856950184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad806ec40 msgr2=0x7f5ad80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/856950184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad806ec40 0x7f5ad80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 -- 172.21.15.66:0/856950184 >> v2:172.21.15.190:3300/0 conn(0x7f5ad81598c0 msgr2=0x7f5ad806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/856950184 >> v2:172.21.15.190:3300/0 conn(0x7f5ad81598c0 0x7f5ad806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.719+0000 7f5ade7b2640 1 -- 172.21.15.66:0/856950184 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad806fa60 con 0x7f5ad80c71c0 2024-05-10T11:18:24.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.720+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/856950184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80c71c0 0x7f5ad815fa30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b3930 tx=0x7f5ad002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5667af7988c544d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.720+0000 7f5adcfaf640 1 -- 172.21.15.66:0/856950184 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0036070 con 0x7f5ad80c71c0 2024-05-10T11:18:24.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.720+0000 7f5adcfaf640 1 -- 172.21.15.66:0/856950184 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad0031600 con 0x7f5ad80c71c0 2024-05-10T11:18:24.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.720+0000 7f5adcfaf640 1 -- 172.21.15.66:0/856950184 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00319d0 con 0x7f5ad80c71c0 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 -- 172.21.15.66:0/856950184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80c71c0 msgr2=0x7f5ad815fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 --2- 172.21.15.66:0/856950184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80c71c0 0x7f5ad815fa30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b3930 tx=0x7f5ad002a6a0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 -- 172.21.15.66:0/856950184 shutdown_connections 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 --2- 172.21.15.66:0/856950184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80c71c0 0x7f5ad815fa30 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 --2- 172.21.15.66:0/856950184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad806ec40 0x7f5ad80c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 --2- 172.21.15.66:0/856950184 >> v2:172.21.15.190:3300/0 conn(0x7f5ad81598c0 0x7f5ad806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 -- 172.21.15.66:0/856950184 >> 172.21.15.66:0/856950184 conn(0x7f5ad80b2900 msgr2=0x7f5ad80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 -- 172.21.15.66:0/856950184 shutdown_connections 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.721+0000 7f5ae0215640 1 -- 172.21.15.66:0/856950184 wait complete. 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.722+0000 7f5ae0215640 1 Processor -- start 2024-05-10T11:18:24.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.722+0000 7f5ae0215640 1 -- start start 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ae0215640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 0x7f5ad815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ae0215640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad80c71c0 0x7f5ad80b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ae0215640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad81598c0 0x7f5ad80ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ae0215640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8159ca0 con 0x7f5ad806ec40 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ae0215640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad815c6e0 con 0x7f5ad80c71c0 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ae0215640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad8159e20 con 0x7f5ad81598c0 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 0x7f5ad815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 0x7f5ad815d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41336/0 (socket says 172.21.15.66:41336) 2024-05-10T11:18:24.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 -- 172.21.15.66:0/709442240 learned_addr learned my addr 172.21.15.66:0/709442240 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5add7b0640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad80c71c0 0x7f5ad80b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad81598c0 0x7f5ad80ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 -- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad81598c0 msgr2=0x7f5ad80ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad81598c0 0x7f5ad80ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 -- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad80c71c0 msgr2=0x7f5ad80b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad80c71c0 0x7f5ad80b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5addfb1640 1 -- 172.21.15.66:0/709442240 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80b1350 con 0x7f5ad806ec40 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.723+0000 7f5add7b0640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad80c71c0 0x7f5ad80b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.724+0000 7f5addfb1640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 0x7f5ad815d5e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400b4a0 tx=0x7f5ad400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.724+0000 7f5ace7fc640 1 -- 172.21.15.66:0/709442240 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4014070 con 0x7f5ad806ec40 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.724+0000 7f5ace7fc640 1 -- 172.21.15.66:0/709442240 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4010610 con 0x7f5ad806ec40 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.724+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad80ae640 con 0x7f5ad806ec40 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.724+0000 7f5ace7fc640 1 -- 172.21.15.66:0/709442240 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4010a00 con 0x7f5ad806ec40 2024-05-10T11:18:24.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.724+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad815dfa0 con 0x7f5ad806ec40 2024-05-10T11:18:24.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.726+0000 7f5ace7fc640 1 -- 172.21.15.66:0/709442240 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5ad4017070 con 0x7f5ad806ec40 2024-05-10T11:18:24.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.727+0000 7f5ace7fc640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5abc0762d0 0x7f5abc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.727+0000 7f5ace7fc640 1 -- 172.21.15.66:0/709442240 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f5ad40970e0 con 0x7f5ad806ec40 2024-05-10T11:18:24.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.727+0000 7f5add7b0640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5abc0762d0 0x7f5abc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.727+0000 7f5ae300a740 1 Processor -- start 2024-05-10T11:18:24.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.727+0000 7f5ae300a740 1 -- start start 2024-05-10T11:18:24.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.727+0000 7f5add7b0640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5abc0762d0 0x7f5abc078790 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b0510 tx=0x7f5ac8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f76225d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f761f5bb0 0x564f761fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f762418b0 0x564f76241d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ae300a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564f7615f8d0 con 0x564f76225950 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f76118c10 con 0x564f762418b0 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564f7615b890 con 0x564f761f5bb0 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5addfb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f76225d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5addfb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f76225d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41338/0 (socket says 172.21.15.66:41338) 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5addfb1640 1 -- 172.21.15.66:0/1168980671 learned_addr learned my addr 172.21.15.66:0/1168980671 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5add7b0640 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f761f5bb0 0x564f761fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.728+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f762418b0 0x564f76241d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5addfb1640 1 -- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f761f5bb0 msgr2=0x564f761fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5addfb1640 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f761f5bb0 0x564f761fbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5addfb1640 1 -- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f762418b0 msgr2=0x564f76241d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5addfb1640 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f762418b0 0x564f76241d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5addfb1640 1 -- 172.21.15.66:0/1168980671 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f761205d0 con 0x564f76225950 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5addfb1640 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f76225d30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5ad405c2c0 tx=0x7f5ad405fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6315fc6ee4893152 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5abb7fe640 1 -- 172.21.15.66:0/1168980671 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad401e040 con 0x564f76225950 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5abb7fe640 1 -- 172.21.15.66:0/1168980671 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad40645f0 con 0x564f76225950 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5abb7fe640 1 -- 172.21.15.66:0/1168980671 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4064370 con 0x564f76225950 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5ae300a740 1 -- 172.21.15.66:0/1168980671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 msgr2=0x564f76225d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.729+0000 7f5ae300a740 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f76225d30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5ad405c2c0 tx=0x7f5ad405fe90 comp rx=0 tx=0).stop 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 -- 172.21.15.66:0/1168980671 shutdown_connections 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f762418b0 0x564f76241d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f761f5bb0 0x564f761fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 --2- 172.21.15.66:0/1168980671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f76225d30 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 -- 172.21.15.66:0/1168980671 >> 172.21.15.66:0/1168980671 conn(0x564f761f7e20 msgr2=0x564f76240760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 -- 172.21.15.66:0/1168980671 shutdown_connections 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 -- 172.21.15.66:0/1168980671 wait complete. 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 -- start start 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.730+0000 7f5ae300a740 1 Processor -- start 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f762204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f762418b0 0x564f76227310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76247f50 0x564f76227850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564f761fc120 con 0x564f76225950 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f7611c760 con 0x564f76247f50 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564f761fb750 con 0x564f762418b0 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5ae300a740 10 client.0 _ll_register_callbacks cb 0x564f76155cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5addfb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f762204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5addfb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f762204d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41350/0 (socket says 172.21.15.66:41350) 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.731+0000 7f5addfb1640 1 -- 172.21.15.66:0/84848141 learned_addr learned my addr 172.21.15.66:0/84848141 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5addfb1640 1 -- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f762418b0 msgr2=0x564f76227310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5addfb1640 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f762418b0 0x564f76227310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5addfb1640 1 -- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76247f50 msgr2=0x564f76227850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5addfb1640 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76247f50 0x564f76227850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5addfb1640 1 -- 172.21.15.66:0/84848141 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f75e712d0 con 0x564f76225950 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5addfb1640 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f762204d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400be60 tx=0x7f5ad400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7d8fe150edc5ad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ab8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/84848141 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad401e040 con 0x564f76225950 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/84848141 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f5ad4010ba0 con 0x564f76225950 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ad40645f0 con 0x564f76225950 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/84848141 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f5ad4069010 con 0x564f76225950 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 10 client.7005 fetch_fsmap learned FSMap version 63 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x564f75f3b6b0 con 0x564f76225950 2024-05-10T11:18:24.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/84848141 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad40645f0 con 0x564f76225950 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/84848141 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 3494+0+0 (secure 0 0 0) 0x7f5ad405f4a0 con 0x564f76225950 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 10 client.7005 fetch_fsmap finished waiting for FSMap version 63 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 10 client.7005 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 20 client.7005 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76260a10 0x564f76262e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 4 client.7005 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.732+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 --> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f760e3760 con 0x564f76260a10 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.733+0000 7f5add7b0640 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76260a10 0x564f76262e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.733+0000 7f5ab8ff9640 10 client.7005 ms_handle_connect on v2:172.21.15.190:6835/1519468735 2024-05-10T11:18:24.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.733+0000 7f5add7b0640 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76260a10 0x564f76262e00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10b5abf5cbaaa97 server_cookie=f2fc429553018b18 in_seq=0 out_seq=0 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/84848141 <== mds.0 v2:172.21.15.190:6835/1519468735 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f760e3760 con 0x564f76260a10 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ab8ff9640 10 client.7005 handle_command_reply: tid=0 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 client.7005 shutdown 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 msgr2=0x564f762204d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f762204d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400be60 tx=0x7f5ad400bf90 comp rx=0 tx=0).stop 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 shutdown_connections 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76260a10 0x564f76262e00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76247f50 0x564f76227850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ab8ff9640 0 client.7005 ms_handle_reset on v2:172.21.15.190:6835/1519468735 2024-05-10T11:18:24.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f762418b0 0x564f76227310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 --2- 172.21.15.66:0/84848141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f76225950 0x564f762204d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 >> 172.21.15.66:0/84848141 conn(0x564f761f5bb0 msgr2=0x564f76240ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 shutdown_connections 2024-05-10T11:18:24.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 1 -- 172.21.15.66:0/84848141 wait complete. 2024-05-10T11:18:24.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.734+0000 7f5ae300a740 20 client.7005 trim_cache size 0 max 16384 2024-05-10T11:18:24.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.753+0000 7f5ae300a740 1 Processor -- start 2024-05-10T11:18:24.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.753+0000 7f5ae300a740 1 -- start start 2024-05-10T11:18:24.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f761fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f76243410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ae300a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81681c0 con 0x564f762418b0 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8138ac0 con 0x564f76225950 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad81512c0 con 0x564f76247f50 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41366/0 (socket says 172.21.15.66:41366) 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 -- 172.21.15.66:0/4048485729 learned_addr learned my addr 172.21.15.66:0/4048485729 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5addfb1640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f761fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f76243410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 -- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 msgr2=0x564f76243410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f76243410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 -- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 msgr2=0x564f761fa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f761fa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5add7b0640 1 -- 172.21.15.66:0/4048485729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7624d070 con 0x564f762418b0 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5addfb1640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f761fa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.754+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f76243410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5add7b0640 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242ed0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009610 tx=0x7f5ac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fe11f74aa641fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5abaffd640 1 -- 172.21.15.66:0/4048485729 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8022910 con 0x564f762418b0 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5abaffd640 1 -- 172.21.15.66:0/4048485729 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8022ab0 con 0x564f762418b0 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5abaffd640 1 -- 172.21.15.66:0/4048485729 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8022c60 con 0x564f762418b0 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 -- 172.21.15.66:0/4048485729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 msgr2=0x564f76242ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242ed0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009610 tx=0x7f5ac80046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 -- 172.21.15.66:0/4048485729 shutdown_connections 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f76243410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242ed0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 --2- 172.21.15.66:0/4048485729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f761fa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 -- 172.21.15.66:0/4048485729 >> 172.21.15.66:0/4048485729 conn(0x564f761f5bb0 msgr2=0x564f762202e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 -- 172.21.15.66:0/4048485729 shutdown_connections 2024-05-10T11:18:24.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.755+0000 7f5ae300a740 1 -- 172.21.15.66:0/4048485729 wait complete. 2024-05-10T11:18:24.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.756+0000 7f5ae300a740 1 -- start start 2024-05-10T11:18:24.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.756+0000 7f5ae300a740 1 Processor -- start 2024-05-10T11:18:24.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f76221b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f762406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564f76226df0 con 0x564f762418b0 2024-05-10T11:18:24.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f761fc120 con 0x564f76225950 2024-05-10T11:18:24.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564f76228950 con 0x564f76247f50 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ae300a740 10 client.0 _ll_register_callbacks cb 0x7f5ad4078070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41382/0 (socket says 172.21.15.66:41382) 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 -- 172.21.15.66:0/2607581183 learned_addr learned my addr 172.21.15.66:0/2607581183 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5addfb1640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f76221b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f762406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 -- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 msgr2=0x564f762406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f762406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 -- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 msgr2=0x564f76221b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f76221b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 -- 172.21.15.66:0/2607581183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f761fbf50 con 0x564f762418b0 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5addfb1640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f76221b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ade7b2640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f762406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:24.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5add7b0640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242070 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5ac802a000 tx=0x7f5ad401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be804230b2f505c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.757+0000 7f5ab8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/2607581183 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8022910 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/2607581183 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f5ac8005d30 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac8022ab0 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/2607581183 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f5ac8006040 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 10 client.7011 fetch_fsmap learned FSMap version 63 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x564f762447b0 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/2607581183 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8022ab0 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/2607581183 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 3494+0+0 (secure 0 0 0) 0x7f5ac8039070 con 0x564f762418b0 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 10 client.7011 fetch_fsmap finished waiting for FSMap version 63 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 10 client.7011 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 20 client.7011 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:24.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76240f00 0x564f76226df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 4 client.7011 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 --> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] -- command(tid 0: {"prefix": "status"}) -- 0x564f7616d4e0 con 0x564f76240f00 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.758+0000 7f5addfb1640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76240f00 0x564f76226df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ab8ff9640 10 client.7011 ms_handle_connect on v2:172.21.15.190:6835/1519468735 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5addfb1640 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76240f00 0x564f76226df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90abd67dc070da5d server_cookie=a8fb781987287e65 in_seq=0 out_seq=0 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ab8ff9640 1 -- 172.21.15.66:0/2607581183 <== mds.0 v2:172.21.15.190:6835/1519468735 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x564f7616d4e0 con 0x564f76240f00 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ab8ff9640 10 client.7011 handle_command_reply: tid=0 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 client.7011 shutdown 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 msgr2=0x564f76242070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242070 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5ac802a000 tx=0x7f5ad401b000 comp rx=0 tx=0).stop 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 shutdown_connections 2024-05-10T11:18:24.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:6835/1519468735,v1:172.21.15.190:6837/1519468735] conn(0x564f76240f00 0x564f76226df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564f76247f50 0x564f762406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564f762418b0 0x564f76242070 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 --2- 172.21.15.66:0/2607581183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f76225950 0x564f76221b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ab8ff9640 0 client.7011 ms_handle_reset on v2:172.21.15.190:6835/1519468735 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 >> 172.21.15.66:0/2607581183 conn(0x564f761f5bb0 msgr2=0x564f76266220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 shutdown_connections 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 1 -- 172.21.15.66:0/2607581183 wait complete. 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.759+0000 7f5ae300a740 20 client.7011 trim_cache size 0 max 16384 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:18:24.767 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 6873, 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 10.266796337000001, 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 63, 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 88, 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 88, 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 15.246895789 2024-05-10T11:18:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:18:24.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5abc0762d0 msgr2=0x7f5abc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5abc0762d0 0x7f5abc078790 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b0510 tx=0x7f5ac8008040 comp rx=0 tx=0).stop 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 msgr2=0x7f5ad815d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 0x7f5ad815d5e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400b4a0 tx=0x7f5ad400b960 comp rx=0 tx=0).stop 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 shutdown_connections 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5abc0762d0 0x7f5abc078790 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad81598c0 0x7f5ad80ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad80c71c0 0x7f5ad80b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 --2- 172.21.15.66:0/709442240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad806ec40 0x7f5ad815d5e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 >> 172.21.15.66:0/709442240 conn(0x7f5ad80b2900 msgr2=0x7f5ad8157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 shutdown_connections 2024-05-10T11:18:24.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.760+0000 7f5ae0215640 1 -- 172.21.15.66:0/709442240 wait complete. 2024-05-10T11:18:24.772 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:18:24.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.875+0000 7fcc109af640 1 Processor -- start 2024-05-10T11:18:24.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.875+0000 7fcc109af640 1 -- start start 2024-05-10T11:18:24.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc109af640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcc0c0cb300 0x7fcc0c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc109af640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0c0cd090 con 0x7fcc0c1611e0 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc109af640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0c0cd370 con 0x7fcc0c15ce60 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc109af640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fcc0c0cb790 con 0x7fcc0c0cb300 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc0ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcc0c0cb300 0x7fcc0c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc0ad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcc0c0cb300 0x7fcc0c0c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41384/0 (socket says 172.21.15.66:41384) 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/2846500750 learned_addr learned my addr 172.21.15.66:0/2846500750 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc09d9b640 1 --1- 172.21.15.66:0/2846500750 >> v1:172.21.15.66:6789/0 conn(0x7fcc0c1611e0 0x7fcc0c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58796/0 (socket says 172.21.15.66:58796) 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/2846500750 >> v1:172.21.15.190:6789/0 conn(0x7fcc0c15ce60 legacy=0x7fcc0c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/2846500750 >> v1:172.21.15.66:6789/0 conn(0x7fcc0c1611e0 legacy=0x7fcc0c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.876+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/2846500750 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c0cd650 con 0x7fcc0c0cb300 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.877+0000 7fcc0ad9d640 1 --2- 172.21.15.66:0/2846500750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c0cb300 0x7fcc0c0c65f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009e50 tx=0x7fcc0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c715aad3a5b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.877+0000 7fcc0959a640 1 -- 172.21.15.66:0/2846500750 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04036070 con 0x7fcc0c0cb300 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.877+0000 7fcc0959a640 1 -- 172.21.15.66:0/2846500750 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04031600 con 0x7fcc0c0cb300 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.877+0000 7fcc0959a640 1 -- 172.21.15.66:0/2846500750 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040319d0 con 0x7fcc0c0cb300 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 -- 172.21.15.66:0/2846500750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c0cb300 msgr2=0x7fcc0c0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 --2- 172.21.15.66:0/2846500750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c0cb300 0x7fcc0c0c65f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009e50 tx=0x7fcc0402a730 comp rx=0 tx=0).stop 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 -- 172.21.15.66:0/2846500750 shutdown_connections 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 --2- 172.21.15.66:0/2846500750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c0cb300 0x7fcc0c0c65f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 -- 172.21.15.66:0/2846500750 >> 172.21.15.66:0/2846500750 conn(0x7fcc0c0b2900 msgr2=0x7fcc0c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:24.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 -- 172.21.15.66:0/2846500750 shutdown_connections 2024-05-10T11:18:24.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.878+0000 7fcc109af640 1 -- 172.21.15.66:0/2846500750 wait complete. 2024-05-10T11:18:24.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.879+0000 7fcc109af640 1 Processor -- start 2024-05-10T11:18:24.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.879+0000 7fcc109af640 1 -- start start 2024-05-10T11:18:24.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc109af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc0c0cb300 0x7fcc0c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc109af640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc0c15ce60 0x7fcc0c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc109af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 0x7fcc0c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc109af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c0cde50 con 0x7fcc0c1611e0 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc109af640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c0ccd60 con 0x7fcc0c15ce60 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc109af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c0cdfd0 con 0x7fcc0c0cb300 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 0x7fcc0c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 0x7fcc0c0b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41386/0 (socket says 172.21.15.66:41386) 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/140311774 learned_addr learned my addr 172.21.15.66:0/140311774 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc09d9b640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc0c15ce60 0x7fcc0c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0a59c640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc0c0cb300 0x7fcc0c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc0c0cb300 msgr2=0x7fcc0c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc0c0cb300 0x7fcc0c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc0c15ce60 msgr2=0x7fcc0c0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc0c15ce60 0x7fcc0c0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0ad9d640 1 -- 172.21.15.66:0/140311774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c09bac0 con 0x7fcc0c1611e0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc09d9b640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc0c15ce60 0x7fcc0c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.880+0000 7fcc0a59c640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc0c0cb300 0x7fcc0c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.881+0000 7fcc0ad9d640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 0x7fcc0c0b4fc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcc04034040 tx=0x7fcc04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.881+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04036050 con 0x7fcc0c1611e0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.881+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04042070 con 0x7fcc0c1611e0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.881+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04009510 con 0x7fcc0c1611e0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.881+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c09bd30 con 0x7fcc0c1611e0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.881+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c09c2f0 con 0x7fcc0c1611e0 2024-05-10T11:18:24.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.882+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0c06a220 con 0x7fcc0c1611e0 2024-05-10T11:18:24.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.882+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc04007bf0 con 0x7fcc0c1611e0 2024-05-10T11:18:24.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.883+0000 7fcbfaffd640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbec0762d0 0x7fcbec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:24.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.883+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fcc040b8600 con 0x7fcc0c1611e0 2024-05-10T11:18:24.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.883+0000 7fcc0a59c640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbec0762d0 0x7fcbec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:24.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.884+0000 7fcc0a59c640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbec0762d0 0x7fcbec078790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c15f8d0 tx=0x7fcbfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:24.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:24.887+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcc04081e60 con 0x7fcc0c1611e0 2024-05-10T11:18:25.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.119+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc0c075250 con 0x7fcc0c1611e0 2024-05-10T11:18:25.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.119+0000 7fcbfaffd640 1 -- 172.21.15.66:0/140311774 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) ==== 53+0+73 (secure 0 0 0) 0x7fcc04081760 con 0x7fcc0c1611e0 2024-05-10T11:18:25.120 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbec0762d0 msgr2=0x7fcbec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbec0762d0 0x7fcbec078790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c15f8d0 tx=0x7fcbfc009040 comp rx=0 tx=0).stop 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 msgr2=0x7fcc0c0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 0x7fcc0c0b4fc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcc04034040 tx=0x7fcc04004a40 comp rx=0 tx=0).stop 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 shutdown_connections 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbec0762d0 0x7fcbec078790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc0c1611e0 0x7fcc0c0b4fc0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc0c15ce60 0x7fcc0c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 --2- 172.21.15.66:0/140311774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc0c0cb300 0x7fcc0c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 >> 172.21.15.66:0/140311774 conn(0x7fcc0c0b2900 msgr2=0x7fcc0c15d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:25.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 shutdown_connections 2024-05-10T11:18:25.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25.121+0000 7fcc109af640 1 -- 172.21.15.66:0/140311774 wait complete. 2024-05-10T11:18:25.132 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:18:25.132 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:18:25.133 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:18:25.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.133 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:18:25.150 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:18:25.150 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:18:25.150 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:18:25.150 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.150 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:18:25.151 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:18:25.152 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:18:25.153 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.153 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:18:25.153 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:18:25.153 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:18:25.153 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:25.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.153 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:18:25.214 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:18:25.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.216 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:18:25.273 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:18:25.273 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:18:25.273 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:18:25.273 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:18:25.273 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:18:25.273 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:18:25.274 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:18:25.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:18:25.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:18:25.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:18:25.274 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:18:25.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:18:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:18:25.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.403 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:18:25.418 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:18:25.418 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:18:25.419 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:18:25.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.419 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:18:25.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:18:25.486 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:25.542 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:18:25.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:18:25.542 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:25.599 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:18:25.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.601 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:25.684 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:25.684 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:18:25.684 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:18:25.693 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:25.693 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:18:25.693 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:18:25.693 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:18:25.693 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:18:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:18:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:18:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:18:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:18:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:18:25.699 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:18:25.701 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:18:25.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:25.727 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:18:25.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:18:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:18:25.833 INFO:teuthology.orchestra.run.smithi066.stdout:client5834 2024-05-10T11:18:25.833 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:18:25.834 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:25.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.850 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-05-10T11:18:25.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.913 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-05-10T11:18:25.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:25.971 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-05-10T11:18:26.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:26.029 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-05-10T11:18:26.090 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:18:26.090 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:18:26.090 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:18:26.090 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:18:26.090 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-05-10T11:18:26.090 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:18:26.198 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:18:26.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:18:26.211 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:18:26.211 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:26.268 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:18:26.268 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:26.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:18:26.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.468+0000 7ff0820d1640 1 Processor -- start 2024-05-10T11:18:26.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.468+0000 7ff0820d1640 1 -- start start 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.469+0000 7ff0820d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff07c072ef0 0x7ff07c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.469+0000 7ff0820d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 0x7ff07c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.469+0000 7ff0820d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07c0cbb40 con 0x7ff07c15ce10 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.469+0000 7ff0820d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff07c0cbe20 con 0x7ff07c072ef0 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.469+0000 7ff0820d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff07c0d0e60 con 0x7ff07c15d1f0 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 0x7ff07c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff07c072ef0 0x7ff07c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07b7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff07c15ce10 0x7ff07c0727e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:45410/0 (socket says 172.21.15.66:45410) 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07b7fe640 1 -- 172.21.15.66:0/573510248 learned_addr learned my addr 172.21.15.66:0/573510248 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:26.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 0x7ff07c1616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:39856/0 (socket says 172.21.15.66:39856) 2024-05-10T11:18:26.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07affd640 1 -- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 msgr2=0x7ff07c1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:26.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07affd640 1 --2- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 0x7ff07c1616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07affd640 1 -- 172.21.15.66:0/573510248 >> v1:172.21.15.190:6789/0 conn(0x7ff07c15ce10 legacy=0x7ff07c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07affd640 1 -- 172.21.15.66:0/573510248 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c0d1140 con 0x7ff07c072ef0 2024-05-10T11:18:26.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07a7fc640 1 -- 172.21.15.66:0/573510248 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271768041 0 0) 0x7ff07c0cbb40 con 0x7ff07c15ce10 2024-05-10T11:18:26.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.470+0000 7ff07bfff640 1 --2- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 0x7ff07c1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff07affd640 1 --2- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c072ef0 0x7ff07c06d4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff0700097a0 tx=0x7ff07002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56154d7248cb597f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff07a7fc640 1 -- 172.21.15.66:0/573510248 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070037070 con 0x7ff07c072ef0 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff07a7fc640 1 -- 172.21.15.66:0/573510248 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070032440 con 0x7ff07c072ef0 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff07a7fc640 1 -- 172.21.15.66:0/573510248 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070032810 con 0x7ff07c072ef0 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff0820d1640 1 -- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c072ef0 msgr2=0x7ff07c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff0820d1640 1 --2- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c072ef0 0x7ff07c06d4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff0700097a0 tx=0x7ff07002a180 comp rx=0 tx=0).stop 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff0820d1640 1 -- 172.21.15.66:0/573510248 shutdown_connections 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff0820d1640 1 --2- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c15d1f0 0x7ff07c1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.471+0000 7ff0820d1640 1 --2- 172.21.15.66:0/573510248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c072ef0 0x7ff07c06d4e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.472+0000 7ff0820d1640 1 -- 172.21.15.66:0/573510248 >> 172.21.15.66:0/573510248 conn(0x7ff07c0d14f0 msgr2=0x7ff07c0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.472+0000 7ff0820d1640 1 -- 172.21.15.66:0/573510248 shutdown_connections 2024-05-10T11:18:26.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.472+0000 7ff0820d1640 1 -- 172.21.15.66:0/573510248 wait complete. 2024-05-10T11:18:26.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.473+0000 7ff0820d1640 1 Processor -- start 2024-05-10T11:18:26.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.473+0000 7ff0820d1640 1 -- start start 2024-05-10T11:18:26.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff0820d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c072ef0 0x7ff07c1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff0820d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 0x7ff07c1e8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff0820d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c15d1f0 0x7ff07c1e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff0820d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c0cdc00 con 0x7ff07c15ce10 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff0820d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c0cda80 con 0x7ff07c15d1f0 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff0820d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff07c0cf3f0 con 0x7ff07c072ef0 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 0x7ff07c1e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 0x7ff07c1e8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41402/0 (socket says 172.21.15.66:41402) 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 -- 172.21.15.66:0/553888913 learned_addr learned my addr 172.21.15.66:0/553888913 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07b7fe640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c072ef0 0x7ff07c1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07bfff640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c15d1f0 0x7ff07c1e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 -- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c072ef0 msgr2=0x7ff07c1f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c072ef0 0x7ff07c1f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 -- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c15d1f0 msgr2=0x7ff07c1e8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c15d1f0 0x7ff07c1e8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 -- 172.21.15.66:0/553888913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c0cb2a0 con 0x7ff07c15ce10 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff07affd640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 0x7ff07c1e8770 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff070035040 tx=0x7ff0700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.474+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070037050 con 0x7ff07c15ce10 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.475+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070038040 con 0x7ff07c15ce10 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.475+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c0cb580 con 0x7ff07c15ce10 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.475+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070004490 con 0x7ff07c15ce10 2024-05-10T11:18:26.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.475+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c155c10 con 0x7ff07c15ce10 2024-05-10T11:18:26.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.476+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07c0d18d0 con 0x7ff07c15ce10 2024-05-10T11:18:26.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.476+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff070003610 con 0x7ff07c15ce10 2024-05-10T11:18:26.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.477+0000 7ff063fff640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0680762d0 0x7ff068078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.477+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7ff0700b8030 con 0x7ff07c15ce10 2024-05-10T11:18:26.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.477+0000 7ff07b7fe640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0680762d0 0x7ff068078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.478+0000 7ff07b7fe640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0680762d0 0x7ff068078790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff06c000f60 tx=0x7ff06c007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:26.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.481+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff07c0d18d0 con 0x7ff07c15ce10 2024-05-10T11:18:26.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.686+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff07c0693f0 con 0x7ff07c15ce10 2024-05-10T11:18:26.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.686+0000 7ff063fff640 1 -- 172.21.15.66:0/553888913 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) ==== 80+0+0 (secure 0 0 0) 0x7ff070081810 con 0x7ff07c15ce10 2024-05-10T11:18:26.687 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0680762d0 msgr2=0x7ff068078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0680762d0 0x7ff068078790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff06c000f60 tx=0x7ff06c007d50 comp rx=0 tx=0).stop 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 msgr2=0x7ff07c1e8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 0x7ff07c1e8770 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff070035040 tx=0x7ff0700046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 shutdown_connections 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff0680762d0 0x7ff068078790 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff07c15d1f0 0x7ff07c1e8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c15ce10 0x7ff07c1e8770 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 --2- 172.21.15.66:0/553888913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff07c072ef0 0x7ff07c1f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.688+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 >> 172.21.15.66:0/553888913 conn(0x7ff07c0d14f0 msgr2=0x7ff07c0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:26.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.689+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 shutdown_connections 2024-05-10T11:18:26.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.689+0000 7ff0820d1640 1 -- 172.21.15.66:0/553888913 wait complete. 2024-05-10T11:18:26.700 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:18:26.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:26.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:26.755 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:18:26.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:26.756 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:18:26.782 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:26.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.929+0000 7f9eecc64640 1 Processor -- start 2024-05-10T11:18:26.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.929+0000 7f9eecc64640 1 -- start start 2024-05-10T11:18:26.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9eecc64640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9ee815f4e0 0x7f9ee806d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9eecc64640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ee815f8c0 0x7f9ee806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9eecc64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee806e450 0x7f9ee80afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9eecc64640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee80b23f0 con 0x7f9ee815f8c0 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9eecc64640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee80b4150 con 0x7f9ee815f4e0 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9eecc64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee806e8c0 con 0x7f9ee806e450 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ee815f8c0 0x7f9ee806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ee815f8c0 0x7f9ee806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41418/0 (socket says 172.21.15.66:41418) 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 -- 172.21.15.66:0/506371190 learned_addr learned my addr 172.21.15.66:0/506371190 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee659c640 1 --2- 172.21.15.66:0/506371190 >> v2:172.21.15.190:3300/0 conn(0x7f9ee815f4e0 0x7f9ee806d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee6d9d640 1 --2- 172.21.15.66:0/506371190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee806e450 0x7f9ee80afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 -- 172.21.15.66:0/506371190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee806e450 msgr2=0x7f9ee80afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 --2- 172.21.15.66:0/506371190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee806e450 0x7f9ee80afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 -- 172.21.15.66:0/506371190 >> v2:172.21.15.190:3300/0 conn(0x7f9ee815f4e0 msgr2=0x7f9ee806d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 --2- 172.21.15.66:0/506371190 >> v2:172.21.15.190:3300/0 conn(0x7f9ee815f4e0 0x7f9ee806d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee5d9b640 1 -- 172.21.15.66:0/506371190 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee80b3540 con 0x7f9ee815f8c0 2024-05-10T11:18:26.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.930+0000 7f9ee659c640 1 --2- 172.21.15.66:0/506371190 >> v2:172.21.15.190:3300/0 conn(0x7f9ee815f4e0 0x7f9ee806d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:26.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.931+0000 7f9ee5d9b640 1 --2- 172.21.15.66:0/506371190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee815f8c0 0x7f9ee806df10 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8068c10 tx=0x7f9edc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88df41e3cf42ce33 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:26.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.931+0000 7f9ee559a640 1 -- 172.21.15.66:0/506371190 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc037070 con 0x7f9ee815f8c0 2024-05-10T11:18:26.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.931+0000 7f9ee559a640 1 -- 172.21.15.66:0/506371190 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9edc032440 con 0x7f9ee815f8c0 2024-05-10T11:18:26.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.931+0000 7f9ee559a640 1 -- 172.21.15.66:0/506371190 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc032810 con 0x7f9ee815f8c0 2024-05-10T11:18:26.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 -- 172.21.15.66:0/506371190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee815f8c0 msgr2=0x7f9ee806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 --2- 172.21.15.66:0/506371190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee815f8c0 0x7f9ee806df10 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8068c10 tx=0x7f9edc02a140 comp rx=0 tx=0).stop 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 -- 172.21.15.66:0/506371190 shutdown_connections 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 --2- 172.21.15.66:0/506371190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee806e450 0x7f9ee80afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 --2- 172.21.15.66:0/506371190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee815f8c0 0x7f9ee806df10 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 --2- 172.21.15.66:0/506371190 >> v2:172.21.15.190:3300/0 conn(0x7f9ee815f4e0 0x7f9ee806d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 -- 172.21.15.66:0/506371190 >> 172.21.15.66:0/506371190 conn(0x7f9ee80d2df0 msgr2=0x7f9ee80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 -- 172.21.15.66:0/506371190 shutdown_connections 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.932+0000 7f9eecc64640 1 -- 172.21.15.66:0/506371190 wait complete. 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.933+0000 7f9eecc64640 1 Processor -- start 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.933+0000 7f9eecc64640 1 -- start start 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9eecc64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 0x7f9ee81549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9eecc64640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ee815f4e0 0x7f9ee80c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9eecc64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee815f8c0 0x7f9ee81f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9eecc64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80b3de0 con 0x7f9ee806e450 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9eecc64640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80b3b00 con 0x7f9ee815f4e0 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9eecc64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee80b45e0 con 0x7f9ee815f8c0 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9ee659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 0x7f9ee81549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9ee659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 0x7f9ee81549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41422/0 (socket says 172.21.15.66:41422) 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9ee659c640 1 -- 172.21.15.66:0/1415238425 learned_addr learned my addr 172.21.15.66:0/1415238425 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9ee5d9b640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ee815f4e0 0x7f9ee80c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.934+0000 7f9ee6d9d640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee815f8c0 0x7f9ee81f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ee659c640 1 -- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee815f8c0 msgr2=0x7f9ee81f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ee659c640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee815f8c0 0x7f9ee81f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ee659c640 1 -- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ee815f4e0 msgr2=0x7f9ee80c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ee659c640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ee815f4e0 0x7f9ee80c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ee659c640 1 -- 172.21.15.66:0/1415238425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee81f5ce0 con 0x7f9ee806e450 2024-05-10T11:18:26.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ee659c640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 0x7f9ee81549c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800d800 tx=0x7f9ed800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:26.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8004030 con 0x7f9ee806e450 2024-05-10T11:18:26.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed80041d0 con 0x7f9ee806e450 2024-05-10T11:18:26.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80096a0 con 0x7f9ee806e450 2024-05-10T11:18:26.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee81f5fc0 con 0x7f9ee806e450 2024-05-10T11:18:26.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.935+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee80c7890 con 0x7f9ee806e450 2024-05-10T11:18:26.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.936+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee806a220 con 0x7f9ee806e450 2024-05-10T11:18:26.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.937+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ed8009840 con 0x7f9ee806e450 2024-05-10T11:18:26.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.937+0000 7f9ed6ffd640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ec80762d0 0x7f9ec8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:26.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.937+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f9ed80978d0 con 0x7f9ee806e450 2024-05-10T11:18:26.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.937+0000 7f9ee5d9b640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ec80762d0 0x7f9ec8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:26.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.938+0000 7f9ee5d9b640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ec80762d0 0x7f9ec8078790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9edc034000 tx=0x7f9edc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:26.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:26.941+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9ed8060a50 con 0x7f9ee806e450 2024-05-10T11:18:27.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.171+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ee80b1600 con 0x7f9ee806e450 2024-05-10T11:18:27.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.172+0000 7f9ed6ffd640 1 -- 172.21.15.66:0/1415238425 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5186 (secure 0 0 0) 0x7f9ed8064d50 con 0x7f9ee806e450 2024-05-10T11:18:27.172 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:27.172 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6867,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:16.882525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6873},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6873":{"gid":6873,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/1519468735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1519468735},{"type":"v1","addr":"172.21.15.190:6837","nonce":1519468735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873]},"id":6}]} 2024-05-10T11:18:27.173 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ec80762d0 msgr2=0x7f9ec8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ec80762d0 0x7f9ec8078790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9edc034000 tx=0x7f9edc02e000 comp rx=0 tx=0).stop 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 msgr2=0x7f9ee81549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 0x7f9ee81549c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800d800 tx=0x7f9ed800dcc0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 shutdown_connections 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ec80762d0 0x7f9ec8078790 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ee815f8c0 0x7f9ee81f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ee815f4e0 0x7f9ee80c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 --2- 172.21.15.66:0/1415238425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ee806e450 0x7f9ee81549c0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 >> 172.21.15.66:0/1415238425 conn(0x7f9ee80d2df0 msgr2=0x7f9ee8071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 shutdown_connections 2024-05-10T11:18:27.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.174+0000 7f9eecc64640 1 -- 172.21.15.66:0/1415238425 wait complete. 2024-05-10T11:18:27.186 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-05-10T11:18:27.321 INFO:teuthology.orchestra.run.smithi190.stdout:{"message":"","return_code":0} 2024-05-10T11:18:27.321 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:18:27.322 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:18:27.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.427+0000 7f0fcb0d1640 1 Processor -- start 2024-05-10T11:18:27.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.427+0000 7f0fcb0d1640 1 -- start start 2024-05-10T11:18:27.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.427+0000 7f0fcb0d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40d5d30 0x7f0fc416a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.427+0000 7f0fcb0d1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc40d30b0 con 0x7f0fc415f3b0 2024-05-10T11:18:27.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.427+0000 7f0fcb0d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc40d3390 con 0x7f0fc415f790 2024-05-10T11:18:27.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.427+0000 7f0fcb0d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc40c8c80 con 0x7f0fc40d5d30 2024-05-10T11:18:27.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc8e6d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0fc415f3b0 0x7f0fc40d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58798/0 (socket says 172.21.15.66:58798) 2024-05-10T11:18:27.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc8e6d640 1 -- 172.21.15.66:0/2159313318 learned_addr learned my addr 172.21.15.66:0/2159313318 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc966e640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40d5d30 0x7f0fc416a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75817525 0 0) 0x7f0fc40d30b0 con 0x7f0fc415f3b0 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb4003520 con 0x7f0fc415f3b0 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288708912 0 0) 0x7f0fc40d3390 con 0x7f0fc415f790 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc40d30b0 con 0x7f0fc415f790 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2483833986 0 0) 0x7f0fb4003520 con 0x7f0fc415f3b0 2024-05-10T11:18:27.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40d5d30 msgr2=0x7f0fc416a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40d5d30 0x7f0fc416a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 >> v1:172.21.15.190:6789/0 conn(0x7f0fc415f790 legacy=0x7f0fc40cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc40c8f60 con 0x7f0fc415f3b0 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f0fb8001670 con 0x7f0fc415f3b0 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 >> v1:172.21.15.66:6789/0 conn(0x7f0fc415f3b0 legacy=0x7f0fc40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fb4003b70 0x7f0fb4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb4004800 0x7f0fb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb40051c0 0x7f0fb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40c8c80 con 0x7f0fb4004800 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb400bfb0 con 0x7f0fb40051c0 2024-05-10T11:18:27.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb400c1b0 con 0x7f0fb4003b70 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc966e640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40d5d30 0x7f0fc416a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb4004800 0x7f0fb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.428+0000 7f0fc8e6d640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fb4003b70 0x7f0fb4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc966e640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb40051c0 0x7f0fb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc3fff640 1 -- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fb4003b70 msgr2=0x7f0fb4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fb4003b70 0x7f0fb4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc3fff640 1 -- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb40051c0 msgr2=0x7f0fb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb40051c0 0x7f0fb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc3fff640 1 -- 172.21.15.66:0/2159313318 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb4003520 con 0x7f0fb4004800 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.429+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb4004800 0x7f0fb4004c80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001890 tx=0x7f0fb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607f13e66bec1db5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00014e0 con 0x7f0fb4004800 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb00052f0 con 0x7f0fb4004800 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fc37fe640 1 -- 172.21.15.66:0/2159313318 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb002ac60 con 0x7f0fb4004800 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/2159313318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb4004800 msgr2=0x7f0fb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/2159313318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb4004800 0x7f0fb4004c80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001890 tx=0x7f0fb4005830 comp rx=0 tx=0).stop 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fc966e640 1 -- 172.21.15.66:0/2159313318 reap_dead start 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/2159313318 shutdown_connections 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/2159313318 >> 172.21.15.66:0/2159313318 conn(0x7f0fc40d5130 msgr2=0x7f0fc40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/2159313318 shutdown_connections 2024-05-10T11:18:27.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.430+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/2159313318 wait complete. 2024-05-10T11:18:27.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.431+0000 7f0fcb0d1640 1 Processor -- start 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.431+0000 7f0fcb0d1640 1 -- start start 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fcb0d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb4004800 0x7f0fc4154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fcb0d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 0x7f0fc40b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fcb0d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc41f52b0 0x7f0fc4161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fcb0d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40d3f80 con 0x7f0fc40d1e80 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fcb0d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40d3e00 con 0x7f0fb4004800 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fcb0d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc40ca770 con 0x7f0fc41f52b0 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.432+0000 7f0fc3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 0x7f0fc40b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 0x7f0fc40b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41436/0 (socket says 172.21.15.66:41436) 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 -- 172.21.15.66:0/1790538173 learned_addr learned my addr 172.21.15.66:0/1790538173 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc8e6d640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb4004800 0x7f0fc4154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc966e640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc41f52b0 0x7f0fc4161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 -- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc41f52b0 msgr2=0x7f0fc4161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc41f52b0 0x7f0fc4161d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 -- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb4004800 msgr2=0x7f0fc4154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb4004800 0x7f0fc4154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 -- 172.21.15.66:0/1790538173 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc40b8490 con 0x7f0fc40d1e80 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc966e640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc41f52b0 0x7f0fc4161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc3fff640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 0x7f0fc40b7d20 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0008fd0 tx=0x7f0fb00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0007a50 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0041070 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc40b8770 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00054a0 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.433+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc40b8d30 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.434+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc406a220 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.435+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fb00067d0 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.435+0000 7f0fc17fa640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0fa80764a0 0x7f0fa8078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.435+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f0fb00b7a60 con 0x7f0fc40d1e80 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.436+0000 7f0fc8e6d640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0fa80764a0 0x7f0fa8078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.436+0000 7f0fc8e6d640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0fa80764a0 0x7f0fa8078960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8001050 tx=0x7f0fb8001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.440+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0fb00811a0 con 0x7f0fc40d1e80 2024-05-10T11:18:27.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.670+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0fc40d4be0 con 0x7f0fc40d1e80 2024-05-10T11:18:27.671 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:18:27.671+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:18:27.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.672+0000 7f0fc17fa640 1 -- 172.21.15.66:0/1790538173 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f0fb0080aa0 con 0x7f0fc40d1e80 2024-05-10T11:18:27.672 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:18:27.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0fa80764a0 msgr2=0x7f0fa8078960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0fa80764a0 0x7f0fa8078960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8001050 tx=0x7f0fb8001e20 comp rx=0 tx=0).stop 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 msgr2=0x7f0fc40b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 0x7f0fc40b7d20 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0008fd0 tx=0x7f0fb00012d0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 shutdown_connections 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0fa80764a0 0x7f0fa8078960 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc41f52b0 0x7f0fc4161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40d1e80 0x7f0fc40b7d20 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 --2- 172.21.15.66:0/1790538173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fb4004800 0x7f0fc4154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 >> 172.21.15.66:0/1790538173 conn(0x7f0fc40d5130 msgr2=0x7f0fc406e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 shutdown_connections 2024-05-10T11:18:27.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.674+0000 7f0fcb0d1640 1 -- 172.21.15.66:0/1790538173 wait complete. 2024-05-10T11:18:27.678 INFO:tasks.ceph.mds.d.smithi190.stderr: -5152> 2024-05-10T11:18:16.468+0000 7f4791098640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:18:27.686 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-05-10T11:18:27.708 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:18:27.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 Processor -- start 2024-05-10T11:18:27.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 -- start start 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 0x55cba6fb0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6eeef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6fc4a30 0x55cba6eef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cba6f35fd0 con 0x55cba6f1e5b0 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cba6e95f50 con 0x55cba6fc1180 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe947595f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55cba6f36260 con 0x55cba6fc4a30 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.729+0000 7fe94508f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 0x55cba6fb0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 0x55cba6fb0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41446/0 (socket says 172.21.15.66:41446) 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 -- 172.21.15.66:0/3744505812 learned_addr learned my addr 172.21.15.66:0/3744505812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe93ffff640 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6eeef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe945890640 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6fc4a30 0x55cba6eef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 -- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6fc4a30 msgr2=0x55cba6eef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6fc4a30 0x55cba6eef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 -- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 msgr2=0x55cba6eeef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6eeef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 -- 172.21.15.66:0/3744505812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba6fb82c0 con 0x55cba6f1e5b0 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe94508f640 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 0x55cba6fb0aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe938001e90 tx=0x7fe93800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa419a50c906d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe93f7fe640 1 -- 172.21.15.66:0/3744505812 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938012020 con 0x55cba6f1e5b0 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe93f7fe640 1 -- 172.21.15.66:0/3744505812 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93800e670 con 0x55cba6f1e5b0 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.730+0000 7fe93f7fe640 1 -- 172.21.15.66:0/3744505812 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93800ea60 con 0x55cba6f1e5b0 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 -- 172.21.15.66:0/3744505812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 msgr2=0x55cba6fb0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 0x55cba6fb0aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe938001e90 tx=0x7fe93800b780 comp rx=0 tx=0).stop 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 -- 172.21.15.66:0/3744505812 shutdown_connections 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6fc4a30 0x55cba6eef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6eeef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 --2- 172.21.15.66:0/3744505812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6f1e5b0 0x55cba6fb0aa0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 -- 172.21.15.66:0/3744505812 >> 172.21.15.66:0/3744505812 conn(0x55cba6f18800 msgr2=0x55cba6fc0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 -- 172.21.15.66:0/3744505812 shutdown_connections 2024-05-10T11:18:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 -- 172.21.15.66:0/3744505812 wait complete. 2024-05-10T11:18:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 Processor -- start 2024-05-10T11:18:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.731+0000 7fe947595f40 1 -- start start 2024-05-10T11:18:27.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe947595f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6f1e5b0 0x55cba6fbc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe947595f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6fbcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe947595f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6fc4a30 0x55cba6fc26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe947595f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cba6eed580 con 0x55cba6fc4a30 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe947595f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cba6ef0a60 con 0x55cba6fc1180 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe947595f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55cba6ef0cb0 con 0x55cba6f1e5b0 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6fc4a30 0x55cba6fc26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe94508f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6f1e5b0 0x55cba6fbc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6fc4a30 0x55cba6fc26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41460/0 (socket says 172.21.15.66:41460) 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe94508f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6f1e5b0 0x55cba6fbc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:39936/0 (socket says 172.21.15.66:39936) 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 -- 172.21.15.66:0/2584184508 learned_addr learned my addr 172.21.15.66:0/2584184508 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe93ffff640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6fbcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 -- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6f1e5b0 msgr2=0x55cba6fbc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba6f1e5b0 0x55cba6fbc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 -- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 msgr2=0x55cba6fbcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba6fc1180 0x55cba6fbcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.732+0000 7fe945890640 1 -- 172.21.15.66:0/2584184508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba6fadb30 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.733+0000 7fe945890640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6fc4a30 0x55cba6fc26e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe940010690 tx=0x7fe940010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.733+0000 7fe93e7fc640 1 -- 172.21.15.66:0/2584184508 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940018020 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.733+0000 7fe93e7fc640 1 -- 172.21.15.66:0/2584184508 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94000d790 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.733+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cba6facf80 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.733+0000 7fe93e7fc640 1 -- 172.21.15.66:0/2584184508 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94000db80 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.733+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba6fae3e0 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.734+0000 7fe93e7fc640 1 -- 172.21.15.66:0/2584184508 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe94001b020 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe93e7fc640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe928074cb0 0x7fe928077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe93e7fc640 1 -- 172.21.15.66:0/2584184508 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fe940096c50 con 0x55cba6fc4a30 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe94508f640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe928074cb0 0x7fe928077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe947595f40 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55cba705d890 0x55cba705dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e89) -- 0x55cba6fbb430 con 0x55cba705d890 2024-05-10T11:18:27.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe93ffff640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55cba705d890 0x55cba705dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.735+0000 7fe94508f640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe928074cb0 0x7fe928077170 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe938001e90 tx=0x7fe938009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.736+0000 7fe93ffff640 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55cba705d890 0x55cba705dc70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.738+0000 7fe93ffff640 1 -- 172.21.15.66:0/2584184508 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v89'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe93004dba0 con 0x55cba705d890 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55cba705d890 msgr2=0x55cba705dc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55cba705d890 0x55cba705dc70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe928074cb0 msgr2=0x7fe928077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe928074cb0 0x7fe928077170 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe938001e90 tx=0x7fe938009000 comp rx=0 tx=0).stop 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6fc4a30 msgr2=0x55cba6fc26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 --2- 172.21.15.66:0/2584184508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cba6fc4a30 0x55cba6fc26e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe940010690 tx=0x7fe940010b50 comp rx=0 tx=0).stop 2024-05-10T11:18:27.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe945890640 1 -- 172.21.15.66:0/2584184508 reap_dead start 2024-05-10T11:18:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 shutdown_connections 2024-05-10T11:18:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 >> 172.21.15.66:0/2584184508 conn(0x55cba6f18800 msgr2=0x55cba6fbfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 shutdown_connections 2024-05-10T11:18:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.739+0000 7fe947595f40 1 -- 172.21.15.66:0/2584184508 wait complete. 2024-05-10T11:18:27.742 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-05-10T11:18:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.825+0000 7f6255c33280 1 -- start start 2024-05-10T11:18:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.825+0000 7f6255c33280 1 Processor -- start 2024-05-10T11:18:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c791e2000 0x563c791da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c78409c00 0x563c791db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6255c33280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 0x563c791dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6255c33280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c791fc000 con 0x563c791e2800 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563c791fc180 con 0x563c78409c00 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563c791fc300 con 0x563c791e2000 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 0x563c791dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 0x563c791dab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41478/0 (socket says 172.21.15.66:41478) 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 -- 172.21.15.66:0/1013684556 learned_addr learned my addr 172.21.15.66:0/1013684556 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6253bde640 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c78409c00 0x563c791db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f62543df640 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c791e2000 0x563c791da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 -- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c791e2000 msgr2=0x563c791da580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c791e2000 0x563c791da580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 -- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c78409c00 msgr2=0x563c791db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c78409c00 0x563c791db080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6254be0640 1 -- 172.21.15.66:0/1013684556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7843e780 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.826+0000 7f6253bde640 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c78409c00 0x563c791db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6254be0640 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 0x563c791dab00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x563c7923b830 tx=0x563c791aa180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b68b0f3ded25d13 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6251bda640 1 -- 172.21.15.66:0/1013684556 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842ed00 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6251bda640 1 -- 172.21.15.66:0/1013684556 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563c78434c40 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6251bda640 1 -- 172.21.15.66:0/1013684556 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842e680 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7843e000 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563c7843f680 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6255c33280 4 waiting for MDS map... 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6251bda640 1 -- 172.21.15.66:0/1013684556 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x563c792e0600 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6251bda640 1 -- 172.21.15.66:0/1013684556 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 2885+0+0 (secure 0 0 0) 0x563c78463180 con 0x563c791e2800 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6255c33280 4 Got MDS map 64 2024-05-10T11:18:27.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6255c33280 10 main: JournalTool::main 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.827+0000 7f6255c33280 4 main: JournalTool: connecting to RADOS... 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 Processor -- start 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 -- start start 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c791fc480 con 0x563c792e2c00 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563c791fc600 con 0x563c792e3000 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563c791fc780 con 0x563c792e3400 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6253bde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6253bde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41492/0 (socket says 172.21.15.66:41492) 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.828+0000 7f6253bde640 1 -- 172.21.15.66:0/2114103126 learned_addr learned my addr 172.21.15.66:0/2114103126 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f62543df640 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 -- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 msgr2=0x563c791dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 -- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e3000 msgr2=0x563c791db600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 -- 172.21.15.66:0/2114103126 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7843f860 con 0x563c792e2c00 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6253bde640 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 0x563c791da000 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x563c792fa630 tx=0x563c791a9f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb75a512e37e4490 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f624fbd6640 1 -- 172.21.15.66:0/2114103126 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842ed00 con 0x563c792e2c00 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f624fbd6640 1 -- 172.21.15.66:0/2114103126 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563c78434e00 con 0x563c792e2c00 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f624fbd6640 1 -- 172.21.15.66:0/2114103126 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842e680 con 0x563c792e2c00 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 -- 172.21.15.66:0/2114103126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 msgr2=0x563c791da000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 0x563c791da000 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x563c792fa630 tx=0x563c791a9f80 comp rx=0 tx=0).stop 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 -- 172.21.15.66:0/2114103126 shutdown_connections 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 --2- 172.21.15.66:0/2114103126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.829+0000 7f6255c33280 1 -- 172.21.15.66:0/2114103126 >> 172.21.15.66:0/2114103126 conn(0x563c791e2400 msgr2=0x563c78501000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.830+0000 7f6255c33280 1 -- 172.21.15.66:0/2114103126 shutdown_connections 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.830+0000 7f6255c33280 1 -- 172.21.15.66:0/2114103126 wait complete. 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.830+0000 7f6255c33280 1 Processor -- start 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.830+0000 7f6255c33280 1 -- start start 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c791fdc80 con 0x563c792e3000 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563c791fdb00 con 0x563c792e2c00 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563c791fd980 con 0x563c792e3400 2024-05-10T11:18:27.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41502/0 (socket says 172.21.15.66:41502) 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 -- 172.21.15.66:0/674482606 learned_addr learned my addr 172.21.15.66:0/674482606 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6253bde640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6253bde640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 -- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 msgr2=0x563c791dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 -- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e2c00 msgr2=0x563c791da000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 -- 172.21.15.66:0/674482606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7843f4a0 con 0x563c792e3000 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6253bde640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f62543df640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 0x563c791db600 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x563c792fba40 tx=0x563c792fd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f624e3d3640 1 -- 172.21.15.66:0/674482606 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842ed00 con 0x563c792e3000 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f624e3d3640 1 -- 172.21.15.66:0/674482606 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563c78434700 con 0x563c792e3000 2024-05-10T11:18:27.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c7843e960 con 0x563c792e3000 2024-05-10T11:18:27.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f624e3d3640 1 -- 172.21.15.66:0/674482606 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842e680 con 0x563c792e3000 2024-05-10T11:18:27.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7843e3c0 con 0x563c792e3000 2024-05-10T11:18:27.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.831+0000 7f6255c33280 4 main: JournalTool: resolving pool 13 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.833+0000 7f624e3d3640 1 -- 172.21.15.66:0/674482606 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x563c792dcc00 con 0x563c792e3000 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.833+0000 7f624e3d3640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x563c79362c00 0x563c791dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.833+0000 7f624e3d3640 1 -- 172.21.15.66:0/674482606 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x563c792dae00 con 0x563c792e3000 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.833+0000 7f6255c33280 4 main: JournalTool: creating IoCtx.. 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.833+0000 7f6255c33280 4 main: Executing for rank 0 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.833+0000 7f6253bde640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x563c79362c00 0x563c791dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.834+0000 7f6253bde640 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x563c79362c00 0x563c791dc100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x563c792fa630 tx=0x563c791a84e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.834+0000 7f6255c33280 1 -- start start 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.834+0000 7f6255c33280 1 Processor -- start 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.834+0000 7f6255c33280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 0x563c791dc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.834+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c79363000 0x563c791dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6255c33280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c79363400 0x563c791dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6255c33280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c791fd680 con 0x563c792e3c00 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563c791fd500 con 0x563c79363000 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6255c33280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563c791fc480 con 0x563c79363400 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 0x563c791dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 0x563c791dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41514/0 (socket says 172.21.15.66:41514) 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 learned_addr learned my addr 172.21.15.66:0/666503780 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f62543df640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c79363000 0x563c791dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6253bde640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c79363400 0x563c791dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c79363400 msgr2=0x563c791dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c79363400 0x563c791dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c79363000 msgr2=0x563c791dcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c79363000 0x563c791dcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7843f860 con 0x563c792e3c00 2024-05-10T11:18:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.835+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 0x563c791dc680 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x563c78749a40 tx=0x563c791a8a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d06241da84968b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.837+0000 7f624b3cd640 1 -- 172.21.15.66:0/666503780 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c7842eb60 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.837+0000 7f624b3cd640 1 -- 172.21.15.66:0/666503780 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563c78434e00 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.837+0000 7f624b3cd640 1 -- 172.21.15.66:0/666503780 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563c793a0340 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.837+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7843f4a0 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.837+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563c7843e960 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.837+0000 7f6255c33280 4 waiting for MDS map... 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f624b3cd640 1 -- 172.21.15.66:0/666503780 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x563c78808600 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f624b3cd640 1 -- 172.21.15.66:0/666503780 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 2885+0+0 (secure 0 0 0) 0x563c78463500 con 0x563c792e3c00 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f6255c33280 4 Got MDS map 64 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x563c79363800 0x563c791dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89) -- 0x563c79363c00 con 0x563c79363800 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f62543df640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x563c79363800 0x563c791dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.838+0000 7f62543df640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x563c79363800 0x563c791dd700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=1adc26eceb8ee4b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.841+0000 7f62543df640 1 -- 172.21.15.66:0/666503780 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x563c78516000 con 0x563c79363800 2024-05-10T11:18:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.841+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x563c78822400 0x563c7882c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.841+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89) -- 0x563c78822800 con 0x563c78822400 2024-05-10T11:18:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.841+0000 7f6253bde640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x563c78822400 0x563c7882c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.841+0000 7f6253bde640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x563c78822400 0x563c7882c000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=276a48b8c7f01a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.843+0000 7f6253bde640 1 -- 172.21.15.66:0/666503780 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x563c78516500 con 0x563c78822400 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.844+0000 7f6249bca640 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e89) -- 0x563c78830000 con 0x563c78822400 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.844+0000 7f6249bca640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x563c78830400 0x563c7882db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.844+0000 7f6249bca640 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e89) -- 0x563c78830800 con 0x563c78830400 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.844+0000 7f6253bde640 1 -- 172.21.15.66:0/666503780 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x563c78516500 con 0x563c78822400 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.844+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x563c78830400 0x563c7882db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.844+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x563c78830400 0x563c7882db80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=73857463af244e00 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.845+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516780 con 0x563c78830400 2024-05-10T11:18:27.848 INFO:teuthology.orchestra.run.smithi066.stdout:old journal was 4212139~2605 2024-05-10T11:18:27.848 INFO:teuthology.orchestra.run.smithi066.stdout:new journal start will be 8388608 (4173864 bytes past old end) 2024-05-10T11:18:27.848 INFO:teuthology.orchestra.run.smithi066.stdout:writing journal head 2024-05-10T11:18:27.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.845+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78822c00 con 0x563c78822400 2024-05-10T11:18:27.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6253bde640 1 -- 172.21.15.66:0/666503780 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v89'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563c78516500 con 0x563c78822400 2024-05-10T11:18:27.849 INFO:teuthology.orchestra.run.smithi066.stdout:writing EResetJournal entry 2024-05-10T11:18:27.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78823000 con 0x563c78830400 2024-05-10T11:18:27.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x563c78823400 0x563c7882c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78823800 con 0x563c78823400 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78823c00 con 0x563c79363800 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x563c78830c00 0x563c7882cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78831000 con 0x563c78830c00 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78831400 con 0x563c78830400 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x563c78831800 0x563c7882d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78831c00 con 0x563c78831800 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6253bde640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x563c78830c00 0x563c7882cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f62543df640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x563c78823400 0x563c7882c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x563c78831800 0x563c7882d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.846+0000 7f6253bde640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x563c78830c00 0x563c7882cb00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=7c570cf2fccbdf07 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.847+0000 7f62543df640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x563c78823400 0x563c7882c580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=66d6b9859b02a2d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.847+0000 7f6254be0640 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x563c78831800 0x563c7882d080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=6d0bca540df33061 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.847+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(6 200.00000002 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516780 con 0x563c78830400 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.847+0000 7f62543df640 1 -- 172.21.15.66:0/666503780 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(8 200.00000004 [delete] v89'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516000 con 0x563c79363800 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.847+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(10 200.00000006 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516780 con 0x563c78830400 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.848+0000 7f6253bde640 1 -- 172.21.15.66:0/666503780 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(9 200.00000005 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516500 con 0x563c78830c00 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.848+0000 7f62543df640 1 -- 172.21.15.66:0/666503780 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(7 200.00000003 [delete] v89'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516000 con 0x563c78823400 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.848+0000 7f6249bca640 1 -- 172.21.15.66:0/666503780 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x563c78807c00 con 0x563c78830400 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.849+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v89'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563c78516780 con 0x563c78830400 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6254be0640 1 -- 172.21.15.66:0/666503780 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(11 200.00000007 [delete] v89'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563c78516780 con 0x563c78831800 2024-05-10T11:18:27.853 INFO:teuthology.orchestra.run.smithi066.stdout:done 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x563c78822400 msgr2=0x563c7882c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x563c78822400 0x563c7882c000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x563c78830c00 msgr2=0x563c7882cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x563c78830c00 0x563c7882cb00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x563c78830400 msgr2=0x563c7882db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x563c78830400 0x563c7882db80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x563c78823400 msgr2=0x563c7882c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x563c78823400 0x563c7882c580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6253bde640 1 -- 172.21.15.66:0/666503780 reap_dead start 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x563c79363800 msgr2=0x563c791dd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x563c79363800 0x563c791dd700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x563c78831800 msgr2=0x563c7882d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x563c78831800 0x563c7882d080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 msgr2=0x563c791dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 0x563c791dc680 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x563c78749a40 tx=0x563c791a8a80 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 shutdown_connections 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x563c78831800 0x563c7882d080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x563c78823400 0x563c7882c580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x563c79363800 0x563c791dd700 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/666503780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3c00 0x563c791dc680 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 >> 172.21.15.66:0/666503780 conn(0x563c792e3800 msgr2=0x563c78500800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 shutdown_connections 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/666503780 wait complete. 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x563c79362c00 msgr2=0x563c791dc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x563c79362c00 0x563c791dc100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x563c792fa630 tx=0x563c791a84e0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 msgr2=0x563c791db600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 0x563c791db600 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x563c792fba40 tx=0x563c792fd800 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 shutdown_connections 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x563c79362c00 0x563c791dc100 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c792e3400 0x563c791dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c792e3000 0x563c791db600 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 --2- 172.21.15.66:0/674482606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c792e2c00 0x563c791da000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 >> 172.21.15.66:0/674482606 conn(0x563c791e2400 msgr2=0x563c78501000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 shutdown_connections 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.850+0000 7f6255c33280 1 -- 172.21.15.66:0/674482606 wait complete. 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 msgr2=0x563c791dab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 0x563c791dab00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x563c7923b830 tx=0x563c791aa180 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 shutdown_connections 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c791e2800 0x563c791dab00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c78409c00 0x563c791db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 --2- 172.21.15.66:0/1013684556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563c791e2000 0x563c791da580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:27.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 >> 172.21.15.66:0/1013684556 conn(0x563c78409000 msgr2=0x563c78502000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:27.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 shutdown_connections 2024-05-10T11:18:27.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:27.851+0000 7f6255c33280 1 -- 172.21.15.66:0/1013684556 wait complete. 2024-05-10T11:18:27.860 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.117973, result: old journal was 4212139~2605 new journal start will be 8388608 (4173864 bytes past old end) writing journal head writing EResetJournal entry done 2024-05-10T11:18:27.860 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T11:18:28.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.004+0000 7f2e99324640 1 Processor -- start 2024-05-10T11:18:28.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.004+0000 7f2e99324640 1 -- start start 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.004+0000 7f2e99324640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 0x7f2e94160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e99324640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9415cfb0 con 0x7f2e940cf240 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e99324640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9415d290 con 0x7f2e9406f410 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e99324640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940ccb60 con 0x7f2e9406f030 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e937fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2e940cf240 0x7f2e940cf6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58834/0 (socket says 172.21.15.66:58834) 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e937fe640 1 -- 172.21.15.66:0/140337943 learned_addr learned my addr 172.21.15.66:0/140337943 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 0x7f2e94160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770967183 0 0) 0x7f2e9415cfb0 con 0x7f2e940cf240 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e7c005730 con 0x7f2e940cf240 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 579978370 0 0) 0x7f2e7c005730 con 0x7f2e940cf240 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 msgr2=0x7f2e94160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:28.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 0x7f2e94160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 >> v1:172.21.15.190:6789/0 conn(0x7f2e9406f410 legacy=0x7f2e9415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9415fd30 con 0x7f2e940cf240 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f2e8c0019f0 con 0x7f2e940cf240 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 >> v1:172.21.15.66:6789/0 conn(0x7f2e940cf240 legacy=0x7f2e940cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e7c005bf0 0x7f2e7c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c006a10 0x7f2e7c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 0x7f2e7c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c00dc80 con 0x7f2e7c005bf0 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c00de00 con 0x7f2e7c006a10 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c00e000 con 0x7f2e9406f030 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e7c005bf0 0x7f2e7c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e927fc640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c006a10 0x7f2e7c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.005+0000 7f2e937fe640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 0x7f2e7c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.006+0000 7f2e92ffd640 1 -- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 msgr2=0x7f2e7c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.006+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e9406f030 0x7f2e7c0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.006+0000 7f2e92ffd640 1 -- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c006a10 msgr2=0x7f2e7c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.006+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c006a10 0x7f2e7c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.006+0000 7f2e92ffd640 1 -- 172.21.15.66:0/140337943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c005730 con 0x7f2e7c005bf0 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.006+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e7c005bf0 0x7f2e7c006010 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009a90 tx=0x7f2e7c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67080e2867948323 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84036070 con 0x7f2e7c005bf0 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e84031400 con 0x7f2e7c005bf0 2024-05-10T11:18:28.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e91ffb640 1 -- 172.21.15.66:0/140337943 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84009690 con 0x7f2e7c005bf0 2024-05-10T11:18:28.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e99324640 1 -- 172.21.15.66:0/140337943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e7c005bf0 msgr2=0x7f2e7c006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e99324640 1 --2- 172.21.15.66:0/140337943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e7c005bf0 0x7f2e7c006010 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009a90 tx=0x7f2e7c007a40 comp rx=0 tx=0).stop 2024-05-10T11:18:28.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e937fe640 1 -- 172.21.15.66:0/140337943 reap_dead start 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e99324640 1 -- 172.21.15.66:0/140337943 shutdown_connections 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e99324640 1 -- 172.21.15.66:0/140337943 >> 172.21.15.66:0/140337943 conn(0x7f2e940d0c90 msgr2=0x7f2e940d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e99324640 1 -- 172.21.15.66:0/140337943 shutdown_connections 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.007+0000 7f2e99324640 1 -- 172.21.15.66:0/140337943 wait complete. 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.008+0000 7f2e99324640 1 Processor -- start 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.008+0000 7f2e99324640 1 -- start start 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e99324640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c005bf0 0x7f2e94151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e99324640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e940c6cb0 0x7f2e940b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e99324640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 0x7f2e940b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e99324640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940cb910 con 0x7f2e940c7130 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e99324640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9415fa40 con 0x7f2e7c005bf0 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e99324640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e94159d70 con 0x7f2e940c6cb0 2024-05-10T11:18:28.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 0x7f2e940b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 0x7f2e940b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41526/0 (socket says 172.21.15.66:41526) 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e937fe640 1 -- 172.21.15.66:0/3572230043 learned_addr learned my addr 172.21.15.66:0/3572230043 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e927fc640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e940c6cb0 0x7f2e940b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.009+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c005bf0 0x7f2e94151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e937fe640 1 -- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e940c6cb0 msgr2=0x7f2e940b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e937fe640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e940c6cb0 0x7f2e940b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e937fe640 1 -- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c005bf0 msgr2=0x7f2e94151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e937fe640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c005bf0 0x7f2e94151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e937fe640 1 -- 172.21.15.66:0/3572230043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e940c5930 con 0x7f2e940c7130 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e927fc640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e940c6cb0 0x7f2e940b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e937fe640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 0x7f2e940b49c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2e940ced30 tx=0x7f2e8c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c017020 con 0x7f2e940c7130 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00ab00 con 0x7f2e940c7130 2024-05-10T11:18:28.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e940c5c10 con 0x7f2e940c7130 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0133f0 con 0x7f2e940c7130 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.010+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e940c61d0 con 0x7f2e940c7130 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.011+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9406a220 con 0x7f2e940c7130 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.012+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e8c01a020 con 0x7f2e940c7130 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.012+0000 7f2e7b7fe640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.012+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f2e8c097ed0 con 0x7f2e940c7130 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.012+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.013+0000 7f2e92ffd640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2e84033000 tx=0x7f2e84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:28.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.016+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2e8c021020 con 0x7f2e940c7130 2024-05-10T11:18:28.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.245+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f2e940cf020 con 0x7f2e940c7130 2024-05-10T11:18:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.677+0000 7f2e7b7fe640 1 -- 172.21.15.66:0/3572230043 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v65) ==== 162+0+0 (secure 0 0 0) 0x7f2e8c0615d0 con 0x7f2e940c7130 2024-05-10T11:18:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 msgr2=0x7f2e800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2e84033000 tx=0x7f2e84008030 comp rx=0 tx=0).stop 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 msgr2=0x7f2e940b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 0x7f2e940b49c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2e940ced30 tx=0x7f2e8c007a90 comp rx=0 tx=0).stop 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 shutdown_connections 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e940c7130 0x7f2e940b49c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e940c6cb0 0x7f2e940b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 --2- 172.21.15.66:0/3572230043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e7c005bf0 0x7f2e94151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 >> 172.21.15.66:0/3572230043 conn(0x7f2e940d0c90 msgr2=0x7f2e940732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:28.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 shutdown_connections 2024-05-10T11:18:28.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.679+0000 7f2e99324640 1 -- 172.21.15.66:0/3572230043 wait complete. 2024-05-10T11:18:28.694 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:28.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.799+0000 7fbfe9e83640 1 Processor -- start 2024-05-10T11:18:28.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.799+0000 7fbfe9e83640 1 -- start start 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe9e83640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbfe415f4e0 0x7fbfe406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe9e83640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe40b0a90 con 0x7fbfe406e620 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe9e83640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe40b3540 con 0x7fbfe415f8c0 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe9e83640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe40b23f0 con 0x7fbfe415f4e0 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbfe415f4e0 0x7fbfe406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe3fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbfe406e620 0x7fbfe40d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58844/0 (socket says 172.21.15.66:58844) 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.800+0000 7fbfe3fff640 1 -- 172.21.15.66:0/128018640 learned_addr learned my addr 172.21.15.66:0/128018640 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:28.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe37fe640 1 -- 172.21.15.66:0/128018640 >> v1:172.21.15.190:6789/0 conn(0x7fbfe415f8c0 legacy=0x7fbfe406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:28.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe37fe640 1 -- 172.21.15.66:0/128018640 >> v1:172.21.15.66:6789/0 conn(0x7fbfe406e620 legacy=0x7fbfe40d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe27fc640 1 -- 172.21.15.66:0/128018640 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571742616 0 0) 0x7fbfe40b0a90 con 0x7fbfe406e620 2024-05-10T11:18:28.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe37fe640 1 -- 172.21.15.66:0/128018640 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe40b3820 con 0x7fbfe415f4e0 2024-05-10T11:18:28.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe37fe640 1 --2- 172.21.15.66:0/128018640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe415f4e0 0x7fbfe406d9d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40097a0 tx=0x7fbfd402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cc103b8d4ef403 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:28.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe27fc640 1 -- 172.21.15.66:0/128018640 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4037070 con 0x7fbfe415f4e0 2024-05-10T11:18:28.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe27fc640 1 -- 172.21.15.66:0/128018640 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd402ae50 con 0x7fbfe415f4e0 2024-05-10T11:18:28.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.801+0000 7fbfe27fc640 1 -- 172.21.15.66:0/128018640 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4032660 con 0x7fbfe415f4e0 2024-05-10T11:18:28.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 -- 172.21.15.66:0/128018640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe415f4e0 msgr2=0x7fbfe406d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/128018640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe415f4e0 0x7fbfe406d9d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40097a0 tx=0x7fbfd402a140 comp rx=0 tx=0).stop 2024-05-10T11:18:28.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 -- 172.21.15.66:0/128018640 shutdown_connections 2024-05-10T11:18:28.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/128018640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe415f4e0 0x7fbfe406d9d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 -- 172.21.15.66:0/128018640 >> 172.21.15.66:0/128018640 conn(0x7fbfe40d2df0 msgr2=0x7fbfe40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:28.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 -- 172.21.15.66:0/128018640 shutdown_connections 2024-05-10T11:18:28.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.802+0000 7fbfe9e83640 1 -- 172.21.15.66:0/128018640 wait complete. 2024-05-10T11:18:28.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.803+0000 7fbfe9e83640 1 Processor -- start 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.803+0000 7fbfe9e83640 1 -- start start 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe9e83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 0x7fbfe41f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe9e83640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfe415f4e0 0x7fbfe40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe9e83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfe415f8c0 0x7fbfe40d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe9e83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40b3de0 con 0x7fbfe406e620 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe9e83640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40b4150 con 0x7fbfe415f4e0 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe9e83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40b45e0 con 0x7fbfe415f8c0 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 0x7fbfe41f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 0x7fbfe41f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41546/0 (socket says 172.21.15.66:41546) 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.804+0000 7fbfe37fe640 1 -- 172.21.15.66:0/2031827402 learned_addr learned my addr 172.21.15.66:0/2031827402 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:28.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe2ffd640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfe415f4e0 0x7fbfe40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe37fe640 1 -- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfe415f8c0 msgr2=0x7fbfe40d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe37fe640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfe415f8c0 0x7fbfe40d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe37fe640 1 -- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfe415f4e0 msgr2=0x7fbfe40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe37fe640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfe415f4e0 0x7fbfe40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe37fe640 1 -- 172.21.15.66:0/2031827402 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe41f8720 con 0x7fbfe406e620 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe37fe640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 0x7fbfe41f81e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4000c00 tx=0x7fbfd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4041070 con 0x7fbfe406e620 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd403c670 con 0x7fbfe406e620 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe4147410 con 0x7fbfe406e620 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4037040 con 0x7fbfe406e620 2024-05-10T11:18:28.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.805+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41479d0 con 0x7fbfe406e620 2024-05-10T11:18:28.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.806+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe4068c40 con 0x7fbfe406e620 2024-05-10T11:18:28.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.807+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbfd4044070 con 0x7fbfe406e620 2024-05-10T11:18:28.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.807+0000 7fbfcbfff640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfd0076300 0x7fbfd00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:28.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.807+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbfd40b7f90 con 0x7fbfe406e620 2024-05-10T11:18:28.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.807+0000 7fbfe2ffd640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfd0076300 0x7fbfd00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:28.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.808+0000 7fbfe2ffd640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfd0076300 0x7fbfd00787c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbfe415bc30 tx=0x7fbfd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:28.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:28.812+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbfe4068c40 con 0x7fbfe406e620 2024-05-10T11:18:29.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.045+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe406a220 con 0x7fbfe406e620 2024-05-10T11:18:29.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.046+0000 7fbfcbfff640 1 -- 172.21.15.66:0/2031827402 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7fbfd4081710 con 0x7fbfe406e620 2024-05-10T11:18:29.046 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:29.046 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:28.680339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":66,"state":"up:replay","state_seq":1,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T11:18:29.046 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 66 2024-05-10T11:18:29.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfd0076300 msgr2=0x7fbfd00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:29.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfd0076300 0x7fbfd00787c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbfe415bc30 tx=0x7fbfd8009040 comp rx=0 tx=0).stop 2024-05-10T11:18:29.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 msgr2=0x7fbfe41f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:29.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 0x7fbfe41f81e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4000c00 tx=0x7fbfd40046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:29.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 shutdown_connections 2024-05-10T11:18:29.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbfd0076300 0x7fbfd00787c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:29.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfe415f8c0 0x7fbfe40d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:29.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfe415f4e0 0x7fbfe40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:29.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.047+0000 7fbfe9e83640 1 --2- 172.21.15.66:0/2031827402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe406e620 0x7fbfe41f81e0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:29.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.048+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 >> 172.21.15.66:0/2031827402 conn(0x7fbfe40d2df0 msgr2=0x7fbfe4071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:29.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.048+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 shutdown_connections 2024-05-10T11:18:29.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:29.048+0000 7fbfe9e83640 1 -- 172.21.15.66:0/2031827402 wait complete. 2024-05-10T11:18:29.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:18:28.680339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6867}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6867': {'gid': 6867, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/577308965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 577308965}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 577308965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:18:29.462 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6867:up:replay 2024-05-10T11:18:30.463 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.652+0000 7f1c7c37f640 1 Processor -- start 2024-05-10T11:18:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.652+0000 7f1c7c37f640 1 -- start start 2024-05-10T11:18:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.653+0000 7f1c7c37f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1c7415f3b0 0x7f1c740d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.653+0000 7f1c7c37f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c7415f790 0x7f1c740d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.653+0000 7f1c7c37f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c740d30b0 con 0x7f1c740d5d30 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.653+0000 7f1c7c37f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f1c740d3390 con 0x7f1c7415f3b0 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.653+0000 7f1c7c37f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1c740c8c80 con 0x7f1c7415f790 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1c7415f3b0 0x7f1c740d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1c7415f3b0 0x7f1c740d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41550/0 (socket says 172.21.15.66:41550) 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 -- 172.21.15.66:0/657516134 learned_addr learned my addr 172.21.15.66:0/657516134 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7991a640 1 --2- 172.21.15.66:0/657516134 >> v2:172.21.15.190:3300/0 conn(0x7f1c7415f790 0x7f1c740d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 -- 172.21.15.66:0/657516134 >> v2:172.21.15.190:3300/0 conn(0x7f1c7415f790 msgr2=0x7f1c740d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 --2- 172.21.15.66:0/657516134 >> v2:172.21.15.190:3300/0 conn(0x7f1c7415f790 0x7f1c740d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 -- 172.21.15.66:0/657516134 >> v1:172.21.15.190:6789/0 conn(0x7f1c740d5d30 legacy=0x7f1c740c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.654+0000 7f1c7a11b640 1 -- 172.21.15.66:0/657516134 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c740c8f60 con 0x7f1c7415f3b0 2024-05-10T11:18:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.655+0000 7f1c7a11b640 1 --2- 172.21.15.66:0/657516134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740d36f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f1c740c8c00 tx=0x7f1c7002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b706eff474ce431b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.655+0000 7f1c79119640 1 -- 172.21.15.66:0/657516134 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70037070 con 0x7f1c7415f3b0 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.655+0000 7f1c79119640 1 -- 172.21.15.66:0/657516134 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70032440 con 0x7f1c7415f3b0 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.655+0000 7f1c79119640 1 -- 172.21.15.66:0/657516134 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70032810 con 0x7f1c7415f3b0 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.655+0000 7f1c7c37f640 1 -- 172.21.15.66:0/657516134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 msgr2=0x7f1c740d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.655+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/657516134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740d36f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f1c740c8c00 tx=0x7f1c7002a230 comp rx=0 tx=0).stop 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.656+0000 7f1c7c37f640 1 -- 172.21.15.66:0/657516134 shutdown_connections 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.656+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/657516134 >> v2:172.21.15.190:3300/0 conn(0x7f1c7415f790 0x7f1c740d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.656+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/657516134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740d36f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.656+0000 7f1c7c37f640 1 -- 172.21.15.66:0/657516134 >> 172.21.15.66:0/657516134 conn(0x7f1c740d5130 msgr2=0x7f1c740d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.656+0000 7f1c7c37f640 1 -- 172.21.15.66:0/657516134 shutdown_connections 2024-05-10T11:18:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.656+0000 7f1c7c37f640 1 -- 172.21.15.66:0/657516134 wait complete. 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.657+0000 7f1c7c37f640 1 Processor -- start 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.657+0000 7f1c7c37f640 1 -- start start 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c740d5d30 0x7f1c741f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c74155f20 0x7f1c740ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1c740d0e60 con 0x7f1c7415f3b0 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1c740d0ce0 con 0x7f1c740d5d30 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1c740d0fe0 con 0x7f1c74155f20 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41556/0 (socket says 172.21.15.66:41556) 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 -- 172.21.15.66:0/1601745156 learned_addr learned my addr 172.21.15.66:0/1601745156 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7a11b640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c740d5d30 0x7f1c741f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7a91c640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c74155f20 0x7f1c740ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 -- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c74155f20 msgr2=0x7f1c740ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c74155f20 0x7f1c740ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 -- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c740d5d30 msgr2=0x7f1c741f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c740d5d30 0x7f1c741f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 -- 172.21.15.66:0/1601745156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c74154d30 con 0x7f1c7415f3b0 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7a11b640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c740d5d30 0x7f1c741f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7a91c640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c74155f20 0x7f1c740ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7991a640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740ce130 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d5c0 tx=0x7f1c6400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c640125f0 con 0x7f1c7415f3b0 2024-05-10T11:18:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c64019070 con 0x7f1c7415f3b0 2024-05-10T11:18:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c740ceca0 con 0x7f1c7415f3b0 2024-05-10T11:18:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c640129d0 con 0x7f1c7415f3b0 2024-05-10T11:18:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.658+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c74155440 con 0x7f1c7415f3b0 2024-05-10T11:18:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.660+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7406a220 con 0x7f1c7415f3b0 2024-05-10T11:18:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.660+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c64012b70 con 0x7f1c7415f3b0 2024-05-10T11:18:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.661+0000 7f1c6affd640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1c580762d0 0x7f1c58078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.661+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f1c64097bf0 con 0x7f1c7415f3b0 2024-05-10T11:18:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.661+0000 7f1c7a11b640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1c580762d0 0x7f1c58078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.661+0000 7f1c7a11b640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1c580762d0 0x7f1c58078790 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1c70034000 tx=0x7f1c7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.665+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1c64061370 con 0x7f1c7415f3b0 2024-05-10T11:18:30.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.894+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c740d2870 con 0x7f1c7415f3b0 2024-05-10T11:18:30.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.895+0000 7f1c6affd640 1 -- 172.21.15.66:0/1601745156 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5180 (secure 0 0 0) 0x7f1c64067070 con 0x7f1c7415f3b0 2024-05-10T11:18:30.896 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:30.896 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:29.685758+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":66,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T11:18:30.896 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 68 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1c580762d0 msgr2=0x7f1c58078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1c580762d0 0x7f1c58078790 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1c70034000 tx=0x7f1c7002e000 comp rx=0 tx=0).stop 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 msgr2=0x7f1c740ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740ce130 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d5c0 tx=0x7f1c6400da80 comp rx=0 tx=0).stop 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 shutdown_connections 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1c580762d0 0x7f1c58078790 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c74155f20 0x7f1c740ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c7415f3b0 0x7f1c740ce130 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 --2- 172.21.15.66:0/1601745156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c740d5d30 0x7f1c741f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 >> 172.21.15.66:0/1601745156 conn(0x7f1c740d5130 msgr2=0x7f1c74075920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 shutdown_connections 2024-05-10T11:18:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:30.897+0000 7f1c7c37f640 1 -- 172.21.15.66:0/1601745156 wait complete. 2024-05-10T11:18:31.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:18:29.685758+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6867}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6867': {'gid': 6867, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.66:6835/577308965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 577308965}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 577308965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:18:31.311 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6867:up:rejoin 2024-05-10T11:18:32.291 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:18:32.294 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:18:32.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:18:32.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.448+0000 7f145afe7640 1 Processor -- start 2024-05-10T11:18:32.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.448+0000 7f145afe7640 1 -- start start 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f145afe7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1454162750 0x7f14540d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f145afe7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14540d5cb0 0x7f14540d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f145afe7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14540b45f0 con 0x7f1454162b30 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f145afe7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f14540b4f20 con 0x7f1454162750 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f145afe7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14540d0fe0 con 0x7f14540d5cb0 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1454162750 0x7f14540d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1454162750 0x7f14540d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41566/0 (socket says 172.21.15.66:41566) 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 -- 172.21.15.66:0/975946737 learned_addr learned my addr 172.21.15.66:0/975946737 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f144bfff640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14540d5cb0 0x7f14540d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 -- 172.21.15.66:0/975946737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14540d5cb0 msgr2=0x7f14540d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14540d5cb0 0x7f14540d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 -- 172.21.15.66:0/975946737 >> v1:172.21.15.190:6789/0 conn(0x7f1454162b30 legacy=0x7f14540d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:32.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f1458d83640 1 -- 172.21.15.66:0/975946737 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14540b48d0 con 0x7f1454162750 2024-05-10T11:18:32.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.449+0000 7f144bfff640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14540d5cb0 0x7f14540d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:32.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.450+0000 7f1458d83640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454162750 0x7f14540d0670 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1450009870 tx=0x7f145002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1360185d463f390e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:32.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.450+0000 7f144b7fe640 1 -- 172.21.15.66:0/975946737 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450037070 con 0x7f1454162750 2024-05-10T11:18:32.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.450+0000 7f144b7fe640 1 -- 172.21.15.66:0/975946737 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450032440 con 0x7f1454162750 2024-05-10T11:18:32.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.450+0000 7f144b7fe640 1 -- 172.21.15.66:0/975946737 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450032810 con 0x7f1454162750 2024-05-10T11:18:32.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 -- 172.21.15.66:0/975946737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454162750 msgr2=0x7f14540d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:32.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454162750 0x7f14540d0670 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1450009870 tx=0x7f145002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 -- 172.21.15.66:0/975946737 shutdown_connections 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14540d5cb0 0x7f14540d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 --2- 172.21.15.66:0/975946737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454162750 0x7f14540d0670 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 -- 172.21.15.66:0/975946737 >> 172.21.15.66:0/975946737 conn(0x7f145409e3b0 msgr2=0x7f14540d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 -- 172.21.15.66:0/975946737 shutdown_connections 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.451+0000 7f145afe7640 1 -- 172.21.15.66:0/975946737 wait complete. 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.452+0000 7f145afe7640 1 Processor -- start 2024-05-10T11:18:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.452+0000 7f145afe7640 1 -- start start 2024-05-10T11:18:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f145afe7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1454162750 0x7f14540cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f145afe7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1454162b30 0x7f14540cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f145afe7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 0x7f14541572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f145afe7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14540d0d30 con 0x7f14540ce3b0 2024-05-10T11:18:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f145afe7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14540d0bb0 con 0x7f1454162750 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f145afe7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14540b63c0 con 0x7f1454162b30 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f1459584640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 0x7f14541572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f1459584640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 0x7f14541572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41580/0 (socket says 172.21.15.66:41580) 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f1459584640 1 -- 172.21.15.66:0/3984931779 learned_addr learned my addr 172.21.15.66:0/3984931779 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f144bfff640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1454162b30 0x7f14540cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.453+0000 7f1458d83640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1454162750 0x7f14540cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1459584640 1 -- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1454162b30 msgr2=0x7f14540cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1459584640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1454162b30 0x7f14540cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1459584640 1 -- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1454162750 msgr2=0x7f14540cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1459584640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1454162750 0x7f14540cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1459584640 1 -- 172.21.15.66:0/3984931779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14540cc370 con 0x7f14540ce3b0 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1458d83640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1454162750 0x7f14540cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f1459584640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 0x7f14541572d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f144c00c6e0 tx=0x7f144c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:32.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c003b70 con 0x7f14540ce3b0 2024-05-10T11:18:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144c003d30 con 0x7f14540ce3b0 2024-05-10T11:18:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c005310 con 0x7f14540ce3b0 2024-05-10T11:18:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14540cc650 con 0x7f14540ce3b0 2024-05-10T11:18:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.454+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14540ccc10 con 0x7f14540ce3b0 2024-05-10T11:18:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.455+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14540cce10 con 0x7f14540ce3b0 2024-05-10T11:18:32.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.456+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f144c0054b0 con 0x7f14540ce3b0 2024-05-10T11:18:32.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.456+0000 7f14497fa640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14400762d0 0x7f1440078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:32.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.456+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f144c097500 con 0x7f14540ce3b0 2024-05-10T11:18:32.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.456+0000 7f1458d83640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14400762d0 0x7f1440078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:32.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.457+0000 7f1458d83640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14400762d0 0x7f1440078790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1450034000 tx=0x7f145002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:32.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.461+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f14540cce10 con 0x7f14540ce3b0 2024-05-10T11:18:32.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.691+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f145406a220 con 0x7f14540ce3b0 2024-05-10T11:18:32.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.692+0000 7f14497fa640 1 -- 172.21.15.66:0/3984931779 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5187 (secure 0 0 0) 0x7f144c060d10 con 0x7f14540ce3b0 2024-05-10T11:18:32.693 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:18:32.693 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:31.689507+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6867,"qdb_cluster":[6867]},"id":6}]} 2024-05-10T11:18:32.693 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 69 2024-05-10T11:18:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14400762d0 msgr2=0x7f1440078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14400762d0 0x7f1440078790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1450034000 tx=0x7f145002e000 comp rx=0 tx=0).stop 2024-05-10T11:18:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 msgr2=0x7f14541572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 0x7f14541572d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f144c00c6e0 tx=0x7f144c00cba0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 shutdown_connections 2024-05-10T11:18:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14400762d0 0x7f1440078790 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14540ce3b0 0x7f14541572d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1454162b30 0x7f14540cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 --2- 172.21.15.66:0/3984931779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1454162750 0x7f14540cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:32.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 >> 172.21.15.66:0/3984931779 conn(0x7f145409e3b0 msgr2=0x7f14540d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:32.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 shutdown_connections 2024-05-10T11:18:32.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:32.695+0000 7f145afe7640 1 -- 172.21.15.66:0/3984931779 wait complete. 2024-05-10T11:18:33.108 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:18:31.689507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6867}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6867': {'gid': 6867, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.66:6835/577308965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 577308965}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 577308965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6867, 'qdb_cluster': [6867]} 2024-05-10T11:18:33.108 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:18:33.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T11:18:33.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.215+0000 7f848c378640 1 Processor -- start 2024-05-10T11:18:33.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.215+0000 7f848c378640 1 -- start start 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f848c378640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f84841598c0 0x7f848406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f848c378640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f848406ec40 0x7f84840c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f848c378640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848406f1c0 con 0x7f84840c71c0 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f848c378640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f84840c7610 con 0x7f848406ec40 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f848c378640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f848406f4a0 con 0x7f84841598c0 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f8489913640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f848406ec40 0x7f84840c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f8489913640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f848406ec40 0x7f84840c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41592/0 (socket says 172.21.15.66:41592) 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.216+0000 7f8489913640 1 -- 172.21.15.66:0/356114578 learned_addr learned my addr 172.21.15.66:0/356114578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f848a114640 1 --2- 172.21.15.66:0/356114578 >> v2:172.21.15.190:3300/0 conn(0x7f84841598c0 0x7f848406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f8489913640 1 -- 172.21.15.66:0/356114578 >> v2:172.21.15.190:3300/0 conn(0x7f84841598c0 msgr2=0x7f848406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f8489913640 1 --2- 172.21.15.66:0/356114578 >> v2:172.21.15.190:3300/0 conn(0x7f84841598c0 0x7f848406e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f8489913640 1 -- 172.21.15.66:0/356114578 >> v1:172.21.15.190:6789/0 conn(0x7f84840c71c0 legacy=0x7f848415fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f8489913640 1 -- 172.21.15.66:0/356114578 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848406f780 con 0x7f848406ec40 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f8489913640 1 --2- 172.21.15.66:0/356114578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f84840c6c80 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f84840b3930 tx=0x7f847402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc783acd00dab4c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.217+0000 7f8489112640 1 -- 172.21.15.66:0/356114578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474037070 con 0x7f848406ec40 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f8489112640 1 -- 172.21.15.66:0/356114578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8474032440 con 0x7f848406ec40 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f8489112640 1 -- 172.21.15.66:0/356114578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474032810 con 0x7f848406ec40 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 -- 172.21.15.66:0/356114578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 msgr2=0x7f84840c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 --2- 172.21.15.66:0/356114578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f84840c6c80 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f84840b3930 tx=0x7f847402a230 comp rx=0 tx=0).stop 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 -- 172.21.15.66:0/356114578 shutdown_connections 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 --2- 172.21.15.66:0/356114578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f84840c6c80 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 --2- 172.21.15.66:0/356114578 >> v2:172.21.15.190:3300/0 conn(0x7f84841598c0 0x7f848406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 -- 172.21.15.66:0/356114578 >> 172.21.15.66:0/356114578 conn(0x7f84840b2900 msgr2=0x7f84840b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 -- 172.21.15.66:0/356114578 shutdown_connections 2024-05-10T11:18:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.218+0000 7f848c378640 1 -- 172.21.15.66:0/356114578 wait complete. 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.219+0000 7f848c378640 1 Processor -- start 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.219+0000 7f848c378640 1 -- start start 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848c378640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f848415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848c378640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84840c71c0 0x7f8484151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848c378640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84841598c0 0x7f84840b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848c378640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f848415c6e0 con 0x7f848406ec40 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848c378640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84840ce920 con 0x7f84840c71c0 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848c378640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8484159ca0 con 0x7f84841598c0 2024-05-10T11:18:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848a114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f848415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848a114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f848415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41598/0 (socket says 172.21.15.66:41598) 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f848a114640 1 -- 172.21.15.66:0/3634472129 learned_addr learned my addr 172.21.15.66:0/3634472129 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.220+0000 7f8489913640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84840c71c0 0x7f8484151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a915640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84841598c0 0x7f84840b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a114640 1 -- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84841598c0 msgr2=0x7f84840b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a114640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84841598c0 0x7f84840b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a114640 1 -- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84840c71c0 msgr2=0x7f8484151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a114640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84840c71c0 0x7f8484151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a114640 1 -- 172.21.15.66:0/3634472129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84841521e0 con 0x7f848406ec40 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848a114640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f848415db40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f848000c7f0 tx=0x7f848000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f847affd640 1 -- 172.21.15.66:0/3634472129 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480015070 con 0x7f848406ec40 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f847affd640 1 -- 172.21.15.66:0/3634472129 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480004220 con 0x7f848406ec40 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f847affd640 1 -- 172.21.15.66:0/3634472129 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480007620 con 0x7f848406ec40 2024-05-10T11:18:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848415e240 con 0x7f848406ec40 2024-05-10T11:18:33.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.221+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f848415e800 con 0x7f848406ec40 2024-05-10T11:18:33.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.223+0000 7f847affd640 1 -- 172.21.15.66:0/3634472129 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84800079d0 con 0x7f848406ec40 2024-05-10T11:18:33.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.223+0000 7f847affd640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8468076300 0x7f84680787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.223+0000 7f847affd640 1 -- 172.21.15.66:0/3634472129 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f84800976f0 con 0x7f848406ec40 2024-05-10T11:18:33.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.223+0000 7f8489913640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8468076300 0x7f84680787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.224+0000 7f848f16c740 1 Processor -- start 2024-05-10T11:18:33.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.224+0000 7f8489913640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8468076300 0x7f84680787c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8474034000 tx=0x7f847402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.224+0000 7f848f16c740 1 -- start start 2024-05-10T11:18:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f848f16c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e5fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e2fbb0 0x55d001e333c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f848f16c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d001d998d0 con 0x55d001e5d330 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d001d52c10 con 0x55d001e5cf50 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d001d95890 con 0x55d001e2fbb0 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f8489913640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e5fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f8489913640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e5fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41604/0 (socket says 172.21.15.66:41604) 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.225+0000 7f8489913640 1 -- 172.21.15.66:0/3223617676 learned_addr learned my addr 172.21.15.66:0/3223617676 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f848a114640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f848a915640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e2fbb0 0x55d001e333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8489913640 1 -- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e2fbb0 msgr2=0x55d001e333c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8489913640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e2fbb0 0x55d001e333c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8489913640 1 -- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 msgr2=0x55d001e5f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8489913640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e5f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8489913640 1 -- 172.21.15.66:0/3223617676 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d001d5a5d0 con 0x55d001e5d330 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f848a114640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e5f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f848a915640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e2fbb0 0x55d001e333c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8489913640 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e5fca0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8474035040 tx=0x7f847402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42b9b2b0505353 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8467fff640 1 -- 172.21.15.66:0/3223617676 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474037040 con 0x55d001e5d330 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8467fff640 1 -- 172.21.15.66:0/3223617676 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847403e660 con 0x55d001e5d330 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.226+0000 7f8467fff640 1 -- 172.21.15.66:0/3223617676 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847403ea10 con 0x55d001e5d330 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 -- 172.21.15.66:0/3223617676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 msgr2=0x55d001e5fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e5fca0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8474035040 tx=0x7f847402c000 comp rx=0 tx=0).stop 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 -- 172.21.15.66:0/3223617676 shutdown_connections 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e2fbb0 0x55d001e333c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e5fca0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 --2- 172.21.15.66:0/3223617676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e5f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 -- 172.21.15.66:0/3223617676 >> 172.21.15.66:0/3223617676 conn(0x55d001e31e20 msgr2=0x55d001e7a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 -- 172.21.15.66:0/3223617676 shutdown_connections 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 -- 172.21.15.66:0/3223617676 wait complete. 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 -- start start 2024-05-10T11:18:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.227+0000 7f848f16c740 1 Processor -- start 2024-05-10T11:18:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e7e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e76360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e53c00 0x55d001e768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d001e34fd0 con 0x55d001e5d330 2024-05-10T11:18:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d001d56760 con 0x55d001e5cf50 2024-05-10T11:18:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d001e352b0 con 0x55d001e53c00 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f848f16c740 10 client.0 _ll_register_callbacks cb 0x55d001d8fcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f8489913640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e76360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f8489913640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e76360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41610/0 (socket says 172.21.15.66:41610) 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.228+0000 7f8489913640 1 -- 172.21.15.66:0/802094592 learned_addr learned my addr 172.21.15.66:0/802094592 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848a915640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e53c00 0x55d001e768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f8489913640 1 -- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e53c00 msgr2=0x55d001e768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848a114640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e7e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f8489913640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e53c00 0x55d001e768a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f8489913640 1 -- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 msgr2=0x55d001e7e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f8489913640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e7e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f8489913640 1 -- 172.21.15.66:0/802094592 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d001aab2d0 con 0x55d001e5d330 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f8489913640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e76360 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f847402a270 tx=0x7f8474004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1724c28c002e39dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f84657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f84657fa640 1 -- 172.21.15.66:0/802094592 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474058060 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f84657fa640 1 -- 172.21.15.66:0/802094592 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f847403c640 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f847403e660 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f84657fa640 1 -- 172.21.15.66:0/802094592 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f847403ee60 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 10 client.7107 fetch_fsmap learned FSMap version 69 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55d001b756b0 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f84657fa640 1 -- 172.21.15.66:0/802094592 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847403e660 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f84657fa640 1 -- 172.21.15.66:0/802094592 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 3494+0+0 (secure 0 0 0) 0x7f8474061080 con 0x55d001e5d330 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 10 client.7107 fetch_fsmap finished waiting for FSMap version 69 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 10 client.7107 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 20 client.7107 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e72170 0x55d001e72550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 4 client.7107 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:18:33.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.229+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d001d1d760 con 0x55d001e72170 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.230+0000 7f848a114640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e72170 0x55d001e72550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.230+0000 7f84657fa640 10 client.7107 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.230+0000 7f848a114640 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e72170 0x55d001e72550 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf87f5f8102e670d server_cookie=fc7e7da336ded0e5 in_seq=0 out_seq=0 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.230+0000 7f84657fa640 1 -- 172.21.15.66:0/802094592 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d001d1d760 con 0x55d001e72170 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.230+0000 7f84657fa640 10 client.7107 handle_command_reply: tid=0 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.230+0000 7f848f16c740 1 client.7107 shutdown 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 msgr2=0x55d001e76360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e76360 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f847402a270 tx=0x7f8474004730 comp rx=0 tx=0).stop 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 shutdown_connections 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e72170 0x55d001e72550 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e53c00 0x55d001e768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e5d330 0x55d001e76360 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f84657fa640 0 client.7107 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 --2- 172.21.15.66:0/802094592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e7e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 >> 172.21.15.66:0/802094592 conn(0x55d001e2fbb0 msgr2=0x55d001e30860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 shutdown_connections 2024-05-10T11:18:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 1 -- 172.21.15.66:0/802094592 wait complete. 2024-05-10T11:18:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.231+0000 7f848f16c740 20 client.7107 trim_cache size 0 max 16384 2024-05-10T11:18:33.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 Processor -- start 2024-05-10T11:18:33.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 -- start start 2024-05-10T11:18:33.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e5c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5cf50 0x55d001e7d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5d330 0x55d001e7dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8484200f90 con 0x55d001e53c00 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84840af610 con 0x55d001e5d330 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.250+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8484200940 con 0x55d001e5cf50 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e5c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e5c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41626/0 (socket says 172.21.15.66:41626) 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 -- 172.21.15.66:0/183441905 learned_addr learned my addr 172.21.15.66:0/183441905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f8489913640 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5cf50 0x55d001e7d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a915640 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5d330 0x55d001e7dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 -- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5cf50 msgr2=0x55d001e7d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5cf50 0x55d001e7d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 -- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5d330 msgr2=0x55d001e7dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5d330 0x55d001e7dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 -- 172.21.15.66:0/183441905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d001e7b0a0 con 0x55d001e53c00 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f8489913640 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5cf50 0x55d001e7d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f848a114640 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e5c9b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8480060790 tx=0x7f84800959a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfa8be06c0497f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f84677fe640 1 -- 172.21.15.66:0/183441905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480095e60 con 0x55d001e53c00 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f84677fe640 1 -- 172.21.15.66:0/183441905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480064bb0 con 0x55d001e53c00 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.251+0000 7f84677fe640 1 -- 172.21.15.66:0/183441905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848001e040 con 0x55d001e53c00 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 -- 172.21.15.66:0/183441905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 msgr2=0x55d001e5c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e5c9b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8480060790 tx=0x7f84800959a0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 -- 172.21.15.66:0/183441905 shutdown_connections 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5d330 0x55d001e7dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5cf50 0x55d001e7d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 --2- 172.21.15.66:0/183441905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e5c9b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 -- 172.21.15.66:0/183441905 >> 172.21.15.66:0/183441905 conn(0x55d001e2fbb0 msgr2=0x55d001e5c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 -- 172.21.15.66:0/183441905 shutdown_connections 2024-05-10T11:18:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 -- 172.21.15.66:0/183441905 wait complete. 2024-05-10T11:18:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.252+0000 7f848f16c740 1 -- start start 2024-05-10T11:18:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 Processor -- start 2024-05-10T11:18:33.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e52070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e525b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5d330 0x55d001e50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d001e72e10 con 0x55d001e53c00 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d001e34fd0 con 0x55d001e5cf50 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d001e7bfa0 con 0x55d001e5d330 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.253+0000 7f848f16c740 10 client.0 _ll_register_callbacks cb 0x7f84740096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e52070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e52070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41638/0 (socket says 172.21.15.66:41638) 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 -- 172.21.15.66:0/56911556 learned_addr learned my addr 172.21.15.66:0/56911556 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f8489913640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a915640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5d330 0x55d001e50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 -- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5d330 msgr2=0x55d001e50b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5d330 0x55d001e50b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 -- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 msgr2=0x55d001e525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 -- 172.21.15.66:0/56911556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d001e73f20 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848a114640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e52070 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f848000a0a0 tx=0x7f847403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2515784cb4c494f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f84657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f84657fa640 1 -- 172.21.15.66:0/56911556 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480092070 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f84657fa640 1 -- 172.21.15.66:0/56911556 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f8480007cc0 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8480064bb0 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f84657fa640 1 -- 172.21.15.66:0/56911556 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f8480081050 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848f16c740 10 client.7113 fetch_fsmap learned FSMap version 69 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55d001e51a00 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.254+0000 7f84657fa640 1 -- 172.21.15.66:0/56911556 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480064bb0 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f84657fa640 1 -- 172.21.15.66:0/56911556 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 3494+0+0 (secure 0 0 0) 0x7f8480075bc0 con 0x55d001e53c00 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 10 client.7113 fetch_fsmap finished waiting for FSMap version 69 2024-05-10T11:18:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 10 client.7113 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 20 client.7113 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e51040 0x55d001e51420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 4 client.7113 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "status"}) -- 0x55d001e75ed0 con 0x55d001e51040 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f8489913640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e51040 0x55d001e51420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f8489913640 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e51040 0x55d001e51420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94bfea95b486f57c server_cookie=763e404b88e6f9db in_seq=0 out_seq=0 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f84657fa640 10 client.7113 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f84657fa640 1 -- 172.21.15.66:0/56911556 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d001e75ed0 con 0x55d001e51040 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f84657fa640 10 client.7113 handle_command_reply: tid=0 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 client.7113 shutdown 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 msgr2=0x55d001e52070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e52070 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f848000a0a0 tx=0x7f847403b000 comp rx=0 tx=0).stop 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 shutdown_connections 2024-05-10T11:18:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d001e51040 0x55d001e51420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d001e5d330 0x55d001e50b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d001e5cf50 0x55d001e525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f84657fa640 0 client.7113 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 --2- 172.21.15.66:0/56911556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d001e53c00 0x55d001e52070 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.255+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 >> 172.21.15.66:0/56911556 conn(0x55d001e2fbb0 msgr2=0x55d001e5c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 shutdown_connections 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848f16c740 1 -- 172.21.15.66:0/56911556 wait complete. 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848f16c740 20 client.7113 trim_cache size 0 max 16384 2024-05-10T11:18:33.262 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 6867, 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 4.5744812499999998, 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 69, 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 89, 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 89, 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 23.748404399000002 2024-05-10T11:18:33.263 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:18:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8468076300 msgr2=0x7f84680787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8468076300 0x7f84680787c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8474034000 tx=0x7f847402e000 comp rx=0 tx=0).stop 2024-05-10T11:18:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 msgr2=0x7f848415db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f848415db40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f848000c7f0 tx=0x7f848000ccb0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 shutdown_connections 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8468076300 0x7f84680787c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84841598c0 0x7f84840b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84840c71c0 0x7f8484151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 --2- 172.21.15.66:0/3634472129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848406ec40 0x7f848415db40 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 >> 172.21.15.66:0/3634472129 conn(0x7f84840b2900 msgr2=0x7f8484157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 shutdown_connections 2024-05-10T11:18:33.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.256+0000 7f848c378640 1 -- 172.21.15.66:0/3634472129 wait complete. 2024-05-10T11:18:33.267 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:18:33.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.370+0000 7f12a2d78640 1 Processor -- start 2024-05-10T11:18:33.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.370+0000 7f12a2d78640 1 -- start start 2024-05-10T11:18:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a2d78640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f129c162940 0x7f129c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a2d78640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f129c0d59d0 0x7f129c0d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a2d78640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c0d2d20 con 0x7f129c0b47a0 2024-05-10T11:18:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a2d78640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f129c162d20 con 0x7f129c0d59d0 2024-05-10T11:18:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a2d78640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f129c0d3000 con 0x7f129c162940 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f129bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f129c0d59d0 0x7f129c0d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a1315640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f129c0b47a0 0x7f129c162f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58846/0 (socket says 172.21.15.66:58846) 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.371+0000 7f12a1315640 1 -- 172.21.15.66:0/3799674492 learned_addr learned my addr 172.21.15.66:0/3799674492 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.372+0000 7f12a0b14640 1 --2- 172.21.15.66:0/3799674492 >> v2:172.21.15.190:3300/0 conn(0x7f129c162940 0x7f129c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.372+0000 7f129bfff640 1 -- 172.21.15.66:0/3799674492 >> v2:172.21.15.190:3300/0 conn(0x7f129c162940 msgr2=0x7f129c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.372+0000 7f129bfff640 1 --2- 172.21.15.66:0/3799674492 >> v2:172.21.15.190:3300/0 conn(0x7f129c162940 0x7f129c0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.372+0000 7f129bfff640 1 -- 172.21.15.66:0/3799674492 >> v1:172.21.15.66:6789/0 conn(0x7f129c0b47a0 legacy=0x7f129c162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.372+0000 7f129bfff640 1 -- 172.21.15.66:0/3799674492 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c0d32e0 con 0x7f129c0d59d0 2024-05-10T11:18:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.372+0000 7f129b7fe640 1 -- 172.21.15.66:0/3799674492 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220967821 0 0) 0x7f129c0d2d20 con 0x7f129c0b47a0 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f129bfff640 1 --2- 172.21.15.66:0/3799674492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c0d3670 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f129c08d970 tx=0x7f129002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1f91bef4b7aa51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f129b7fe640 1 -- 172.21.15.66:0/3799674492 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290037070 con 0x7f129c0d59d0 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f129b7fe640 1 -- 172.21.15.66:0/3799674492 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1290032440 con 0x7f129c0d59d0 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f129b7fe640 1 -- 172.21.15.66:0/3799674492 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129002ae60 con 0x7f129c0d59d0 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 -- 172.21.15.66:0/3799674492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 msgr2=0x7f129c0d3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 --2- 172.21.15.66:0/3799674492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c0d3670 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f129c08d970 tx=0x7f129002a110 comp rx=0 tx=0).stop 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 -- 172.21.15.66:0/3799674492 shutdown_connections 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 --2- 172.21.15.66:0/3799674492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c0d3670 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 --2- 172.21.15.66:0/3799674492 >> v2:172.21.15.190:3300/0 conn(0x7f129c162940 0x7f129c0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 -- 172.21.15.66:0/3799674492 >> 172.21.15.66:0/3799674492 conn(0x7f129c09e380 msgr2=0x7f129c0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 -- 172.21.15.66:0/3799674492 shutdown_connections 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.373+0000 7f12a2d78640 1 -- 172.21.15.66:0/3799674492 wait complete. 2024-05-10T11:18:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 Processor -- start 2024-05-10T11:18:33.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 -- start start 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0b47a0 0x7f129c0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c162940 0x7f129c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f129c0d2390 con 0x7f129c0d59d0 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f129c0cfc50 con 0x7f129c162940 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.375+0000 7f12a2d78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f129c0d2510 con 0x7f129c0b47a0 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41646/0 (socket says 172.21.15.66:41646) 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 -- 172.21.15.66:0/542666030 learned_addr learned my addr 172.21.15.66:0/542666030 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12a0b14640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0b47a0 0x7f129c0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 -- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0b47a0 msgr2=0x7f129c0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0b47a0 0x7f129c0cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12a1315640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c162940 0x7f129c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 -- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c162940 msgr2=0x7f129c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c162940 0x7f129c0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 -- 172.21.15.66:0/542666030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c0b1ec0 con 0x7f129c0d59d0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f129bfff640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c155c30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f1290000c00 tx=0x7f12900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290037050 con 0x7f129c0d59d0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1290038040 con 0x7f129c0d59d0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290004470 con 0x7f129c0d59d0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129c0b21a0 con 0x7f129c0d59d0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.376+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129c0b2c80 con 0x7f129c0d59d0 2024-05-10T11:18:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.377+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129c06a220 con 0x7f129c0d59d0 2024-05-10T11:18:33.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.378+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1290030900 con 0x7f129c0d59d0 2024-05-10T11:18:33.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.378+0000 7f12997fa640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:33.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.378+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f12900b82f0 con 0x7f129c0d59d0 2024-05-10T11:18:33.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.379+0000 7f12a0b14640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:33.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.379+0000 7f12a0b14640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f128c006fd0 tx=0x7f128c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.383+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1290081a70 con 0x7f129c0d59d0 2024-05-10T11:18:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.618+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f129c0d2730 con 0x7f129c0d59d0 2024-05-10T11:18:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.619+0000 7f12997fa640 1 -- 172.21.15.66:0/542666030 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7f1290081370 con 0x7f129c0d59d0 2024-05-10T11:18:33.619 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 msgr2=0x7f1288078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f128c006fd0 tx=0x7f128c008040 comp rx=0 tx=0).stop 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 msgr2=0x7f129c155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c155c30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f1290000c00 tx=0x7f12900046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 shutdown_connections 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f12880762d0 0x7f1288078790 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c162940 0x7f129c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f129c0d59d0 0x7f129c155c30 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 --2- 172.21.15.66:0/542666030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f129c0b47a0 0x7f129c0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 >> 172.21.15.66:0/542666030 conn(0x7f129c09e380 msgr2=0x7f129c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 shutdown_connections 2024-05-10T11:18:33.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33.621+0000 7f12a2d78640 1 -- 172.21.15.66:0/542666030 wait complete. 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:18:33.633 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:18:33.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:33.634 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.650 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42380sec preferred_lft 42380sec 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.651 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:18:33.652 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:18:33.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:33.653 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:18:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:18:33.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:33.716 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:18:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:18:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:18:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:18:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:18:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:18:33.774 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:18:33.774 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:18:33.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:18:33.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:18:33.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:18:33.775 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:18:33.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:18:33.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:18:33.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:33.906 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:18:33.922 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:18:33.922 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:18:33.922 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:18:33.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:33.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:18:33.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:18:33.990 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:34.046 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:18:34.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:18:34.047 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:34.103 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:18:34.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:34.104 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:34.188 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:34.188 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:18:34.188 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:18:34.197 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:34.197 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:18:34.197 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:18:34.197 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:18:34.197 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:18:34.208 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:18:34.208 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:18:34.208 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:18:34.208 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:18:34.208 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:18:34.208 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:18:34.209 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:18:34.211 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:18:34.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:34.211 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:18:34.237 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:18:34.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:18:34.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:18:34.335 INFO:teuthology.orchestra.run.smithi066.stdout:client6337 2024-05-10T11:18:34.335 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:18:34.335 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:18:34.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:34.352 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-05-10T11:18:34.410 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:18:34.410+0000 7f1a5e808640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-05-10T11:18:34.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:18:34.411 INFO:teuthology.orchestra.run.smithi066.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-05-10T11:18:34.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:34.412 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-05-10T11:18:34.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.560+0000 7f5af5609640 1 Processor -- start 2024-05-10T11:18:34.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.560+0000 7f5af5609640 1 -- start start 2024-05-10T11:18:34.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5af5609640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5af0162990 0x7f5af00b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5af5609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 0x7f5af00d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5af5609640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00d0830 con 0x7f5af00d1aa0 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5af5609640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5af00d10d0 con 0x7f5af0162990 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5af5609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00d0b10 con 0x7f5af00b5f30 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aef7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5af00d1aa0 0x7f5af01630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:58848/0 (socket says 172.21.15.66:58848) 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aef7fe640 1 -- 172.21.15.66:0/500893909 learned_addr learned my addr 172.21.15.66:0/500893909 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016278132 0 0) 0x7f5af00d0830 con 0x7f5af00d1aa0 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 0x7f5af00d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/500893909 >> v2:172.21.15.190:3300/0 conn(0x7f5af0162990 0x7f5af00b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ad8003520 con 0x7f5af00d1aa0 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555382051 0 0) 0x7f5ad8003520 con 0x7f5af00d1aa0 2024-05-10T11:18:34.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 msgr2=0x7f5af00d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 0x7f5af00d59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 >> v2:172.21.15.190:3300/0 conn(0x7f5af0162990 msgr2=0x7f5af00b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.561+0000 7f5aedffb640 1 --2- 172.21.15.66:0/500893909 >> v2:172.21.15.190:3300/0 conn(0x7f5af0162990 0x7f5af00b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00d0df0 con 0x7f5af00d1aa0 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f5ae80019f0 con 0x7f5af00d1aa0 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 >> v1:172.21.15.66:6789/0 conn(0x7f5af00d1aa0 legacy=0x7f5af01630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80039b0 0x7f5ad8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 0x7f5ad8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad8004d40 0x7f5ad80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00d10d0 con 0x7f5ad80039b0 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00d0b10 con 0x7f5ad8004d40 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad800b9c0 con 0x7f5af00b5f30 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80039b0 0x7f5ad8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 0x7f5ad8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad8004d40 0x7f5ad80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aeeffd640 1 -- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 msgr2=0x7f5ad8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5af00b5f30 0x7f5ad8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aeeffd640 1 -- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad8004d40 msgr2=0x7f5ad80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ad8004d40 0x7f5ad80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.562+0000 7f5aeeffd640 1 -- 172.21.15.66:0/500893909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad8003520 con 0x7f5ad80039b0 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80039b0 0x7f5ad8003dd0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009ac0 tx=0x7f5ad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b29e7bf8be9d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0036070 con 0x7f5ad80039b0 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0031400 con 0x7f5ad80039b0 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5aedffb640 1 -- 172.21.15.66:0/500893909 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0009690 con 0x7f5ad80039b0 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5af5609640 1 -- 172.21.15.66:0/500893909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80039b0 msgr2=0x7f5ad8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5af5609640 1 --2- 172.21.15.66:0/500893909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad80039b0 0x7f5ad8003dd0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009ac0 tx=0x7f5ad8005830 comp rx=0 tx=0).stop 2024-05-10T11:18:34.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.563+0000 7f5aef7fe640 1 -- 172.21.15.66:0/500893909 reap_dead start 2024-05-10T11:18:34.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.564+0000 7f5af5609640 1 -- 172.21.15.66:0/500893909 shutdown_connections 2024-05-10T11:18:34.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.564+0000 7f5af5609640 1 -- 172.21.15.66:0/500893909 >> 172.21.15.66:0/500893909 conn(0x7f5af009e3f0 msgr2=0x7f5af00d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.564+0000 7f5af5609640 1 -- 172.21.15.66:0/500893909 shutdown_connections 2024-05-10T11:18:34.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.564+0000 7f5af5609640 1 -- 172.21.15.66:0/500893909 wait complete. 2024-05-10T11:18:34.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.565+0000 7f5af5609640 1 Processor -- start 2024-05-10T11:18:34.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.565+0000 7f5af5609640 1 -- start start 2024-05-10T11:18:34.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad80039b0 0x7f5af00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af00b9e00 0x7f5af00cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 0x7f5af01f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00d1f30 con 0x7f5af01f5e40 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0162d70 con 0x7f5af00b9e00 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00d20b0 con 0x7f5ad80039b0 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 0x7f5af01f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 0x7f5af01f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41666/0 (socket says 172.21.15.66:41666) 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1492558591 learned_addr learned my addr 172.21.15.66:0/1492558591 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af00b9e00 0x7f5af00cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad80039b0 msgr2=0x7f5af00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad80039b0 0x7f5af00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad80039b0 0x7f5af00c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af00b9e00 msgr2=0x7f5af00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af00b9e00 0x7f5af00cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1492558591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00b9a30 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 0x7f5af01f52b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5af006cd80 tx=0x7f5ae8007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5ad77fe640 1 -- 172.21.15.66:0/1492558591 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800ab80 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5ad77fe640 1 -- 172.21.15.66:0/1492558591 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae8019070 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.566+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af00ca1f0 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.567+0000 7f5ad77fe640 1 -- 172.21.15.66:0/1492558591 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80133f0 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.567+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af00ca7b0 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.568+0000 7f5ad77fe640 1 -- 172.21.15.66:0/1492558591 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5ae8013590 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.569+0000 7f5ad77fe640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5adc0762d0 0x7f5adc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.569+0000 7f5ad77fe640 1 -- 172.21.15.66:0/1492558591 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f5ae8097d40 con 0x7f5af01f5e40 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.569+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5adc0762d0 0x7f5adc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.570+0000 7f5af8404740 1 Processor -- start 2024-05-10T11:18:34.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.570+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5adc0762d0 0x7f5adc078790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0033000 tx=0x7f5ae0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.570+0000 7f5af8404740 1 -- start start 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc16ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5af8404740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc16ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16bc4f0 0x557dc16bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5af8404740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557dc1625bc0 con 0x557dc16e9c70 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557dc15ded30 con 0x557dc16e9890 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557dc1621b80 con 0x557dc16bc4f0 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc16ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc16ec5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41670/0 (socket says 172.21.15.66:41670) 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 -- 172.21.15.66:0/2806828023 learned_addr learned my addr 172.21.15.66:0/2806828023 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc16ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16bc4f0 0x557dc16bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 -- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16bc4f0 msgr2=0x557dc16bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16bc4f0 0x557dc16bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 -- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 msgr2=0x557dc16ec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc16ec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 -- 172.21.15.66:0/2806828023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc15c3100 con 0x557dc16e9c70 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc16ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc16ec5e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009ab0 tx=0x7f5ae4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d805902d4a7fc6f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5ad4ff9640 1 -- 172.21.15.66:0/2806828023 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae401b070 con 0x557dc16e9c70 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5ad4ff9640 1 -- 172.21.15.66:0/2806828023 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae4013bf0 con 0x557dc16e9c70 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.571+0000 7f5ad4ff9640 1 -- 172.21.15.66:0/2806828023 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4016460 con 0x557dc16e9c70 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 -- 172.21.15.66:0/2806828023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 msgr2=0x557dc16ec5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc16ec5e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009ab0 tx=0x7f5ae4009190 comp rx=0 tx=0).stop 2024-05-10T11:18:34.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 -- 172.21.15.66:0/2806828023 shutdown_connections 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16bc4f0 0x557dc16bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc16ec5e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 --2- 172.21.15.66:0/2806828023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc16ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 -- 172.21.15.66:0/2806828023 >> 172.21.15.66:0/2806828023 conn(0x557dc16be760 msgr2=0x557dc17070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 -- 172.21.15.66:0/2806828023 shutdown_connections 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.572+0000 7f5af8404740 1 -- 172.21.15.66:0/2806828023 wait complete. 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.573+0000 7f5af8404740 1 -- start start 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.573+0000 7f5af8404740 1 Processor -- start 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc17016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc16df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc16ff930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557dc16c1910 con 0x557dc16e0780 2024-05-10T11:18:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557dc15e2870 con 0x557dc16e9890 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557dc16c1bf0 con 0x557dc16e9c70 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 10 client.0 _ll_register_callbacks cb 0x557dc1632b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc16ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc16ff930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41680/0 (socket says 172.21.15.66:41680) 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 -- 172.21.15.66:0/233882264 learned_addr learned my addr 172.21.15.66:0/233882264 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc17016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc16df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 -- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 msgr2=0x557dc16df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc16df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 -- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 msgr2=0x557dc17016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc17016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 -- 172.21.15.66:0/233882264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc14037b0 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc17016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc16ff930 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8060ac0 tx=0x7f5ae8060990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b704d4c160474d5b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5acdffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5acdffb640 1 -- 172.21.15.66:0/233882264 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8065170 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5acdffb640 1 -- 172.21.15.66:0/233882264 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f5ae8094cb0 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.574+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae4013bf0 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5acdffb640 1 -- 172.21.15.66:0/233882264 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f5ae807f050 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 10 client.7134 fetch_fsmap learned FSMap version 69 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x557dc1463f40 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5acdffb640 1 -- 172.21.15.66:0/233882264 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae4013bf0 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5acdffb640 1 -- 172.21.15.66:0/233882264 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 3494+0+0 (secure 0 0 0) 0x7f5ae8082020 con 0x557dc16e0780 2024-05-10T11:18:34.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 10 client.7134 fetch_fsmap finished waiting for FSMap version 69 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 10 client.7134 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 20 client.7134 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc16e0c00 0x557dc170a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 4 client.7134 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dc16337d0 con 0x557dc16e0c00 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc16e0c00 0x557dc170a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc16e0c00 0x557dc170a220 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6fccfd8237254ea server_cookie=a9ccf674f75f54f in_seq=0 out_seq=0 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.575+0000 7f5acdffb640 10 client.7134 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5acdffb640 1 -- 172.21.15.66:0/233882264 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557dc16337d0 con 0x557dc16e0c00 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5acdffb640 10 client.7134 handle_command_reply: tid=0 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 client.7134 shutdown 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 msgr2=0x557dc16ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc16ff930 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8060ac0 tx=0x7f5ae8060990 comp rx=0 tx=0).stop 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 shutdown_connections 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc16e0c00 0x557dc170a220 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc16ff930 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc16df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5acdffb640 0 client.7134 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 --2- 172.21.15.66:0/233882264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc17016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 >> 172.21.15.66:0/233882264 conn(0x557dc16bc4f0 msgr2=0x557dc16bd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 shutdown_connections 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 1 -- 172.21.15.66:0/233882264 wait complete. 2024-05-10T11:18:34.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.576+0000 7f5af8404740 20 client.7134 trim_cache size 0 max 16384 2024-05-10T11:18:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.594+0000 7f5af8404740 1 Processor -- start 2024-05-10T11:18:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 -- start start 2024-05-10T11:18:34.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc170a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc170a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc172b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0202560 con 0x557dc16e0780 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0201540 con 0x557dc16e9890 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00b8750 con 0x557dc16e9c70 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc170a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc170a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41682/0 (socket says 172.21.15.66:41682) 2024-05-10T11:18:34.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.595+0000 7f5aeeffd640 1 -- 172.21.15.66:0/4057392475 learned_addr learned my addr 172.21.15.66:0/4057392475 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5aeeffd640 1 -- 172.21.15.66:0/4057392475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 msgr2=0x557dc172b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc172b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5aeeffd640 1 -- 172.21.15.66:0/4057392475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 msgr2=0x557dc170a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc170a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5aeeffd640 1 -- 172.21.15.66:0/4057392475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc12f70a0 con 0x557dc16e0780 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc170a1e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009be0 tx=0x7f5ae002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523bfa9af6951cc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5acffff640 1 -- 172.21.15.66:0/4057392475 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0036050 con 0x557dc16e0780 2024-05-10T11:18:34.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5acffff640 1 -- 172.21.15.66:0/4057392475 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0053070 con 0x557dc16e0780 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5acffff640 1 -- 172.21.15.66:0/4057392475 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0003c60 con 0x557dc16e0780 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 -- 172.21.15.66:0/4057392475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 msgr2=0x557dc170a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc170a1e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009be0 tx=0x7f5ae002e000 comp rx=0 tx=0).stop 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 -- 172.21.15.66:0/4057392475 shutdown_connections 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9c70 0x557dc172b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e9890 0x557dc170a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 --2- 172.21.15.66:0/4057392475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e0780 0x557dc170a1e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.596+0000 7f5af8404740 1 -- 172.21.15.66:0/4057392475 >> 172.21.15.66:0/4057392475 conn(0x557dc16bc4f0 msgr2=0x557dc16df4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.597+0000 7f5af8404740 1 -- 172.21.15.66:0/4057392475 shutdown_connections 2024-05-10T11:18:34.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.597+0000 7f5af8404740 1 -- 172.21.15.66:0/4057392475 wait complete. 2024-05-10T11:18:34.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.597+0000 7f5af8404740 1 -- start start 2024-05-10T11:18:34.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.597+0000 7f5af8404740 1 Processor -- start 2024-05-10T11:18:34.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e0780 0x557dc17823a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9890 0x557dc170a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc1702190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557dc1704450 con 0x557dc16e9c70 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0200ef0 con 0x557dc16e0780 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557dc170ac60 con 0x557dc16e9890 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5af8404740 10 client.0 _ll_register_callbacks cb 0x7f5ae8060710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc1702190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc1702190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41684/0 (socket says 172.21.15.66:41684) 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1854901588 learned_addr learned my addr 172.21.15.66:0/1854901588 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e0780 0x557dc17823a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9890 0x557dc170a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9890 msgr2=0x557dc170a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9890 0x557dc170a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e0780 msgr2=0x557dc17823a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e0780 0x557dc17823a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 -- 172.21.15.66:0/1854901588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc16e3400 con 0x557dc16e9c70 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aee7fc640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9890 0x557dc170a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5aef7fe640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc1702190 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8000f80 tx=0x7f5ae8095f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3049517b7daa77 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.598+0000 7f5acdffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5acdffb640 1 -- 172.21.15.66:0/1854901588 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8065170 con 0x557dc16e9c70 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5acdffb640 1 -- 172.21.15.66:0/1854901588 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f5ae805c730 con 0x557dc16e9c70 2024-05-10T11:18:34.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae0053070 con 0x557dc16e9c70 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5acdffb640 1 -- 172.21.15.66:0/1854901588 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f5ae8069b90 con 0x557dc16e9c70 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 10 client.7140 fetch_fsmap learned FSMap version 69 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x557dc16bb510 con 0x557dc16e9c70 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5acdffb640 1 -- 172.21.15.66:0/1854901588 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0053070 con 0x557dc16e9c70 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5acdffb640 1 -- 172.21.15.66:0/1854901588 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 3494+0+0 (secure 0 0 0) 0x7f5ae805c930 con 0x557dc16e9c70 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 10 client.7140 fetch_fsmap finished waiting for FSMap version 69 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 10 client.7140 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 20 client.7140 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc1707110 0x557dc17026d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 4 client.7140 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x557dc16c1f60 con 0x557dc1707110 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.599+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc1707110 0x557dc17026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5aeeffd640 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc1707110 0x557dc17026d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8065f7cfcb4b1fba server_cookie=b546aec911e2283c in_seq=0 out_seq=0 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5acdffb640 10 client.7140 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5acdffb640 1 -- 172.21.15.66:0/1854901588 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557dc16c1f60 con 0x557dc1707110 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5acdffb640 10 client.7140 handle_command_reply: tid=0 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 client.7140 shutdown 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 msgr2=0x557dc1702190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc1702190 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8000f80 tx=0x7f5ae8095f60 comp rx=0 tx=0).stop 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 shutdown_connections 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557dc1707110 0x557dc17026d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557dc16e9c70 0x557dc1702190 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557dc16e9890 0x557dc170a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 --2- 172.21.15.66:0/1854901588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557dc16e0780 0x557dc17823a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 >> 172.21.15.66:0/1854901588 conn(0x557dc16bc4f0 msgr2=0x557dc16ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5acdffb640 0 client.7140 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.613 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f1a5e808640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0) n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x559b585f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-05-10T11:18:34.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 shutdown_connections 2024-05-10T11:18:34.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.600+0000 7f5af8404740 1 -- 172.21.15.66:0/1854901588 wait complete. 2024-05-10T11:18:34.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af8404740 20 client.7140 trim_cache size 0 max 16384 2024-05-10T11:18:34.614 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:18:34.614 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:18:34.614 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "8b976a90-5ef3-4cd0-97bc-ec6474dd7483", 2024-05-10T11:18:34.614 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:18:34.614 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5adc0762d0 msgr2=0x7f5adc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5adc0762d0 0x7f5adc078790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0033000 tx=0x7f5ae0008030 comp rx=0 tx=0).stop 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 msgr2=0x7f5af01f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 0x7f5af01f52b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5af006cd80 tx=0x7f5ae8007b20 comp rx=0 tx=0).stop 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 shutdown_connections 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5adc0762d0 0x7f5adc078790 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af01f5e40 0x7f5af01f52b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af00b9e00 0x7f5af00cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 --2- 172.21.15.66:0/1492558591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ad80039b0 0x7f5af00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 >> 172.21.15.66:0/1492558591 conn(0x7f5af009e3f0 msgr2=0x7f5af00b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 shutdown_connections 2024-05-10T11:18:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.601+0000 7f5af5609640 1 -- 172.21.15.66:0/1492558591 wait complete. 2024-05-10T11:18:34.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:18:34.617 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T11:18:34.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.723+0000 7f0d443dd640 1 Processor -- start 2024-05-10T11:18:34.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.723+0000 7f0d443dd640 1 -- start start 2024-05-10T11:18:34.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d443dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d3c162ce0 0x7f0d3c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d443dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d443dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0d4190 con 0x7f0d3c162900 2024-05-10T11:18:34.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d443dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c0cfc40 con 0x7f0d3c162ce0 2024-05-10T11:18:34.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d443dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0d3eb0 con 0x7f0d3c0b4e20 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d4297a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d41978640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d3c162ce0 0x7f0d3c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d42179640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0d3c162900 0x7f0d3c0d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:38816/0 (socket says 172.21.15.66:38816) 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d42179640 1 -- 172.21.15.66:0/916181539 learned_addr learned my addr 172.21.15.66:0/916181539 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d41978640 1 -- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 msgr2=0x7f0d3c0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d41978640 1 --2- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d41978640 1 -- 172.21.15.66:0/916181539 >> v1:172.21.15.190:6789/0 conn(0x7f0d3c162900 legacy=0x7f0d3c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d41978640 1 -- 172.21.15.66:0/916181539 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0cfee0 con 0x7f0d3c162ce0 2024-05-10T11:18:34.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.724+0000 7f0d41177640 1 -- 172.21.15.66:0/916181539 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358979000 0 0) 0x7f0d38001110 con 0x7f0d3c162900 2024-05-10T11:18:34.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.725+0000 7f0d41978640 1 --2- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c0b48e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097a0 tx=0x7f0d2c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69de61b7664ada62 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.725+0000 7f0d41177640 1 -- 172.21.15.66:0/916181539 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c037070 con 0x7f0d3c162ce0 2024-05-10T11:18:34.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d41177640 1 -- 172.21.15.66:0/916181539 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c02ae50 con 0x7f0d3c162ce0 2024-05-10T11:18:34.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d41177640 1 -- 172.21.15.66:0/916181539 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c032660 con 0x7f0d3c162ce0 2024-05-10T11:18:34.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 -- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 msgr2=0x7f0d3c0b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 --2- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c0b48e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097a0 tx=0x7f0d2c02a100 comp rx=0 tx=0).stop 2024-05-10T11:18:34.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 -- 172.21.15.66:0/916181539 shutdown_connections 2024-05-10T11:18:34.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 --2- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 --2- 172.21.15.66:0/916181539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c0b48e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 -- 172.21.15.66:0/916181539 >> 172.21.15.66:0/916181539 conn(0x7f0d3c09e430 msgr2=0x7f0d3c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 -- 172.21.15.66:0/916181539 shutdown_connections 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.726+0000 7f0d443dd640 1 -- 172.21.15.66:0/916181539 wait complete. 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.727+0000 7f0d443dd640 1 Processor -- start 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.727+0000 7f0d443dd640 1 -- start start 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d443dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d443dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 0x7f0d3c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d443dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d443dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0b4180 con 0x7f0d3c162900 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d443dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0d3b20 con 0x7f0d3c162ce0 2024-05-10T11:18:34.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d443dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0b4300 con 0x7f0d3c0b4e20 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d41978640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 0x7f0d3c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d41978640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 0x7f0d3c14d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60812/0 (socket says 172.21.15.66:60812) 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d41978640 1 -- 172.21.15.66:0/3599180767 learned_addr learned my addr 172.21.15.66:0/3599180767 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d42179640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.728+0000 7f0d4297a640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d41978640 1 -- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 msgr2=0x7f0d3c0b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d41978640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d41978640 1 -- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 msgr2=0x7f0d3c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d41978640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d41978640 1 -- 172.21.15.66:0/3599180767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0b81a0 con 0x7f0d3c162900 2024-05-10T11:18:34.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d41978640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 0x7f0d3c14d470 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097a0 tx=0x7f0d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d32ffd640 1 -- 172.21.15.66:0/3599180767 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c037040 con 0x7f0d3c162900 2024-05-10T11:18:34.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d32ffd640 1 -- 172.21.15.66:0/3599180767 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c004030 con 0x7f0d3c162900 2024-05-10T11:18:34.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c0cc250 con 0x7f0d3c162900 2024-05-10T11:18:34.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d32ffd640 1 -- 172.21.15.66:0/3599180767 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c004420 con 0x7f0d3c162900 2024-05-10T11:18:34.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.729+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c0cc810 con 0x7f0d3c162900 2024-05-10T11:18:34.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.731+0000 7f0d32ffd640 1 -- 172.21.15.66:0/3599180767 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d2c003610 con 0x7f0d3c162900 2024-05-10T11:18:34.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.732+0000 7f0d32ffd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d20076300 0x7f0d200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.732+0000 7f0d32ffd640 1 -- 172.21.15.66:0/3599180767 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f0d2c0b8310 con 0x7f0d3c162900 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.732+0000 7f0d42179640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d20076300 0x7f0d200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.733+0000 7f0d42179640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d20076300 0x7f0d200787c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0d38000f60 tx=0x7f0d38007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.733+0000 7f0d471d3740 1 Processor -- start 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.733+0000 7f0d471d3740 1 -- start start 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be99d9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a09600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a09b40 0x563be99de950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d471d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563be99a6690 con 0x563be9a0a280 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563be9943f30 con 0x563be9a09b40 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563be98fcb20 con 0x563be9a27160 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a09600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a09600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60816/0 (socket says 172.21.15.66:60816) 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 -- 172.21.15.66:0/1348632939 learned_addr learned my addr 172.21.15.66:0/1348632939 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d4297a640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a09b40 0x563be99de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d42179640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be99d9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 -- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 msgr2=0x563be99d9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be99d9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 -- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a09b40 msgr2=0x563be99de950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a09b40 0x563be99de950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 -- 172.21.15.66:0/1348632939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be98f4e60 con 0x563be9a0a280 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d4297a640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a09b40 0x563be99de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d42179640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be99d9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d41978640 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a09600 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c035040 tx=0x7f0d2c07d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109d469b48984e25 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d1ffff640 1 -- 172.21.15.66:0/1348632939 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c080fe0 con 0x563be9a0a280 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d1ffff640 1 -- 172.21.15.66:0/1348632939 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c02ae50 con 0x563be9a0a280 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.734+0000 7f0d1ffff640 1 -- 172.21.15.66:0/1348632939 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0814d0 con 0x563be9a0a280 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 -- 172.21.15.66:0/1348632939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 msgr2=0x563be9a09600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a09600 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c035040 tx=0x7f0d2c07d450 comp rx=0 tx=0).stop 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 -- 172.21.15.66:0/1348632939 shutdown_connections 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a09b40 0x563be99de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a09600 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1348632939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be99d9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 -- 172.21.15.66:0/1348632939 >> 172.21.15.66:0/1348632939 conn(0x563be99dbd60 msgr2=0x563be9a24600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 -- 172.21.15.66:0/1348632939 shutdown_connections 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.735+0000 7f0d471d3740 1 -- 172.21.15.66:0/1348632939 wait complete. 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.736+0000 7f0d471d3740 1 -- start start 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.736+0000 7f0d471d3740 1 Processor -- start 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be9a0c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be99f7740 0x563be99f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563be99005e0 con 0x563be9a0a280 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563be993fef0 con 0x563be99f7740 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563be9943f30 con 0x563be9a27160 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 10 client.0 _ll_register_callbacks cb 0x563be98fb320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a23600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60830/0 (socket says 172.21.15.66:60830) 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 -- 172.21.15.66:0/1230637855 learned_addr learned my addr 172.21.15.66:0/1230637855 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d41978640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be9a0c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d4297a640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be99f7740 0x563be99f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 -- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 msgr2=0x563be9a0c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be9a0c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 -- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be99f7740 msgr2=0x563be99f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be99f7740 0x563be99f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 -- 172.21.15.66:0/1230637855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be971f7d0 con 0x563be9a0a280 2024-05-10T11:18:34.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d41978640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be9a0c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d4297a640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be99f7740 0x563be99f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d42179640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a23600 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0d380136d0 tx=0x7f0d38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744a7242b5ff0fe6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/1230637855 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38026060 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/1230637855 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f0d38021c80 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.737+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2c02ae50 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/1230637855 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f0d38019070 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 10 client.7149 fetch_fsmap learned FSMap version 69 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x563be96553f0 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/1230637855 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c02ae50 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/1230637855 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 3494+0+0 (secure 0 0 0) 0x7f0d3801f070 con 0x563be9a0a280 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 10 client.7149 fetch_fsmap finished waiting for FSMap version 69 2024-05-10T11:18:34.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 10 client.7149 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 20 client.7149 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be9a0b660 0x563be9a0ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 4 client.7149 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563be9951b40 con 0x563be9a0b660 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d41978640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be9a0b660 0x563be9a0ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d1d7fa640 10 client.7149 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.738+0000 7f0d41978640 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be9a0b660 0x563be9a0ba80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d376792ec17939 server_cookie=c3e00ab1c43f4537 in_seq=0 out_seq=0 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/1230637855 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563be9951b40 con 0x563be9a0b660 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d1d7fa640 10 client.7149 handle_command_reply: tid=0 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 client.7149 shutdown 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 msgr2=0x563be9a23600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a23600 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0d380136d0 tx=0x7f0d38000ed0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 shutdown_connections 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be9a0b660 0x563be9a0ba80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be99f7740 0x563be99f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a27160 0x563be9a0c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d1d7fa640 0 client.7149 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 --2- 172.21.15.66:0/1230637855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a0a280 0x563be9a23600 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 >> 172.21.15.66:0/1230637855 conn(0x563be9a09b40 msgr2=0x563be99d9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 shutdown_connections 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 1 -- 172.21.15.66:0/1230637855 wait complete. 2024-05-10T11:18:34.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.739+0000 7f0d471d3740 20 client.7149 trim_cache size 0 max 16384 2024-05-10T11:18:34.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.758+0000 7f0d471d3740 1 Processor -- start 2024-05-10T11:18:34.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.758+0000 7f0d471d3740 1 -- start start 2024-05-10T11:18:34.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.758+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be99f7740 0x563be99dd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.758+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a0a280 0x563be99ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 0x563be9a21070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d471d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c201f90 con 0x563be9a27160 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c201040 con 0x563be9a0a280 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0b3ba0 con 0x563be99f7740 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 0x563be9a21070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 0x563be9a21070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60838/0 (socket says 172.21.15.66:60838) 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 -- 172.21.15.66:0/283965382 learned_addr learned my addr 172.21.15.66:0/283965382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 -- 172.21.15.66:0/283965382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be99f7740 msgr2=0x563be99dd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be99f7740 0x563be99dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 -- 172.21.15.66:0/283965382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a0a280 msgr2=0x563be99ddb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a0a280 0x563be99ddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 -- 172.21.15.66:0/283965382 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be96150f0 con 0x563be9a27160 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d4297a640 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 0x563be9a21070 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0d340076b0 tx=0x7f0d34009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289f05951dd48fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d1f7fe640 1 -- 172.21.15.66:0/283965382 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3401d070 con 0x563be9a27160 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d1f7fe640 1 -- 172.21.15.66:0/283965382 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d340148d0 con 0x563be9a27160 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.759+0000 7f0d1f7fe640 1 -- 172.21.15.66:0/283965382 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34014cc0 con 0x563be9a27160 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 -- 172.21.15.66:0/283965382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 msgr2=0x563be9a21070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 0x563be9a21070 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0d340076b0 tx=0x7f0d34009750 comp rx=0 tx=0).stop 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 -- 172.21.15.66:0/283965382 shutdown_connections 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be9a27160 0x563be9a21070 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a0a280 0x563be99ddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 --2- 172.21.15.66:0/283965382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be99f7740 0x563be99dd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 -- 172.21.15.66:0/283965382 >> 172.21.15.66:0/283965382 conn(0x563be9a09b40 msgr2=0x563be9a0c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 -- 172.21.15.66:0/283965382 shutdown_connections 2024-05-10T11:18:34.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 -- 172.21.15.66:0/283965382 wait complete. 2024-05-10T11:18:34.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 -- start start 2024-05-10T11:18:34.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.760+0000 7f0d471d3740 1 Processor -- start 2024-05-10T11:18:34.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 0x563be9aa4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a0a280 0x563be9a36fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a27160 0x563be9a3dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563be99a6690 con 0x563be99f7740 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0cdde0 con 0x563be9a27160 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x563be9a286f0 con 0x563be9a0a280 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d471d3740 10 client.0 _ll_register_callbacks cb 0x7f0d38004940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.761+0000 7f0d42179640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 0x563be9aa4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 0x563be9aa4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60844/0 (socket says 172.21.15.66:60844) 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 -- 172.21.15.66:0/3059549495 learned_addr learned my addr 172.21.15.66:0/3059549495 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d41978640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a0a280 0x563be9a36fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d4297a640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a27160 0x563be9a3dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 -- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a0a280 msgr2=0x563be9a36fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a0a280 0x563be9a36fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 -- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a27160 msgr2=0x563be9a3dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a27160 0x563be9a3dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 -- 172.21.15.66:0/3059549495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be9a215e0 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d4297a640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a27160 0x563be9a3dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d42179640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 0x563be9aa4a90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0d380078c0 tx=0x7f0d38001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608ff88a15ce212f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/3059549495 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38039060 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/3059549495 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f0d38031040 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d340148d0 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/3059549495 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f0d3803f050 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d471d3740 10 client.7155 fetch_fsmap learned FSMap version 69 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.762+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x563be99dfe60 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/3059549495 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d340148d0 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/3059549495 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 3494+0+0 (secure 0 0 0) 0x7f0d38042020 con 0x563be99f7740 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 10 client.7155 fetch_fsmap finished waiting for FSMap version 69 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 10 client.7155 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:18:34.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 20 client.7155 populate_metadata read hostname 'smithi066' 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be99f6300 0x563be9a3e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 4 client.7155 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563be994b9b0 con 0x563be99f6300 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d41978640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be99f6300 0x563be9a3e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d1d7fa640 10 client.7155 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d41978640 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be99f6300 0x563be9a3e010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27d5af5bdcaf163 server_cookie=bc924d875ff98e49 in_seq=0 out_seq=0 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d1d7fa640 1 -- 172.21.15.66:0/3059549495 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x563be994b9b0 con 0x563be99f6300 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d1d7fa640 10 client.7155 handle_command_reply: tid=0 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 1 client.7155 shutdown 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 msgr2=0x563be9aa4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.763+0000 7f0d471d3740 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 0x563be9aa4a90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0d380078c0 tx=0x7f0d38001080 comp rx=0 tx=0).stop 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 shutdown_connections 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x563be99f6300 0x563be9a3e010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563be9a27160 0x563be9a3dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563be9a0a280 0x563be9a36fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d1d7fa640 0 client.7155 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 --2- 172.21.15.66:0/3059549495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be99f7740 0x563be9aa4a90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 >> 172.21.15.66:0/3059549495 conn(0x563be9a09b40 msgr2=0x563be9a260f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 shutdown_connections 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 1 -- 172.21.15.66:0/3059549495 wait complete. 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d471d3740 20 client.7155 trim_cache size 0 max 16384 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:18:34.772 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: "8b976a90-5ef3-4cd0-97bc-ec6474dd7483": { 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/dir", 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "8b976a90-5ef3-4cd0-97bc-ec6474dd7483", 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive" 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:18:34.773 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d20076300 msgr2=0x7f0d200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d20076300 0x7f0d200787c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0d38000f60 tx=0x7f0d38007b50 comp rx=0 tx=0).stop 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 msgr2=0x7f0d3c14d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 0x7f0d3c14d470 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097a0 tx=0x7f0d2c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 shutdown_connections 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d20076300 0x7f0d200787c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d3c162ce0 0x7f0d3c15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d3c162900 0x7f0d3c14d470 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 --2- 172.21.15.66:0/3599180767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d3c0b4e20 0x7f0d3c0b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:18:34.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 >> 172.21.15.66:0/3599180767 conn(0x7f0d3c09e430 msgr2=0x7f0d3c06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:18:34.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 shutdown_connections 2024-05-10T11:18:34.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:18:34.764+0000 7f0d443dd640 1 -- 172.21.15.66:0/3599180767 wait complete. 2024-05-10T11:18:34.776 INFO:tasks.cephfs.filesystem:scrub status for tag:8b976a90-5ef3-4cd0-97bc-ec6474dd7483 - {'path': '/dir', 'tag': '8b976a90-5ef3-4cd0-97bc-ec6474dd7483', 'options': 'recursive'} 2024-05-10T11:18:34.847 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:18:34.847+0000 7fa7d81b5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T11:18:36.467 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:18:36.467+0000 7f1a62810640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:19:02.517 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:19:02.520 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:19:04.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:04.776 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T11:19:04.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.895+0000 7fbe5da46640 1 Processor -- start 2024-05-10T11:19:04.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.895+0000 7fbe5da46640 1 -- start start 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.896+0000 7fbe5da46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbe580d2d10 0x7fbe580d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.896+0000 7fbe5da46640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe580d31a0 con 0x7fbe580d1f50 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.896+0000 7fbe5da46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe580d41d0 con 0x7fbe580d3df0 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.896+0000 7fbe5da46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbe580cfd50 con 0x7fbe580d2d10 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.896+0000 7fbe577fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbe580d1f50 0x7fbe580d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34500/0 (socket says 172.21.15.66:34500) 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.896+0000 7fbe577fe640 1 -- 172.21.15.66:0/365309379 learned_addr learned my addr 172.21.15.66:0/365309379 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe567fc640 1 --2- 172.21.15.66:0/365309379 >> v2:172.21.15.190:3300/0 conn(0x7fbe580d2d10 0x7fbe580d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591691708 0 0) 0x7fbe580d31a0 con 0x7fbe580d1f50 2024-05-10T11:19:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe40003520 con 0x7fbe580d1f50 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2229252362 0 0) 0x7fbe40003520 con 0x7fbe580d1f50 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 >> v2:172.21.15.190:3300/0 conn(0x7fbe580d2d10 msgr2=0x7fbe580d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 --2- 172.21.15.66:0/365309379 >> v2:172.21.15.190:3300/0 conn(0x7fbe580d2d10 0x7fbe580d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 >> v1:172.21.15.190:6789/0 conn(0x7fbe580d3df0 legacy=0x7fbe580b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe580b54f0 con 0x7fbe580d1f50 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fbe500019f0 con 0x7fbe580d1f50 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 >> v1:172.21.15.66:6789/0 conn(0x7fbe580d1f50 legacy=0x7fbe580d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe400039b0 0x7fbe40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe40004800 0x7fbe40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe400051c0 0x7fbe4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4000c030 con 0x7fbe40004800 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4000c1e0 con 0x7fbe400051c0 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4000c3e0 con 0x7fbe400039b0 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe567fc640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe40004800 0x7fbe40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe577fe640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe400051c0 0x7fbe4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.897+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe400039b0 0x7fbe40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe567fc640 1 -- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe400039b0 msgr2=0x7fbe40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe567fc640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe400039b0 0x7fbe40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe567fc640 1 -- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe400051c0 msgr2=0x7fbe4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe567fc640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe400051c0 0x7fbe4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe567fc640 1 -- 172.21.15.66:0/365309379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe40003520 con 0x7fbe40004800 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe577fe640 1 -- 172.21.15.66:0/365309379 reap_dead start 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe400039b0 0x7fbe40003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.898+0000 7fbe567fc640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe40004800 0x7fbe40004c80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009ac0 tx=0x7fbe40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6911c48a76b7638e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c036070 con 0x7fbe40004800 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c031400 con 0x7fbe40004800 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe55ffb640 1 -- 172.21.15.66:0/365309379 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c009690 con 0x7fbe40004800 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 -- 172.21.15.66:0/365309379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe40004800 msgr2=0x7fbe40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe40004800 0x7fbe40004c80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009ac0 tx=0x7fbe40005830 comp rx=0 tx=0).stop 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 -- 172.21.15.66:0/365309379 shutdown_connections 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 --2- 172.21.15.66:0/365309379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe40004800 0x7fbe40004c80 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 -- 172.21.15.66:0/365309379 >> 172.21.15.66:0/365309379 conn(0x7fbe5809e450 msgr2=0x7fbe580d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 -- 172.21.15.66:0/365309379 shutdown_connections 2024-05-10T11:19:04.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.899+0000 7fbe5da46640 1 -- 172.21.15.66:0/365309379 wait complete. 2024-05-10T11:19:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 Processor -- start 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 -- start start 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe40004800 0x7fbe580b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe580ce8f0 0x7fbe581525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 0x7fbe580b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe580d2380 con 0x7fbe580b96a0 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe580b5d90 con 0x7fbe40004800 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.901+0000 7fbe5da46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe580b5ab0 con 0x7fbe580ce8f0 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 0x7fbe580b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 0x7fbe580b9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53752/0 (socket says 172.21.15.66:53752) 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 -- 172.21.15.66:0/3192300096 learned_addr learned my addr 172.21.15.66:0/3192300096 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe40004800 0x7fbe580b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe567fc640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe580ce8f0 0x7fbe581525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 -- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe580ce8f0 msgr2=0x7fbe581525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe580ce8f0 0x7fbe581525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 -- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe40004800 msgr2=0x7fbe580b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe40004800 0x7fbe580b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 -- 172.21.15.66:0/3192300096 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe580cf070 con 0x7fbe580b96a0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe577fe640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 0x7fbe580b9b00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbe580d50a0 tx=0x7fbe50007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe3ffff640 1 -- 172.21.15.66:0/3192300096 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000abc0 con 0x7fbe580b96a0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe3ffff640 1 -- 172.21.15.66:0/3192300096 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe50018070 con 0x7fbe580b96a0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe58152af0 con 0x7fbe580b96a0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe3ffff640 1 -- 172.21.15.66:0/3192300096 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500133f0 con 0x7fbe580b96a0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.902+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe580ba6c0 con 0x7fbe580b96a0 2024-05-10T11:19:04.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.905+0000 7fbe3ffff640 1 -- 172.21.15.66:0/3192300096 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe50013590 con 0x7fbe580b96a0 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.905+0000 7fbe3ffff640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbe44076300 0x7fbe440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.905+0000 7fbe3ffff640 1 -- 172.21.15.66:0/3192300096 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbe50097d00 con 0x7fbe580b96a0 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.906+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbe44076300 0x7fbe440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.906+0000 7fbe60835740 1 Processor -- start 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.906+0000 7fbe60835740 1 -- start start 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.906+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbe44076300 0x7fbe440787c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe58069aa0 tx=0x7fbe48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe60835740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 0x557edf2b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf2e3280 0x557edf2e2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e2b40 0x557edf2b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe60835740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557edf27f690 con 0x557edf300160 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557edf21cf30 con 0x557edf2e2b40 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557edf1d5b20 con 0x557edf2e3280 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 0x557edf2b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 0x557edf2b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53756/0 (socket says 172.21.15.66:53756) 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 -- 172.21.15.66:0/3170386509 learned_addr learned my addr 172.21.15.66:0/3170386509 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe567fc640 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf2e3280 0x557edf2e2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe577fe640 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e2b40 0x557edf2b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 -- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf2e3280 msgr2=0x557edf2e2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf2e3280 0x557edf2e2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 -- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e2b40 msgr2=0x557edf2b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e2b40 0x557edf2b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.907+0000 7fbe56ffd640 1 -- 172.21.15.66:0/3170386509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557edf1cde60 con 0x557edf300160 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.908+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 0x557edf2b2af0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbe48014840 tx=0x7fbe48007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db43a7ef80818b21 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.908+0000 7fbe3d7fa640 1 -- 172.21.15.66:0/3170386509 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48026070 con 0x557edf300160 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.908+0000 7fbe3d7fa640 1 -- 172.21.15.66:0/3170386509 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4801b050 con 0x557edf300160 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.908+0000 7fbe3d7fa640 1 -- 172.21.15.66:0/3170386509 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48013d40 con 0x557edf300160 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.908+0000 7fbe60835740 1 -- 172.21.15.66:0/3170386509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 msgr2=0x557edf2b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.908+0000 7fbe60835740 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 0x557edf2b2af0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbe48014840 tx=0x7fbe48007f90 comp rx=0 tx=0).stop 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 -- 172.21.15.66:0/3170386509 shutdown_connections 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e2b40 0x557edf2b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf2e3280 0x557edf2e2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 --2- 172.21.15.66:0/3170386509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf300160 0x557edf2b2af0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 -- 172.21.15.66:0/3170386509 >> 172.21.15.66:0/3170386509 conn(0x557edf2b4d60 msgr2=0x557edf2fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 -- 172.21.15.66:0/3170386509 shutdown_connections 2024-05-10T11:19:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 -- 172.21.15.66:0/3170386509 wait complete. 2024-05-10T11:19:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 -- start start 2024-05-10T11:19:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.909+0000 7fbe60835740 1 Processor -- start 2024-05-10T11:19:04.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 0x557edf2de060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf300160 0x557edf311270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf3117b0 0x557edf2e1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557edf1d95e0 con 0x557edf2e3280 2024-05-10T11:19:04.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557edf218ef0 con 0x557edf300160 2024-05-10T11:19:04.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557edf2b6f10 con 0x557edf3117b0 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe60835740 10 client.0 _ll_register_callbacks cb 0x557edf1d4320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 0x557edf2de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 0x557edf2de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53770/0 (socket says 172.21.15.66:53770) 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 -- 172.21.15.66:0/2800475590 learned_addr learned my addr 172.21.15.66:0/2800475590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe577fe640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf3117b0 0x557edf2e1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe567fc640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf300160 0x557edf311270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 -- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf3117b0 msgr2=0x557edf2e1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf3117b0 0x557edf2e1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 -- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf300160 msgr2=0x557edf311270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf300160 0x557edf311270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.910+0000 7fbe56ffd640 1 -- 172.21.15.66:0/2800475590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557edeff87d0 con 0x557edf2e3280 2024-05-10T11:19:04.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe577fe640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf3117b0 0x557edf2e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 0x557edf2de060 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fbe48013780 tx=0x7fbe48001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ef6b30c313236 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe367fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe367fc640 1 -- 172.21.15.66:0/2800475590 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48030060 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe4801b050 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe367fc640 1 -- 172.21.15.66:0/2800475590 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbe480069d0 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe367fc640 1 -- 172.21.15.66:0/2800475590 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fbe48036050 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 10 client.7167 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x557edef2e3f0 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe367fc640 1 -- 172.21.15.66:0/2800475590 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4801b050 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe367fc640 1 -- 172.21.15.66:0/2800475590 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7fbe48039020 con 0x557edf2e3280 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 10 client.7167 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 10 client.7167 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 20 client.7167 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:04.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf2e3770 0x557edf2e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 4 client.7167 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.911+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557edf22ab40 con 0x557edf2e3770 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.912+0000 7fbe567fc640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf2e3770 0x557edf2e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.912+0000 7fbe567fc640 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf2e3770 0x557edf2e3b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79f2e2798a1b68f4 server_cookie=71524734dc3a70ce in_seq=0 out_seq=0 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.912+0000 7fbe367fc640 10 client.7167 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.912+0000 7fbe367fc640 1 -- 172.21.15.66:0/2800475590 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557edf22ab40 con 0x557edf2e3770 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.912+0000 7fbe367fc640 10 client.7167 handle_command_reply: tid=0 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.912+0000 7fbe60835740 1 client.7167 shutdown 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 msgr2=0x557edf2de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 0x557edf2de060 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fbe48013780 tx=0x7fbe48001190 comp rx=0 tx=0).stop 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 shutdown_connections 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf2e3770 0x557edf2e3b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf3117b0 0x557edf2e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf300160 0x557edf311270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe367fc640 0 client.7167 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 --2- 172.21.15.66:0/2800475590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf2e3280 0x557edf2de060 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 >> 172.21.15.66:0/2800475590 conn(0x557edf2e2b40 msgr2=0x557edf2b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 shutdown_connections 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 1 -- 172.21.15.66:0/2800475590 wait complete. 2024-05-10T11:19:04.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.913+0000 7fbe60835740 20 client.7167 trim_cache size 0 max 16384 2024-05-10T11:19:04.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.931+0000 7fbe60835740 1 Processor -- start 2024-05-10T11:19:04.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.931+0000 7fbe60835740 1 -- start start 2024-05-10T11:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf2b6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf2b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe60835740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf2b8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe60835740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58202470 con 0x557edf3117b0 2024-05-10T11:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58201490 con 0x557edf2e3280 2024-05-10T11:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe580cd5c0 con 0x557edf300160 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf2b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf2b8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53776/0 (socket says 172.21.15.66:53776) 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 -- 172.21.15.66:0/2851667699 learned_addr learned my addr 172.21.15.66:0/2851667699 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 -- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 msgr2=0x557edf2b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe567fc640 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf2b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf2b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf2b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 -- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 msgr2=0x557edf2b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf2b6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe577fe640 1 -- 172.21.15.66:0/2851667699 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557edeeee0f0 con 0x557edf3117b0 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.932+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf2b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe577fe640 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf2b8200 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fbe50060b10 tx=0x7fbe5005d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d05476a3712941e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe3cff9640 1 -- 172.21.15.66:0/2851667699 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5007a360 con 0x557edf3117b0 2024-05-10T11:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe3cff9640 1 -- 172.21.15.66:0/2851667699 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe50060e10 con 0x557edf3117b0 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe3cff9640 1 -- 172.21.15.66:0/2851667699 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500651c0 con 0x557edf3117b0 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 -- 172.21.15.66:0/2851667699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 msgr2=0x557edf2b8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf2b8200 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fbe50060b10 tx=0x7fbe5005d590 comp rx=0 tx=0).stop 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 -- 172.21.15.66:0/2851667699 shutdown_connections 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf2b8200 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf2b6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 --2- 172.21.15.66:0/2851667699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf2b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.933+0000 7fbe60835740 1 -- 172.21.15.66:0/2851667699 >> 172.21.15.66:0/2851667699 conn(0x557edf2e2b40 msgr2=0x557edf2b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.934+0000 7fbe60835740 1 -- 172.21.15.66:0/2851667699 shutdown_connections 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.934+0000 7fbe60835740 1 -- 172.21.15.66:0/2851667699 wait complete. 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.934+0000 7fbe60835740 1 -- start start 2024-05-10T11:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.934+0000 7fbe60835740 1 Processor -- start 2024-05-10T11:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf37a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf309fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf3209a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58200e40 con 0x557edf3117b0 2024-05-10T11:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557edf300b60 con 0x557edf2e3280 2024-05-10T11:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557edf2e5ed0 con 0x557edf300160 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe60835740 10 client.0 _ll_register_callbacks cb 0x7fbe48024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf3209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf3209a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53786/0 (socket says 172.21.15.66:53786) 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 -- 172.21.15.66:0/920841358 learned_addr learned my addr 172.21.15.66:0/920841358 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf37a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe567fc640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf309fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 -- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 msgr2=0x557edf309fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf309fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 -- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 msgr2=0x557edf37a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf37a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 -- 172.21.15.66:0/920841358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557edf2b8c70 con 0x557edf3117b0 2024-05-10T11:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe567fc640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf309fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf37a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe577fe640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf3209a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbe500960b0 tx=0x7fbe5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8754bfd6fcaccf82 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.935+0000 7fbe367fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe367fc640 1 -- 172.21.15.66:0/920841358 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50069be0 con 0x557edf3117b0 2024-05-10T11:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe367fc640 1 -- 172.21.15.66:0/920841358 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbe50060070 con 0x557edf3117b0 2024-05-10T11:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe50060e10 con 0x557edf3117b0 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe367fc640 1 -- 172.21.15.66:0/920841358 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fbe500651c0 con 0x557edf3117b0 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 10 client.7173 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x557edf320ee0 con 0x557edf3117b0 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe367fc640 1 -- 172.21.15.66:0/920841358 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe50060e10 con 0x557edf3117b0 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe367fc640 1 -- 172.21.15.66:0/920841358 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7fbe50082360 con 0x557edf3117b0 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 10 client.7173 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 10 client.7173 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 20 client.7173 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf300d70 0x557edf2b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 4 client.7173 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557edf2249b0 con 0x557edf300d70 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf300d70 0x557edf2b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe367fc640 10 client.7173 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.936+0000 7fbe56ffd640 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf300d70 0x557edf2b71d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39260b7cfd0e293 server_cookie=a4e47a191488cc8e in_seq=0 out_seq=0 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe367fc640 1 -- 172.21.15.66:0/920841358 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557edf2249b0 con 0x557edf300d70 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe367fc640 10 client.7173 handle_command_reply: tid=0 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 client.7173 shutdown 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 msgr2=0x557edf3209a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf3209a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbe500960b0 tx=0x7fbe5000a060 comp rx=0 tx=0).stop 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 shutdown_connections 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x557edf300d70 0x557edf2b71d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557edf3117b0 0x557edf3209a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557edf300160 0x557edf309fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe367fc640 0 client.7173 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 --2- 172.21.15.66:0/920841358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557edf2e3280 0x557edf37a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 >> 172.21.15.66:0/920841358 conn(0x557edf2e2b40 msgr2=0x557edf30d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 shutdown_connections 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 1 -- 172.21.15.66:0/920841358 wait complete. 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe60835740 20 client.7173 trim_cache size 0 max 16384 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:19:04.947 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbe44076300 msgr2=0x7fbe440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe5da46640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbe44076300 0x7fbe440787c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe58069aa0 tx=0x7fbe48009040 comp rx=0 tx=0).stop 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 msgr2=0x7fbe580b9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.937+0000 7fbe5da46640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 0x7fbe580b9b00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbe580d50a0 tx=0x7fbe50007bd0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 shutdown_connections 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbe44076300 0x7fbe440787c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe580b96a0 0x7fbe580b9b00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe580ce8f0 0x7fbe581525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 --2- 172.21.15.66:0/3192300096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe40004800 0x7fbe580b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 >> 172.21.15.66:0/3192300096 conn(0x7fbe5809e450 msgr2=0x7fbe580d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 shutdown_connections 2024-05-10T11:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:04.938+0000 7fbe5da46640 1 -- 172.21.15.66:0/3192300096 wait complete. 2024-05-10T11:19:04.950 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:19:04.950 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:19:05.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.056+0000 7fbb700da640 1 Processor -- start 2024-05-10T11:19:05.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.056+0000 7fbb700da640 1 -- start start 2024-05-10T11:19:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb700da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb700da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb68162b30 0x7fbb680b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb700da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb680b45f0 con 0x7fbb680d5cb0 2024-05-10T11:19:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb700da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbb680b4f20 con 0x7fbb68162b30 2024-05-10T11:19:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb700da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb680d0fe0 con 0x7fbb68162750 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb68162b30 0x7fbb680b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb68162b30 0x7fbb680b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53788/0 (socket says 172.21.15.66:53788) 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 -- 172.21.15.66:0/3699363085 learned_addr learned my addr 172.21.15.66:0/3699363085 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6de76640 1 --2- 172.21.15.66:0/3699363085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 -- 172.21.15.66:0/3699363085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 msgr2=0x7fbb680d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 --2- 172.21.15.66:0/3699363085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 -- 172.21.15.66:0/3699363085 >> v1:172.21.15.190:6789/0 conn(0x7fbb680d5cb0 legacy=0x7fbb680d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.057+0000 7fbb6e677640 1 -- 172.21.15.66:0/3699363085 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb680b48d0 con 0x7fbb68162b30 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.058+0000 7fbb6e677640 1 --2- 172.21.15.66:0/3699363085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680b53b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e50 tx=0x7fbb6002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595e7d2baf5f14fd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.058+0000 7fbb6ce74640 1 -- 172.21.15.66:0/3699363085 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60036070 con 0x7fbb68162b30 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.058+0000 7fbb6ce74640 1 -- 172.21.15.66:0/3699363085 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb60031600 con 0x7fbb68162b30 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.058+0000 7fbb6ce74640 1 -- 172.21.15.66:0/3699363085 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb600319d0 con 0x7fbb68162b30 2024-05-10T11:19:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 -- 172.21.15.66:0/3699363085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 msgr2=0x7fbb680b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 --2- 172.21.15.66:0/3699363085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680b53b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e50 tx=0x7fbb6002a630 comp rx=0 tx=0).stop 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 -- 172.21.15.66:0/3699363085 shutdown_connections 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 --2- 172.21.15.66:0/3699363085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680b53b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 --2- 172.21.15.66:0/3699363085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 -- 172.21.15.66:0/3699363085 >> 172.21.15.66:0/3699363085 conn(0x7fbb6809e3b0 msgr2=0x7fbb680d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 -- 172.21.15.66:0/3699363085 shutdown_connections 2024-05-10T11:19:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.059+0000 7fbb700da640 1 -- 172.21.15.66:0/3699363085 wait complete. 2024-05-10T11:19:05.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.060+0000 7fbb700da640 1 Processor -- start 2024-05-10T11:19:05.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.060+0000 7fbb700da640 1 -- start start 2024-05-10T11:19:05.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb700da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680b9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb700da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb700da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb680b3cd0 0x7fbb680ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb700da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680d0d30 con 0x7fbb68162b30 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb700da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680d0bb0 con 0x7fbb680b3cd0 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb700da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb680d3d40 con 0x7fbb68162750 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53792/0 (socket says 172.21.15.66:53792) 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 -- 172.21.15.66:0/3689101711 learned_addr learned my addr 172.21.15.66:0/3689101711 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6de76640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6e677640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb680b3cd0 0x7fbb680ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 -- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 msgr2=0x7fbb680b9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680b9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 -- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb680b3cd0 msgr2=0x7fbb680ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb680b3cd0 0x7fbb680ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 -- 172.21.15.66:0/3689101711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb680cd2a0 con 0x7fbb68162b30 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.061+0000 7fbb6d675640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680c8b40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c430 tx=0x7fbb5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.062+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011790 con 0x7fbb68162b30 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.062+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb58017070 con 0x7fbb68162b30 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.062+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb680cd580 con 0x7fbb68162b30 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.062+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011bb0 con 0x7fbb68162b30 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.062+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb680b9da0 con 0x7fbb68162b30 2024-05-10T11:19:05.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.063+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6806a220 con 0x7fbb68162b30 2024-05-10T11:19:05.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.063+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb5801c460 con 0x7fbb68162b30 2024-05-10T11:19:05.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.064+0000 7fbb5e7fc640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbb4c0762d0 0x7fbb4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.064+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbb580975d0 con 0x7fbb68162b30 2024-05-10T11:19:05.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.064+0000 7fbb6de76640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbb4c0762d0 0x7fbb4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.064+0000 7fbb6de76640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbb4c0762d0 0x7fbb4c078790 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400a970 tx=0x7fbb64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.068+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbb58060de0 con 0x7fbb68162b30 2024-05-10T11:19:05.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.297+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb680b5e60 con 0x7fbb68162b30 2024-05-10T11:19:05.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.297+0000 7fbb5e7fc640 1 -- 172.21.15.66:0/3689101711 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5187 (secure 0 0 0) 0x7fbb580606e0 con 0x7fbb68162b30 2024-05-10T11:19:05.298 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:05.298 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:34.690562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6867,"qdb_cluster":[6867]},"id":6}]} 2024-05-10T11:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 70 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbb4c0762d0 msgr2=0x7fbb4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbb4c0762d0 0x7fbb4c078790 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400a970 tx=0x7fbb64008040 comp rx=0 tx=0).stop 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 msgr2=0x7fbb680c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680c8b40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c430 tx=0x7fbb5800c8f0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 shutdown_connections 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbb4c0762d0 0x7fbb4c078790 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb680b3cd0 0x7fbb680ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb68162b30 0x7fbb680c8b40 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 --2- 172.21.15.66:0/3689101711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb68162750 0x7fbb680b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 >> 172.21.15.66:0/3689101711 conn(0x7fbb6809e3b0 msgr2=0x7fbb6806dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 shutdown_connections 2024-05-10T11:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.299+0000 7fbb700da640 1 -- 172.21.15.66:0/3689101711 wait complete. 2024-05-10T11:19:05.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T11:19:05.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.416+0000 7facce81c640 1 Processor -- start 2024-05-10T11:19:05.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.416+0000 7facce81c640 1 -- start start 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facce81c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7facc80ce300 0x7facc80ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facce81c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc8160fa0 con 0x7facc815d050 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facce81c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc8161280 con 0x7facc80ced20 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facce81c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7facc8160d50 con 0x7facc80ce300 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facbffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7facc80ce300 0x7facc80ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facc7fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7facc815d050 0x7facc80cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34506/0 (socket says 172.21.15.66:34506) 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.417+0000 7facc7fff640 1 -- 172.21.15.66:0/2089275430 learned_addr learned my addr 172.21.15.66:0/2089275430 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.418+0000 7facbffff640 1 -- 172.21.15.66:0/2089275430 >> v1:172.21.15.190:6789/0 conn(0x7facc80ced20 legacy=0x7facc806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.418+0000 7facbffff640 1 -- 172.21.15.66:0/2089275430 >> v1:172.21.15.66:6789/0 conn(0x7facc815d050 legacy=0x7facc80cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.418+0000 7facc77fe640 1 -- 172.21.15.66:0/2089275430 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760259446 0 0) 0x7facc8160fa0 con 0x7facc815d050 2024-05-10T11:19:05.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.418+0000 7facbffff640 1 -- 172.21.15.66:0/2089275430 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc8161560 con 0x7facc80ce300 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.418+0000 7facbffff640 1 --2- 172.21.15.66:0/2089275430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ce300 0x7facc80ce7e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7facb00097a0 tx=0x7facb002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49276b50518abea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facc77fe640 1 -- 172.21.15.66:0/2089275430 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0037070 con 0x7facc80ce300 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facc77fe640 1 -- 172.21.15.66:0/2089275430 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb0032440 con 0x7facc80ce300 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facc77fe640 1 -- 172.21.15.66:0/2089275430 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0032810 con 0x7facc80ce300 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 -- 172.21.15.66:0/2089275430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ce300 msgr2=0x7facc80ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 --2- 172.21.15.66:0/2089275430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ce300 0x7facc80ce7e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7facb00097a0 tx=0x7facb002a230 comp rx=0 tx=0).stop 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 -- 172.21.15.66:0/2089275430 shutdown_connections 2024-05-10T11:19:05.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 --2- 172.21.15.66:0/2089275430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ce300 0x7facc80ce7e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 -- 172.21.15.66:0/2089275430 >> 172.21.15.66:0/2089275430 conn(0x7facc80b3c60 msgr2=0x7facc80b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 -- 172.21.15.66:0/2089275430 shutdown_connections 2024-05-10T11:19:05.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.419+0000 7facce81c640 1 -- 172.21.15.66:0/2089275430 wait complete. 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.420+0000 7facce81c640 1 Processor -- start 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.420+0000 7facce81c640 1 -- start start 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facce81c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc80ce300 0x7facc81f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facce81c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 0x7facc8154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facce81c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc815d050 0x7facc815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facce81c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7facc81618d0 con 0x7facc80ced20 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facce81c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7facc8070230 con 0x7facc815d050 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facce81c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7facc80703b0 con 0x7facc80ce300 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 0x7facc8154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 0x7facc8154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53804/0 (socket says 172.21.15.66:53804) 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.421+0000 7facbffff640 1 -- 172.21.15.66:0/654663127 learned_addr learned my addr 172.21.15.66:0/654663127 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facc7fff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc80ce300 0x7facc81f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facccdb9640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc815d050 0x7facc815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facbffff640 1 -- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc80ce300 msgr2=0x7facc81f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facbffff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc80ce300 0x7facc81f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facbffff640 1 -- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc815d050 msgr2=0x7facc815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facbffff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc815d050 0x7facc815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facbffff640 1 -- 172.21.15.66:0/654663127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc81f0670 con 0x7facc80ced20 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facc7fff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc80ce300 0x7facc81f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facccdb9640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc815d050 0x7facc815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facbffff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 0x7facc8154280 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7facb0035040 tx=0x7facb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facc57fa640 1 -- 172.21.15.66:0/654663127 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0037040 con 0x7facc80ced20 2024-05-10T11:19:05.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facc57fa640 1 -- 172.21.15.66:0/654663127 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb0030770 con 0x7facc80ced20 2024-05-10T11:19:05.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc8154d20 con 0x7facc80ced20 2024-05-10T11:19:05.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facc57fa640 1 -- 172.21.15.66:0/654663127 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0030b80 con 0x7facc80ced20 2024-05-10T11:19:05.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.422+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81552e0 con 0x7facc80ced20 2024-05-10T11:19:05.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.424+0000 7facc57fa640 1 -- 172.21.15.66:0/654663127 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7facb0044020 con 0x7facc80ced20 2024-05-10T11:19:05.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.424+0000 7facc57fa640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faca8076300 0x7faca80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.424+0000 7facc57fa640 1 -- 172.21.15.66:0/654663127 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7facb00b7d90 con 0x7facc80ced20 2024-05-10T11:19:05.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.424+0000 7facc7fff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faca8076300 0x7faca80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.425+0000 7facd161c740 1 Processor -- start 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.425+0000 7facd161c740 1 -- start start 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.425+0000 7facc7fff640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faca8076300 0x7faca80787c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7facb8000f60 tx=0x7facb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facd161c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9ab57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9a896d0 0x55d3a9ab1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ab4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facd161c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3a9975920 con 0x55d3a9ab19c0 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d3a99eadd0 con 0x55d3a9ab22e0 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d3a999b3e0 con 0x55d3a9a896d0 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9ab57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9ab57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53812/0 (socket says 172.21.15.66:53812) 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 -- 172.21.15.66:0/3161053389 learned_addr learned my addr 172.21.15.66:0/3161053389 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facccdb9640 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ab4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facbffff640 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9a896d0 0x55d3a9ab1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 -- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9a896d0 msgr2=0x55d3a9ab1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9a896d0 0x55d3a9ab1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 -- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab22e0 msgr2=0x55d3a9ab4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ab4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 -- 172.21.15.66:0/3161053389 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3a97cc7c0 con 0x55d3a9ab19c0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facccdb9640 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ab4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facc7fff640 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9ab57c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7facb8007260 tx=0x7facb8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7997be074c1c89a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facbdffb640 1 -- 172.21.15.66:0/3161053389 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb800d9a0 con 0x55d3a9ab19c0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facbdffb640 1 -- 172.21.15.66:0/3161053389 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb800db40 con 0x55d3a9ab19c0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.426+0000 7facbdffb640 1 -- 172.21.15.66:0/3161053389 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8020450 con 0x55d3a9ab19c0 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 -- 172.21.15.66:0/3161053389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 msgr2=0x55d3a9ab57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9ab57c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7facb8007260 tx=0x7facb8010000 comp rx=0 tx=0).stop 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 -- 172.21.15.66:0/3161053389 shutdown_connections 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ab4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9a896d0 0x55d3a9ab1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 --2- 172.21.15.66:0/3161053389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9ab57c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 -- 172.21.15.66:0/3161053389 >> 172.21.15.66:0/3161053389 conn(0x55d3a9a87560 msgr2=0x55d3a9acfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 -- 172.21.15.66:0/3161053389 shutdown_connections 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.427+0000 7facd161c740 1 -- 172.21.15.66:0/3161053389 wait complete. 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.428+0000 7facd161c740 1 -- start start 2024-05-10T11:19:05.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.428+0000 7facd161c740 1 Processor -- start 2024-05-10T11:19:05.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab19c0 0x55d3a9aa5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ae7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9aa5b60 0x55d3a9ae8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3a99f3440 con 0x55d3a9ab22e0 2024-05-10T11:19:05.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d3a99ee120 con 0x55d3a9ab19c0 2024-05-10T11:19:05.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d3a99fc210 con 0x55d3a9aa5b60 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 10 client.0 _ll_register_callbacks cb 0x55d3a9993690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ae7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ae7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53822/0 (socket says 172.21.15.66:53822) 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 -- 172.21.15.66:0/2489767112 learned_addr learned my addr 172.21.15.66:0/2489767112 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 -- 172.21.15.66:0/2489767112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9aa5b60 msgr2=0x55d3a9ae8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9aa5b60 0x55d3a9ae8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 -- 172.21.15.66:0/2489767112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab19c0 msgr2=0x55d3a9aa5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab19c0 0x55d3a9aa5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 -- 172.21.15.66:0/2489767112 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3a982cf50 con 0x55d3a9ab22e0 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facbffff640 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ae7c30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7facb002a270 tx=0x7facb0080630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6d7a819359718f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7faca6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7faca6ffd640 1 -- 172.21.15.66:0/2489767112 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00315b0 con 0x55d3a9ab22e0 2024-05-10T11:19:05.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7faca6ffd640 1 -- 172.21.15.66:0/2489767112 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7facb0081060 con 0x55d3a9ab22e0 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb800db40 con 0x55d3a9ab22e0 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7faca6ffd640 1 -- 172.21.15.66:0/2489767112 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7facb0080e00 con 0x55d3a9ab22e0 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 10 client.7194 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.429+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55d3a96c00b0 con 0x55d3a9ab22e0 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7faca6ffd640 1 -- 172.21.15.66:0/2489767112 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb800db40 con 0x55d3a9ab22e0 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7faca6ffd640 1 -- 172.21.15.66:0/2489767112 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7facb003a030 con 0x55d3a9ab22e0 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facd161c740 10 client.7194 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facd161c740 10 client.7194 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facd161c740 20 client.7194 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facd161c740 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aaf820 0x55d3a9aa7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facd161c740 4 client.7194 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3a99fca20 con 0x55d3a9aaf820 2024-05-10T11:19:05.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facc7fff640 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aaf820 0x55d3a9aa7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7facc7fff640 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aaf820 0x55d3a9aa7900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba55182067f46737 server_cookie=74d5fd1e46638668 in_seq=0 out_seq=0 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.430+0000 7faca6ffd640 10 client.7194 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7faca6ffd640 1 -- 172.21.15.66:0/2489767112 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d3a99fca20 con 0x55d3a9aaf820 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7faca6ffd640 10 client.7194 handle_command_reply: tid=0 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 client.7194 shutdown 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 msgr2=0x55d3a9ae7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ae7c30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7facb002a270 tx=0x7facb0080630 comp rx=0 tx=0).stop 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 shutdown_connections 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aaf820 0x55d3a9aa7900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9aa5b60 0x55d3a9ae8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9ae7c30 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7faca6ffd640 0 client.7194 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 --2- 172.21.15.66:0/2489767112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9ab19c0 0x55d3a9aa5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 >> 172.21.15.66:0/2489767112 conn(0x55d3a9a896d0 msgr2=0x55d3a9a841a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 shutdown_connections 2024-05-10T11:19:05.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 1 -- 172.21.15.66:0/2489767112 wait complete. 2024-05-10T11:19:05.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.431+0000 7facd161c740 20 client.7194 trim_cache size 0 max 16384 2024-05-10T11:19:05.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.445+0000 7facd161c740 1 Processor -- start 2024-05-10T11:19:05.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.445+0000 7facd161c740 1 -- start start 2024-05-10T11:19:05.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9ae7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facd161c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9a88a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab22e0 0x55d3a9a841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facd161c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7facc80b66b0 con 0x55d3a9ab19c0 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7facc815a680 con 0x55d3a9aa5b60 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7facc80b6090 con 0x55d3a9ab22e0 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9a88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9a88a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53824/0 (socket says 172.21.15.66:53824) 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 -- 172.21.15.66:0/1259588101 learned_addr learned my addr 172.21.15.66:0/1259588101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 -- 172.21.15.66:0/1259588101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab22e0 msgr2=0x55d3a9a841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab22e0 0x55d3a9a841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 -- 172.21.15.66:0/1259588101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 msgr2=0x55d3a9ae7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9ae7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 -- 172.21.15.66:0/1259588101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3a9adc570 con 0x55d3a9ab19c0 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbffff640 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9a88a80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7facb0085240 tx=0x7facb0083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be953dc875c44623 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbd7fa640 1 -- 172.21.15.66:0/1259588101 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0080750 con 0x55d3a9ab19c0 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbd7fa640 1 -- 172.21.15.66:0/1259588101 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb00315b0 con 0x55d3a9ab19c0 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.446+0000 7facbd7fa640 1 -- 172.21.15.66:0/1259588101 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0089bd0 con 0x55d3a9ab19c0 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 -- 172.21.15.66:0/1259588101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 msgr2=0x55d3a9a88a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9a88a80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7facb0085240 tx=0x7facb0083000 comp rx=0 tx=0).stop 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 -- 172.21.15.66:0/1259588101 shutdown_connections 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab22e0 0x55d3a9a841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab19c0 0x55d3a9a88a80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 --2- 172.21.15.66:0/1259588101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9ae7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 -- 172.21.15.66:0/1259588101 >> 172.21.15.66:0/1259588101 conn(0x55d3a9a896d0 msgr2=0x55d3a9aa6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 -- 172.21.15.66:0/1259588101 shutdown_connections 2024-05-10T11:19:05.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 -- 172.21.15.66:0/1259588101 wait complete. 2024-05-10T11:19:05.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.447+0000 7facd161c740 1 -- start start 2024-05-10T11:19:05.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 Processor -- start 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9b56820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab19c0 0x55d3a9aa78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9aad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3a9aa8860 con 0x55d3a9ab22e0 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d3a99a4a20 con 0x55d3a9aa5b60 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d3a9aafca0 con 0x55d3a9ab19c0 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.448+0000 7facd161c740 10 client.0 _ll_register_callbacks cb 0x7facb0009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9aad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9aad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53840/0 (socket says 172.21.15.66:53840) 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 -- 172.21.15.66:0/715287803 learned_addr learned my addr 172.21.15.66:0/715287803 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facc7fff640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9b56820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facbffff640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab19c0 0x55d3a9aa78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 -- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab19c0 msgr2=0x55d3a9aa78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab19c0 0x55d3a9aa78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 -- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 msgr2=0x55d3a9b56820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9b56820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 -- 172.21.15.66:0/715287803 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3a9af70a0 con 0x55d3a9ab22e0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facbffff640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab19c0 0x55d3a9aa78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facccdb9640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9aad640 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7facc80ce2d0 tx=0x7facc000f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7070be80323f1fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7faca6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7faca6ffd640 1 -- 172.21.15.66:0/715287803 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0003b80 con 0x55d3a9ab22e0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7faca6ffd640 1 -- 172.21.15.66:0/715287803 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7facc0003d20 con 0x55d3a9ab22e0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3a99f6890 con 0x55d3a9ab22e0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7faca6ffd640 1 -- 172.21.15.66:0/715287803 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7facc00050d0 con 0x55d3a9ab22e0 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facd161c740 10 client.7200 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:05.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.449+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55d3a9ab8b30 con 0x55d3a9ab22e0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7faca6ffd640 1 -- 172.21.15.66:0/715287803 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d3a99f6890 con 0x55d3a9ab22e0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7faca6ffd640 1 -- 172.21.15.66:0/715287803 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7facc0023080 con 0x55d3a9ab22e0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 10 client.7200 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 10 client.7200 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 20 client.7200 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aadcd0 0x55d3a9ac58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 4 client.7200 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55d3a9867920 con 0x55d3a9aadcd0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facc7fff640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aadcd0 0x55d3a9ac58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7faca6ffd640 10 client.7200 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facc7fff640 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aadcd0 0x55d3a9ac58f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0b1893f0c903f5b server_cookie=fa54e2804c750d8f in_seq=0 out_seq=0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7faca6ffd640 1 -- 172.21.15.66:0/715287803 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+420 (crc 0 0 0) 0x55d3a9867920 con 0x55d3a9aadcd0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7faca6ffd640 10 client.7200 handle_command_reply: tid=0 2024-05-10T11:19:05.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 1 client.7200 shutdown 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 msgr2=0x55d3a9aad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.450+0000 7facd161c740 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9aad640 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7facc80ce2d0 tx=0x7facc000f890 comp rx=0 tx=0).stop 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 shutdown_connections 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55d3a9aadcd0 0x55d3a9ac58f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7faca6ffd640 0 client.7200 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3a9ab22e0 0x55d3a9aad640 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d3a9ab19c0 0x55d3a9aa78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 --2- 172.21.15.66:0/715287803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d3a9aa5b60 0x55d3a9b56820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 >> 172.21.15.66:0/715287803 conn(0x55d3a9a896d0 msgr2=0x55d3a9aaefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 shutdown_connections 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 1 -- 172.21.15.66:0/715287803 wait complete. 2024-05-10T11:19:05.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facd161c740 20 client.7200 trim_cache size 0 max 16384 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: "damage_type": "dir_frag", 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 2390050520, 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627776, 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: "frag": "*", 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/dir" 2024-05-10T11:19:05.459 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "damage_type": "backtrace", 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 2607689150, 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627777, 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/testdir/hardlink" 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "damage_type": "backtrace", 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4119964371, 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627776, 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/dir" 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:19:05.460 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:19:05.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faca8076300 msgr2=0x7faca80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faca8076300 0x7faca80787c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7facb8000f60 tx=0x7facb8009040 comp rx=0 tx=0).stop 2024-05-10T11:19:05.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 msgr2=0x7facc8154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 0x7facc8154280 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7facb0035040 tx=0x7facb00046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 shutdown_connections 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faca8076300 0x7faca80787c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc815d050 0x7facc815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc80ced20 0x7facc8154280 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 --2- 172.21.15.66:0/654663127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc80ce300 0x7facc81f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 >> 172.21.15.66:0/654663127 conn(0x7facc80b3c60 msgr2=0x7facc815db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 shutdown_connections 2024-05-10T11:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.451+0000 7facce81c640 1 -- 172.21.15.66:0/654663127 wait complete. 2024-05-10T11:19:05.463 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.565+0000 7f9032cf1640 1 Processor -- start 2024-05-10T11:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.565+0000 7f9032cf1640 1 -- start start 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f9032cf1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f902c162b30 0x7f902c169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f9032cf1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902c0b45f0 con 0x7f902c162750 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f9032cf1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902c0b48d0 con 0x7f902c0d5cb0 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f9032cf1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f902c0b4f20 con 0x7f902c162b30 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f903128e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f902c162b30 0x7f902c169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f9030a8d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f902c162750 0x7f902c0d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34520/0 (socket says 172.21.15.66:34520) 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.566+0000 7f9030a8d640 1 -- 172.21.15.66:0/1829857553 learned_addr learned my addr 172.21.15.66:0/1829857553 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.567+0000 7f903128e640 1 -- 172.21.15.66:0/1829857553 >> v1:172.21.15.190:6789/0 conn(0x7f902c0d5cb0 legacy=0x7f902c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.567+0000 7f903128e640 1 -- 172.21.15.66:0/1829857553 >> v1:172.21.15.66:6789/0 conn(0x7f902c162750 legacy=0x7f902c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.567+0000 7f903128e640 1 -- 172.21.15.66:0/1829857553 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c0b4bb0 con 0x7f902c162b30 2024-05-10T11:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.567+0000 7f902b7fe640 1 -- 172.21.15.66:0/1829857553 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990415389 0 0) 0x7f902c0b45f0 con 0x7f902c162750 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.567+0000 7f903128e640 1 --2- 172.21.15.66:0/1829857553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162b30 0x7f902c169fe0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f90140097a0 tx=0x7f901402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226690d26dc1f949 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.567+0000 7f902b7fe640 1 -- 172.21.15.66:0/1829857553 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014037070 con 0x7f902c162b30 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f902b7fe640 1 -- 172.21.15.66:0/1829857553 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901402ae50 con 0x7f902c162b30 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f902b7fe640 1 -- 172.21.15.66:0/1829857553 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014032660 con 0x7f902c162b30 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 -- 172.21.15.66:0/1829857553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162b30 msgr2=0x7f902c169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 --2- 172.21.15.66:0/1829857553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162b30 0x7f902c169fe0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f90140097a0 tx=0x7f901402a140 comp rx=0 tx=0).stop 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 -- 172.21.15.66:0/1829857553 shutdown_connections 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 --2- 172.21.15.66:0/1829857553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162b30 0x7f902c169fe0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 -- 172.21.15.66:0/1829857553 >> 172.21.15.66:0/1829857553 conn(0x7f902c09e3b0 msgr2=0x7f902c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 -- 172.21.15.66:0/1829857553 shutdown_connections 2024-05-10T11:19:05.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.568+0000 7f9032cf1640 1 -- 172.21.15.66:0/1829857553 wait complete. 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.569+0000 7f9032cf1640 1 Processor -- start 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.569+0000 7f9032cf1640 1 -- start start 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9032cf1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 0x7f902c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9032cf1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902c162b30 0x7f902c0b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9032cf1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902c0b9dc0 0x7f902c1f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9032cf1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0d0fe0 con 0x7f902c162750 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9032cf1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0d3f90 con 0x7f902c162b30 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9032cf1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f902c0d0d80 con 0x7f902c0b9dc0 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9030a8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 0x7f902c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9030a8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 0x7f902c1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53862/0 (socket says 172.21.15.66:53862) 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.570+0000 7f9030a8d640 1 -- 172.21.15.66:0/702453884 learned_addr learned my addr 172.21.15.66:0/702453884 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f902bfff640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902c162b30 0x7f902c0b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f903128e640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902c0b9dc0 0x7f902c1f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9030a8d640 1 -- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902c0b9dc0 msgr2=0x7f902c1f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9030a8d640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902c0b9dc0 0x7f902c1f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9030a8d640 1 -- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902c162b30 msgr2=0x7f902c0b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9030a8d640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902c162b30 0x7f902c0b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9030a8d640 1 -- 172.21.15.66:0/702453884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c0ba250 con 0x7f902c162750 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9030a8d640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 0x7f902c1579f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f902400c4d0 tx=0x7f902400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024018070 con 0x7f902c162750 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c1f4d10 con 0x7f902c162750 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024007500 con 0x7f902c162750 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024004a20 con 0x7f902c162750 2024-05-10T11:19:05.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.571+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c0b85e0 con 0x7f902c162750 2024-05-10T11:19:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.572+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902c08f140 con 0x7f902c162750 2024-05-10T11:19:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.573+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9024004bc0 con 0x7f902c162750 2024-05-10T11:19:05.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.573+0000 7f90297fa640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f900c0762d0 0x7f900c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.573+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f9024096a30 con 0x7f902c162750 2024-05-10T11:19:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.573+0000 7f902bfff640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f900c0762d0 0x7f900c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.574+0000 7f902bfff640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f900c0762d0 0x7f900c078790 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f902c157f30 tx=0x7f901c0094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.577+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f902c08f140 con 0x7f902c162750 2024-05-10T11:19:05.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.809+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f902c075dd0 con 0x7f902c162750 2024-05-10T11:19:05.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.809+0000 7f90297fa640 1 -- 172.21.15.66:0/702453884 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f90240601c0 con 0x7f902c162750 2024-05-10T11:19:05.809 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:05.810 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f900c0762d0 msgr2=0x7f900c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f900c0762d0 0x7f900c078790 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f902c157f30 tx=0x7f901c0094f0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 msgr2=0x7f902c1579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 0x7f902c1579f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f902400c4d0 tx=0x7f902400c990 comp rx=0 tx=0).stop 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 shutdown_connections 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f900c0762d0 0x7f900c078790 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902c0b9dc0 0x7f902c1f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902c162b30 0x7f902c0b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 --2- 172.21.15.66:0/702453884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c162750 0x7f902c1579f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 >> 172.21.15.66:0/702453884 conn(0x7f902c09e3b0 msgr2=0x7f902c0b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 shutdown_connections 2024-05-10T11:19:05.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.811+0000 7f9032cf1640 1 -- 172.21.15.66:0/702453884 wait complete. 2024-05-10T11:19:05.823 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T11:19:05.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:05.823 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-05-10T11:19:05.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.931+0000 7f7c8c815640 1 Processor -- start 2024-05-10T11:19:05.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.931+0000 7f7c8c815640 1 -- start start 2024-05-10T11:19:05.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8c815640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c8815b3d0 0x7f7c880b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8c815640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b7b0 0x7f7c880b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8c815640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c8806ec80 0x7f7c8806f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8c815640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7c88072cc0 con 0x7f7c8815b3d0 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8c815640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7c880720f0 con 0x7f7c8806ec80 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8c815640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c88074260 con 0x7f7c8815b7b0 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c8815b3d0 0x7f7c880b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c8815b3d0 0x7f7c880b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53866/0 (socket says 172.21.15.66:53866) 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 -- 172.21.15.66:0/4237590545 learned_addr learned my addr 172.21.15.66:0/4237590545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/4237590545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b7b0 0x7f7c880b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/4237590545 >> v2:172.21.15.190:3300/0 conn(0x7f7c8806ec80 0x7f7c8806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 -- 172.21.15.66:0/4237590545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b7b0 msgr2=0x7f7c880b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 --2- 172.21.15.66:0/4237590545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b7b0 0x7f7c880b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 -- 172.21.15.66:0/4237590545 >> v2:172.21.15.190:3300/0 conn(0x7f7c8806ec80 msgr2=0x7f7c8806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 --2- 172.21.15.66:0/4237590545 >> v2:172.21.15.190:3300/0 conn(0x7f7c8806ec80 0x7f7c8806f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.932+0000 7f7c8659c640 1 -- 172.21.15.66:0/4237590545 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c88072390 con 0x7f7c8815b3d0 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.933+0000 7f7c8659c640 1 --2- 172.21.15.66:0/4237590545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8815b3d0 0x7f7c880b44f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7c8815f070 tx=0x7f7c7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6e4c800909f897 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.933+0000 7f7c85d9b640 1 -- 172.21.15.66:0/4237590545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78037070 con 0x7f7c8815b3d0 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.933+0000 7f7c85d9b640 1 -- 172.21.15.66:0/4237590545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c78032440 con 0x7f7c8815b3d0 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.933+0000 7f7c85d9b640 1 -- 172.21.15.66:0/4237590545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78032810 con 0x7f7c8815b3d0 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 -- 172.21.15.66:0/4237590545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8815b3d0 msgr2=0x7f7c880b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 --2- 172.21.15.66:0/4237590545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8815b3d0 0x7f7c880b44f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7c8815f070 tx=0x7f7c7802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 -- 172.21.15.66:0/4237590545 shutdown_connections 2024-05-10T11:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 --2- 172.21.15.66:0/4237590545 >> v2:172.21.15.190:3300/0 conn(0x7f7c8806ec80 0x7f7c8806f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 --2- 172.21.15.66:0/4237590545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b7b0 0x7f7c880b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 --2- 172.21.15.66:0/4237590545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8815b3d0 0x7f7c880b44f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 -- 172.21.15.66:0/4237590545 >> 172.21.15.66:0/4237590545 conn(0x7f7c8806c4a0 msgr2=0x7f7c8806c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 -- 172.21.15.66:0/4237590545 shutdown_connections 2024-05-10T11:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.934+0000 7f7c8c815640 1 -- 172.21.15.66:0/4237590545 wait complete. 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.935+0000 7f7c8c815640 1 Processor -- start 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.935+0000 7f7c8c815640 1 -- start start 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8c815640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 0x7f7c88151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8c815640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b3d0 0x7f7c880b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8c815640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c8815b7b0 0x7f7c8809cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8c815640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8806f640 con 0x7f7c8806ec80 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8c815640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7c88072950 con 0x7f7c8815b7b0 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8c815640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c880ade90 con 0x7f7c8815b3d0 2024-05-10T11:19:05.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 0x7f7c88151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 0x7f7c88151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53882/0 (socket says 172.21.15.66:53882) 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 -- 172.21.15.66:0/2186326450 learned_addr learned my addr 172.21.15.66:0/2186326450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b3d0 0x7f7c880b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c8815b7b0 0x7f7c8809cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 -- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b3d0 msgr2=0x7f7c880b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b3d0 0x7f7c880b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 -- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c8815b7b0 msgr2=0x7f7c8809cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.936+0000 7f7c8659c640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c8815b7b0 0x7f7c8809cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c8659c640 1 -- 172.21.15.66:0/2186326450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8809bf20 con 0x7f7c8806ec80 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c8815b7b0 0x7f7c8809cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c8659c640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 0x7f7c88151f90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f7c7802a220 tx=0x7f7c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c7f7fe640 1 -- 172.21.15.66:0/2186326450 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78041020 con 0x7f7c8806ec80 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c7f7fe640 1 -- 172.21.15.66:0/2186326450 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c780306c0 con 0x7f7c8806ec80 2024-05-10T11:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8809c200 con 0x7f7c8806ec80 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c7f7fe640 1 -- 172.21.15.66:0/2186326450 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78037040 con 0x7f7c8806ec80 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.937+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8809c7c0 con 0x7f7c8806ec80 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.939+0000 7f7c7f7fe640 1 -- 172.21.15.66:0/2186326450 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c78044020 con 0x7f7c8806ec80 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.939+0000 7f7c7f7fe640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c680762d0 0x7f7c68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.939+0000 7f7c7f7fe640 1 -- 172.21.15.66:0/2186326450 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7c780b7fd0 con 0x7f7c8806ec80 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.940+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c680762d0 0x7f7c68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.940+0000 7f7c8f608740 1 Processor -- start 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.940+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c680762d0 0x7f7c68078790 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7c70006fd0 tx=0x7f7c70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.940+0000 7f7c8f608740 1 -- start start 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e30bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 0x561c62e35a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8f608740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561c62d99cf0 con 0x561c62e60c00 2024-05-10T11:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561c62d52e10 con 0x561c62e7e220 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x561c62d95cb0 con 0x561c62e61340 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 0x561c62e35a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 0x561c62e35a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53884/0 (socket says 172.21.15.66:53884) 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 -- 172.21.15.66:0/413953182 learned_addr learned my addr 172.21.15.66:0/413953182 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c8659c640 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e30bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 -- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 msgr2=0x561c62e606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 -- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 msgr2=0x561c62e30bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e30bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.941+0000 7f7c86d9d640 1 -- 172.21.15.66:0/413953182 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c62b737e0 con 0x561c62e60c00 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 0x561c62e35a10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7c800073e0 tx=0x7f7c800078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41407a36db2e80c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c67fff640 1 -- 172.21.15.66:0/413953182 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8001a070 con 0x561c62e60c00 2024-05-10T11:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c67fff640 1 -- 172.21.15.66:0/413953182 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c80003da0 con 0x561c62e60c00 2024-05-10T11:19:05.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c67fff640 1 -- 172.21.15.66:0/413953182 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80004230 con 0x561c62e60c00 2024-05-10T11:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 -- 172.21.15.66:0/413953182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 msgr2=0x561c62e35a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 0x561c62e35a10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7c800073e0 tx=0x7f7c800078a0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 -- 172.21.15.66:0/413953182 shutdown_connections 2024-05-10T11:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e60c00 0x561c62e35a10 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 --2- 172.21.15.66:0/413953182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e30bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.942+0000 7f7c8f608740 1 -- 172.21.15.66:0/413953182 >> 172.21.15.66:0/413953182 conn(0x561c62e32e20 msgr2=0x561c62e7b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.943+0000 7f7c8f608740 1 -- 172.21.15.66:0/413953182 shutdown_connections 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.943+0000 7f7c8f608740 1 -- 172.21.15.66:0/413953182 wait complete. 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.943+0000 7f7c8f608740 1 -- start start 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.943+0000 7f7c8f608740 1 Processor -- start 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e72940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e8f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e63c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561c62e34fd0 con 0x561c62e7e220 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561c62d56940 con 0x561c62e79c80 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x561c62e343c0 con 0x561c62e61340 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8f608740 10 client.0 _ll_register_callbacks cb 0x561c62d59440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e8f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e8f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53898/0 (socket says 172.21.15.66:53898) 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/3513068588 learned_addr learned my addr 172.21.15.66:0/3513068588 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c8659c640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e72940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e63c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 msgr2=0x561c62e72940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e72940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 msgr2=0x561c62e63c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.944+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e63c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/3513068588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c62bd3f70 con 0x561c62e7e220 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e8f6a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f7c700144e0 tx=0x7f7c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a477ddc2e193ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c657fa640 1 -- 172.21.15.66:0/3513068588 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70025030 con 0x561c62e7e220 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c657fa640 1 -- 172.21.15.66:0/3513068588 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7c70021750 con 0x561c62e7e220 2024-05-10T11:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c80003da0 con 0x561c62e7e220 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c657fa640 1 -- 172.21.15.66:0/3513068588 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f7c70030050 con 0x561c62e7e220 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 10 client.7221 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x561c62a6b170 con 0x561c62e7e220 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c657fa640 1 -- 172.21.15.66:0/3513068588 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c80003da0 con 0x561c62e7e220 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c657fa640 1 -- 172.21.15.66:0/3513068588 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7f7c70033020 con 0x561c62e7e220 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 10 client.7221 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 10 client.7221 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 20 client.7221 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e782f0 0x561c62e786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 4 client.7221 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c62da7900 con 0x561c62e782f0 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.945+0000 7f7c8659c640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e782f0 0x561c62e786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.946+0000 7f7c657fa640 10 client.7221 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.946+0000 7f7c8659c640 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e782f0 0x561c62e786f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=939385b92614b565 server_cookie=2516ece0f3d84562 in_seq=0 out_seq=0 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.946+0000 7f7c657fa640 1 -- 172.21.15.66:0/3513068588 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561c62da7900 con 0x561c62e782f0 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.946+0000 7f7c657fa640 10 client.7221 handle_command_reply: tid=0 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.946+0000 7f7c8f608740 1 client.7221 shutdown 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 msgr2=0x561c62e8f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e8f6a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f7c700144e0 tx=0x7f7c700046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 shutdown_connections 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e782f0 0x561c62e786f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e63c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e8f6a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c657fa640 0 client.7221 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 --2- 172.21.15.66:0/3513068588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e72940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 >> 172.21.15.66:0/3513068588 conn(0x561c62e60c00 msgr2=0x561c62e7b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 shutdown_connections 2024-05-10T11:19:05.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 1 -- 172.21.15.66:0/3513068588 wait complete. 2024-05-10T11:19:05.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.947+0000 7f7c8f608740 20 client.7221 trim_cache size 0 max 16384 2024-05-10T11:19:05.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.965+0000 7f7c8f608740 1 Processor -- start 2024-05-10T11:19:05.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.965+0000 7f7c8f608740 1 -- start start 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e30420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e36910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8f608740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c881ffe50 con 0x561c62e7e220 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7c881fee60 con 0x561c62e79c80 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c881fe1d0 con 0x561c62e61340 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e36910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e36910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53900/0 (socket says 172.21.15.66:53900) 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 -- 172.21.15.66:0/1868156991 learned_addr learned my addr 172.21.15.66:0/1868156991 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c8659c640 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e30420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 -- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 msgr2=0x561c62e30420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e30420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 -- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 msgr2=0x561c62e363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 -- 172.21.15.66:0/1868156991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c62e32ba0 con 0x561c62e7e220 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e36910 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7c80007da0 tx=0x7f7c80013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c10326c267cd9c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c677fe640 1 -- 172.21.15.66:0/1868156991 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8001a030 con 0x561c62e7e220 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c677fe640 1 -- 172.21.15.66:0/1868156991 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8001b040 con 0x561c62e7e220 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.966+0000 7f7c677fe640 1 -- 172.21.15.66:0/1868156991 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80015690 con 0x561c62e7e220 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 -- 172.21.15.66:0/1868156991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 msgr2=0x561c62e36910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e36910 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7c80007da0 tx=0x7f7c80013000 comp rx=0 tx=0).stop 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 -- 172.21.15.66:0/1868156991 shutdown_connections 2024-05-10T11:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e7e220 0x561c62e36910 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e79c80 0x561c62e363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 --2- 172.21.15.66:0/1868156991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62e30420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 -- 172.21.15.66:0/1868156991 >> 172.21.15.66:0/1868156991 conn(0x561c62e60c00 msgr2=0x561c62e850e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 -- 172.21.15.66:0/1868156991 shutdown_connections 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.967+0000 7f7c8f608740 1 -- 172.21.15.66:0/1868156991 wait complete. 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.968+0000 7f7c8f608740 1 -- start start 2024-05-10T11:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.968+0000 7f7c8f608740 1 Processor -- start 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62ef9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 0x561c62e368c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e5b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561c62d3a5d0 con 0x561c62e79c80 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7c881fe7f0 con 0x561c62e7e220 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x561c62ea0ce0 con 0x561c62e61340 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 10 client.0 _ll_register_callbacks cb 0x7f7c7000d5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:05.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 0x561c62e368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 0x561c62e368c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53914/0 (socket says 172.21.15.66:53914) 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/633531074 learned_addr learned my addr 172.21.15.66:0/633531074 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8659c640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62ef9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c86d9d640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e5b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 msgr2=0x561c62ef9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62ef9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 msgr2=0x561c62e5b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e5b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 -- 172.21.15.66:0/633531074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c62e84800 con 0x561c62e79c80 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c7dd9b640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 0x561c62e368c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000f880 tx=0x7f7c70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6853650cd82e68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c657fa640 1 -- 172.21.15.66:0/633531074 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70038070 con 0x561c62e79c80 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c657fa640 1 -- 172.21.15.66:0/633531074 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7c70021ae0 con 0x561c62e79c80 2024-05-10T11:19:05.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.969+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c8001b040 con 0x561c62e79c80 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c657fa640 1 -- 172.21.15.66:0/633531074 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f7c70043050 con 0x561c62e79c80 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 10 client.7227 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x561c62e84520 con 0x561c62e79c80 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c657fa640 1 -- 172.21.15.66:0/633531074 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8001b040 con 0x561c62e79c80 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c657fa640 1 -- 172.21.15.66:0/633531074 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7f7c70046020 con 0x561c62e79c80 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 10 client.7227 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 10 client.7227 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 20 client.7227 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e5bd90 0x561c62e78d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 4 client.7227 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x561c62da1770 con 0x561c62e5bd90 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8659c640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e5bd90 0x561c62e78d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c657fa640 10 client.7227 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.970+0000 7f7c8659c640 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e5bd90 0x561c62e78d20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bde2ca91f15bedd server_cookie=92b0e17aea86459 in_seq=0 out_seq=0 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c657fa640 1 -- 172.21.15.66:0/633531074 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561c62da1770 con 0x561c62e5bd90 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c657fa640 10 client.7227 handle_command_reply: tid=0 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 client.7227 shutdown 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 msgr2=0x561c62e368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 0x561c62e368c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000f880 tx=0x7f7c70017000 comp rx=0 tx=0).stop 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 shutdown_connections 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x561c62e5bd90 0x561c62e78d20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561c62e7e220 0x561c62e5b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c657fa640 0 client.7227 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561c62e79c80 0x561c62e368c0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 --2- 172.21.15.66:0/633531074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561c62e61340 0x561c62ef9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 >> 172.21.15.66:0/633531074 conn(0x561c62e60c00 msgr2=0x561c62e72620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 shutdown_connections 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 1 -- 172.21.15.66:0/633531074 wait complete. 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f7c8f608740 20 client.7227 trim_cache size 0 max 16384 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "1de3c3ed-2899-4882-830a-d4e8c1e7f75e", 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:19:05.978 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:05.979 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:19:05.971+0000 7f1a5e808640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0)->f(v1 m2024-05-10T11:18:25.969922+0000) n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1)->n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559b585f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-05-10T11:19:05.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c680762d0 msgr2=0x7f7c68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c680762d0 0x7f7c68078790 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7c70006fd0 tx=0x7f7c70008040 comp rx=0 tx=0).stop 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 msgr2=0x7f7c88151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 0x7f7c88151f90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f7c7802a220 tx=0x7f7c780046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 shutdown_connections 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7c680762d0 0x7f7c68078790 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c8815b7b0 0x7f7c8809cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c8815b3d0 0x7f7c880b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 --2- 172.21.15.66:0/2186326450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c8806ec80 0x7f7c88151f90 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 >> 172.21.15.66:0/2186326450 conn(0x7f7c8806c4a0 msgr2=0x7f7c88153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 shutdown_connections 2024-05-10T11:19:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:05.972+0000 7f7c8c815640 1 -- 172.21.15.66:0/2186326450 wait complete. 2024-05-10T11:19:05.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:05.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T11:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.089+0000 7f4a9ccfc640 1 Processor -- start 2024-05-10T11:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.089+0000 7f4a9ccfc640 1 -- start start 2024-05-10T11:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9ccfc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4a980cf3e0 0x7f4a980cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9ccfc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980cd500 0x7f4a980cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9ccfc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9806e720 con 0x7f4a980b2dd0 2024-05-10T11:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9ccfc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9806de80 con 0x7f4a980cf3e0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9ccfc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9806e160 con 0x7f4a980cd500 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4a980cf3e0 0x7f4a980cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4a980cf3e0 0x7f4a980cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53918/0 (socket says 172.21.15.66:53918) 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 -- 172.21.15.66:0/868566520 learned_addr learned my addr 172.21.15.66:0/868566520 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980cd500 0x7f4a980cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 -- 172.21.15.66:0/868566520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980cd500 msgr2=0x7f4a980cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980cd500 0x7f4a980cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 -- 172.21.15.66:0/868566520 >> v1:172.21.15.190:6789/0 conn(0x7f4a980b2dd0 legacy=0x7f4a980b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a9659c640 1 -- 172.21.15.66:0/868566520 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9806e440 con 0x7f4a980cf3e0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.090+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980cd500 0x7f4a980cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.091+0000 7f4a9659c640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a980cf8c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009870 tx=0x7f4a8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268496437b38a4d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.091+0000 7f4a9559a640 1 -- 172.21.15.66:0/868566520 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88037070 con 0x7f4a980cf3e0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.091+0000 7f4a9559a640 1 -- 172.21.15.66:0/868566520 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a88032440 con 0x7f4a980cf3e0 2024-05-10T11:19:06.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.091+0000 7f4a9559a640 1 -- 172.21.15.66:0/868566520 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88032810 con 0x7f4a980cf3e0 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.091+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/868566520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 msgr2=0x7f4a980cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.091+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a980cf8c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009870 tx=0x7f4a8802a270 comp rx=0 tx=0).stop 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.092+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/868566520 shutdown_connections 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.092+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980cd500 0x7f4a980cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.092+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/868566520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a980cf8c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.092+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/868566520 >> 172.21.15.66:0/868566520 conn(0x7f4a980d2eb0 msgr2=0x7f4a980d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.092+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/868566520 shutdown_connections 2024-05-10T11:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.092+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/868566520 wait complete. 2024-05-10T11:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.093+0000 7f4a9ccfc640 1 Processor -- start 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.093+0000 7f4a9ccfc640 1 -- start start 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b2dd0 0x7f4a98153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a980cd500 0x7f4a980b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a981566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a980d2190 con 0x7f4a980cf3e0 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4a980b4510 con 0x7f4a980cd500 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4a980d2310 con 0x7f4a980b2dd0 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a981566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a981566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53928/0 (socket says 172.21.15.66:53928) 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3990752483 learned_addr learned my addr 172.21.15.66:0/3990752483 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a980cd500 0x7f4a980b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b2dd0 0x7f4a98153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b2dd0 msgr2=0x7f4a98153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b2dd0 0x7f4a98153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a980cd500 msgr2=0x7f4a980b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a980cd500 0x7f4a980b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3990752483 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a980afc00 con 0x7f4a980cf3e0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a980cd500 0x7f4a980b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b2dd0 0x7f4a98153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a981566b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c7d0 tx=0x7f4a9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a8effd640 1 -- 172.21.15.66:0/3990752483 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90003b70 con 0x7f4a980cf3e0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a8effd640 1 -- 172.21.15.66:0/3990752483 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90003d30 con 0x7f4a980cf3e0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a980afee0 con 0x7f4a980cf3e0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.094+0000 7f4a8effd640 1 -- 172.21.15.66:0/3990752483 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9000aa90 con 0x7f4a980cf3e0 2024-05-10T11:19:06.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.095+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a980b04a0 con 0x7f4a980cf3e0 2024-05-10T11:19:06.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.096+0000 7f4a8effd640 1 -- 172.21.15.66:0/3990752483 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a9000ac30 con 0x7f4a980cf3e0 2024-05-10T11:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.097+0000 7f4a8effd640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4a78076300 0x7f4a780787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.097+0000 7f4a8effd640 1 -- 172.21.15.66:0/3990752483 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f4a90097720 con 0x7f4a980cf3e0 2024-05-10T11:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.097+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4a78076300 0x7f4a780787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.097+0000 7f4a9fa14740 1 Processor -- start 2024-05-10T11:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.097+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4a78076300 0x7f4a780787c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a88034000 tx=0x7f4a8802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.097+0000 7f4a9fa14740 1 -- start start 2024-05-10T11:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ae02160 0x55a44adb4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 0x55a44ade4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade4b40 0x55a44adb9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a44ad81690 con 0x55a44ade5280 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a44ad1ef30 con 0x55a44ade4b40 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a44acd7b20 con 0x55a44ae02160 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 0x55a44ade4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 0x55a44ade4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53932/0 (socket says 172.21.15.66:53932) 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a95d9b640 1 -- 172.21.15.66:0/742435716 learned_addr learned my addr 172.21.15.66:0/742435716 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade4b40 0x55a44adb9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.098+0000 7f4a9659c640 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ae02160 0x55a44adb4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a95d9b640 1 -- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ae02160 msgr2=0x55a44adb4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ae02160 0x55a44adb4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a95d9b640 1 -- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade4b40 msgr2=0x55a44adb9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade4b40 0x55a44adb9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a95d9b640 1 -- 172.21.15.66:0/742435716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44accfe60 con 0x55a44ade5280 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 0x55a44ade4600 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000d910 tx=0x7f4a8000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bce2f0b4bad3c78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a77fff640 1 -- 172.21.15.66:0/742435716 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000fa80 con 0x55a44ade5280 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a77fff640 1 -- 172.21.15.66:0/742435716 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8000fc20 con 0x55a44ade5280 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.099+0000 7f4a77fff640 1 -- 172.21.15.66:0/742435716 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80014480 con 0x55a44ade5280 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 -- 172.21.15.66:0/742435716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 msgr2=0x55a44ade4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 0x55a44ade4600 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000d910 tx=0x7f4a8000ddd0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 -- 172.21.15.66:0/742435716 shutdown_connections 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade4b40 0x55a44adb9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ade5280 0x55a44ade4600 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/742435716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ae02160 0x55a44adb4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 -- 172.21.15.66:0/742435716 >> 172.21.15.66:0/742435716 conn(0x55a44adb6d60 msgr2=0x55a44adff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 -- 172.21.15.66:0/742435716 shutdown_connections 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 -- 172.21.15.66:0/742435716 wait complete. 2024-05-10T11:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 -- start start 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.100+0000 7f4a9fa14740 1 Processor -- start 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44adf62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44add1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adf6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a44acdb5e0 con 0x55a44adb9f40 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a44ad1aef0 con 0x55a44ae02160 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a44adb8f10 con 0x55a44ade5280 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a9fa14740 10 client.0 _ll_register_callbacks cb 0x55a44acd6320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adf6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adf6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53934/0 (socket says 172.21.15.66:53934) 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.101+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3477320583 learned_addr learned my addr 172.21.15.66:0/3477320583 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44add1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44adf62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 msgr2=0x55a44adf62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44adf62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 msgr2=0x55a44add1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44add1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3477320583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a44aafa7d0 con 0x55a44adb9f40 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44add1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adf6c30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4a9005cd70 tx=0x7f4a900601c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a779ba8433a42f22 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a757fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a757fa640 1 -- 172.21.15.66:0/3477320583 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90067070 con 0x55a44adb9f40 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a757fa640 1 -- 172.21.15.66:0/3477320583 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f4a90075b40 con 0x55a44adb9f40 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a8000fc20 con 0x55a44adb9f40 2024-05-10T11:19:06.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a757fa640 1 -- 172.21.15.66:0/3477320583 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f4a90095050 con 0x55a44adb9f40 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a9fa14740 10 client.7239 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55a44aa303f0 con 0x55a44adb9f40 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.102+0000 7f4a757fa640 1 -- 172.21.15.66:0/3477320583 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8000fc20 con 0x55a44adb9f40 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a757fa640 1 -- 172.21.15.66:0/3477320583 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7f4a9005c0f0 con 0x55a44adb9f40 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9fa14740 10 client.7239 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9fa14740 10 client.7239 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9fa14740 20 client.7239 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44ae12b40 0x55a44ae12f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9fa14740 4 client.7239 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a44ad2cb40 con 0x55a44ae12b40 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44ae12b40 0x55a44ae12f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a757fa640 10 client.7239 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:06.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.103+0000 7f4a9659c640 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44ae12b40 0x55a44ae12f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=694201a0b3eb4e1b server_cookie=cd0c84d32d99c0cf in_seq=0 out_seq=0 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a757fa640 1 -- 172.21.15.66:0/3477320583 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a44ad2cb40 con 0x55a44ae12b40 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a757fa640 10 client.7239 handle_command_reply: tid=0 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 client.7239 shutdown 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 msgr2=0x55a44adf6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adf6c30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4a9005cd70 tx=0x7f4a900601c0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 shutdown_connections 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44ae12b40 0x55a44ae12f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adf6c30 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44add1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a757fa640 0 client.7239 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3477320583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44adf62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 >> 172.21.15.66:0/3477320583 conn(0x55a44ade4b40 msgr2=0x55a44adb85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 shutdown_connections 2024-05-10T11:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3477320583 wait complete. 2024-05-10T11:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.104+0000 7f4a9fa14740 20 client.7239 trim_cache size 0 max 16384 2024-05-10T11:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.122+0000 7f4a9fa14740 1 Processor -- start 2024-05-10T11:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.122+0000 7f4a9fa14740 1 -- start start 2024-05-10T11:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44adb9f40 0x55a44adf63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade5280 0x55a44adf7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 0x55a44ade1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98202090 con 0x55a44ae02160 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98201070 con 0x55a44ade5280 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4a981f5cd0 con 0x55a44adb9f40 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 0x55a44ade1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 0x55a44ade1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53942/0 (socket says 172.21.15.66:53942) 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3738648932 learned_addr learned my addr 172.21.15.66:0/3738648932 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44adb9f40 msgr2=0x55a44adf63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44adb9f40 0x55a44adf63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade5280 msgr2=0x55a44adf7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade5280 0x55a44adf7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade5280 0x55a44adf7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 -- 172.21.15.66:0/3738648932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44a9f00f0 con 0x55a44ae02160 2024-05-10T11:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade5280 0x55a44adf7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.123+0000 7f4a96d9d640 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 0x55a44ade1000 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a430 tx=0x7f4a90067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaf51177f303f49 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a777fe640 1 -- 172.21.15.66:0/3738648932 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9005c640 con 0x55a44ae02160 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a777fe640 1 -- 172.21.15.66:0/3738648932 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90067070 con 0x55a44ae02160 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a777fe640 1 -- 172.21.15.66:0/3738648932 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a900607d0 con 0x55a44ae02160 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3738648932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 msgr2=0x55a44ade1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 0x55a44ade1000 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a430 tx=0x7f4a90067000 comp rx=0 tx=0).stop 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3738648932 shutdown_connections 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44ae02160 0x55a44ade1000 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ade5280 0x55a44adf7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/3738648932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44adb9f40 0x55a44adf63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3738648932 >> 172.21.15.66:0/3738648932 conn(0x55a44ade4b40 msgr2=0x55a44adff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3738648932 shutdown_connections 2024-05-10T11:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.124+0000 7f4a9fa14740 1 -- 172.21.15.66:0/3738648932 wait complete. 2024-05-10T11:19:06.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.125+0000 7f4a9fa14740 1 -- start start 2024-05-10T11:19:06.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.125+0000 7f4a9fa14740 1 Processor -- start 2024-05-10T11:19:06.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adfe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44ae7c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44ae7cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a44adb00c0 con 0x55a44adb9f40 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98200a30 con 0x55a44ae02160 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55a44adf6910 con 0x55a44ade5280 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 10 client.0 _ll_register_callbacks cb 0x7f4a9005cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adfe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adfe880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53950/0 (socket says 172.21.15.66:53950) 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 -- 172.21.15.66:0/2202254341 learned_addr learned my addr 172.21.15.66:0/2202254341 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 -- 172.21.15.66:0/2202254341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 msgr2=0x55a44ae7c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44ae7c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 -- 172.21.15.66:0/2202254341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 msgr2=0x55a44ae7cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44ae7cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 -- 172.21.15.66:0/2202254341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a44adb9a90 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9659c640 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adfe880 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4a88035040 tx=0x7f4a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d00c21fc592b57 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a757fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a757fa640 1 -- 172.21.15.66:0/2202254341 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88037040 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a757fa640 1 -- 172.21.15.66:0/2202254341 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f4a8804f490 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a44ad269b0 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a757fa640 1 -- 172.21.15.66:0/2202254341 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f4a8805e050 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.126+0000 7f4a9fa14740 10 client.7245 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55a44adfd7e0 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a757fa640 1 -- 172.21.15.66:0/2202254341 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a44ad269b0 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a757fa640 1 -- 172.21.15.66:0/2202254341 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7f4a88061020 con 0x55a44adb9f40 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 10 client.7245 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 10 client.7245 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 20 client.7245 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44adb0260 0x55a44addf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 4 client.7245 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a44aca14a0 con 0x55a44adb0260 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44adb0260 0x55a44addf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a757fa640 10 client.7245 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a95d9b640 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44adb0260 0x55a44addf0e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8823c647a90b398 server_cookie=a355b854141cf91 in_seq=0 out_seq=0 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a757fa640 1 -- 172.21.15.66:0/2202254341 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x55a44aca14a0 con 0x55a44adb0260 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a757fa640 10 client.7245 handle_command_reply: tid=0 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.127+0000 7f4a9fa14740 1 client.7245 shutdown 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 msgr2=0x55a44adfe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adfe880 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4a88035040 tx=0x7f4a880046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 shutdown_connections 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55a44adb0260 0x55a44addf0e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a44ae02160 0x55a44ae7cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a757fa640 0 client.7245 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a44ade5280 0x55a44ae7c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 --2- 172.21.15.66:0/2202254341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a44adb9f40 0x55a44adfe880 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 >> 172.21.15.66:0/2202254341 conn(0x55a44ade4b40 msgr2=0x55a44ade1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 shutdown_connections 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 1 -- 172.21.15.66:0/2202254341 wait complete. 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9fa14740 20 client.7245 trim_cache size 0 max 16384 2024-05-10T11:19:06.135 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: "1de3c3ed-2899-4882-830a-d4e8c1e7f75e": { 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/dir", 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "1de3c3ed-2899-4882-830a-d4e8c1e7f75e", 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair" 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:19:06.136 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4a78076300 msgr2=0x7f4a780787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4a78076300 0x7f4a780787c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a88034000 tx=0x7f4a8802e000 comp rx=0 tx=0).stop 2024-05-10T11:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 msgr2=0x7f4a981566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a981566b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c7d0 tx=0x7f4a9000cc90 comp rx=0 tx=0).stop 2024-05-10T11:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 shutdown_connections 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4a78076300 0x7f4a780787c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a980cf3e0 0x7f4a981566b0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a980cd500 0x7f4a980b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 --2- 172.21.15.66:0/3990752483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b2dd0 0x7f4a98153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 >> 172.21.15.66:0/3990752483 conn(0x7f4a980d2eb0 msgr2=0x7f4a980d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 shutdown_connections 2024-05-10T11:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:06.128+0000 7f4a9ccfc640 1 -- 172.21.15.66:0/3990752483 wait complete. 2024-05-10T11:19:06.142 INFO:tasks.cephfs.filesystem:scrub status for tag:1de3c3ed-2899-4882-830a-d4e8c1e7f75e - {'path': '/dir', 'tag': '1de3c3ed-2899-4882-830a-d4e8c1e7f75e', 'options': 'recursive,repair'} 2024-05-10T11:19:32.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:19:32.581 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:19:36.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:36.144 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T11:19:36.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.263+0000 7f128110a640 1 Processor -- start 2024-05-10T11:19:36.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.264+0000 7f128110a640 1 -- start start 2024-05-10T11:19:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.264+0000 7f128110a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f127c15d810 0x7f127c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.264+0000 7f128110a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c157a40 con 0x7f127c06df20 2024-05-10T11:19:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.264+0000 7f128110a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c160d80 con 0x7f127c06c2c0 2024-05-10T11:19:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.264+0000 7f128110a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f127c161990 con 0x7f127c15d810 2024-05-10T11:19:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f127c15d810 0x7f127c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f127c15d810 0x7f127c15dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38998/0 (socket says 172.21.15.66:38998) 2024-05-10T11:19:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127b59e640 1 -- 172.21.15.66:0/688249155 learned_addr learned my addr 172.21.15.66:0/688249155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127a59c640 1 --1- 172.21.15.66:0/688249155 >> v1:172.21.15.66:6789/0 conn(0x7f127c06df20 0x7f127c0739e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52636/0 (socket says 172.21.15.66:52636) 2024-05-10T11:19:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127b59e640 1 -- 172.21.15.66:0/688249155 >> v1:172.21.15.190:6789/0 conn(0x7f127c06c2c0 legacy=0x7f127c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f1279d9b640 1 -- 172.21.15.66:0/688249155 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514565844 0 0) 0x7f1264001110 con 0x7f127c06df20 2024-05-10T11:19:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127b59e640 1 -- 172.21.15.66:0/688249155 >> v1:172.21.15.66:6789/0 conn(0x7f127c06df20 legacy=0x7f127c0739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.265+0000 7f127b59e640 1 -- 172.21.15.66:0/688249155 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c161060 con 0x7f127c15d810 2024-05-10T11:19:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.266+0000 7f127b59e640 1 --2- 172.21.15.66:0/688249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c15dc40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1274009870 tx=0x7f127402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efae72258cedf7f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.266+0000 7f1279d9b640 1 -- 172.21.15.66:0/688249155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274037070 con 0x7f127c15d810 2024-05-10T11:19:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.266+0000 7f1279d9b640 1 -- 172.21.15.66:0/688249155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127402ae50 con 0x7f127c15d810 2024-05-10T11:19:36.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.266+0000 7f1279d9b640 1 -- 172.21.15.66:0/688249155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274032860 con 0x7f127c15d810 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 -- 172.21.15.66:0/688249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 msgr2=0x7f127c15dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 --2- 172.21.15.66:0/688249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c15dc40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1274009870 tx=0x7f127402a300 comp rx=0 tx=0).stop 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 -- 172.21.15.66:0/688249155 shutdown_connections 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 --2- 172.21.15.66:0/688249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c15dc40 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 -- 172.21.15.66:0/688249155 >> 172.21.15.66:0/688249155 conn(0x7f127c0d0c90 msgr2=0x7f127c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 -- 172.21.15.66:0/688249155 shutdown_connections 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.267+0000 7f128110a640 1 -- 172.21.15.66:0/688249155 wait complete. 2024-05-10T11:19:36.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.268+0000 7f128110a640 1 Processor -- start 2024-05-10T11:19:36.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.268+0000 7f128110a640 1 -- start start 2024-05-10T11:19:36.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f128110a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f127c06c2c0 0x7f127c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f128110a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f127c06df20 0x7f127c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f128110a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f128110a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0cd440 con 0x7f127c15d810 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f128110a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f127c161620 con 0x7f127c06df20 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f128110a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f127c072180 con 0x7f127c06c2c0 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c0b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39014/0 (socket says 172.21.15.66:39014) 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 -- 172.21.15.66:0/2057678340 learned_addr learned my addr 172.21.15.66:0/2057678340 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127a59c640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f127c06df20 0x7f127c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127ad9d640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f127c06c2c0 0x7f127c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 -- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f127c06c2c0 msgr2=0x7f127c152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f127c06c2c0 0x7f127c152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 -- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f127c06df20 msgr2=0x7f127c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f127c06df20 0x7f127c152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.269+0000 7f127b59e640 1 -- 172.21.15.66:0/2057678340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c0b3040 con 0x7f127c15d810 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.270+0000 7f127b59e640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c0b3c80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f127402a340 tx=0x7f12740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.270+0000 7f12737fe640 1 -- 172.21.15.66:0/2057678340 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274041070 con 0x7f127c15d810 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.270+0000 7f12737fe640 1 -- 172.21.15.66:0/2057678340 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127403c890 con 0x7f127c15d810 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.270+0000 7f12737fe640 1 -- 172.21.15.66:0/2057678340 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274037040 con 0x7f127c15d810 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.270+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c0b3320 con 0x7f127c15d810 2024-05-10T11:19:36.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.270+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c15e630 con 0x7f127c15d810 2024-05-10T11:19:36.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.272+0000 7f12737fe640 1 -- 172.21.15.66:0/2057678340 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1274044070 con 0x7f127c15d810 2024-05-10T11:19:36.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.272+0000 7f12737fe640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f125c0762d0 0x7f125c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.272+0000 7f12737fe640 1 -- 172.21.15.66:0/2057678340 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f12740b8140 con 0x7f127c15d810 2024-05-10T11:19:36.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.273+0000 7f127ad9d640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f125c0762d0 0x7f125c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.273+0000 7f1283e26740 1 Processor -- start 2024-05-10T11:19:36.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.273+0000 7f127ad9d640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f125c0762d0 0x7f125c078790 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f127c0ca980 tx=0x7f126c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.273+0000 7f1283e26740 1 -- start start 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e3450 0x55accf4e7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4bb160 0x55accf4e3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f1283e26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf4e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f1283e26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55accf483690 con 0x55accf4e3d70 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55accf420f30 con 0x55accf4e3450 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55accf3d9b20 con 0x55accf4bb160 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f127b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf4e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f127a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4bb160 0x55accf4e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f127b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf4e6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39028/0 (socket says 172.21.15.66:39028) 2024-05-10T11:19:36.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f127ad9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e3450 0x55accf4e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.274+0000 7f127b59e640 1 -- 172.21.15.66:0/1279032001 learned_addr learned my addr 172.21.15.66:0/1279032001 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f127b59e640 1 -- 172.21.15.66:0/1279032001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4bb160 msgr2=0x55accf4e3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f127b59e640 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4bb160 0x55accf4e3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f127b59e640 1 -- 172.21.15.66:0/1279032001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e3450 msgr2=0x55accf4e7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f127b59e640 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e3450 0x55accf4e7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f127b59e640 1 -- 172.21.15.66:0/1279032001 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accf3d1e60 con 0x55accf4e3d70 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f127b59e640 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf4e6600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f12740b6360 tx=0x7f1274080fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c46ba7ddde2ce44 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f1270ff9640 1 -- 172.21.15.66:0/1279032001 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127404b040 con 0x55accf4e3d70 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f1270ff9640 1 -- 172.21.15.66:0/1279032001 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127402ae50 con 0x55accf4e3d70 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.275+0000 7f1270ff9640 1 -- 172.21.15.66:0/1279032001 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274081850 con 0x55accf4e3d70 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 -- 172.21.15.66:0/1279032001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 msgr2=0x55accf4e6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf4e6600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f12740b6360 tx=0x7f1274080fe0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 -- 172.21.15.66:0/1279032001 shutdown_connections 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf4e6600 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4bb160 0x55accf4e3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 --2- 172.21.15.66:0/1279032001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e3450 0x55accf4e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 -- 172.21.15.66:0/1279032001 >> 172.21.15.66:0/1279032001 conn(0x55accf4b8d60 msgr2=0x55accf501600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 -- 172.21.15.66:0/1279032001 shutdown_connections 2024-05-10T11:19:36.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 -- 172.21.15.66:0/1279032001 wait complete. 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.276+0000 7f1283e26740 1 -- start start 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 Processor -- start 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4d92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55accf3dd5e0 con 0x55accf4e3450 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55accf41cef0 con 0x55accf4e1d40 2024-05-10T11:19:36.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55accf4b70b0 con 0x55accf4e3d70 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f1283e26740 10 client.0 _ll_register_callbacks cb 0x55accf3d8320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f127ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f127ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39040/0 (socket says 172.21.15.66:39040) 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.277+0000 7f127ad9d640 1 -- 172.21.15.66:0/4083879358 learned_addr learned my addr 172.21.15.66:0/4083879358 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127ad9d640 1 -- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 msgr2=0x55accf4e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127a59c640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127ad9d640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127b59e640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4d92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127ad9d640 1 -- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 msgr2=0x55accf4d92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127ad9d640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4d92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127ad9d640 1 -- 172.21.15.66:0/4083879358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55accf1fc7d0 con 0x55accf4e3450 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127a59c640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127b59e640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4d92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:36.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f127ad9d640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e0fb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f126c00eb50 tx=0x7f126c001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1450b2c9aad1213c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1259ffb640 1 -- 172.21.15.66:0/4083879358 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c027060 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1259ffb640 1 -- 172.21.15.66:0/4083879358 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f126c010040 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f127402ae50 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1259ffb640 1 -- 172.21.15.66:0/4083879358 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f126c013420 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1283e26740 10 client.7260 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55accf1323f0 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.278+0000 7f1259ffb640 1 -- 172.21.15.66:0/4083879358 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127402ae50 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1259ffb640 1 -- 172.21.15.66:0/4083879358 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7f126c0135c0 con 0x55accf4e3450 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1283e26740 10 client.7260 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1283e26740 10 client.7260 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1283e26740 20 client.7260 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:36.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1283e26740 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf4d9cf0 0x55accf4d7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1283e26740 4 client.7260 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55accf42eb40 con 0x55accf4d9cf0 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f127a59c640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf4d9cf0 0x55accf4d7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f127a59c640 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf4d9cf0 0x55accf4d7990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd2496a3a5b1887 server_cookie=44dd70dd38c5041e in_seq=0 out_seq=0 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.279+0000 7f1259ffb640 10 client.7260 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1259ffb640 1 -- 172.21.15.66:0/4083879358 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55accf42eb40 con 0x55accf4d9cf0 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1259ffb640 10 client.7260 handle_command_reply: tid=0 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 client.7260 shutdown 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 msgr2=0x55accf4e0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e0fb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f126c00eb50 tx=0x7f126c001400 comp rx=0 tx=0).stop 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 shutdown_connections 2024-05-10T11:19:36.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf4d9cf0 0x55accf4d7990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4d92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1259ffb640 0 client.7260 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 --2- 172.21.15.66:0/4083879358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e0fb0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 >> 172.21.15.66:0/4083879358 conn(0x55accf4bb160 msgr2=0x55accf4bbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 shutdown_connections 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 1 -- 172.21.15.66:0/4083879358 wait complete. 2024-05-10T11:19:36.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.280+0000 7f1283e26740 20 client.7260 trim_cache size 0 max 16384 2024-05-10T11:19:36.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.298+0000 7f1283e26740 1 Processor -- start 2024-05-10T11:19:36.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.298+0000 7f1283e26740 1 -- start start 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f1283e26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f1283e26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1fdeb0 con 0x55accf4e3450 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0d0460 con 0x55accf4e1d40 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f127c0c6800 con 0x55accf4e3d70 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39044/0 (socket says 172.21.15.66:39044) 2024-05-10T11:19:36.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 -- 172.21.15.66:0/1756637745 learned_addr learned my addr 172.21.15.66:0/1756637745 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 -- 172.21.15.66:0/1756637745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 msgr2=0x55accf4e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 -- 172.21.15.66:0/1756637745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 msgr2=0x55accf4b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.299+0000 7f127a59c640 1 -- 172.21.15.66:0/1756637745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accf4e1320 con 0x55accf4e3450 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f127a59c640 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e16e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f1264000c00 tx=0x7f12640070d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d8127ab9ea9c83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f125bfff640 1 -- 172.21.15.66:0/1756637745 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640199b0 con 0x55accf4e3450 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f125bfff640 1 -- 172.21.15.66:0/1756637745 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1264019b50 con 0x55accf4e3450 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f125bfff640 1 -- 172.21.15.66:0/1756637745 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1264024450 con 0x55accf4e3450 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 -- 172.21.15.66:0/1756637745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 msgr2=0x55accf4e16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e16e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f1264000c00 tx=0x7f12640070d0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 -- 172.21.15.66:0/1756637745 shutdown_connections 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3d70 0x55accf4e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3450 0x55accf4e16e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 --2- 172.21.15.66:0/1756637745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf4b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 -- 172.21.15.66:0/1756637745 >> 172.21.15.66:0/1756637745 conn(0x55accf4bb160 msgr2=0x55accf4b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 -- 172.21.15.66:0/1756637745 shutdown_connections 2024-05-10T11:19:36.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.300+0000 7f1283e26740 1 -- 172.21.15.66:0/1756637745 wait complete. 2024-05-10T11:19:36.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.301+0000 7f1283e26740 1 -- start start 2024-05-10T11:19:36.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.301+0000 7f1283e26740 1 Processor -- start 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf583750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3450 0x55accf51f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf5270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0cfdd0 con 0x55accf4e3d70 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55accf583fa0 con 0x55accf4e1d40 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55accf5056d0 con 0x55accf4e3450 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1283e26740 10 client.0 _ll_register_callbacks cb 0x7f126c003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf5270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf5270c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39048/0 (socket says 172.21.15.66:39048) 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 -- 172.21.15.66:0/2879752286 learned_addr learned my addr 172.21.15.66:0/2879752286 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127ad9d640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf583750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127a59c640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3450 0x55accf51f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 -- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3450 msgr2=0x55accf51f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3450 0x55accf51f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 -- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 msgr2=0x55accf583750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf583750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 -- 172.21.15.66:0/2879752286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55accf0f20f0 con 0x55accf4e3d70 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127a59c640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3450 0x55accf51f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f127b59e640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf5270c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f127407d1d0 tx=0x7f12740b62f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa4208ff01ff38 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.302+0000 7f1259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1259ffb640 1 -- 172.21.15.66:0/2879752286 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740b4060 con 0x55accf4e3d70 2024-05-10T11:19:36.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1259ffb640 1 -- 172.21.15.66:0/2879752286 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f1274089c90 con 0x55accf4e3d70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1264019b50 con 0x55accf4e3d70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1259ffb640 1 -- 172.21.15.66:0/2879752286 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f127404b040 con 0x55accf4e3d70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 10 client.7266 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55accf583d40 con 0x55accf4e3d70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1259ffb640 1 -- 172.21.15.66:0/2879752286 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1264019b50 con 0x55accf4e3d70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1259ffb640 1 -- 172.21.15.66:0/2879752286 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7f12740803b0 con 0x55accf4e3d70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 10 client.7266 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 10 client.7266 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 20 client.7266 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf527600 0x55accf4bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 4 client.7266 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55accf50e060 con 0x55accf527600 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f127ad9d640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf527600 0x55accf4bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f127ad9d640 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf527600 0x55accf4bd5c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e47a6f66b26963a0 server_cookie=6afc674115cdd1c6 in_seq=0 out_seq=0 2024-05-10T11:19:36.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.303+0000 7f1259ffb640 10 client.7266 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1259ffb640 1 -- 172.21.15.66:0/2879752286 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55accf50e060 con 0x55accf527600 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1259ffb640 10 client.7266 handle_command_reply: tid=0 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 client.7266 shutdown 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 msgr2=0x55accf5270c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf5270c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f127407d1d0 tx=0x7f12740b62f0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 shutdown_connections 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x55accf527600 0x55accf4bd5c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55accf4e3d70 0x55accf5270c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55accf4e3450 0x55accf51f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 --2- 172.21.15.66:0/2879752286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55accf4e1d40 0x55accf583750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 >> 172.21.15.66:0/2879752286 conn(0x55accf4bb160 msgr2=0x55accf4e2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1259ffb640 0 client.7266 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 shutdown_connections 2024-05-10T11:19:36.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 1 -- 172.21.15.66:0/2879752286 wait complete. 2024-05-10T11:19:36.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f1283e26740 20 client.7266 trim_cache size 0 max 16384 2024-05-10T11:19:36.311 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:36.311 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:19:36.311 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:19:36.311 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:36.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f125c0762d0 msgr2=0x7f125c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f128110a640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f125c0762d0 0x7f125c078790 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f127c0ca980 tx=0x7f126c009040 comp rx=0 tx=0).stop 2024-05-10T11:19:36.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 msgr2=0x7f127c0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.304+0000 7f128110a640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c0b3c80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f127402a340 tx=0x7f12740046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 shutdown_connections 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f125c0762d0 0x7f125c078790 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127c15d810 0x7f127c0b3c80 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f127c06df20 0x7f127c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 --2- 172.21.15.66:0/2057678340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f127c06c2c0 0x7f127c152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 >> 172.21.15.66:0/2057678340 conn(0x7f127c0d0c90 msgr2=0x7f127c1553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 shutdown_connections 2024-05-10T11:19:36.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.305+0000 7f128110a640 1 -- 172.21.15.66:0/2057678340 wait complete. 2024-05-10T11:19:36.316 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:19:36.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:19:36.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.420+0000 7fca5a293640 1 Processor -- start 2024-05-10T11:19:36.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.420+0000 7fca5a293640 1 -- start start 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca5a293640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fca54162750 0x7fca540d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca5a293640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca540d5cb0 0x7fca540d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca5a293640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca540b45f0 con 0x7fca54162b30 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca5a293640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fca540b4f20 con 0x7fca54162750 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca5a293640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fca540d0fe0 con 0x7fca540d5cb0 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fca54162750 0x7fca540d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fca54162750 0x7fca540d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39052/0 (socket says 172.21.15.66:39052) 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 -- 172.21.15.66:0/3726549503 learned_addr learned my addr 172.21.15.66:0/3726549503 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca537fe640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca540d5cb0 0x7fca540d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 -- 172.21.15.66:0/3726549503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca540d5cb0 msgr2=0x7fca540d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca540d5cb0 0x7fca540d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 -- 172.21.15.66:0/3726549503 >> v1:172.21.15.190:6789/0 conn(0x7fca54162b30 legacy=0x7fca540d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca53fff640 1 -- 172.21.15.66:0/3726549503 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca540b48d0 con 0x7fca54162750 2024-05-10T11:19:36.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.421+0000 7fca537fe640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca540d5cb0 0x7fca540d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:36.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.422+0000 7fca53fff640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca540d0670 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fca44009870 tx=0x7fca4402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c96f7ff64b0ec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.422+0000 7fca52ffd640 1 -- 172.21.15.66:0/3726549503 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44037070 con 0x7fca54162750 2024-05-10T11:19:36.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.422+0000 7fca52ffd640 1 -- 172.21.15.66:0/3726549503 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44032440 con 0x7fca54162750 2024-05-10T11:19:36.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.422+0000 7fca52ffd640 1 -- 172.21.15.66:0/3726549503 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44032810 con 0x7fca54162750 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 -- 172.21.15.66:0/3726549503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 msgr2=0x7fca540d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca540d0670 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fca44009870 tx=0x7fca4402a180 comp rx=0 tx=0).stop 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 -- 172.21.15.66:0/3726549503 shutdown_connections 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca540d5cb0 0x7fca540d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 --2- 172.21.15.66:0/3726549503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca540d0670 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 -- 172.21.15.66:0/3726549503 >> 172.21.15.66:0/3726549503 conn(0x7fca5409e3b0 msgr2=0x7fca540d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 -- 172.21.15.66:0/3726549503 shutdown_connections 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.423+0000 7fca5a293640 1 -- 172.21.15.66:0/3726549503 wait complete. 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.424+0000 7fca5a293640 1 Processor -- start 2024-05-10T11:19:36.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.424+0000 7fca5a293640 1 -- start start 2024-05-10T11:19:36.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca5a293640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca541f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca5a293640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca54162b30 0x7fca5414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca5a293640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca541f5900 0x7fca54160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca5a293640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fca540d0d30 con 0x7fca54162750 2024-05-10T11:19:36.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca5a293640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fca540d0bb0 con 0x7fca541f5900 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca5a293640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fca540b63c0 con 0x7fca54162b30 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca541f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca541f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39068/0 (socket says 172.21.15.66:39068) 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 -- 172.21.15.66:0/4010714892 learned_addr learned my addr 172.21.15.66:0/4010714892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca537fe640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca54162b30 0x7fca5414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca58830640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca541f5900 0x7fca54160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 -- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca54162b30 msgr2=0x7fca5414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca54162b30 0x7fca5414dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 -- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca541f5900 msgr2=0x7fca54160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca541f5900 0x7fca54160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 -- 172.21.15.66:0/4010714892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca541f8ae0 con 0x7fca54162750 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.425+0000 7fca53fff640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca541f8450 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fca44009870 tx=0x7fca440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.426+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44041020 con 0x7fca54162750 2024-05-10T11:19:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.426+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44030970 con 0x7fca54162750 2024-05-10T11:19:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.426+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca541f8dc0 con 0x7fca54162750 2024-05-10T11:19:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.426+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44037040 con 0x7fca54162750 2024-05-10T11:19:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.426+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca54159a30 con 0x7fca54162750 2024-05-10T11:19:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.427+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5406a220 con 0x7fca54162750 2024-05-10T11:19:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.427+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca44044020 con 0x7fca54162750 2024-05-10T11:19:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.428+0000 7fca50ff9640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca40076300 0x7fca400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.428+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fca440b81d0 con 0x7fca54162750 2024-05-10T11:19:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.428+0000 7fca537fe640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca40076300 0x7fca400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.429+0000 7fca537fe640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca40076300 0x7fca400787c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fca540cb740 tx=0x7fca48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.432+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fca4404b030 con 0x7fca54162750 2024-05-10T11:19:36.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.660+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca54159800 con 0x7fca54162750 2024-05-10T11:19:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.661+0000 7fca50ff9640 1 -- 172.21.15.66:0/4010714892 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5187 (secure 0 0 0) 0x7fca440818e0 con 0x7fca54162750 2024-05-10T11:19:36.661 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:36.661 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:34.690562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6867,"qdb_cluster":[6867]},"id":6}]} 2024-05-10T11:19:36.662 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 70 2024-05-10T11:19:36.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca40076300 msgr2=0x7fca400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca40076300 0x7fca400787c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fca540cb740 tx=0x7fca48008040 comp rx=0 tx=0).stop 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 msgr2=0x7fca541f8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca541f8450 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fca44009870 tx=0x7fca440046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 shutdown_connections 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fca40076300 0x7fca400787c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca541f5900 0x7fca54160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca54162b30 0x7fca5414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 --2- 172.21.15.66:0/4010714892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca54162750 0x7fca541f8450 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 >> 172.21.15.66:0/4010714892 conn(0x7fca5409e3b0 msgr2=0x7fca5406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 shutdown_connections 2024-05-10T11:19:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.663+0000 7fca5a293640 1 -- 172.21.15.66:0/4010714892 wait complete. 2024-05-10T11:19:36.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T11:19:36.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.781+0000 7fa664f0a640 1 Processor -- start 2024-05-10T11:19:36.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.781+0000 7fa664f0a640 1 -- start start 2024-05-10T11:19:36.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa664f0a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6600cfe90 0x7fa6600cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa664f0a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa660160c50 con 0x7fa6600b2960 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa664f0a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6600d39d0 con 0x7fa660160870 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa664f0a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600d3cb0 con 0x7fa6600cfe90 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa657fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6600cfe90 0x7fa6600cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa65ed9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa6600b2960 0x7fa6600b2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52644/0 (socket says 172.21.15.66:52644) 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa65ed9d640 1 -- 172.21.15.66:0/3998716716 learned_addr learned my addr 172.21.15.66:0/3998716716 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa657fff640 1 -- 172.21.15.66:0/3998716716 >> v1:172.21.15.190:6789/0 conn(0x7fa660160870 legacy=0x7fa6600cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa657fff640 1 -- 172.21.15.66:0/3998716716 >> v1:172.21.15.66:6789/0 conn(0x7fa6600b2960 legacy=0x7fa6600b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa657fff640 1 -- 172.21.15.66:0/3998716716 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600d1770 con 0x7fa6600cfe90 2024-05-10T11:19:36.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.782+0000 7fa65dd9b640 1 -- 172.21.15.66:0/3998716716 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806152796 0 0) 0x7fa660160c50 con 0x7fa6600b2960 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.783+0000 7fa657fff640 1 --2- 172.21.15.66:0/3998716716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600cfe90 0x7fa6600cea60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa6480097a0 tx=0x7fa64802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb38f350c333beb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.783+0000 7fa65dd9b640 1 -- 172.21.15.66:0/3998716716 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648037070 con 0x7fa6600cfe90 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.783+0000 7fa65dd9b640 1 -- 172.21.15.66:0/3998716716 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64802ae50 con 0x7fa6600cfe90 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.783+0000 7fa65dd9b640 1 -- 172.21.15.66:0/3998716716 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648032660 con 0x7fa6600cfe90 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.783+0000 7fa664f0a640 1 -- 172.21.15.66:0/3998716716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600cfe90 msgr2=0x7fa6600cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.783+0000 7fa664f0a640 1 --2- 172.21.15.66:0/3998716716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600cfe90 0x7fa6600cea60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa6480097a0 tx=0x7fa64802a140 comp rx=0 tx=0).stop 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.784+0000 7fa664f0a640 1 -- 172.21.15.66:0/3998716716 shutdown_connections 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.784+0000 7fa664f0a640 1 --2- 172.21.15.66:0/3998716716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600cfe90 0x7fa6600cea60 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.784+0000 7fa664f0a640 1 -- 172.21.15.66:0/3998716716 >> 172.21.15.66:0/3998716716 conn(0x7fa6600d2eb0 msgr2=0x7fa6600d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.784+0000 7fa664f0a640 1 -- 172.21.15.66:0/3998716716 shutdown_connections 2024-05-10T11:19:36.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.784+0000 7fa664f0a640 1 -- 172.21.15.66:0/3998716716 wait complete. 2024-05-10T11:19:36.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.785+0000 7fa664f0a640 1 Processor -- start 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.785+0000 7fa664f0a640 1 -- start start 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa664f0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6600b2960 0x7fa66006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa664f0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6600cfe90 0x7fa66006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa664f0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 0x7fa6600cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa664f0a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600d1460 con 0x7fa660160870 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa664f0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600d1d30 con 0x7fa6600cfe90 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa664f0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600b34a0 con 0x7fa6600b2960 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 0x7fa6600cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 0x7fa6600cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39092/0 (socket says 172.21.15.66:39092) 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 -- 172.21.15.66:0/1105959676 learned_addr learned my addr 172.21.15.66:0/1105959676 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 -- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6600b2960 msgr2=0x7fa66006efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa657fff640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6600cfe90 0x7fa66006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65e59c640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6600b2960 0x7fa66006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6600b2960 0x7fa66006efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 -- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6600cfe90 msgr2=0x7fa66006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6600cfe90 0x7fa66006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 -- 172.21.15.66:0/1105959676 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6601f5390 con 0x7fa660160870 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa657fff640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6600cfe90 0x7fa66006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65e59c640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6600b2960 0x7fa66006efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa65ed9d640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 0x7fa6600cdc80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c7a0 tx=0x7fa65800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.786+0000 7fa656ffd640 1 -- 172.21.15.66:0/1105959676 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658018070 con 0x7fa660160870 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.787+0000 7fa656ffd640 1 -- 172.21.15.66:0/1105959676 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65800a640 con 0x7fa660160870 2024-05-10T11:19:36.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.787+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6601f5670 con 0x7fa660160870 2024-05-10T11:19:36.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.787+0000 7fa656ffd640 1 -- 172.21.15.66:0/1105959676 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65800aab0 con 0x7fa660160870 2024-05-10T11:19:36.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.787+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6601f5c30 con 0x7fa660160870 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.789+0000 7fa656ffd640 1 -- 172.21.15.66:0/1105959676 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa65801b070 con 0x7fa660160870 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.789+0000 7fa656ffd640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6400762d0 0x7fa640078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.789+0000 7fa656ffd640 1 -- 172.21.15.66:0/1105959676 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fa658096eb0 con 0x7fa660160870 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.790+0000 7fa65e59c640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6400762d0 0x7fa640078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.790+0000 7fa667c27740 1 Processor -- start 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.790+0000 7fa667c27740 1 -- start start 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.790+0000 7fa65e59c640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6400762d0 0x7fa640078790 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa65000a830 tx=0x7fa650008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa667c27740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 0x559e875602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875907f0 0x559e8758fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875900b0 0x559e87564ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa667c27740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e87450920 con 0x559e875ad6d0 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559e874c5dd0 con 0x559e875907f0 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559e874763e0 con 0x559e875900b0 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 0x559e875602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 0x559e875602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39108/0 (socket says 172.21.15.66:39108) 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 -- 172.21.15.66:0/3813943512 learned_addr learned my addr 172.21.15.66:0/3813943512 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa657fff640 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875907f0 0x559e8758fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65ed9d640 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875900b0 0x559e87564ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 -- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875900b0 msgr2=0x559e87564ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875900b0 0x559e87564ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 -- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875907f0 msgr2=0x559e8758fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875907f0 0x559e8758fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.791+0000 7fa65e59c640 1 -- 172.21.15.66:0/3813943512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e872a77c0 con 0x559e875ad6d0 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa65e59c640 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 0x559e875602f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa65000cac0 tx=0x7fa65000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bd9f62df600e71 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa63ffff640 1 -- 172.21.15.66:0/3813943512 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65000ae60 con 0x559e875ad6d0 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa63ffff640 1 -- 172.21.15.66:0/3813943512 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650013dd0 con 0x559e875ad6d0 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa63ffff640 1 -- 172.21.15.66:0/3813943512 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650004260 con 0x559e875ad6d0 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 -- 172.21.15.66:0/3813943512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 msgr2=0x559e875602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 0x559e875602f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa65000cac0 tx=0x7fa65000f000 comp rx=0 tx=0).stop 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 -- 172.21.15.66:0/3813943512 shutdown_connections 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875900b0 0x559e87564ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875907f0 0x559e8758fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 --2- 172.21.15.66:0/3813943512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875ad6d0 0x559e875602f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.792+0000 7fa667c27740 1 -- 172.21.15.66:0/3813943512 >> 172.21.15.66:0/3813943512 conn(0x559e87562560 msgr2=0x559e875aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.793+0000 7fa667c27740 1 -- 172.21.15.66:0/3813943512 shutdown_connections 2024-05-10T11:19:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.793+0000 7fa667c27740 1 -- 172.21.15.66:0/3813943512 wait complete. 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.793+0000 7fa667c27740 1 -- start start 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.793+0000 7fa667c27740 1 Processor -- start 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 0x559e875ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e875a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e87593130 0x559e875935b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e874ce440 con 0x559e875907f0 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559e874c9120 con 0x559e875ad6d0 2024-05-10T11:19:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559e874d7210 con 0x559e87593130 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa667c27740 10 client.0 _ll_register_callbacks cb 0x559e8746e690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 0x559e875ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 0x559e875ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39124/0 (socket says 172.21.15.66:39124) 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa65e59c640 1 -- 172.21.15.66:0/70986157 learned_addr learned my addr 172.21.15.66:0/70986157 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa657fff640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e875a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.794+0000 7fa65ed9d640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e87593130 0x559e875935b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa65e59c640 1 -- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e87593130 msgr2=0x559e875935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa65e59c640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e87593130 0x559e875935b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa65e59c640 1 -- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 msgr2=0x559e875a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa65e59c640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e875a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa65e59c640 1 -- 172.21.15.66:0/70986157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e87307f50 con 0x559e875907f0 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa65e59c640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 0x559e875ac0a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa650008010 tx=0x7fa650004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdea118c2cb10a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa63d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa63d7fa640 1 -- 172.21.15.66:0/70986157 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65002e020 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa63d7fa640 1 -- 172.21.15.66:0/70986157 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fa6500035f0 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa650013dd0 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa63d7fa640 1 -- 172.21.15.66:0/70986157 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fa650038050 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 10 client.7287 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x559e8719b0b0 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa63d7fa640 1 -- 172.21.15.66:0/70986157 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650013dd0 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa63d7fa640 1 -- 172.21.15.66:0/70986157 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7fa65003b020 con 0x559e875907f0 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 10 client.7287 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 10 client.7287 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 20 client.7287 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875c6190 0x559e875c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 4 client.7287 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.795+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e874d7a20 con 0x559e875c6190 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.796+0000 7fa657fff640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875c6190 0x559e875c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.796+0000 7fa657fff640 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875c6190 0x559e875c8580 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f48e2cd17217c1e server_cookie=ace8d59f20a0db83 in_seq=0 out_seq=0 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.796+0000 7fa63d7fa640 10 client.7287 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.796+0000 7fa63d7fa640 1 -- 172.21.15.66:0/70986157 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559e874d7a20 con 0x559e875c6190 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.796+0000 7fa63d7fa640 10 client.7287 handle_command_reply: tid=0 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.796+0000 7fa667c27740 1 client.7287 shutdown 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 msgr2=0x559e875ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 0x559e875ac0a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa650008010 tx=0x7fa650004680 comp rx=0 tx=0).stop 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 shutdown_connections 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875c6190 0x559e875c8580 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e87593130 0x559e875935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e875a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 --2- 172.21.15.66:0/70986157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e875907f0 0x559e875ac0a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa63d7fa640 0 client.7287 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 >> 172.21.15.66:0/70986157 conn(0x559e875900b0 msgr2=0x559e8755fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 shutdown_connections 2024-05-10T11:19:36.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 1 -- 172.21.15.66:0/70986157 wait complete. 2024-05-10T11:19:36.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.797+0000 7fa667c27740 20 client.7287 trim_cache size 0 max 16384 2024-05-10T11:19:36.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 Processor -- start 2024-05-10T11:19:36.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 -- start start 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e87566020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e8761e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa660202160 con 0x559e87593130 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600c7060 con 0x559e875ad6d0 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600a0a60 con 0x559e875907f0 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa657fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa657fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39130/0 (socket says 172.21.15.66:39130) 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.811+0000 7fa657fff640 1 -- 172.21.15.66:0/2643389841 learned_addr learned my addr 172.21.15.66:0/2643389841 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa657fff640 1 -- 172.21.15.66:0/2643389841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 msgr2=0x559e87566020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa657fff640 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e87566020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa657fff640 1 -- 172.21.15.66:0/2643389841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 msgr2=0x559e8761e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa657fff640 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e8761e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa657fff640 1 -- 172.21.15.66:0/2643389841 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e875bb750 con 0x559e87593130 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa657fff640 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875aad30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa64802a730 tx=0x7fa64802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c75f815b83a89c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa63f7fe640 1 -- 172.21.15.66:0/2643389841 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648037040 con 0x559e87593130 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa63f7fe640 1 -- 172.21.15.66:0/2643389841 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa648004230 con 0x559e87593130 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa63f7fe640 1 -- 172.21.15.66:0/2643389841 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480327d0 con 0x559e87593130 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 -- 172.21.15.66:0/2643389841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 msgr2=0x559e875aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875aad30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa64802a730 tx=0x7fa64802c000 comp rx=0 tx=0).stop 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 -- 172.21.15.66:0/2643389841 shutdown_connections 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e8761e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875aad30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 --2- 172.21.15.66:0/2643389841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e87566020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 -- 172.21.15.66:0/2643389841 >> 172.21.15.66:0/2643389841 conn(0x559e875900b0 msgr2=0x559e875acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.812+0000 7fa667c27740 1 -- 172.21.15.66:0/2643389841 shutdown_connections 2024-05-10T11:19:36.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.813+0000 7fa667c27740 1 -- 172.21.15.66:0/2643389841 wait complete. 2024-05-10T11:19:36.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.813+0000 7fa667c27740 1 -- start start 2024-05-10T11:19:36.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.813+0000 7fa667c27740 1 Processor -- start 2024-05-10T11:19:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e8761dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e87627e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e8747fa20 con 0x559e87593130 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600c6a10 con 0x559e875ad6d0 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x559e875a2560 con 0x559e875907f0 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa667c27740 10 client.0 _ll_register_callbacks cb 0x7fa65000c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39144/0 (socket says 172.21.15.66:39144) 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 -- 172.21.15.66:0/443767619 learned_addr learned my addr 172.21.15.66:0/443767619 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa65e59c640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e8761dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa65ed9d640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e87627e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 -- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 msgr2=0x559e8761dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e8761dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 -- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 msgr2=0x559e87627e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:36.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e87627e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.814+0000 7fa657fff640 1 -- 172.21.15.66:0/443767619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e875ab060 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa657fff640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875b9fb0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa648000c00 tx=0x7fa648004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63acfb16547e84d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa63d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa63d7fa640 1 -- 172.21.15.66:0/443767619 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648037040 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa63d7fa640 1 -- 172.21.15.66:0/443767619 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fa6480327d0 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa648004230 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa63d7fa640 1 -- 172.21.15.66:0/443767619 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fa648056050 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 10 client.7293 fetch_fsmap learned FSMap version 70 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x559e87628780 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa63d7fa640 1 -- 172.21.15.66:0/443767619 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa648004230 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa63d7fa640 1 -- 172.21.15.66:0/443767619 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 3494+0+0 (secure 0 0 0) 0x7fa648059020 con 0x559e87593130 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 10 client.7293 fetch_fsmap finished waiting for FSMap version 70 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 10 client.7293 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:19:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 20 client.7293 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875ae410 0x559e8758bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 4 client.7293 mds_command: new command op to 6867 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 --> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x559e874d1890 con 0x559e875ae410 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.815+0000 7fa65e59c640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875ae410 0x559e8758bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa63d7fa640 10 client.7293 ms_handle_connect on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa65e59c640 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875ae410 0x559e8758bca0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243543ce3918abfc server_cookie=9b1259c0b73e1f66 in_seq=0 out_seq=0 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa63d7fa640 1 -- 172.21.15.66:0/443767619 <== mds.0 v2:172.21.15.66:6834/577308965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+144 (crc 0 0 0) 0x559e874d1890 con 0x559e875ae410 2024-05-10T11:19:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa63d7fa640 10 client.7293 handle_command_reply: tid=0 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 client.7293 shutdown 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 msgr2=0x559e875b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875b9fb0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa648000c00 tx=0x7fa648004730 comp rx=0 tx=0).stop 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 shutdown_connections 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:6834/577308965,v1:172.21.15.66:6835/577308965] conn(0x559e875ae410 0x559e8758bca0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e875ad6d0 0x559e87627e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e87593130 0x559e875b9fb0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 --2- 172.21.15.66:0/443767619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x559e875907f0 0x559e8761dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa63d7fa640 0 client.7293 ms_handle_reset on v2:172.21.15.66:6834/577308965 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 >> 172.21.15.66:0/443767619 conn(0x559e875900b0 msgr2=0x559e875aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 shutdown_connections 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 1 -- 172.21.15.66:0/443767619 wait complete. 2024-05-10T11:19:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.816+0000 7fa667c27740 20 client.7293 trim_cache size 0 max 16384 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: "damage_type": "backtrace", 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 2607689150, 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 1099511627777, 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/testdir/hardlink" 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:19:36.824 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:19:36.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6400762d0 msgr2=0x7fa640078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6400762d0 0x7fa640078790 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa65000a830 tx=0x7fa650008040 comp rx=0 tx=0).stop 2024-05-10T11:19:36.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 msgr2=0x7fa6600cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:36.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 0x7fa6600cdc80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c7a0 tx=0x7fa65800cc60 comp rx=0 tx=0).stop 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 shutdown_connections 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa6400762d0 0x7fa640078790 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa660160870 0x7fa6600cdc80 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6600cfe90 0x7fa66006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 --2- 172.21.15.66:0/1105959676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6600b2960 0x7fa66006efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 >> 172.21.15.66:0/1105959676 conn(0x7fa6600d2eb0 msgr2=0x7fa6600b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 shutdown_connections 2024-05-10T11:19:36.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:36.817+0000 7fa664f0a640 1 -- 172.21.15.66:0/1105959676 wait complete. 2024-05-10T11:19:36.828 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:19:36.828 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:19:36.845 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:19:36.845 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:19:36.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:19:37.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.045+0000 7f466e27c640 1 Processor -- start 2024-05-10T11:19:37.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.045+0000 7f466e27c640 1 -- start start 2024-05-10T11:19:37.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466e27c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f466815f390 0x7f46680d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466e27c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680d5190 0x7f46680d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466e27c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46680cfd10 con 0x7f46680b4c00 2024-05-10T11:19:37.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466e27c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f46680cff90 con 0x7f466815f390 2024-05-10T11:19:37.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466e27c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4668163d00 con 0x7f46680d5190 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466c819640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f46680b4c00 0x7f46680b5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52652/0 (socket says 172.21.15.66:52652) 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f466c819640 1 -- 172.21.15.66:0/1868024557 learned_addr learned my addr 172.21.15.66:0/1868024557 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f46677fe640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680d5190 0x7f46680d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f4667fff640 1 --2- 172.21.15.66:0/1868024557 >> v2:172.21.15.190:3300/0 conn(0x7f466815f390 0x7f46680d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147899993 0 0) 0x7f4660001490 con 0x7f46680b4c00 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.046+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4650003520 con 0x7f46680b4c00 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2249316337 0 0) 0x7f4650003520 con 0x7f46680b4c00 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680d5190 msgr2=0x7f46680d55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680d5190 0x7f46680d55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 >> v2:172.21.15.190:3300/0 conn(0x7f466815f390 msgr2=0x7f46680d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 --2- 172.21.15.66:0/1868024557 >> v2:172.21.15.190:3300/0 conn(0x7f466815f390 0x7f46680d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46680d0250 con 0x7f46680b4c00 2024-05-10T11:19:37.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f4660001bc0 con 0x7f46680b4c00 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 >> v1:172.21.15.66:6789/0 conn(0x7f46680b4c00 legacy=0x7f46680b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500039b0 0x7f4650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4650004800 0x7f4650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500051c0 0x7f465000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f46680cff90 con 0x7f46500039b0 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4668163d00 con 0x7f4650004800 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f465000bf00 con 0x7f46500051c0 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f46677fe640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680d5190 0x7f46680d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4667fff640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500039b0 0x7f4650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f466c819640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500051c0 0x7f465000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f46677fe640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4650004800 0x7f4650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4667fff640 1 -- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500051c0 msgr2=0x7f465000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4667fff640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500051c0 0x7f465000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4667fff640 1 -- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4650004800 msgr2=0x7f4650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4667fff640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4650004800 0x7f4650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f4667fff640 1 -- 172.21.15.66:0/1868024557 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4650003520 con 0x7f46500039b0 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.047+0000 7f466c819640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46500051c0 0x7f465000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f4667fff640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500039b0 0x7f4650003dd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4658009af0 tx=0x7f4650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97781f884112ae3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658036070 con 0x7f46500039b0 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4658031400 con 0x7f46500039b0 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f4666ffd640 1 -- 172.21.15.66:0/1868024557 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658009690 con 0x7f46500039b0 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f466e27c640 1 -- 172.21.15.66:0/1868024557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500039b0 msgr2=0x7f4650003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f466e27c640 1 --2- 172.21.15.66:0/1868024557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46500039b0 0x7f4650003dd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4658009af0 tx=0x7f4650005830 comp rx=0 tx=0).stop 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f466c819640 1 -- 172.21.15.66:0/1868024557 reap_dead start 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f466e27c640 1 -- 172.21.15.66:0/1868024557 shutdown_connections 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f466e27c640 1 -- 172.21.15.66:0/1868024557 >> 172.21.15.66:0/1868024557 conn(0x7f466808ecb0 msgr2=0x7f466809e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:37.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.048+0000 7f466e27c640 1 -- 172.21.15.66:0/1868024557 shutdown_connections 2024-05-10T11:19:37.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.049+0000 7f466e27c640 1 -- 172.21.15.66:0/1868024557 wait complete. 2024-05-10T11:19:37.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.050+0000 7f466e27c640 1 Processor -- start 2024-05-10T11:19:37.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.050+0000 7f466e27c640 1 -- start start 2024-05-10T11:19:37.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46500039b0 0x7f466815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680ccd10 0x7f46681f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 0x7f46681f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f46680d1110 con 0x7f46680cd190 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f46680d0f90 con 0x7f46500039b0 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f466815f770 con 0x7f46680ccd10 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 0x7f46681f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 0x7f46681f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39156/0 (socket says 172.21.15.66:39156) 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 -- 172.21.15.66:0/1608483660 learned_addr learned my addr 172.21.15.66:0/1608483660 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 -- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680ccd10 msgr2=0x7f46681f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f4667fff640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46500039b0 0x7f466815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f46677fe640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680ccd10 0x7f46681f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680ccd10 0x7f46681f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 -- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46500039b0 msgr2=0x7f466815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46500039b0 0x7f466815c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 -- 172.21.15.66:0/1608483660 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46681f63a0 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466c819640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 0x7f46681f5a30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f46680d2d30 tx=0x7f466000a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466000abb0 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660018070 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46680ced00 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.051+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660013420 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.052+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4668160c70 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.052+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466806a220 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.053+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46600135c0 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.053+0000 7f4664ff9640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46540762d0 0x7f4654078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.054+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f4660097c10 con 0x7f46680cd190 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.054+0000 7f4667fff640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46540762d0 0x7f4654078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.054+0000 7f4667fff640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46540762d0 0x7f4654078790 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4658033000 tx=0x7f4658008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:37.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.058+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f46680cfd10 con 0x7f46680cd190 2024-05-10T11:19:37.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.264+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f46680d5ff0 con 0x7f46680cd190 2024-05-10T11:19:37.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.265+0000 7f4664ff9640 1 -- 172.21.15.66:0/1608483660 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v91) ==== 80+0+124 (secure 0 0 0) 0x7f4660061470 con 0x7f46680cd190 2024-05-10T11:19:37.265 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6837/1519468735 2024-05-11T11:18:27.672306+0000 2024-05-10T11:19:37.265 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6835/1519468735 2024-05-11T11:18:27.672306+0000 2024-05-10T11:19:37.266 INFO:teuthology.orchestra.run.smithi066.stderr:listed 2 entries 2024-05-10T11:19:37.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46540762d0 msgr2=0x7f4654078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46540762d0 0x7f4654078790 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4658033000 tx=0x7f4658008030 comp rx=0 tx=0).stop 2024-05-10T11:19:37.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 msgr2=0x7f46681f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 0x7f46681f5a30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f46680d2d30 tx=0x7f466000a550 comp rx=0 tx=0).stop 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 shutdown_connections 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46540762d0 0x7f4654078790 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680cd190 0x7f46681f5a30 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46680ccd10 0x7f46681f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 --2- 172.21.15.66:0/1608483660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46500039b0 0x7f466815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 >> 172.21.15.66:0/1608483660 conn(0x7f466808ecb0 msgr2=0x7f466806dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 shutdown_connections 2024-05-10T11:19:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.267+0000 7f466e27c640 1 -- 172.21.15.66:0/1608483660 wait complete. 2024-05-10T11:19:37.278 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:19:37.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:37.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:19:37.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:19:37.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:37.309 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:19:37.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:19:37.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.510+0000 7f9bd582a640 1 Processor -- start 2024-05-10T11:19:37.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.510+0000 7f9bd582a640 1 -- start start 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bd582a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9bd00c7110 0x7f9bd00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bd582a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd006f1c0 con 0x7f9bd00c6c80 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bd582a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd006f4a0 con 0x7f9bd01598c0 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bd582a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd006f780 con 0x7f9bd00c7110 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bc67fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9bd00c6c80 0x7f9bd00cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52666/0 (socket says 172.21.15.66:52666) 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bc67fc640 1 -- 172.21.15.66:0/324428549 learned_addr learned my addr 172.21.15.66:0/324428549 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:37.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/324428549 >> v2:172.21.15.190:3300/0 conn(0x7f9bd00c7110 0x7f9bd00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748881359 0 0) 0x7f9bd006f1c0 con 0x7f9bd00c6c80 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bbc003520 con 0x7f9bd00c6c80 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4128948858 0 0) 0x7f9bbc003520 con 0x7f9bd00c6c80 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 >> v2:172.21.15.190:3300/0 conn(0x7f9bd00c7110 msgr2=0x7f9bd00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 --2- 172.21.15.66:0/324428549 >> v2:172.21.15.190:3300/0 conn(0x7f9bd00c7110 0x7f9bd00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 >> v1:172.21.15.190:6789/0 conn(0x7f9bd01598c0 legacy=0x7f9bd006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.511+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd006fa60 con 0x7f9bd00c6c80 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f9bb8001670 con 0x7f9bd00c6c80 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 >> v1:172.21.15.66:6789/0 conn(0x7f9bd00c6c80 legacy=0x7f9bd00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bbc0039b0 0x7f9bbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bbc0043b0 0x7f9bbc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd006f780 con 0x7f9bbc005080 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc00bfe0 con 0x7f9bbc0043b0 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9bbc00c1e0 con 0x7f9bbc0039b0 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bbc0043b0 0x7f9bbc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bceffd640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bbc0039b0 0x7f9bbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bcf7fe640 1 -- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bbc0039b0 msgr2=0x7f9bbc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bbc0039b0 0x7f9bbc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bcf7fe640 1 -- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bbc0043b0 msgr2=0x7f9bbc004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bbc0043b0 0x7f9bbc004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.512+0000 7f9bcf7fe640 1 -- 172.21.15.66:0/324428549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc003520 con 0x7f9bbc005080 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bcf7fe640 1 -- 172.21.15.66:0/324428549 reap_dead start 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bbc00b9c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009fc0 tx=0x7f9bbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fdc2e9ce18cc38 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8035020 con 0x7f9bbc005080 2024-05-10T11:19:37.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc8003bd0 con 0x7f9bbc005080 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bce7fc640 1 -- 172.21.15.66:0/324428549 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8009c10 con 0x7f9bbc005080 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bd582a640 1 -- 172.21.15.66:0/324428549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 msgr2=0x7f9bbc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bd582a640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bbc00b9c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009fc0 tx=0x7f9bbc005830 comp rx=0 tx=0).stop 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bd582a640 1 -- 172.21.15.66:0/324428549 shutdown_connections 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.513+0000 7f9bd582a640 1 --2- 172.21.15.66:0/324428549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bbc00b9c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.514+0000 7f9bd582a640 1 -- 172.21.15.66:0/324428549 >> 172.21.15.66:0/324428549 conn(0x7f9bd00b2900 msgr2=0x7f9bd00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.514+0000 7f9bd582a640 1 -- 172.21.15.66:0/324428549 shutdown_connections 2024-05-10T11:19:37.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.514+0000 7f9bd582a640 1 -- 172.21.15.66:0/324428549 wait complete. 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.515+0000 7f9bd582a640 1 Processor -- start 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.515+0000 7f9bd582a640 1 -- start start 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bd015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd00af7c0 0x7f9bd00afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd01563f0 0x7f9bd0156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd015c6e0 con 0x7f9bbc005080 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd00c7560 con 0x7f9bd01563f0 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd0159ca0 con 0x7f9bd00af7c0 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bd015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bd015e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39162/0 (socket says 172.21.15.66:39162) 2024-05-10T11:19:37.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 -- 172.21.15.66:0/4280930142 learned_addr learned my addr 172.21.15.66:0/4280930142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd00af7c0 0x7f9bd00afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd01563f0 0x7f9bd0156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 -- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd00af7c0 msgr2=0x7f9bd00afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd00af7c0 0x7f9bd00afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 -- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd01563f0 msgr2=0x7f9bd0156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd01563f0 0x7f9bd0156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 -- 172.21.15.66:0/4280930142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd01f2b90 con 0x7f9bbc005080 2024-05-10T11:19:37.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bcf7fe640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd01563f0 0x7f9bd0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bceffd640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bd015e860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000f7c0 tx=0x7f9bc000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc000fe70 con 0x7f9bbc005080 2024-05-10T11:19:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0018070 con 0x7f9bbc005080 2024-05-10T11:19:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd01f2e50 con 0x7f9bbc005080 2024-05-10T11:19:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc000d730 con 0x7f9bbc005080 2024-05-10T11:19:37.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.516+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd01f3410 con 0x7f9bbc005080 2024-05-10T11:19:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.517+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd006a220 con 0x7f9bbc005080 2024-05-10T11:19:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.518+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9bc000d8d0 con 0x7f9bbc005080 2024-05-10T11:19:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.518+0000 7f9bccff9640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb00762d0 0x7f9bb0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.519+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f9bc0097750 con 0x7f9bbc005080 2024-05-10T11:19:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.519+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb00762d0 0x7f9bb0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:37.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.519+0000 7f9bc67fc640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb00762d0 0x7f9bb0078790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8001050 tx=0x7f9bb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:37.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.524+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9bc0060e60 con 0x7f9bbc005080 2024-05-10T11:19:37.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.753+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bd00d0630 con 0x7f9bbc005080 2024-05-10T11:19:37.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.753+0000 7f9bccff9640 1 -- 172.21.15.66:0/4280930142 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5187 (secure 0 0 0) 0x7f9bc0060760 con 0x7f9bbc005080 2024-05-10T11:19:37.754 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:37.754 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:18:34.690562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6835/577308965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":577308965},{"type":"v1","addr":"172.21.15.66:6835","nonce":577308965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6867,"qdb_cluster":[6867]},"id":6}]} 2024-05-10T11:19:37.754 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 70 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb00762d0 msgr2=0x7f9bb0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb00762d0 0x7f9bb0078790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8001050 tx=0x7f9bb8009040 comp rx=0 tx=0).stop 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 msgr2=0x7f9bd015e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bd015e860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000f7c0 tx=0x7f9bc000fc80 comp rx=0 tx=0).stop 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 shutdown_connections 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9bb00762d0 0x7f9bb0078790 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd01563f0 0x7f9bd0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd00af7c0 0x7f9bd00afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 --2- 172.21.15.66:0/4280930142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bbc005080 0x7f9bd015e860 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:37.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 >> 172.21.15.66:0/4280930142 conn(0x7f9bd00b2900 msgr2=0x7f9bd00c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:37.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 shutdown_connections 2024-05-10T11:19:37.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:37.756+0000 7f9bd582a640 1 -- 172.21.15.66:0/4280930142 wait complete. 2024-05-10T11:19:37.767 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-10T11:19:37.904 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:19:37.904 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:19:37.904 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:19:38.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.010+0000 7f67dca1c640 1 Processor -- start 2024-05-10T11:19:38.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.010+0000 7f67dca1c640 1 -- start start 2024-05-10T11:19:38.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67dca1c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162750 0x7f67d80d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67dca1c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f67d80d5cb0 0x7f67d80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67dca1c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d80b45f0 con 0x7f67d8162b30 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67dca1c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f67d80b4f20 con 0x7f67d80d5cb0 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67dca1c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67d80d0fe0 con 0x7f67d8162750 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d5d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f67d80d5cb0 0x7f67d80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d6d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f67d8162b30 0x7f67d80d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52670/0 (socket says 172.21.15.66:52670) 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d6d9d640 1 -- 172.21.15.66:0/3800754052 learned_addr learned my addr 172.21.15.66:0/3800754052 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d5d9b640 1 -- 172.21.15.66:0/3800754052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162750 msgr2=0x7f67d80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d659c640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162750 0x7f67d80d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d5d9b640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162750 0x7f67d80d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d5d9b640 1 -- 172.21.15.66:0/3800754052 >> v1:172.21.15.66:6789/0 conn(0x7f67d8162b30 legacy=0x7f67d80d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d559a640 1 -- 172.21.15.66:0/3800754052 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579279885 0 0) 0x7f67d80b45f0 con 0x7f67d8162b30 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d5d9b640 1 -- 172.21.15.66:0/3800754052 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d80b48d0 con 0x7f67d80d5cb0 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.011+0000 7f67d659c640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162750 0x7f67d80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.012+0000 7f67d5d9b640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d80d5cb0 0x7f67d80d3630 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0097a0 tx=0x7f67cc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83aff9611d7d0ba9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.012+0000 7f67d559a640 1 -- 172.21.15.66:0/3800754052 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc037070 con 0x7f67d80d5cb0 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.012+0000 7f67d559a640 1 -- 172.21.15.66:0/3800754052 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67cc02ae50 con 0x7f67d80d5cb0 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.012+0000 7f67d559a640 1 -- 172.21.15.66:0/3800754052 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc032660 con 0x7f67d80d5cb0 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 -- 172.21.15.66:0/3800754052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d80d5cb0 msgr2=0x7f67d80d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d80d5cb0 0x7f67d80d3630 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0097a0 tx=0x7f67cc02a100 comp rx=0 tx=0).stop 2024-05-10T11:19:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 -- 172.21.15.66:0/3800754052 shutdown_connections 2024-05-10T11:19:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d80d5cb0 0x7f67d80d3630 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3800754052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162750 0x7f67d80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 -- 172.21.15.66:0/3800754052 >> 172.21.15.66:0/3800754052 conn(0x7f67d809e3b0 msgr2=0x7f67d80d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 -- 172.21.15.66:0/3800754052 shutdown_connections 2024-05-10T11:19:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.013+0000 7f67dca1c640 1 -- 172.21.15.66:0/3800754052 wait complete. 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.014+0000 7f67dca1c640 1 Processor -- start 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.014+0000 7f67dca1c640 1 -- start start 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67dca1c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d8162750 0x7f67d80b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67dca1c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162b30 0x7f67d80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67dca1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 0x7f67d80ba250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67dca1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f67d80d0d30 con 0x7f67d815a5b0 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67dca1c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f67d80d0bb0 con 0x7f67d8162750 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67dca1c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67d80b63c0 con 0x7f67d8162b30 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 0x7f67d80ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 0x7f67d80ba250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39176/0 (socket says 172.21.15.66:39176) 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 -- 172.21.15.66:0/3235631975 learned_addr learned my addr 172.21.15.66:0/3235631975 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 -- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162b30 msgr2=0x7f67d80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162b30 0x7f67d80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d659c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d8162750 0x7f67d80b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 -- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d8162750 msgr2=0x7f67d80b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d8162750 0x7f67d80b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.015+0000 7f67d6d9d640 1 -- 172.21.15.66:0/3235631975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d80b8dc0 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.016+0000 7f67d6d9d640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 0x7f67d80ba250 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c700 tx=0x7f67d000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.016+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0018070 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.016+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d000ce10 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.016+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d80b90a0 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.016+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d000a860 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.016+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d80b9660 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.017+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d806a220 con 0x7f67d815a5b0 2024-05-10T11:19:38.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.017+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f67d001b070 con 0x7f67d815a5b0 2024-05-10T11:19:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.018+0000 7f67c6ffd640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67b80762d0 0x7f67b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.018+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f67d0096e10 con 0x7f67d815a5b0 2024-05-10T11:19:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.018+0000 7f67d659c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67b80762d0 0x7f67b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.019+0000 7f67d659c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67b80762d0 0x7f67b8078790 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f67c8008850 tx=0x7f67c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.022+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f67d0060520 con 0x7f67d815a5b0 2024-05-10T11:19:38.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.254+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67d80b7460 con 0x7f67d815a5b0 2024-05-10T11:19:38.255 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:19:38.255+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:19:38.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.256+0000 7f67c6ffd640 1 -- 172.21.15.66:0/3235631975 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) ==== 161+0+0 (secure 0 0 0) 0x7f67d005fe20 con 0x7f67d815a5b0 2024-05-10T11:19:38.257 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67b80762d0 msgr2=0x7f67b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67b80762d0 0x7f67b8078790 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f67c8008850 tx=0x7f67c8008040 comp rx=0 tx=0).stop 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 msgr2=0x7f67d80ba250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 0x7f67d80ba250 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c700 tx=0x7f67d000cbc0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 shutdown_connections 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f67b80762d0 0x7f67b8078790 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f67c8008850 tx=0x7f67c8008040 comp rx=0 tx=0).stop 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67d815a5b0 0x7f67d80ba250 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67d8162b30 0x7f67d80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 --2- 172.21.15.66:0/3235631975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d8162750 0x7f67d80b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.259+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 >> 172.21.15.66:0/3235631975 conn(0x7f67d809e3b0 msgr2=0x7f67d80d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.260+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 shutdown_connections 2024-05-10T11:19:38.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.260+0000 7f67dca1c640 1 -- 172.21.15.66:0/3235631975 wait complete. 2024-05-10T11:19:38.263 INFO:tasks.ceph.mds.a.smithi066.stderr: -4201> 2024-05-10T11:18:34.410+0000 7f1a5e808640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-05-10T11:19:38.263 INFO:tasks.ceph.mds.a.smithi066.stderr: -4019> 2024-05-10T11:18:34.600+0000 7f1a5e808640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0) n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x559b585f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-05-10T11:19:38.263 INFO:tasks.ceph.mds.a.smithi066.stderr: -3850> 2024-05-10T11:18:36.467+0000 7f1a62810640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:19:38.265 INFO:tasks.ceph.mds.a.smithi066.stderr: -2166> 2024-05-10T11:19:05.971+0000 7f1a5e808640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0)->f(v1 m2024-05-10T11:18:25.969922+0000) n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1)->n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559b585f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T11:18:25.969922+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T11:18:26.088921+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-05-10T11:19:38.271 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-05-10T11:19:38.292 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:19:38.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.312+0000 7f14b0211740 1 -- start start 2024-05-10T11:19:38.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.312+0000 7f14b0211740 1 Processor -- start 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84c52ec00 0x55e84d308000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 0x55e84d308580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84c52fc00 0x55e84d308b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e84d328180 con 0x55e84c52f800 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e84d328300 con 0x55e84c52ec00 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e84d328480 con 0x55e84c52fc00 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 0x55e84d308580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 0x55e84d308580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39206/0 (socket says 172.21.15.66:39206) 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 -- 172.21.15.66:0/1498818444 learned_addr learned my addr 172.21.15.66:0/1498818444 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14adf29640 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84c52ec00 0x55e84d308000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ae72a640 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84c52fc00 0x55e84d308b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 -- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84c52fc00 msgr2=0x55e84d308b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84c52fc00 0x55e84d308b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 -- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84c52ec00 msgr2=0x55e84d308000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84c52ec00 0x55e84d308000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 -- 172.21.15.66:0/1498818444 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e84c55b680 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14adf29640 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84c52ec00 0x55e84d308000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ad728640 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 0x55e84d308580 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x55e84d355bc0 tx=0x55e84c5fe120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb33bf1597d9f07 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ab724640 1 -- 172.21.15.66:0/1498818444 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e84c554680 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ab724640 1 -- 172.21.15.66:0/1498818444 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e84c576540 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14ab724640 1 -- 172.21.15.66:0/1498818444 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e84c554b60 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.313+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e84c55b860 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e84c55b2c0 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 4 waiting for MDS map... 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14ab724640 1 -- 172.21.15.66:0/1498818444 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x55e84d416600 con 0x55e84c52f800 2024-05-10T11:19:38.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14ab724640 1 -- 172.21.15.66:0/1498818444 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 2885+0+0 (secure 0 0 0) 0x55e84c587180 con 0x55e84c52f800 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 4 Got MDS map 71 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 4 datascan.main: Using metadata pool output 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 4 datascan.main: connecting to RADOS... 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 1 Processor -- start 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.314+0000 7f14b0211740 1 -- start start 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14b0211740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 0x55e84d309080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14b0211740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14b0211740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 0x55e84d309b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14b0211740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e84d328600 con 0x55e84d419800 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14b0211740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e84d328780 con 0x55e84d419400 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14b0211740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e84d328900 con 0x55e84d419c00 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39222/0 (socket says 172.21.15.66:39222) 2024-05-10T11:19:38.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 -- 172.21.15.66:0/2423327655 learned_addr learned my addr 172.21.15.66:0/2423327655 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14ae72a640 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 0x55e84d309080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14ad728640 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 0x55e84d309b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 -- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 msgr2=0x55e84d309b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 0x55e84d309b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 -- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 msgr2=0x55e84d309080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 0x55e84d309080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.315+0000 7f14adf29640 1 -- 172.21.15.66:0/2423327655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e84c55b4a0 con 0x55e84d419800 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14adf29640 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x55e84d430f60 tx=0x55e84d435800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175a54acf9715a9d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14a9720640 1 -- 172.21.15.66:0/2423327655 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e84c554680 con 0x55e84d419800 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14a9720640 1 -- 172.21.15.66:0/2423327655 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e84c576e00 con 0x55e84d419800 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14a9720640 1 -- 172.21.15.66:0/2423327655 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e84c554b60 con 0x55e84d419800 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 -- 172.21.15.66:0/2423327655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 msgr2=0x55e84d309600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x55e84d430f60 tx=0x55e84d435800 comp rx=0 tx=0).stop 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 -- 172.21.15.66:0/2423327655 shutdown_connections 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 0x55e84d309b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 --2- 172.21.15.66:0/2423327655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 0x55e84d309080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 -- 172.21.15.66:0/2423327655 >> 172.21.15.66:0/2423327655 conn(0x55e84d419000 msgr2=0x55e84d2ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 -- 172.21.15.66:0/2423327655 shutdown_connections 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.316+0000 7f14b0211740 1 -- 172.21.15.66:0/2423327655 wait complete. 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 Processor -- start 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 -- start start 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 0x55e84d309080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 0x55e84d309b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e84d329c80 con 0x55e84d419800 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e84d329b00 con 0x55e84d419400 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14b0211740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e84d329980 con 0x55e84d419c00 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14adf29640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14adf29640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39232/0 (socket says 172.21.15.66:39232) 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.317+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 learned_addr learned my addr 172.21.15.66:0/491238566 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 msgr2=0x55e84d309b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84d419c00 0x55e84d309b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 msgr2=0x55e84d309080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84d419400 0x55e84d309080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e84c55b680 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x55e84d431c20 tx=0x55e84d2d4a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14a7f1d640 1 -- 172.21.15.66:0/491238566 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e84c5544e0 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14a7f1d640 1 -- 172.21.15.66:0/491238566 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e84c576c40 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e84c55b860 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14a7f1d640 1 -- 172.21.15.66:0/491238566 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e84c554680 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e84c55b0e0 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.318+0000 7f14b0211740 4 datascan.init: resolving metadata pool 13 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.319+0000 7f14a7f1d640 1 -- 172.21.15.66:0/491238566 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55e84d48ec00 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14a7f1d640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e84d48ac00 0x55e84d30a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14a7f1d640 1 -- 172.21.15.66:0/491238566 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x55e84d48ca00 con 0x55e84d419800 2024-05-10T11:19:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14b0211740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14b0211740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14b0211740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e84d48b000 0x55e84d30a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d48b400 con 0x55e84d48b000 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e84d48ac00 0x55e84d30a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14ad728640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e84d48b000 0x55e84d30a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14ad728640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e84d48b000 0x55e84d30a680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.320+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e84d48ac00 0x55e84d30a100 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55e84d2d6030 tx=0x55e84d2d4a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.322+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(1 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.322+0000 7f14a8f1f640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e84d33a000 0x55e84c8ec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.322+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33a400 con 0x55e84d33a000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.322+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e84d33a000 0x55e84c8ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.323+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e84d33a000 0x55e84c8ec000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.324+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(2 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33ac00 con 0x55e84d48b000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== osd_op_reply(3 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33a800 con 0x55e84d33a000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(4 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33b000 con 0x55e84d33a000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(5 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.325+0000 7f14a8f1f640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e84d33a400 0x55e84c8ec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d325400 con 0x55e84d33a400 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e84d33a400 0x55e84c8ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e84d33a400 0x55e84c8ec580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(6 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33a400 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14a9720640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e84d33b400 0x55e84c8ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33a800 con 0x55e84d33b400 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.326+0000 7f14ad728640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e84d33b400 0x55e84c8ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.327+0000 7f14ad728640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e84d33b400 0x55e84c8ed080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.327+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(7 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33b400 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.327+0000 7f14a8f1f640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e84d325000 0x55e84c8ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.327+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33bc00 con 0x55e84d325000 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.327+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e84d325000 0x55e84c8ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.328+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e84d325000 0x55e84c8ecb00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.329+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(8 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.330+0000 7f14a9720640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e84d33b000 0x55e84c8ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.330+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33b800 con 0x55e84d33b000 2024-05-10T11:19:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.330+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e84d33b000 0x55e84c8ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.330+0000 7f14adf29640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e84d33b000 0x55e84c8ed600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.332+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(9 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33b000 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.333+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c000 con 0x55e84d325000 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.333+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(10 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.333+0000 7f14a9720640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e84d33d400 0x55e84c8edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.333+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d800 con 0x55e84d33d400 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.333+0000 7f14ad728640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e84d33d400 0x55e84c8edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.334+0000 7f14ad728640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e84d33d400 0x55e84c8edb80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(11 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c400 con 0x55e84d48b000 2024-05-10T11:19:38.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 3 ==== osd_op_reply(12 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33dc00 con 0x55e84d33a000 2024-05-10T11:19:38.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 4 ==== osd_op_reply(13 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c800 con 0x55e84d325000 2024-05-10T11:19:38.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 3 ==== osd_op_reply(14 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d800 con 0x55e84d33a000 2024-05-10T11:19:38.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 5 ==== osd_op_reply(15 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33cc00 con 0x55e84d325000 2024-05-10T11:19:38.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 4 ==== osd_op_reply(16 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.337+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33ac00 con 0x55e84d33b000 2024-05-10T11:19:38.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.338+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(17 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33b000 2024-05-10T11:19:38.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.338+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d000 con 0x55e84d33d400 2024-05-10T11:19:38.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.338+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(18 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.338+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33a800 con 0x55e84d48b000 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.339+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 4 ==== osd_op_reply(19 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.339+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c000 con 0x55e84d33d400 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.339+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(20 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.339+0000 7f14a9720640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e84d48b400 0x55e84c8ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.339+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d418800 con 0x55e84d48b400 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.339+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e84d48b400 0x55e84c8ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.340+0000 7f14ae72a640 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e84d48b400 0x55e84c8ee100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.342+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(21 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.342+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33dc00 con 0x55e84d33d400 2024-05-10T11:19:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.342+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(22 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.342+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e000 con 0x55e84d33a000 2024-05-10T11:19:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.343+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 6 ==== osd_op_reply(23 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.343+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c800 con 0x55e84d33a000 2024-05-10T11:19:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.343+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 7 ==== osd_op_reply(24 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.343+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e400 con 0x55e84d33a000 2024-05-10T11:19:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.343+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 8 ==== osd_op_reply(25 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.343+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d800 con 0x55e84d33d400 2024-05-10T11:19:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 5 ==== osd_op_reply(26 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e800 con 0x55e84d33a400 2024-05-10T11:19:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(27 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33a400 2024-05-10T11:19:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33cc00 con 0x55e84d48b000 2024-05-10T11:19:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 5 ==== osd_op_reply(28 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90ec00 con 0x55e84d33d400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 6 ==== osd_op_reply(29 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.344+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33bc00 con 0x55e84d33a400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.345+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(30 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33a400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.345+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90f000 con 0x55e84d33b400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.345+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== osd_op_reply(31 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33b400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.345+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c400 con 0x55e84d48b400 2024-05-10T11:19:38.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.346+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== osd_op_reply(32 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.346+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90f400 con 0x55e84d33a400 2024-05-10T11:19:38.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.346+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.3 v2:172.21.15.66:6824/286653269 4 ==== osd_op_reply(33 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33a400 2024-05-10T11:19:38.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.346+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d000 con 0x55e84d48b400 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.346+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 3 ==== osd_op_reply(34 [pgnls start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.346+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e800 con 0x55e84d33d400 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.347+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 7 ==== osd_op_reply(35 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.347+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c000 con 0x55e84d325000 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.347+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 5 ==== osd_op_reply(36 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.347+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90f800 con 0x55e84d48b400 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.347+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 4 ==== osd_op_reply(37 [pgnls start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.347+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33b800 con 0x55e84d33b000 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.348+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(38 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33b000 2024-05-10T11:19:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.348+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90fc00 con 0x55e84d33b000 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.348+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.6 v2:172.21.15.190:6808/4182602787 4 ==== osd_op_reply(39 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33b000 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.348+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33ac00 con 0x55e84d33b400 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.348+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.7 v2:172.21.15.190:6824/1531895533 3 ==== osd_op_reply(40 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33b400 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.348+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33dc00 con 0x55e84d33a000 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.349+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 9 ==== osd_op_reply(41 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.349+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33a800 con 0x55e84d48b000 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.349+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 6 ==== osd_op_reply(42 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.349+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d800 con 0x55e84d33b400 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.349+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.7 v2:172.21.15.190:6824/1531895533 4 ==== osd_op_reply(43 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33b400 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.349+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d325400 con 0x55e84d33d400 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.350+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 8 ==== osd_op_reply(44 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.350+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90ec00 con 0x55e84d33b000 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.350+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.6 v2:172.21.15.190:6808/4182602787 5 ==== osd_op_reply(45 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33b000 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.350+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33cc00 con 0x55e84d33d400 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.350+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 9 ==== osd_op_reply(46 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.350+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90f000 con 0x55e84d33a000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.351+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 10 ==== osd_op_reply(47 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.351+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33d800 con 0x55e84d33a400 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.351+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.3 v2:172.21.15.66:6824/286653269 5 ==== osd_op_reply(48 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33a400 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.351+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e800 con 0x55e84d33a000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.351+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 11 ==== osd_op_reply(49 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.351+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c800 con 0x55e84d33b400 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.7 v2:172.21.15.190:6824/1531895533 5 ==== osd_op_reply(50 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33b400 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e000 con 0x55e84d48b000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 7 ==== osd_op_reply(51 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90f400 con 0x55e84d48b000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.2 v2:172.21.15.66:6816/3859729948 8 ==== osd_op_reply(52 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d48b000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90e400 con 0x55e84d33a000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 12 ==== osd_op_reply(53 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.352+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90fc00 con 0x55e84d33d400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 10 ==== osd_op_reply(54 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d418800 con 0x55e84d325000 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 6 ==== osd_op_reply(55 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84c90ec00 con 0x55e84d33d400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 11 ==== osd_op_reply(56 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33ac00 con 0x55e84d48b400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 5 ==== osd_op_reply(57 [pgnls start_epoch 92 out=81b] v88'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.353+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x55e84d48b800 con 0x55e84d48b400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.354+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 6 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.354+0000 7f14b0211740 10 datascan.operator(): handling object 1099511627777.0 2024-05-10T11:19:38.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.354+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55e84d48bc00 con 0x55e84d48b400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.355+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 7 ==== osd_op_reply(59 10000000001.00000000 [call] v92'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.355+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33ac00 con 0x55e84d48b400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.355+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.5 v2:172.21.15.190:6800/4020203147 8 ==== osd_op_reply(60 [pgnls start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d48b400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.356+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33a800 con 0x55e84d325000 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.356+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.1 v2:172.21.15.66:6808/2096128619 7 ==== osd_op_reply(61 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d325000 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.356+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33bc00 con 0x55e84d33d400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.356+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.4 v2:172.21.15.190:6816/1866487272 12 ==== osd_op_reply(62 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33d400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.356+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33cc00 con 0x55e84d33b400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14ad728640 1 -- 172.21.15.66:0/491238566 <== osd.7 v2:172.21.15.190:6824/1531895533 6 ==== osd_op_reply(63 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0000 con 0x55e84d33b400 2024-05-10T11:19:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33b800 con 0x55e84d33a000 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 13 ==== osd_op_reply(64 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14a9720640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33c800 con 0x55e84d33a000 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14ae72a640 1 -- 172.21.15.66:0/491238566 <== osd.0 v2:172.21.15.66:6800/1407218537 14 ==== osd_op_reply(65 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0500 con 0x55e84d33a000 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14a8f1f640 1 -- 172.21.15.66:0/491238566 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55e84d33dc00 con 0x55e84d33a400 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 <== osd.3 v2:172.21.15.66:6824/286653269 6 ==== osd_op_reply(66 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e84d2c0780 con 0x55e84d33a400 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e84d33a000 msgr2=0x55e84c8ec000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e84d33a000 0x55e84c8ec000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e84d325000 msgr2=0x55e84c8ecb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e84d325000 0x55e84c8ecb00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e84d48b000 msgr2=0x55e84d30a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e84d48b000 0x55e84d30a680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e84d33a400 msgr2=0x55e84c8ec580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e84d33a400 0x55e84c8ec580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e84d33d400 msgr2=0x55e84c8edb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e84d33d400 0x55e84c8edb80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 reap_dead start 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 reap_dead start 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e84d48b400 msgr2=0x55e84c8ee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e84d48b400 0x55e84c8ee100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e84d33b000 msgr2=0x55e84c8ed600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e84d33b000 0x55e84c8ed600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e84d33b400 msgr2=0x55e84c8ed080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.357+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e84d33b400 0x55e84c8ed080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e84d48ac00 msgr2=0x55e84d30a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e84d48ac00 0x55e84d30a100 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55e84d2d6030 tx=0x55e84d2d4a20 comp rx=0 tx=0).stop 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 msgr2=0x55e84d309600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 --2- 172.21.15.66:0/491238566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84d419800 0x55e84d309600 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x55e84d431c20 tx=0x55e84d2d4a80 comp rx=0 tx=0).stop 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14adf29640 1 -- 172.21.15.66:0/491238566 reap_dead start 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 shutdown_connections 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 >> 172.21.15.66:0/491238566 conn(0x55e84d419000 msgr2=0x55e84d2ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 shutdown_connections 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/491238566 wait complete. 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 msgr2=0x55e84d308580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 0x55e84d308580 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x55e84d355bc0 tx=0x55e84c5fe120 comp rx=0 tx=0).stop 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 shutdown_connections 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e84c52fc00 0x55e84d308b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e84c52f800 0x55e84d308580 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 --2- 172.21.15.66:0/1498818444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e84c52ec00 0x55e84d308000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 >> 172.21.15.66:0/1498818444 conn(0x55e84c52f000 msgr2=0x55e84d2ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 shutdown_connections 2024-05-10T11:19:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.358+0000 7f14b0211740 1 -- 172.21.15.66:0/1498818444 wait complete. 2024-05-10T11:19:38.365 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.093247, result: 2024-05-10T11:19:38.365 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-05-10T11:19:38.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.447+0000 7f251b60e740 1 -- start start 2024-05-10T11:19:38.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.447+0000 7f251b60e740 1 Processor -- start 2024-05-10T11:19:38.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251b60e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 0x557223048000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251b60e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557222279800 0x557223048580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251b60e740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557222279c00 0x557223048b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251b60e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55722306a600 con 0x557222278c00 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251b60e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55722306a480 con 0x557222279800 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251b60e740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55722306a300 con 0x557222279c00 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251930e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 0x557223048000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251930e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 0x557223048000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39234/0 (socket says 172.21.15.66:39234) 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f251930e640 1 -- 172.21.15.66:0/1709821339 learned_addr learned my addr 172.21.15.66:0/1709821339 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f2518b0d640 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557222279800 0x557223048580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.448+0000 7f2519b0f640 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557222279c00 0x557223048b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251930e640 1 -- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557222279c00 msgr2=0x557223048b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251930e640 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557222279c00 0x557223048b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251930e640 1 -- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557222279800 msgr2=0x557223048580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251930e640 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557222279800 0x557223048580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251930e640 1 -- 172.21.15.66:0/1709821339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572222a5680 con 0x557222278c00 2024-05-10T11:19:38.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251930e640 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 0x557223048000 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x5572230a5b90 tx=0x557222348180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469781edef49a7ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f2516b09640 1 -- 172.21.15.66:0/1709821339 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55722229e680 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f2516b09640 1 -- 172.21.15.66:0/1709821339 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5572222c0e00 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f2516b09640 1 -- 172.21.15.66:0/1709821339 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55722229eb60 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572222a5860 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5572222a52c0 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251b60e740 4 waiting for MDS map... 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f2516b09640 1 -- 172.21.15.66:0/1709821339 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x557223152600 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f2516b09640 1 -- 172.21.15.66:0/1709821339 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 2885+0+0 (secure 0 0 0) 0x5572222d1180 con 0x557222278c00 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251b60e740 4 Got MDS map 71 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251b60e740 4 datascan.main: Using metadata pool output 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.449+0000 7f251b60e740 4 datascan.main: connecting to RADOS... 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 Processor -- start 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 -- start start 2024-05-10T11:19:38.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059400 0x557223049080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 0x557223049600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55722306a180 con 0x557223059800 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55722306a900 con 0x557223059400 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.450+0000 7f251b60e740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5572222d8900 con 0x557223059c00 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 0x557223049600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 0x557223049600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39236/0 (socket says 172.21.15.66:39236) 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 -- 172.21.15.66:0/1112472578 learned_addr learned my addr 172.21.15.66:0/1112472578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2518b0d640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2519b0f640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059400 0x557223049080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 -- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059c00 msgr2=0x557223049b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 -- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059400 msgr2=0x557223049080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059400 0x557223049080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 -- 172.21.15.66:0/1112472578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572222a54a0 con 0x557223059800 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2519b0f640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059400 0x557223049080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2518b0d640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f251930e640 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 0x557223049600 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x557223162f30 tx=0x55722301e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c618cfa875729be5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2514b05640 1 -- 172.21.15.66:0/1112472578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55722229e820 con 0x557223059800 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2514b05640 1 -- 172.21.15.66:0/1112472578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5572222c0c40 con 0x557223059800 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.451+0000 7f2514b05640 1 -- 172.21.15.66:0/1112472578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55722229e680 con 0x557223059800 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 -- 172.21.15.66:0/1112472578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 msgr2=0x557223049600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 0x557223049600 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x557223162f30 tx=0x55722301e9c0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 -- 172.21.15.66:0/1112472578 shutdown_connections 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059800 0x557223049600 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 --2- 172.21.15.66:0/1112472578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059400 0x557223049080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 -- 172.21.15.66:0/1112472578 >> 172.21.15.66:0/1112472578 conn(0x557223059000 msgr2=0x557222ff7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 -- 172.21.15.66:0/1112472578 shutdown_connections 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 -- 172.21.15.66:0/1112472578 wait complete. 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 Processor -- start 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.452+0000 7f251b60e740 1 -- start start 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f251b60e740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059400 0x557223049080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f251b60e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059800 0x557223049600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f251b60e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f251b60e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55722306b680 con 0x557223059c00 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f251b60e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55722306b800 con 0x557223059800 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f251b60e740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55722306b500 con 0x557223059400 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059c00 0x557223049b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39248/0 (socket says 172.21.15.66:39248) 2024-05-10T11:19:38.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 learned_addr learned my addr 172.21.15.66:0/3100090180 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059400 msgr2=0x557223049080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557223059400 0x557223049080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059800 msgr2=0x557223049600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557223059800 0x557223049600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572222a5680 con 0x557223059c00 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059c00 0x557223049b80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x557223163c80 tx=0x55722301e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.453+0000 7f2513302640 1 -- 172.21.15.66:0/3100090180 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55722229e9c0 con 0x557223059c00 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.454+0000 7f2513302640 1 -- 172.21.15.66:0/3100090180 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5572222c1340 con 0x557223059c00 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.454+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572222a5860 con 0x557223059c00 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.454+0000 7f2513302640 1 -- 172.21.15.66:0/3100090180 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55722229e820 con 0x557223059c00 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.454+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572222a50e0 con 0x557223059c00 2024-05-10T11:19:38.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.454+0000 7f251b60e740 4 datascan.init: resolving metadata pool 13 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f2513302640 1 -- 172.21.15.66:0/3100090180 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x5572231c8c00 con 0x557223059c00 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f2513302640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x5572231c7000 0x55722304a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f2513302640 1 -- 172.21.15.66:0/3100090180 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x5572231cc600 con 0x557223059c00 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f251b60e740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f251b60e740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f251b60e740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T11:19:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x5572231c7400 0x55722304a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.455+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5572231c7800 con 0x5572231c7400 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x5572231c7000 0x55722304a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f251930e640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x5572231c7400 0x55722304a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f251930e640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x5572231c7400 0x55722304a680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x5572231c7000 0x55722304a100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5572230211a0 tx=0x557222591020 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x5572231c7c00 0x55722304ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6c00 con 0x5572231c7c00 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.456+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x5572231c7c00 0x55722304ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.457+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x5572231c7c00 0x55722304ac00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.457+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.457+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x5572231c6800 0x55722304b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.457+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6400 con 0x5572231c6800 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.457+0000 7f251930e640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x5572231c6800 0x55722304b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.458+0000 7f251930e640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x5572231c6800 0x55722304b180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.458+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.458+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222616c00 con 0x5572231c7400 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.458+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.458+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617000 con 0x5572231c6800 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.458+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x5572231c7400 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617c00 con 0x5572231c7400 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f2514304640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x557222617800 0x557222632000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x557222617800 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.459+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x557222617800 0x557222632000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.460+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x557222617800 0x557222632000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.460+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.460+0000 7f2514b05640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x557222636c00 0x557222632580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.460+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x557222636c00 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.460+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x557222636c00 0x557222632580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.460+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x557222636c00 0x557222632580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f2514304640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x557222636400 0x557222632b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636800 con 0x557222636400 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f251930e640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x557222636400 0x557222632b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f251930e640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x557222636400 0x557222632b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(10 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.461+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637400 con 0x5572231c7c00 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.462+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.462+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x557222636400 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.462+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(12 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.462+0000 7f2514b05640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x557222616c00 0x557222633600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.462+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617000 con 0x557222616c00 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.462+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x557222616c00 0x557222633600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.463+0000 7f2518b0d640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x557222616c00 0x557222633600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.463+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.463+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637400 con 0x5572231c6800 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.463+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.463+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x5572231c7400 2024-05-10T11:19:38.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 5 ==== osd_op_reply(15 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6c00 con 0x557222636400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6400 con 0x5572231c7400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222616800 con 0x557222636400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.464+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636800 con 0x5572231c7c00 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.465+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.465+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e000 con 0x557222616c00 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.465+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.465+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x5572231c6800 2024-05-10T11:19:38.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.466+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 4 ==== osd_op_reply(21 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.466+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e400 con 0x557222616c00 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.466+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.466+0000 7f2514b05640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x557222637800 0x557222633b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.466+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637c00 con 0x557222637800 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.466+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x557222637800 0x557222633b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f2519b0f640 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x557222637800 0x557222633b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(23 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e800 con 0x557222616c00 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617c00 con 0x5572231c7400 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.467+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264ec00 con 0x5572231c7400 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.468+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.468+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637400 con 0x5572231c7400 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.468+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 9 ==== osd_op_reply(27 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.468+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f000 con 0x557222616c00 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.468+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.468+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x557222617800 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264ec00 con 0x5572231c6800 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 5 ==== osd_op_reply(30 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x557222616c00 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e000 con 0x557222617800 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.469+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722306d400 con 0x557222636c00 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.470+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== osd_op_reply(33 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.470+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x557222637800 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.470+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== osd_op_reply(34 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.470+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6c00 con 0x557222617800 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.470+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.470+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222616800 con 0x557222637800 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.471+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 3 ==== osd_op_reply(36 [pgnls-filter start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.471+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6400 con 0x557222616c00 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.471+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.471+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617c00 con 0x557222636400 2024-05-10T11:19:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.471+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 5 ==== osd_op_reply(38 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.471+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636800 con 0x557222637800 2024-05-10T11:19:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.472+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 4 ==== osd_op_reply(39 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.472+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617000 con 0x5572231c7c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.472+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.472+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637c00 con 0x5572231c7c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.472+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.472+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e800 con 0x557222636c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.473+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 3 ==== osd_op_reply(42 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.473+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x5572231c7400 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.473+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 10 ==== osd_op_reply(43 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.474+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f000 con 0x5572231c6800 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.474+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.474+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x557222636c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.474+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 4 ==== osd_op_reply(45 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.474+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e000 con 0x557222616c00 2024-05-10T11:19:38.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.475+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.475+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x5572231c7c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.475+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 6 ==== osd_op_reply(47 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.475+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e400 con 0x557222616c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.475+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.475+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222616800 con 0x5572231c7400 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 11 ==== osd_op_reply(49 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f400 con 0x557222617800 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722306d400 con 0x5572231c7400 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 12 ==== osd_op_reply(51 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f800 con 0x557222636c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.476+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e800 con 0x5572231c6800 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6c00 con 0x5572231c6800 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264fc00 con 0x5572231c7400 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 13 ==== osd_op_reply(55 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.477+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264ec00 con 0x557222616c00 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.478+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.478+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617000 con 0x557222636400 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.478+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 6 ==== osd_op_reply(57 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.478+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f000 con 0x557222616c00 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.479+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 11 ==== osd_op_reply(58 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.479+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x557222637800 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.479+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 92 out=81b] v92'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.479+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6000 con 0x5572231c6800 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 9 ==== osd_op_reply(60 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636800 con 0x5572231c7400 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e800 con 0x5572231c6800 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 10 ==== osd_op_reply(62 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637c00 con 0x5572231c7400 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 15 ==== osd_op_reply(63 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.480+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722306d400 con 0x5572231c7400 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.481+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 16 ==== osd_op_reply(64 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.481+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x557222617800 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.481+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.481+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617c00 con 0x557222636c00 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.481+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 6 ==== osd_op_reply(66 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.481+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6400 con 0x557222636400 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.482+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.482+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222616800 con 0x5572231c7c00 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.482+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.482+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6c00 con 0x557222636400 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.482+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.482+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637400 con 0x557222616c00 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x5572231c6800 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 11 ==== osd_op_reply(71 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x5572231c7400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 17 ==== osd_op_reply(72 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e000 con 0x557222636400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 9 ==== osd_op_reply(73 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.483+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636800 con 0x5572231c7400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e400 con 0x557222636400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 10 ==== osd_op_reply(75 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637c00 con 0x5572231c7c00 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f400 con 0x557222616c00 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.484+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6000 con 0x5572231c6800 2024-05-10T11:19:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.485+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 12 ==== osd_op_reply(78 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.485+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264ec00 con 0x557222616c00 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.485+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.485+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6400 con 0x557222637800 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.485+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 6 ==== osd_op_reply(80 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.485+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f000 con 0x557222616c00 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6c00 con 0x5572231c7400 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 19 ==== osd_op_reply(82 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x5572231c7400 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 20 ==== osd_op_reply(83 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722306d400 con 0x5572231c7400 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 21 ==== osd_op_reply(84 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.486+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265e000 con 0x557222616c00 2024-05-10T11:19:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.487+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 16 ==== osd_op_reply(85 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.487+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264fc00 con 0x557222617800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.487+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 7 ==== osd_op_reply(86 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.487+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265e400 con 0x5572231c6800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.487+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 13 ==== osd_op_reply(87 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.487+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e800 con 0x557222616c00 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.488+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.488+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265e800 con 0x557222617800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.488+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.488+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617000 con 0x557222636c00 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.488+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 7 ==== osd_op_reply(90 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.488+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265ec00 con 0x557222637800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.489+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.489+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f800 con 0x557222617800 2024-05-10T11:19:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.489+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.489+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265f000 con 0x557222637800 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.489+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 8 ==== osd_op_reply(93 [pgnls-filter start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.489+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f400 con 0x557222616c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.490+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 18 ==== osd_op_reply(94 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.490+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265f400 con 0x557222636400 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.490+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 11 ==== osd_op_reply(95 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.490+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264ec00 con 0x557222637800 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.490+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 9 ==== osd_op_reply(96 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.490+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265f800 con 0x5572231c7c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.491+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 9 ==== osd_op_reply(97 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.491+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637c00 con 0x5572231c7c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.491+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 10 ==== osd_op_reply(98 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.491+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265fc00 con 0x557222636c00 2024-05-10T11:19:38.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.491+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 8 ==== osd_op_reply(99 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.491+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637400 con 0x5572231c7400 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.492+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 22 ==== osd_op_reply(100 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.492+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e000 con 0x5572231c6800 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.492+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 14 ==== osd_op_reply(101 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.492+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x557222636c00 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.492+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 9 ==== osd_op_reply(102 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.492+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e400 con 0x557222616c00 2024-05-10T11:19:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617c00 con 0x5572231c7c00 2024-05-10T11:19:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 11 ==== osd_op_reply(104 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264f000 con 0x557222616c00 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 20 ==== osd_op_reply(105 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222616800 con 0x5572231c7400 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 23 ==== osd_op_reply(106 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.493+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264fc00 con 0x557222617800 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.494+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.494+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617000 con 0x5572231c7400 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.494+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 24 ==== osd_op_reply(108 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.494+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264e800 con 0x557222636c00 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.494+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 10 ==== osd_op_reply(109 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.494+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6400 con 0x5572231c6800 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 15 ==== osd_op_reply(110 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637000 con 0x5572231c6800 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.2 v2:172.21.15.66:6816/3859729948 16 ==== osd_op_reply(111 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c6800 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617400 con 0x5572231c7400 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 25 ==== osd_op_reply(112 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636800 con 0x557222616c00 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.495+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222617c00 con 0x557222636400 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 12 ==== osd_op_reply(114 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222636000 con 0x557222616c00 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 22 ==== osd_op_reply(115 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637c00 con 0x557222637800 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 10 ==== osd_op_reply(116 [pgnls-filter start_epoch 92 out=81b] v92'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f251b60e740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f251b60e740 10 datascan.operator(): handling object 10000000001.0 2024-05-10T11:19:38.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.496+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x557223058800 con 0x557222637800 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 11 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x55722265e000 con 0x557222636400 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 13 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x55722265e400 con 0x5572231c7c00 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.6 v2:172.21.15.190:6808/4182602787 12 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) ==== 154+0+581 (crc 0 0 0) 0x55722300a500 con 0x5572231c7c00 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.497+0000 7f251b60e740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 20 datascan.get_frag_of: frag is * 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x55722265e800 con 0x557222636400 2024-05-10T11:19:38.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 14 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x55722265ec00 con 0x557222636400 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 15 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 20 datascan.read_dentry: file_head not found in result 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.498+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55722265f000 con 0x557222636400 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 16 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v92'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f251b60e740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265f400 con 0x557222637800 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.5 v2:172.21.15.190:6800/4020203147 12 ==== osd_op_reply(123 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222637800 2024-05-10T11:19:38.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722264ec00 con 0x557222636400 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.1 v2:172.21.15.66:6808/2096128619 17 ==== osd_op_reply(124 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x557222636400 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.502+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x557222637400 con 0x557222616c00 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.503+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.4 v2:172.21.15.190:6816/1866487272 23 ==== osd_op_reply(125 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222616c00 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.503+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265e000 con 0x557222636c00 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.503+0000 7f2519b0f640 1 -- 172.21.15.66:0/3100090180 <== osd.7 v2:172.21.15.190:6824/1531895533 11 ==== osd_op_reply(126 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a500 con 0x557222636c00 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.503+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722306d400 con 0x5572231c7400 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.503+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 26 ==== osd_op_reply(127 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.503+0000 7f2514304640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55722265e800 con 0x5572231c7400 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251930e640 1 -- 172.21.15.66:0/3100090180 <== osd.0 v2:172.21.15.66:6800/1407218537 27 ==== osd_op_reply(128 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a000 con 0x5572231c7400 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f2514b05640 1 -- 172.21.15.66:0/3100090180 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5572231c6000 con 0x557222617800 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 <== osd.3 v2:172.21.15.66:6824/286653269 11 ==== osd_op_reply(129 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55722300a780 con 0x557222617800 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x5572231c7400 msgr2=0x55722304a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x5572231c7400 0x55722304a680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x557222636400 msgr2=0x557222632b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x557222636400 0x557222632b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x5572231c6800 msgr2=0x55722304b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x5572231c6800 0x55722304b180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x557222617800 msgr2=0x557222632000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 reap_dead start 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x557222617800 0x557222632000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x557222616c00 msgr2=0x557222633600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x557222616c00 0x557222633600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x557222637800 msgr2=0x557222633b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x557222637800 0x557222633b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x5572231c7c00 msgr2=0x55722304ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x5572231c7c00 0x55722304ac00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x557222636c00 msgr2=0x557222632580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x557222636c00 0x557222632580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x5572231c7000 msgr2=0x55722304a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x5572231c7000 0x55722304a100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5572230211a0 tx=0x557222591020 comp rx=0 tx=0).stop 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059c00 msgr2=0x557223049b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 --2- 172.21.15.66:0/3100090180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557223059c00 0x557223049b80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x557223163c80 tx=0x55722301e720 comp rx=0 tx=0).stop 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 reap_dead start 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 shutdown_connections 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 >> 172.21.15.66:0/3100090180 conn(0x557223059000 msgr2=0x557222ff7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f2518b0d640 1 -- 172.21.15.66:0/3100090180 reap_dead start 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 shutdown_connections 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.504+0000 7f251b60e740 1 -- 172.21.15.66:0/3100090180 wait complete. 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 msgr2=0x557223048000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 0x557223048000 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x5572230a5b90 tx=0x557222348180 comp rx=0 tx=0).stop 2024-05-10T11:19:38.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 shutdown_connections 2024-05-10T11:19:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557222279c00 0x557223048b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557222279800 0x557223048580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 --2- 172.21.15.66:0/1709821339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557222278c00 0x557223048000 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 >> 172.21.15.66:0/1709821339 conn(0x557222279000 msgr2=0x557222ff6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 shutdown_connections 2024-05-10T11:19:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.505+0000 7f251b60e740 1 -- 172.21.15.66:0/1709821339 wait complete. 2024-05-10T11:19:38.518 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.153344, result: 2024-05-10T11:19:38.519 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-05-10T11:19:38.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 -- start start 2024-05-10T11:19:38.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 Processor -- start 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562073d8ec00 0x562074b62000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562073d8f800 0x562074b62580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 0x562074b62b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562074b80180 con 0x562073d8fc00 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562074b80300 con 0x562073d8f800 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3e818740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562074b80480 con 0x562073d8ec00 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3cd32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 0x562074b62b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3cd32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 0x562074b62b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39276/0 (socket says 172.21.15.66:39276) 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.591+0000 7f6d3cd32640 1 -- 172.21.15.66:0/3918933482 learned_addr learned my addr 172.21.15.66:0/3918933482 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3c531640 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562073d8ec00 0x562074b62000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562073d8f800 0x562074b62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3cd32640 1 -- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562073d8ec00 msgr2=0x562074b62000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562073d8ec00 0x562074b62000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3cd32640 1 -- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562073d8f800 msgr2=0x562074b62580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562073d8f800 0x562074b62580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3cd32640 1 -- 172.21.15.66:0/3918933482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562073dbb680 con 0x562073d8fc00 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3c531640 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562073d8ec00 0x562074b62000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 0x562074b62b00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x562074bb5bc0 tx=0x562074b35f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dee87fef68b8f89 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d39d2c640 1 -- 172.21.15.66:0/3918933482 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562073db49c0 con 0x562073d8fc00 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d39d2c640 1 -- 172.21.15.66:0/3918933482 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562073dd61c0 con 0x562073d8fc00 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d39d2c640 1 -- 172.21.15.66:0/3918933482 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562073db4680 con 0x562073d8fc00 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562073dbb860 con 0x562073d8fc00 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562073dbb2c0 con 0x562073d8fc00 2024-05-10T11:19:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3e818740 4 waiting for MDS map... 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d39d2c640 1 -- 172.21.15.66:0/3918933482 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x562074c70600 con 0x562073d8fc00 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d39d2c640 1 -- 172.21.15.66:0/3918933482 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 2885+0+0 (secure 0 0 0) 0x562073de7180 con 0x562073d8fc00 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.592+0000 7f6d3e818740 4 Got MDS map 71 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.593+0000 7f6d3e818740 4 datascan.main: Using metadata pool output 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.593+0000 7f6d3e818740 4 datascan.main: connecting to RADOS... 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.593+0000 7f6d3e818740 1 Processor -- start 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.593+0000 7f6d3e818740 1 -- start start 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 0x562074b63600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3e818740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562074b80600 con 0x562074cbe000 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3e818740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562074b80780 con 0x562074cbe800 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3e818740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562074b80900 con 0x562074cbe400 2024-05-10T11:19:38.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39288/0 (socket says 172.21.15.66:39288) 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 -- 172.21.15.66:0/3900480584 learned_addr learned my addr 172.21.15.66:0/3900480584 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 -- 172.21.15.66:0/3900480584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 msgr2=0x562074b63600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 0x562074b63600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 -- 172.21.15.66:0/3900480584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe800 msgr2=0x562074b63b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 -- 172.21.15.66:0/3900480584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562073dbb4a0 con 0x562074cbe000 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 0x562074b63080 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x562074c62fc0 tx=0x562074b9d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd0d2008fd65839 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d37d28640 1 -- 172.21.15.66:0/3900480584 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562073db49c0 con 0x562074cbe000 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d37d28640 1 -- 172.21.15.66:0/3900480584 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562073dd6e00 con 0x562074cbe000 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.594+0000 7f6d37d28640 1 -- 172.21.15.66:0/3900480584 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562073db4680 con 0x562074cbe000 2024-05-10T11:19:38.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 -- 172.21.15.66:0/3900480584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 msgr2=0x562074b63080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 0x562074b63080 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x562074c62fc0 tx=0x562074b9d800 comp rx=0 tx=0).stop 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 -- 172.21.15.66:0/3900480584 shutdown_connections 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 0x562074b63600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3900480584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 -- 172.21.15.66:0/3900480584 >> 172.21.15.66:0/3900480584 conn(0x562074b83c00 msgr2=0x562074b0d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 -- 172.21.15.66:0/3900480584 shutdown_connections 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 -- 172.21.15.66:0/3900480584 wait complete. 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 Processor -- start 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.595+0000 7f6d3e818740 1 -- start start 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 0x562074b63600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3e818740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3e818740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562074b81c80 con 0x562074cbe800 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3e818740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562074b81b00 con 0x562074cbe000 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3e818740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562074b81980 con 0x562074cbe400 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39296/0 (socket says 172.21.15.66:39296) 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 learned_addr learned my addr 172.21.15.66:0/2264975771 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 0x562074b63600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 msgr2=0x562074b63600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562074cbe400 0x562074b63600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe000 msgr2=0x562074b63080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562074cbe000 0x562074b63080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562073dbb0e0 con 0x562074cbe800 2024-05-10T11:19:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.596+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 0x562074b63b80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x562074c63c80 tx=0x562074b34720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.597+0000 7f6d36525640 1 -- 172.21.15.66:0/2264975771 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562073db44e0 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.597+0000 7f6d36525640 1 -- 172.21.15.66:0/2264975771 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562073dd6c40 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.597+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562073dbba40 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.597+0000 7f6d36525640 1 -- 172.21.15.66:0/2264975771 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562073db49c0 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.597+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562073dba3c0 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.597+0000 7f6d3e818740 4 datascan.init: resolving metadata pool 13 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.598+0000 7f6d36525640 1 -- 172.21.15.66:0/2264975771 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x562074cd2c00 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.598+0000 7f6d36525640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x562074132000 0x562074b64100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.598+0000 7f6d36525640 1 -- 172.21.15.66:0/2264975771 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x562074ccca00 con 0x562074cbe800 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.598+0000 7f6d3e818740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.598+0000 7f6d3e818740 4 datascan.main: resolving metadata pool 13 2024-05-10T11:19:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x562074cbec00 0x562074b64680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x562074132000 0x562074b64100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074cbf000 con 0x562074cbec00 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x562074cbec00 0x562074b64680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x562074132000 0x562074b64100 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x562074bb5aa0 tx=0x5620740baf60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x562074cbec00 0x562074b64680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.599+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(1 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x562074cbf000 0x562074144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133000 con 0x562074cbf000 2024-05-10T11:19:38.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x562074cbf000 0x562074144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x562074cbf000 0x562074144000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(2 [pgnls start_epoch 92 out=177b] v92'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x562074133000 0x562074144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.600+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133c00 con 0x562074133000 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x562074133000 0x562074144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x562074133000 0x562074144580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(3 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133000 2024-05-10T11:19:38.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133c00 con 0x562074cbec00 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== osd_op_reply(4 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x562074133c00 0x562074144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.601+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133400 con 0x562074133c00 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.602+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x562074133c00 0x562074144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.602+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x562074133c00 0x562074144b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.602+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(5 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.602+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x562074133400 0x562074145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.602+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133800 con 0x562074133400 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.602+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x562074133400 0x562074145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x562074133400 0x562074145080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(6 [pgnls start_epoch 92 out=149b] v91'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133800 con 0x562074cbf000 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(7 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074133800 con 0x562074133c00 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(8 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562074133800 0x562074145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.603+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac000 con 0x562074133800 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.604+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562074133800 0x562074145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.604+0000 7f6d3c531640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562074133800 0x562074145600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.604+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(9 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.604+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac000 con 0x562074133400 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.604+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(10 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.604+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac000 con 0x562074133000 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.605+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== osd_op_reply(11 [pgnls start_epoch 92 out=81b] v91'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562074b20780 con 0x562074133000 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.605+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac000 con 0x562074cbf000 2024-05-10T11:19:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.605+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 3 ==== osd_op_reply(12 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.605+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x5620740ac000 0x562074146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.605+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ad000 con 0x5620740ac000 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.605+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x5620740ac000 0x562074146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x5620740ac000 0x562074146680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(13 [pgnls start_epoch 92 out=77b] v91'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3bd30640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x5620740ad000 0x562074145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ad000 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x5620740ad000 0x562074145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3cd32640 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x5620740ad000 0x562074145b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(14 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x5620740ad000 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.606+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbec00 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.607+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 3 ==== osd_op_reply(15 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.607+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ac000 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.607+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(16 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.607+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133c00 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.607+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(17 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.607+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbf000 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 4 ==== osd_op_reply(18 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133800 2024-05-10T11:19:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== osd_op_reply(19 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ad000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(20 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x5620740ad000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ac000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(21 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.608+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ac000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.609+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(22 [pgnls start_epoch 92 out=97b] v91'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.609+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ac000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.609+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 5 ==== osd_op_reply(23 [pgnls start_epoch 92 out=74b] v87'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.609+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbec00 2024-05-10T11:19:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.609+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 4 ==== osd_op_reply(24 [pgnls start_epoch 92 out=73b] v91'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.609+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133400 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.610+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(25 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.610+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbec00 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.610+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 5 ==== osd_op_reply(26 [pgnls start_epoch 92 out=98b] v91'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.610+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133800 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.610+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 3 ==== osd_op_reply(27 [pgnls start_epoch 92 out=76b] v91'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.610+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x5620740ac000 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.611+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 6 ==== osd_op_reply(28 [pgnls start_epoch 92 out=73b] v91'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.611+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbec00 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.611+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 6 ==== osd_op_reply(29 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.611+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133800 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.611+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 4 ==== osd_op_reply(30 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.611+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133c00 2024-05-10T11:19:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.612+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 4 ==== osd_op_reply(31 [pgnls start_epoch 92 out=73b] v87'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.612+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133c00 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.612+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 5 ==== osd_op_reply(32 [pgnls start_epoch 92 out=101b] v91'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.612+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.612+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160000 con 0x562074cbf000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160400 con 0x562074cbf000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbf000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 20 datascan.scan_links: injected ino detected 2024-05-10T11:19:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160c00 con 0x562074cbf000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.613+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161000 con 0x562074cbf000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-05-10T11:19:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161400 con 0x562074133400 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160000 con 0x562074133c00 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.614+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160400 con 0x562074133000 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.2 v2:172.21.15.66:6816/3859729948 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x562074b20780 con 0x562074133000 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-05-10T11:19:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.615+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160c00 con 0x5620740ac000 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740adc00 con 0x562074cbec00 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 8 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ad800 con 0x562074cbec00 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.616+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ad400 con 0x562074cbec00 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 10 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160000 con 0x562074133c00 2024-05-10T11:19:38.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.617+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 7 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.618+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.618+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 11 ==== osd_op_reply(47 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.618+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbf000 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.618+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 10 ==== osd_op_reply(48 [pgnls start_epoch 92 out=177b] v92'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.618+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133000 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.619+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.2 v2:172.21.15.66:6816/3859729948 4 ==== osd_op_reply(49 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133000 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.619+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.619+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 12 ==== osd_op_reply(50 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.619+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133c00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.619+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 8 ==== osd_op_reply(51 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.619+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133400 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 5 ==== osd_op_reply(52 [pgnls start_epoch 92 out=149b] v91'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbf000 2024-05-10T11:19:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 11 ==== osd_op_reply(53 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133c00 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 9 ==== osd_op_reply(54 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133800 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 5 ==== osd_op_reply(55 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.620+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133400 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 6 ==== osd_op_reply(56 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.2 v2:172.21.15.66:6816/3859729948 5 ==== osd_op_reply(57 [pgnls start_epoch 92 out=81b] v91'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562074b20780 con 0x562074133000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbf000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 12 ==== osd_op_reply(58 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 8 ==== osd_op_reply(59 [pgnls start_epoch 92 out=77b] v91'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.621+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ad000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.622+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(60 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x5620740ad000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.622+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.622+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 13 ==== osd_op_reply(61 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.622+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.622+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 9 ==== osd_op_reply(62 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.622+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133c00 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 10 ==== osd_op_reply(63 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbf000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 13 ==== osd_op_reply(64 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133800 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 6 ==== osd_op_reply(65 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ad000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.3 v2:172.21.15.66:6824/286653269 4 ==== osd_op_reply(66 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x5620740ad000 2024-05-10T11:19:38.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.623+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.624+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 10 ==== osd_op_reply(67 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.624+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.624+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 11 ==== osd_op_reply(68 [pgnls start_epoch 92 out=97b] v91'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.624+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.624+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 12 ==== osd_op_reply(69 [pgnls start_epoch 92 out=74b] v87'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.624+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 14 ==== osd_op_reply(70 [pgnls start_epoch 92 out=73b] v91'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133400 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 7 ==== osd_op_reply(71 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 15 ==== osd_op_reply(72 [pgnls start_epoch 92 out=98b] v91'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133800 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 7 ==== osd_op_reply(73 [pgnls start_epoch 92 out=76b] v91'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.625+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.626+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 13 ==== osd_op_reply(74 [pgnls start_epoch 92 out=73b] v91'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.626+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074cbec00 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.626+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 16 ==== osd_op_reply(75 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.626+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133800 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.626+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.5 v2:172.21.15.190:6800/4020203147 8 ==== osd_op_reply(76 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562074b20780 con 0x562074133800 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.626+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133c00 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 11 ==== osd_op_reply(77 [pgnls start_epoch 92 out=73b] v87'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x562074133c00 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 12 ==== osd_op_reply(78 [pgnls start_epoch 92 out=101b] v91'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160c00 con 0x562074cbf000 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-05-10T11:19:38.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161800 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.627+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161c00 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 20 datascan.scan_links: injected ino detected 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740acc00 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac800 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074133400 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.0 v2:172.21.15.66:6800/1407218537 8 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20500 con 0x562074133400 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.628+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740acc00 con 0x562074133c00 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-05-10T11:19:38.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac800 con 0x562074133000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 <== osd.2 v2:172.21.15.66:6816/3859729948 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x562074b20780 con 0x562074133000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.629+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbec00 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 17 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161000 con 0x5620740ac000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 14 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-05-10T11:19:38.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.630+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161400 con 0x562074cbec00 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 18 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160c00 con 0x562074cbec00 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 19 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161800 con 0x562074cbec00 2024-05-10T11:19:38.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 20 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.631+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074161c00 con 0x562074133c00 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.6 v2:172.21.15.190:6808/4182602787 14 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x562074b20000 con 0x562074133c00 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740adc00 con 0x562074cbf000 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.632+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x5620740ad800 con 0x562074cbf000 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v92'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 10 datascan.scan_links: processing 1 injected_inos 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ad400 con 0x562074cbf000 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 20 datascan.scan_links: first is now 2 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.633+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x5620740acc00 con 0x562074cbf000 2024-05-10T11:19:38.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3cd32640 1 -- 172.21.15.66:0/2264975771 <== osd.1 v2:172.21.15.66:6808/2096128619 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v92'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562074b20500 con 0x562074cbf000 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3e818740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3e818740 10 datascan.scan_links: updating inotable 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5620740ac400 con 0x562074cbec00 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3e818740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3e818740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.636+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x562074160000 con 0x562074cbec00 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.637+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.7 v2:172.21.15.190:6824/1531895533 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v92'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x562074b20000 con 0x562074cbec00 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.637+0000 7f6d3e818740 10 datascan.scan_links: updating snaptable 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.637+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x562074160800 con 0x5620740ac000 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3bd30640 1 -- 172.21.15.66:0/2264975771 <== osd.4 v2:172.21.15.190:6816/1866487272 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x562074b20000 con 0x5620740ac000 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x562074133400 msgr2=0x562074145080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x562074133400 0x562074145080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x562074cbf000 msgr2=0x562074144000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x562074cbf000 0x562074144000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x562074133000 msgr2=0x562074144580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x562074133000 0x562074144580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x5620740ad000 msgr2=0x562074145b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x5620740ad000 0x562074145b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 reap_dead start 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x5620740ac000 msgr2=0x562074146680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x5620740ac000 0x562074146680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562074133800 msgr2=0x562074145600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x562074133800 0x562074145600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x562074133c00 msgr2=0x562074144b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x562074133c00 0x562074144b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x562074cbec00 msgr2=0x562074b64680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x562074cbec00 0x562074b64680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3c531640 1 -- 172.21.15.66:0/2264975771 reap_dead start 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x562074132000 msgr2=0x562074b64100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x562074132000 0x562074b64100 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x562074bb5aa0 tx=0x5620740baf60 comp rx=0 tx=0).stop 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 msgr2=0x562074b63b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 0x562074b63b80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x562074c63c80 tx=0x562074b34720 comp rx=0 tx=0).stop 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 shutdown_connections 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x562074132000 0x562074b64100 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/2264975771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562074cbe800 0x562074b63b80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 >> 172.21.15.66:0/2264975771 conn(0x562074b83c00 msgr2=0x562074b0d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 shutdown_connections 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/2264975771 wait complete. 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 msgr2=0x562074b62b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 0x562074b62b00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x562074bb5bc0 tx=0x562074b35f20 comp rx=0 tx=0).stop 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 shutdown_connections 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562073d8fc00 0x562074b62b00 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562073d8f800 0x562074b62580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 --2- 172.21.15.66:0/3918933482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562073d8ec00 0x562074b62000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.638+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 >> 172.21.15.66:0/3918933482 conn(0x562073d8f000 msgr2=0x562074b0c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.639+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 shutdown_connections 2024-05-10T11:19:38.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.639+0000 7f6d3e818740 1 -- 172.21.15.66:0/3918933482 wait complete. 2024-05-10T11:19:38.662 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.143757, result: 2024-05-10T11:19:38.662 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T11:19:38.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.797+0000 7f13c4b4d640 1 Processor -- start 2024-05-10T11:19:38.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.797+0000 7f13c4b4d640 1 -- start start 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.798+0000 7f13c4b4d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 0x7f13c00b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.798+0000 7f13c4b4d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f13c00d36d0 0x7f13c00d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.798+0000 7f13c4b4d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c00d2800 con 0x7f13c015f410 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.798+0000 7f13c4b4d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f13c00d2ae0 con 0x7f13c00d36d0 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.798+0000 7f13c4b4d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13c00d01d0 con 0x7f13c00b4f90 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13be59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f13c015f410 0x7f13c00d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52682/0 (socket says 172.21.15.66:52682) 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13be59c640 1 -- 172.21.15.66:0/3013970424 learned_addr learned my addr 172.21.15.66:0/3013970424 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bed9d640 1 --2- 172.21.15.66:0/3013970424 >> v2:172.21.15.190:3300/0 conn(0x7f13c00d36d0 0x7f13c00d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bdd9b640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 0x7f13c00b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582133683 0 0) 0x7f13c00d2800 con 0x7f13c015f410 2024-05-10T11:19:38.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13a8003520 con 0x7f13c015f410 2024-05-10T11:19:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2984487562 0 0) 0x7f13a8003520 con 0x7f13c015f410 2024-05-10T11:19:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 msgr2=0x7f13c00b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 0x7f13c00b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 >> v2:172.21.15.190:3300/0 conn(0x7f13c00d36d0 msgr2=0x7f13c00d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 --2- 172.21.15.66:0/3013970424 >> v2:172.21.15.190:3300/0 conn(0x7f13c00d36d0 0x7f13c00d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c00d04b0 con 0x7f13c015f410 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f13b8001670 con 0x7f13c015f410 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 >> v1:172.21.15.66:6789/0 conn(0x7f13c015f410 legacy=0x7f13c00d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13a80039b0 0x7f13a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13a8004800 0x7f13a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 0x7f13a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00d2ae0 con 0x7f13a8004800 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00d01d0 con 0x7f13a80039b0 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13a80141d0 con 0x7f13c00b4f90 2024-05-10T11:19:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bdd9b640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13a8004800 0x7f13a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13be59c640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13a80039b0 0x7f13a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.799+0000 7f13bed9d640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 0x7f13a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bdd9b640 1 -- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 msgr2=0x7f13a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bdd9b640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13c00b4f90 0x7f13a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bdd9b640 1 -- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13a80039b0 msgr2=0x7f13a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bdd9b640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13a80039b0 0x7f13a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bdd9b640 1 -- 172.21.15.66:0/3013970424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8003520 con 0x7f13a8004800 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13be59c640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13a80039b0 0x7f13a8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bdd9b640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13a8004800 0x7f13a8004c80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009af0 tx=0x7f13a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86f47b1c1dd99d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4036070 con 0x7f13a8004800 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4031400 con 0x7f13a8004800 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.800+0000 7f13bd59a640 1 -- 172.21.15.66:0/3013970424 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4009690 con 0x7f13a8004800 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3013970424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13a8004800 msgr2=0x7f13a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3013970424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13a8004800 0x7f13a8004c80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009af0 tx=0x7f13a8005830 comp rx=0 tx=0).stop 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13bed9d640 1 -- 172.21.15.66:0/3013970424 reap_dead start 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3013970424 shutdown_connections 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3013970424 >> 172.21.15.66:0/3013970424 conn(0x7f13c008ed30 msgr2=0x7f13c009e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3013970424 shutdown_connections 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.801+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3013970424 wait complete. 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.802+0000 7f13c4b4d640 1 Processor -- start 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 -- start start 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13a8004800 0x7f13c00b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c014f1d0 0x7f13c014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 0x7f13c00ba860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00cffb0 con 0x7f13c00ba3d0 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00cfe30 con 0x7f13c014f1d0 2024-05-10T11:19:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13c4b4d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13c00d10e0 con 0x7f13a8004800 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13bed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 0x7f13c00ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13bed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 0x7f13c00ba860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39306/0 (socket says 172.21.15.66:39306) 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.803+0000 7f13bed9d640 1 -- 172.21.15.66:0/3665955736 learned_addr learned my addr 172.21.15.66:0/3665955736 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13be59c640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13a8004800 0x7f13c00b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bdd9b640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c014f1d0 0x7f13c014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bed9d640 1 -- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13a8004800 msgr2=0x7f13c00b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bed9d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13a8004800 0x7f13c00b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bed9d640 1 -- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c014f1d0 msgr2=0x7f13c014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bed9d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c014f1d0 0x7f13c014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bed9d640 1 -- 172.21.15.66:0/3665955736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c00b8950 con 0x7f13c00ba3d0 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13be59c640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13a8004800 0x7f13c00b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13bed9d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 0x7f13c00ba860 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f13c008f5f0 tx=0x7f13b000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8007d50 con 0x7f13c00ba3d0 2024-05-10T11:19:38.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b001d070 con 0x7f13c00ba3d0 2024-05-10T11:19:38.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c00b8c30 con 0x7f13c00ba3d0 2024-05-10T11:19:38.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0015430 con 0x7f13c00ba3d0 2024-05-10T11:19:38.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.804+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c00b2250 con 0x7f13c00ba3d0 2024-05-10T11:19:38.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.805+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c006a220 con 0x7f13c00ba3d0 2024-05-10T11:19:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.806+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13b00155d0 con 0x7f13c00ba3d0 2024-05-10T11:19:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.806+0000 7f13aeffd640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13a00762d0 0x7f13a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.806+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f13b0098100 con 0x7f13c00ba3d0 2024-05-10T11:19:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.806+0000 7f13be59c640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13a00762d0 0x7f13a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.807+0000 7f13be59c640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13a00762d0 0x7f13a0078790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13b8001690 tx=0x7f13b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:38.811+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f13b0010040 con 0x7f13c00ba3d0 2024-05-10T11:19:39.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.042+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f13c00d6090 con 0x7f13c00ba3d0 2024-05-10T11:19:39.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.258+0000 7f13aeffd640 1 -- 172.21.15.66:0/3665955736 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v72) ==== 162+0+0 (secure 0 0 0) 0x7f13b00617b0 con 0x7f13c00ba3d0 2024-05-10T11:19:39.258 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13a00762d0 msgr2=0x7f13a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13a00762d0 0x7f13a0078790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13b8001690 tx=0x7f13b8009040 comp rx=0 tx=0).stop 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 msgr2=0x7f13c00ba860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 0x7f13c00ba860 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f13c008f5f0 tx=0x7f13b000f580 comp rx=0 tx=0).stop 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 shutdown_connections 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13a00762d0 0x7f13a0078790 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c00ba3d0 0x7f13c00ba860 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c014f1d0 0x7f13c014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 --2- 172.21.15.66:0/3665955736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13a8004800 0x7f13c00b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 >> 172.21.15.66:0/3665955736 conn(0x7f13c008ed30 msgr2=0x7f13c015e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:39.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 shutdown_connections 2024-05-10T11:19:39.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.260+0000 7f13c4b4d640 1 -- 172.21.15.66:0/3665955736 wait complete. 2024-05-10T11:19:39.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:19:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.377+0000 7f3dbdc72640 1 Processor -- start 2024-05-10T11:19:39.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.377+0000 7f3dbdc72640 1 -- start start 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3dbdc72640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3db80c6c80 0x7f3db80c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3dbdc72640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3db80cee40 0x7f3db80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3dbdc72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db806f1c0 con 0x7f3db81598c0 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3dbdc72640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3db806f4a0 con 0x7f3db80c6c80 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3dbdc72640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3db806f780 con 0x7f3db80cee40 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3db80c6c80 0x7f3db80c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3db80c6c80 0x7f3db80c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39310/0 (socket says 172.21.15.66:39310) 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 -- 172.21.15.66:0/1584606751 learned_addr learned my addr 172.21.15.66:0/1584606751 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 -- 172.21.15.66:0/1584606751 >> v2:172.21.15.190:3300/0 conn(0x7f3db80cee40 msgr2=0x7f3db80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:39.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db7fff640 1 --2- 172.21.15.66:0/1584606751 >> v2:172.21.15.190:3300/0 conn(0x7f3db80cee40 0x7f3db80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 --2- 172.21.15.66:0/1584606751 >> v2:172.21.15.190:3300/0 conn(0x7f3db80cee40 0x7f3db80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 -- 172.21.15.66:0/1584606751 >> v1:172.21.15.190:6789/0 conn(0x7f3db81598c0 legacy=0x7f3db806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.378+0000 7f3db6ffd640 1 -- 172.21.15.66:0/1584606751 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db806fa60 con 0x7f3db80c6c80 2024-05-10T11:19:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.379+0000 7f3db6ffd640 1 --2- 172.21.15.66:0/1584606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80c6c80 0x7f3db80c7110 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3db80b0820 tx=0x7f3dac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2b27c677d777df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.379+0000 7f3db67fc640 1 -- 172.21.15.66:0/1584606751 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac037070 con 0x7f3db80c6c80 2024-05-10T11:19:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.379+0000 7f3db67fc640 1 -- 172.21.15.66:0/1584606751 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac032440 con 0x7f3db80c6c80 2024-05-10T11:19:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.379+0000 7f3db67fc640 1 -- 172.21.15.66:0/1584606751 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac032810 con 0x7f3db80c6c80 2024-05-10T11:19:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 -- 172.21.15.66:0/1584606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80c6c80 msgr2=0x7f3db80c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/1584606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80c6c80 0x7f3db80c7110 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3db80b0820 tx=0x7f3dac02a230 comp rx=0 tx=0).stop 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 -- 172.21.15.66:0/1584606751 shutdown_connections 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/1584606751 >> v2:172.21.15.190:3300/0 conn(0x7f3db80cee40 0x7f3db80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/1584606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80c6c80 0x7f3db80c7110 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 -- 172.21.15.66:0/1584606751 >> 172.21.15.66:0/1584606751 conn(0x7f3db80b2900 msgr2=0x7f3db80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 -- 172.21.15.66:0/1584606751 shutdown_connections 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.380+0000 7f3dbdc72640 1 -- 172.21.15.66:0/1584606751 wait complete. 2024-05-10T11:19:39.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.381+0000 7f3dbdc72640 1 Processor -- start 2024-05-10T11:19:39.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.381+0000 7f3dbdc72640 1 -- start start 2024-05-10T11:19:39.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3dbdc72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3db80c6c80 0x7f3db81560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:39.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3dbdc72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 0x7f3db815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:39.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3dbdc72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3db81598c0 0x7f3db80ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3dbdc72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3db806ee10 con 0x7f3db80cee40 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3dbdc72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3db815c6e0 con 0x7f3db80c6c80 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3dbdc72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3db815ae90 con 0x7f3db81598c0 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 0x7f3db815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 0x7f3db815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39316/0 (socket says 172.21.15.66:39316) 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3db6ffd640 1 -- 172.21.15.66:0/2427878756 learned_addr learned my addr 172.21.15.66:0/2427878756 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.382+0000 7f3db7fff640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3db81598c0 0x7f3db80ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db77fe640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3db80c6c80 0x7f3db81560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db6ffd640 1 -- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3db81598c0 msgr2=0x7f3db80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db6ffd640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3db81598c0 0x7f3db80ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db6ffd640 1 -- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3db80c6c80 msgr2=0x7f3db81560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db6ffd640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3db80c6c80 0x7f3db81560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db6ffd640 1 -- 172.21.15.66:0/2427878756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db80cd870 con 0x7f3db80cee40 2024-05-10T11:19:39.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db7fff640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3db81598c0 0x7f3db80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3db6ffd640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 0x7f3db815bbf0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000c00 tx=0x7f3dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac041020 con 0x7f3db80cee40 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac030970 con 0x7f3db80cee40 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db815b110 con 0x7f3db80cee40 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac037040 con 0x7f3db80cee40 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.383+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db815c130 con 0x7f3db80cee40 2024-05-10T11:19:39.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.384+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db806a220 con 0x7f3db80cee40 2024-05-10T11:19:39.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.385+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3dac044020 con 0x7f3db80cee40 2024-05-10T11:19:39.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.385+0000 7f3d9ffff640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3da40762d0 0x7f3da4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:39.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.386+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f3dac0b8370 con 0x7f3db80cee40 2024-05-10T11:19:39.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.386+0000 7f3db77fe640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3da40762d0 0x7f3da4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:39.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.386+0000 7f3db77fe640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3da40762d0 0x7f3da4078790 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3da8006fd0 tx=0x7f3da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:39.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.391+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3dac04b030 con 0x7f3db80cee40 2024-05-10T11:19:39.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.623+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3db806e4e0 con 0x7f3db80cee40 2024-05-10T11:19:39.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.623+0000 7f3d9ffff640 1 -- 172.21.15.66:0/2427878756 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5180 (secure 0 0 0) 0x7f3dac0819a0 con 0x7f3db80cee40 2024-05-10T11:19:39.623 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:39.623 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:39.261677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:replay","state_seq":1,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T11:19:39.623 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 73 2024-05-10T11:19:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3da40762d0 msgr2=0x7f3da4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3da40762d0 0x7f3da4078790 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3da8006fd0 tx=0x7f3da8008040 comp rx=0 tx=0).stop 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 msgr2=0x7f3db815bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 0x7f3db815bbf0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000c00 tx=0x7f3dac0046c0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 shutdown_connections 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3da40762d0 0x7f3da4078790 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3db81598c0 0x7f3db80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3db80cee40 0x7f3db815bbf0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 --2- 172.21.15.66:0/2427878756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3db80c6c80 0x7f3db81560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 >> 172.21.15.66:0/2427878756 conn(0x7f3db80b2900 msgr2=0x7f3db80b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 shutdown_connections 2024-05-10T11:19:39.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:39.626+0000 7f3dbdc72640 1 -- 172.21.15.66:0/2427878756 wait complete. 2024-05-10T11:19:40.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:19:39.261677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7323': {'gid': 7323, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/821296830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 821296830}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 821296830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:19:40.040 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7323:up:replay 2024-05-10T11:19:41.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:19:41.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.158+0000 7fb50a30a640 1 Processor -- start 2024-05-10T11:19:41.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.158+0000 7fb50a30a640 1 -- start start 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb50a30a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5040d0230 0x7fb5040cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb50a30a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040cfbb0 0x7fb5040ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb50a30a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50415fc90 con 0x7fb5040b8860 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb50a30a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb50406ec30 con 0x7fb5040d0230 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb50a30a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb50406ee50 con 0x7fb5040cfbb0 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb503fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb5040b8860 0x7fb50406e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52692/0 (socket says 172.21.15.66:52692) 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb503fff640 1 -- 172.21.15.66:0/2061208081 learned_addr learned my addr 172.21.15.66:0/2061208081 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.159+0000 7fb5037fe640 1 --2- 172.21.15.66:0/2061208081 >> v2:172.21.15.66:3300/0 conn(0x7fb5040d0230 0x7fb5040cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:41.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb5088a7640 1 --2- 172.21.15.66:0/2061208081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040cfbb0 0x7fb5040ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb502ffd640 1 -- 172.21.15.66:0/2061208081 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651548651 0 0) 0x7fb50415fc90 con 0x7fb5040b8860 2024-05-10T11:19:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb502ffd640 1 -- 172.21.15.66:0/2061208081 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003520 con 0x7fb5040b8860 2024-05-10T11:19:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb5037fe640 1 -- 172.21.15.66:0/2061208081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040cfbb0 msgr2=0x7fb5040ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb5037fe640 1 --2- 172.21.15.66:0/2061208081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040cfbb0 0x7fb5040ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb5037fe640 1 -- 172.21.15.66:0/2061208081 >> v1:172.21.15.66:6789/0 conn(0x7fb5040b8860 legacy=0x7fb50406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.160+0000 7fb5037fe640 1 -- 172.21.15.66:0/2061208081 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5040b8c40 con 0x7fb5040d0230 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb5037fe640 1 --2- 172.21.15.66:0/2061208081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb5040cf670 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097d0 tx=0x7fb4f802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ea046eadea89f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb502ffd640 1 -- 172.21.15.66:0/2061208081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8037070 con 0x7fb5040d0230 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb502ffd640 1 -- 172.21.15.66:0/2061208081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f802ae40 con 0x7fb5040d0230 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb502ffd640 1 -- 172.21.15.66:0/2061208081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8032660 con 0x7fb5040d0230 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 -- 172.21.15.66:0/2061208081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 msgr2=0x7fb5040cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 --2- 172.21.15.66:0/2061208081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb5040cf670 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097d0 tx=0x7fb4f802a130 comp rx=0 tx=0).stop 2024-05-10T11:19:41.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 -- 172.21.15.66:0/2061208081 shutdown_connections 2024-05-10T11:19:41.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 --2- 172.21.15.66:0/2061208081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040cfbb0 0x7fb5040ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 --2- 172.21.15.66:0/2061208081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb5040cf670 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 -- 172.21.15.66:0/2061208081 >> 172.21.15.66:0/2061208081 conn(0x7fb5040d2df0 msgr2=0x7fb5040d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:41.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 -- 172.21.15.66:0/2061208081 shutdown_connections 2024-05-10T11:19:41.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.161+0000 7fb50a30a640 1 -- 172.21.15.66:0/2061208081 wait complete. 2024-05-10T11:19:41.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.163+0000 7fb50a30a640 1 Processor -- start 2024-05-10T11:19:41.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.163+0000 7fb50a30a640 1 -- start start 2024-05-10T11:19:41.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040b8860 0x7fb504160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:41.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5040cfbb0 0x7fb50415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:41.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb504071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5040cdb30 con 0x7fb5040d0230 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb5040cd850 con 0x7fb5040cfbb0 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5040cde10 con 0x7fb5040b8860 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb504071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb504071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39334/0 (socket says 172.21.15.66:39334) 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 -- 172.21.15.66:0/3108927150 learned_addr learned my addr 172.21.15.66:0/3108927150 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5037fe640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5040cfbb0 0x7fb50415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb503fff640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040b8860 0x7fb504160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 -- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040b8860 msgr2=0x7fb504160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040b8860 0x7fb504160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 -- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5040cfbb0 msgr2=0x7fb50415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5040cfbb0 0x7fb50415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 -- 172.21.15.66:0/3108927150 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50415d6b0 con 0x7fb5040d0230 2024-05-10T11:19:41.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5037fe640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5040cfbb0 0x7fb50415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:41.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb5088a7640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb504071510 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc007e40 tx=0x7fb4fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:41.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc014620 con 0x7fb5040d0230 2024-05-10T11:19:41.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc019070 con 0x7fb5040d0230 2024-05-10T11:19:41.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc014a20 con 0x7fb5040d0230 2024-05-10T11:19:41.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.164+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50415e7c0 con 0x7fb5040d0230 2024-05-10T11:19:41.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.165+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5040ca110 con 0x7fb5040d0230 2024-05-10T11:19:41.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.166+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50406a220 con 0x7fb5040d0230 2024-05-10T11:19:41.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.166+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4fc014bc0 con 0x7fb5040d0230 2024-05-10T11:19:41.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.167+0000 7fb500ff9640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4f00762d0 0x7fb4f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:41.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.167+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fb4fc098140 con 0x7fb5040d0230 2024-05-10T11:19:41.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.167+0000 7fb503fff640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4f00762d0 0x7fb4f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:41.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.168+0000 7fb503fff640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4f00762d0 0x7fb4f0078790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4005880 tx=0x7fb4f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:41.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.171+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb4fc061880 con 0x7fb5040d0230 2024-05-10T11:19:41.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.402+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5040d1e20 con 0x7fb5040d0230 2024-05-10T11:19:41.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.402+0000 7fb500ff9640 1 -- 172.21.15.66:0/3108927150 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5180 (secure 0 0 0) 0x7fb4fc061180 con 0x7fb5040d0230 2024-05-10T11:19:41.402 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:41.402 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:40.273401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T11:19:41.402 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 75 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.404+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4f00762d0 msgr2=0x7fb4f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.404+0000 7fb50a30a640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4f00762d0 0x7fb4f0078790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4005880 tx=0x7fb4f4009040 comp rx=0 tx=0).stop 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.404+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 msgr2=0x7fb504071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.404+0000 7fb50a30a640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb504071510 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc007e40 tx=0x7fb4fc00e4b0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 shutdown_connections 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb4f00762d0 0x7fb4f0078790 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5040d0230 0x7fb504071510 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5040cfbb0 0x7fb50415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 --2- 172.21.15.66:0/3108927150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5040b8860 0x7fb504160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:41.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 >> 172.21.15.66:0/3108927150 conn(0x7fb5040d2df0 msgr2=0x7fb5040b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:41.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 shutdown_connections 2024-05-10T11:19:41.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:41.405+0000 7fb50a30a640 1 -- 172.21.15.66:0/3108927150 wait complete. 2024-05-10T11:19:41.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:19:40.273401+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7323': {'gid': 7323, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.66:6835/821296830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 821296830}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 821296830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:19:41.818 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7323:up:rejoin 2024-05-10T11:19:42.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:19:42.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.937+0000 7f59725b6640 1 Processor -- start 2024-05-10T11:19:42.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.937+0000 7f59725b6640 1 -- start start 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.937+0000 7f59725b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f596c0cfb70 0x7f596c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f59725b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f596c0cff50 0x7f596c06e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f59725b6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c0d1630 con 0x7f596c06d670 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f59725b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0d1910 con 0x7f596c0cff50 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f59725b6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0d1bf0 con 0x7f596c0cfb70 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f596c0cff50 0x7f596c06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f596c0cff50 0x7f596c06e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39348/0 (socket says 172.21.15.66:39348) 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 -- 172.21.15.66:0/1394231600 learned_addr learned my addr 172.21.15.66:0/1394231600 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596bfff640 1 --2- 172.21.15.66:0/1394231600 >> v2:172.21.15.190:3300/0 conn(0x7f596c0cfb70 0x7f596c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 -- 172.21.15.66:0/1394231600 >> v2:172.21.15.190:3300/0 conn(0x7f596c0cfb70 msgr2=0x7f596c06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:42.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 --2- 172.21.15.66:0/1394231600 >> v2:172.21.15.190:3300/0 conn(0x7f596c0cfb70 0x7f596c06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:42.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 -- 172.21.15.66:0/1394231600 >> v1:172.21.15.190:6789/0 conn(0x7f596c06d670 legacy=0x7f596c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:42.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596b7fe640 1 -- 172.21.15.66:0/1394231600 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0d1ed0 con 0x7f596c0cff50 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.938+0000 7f596bfff640 1 --2- 172.21.15.66:0/1394231600 >> v2:172.21.15.190:3300/0 conn(0x7f596c0cfb70 0x7f596c06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.939+0000 7f596b7fe640 1 --2- 172.21.15.66:0/1394231600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c06e290 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f596c164060 tx=0x7f596002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c63eb6b965c190f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.939+0000 7f596affd640 1 -- 172.21.15.66:0/1394231600 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960037070 con 0x7f596c0cff50 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.939+0000 7f596affd640 1 -- 172.21.15.66:0/1394231600 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5960032440 con 0x7f596c0cff50 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.939+0000 7f596affd640 1 -- 172.21.15.66:0/1394231600 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960032810 con 0x7f596c0cff50 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.939+0000 7f59725b6640 1 -- 172.21.15.66:0/1394231600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 msgr2=0x7f596c06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 --2- 172.21.15.66:0/1394231600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c06e290 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f596c164060 tx=0x7f596002a230 comp rx=0 tx=0).stop 2024-05-10T11:19:42.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 -- 172.21.15.66:0/1394231600 shutdown_connections 2024-05-10T11:19:42.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 --2- 172.21.15.66:0/1394231600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c06e290 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:42.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 --2- 172.21.15.66:0/1394231600 >> v2:172.21.15.190:3300/0 conn(0x7f596c0cfb70 0x7f596c06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:42.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 -- 172.21.15.66:0/1394231600 >> 172.21.15.66:0/1394231600 conn(0x7f596c0d2e50 msgr2=0x7f596c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:42.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 -- 172.21.15.66:0/1394231600 shutdown_connections 2024-05-10T11:19:42.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.940+0000 7f59725b6640 1 -- 172.21.15.66:0/1394231600 wait complete. 2024-05-10T11:19:42.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.941+0000 7f59725b6640 1 Processor -- start 2024-05-10T11:19:42.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.941+0000 7f59725b6640 1 -- start start 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f59725b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596c06d670 0x7f596c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f59725b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596c0cfb70 0x7f596c160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f59725b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c0b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f59725b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0d1340 con 0x7f596c0cff50 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f59725b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0d11c0 con 0x7f596c0cfb70 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f59725b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0d3970 con 0x7f596c06d670 2024-05-10T11:19:42.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c0b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c0b6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39352/0 (socket says 172.21.15.66:39352) 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 -- 172.21.15.66:0/949230084 learned_addr learned my addr 172.21.15.66:0/949230084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f596b7fe640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596c0cfb70 0x7f596c160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f596bfff640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596c06d670 0x7f596c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 -- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596c06d670 msgr2=0x7f596c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596c06d670 0x7f596c15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 -- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596c0cfb70 msgr2=0x7f596c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596c0cfb70 0x7f596c160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 -- 172.21.15.66:0/949230084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0b5ed0 con 0x7f596c0cff50 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f596b7fe640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596c0cfb70 0x7f596c160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f596bfff640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596c06d670 0x7f596c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.942+0000 7f5970b53640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c0b6c90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f596400c7b0 tx=0x7f596400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.943+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964017070 con 0x7f596c0cff50 2024-05-10T11:19:42.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.943+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964003da0 con 0x7f596c0cff50 2024-05-10T11:19:42.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.943+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c0b61b0 con 0x7f596c0cff50 2024-05-10T11:19:42.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.943+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640052b0 con 0x7f596c0cff50 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.943+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c0b6770 con 0x7f596c0cff50 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.944+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c0cef90 con 0x7f596c0cff50 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.945+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f596401a070 con 0x7f596c0cff50 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.945+0000 7f5968ff9640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59580762d0 0x7f5958078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.945+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f5964096e60 con 0x7f596c0cff50 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.945+0000 7f596bfff640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59580762d0 0x7f5958078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.946+0000 7f596bfff640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59580762d0 0x7f5958078790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f595c006fd0 tx=0x7f595c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:42.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:42.950+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f596c0cef90 con 0x7f596c0cff50 2024-05-10T11:19:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.179+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f596c0693f0 con 0x7f596c0cff50 2024-05-10T11:19:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.180+0000 7f5968ff9640 1 -- 172.21.15.66:0/949230084 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5187 (secure 0 0 0) 0x7f59640605a0 con 0x7f596c0cff50 2024-05-10T11:19:43.187 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:19:43.188 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:42.277004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7323,"qdb_cluster":[7323]},"id":6}]} 2024-05-10T11:19:43.188 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 76 2024-05-10T11:19:43.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59580762d0 msgr2=0x7f5958078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59580762d0 0x7f5958078790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f595c006fd0 tx=0x7f595c008040 comp rx=0 tx=0).stop 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 msgr2=0x7f596c0b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c0b6c90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f596400c7b0 tx=0x7f596400cc70 comp rx=0 tx=0).stop 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 shutdown_connections 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f59580762d0 0x7f5958078790 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f596c0cff50 0x7f596c0b6c90 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596c0cfb70 0x7f596c160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 --2- 172.21.15.66:0/949230084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596c06d670 0x7f596c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 >> 172.21.15.66:0/949230084 conn(0x7f596c0d2e50 msgr2=0x7f596c0b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 shutdown_connections 2024-05-10T11:19:43.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.182+0000 7f59725b6640 1 -- 172.21.15.66:0/949230084 wait complete. 2024-05-10T11:19:43.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:18:13.858815+0000', 'modified': '2024-05-10T11:19:42.277004+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7323': {'gid': 7323, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6835/821296830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 821296830}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 821296830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7323, 'qdb_cluster': [7323]} 2024-05-10T11:19:43.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:19:43.596 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T11:19:43.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.706+0000 7f4ac66e1640 1 Processor -- start 2024-05-10T11:19:43.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.706+0000 7f4ac66e1640 1 -- start start 2024-05-10T11:19:43.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4ac66e1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4ac00b8860 0x7f4ac006e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4ac66e1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac015fc90 con 0x7f4ac00d0230 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4ac66e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00b8c40 con 0x7f4ac00cfd80 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4ac66e1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac006ee50 con 0x7f4ac00b8860 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4abffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4ac00b8860 0x7f4ac006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4ab7fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4ac00d0230 0x7f4ac00cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52700/0 (socket says 172.21.15.66:52700) 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4ab7fff640 1 -- 172.21.15.66:0/469881016 learned_addr learned my addr 172.21.15.66:0/469881016 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4abffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4ac00b8860 0x7f4ac006e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39358/0 (socket says 172.21.15.66:39358) 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4abffff640 1 -- 172.21.15.66:0/469881016 >> v1:172.21.15.190:6789/0 conn(0x7f4ac00cfd80 legacy=0x7f4ac00ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4abffff640 1 -- 172.21.15.66:0/469881016 >> v1:172.21.15.66:6789/0 conn(0x7f4ac00d0230 legacy=0x7f4ac00cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4abf7fe640 1 -- 172.21.15.66:0/469881016 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513575123 0 0) 0x7f4ac015fc90 con 0x7f4ac00d0230 2024-05-10T11:19:43.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.707+0000 7f4abffff640 1 -- 172.21.15.66:0/469881016 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00cd570 con 0x7f4ac00b8860 2024-05-10T11:19:43.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.708+0000 7f4abffff640 1 --2- 172.21.15.66:0/469881016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00b8860 0x7f4ac006e520 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097a0 tx=0x7f4ab002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba195caec6001ed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.708+0000 7f4abf7fe640 1 -- 172.21.15.66:0/469881016 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0037070 con 0x7f4ac00b8860 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.708+0000 7f4abf7fe640 1 -- 172.21.15.66:0/469881016 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab002ae50 con 0x7f4ac00b8860 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.708+0000 7f4abf7fe640 1 -- 172.21.15.66:0/469881016 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0032660 con 0x7f4ac00b8860 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 -- 172.21.15.66:0/469881016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00b8860 msgr2=0x7f4ac006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/469881016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00b8860 0x7f4ac006e520 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097a0 tx=0x7f4ab002a140 comp rx=0 tx=0).stop 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 -- 172.21.15.66:0/469881016 shutdown_connections 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/469881016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00b8860 0x7f4ac006e520 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 -- 172.21.15.66:0/469881016 >> 172.21.15.66:0/469881016 conn(0x7f4ac00d2df0 msgr2=0x7f4ac00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 -- 172.21.15.66:0/469881016 shutdown_connections 2024-05-10T11:19:43.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.709+0000 7f4ac66e1640 1 -- 172.21.15.66:0/469881016 wait complete. 2024-05-10T11:19:43.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.710+0000 7f4ac66e1640 1 Processor -- start 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.710+0000 7f4ac66e1640 1 -- start start 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac66e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b8860 0x7f4ac00c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac66e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00cfd80 0x7f4ac00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac66e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 0x7f4ac00c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac66e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00cde10 con 0x7f4ac00d0230 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac66e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00cdb30 con 0x7f4ac00cfd80 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac66e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac006ea60 con 0x7f4ac00b8860 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 0x7f4ac00c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 0x7f4ac00c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39370/0 (socket says 172.21.15.66:39370) 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 -- 172.21.15.66:0/2097659711 learned_addr learned my addr 172.21.15.66:0/2097659711 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00cfd80 0x7f4ac00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4abffff640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b8860 0x7f4ac00c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 -- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b8860 msgr2=0x7f4ac00c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b8860 0x7f4ac00c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 -- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00cfd80 msgr2=0x7f4ac00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00cfd80 0x7f4ac00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 -- 172.21.15.66:0/2097659711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00c6f50 con 0x7f4ac00d0230 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.711+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 0x7f4ac00c91f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c780 tx=0x7f4ab800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.712+0000 7f4abd7fa640 1 -- 172.21.15.66:0/2097659711 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8017070 con 0x7f4ac00d0230 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.712+0000 7f4abd7fa640 1 -- 172.21.15.66:0/2097659711 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8003da0 con 0x7f4ac00d0230 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.712+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac00c7230 con 0x7f4ac00d0230 2024-05-10T11:19:43.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.712+0000 7f4abd7fa640 1 -- 172.21.15.66:0/2097659711 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80052b0 con 0x7f4ac00d0230 2024-05-10T11:19:43.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.712+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac01f8450 con 0x7f4ac00d0230 2024-05-10T11:19:43.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.713+0000 7f4abd7fa640 1 -- 172.21.15.66:0/2097659711 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4ab801a070 con 0x7f4ac00d0230 2024-05-10T11:19:43.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.714+0000 7f4abd7fa640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4aa00762d0 0x7f4aa0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.714+0000 7f4abd7fa640 1 -- 172.21.15.66:0/2097659711 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f4ab8096ea0 con 0x7f4ac00d0230 2024-05-10T11:19:43.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.714+0000 7f4abffff640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4aa00762d0 0x7f4aa0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 Processor -- start 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4abffff640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4aa00762d0 0x7f4aa0078790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0034000 tx=0x7f4ab002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 -- start start 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5ccd1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5ccd1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cca1bb0 0x564e5cca53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e5cc0b8d0 con 0x564e5cccf330 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564e5cbc4c10 con 0x564e5cca1bb0 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564e5cc07890 con 0x564e5cccef50 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5ccd1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5ccd1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39376/0 (socket says 172.21.15.66:39376) 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.715+0000 7f4ab7fff640 1 -- 172.21.15.66:0/2504302313 learned_addr learned my addr 172.21.15.66:0/2504302313 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:43.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cca1bb0 0x564e5cca53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4abffff640 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5ccd1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab7fff640 1 -- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 msgr2=0x564e5ccd1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5ccd1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab7fff640 1 -- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cca1bb0 msgr2=0x564e5cca53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cca1bb0 0x564e5cca53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab7fff640 1 -- 172.21.15.66:0/2504302313 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5cbcc5d0 con 0x564e5cccf330 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4abffff640 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5ccd1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5ccd1ca0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4ac015e100 tx=0x7f4aa8005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b596667573ea85eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab5ffb640 1 -- 172.21.15.66:0/2504302313 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8019070 con 0x564e5cccf330 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab5ffb640 1 -- 172.21.15.66:0/2504302313 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa80016d0 con 0x564e5cccf330 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ab5ffb640 1 -- 172.21.15.66:0/2504302313 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8001ac0 con 0x564e5cccf330 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ac9401740 1 -- 172.21.15.66:0/2504302313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 msgr2=0x564e5ccd1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.716+0000 7f4ac9401740 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5ccd1ca0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4ac015e100 tx=0x7f4aa8005bc0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 -- 172.21.15.66:0/2504302313 shutdown_connections 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cca1bb0 0x564e5cca53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5ccd1ca0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 --2- 172.21.15.66:0/2504302313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5ccd1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 -- 172.21.15.66:0/2504302313 >> 172.21.15.66:0/2504302313 conn(0x564e5cca3e20 msgr2=0x564e5ccec760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 -- 172.21.15.66:0/2504302313 shutdown_connections 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 -- 172.21.15.66:0/2504302313 wait complete. 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 -- start start 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.717+0000 7f4ac9401740 1 Processor -- start 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5cccb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5cccba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5ccedba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e5cca6fd0 con 0x564e5cccf330 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564e5cbc8760 con 0x564e5ccc5840 2024-05-10T11:19:43.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564e5cca72b0 con 0x564e5cccef50 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac9401740 10 client.0 _ll_register_callbacks cb 0x564e5cc01cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5cccba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5cccba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39388/0 (socket says 172.21.15.66:39388) 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ab7fff640 1 -- 172.21.15.66:0/3338263367 learned_addr learned my addr 172.21.15.66:0/3338263367 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5ccedba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4abffff640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5cccb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ab7fff640 1 -- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 msgr2=0x564e5cccb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.718+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5cccb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ab7fff640 1 -- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 msgr2=0x564e5ccedba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5ccedba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ab7fff640 1 -- 172.21.15.66:0/3338263367 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5c91d2d0 con 0x564e5cccf330 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5ccedba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5cccba70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x564e5cca94b0 tx=0x7f4aa8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc96c26ba91a6d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4a9effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4a9effd640 1 -- 172.21.15.66:0/3338263367 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8019040 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4a9effd640 1 -- 172.21.15.66:0/3338263367 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f4aa800f030 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa80016d0 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4a9effd640 1 -- 172.21.15.66:0/3338263367 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f4aa802a050 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 10 client.7398 fetch_fsmap learned FSMap version 76 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x564e5c9e76b0 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4a9effd640 1 -- 172.21.15.66:0/3338263367 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa80016d0 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4a9effd640 1 -- 172.21.15.66:0/3338263367 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7f4aa802d020 con 0x564e5cccf330 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 10 client.7398 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 10 client.7398 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 20 client.7398 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccee260 0x564e5ccc79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 4 client.7398 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.719+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e5cb8f760 con 0x564e5ccee260 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.720+0000 7f4abffff640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccee260 0x564e5ccc79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.720+0000 7f4a9effd640 10 client.7398 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.720+0000 7f4abffff640 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccee260 0x564e5ccc79d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2cdd8e565809561 server_cookie=f1e309e119b2c84a in_seq=0 out_seq=0 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.720+0000 7f4a9effd640 1 -- 172.21.15.66:0/3338263367 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564e5cb8f760 con 0x564e5ccee260 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.720+0000 7f4a9effd640 10 client.7398 handle_command_reply: tid=0 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 client.7398 shutdown 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 msgr2=0x564e5cccba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5cccba70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x564e5cca94b0 tx=0x7f4aa8000ed0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 shutdown_connections 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5ccedba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccf330 0x564e5cccba70 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccee260 0x564e5ccc79d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3338263367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccef50 0x564e5cccb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4a9effd640 0 client.7398 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 >> 172.21.15.66:0/3338263367 conn(0x564e5cca1bb0 msgr2=0x564e5ccce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 shutdown_connections 2024-05-10T11:19:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 1 -- 172.21.15.66:0/3338263367 wait complete. 2024-05-10T11:19:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.721+0000 7f4ac9401740 20 client.7398 trim_cache size 0 max 16384 2024-05-10T11:19:43.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.740+0000 7f4ac9401740 1 Processor -- start 2024-05-10T11:19:43.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.740+0000 7f4ac9401740 1 -- start start 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.740+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 0x564e5cccdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.740+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cccef50 0x564e5cd10620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.740+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cd10b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4ac9401740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac02011d0 con 0x564e5ccc5840 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac0200590 con 0x564e5cccef50 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac0200bb0 con 0x564e5cccf330 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 0x564e5cccdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 0x564e5cccdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39396/0 (socket says 172.21.15.66:39396) 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 -- 172.21.15.66:0/3423589228 learned_addr learned my addr 172.21.15.66:0/3423589228 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 -- 172.21.15.66:0/3423589228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 msgr2=0x564e5cd10b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cd10b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 -- 172.21.15.66:0/3423589228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cccef50 msgr2=0x564e5cd10620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cccef50 0x564e5cd10620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 -- 172.21.15.66:0/3423589228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5ccc5650 con 0x564e5ccc5840 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4abffff640 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 0x564e5cccdc00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4ab002a180 tx=0x7f4ab002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a39f62c9dd7767 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4ab57fa640 1 -- 172.21.15.66:0/3423589228 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0037040 con 0x564e5ccc5840 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4ab57fa640 1 -- 172.21.15.66:0/3423589228 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab0055070 con 0x564e5ccc5840 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.741+0000 7f4ab57fa640 1 -- 172.21.15.66:0/3423589228 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab003dbe0 con 0x564e5ccc5840 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 -- 172.21.15.66:0/3423589228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 msgr2=0x564e5cccdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 0x564e5cccdc00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4ab002a180 tx=0x7f4ab002c000 comp rx=0 tx=0).stop 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 -- 172.21.15.66:0/3423589228 shutdown_connections 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cd10b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5cccef50 0x564e5cd10620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 --2- 172.21.15.66:0/3423589228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5ccc5840 0x564e5cccdc00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 -- 172.21.15.66:0/3423589228 >> 172.21.15.66:0/3423589228 conn(0x564e5cca1bb0 msgr2=0x564e5ccce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 -- 172.21.15.66:0/3423589228 shutdown_connections 2024-05-10T11:19:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 -- 172.21.15.66:0/3423589228 wait complete. 2024-05-10T11:19:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.742+0000 7f4ac9401740 1 -- start start 2024-05-10T11:19:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 Processor -- start 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5cca2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 0x564e5cce23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cccdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e5ccee0e0 con 0x564e5cccef50 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564e5ccc8380 con 0x564e5ccc5840 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564e5ccee6d0 con 0x564e5cccf330 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ac9401740 10 client.0 _ll_register_callbacks cb 0x7f4aa8017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 0x564e5cce23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 0x564e5cce23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39402/0 (socket says 172.21.15.66:39402) 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.743+0000 7f4ab7fff640 1 -- 172.21.15.66:0/852868446 learned_addr learned my addr 172.21.15.66:0/852868446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cccdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4abffff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5cca2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ab7fff640 1 -- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 msgr2=0x564e5cccdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cccdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ab7fff640 1 -- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 msgr2=0x564e5cca2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5cca2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ab7fff640 1 -- 172.21.15.66:0/852868446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5ccc7cb0 con 0x564e5cccef50 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4abffff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5cca2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac4c7e640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cccdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ab7fff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 0x564e5cce23d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8005c00 tx=0x7f4aa8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff989cc6fa5dd10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4a9effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4a9effd640 1 -- 172.21.15.66:0/852868446 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8019070 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4a9effd640 1 -- 172.21.15.66:0/852868446 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f4aa800f040 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ab0055070 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4a9effd640 1 -- 172.21.15.66:0/852868446 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f4aa8007900 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 10 client.7404 fetch_fsmap learned FSMap version 76 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x564e5cca3230 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4a9effd640 1 -- 172.21.15.66:0/852868446 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab0055070 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4a9effd640 1 -- 172.21.15.66:0/852868446 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7f4aa802d040 con 0x564e5cccef50 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 10 client.7404 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 10 client.7404 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 20 client.7404 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.744+0000 7f4ac9401740 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccce120 0x564e5cceeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 4 client.7404 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:19:43.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "status"}) -- 0x564e5cc194e0 con 0x564e5ccce120 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4abffff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccce120 0x564e5cceeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4a9effd640 10 client.7404 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4abffff640 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccce120 0x564e5cceeab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75289e95a71b70 server_cookie=f65881c900032ded in_seq=0 out_seq=0 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4a9effd640 1 -- 172.21.15.66:0/852868446 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564e5cc194e0 con 0x564e5ccce120 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4a9effd640 10 client.7404 handle_command_reply: tid=0 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 client.7404 shutdown 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 msgr2=0x564e5cce23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 0x564e5cce23d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8005c00 tx=0x7f4aa8001080 comp rx=0 tx=0).stop 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 shutdown_connections 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x564e5ccce120 0x564e5cceeab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564e5cccf330 0x564e5cccdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e5cccef50 0x564e5cce23d0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 --2- 172.21.15.66:0/852868446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e5ccc5840 0x564e5cca2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4a9effd640 0 client.7404 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.745+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 >> 172.21.15.66:0/852868446 conn(0x564e5cca1bb0 msgr2=0x564e5cd10620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 shutdown_connections 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac9401740 1 -- 172.21.15.66:0/852868446 wait complete. 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac9401740 20 client.7404 trim_cache size 0 max 16384 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 7323, 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:19:43.752 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 4.4800816189999999, 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 76, 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 92, 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 92, 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 5.4503629360000003 2024-05-10T11:19:43.753 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4aa00762d0 msgr2=0x7f4aa0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4aa00762d0 0x7f4aa0078790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0034000 tx=0x7f4ab002e000 comp rx=0 tx=0).stop 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 msgr2=0x7f4ac00c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 0x7f4ac00c91f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c780 tx=0x7f4ab800cc40 comp rx=0 tx=0).stop 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 shutdown_connections 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4aa00762d0 0x7f4aa0078790 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ac00d0230 0x7f4ac00c91f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00cfd80 0x7f4ac00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 --2- 172.21.15.66:0/2097659711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b8860 0x7f4ac00c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 >> 172.21.15.66:0/2097659711 conn(0x7f4ac00d2df0 msgr2=0x7f4ac00cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 shutdown_connections 2024-05-10T11:19:43.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.746+0000 7f4ac66e1640 1 -- 172.21.15.66:0/2097659711 wait complete. 2024-05-10T11:19:43.757 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:19:43.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.862+0000 7faa9babd640 1 Processor -- start 2024-05-10T11:19:43.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.862+0000 7faa9babd640 1 -- start start 2024-05-10T11:19:43.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa9babd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faa940cf170 0x7faa9415f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa9babd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa940c74c0 con 0x7faa940cf5d0 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa9babd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa940c5d10 con 0x7faa9415b6d0 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa9babd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7faa940cc380 con 0x7faa940cf170 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa9a05a640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7faa940cf5d0 0x7faa9406dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52708/0 (socket says 172.21.15.66:52708) 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa9a05a640 1 -- 172.21.15.66:0/4245053021 learned_addr learned my addr 172.21.15.66:0/4245053021 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa99058640 1 --2- 172.21.15.66:0/4245053021 >> v2:172.21.15.190:3300/0 conn(0x7faa940cf170 0x7faa9415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659990955 0 0) 0x7faa940c74c0 con 0x7faa940cf5d0 2024-05-10T11:19:43.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.863+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa80003520 con 0x7faa940cf5d0 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 752545620 0 0) 0x7faa80003520 con 0x7faa940cf5d0 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 >> v2:172.21.15.190:3300/0 conn(0x7faa940cf170 msgr2=0x7faa9415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 --2- 172.21.15.66:0/4245053021 >> v2:172.21.15.190:3300/0 conn(0x7faa940cf170 0x7faa9415f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 >> v1:172.21.15.190:6789/0 conn(0x7faa9415b6d0 legacy=0x7faa940c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa940c5ff0 con 0x7faa940cf5d0 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7faa8c0019f0 con 0x7faa940cf5d0 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 >> v1:172.21.15.66:6789/0 conn(0x7faa940cf5d0 legacy=0x7faa9406dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa800039b0 0x7faa80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa80004800 0x7faa80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa800051c0 0x7faa8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa8000c040 con 0x7faa800051c0 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa8000c1f0 con 0x7faa80004800 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faa8000c3f0 con 0x7faa800039b0 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa9a05a640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa800051c0 0x7faa8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa99058640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa80004800 0x7faa80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa99859640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa800039b0 0x7faa80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa9a05a640 1 -- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa800039b0 msgr2=0x7faa80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa9a05a640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa800039b0 0x7faa80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa9a05a640 1 -- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa80004800 msgr2=0x7faa80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa9a05a640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa80004800 0x7faa80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.864+0000 7faa9a05a640 1 -- 172.21.15.66:0/4245053021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa80003520 con 0x7faa800051c0 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.865+0000 7faa9a05a640 1 -- 172.21.15.66:0/4245053021 reap_dead start 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.865+0000 7faa9a05a640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa800051c0 0x7faa8000b9c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00a850 tx=0x7faa80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b32b0288cd102f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.865+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00a4a0 con 0x7faa800051c0 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.865+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c02f070 con 0x7faa800051c0 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.865+0000 7faa98857640 1 -- 172.21.15.66:0/4245053021 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c02bce0 con 0x7faa800051c0 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 -- 172.21.15.66:0/4245053021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa800051c0 msgr2=0x7faa8000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa800051c0 0x7faa8000b9c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00a850 tx=0x7faa80005830 comp rx=0 tx=0).stop 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 -- 172.21.15.66:0/4245053021 shutdown_connections 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 --2- 172.21.15.66:0/4245053021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa800051c0 0x7faa8000b9c0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 -- 172.21.15.66:0/4245053021 >> 172.21.15.66:0/4245053021 conn(0x7faa940b2900 msgr2=0x7faa940b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:43.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 -- 172.21.15.66:0/4245053021 shutdown_connections 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.866+0000 7faa9babd640 1 -- 172.21.15.66:0/4245053021 wait complete. 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.867+0000 7faa9babd640 1 Processor -- start 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.867+0000 7faa9babd640 1 -- start start 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa800051c0 0x7faa941f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 0x7faa940af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa94157640 0x7faa94157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa940c6890 con 0x7faa940ca740 2024-05-10T11:19:43.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa940c65b0 con 0x7faa800051c0 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faa940cd170 con 0x7faa94157640 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 0x7faa940af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 0x7faa940af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39414/0 (socket says 172.21.15.66:39414) 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 -- 172.21.15.66:0/1206255449 learned_addr learned my addr 172.21.15.66:0/1206255449 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 -- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa94157640 msgr2=0x7faa94157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa94157640 0x7faa94157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 -- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa800051c0 msgr2=0x7faa941f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa800051c0 0x7faa941f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:43.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 -- 172.21.15.66:0/1206255449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa941f5590 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa99058640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 0x7faa940af5b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7faa840118e0 tx=0x7faa84011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8400fa90 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8400fc30 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941f5870 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.868+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84014440 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.869+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941f5e30 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.869+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9406a220 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.870+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa84012040 con 0x7faa940ca740 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.871+0000 7faa8a7fc640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa780762d0 0x7faa78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:43.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.871+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7faa84097f90 con 0x7faa940ca740 2024-05-10T11:19:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.871+0000 7faa99859640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa780762d0 0x7faa78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.871+0000 7faa99859640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa780762d0 0x7faa78078790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faa90000c00 tx=0x7faa90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:43.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:43.875+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7faa84019030 con 0x7faa940ca740 2024-05-10T11:19:44.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.112+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faa94073800 con 0x7faa940ca740 2024-05-10T11:19:44.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.112+0000 7faa8a7fc640 1 -- 172.21.15.66:0/1206255449 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7faa84061640 con 0x7faa940ca740 2024-05-10T11:19:44.111 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa780762d0 msgr2=0x7faa78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa780762d0 0x7faa78078790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faa90000c00 tx=0x7faa90009040 comp rx=0 tx=0).stop 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 msgr2=0x7faa940af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 0x7faa940af5b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7faa840118e0 tx=0x7faa84011da0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 shutdown_connections 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faa780762d0 0x7faa78078790 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa94157640 0x7faa94157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa940ca740 0x7faa940af5b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 --2- 172.21.15.66:0/1206255449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa800051c0 0x7faa941f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 >> 172.21.15.66:0/1206255449 conn(0x7faa940b2900 msgr2=0x7faa94158480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:44.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.114+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 shutdown_connections 2024-05-10T11:19:44.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.115+0000 7faa9babd640 1 -- 172.21.15.66:0/1206255449 wait complete. 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:19:44.125 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:19:44.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.126 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:19:44.144 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:19:44.144 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:19:44.144 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:19:44.144 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.144 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:19:44.144 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42309sec preferred_lft 42309sec 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:19:44.145 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:19:44.146 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:19:44.147 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:19:44.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.147 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:19:44.208 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:19:44.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.210 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:19:44.267 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:19:44.267 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:19:44.267 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:19:44.267 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:19:44.267 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:19:44.268 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:19:44.268 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:19:44.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:19:44.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:19:44.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:19:44.268 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:19:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:19:44.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:19:44.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.398 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:19:44.414 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:19:44.414 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:19:44.414 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:19:44.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:19:44.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:19:44.480 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:19:44.536 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:19:44.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:19:44.537 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:19:44.593 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:19:44.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.593 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:19:44.678 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:19:44.678 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:19:44.678 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:19:44.687 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:19:44.687 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:19:44.687 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:19:44.687 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:19:44.687 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:19:44.697 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:19:44.697 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:19:44.697 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:19:44.697 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:19:44.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:19:44.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:19:44.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:19:44.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:19:44.698 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:19:44.699 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:19:44.699 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:19:44.699 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:19:44.699 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:19:44.700 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:19:44.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:19:44.726 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:19:44.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:19:44.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:19:44.824 INFO:teuthology.orchestra.run.smithi066.stdout:client6502 2024-05-10T11:19:44.825 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:19:44.825 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:19:44.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:44.842 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-05-10T11:19:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.990+0000 7ff2e4a54640 1 Processor -- start 2024-05-10T11:19:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.990+0000 7ff2e4a54640 1 -- start start 2024-05-10T11:19:44.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2e4a54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 0x7ff2e00d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2e4a54640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2e01639a0 0x7ff2e0070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2e4a54640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e00d2510 con 0x7ff2e0071520 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2e4a54640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e0070220 con 0x7ff2e01639a0 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2e4a54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e0070500 con 0x7ff2e015f370 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2ded9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff2e0071520 0x7ff2e0162e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:60752/0 (socket says 172.21.15.66:60752) 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2ded9d640 1 -- 172.21.15.66:0/3223444155 learned_addr learned my addr 172.21.15.66:0/3223444155 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2de59c640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 0x7ff2e00d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.991+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/3223444155 >> v2:172.21.15.190:3300/0 conn(0x7ff2e01639a0 0x7ff2e0070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957416377 0 0) 0x7ff2e00d2510 con 0x7ff2e0071520 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c8003520 con 0x7ff2e0071520 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2386847269 0 0) 0x7ff2c8003520 con 0x7ff2e0071520 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 msgr2=0x7ff2e00d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 0x7ff2e00d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 >> v2:172.21.15.190:3300/0 conn(0x7ff2e01639a0 msgr2=0x7ff2e0070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 --2- 172.21.15.66:0/3223444155 >> v2:172.21.15.190:3300/0 conn(0x7ff2e01639a0 0x7ff2e0070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e00707e0 con 0x7ff2e0071520 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7ff2d80019f0 con 0x7ff2e0071520 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 >> v1:172.21.15.66:6789/0 conn(0x7ff2e0071520 legacy=0x7ff2e0162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 0x7ff2c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2c8003f30 0x7ff2c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8004d40 0x7ff2c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0070220 con 0x7ff2c8003f30 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0070500 con 0x7ff2c8004d40 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c800b9f0 con 0x7ff2e015f370 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2c8003f30 0x7ff2c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2de59c640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 0x7ff2c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8004d40 0x7ff2c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 msgr2=0x7ff2c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e015f370 0x7ff2c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8004d40 msgr2=0x7ff2c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8004d40 0x7ff2c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/3223444155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c8003520 con 0x7ff2c8003f30 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.992+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8004d40 0x7ff2c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.993+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2c8003f30 0x7ff2c8004800 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009ac0 tx=0x7ff2c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36929e1f4d4c8ee2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.993+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4036070 con 0x7ff2c8003f30 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.993+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4031400 con 0x7ff2c8003f30 2024-05-10T11:19:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.993+0000 7ff2dd59a640 1 -- 172.21.15.66:0/3223444155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4009690 con 0x7ff2c8003f30 2024-05-10T11:19:44.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2e4a54640 1 -- 172.21.15.66:0/3223444155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2c8003f30 msgr2=0x7ff2c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/3223444155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2c8003f30 0x7ff2c8004800 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009ac0 tx=0x7ff2c8005830 comp rx=0 tx=0).stop 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2ded9d640 1 -- 172.21.15.66:0/3223444155 reap_dead start 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2e4a54640 1 -- 172.21.15.66:0/3223444155 shutdown_connections 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2e4a54640 1 -- 172.21.15.66:0/3223444155 >> 172.21.15.66:0/3223444155 conn(0x7ff2e00d2e10 msgr2=0x7ff2e00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2e4a54640 1 -- 172.21.15.66:0/3223444155 shutdown_connections 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.994+0000 7ff2e4a54640 1 -- 172.21.15.66:0/3223444155 wait complete. 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.995+0000 7ff2e4a54640 1 Processor -- start 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.995+0000 7ff2e4a54640 1 -- start start 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2e4a54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8003f30 0x7ff2e01618c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2e4a54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 0x7ff2e00b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2e4a54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e00b0950 0x7ff2e015f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2e4a54640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0163690 con 0x7ff2e01586c0 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2e4a54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0163510 con 0x7ff2c8003f30 2024-05-10T11:19:44.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2e4a54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e00d1cc0 con 0x7ff2e00b0950 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 0x7ff2e00b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 0x7ff2e00b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36854/0 (socket says 172.21.15.66:36854) 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/743501207 learned_addr learned my addr 172.21.15.66:0/743501207 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2de59c640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8003f30 0x7ff2e01618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e00b0950 0x7ff2e015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e00b0950 msgr2=0x7ff2e015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e00b0950 0x7ff2e015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8003f30 msgr2=0x7ff2e01618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8003f30 0x7ff2e01618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/743501207 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e01e8d70 con 0x7ff2e01586c0 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2de59c640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8003f30 0x7ff2e01618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.996+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e00b0950 0x7ff2e015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:45.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.997+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 0x7ff2e00b0410 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4034040 tx=0x7ff2d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.997+0000 7ff2ceffd640 1 -- 172.21.15.66:0/743501207 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4040020 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.997+0000 7ff2ceffd640 1 -- 172.21.15.66:0/743501207 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4003c60 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.997+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e01e9050 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.997+0000 7ff2ceffd640 1 -- 172.21.15.66:0/743501207 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4036040 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.997+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e01e9610 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.999+0000 7ff2ceffd640 1 -- 172.21.15.66:0/743501207 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff2d4043020 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.999+0000 7ff2ceffd640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2c00762d0 0x7ff2c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.999+0000 7ff2ceffd640 1 -- 172.21.15.66:0/743501207 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff2d40b7a00 con 0x7ff2e01586c0 2024-05-10T11:19:45.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:44.999+0000 7ff2de59c640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2c00762d0 0x7ff2c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.000+0000 7ff2e776f740 1 Processor -- start 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.000+0000 7ff2e776f740 1 -- start start 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.000+0000 7ff2de59c640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2c00762d0 0x7ff2c0078790 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009ae0 tx=0x7ff2d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e84bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5eb46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb4c00 0x557fc5e89a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2e776f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557fc5dedcf0 con 0x557fc5ed2220 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557fc5da6e10 con 0x557fc5eb5340 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557fc5de9cb0 con 0x557fc5eb4c00 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e84bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e84bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36860/0 (socket says 172.21.15.66:36860) 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 -- 172.21.15.66:0/786077715 learned_addr learned my addr 172.21.15.66:0/786077715 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb4c00 0x557fc5e89a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 -- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb4c00 msgr2=0x557fc5e89a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb4c00 0x557fc5e89a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 -- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 msgr2=0x557fc5eb46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5eb46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 -- 172.21.15.66:0/786077715 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc5bc77e0 con 0x557fc5ed2220 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2de59c640 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e84bb0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0014e40 tx=0x7ff2d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dc6e74723e47c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2bffff640 1 -- 172.21.15.66:0/786077715 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0027070 con 0x557fc5ed2220 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2bffff640 1 -- 172.21.15.66:0/786077715 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0014e70 con 0x557fc5ed2220 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.001+0000 7ff2bffff640 1 -- 172.21.15.66:0/786077715 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0006bd0 con 0x557fc5ed2220 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 -- 172.21.15.66:0/786077715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 msgr2=0x557fc5e84bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e84bb0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0014e40 tx=0x7ff2d0017000 comp rx=0 tx=0).stop 2024-05-10T11:19:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 -- 172.21.15.66:0/786077715 shutdown_connections 2024-05-10T11:19:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb4c00 0x557fc5e89a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5eb46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 --2- 172.21.15.66:0/786077715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e84bb0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 -- 172.21.15.66:0/786077715 >> 172.21.15.66:0/786077715 conn(0x557fc5e86e20 msgr2=0x557fc5ecf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 -- 172.21.15.66:0/786077715 shutdown_connections 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.002+0000 7ff2e776f740 1 -- 172.21.15.66:0/786077715 wait complete. 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.003+0000 7ff2e776f740 1 -- start start 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.003+0000 7ff2e776f740 1 Processor -- start 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ee2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e8a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ea55d0 0x557fc5eb7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557fc5e88fd0 con 0x557fc5ed2220 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557fc5daa940 con 0x557fc5ea55d0 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557fc5e883c0 con 0x557fc5eb5340 2024-05-10T11:19:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 10 client.0 _ll_register_callbacks cb 0x557fc5dad440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e8a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e8a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36876/0 (socket says 172.21.15.66:36876) 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/622858987 learned_addr learned my addr 172.21.15.66:0/622858987 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2de59c640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ee2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ea55d0 0x557fc5eb7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 msgr2=0x557fc5ee2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ee2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ea55d0 msgr2=0x557fc5eb7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ea55d0 0x557fc5eb7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 -- 172.21.15.66:0/622858987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc5c27f70 con 0x557fc5ed2220 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e8a3d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4080740 tx=0x7ff2d4080550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c530abb2e807200 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/622858987 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4080a40 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/622858987 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff2d40872d0 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.004+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d0014e70 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/622858987 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff2d4084df0 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 10 client.7422 fetch_fsmap learned FSMap version 76 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x557fc5abf170 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/622858987 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0014e70 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/622858987 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7ff2d4089380 con 0x557fc5ed2220 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 10 client.7422 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 10 client.7422 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 20 client.7422 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5eb5830 0x557fc5eb5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 4 client.7422 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fc5dfb900 con 0x557fc5eb5830 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2de59c640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5eb5830 0x557fc5eb5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2de59c640 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5eb5830 0x557fc5eb5c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9f490334694911 server_cookie=c0e25a8e15c82d63 in_seq=0 out_seq=0 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.005+0000 7ff2bd7fa640 10 client.7422 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/622858987 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fc5dfb900 con 0x557fc5eb5830 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2bd7fa640 10 client.7422 handle_command_reply: tid=0 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 client.7422 shutdown 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 msgr2=0x557fc5e8a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e8a3d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4080740 tx=0x7ff2d4080550 comp rx=0 tx=0).stop 2024-05-10T11:19:45.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 shutdown_connections 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ea55d0 0x557fc5eb7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5e8a3d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5eb5830 0x557fc5eb5c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 --2- 172.21.15.66:0/622858987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ee2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 >> 172.21.15.66:0/622858987 conn(0x557fc5eb4c00 msgr2=0x557fc5ecf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2bd7fa640 0 client.7422 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 shutdown_connections 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 1 -- 172.21.15.66:0/622858987 wait complete. 2024-05-10T11:19:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.006+0000 7ff2e776f740 20 client.7422 trim_cache size 0 max 16384 2024-05-10T11:19:45.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.024+0000 7ff2e776f740 1 Processor -- start 2024-05-10T11:19:45.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 -- start start 2024-05-10T11:19:45.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 0x557fc5ecfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ef37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ed2220 0x557fc5e88500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0202860 con 0x557fc5ea55d0 2024-05-10T11:19:45.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e02018f0 con 0x557fc5ed2220 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e015a7b0 con 0x557fc5eb5340 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2de59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 0x557fc5ecfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2de59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 0x557fc5ecfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36882/0 (socket says 172.21.15.66:36882) 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.025+0000 7ff2de59c640 1 -- 172.21.15.66:0/2191668296 learned_addr learned my addr 172.21.15.66:0/2191668296 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2de59c640 1 -- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 msgr2=0x557fc5ef37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2de59c640 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ef37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ed2220 0x557fc5e88500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2de59c640 1 -- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ed2220 msgr2=0x557fc5e88500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2de59c640 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ed2220 0x557fc5e88500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2de59c640 1 -- 172.21.15.66:0/2191668296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc5ecf0a0 con 0x557fc5ea55d0 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2de59c640 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 0x557fc5ecfdf0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0014e10 tx=0x7ff2d001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14986da0f4296a51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2bf7fe640 1 -- 172.21.15.66:0/2191668296 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0027040 con 0x557fc5ea55d0 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2bf7fe640 1 -- 172.21.15.66:0/2191668296 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0039e50 con 0x557fc5ea55d0 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2bf7fe640 1 -- 172.21.15.66:0/2191668296 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0023a60 con 0x557fc5ea55d0 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2e776f740 1 -- 172.21.15.66:0/2191668296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 msgr2=0x557fc5ecfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.026+0000 7ff2e776f740 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 0x557fc5ecfdf0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0014e10 tx=0x7ff2d001b000 comp rx=0 tx=0).stop 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 -- 172.21.15.66:0/2191668296 shutdown_connections 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5ed2220 0x557fc5e88500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5eb5340 0x557fc5ef37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 --2- 172.21.15.66:0/2191668296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ea55d0 0x557fc5ecfdf0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 -- 172.21.15.66:0/2191668296 >> 172.21.15.66:0/2191668296 conn(0x557fc5eb4c00 msgr2=0x557fc5ea43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 -- 172.21.15.66:0/2191668296 shutdown_connections 2024-05-10T11:19:45.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 -- 172.21.15.66:0/2191668296 wait complete. 2024-05-10T11:19:45.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 -- start start 2024-05-10T11:19:45.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.027+0000 7ff2e776f740 1 Processor -- start 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5ea55d0 0x557fc5e88410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5e88950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5ec54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557fc5eb7520 con 0x557fc5ed2220 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e02012a0 con 0x557fc5eb5340 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557fc5eb7f40 con 0x557fc5ea55d0 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2e776f740 10 client.0 _ll_register_callbacks cb 0x7ff2d40097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2ded9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5ec54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2ded9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5ec54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36898/0 (socket says 172.21.15.66:36898) 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2ded9d640 1 -- 172.21.15.66:0/1453639182 learned_addr learned my addr 172.21.15.66:0/1453639182 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2ddd9b640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5e88950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.028+0000 7ff2de59c640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5ea55d0 0x557fc5e88410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2ded9d640 1 -- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5ea55d0 msgr2=0x557fc5e88410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5ea55d0 0x557fc5e88410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2ded9d640 1 -- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 msgr2=0x557fc5e88950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5e88950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2ded9d640 1 -- 172.21.15.66:0/1453639182 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc5eb5ff0 con 0x557fc5ed2220 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2ded9d640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5ec54a0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0072e30 tx=0x7ff2d8007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcf873eb0347092 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/1453639182 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8014b40 con 0x557fc5ed2220 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/1453639182 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff2d8014ce0 con 0x557fc5ed2220 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d0039e50 con 0x557fc5ed2220 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/1453639182 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff2d8024050 con 0x557fc5ed2220 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 10 client.7428 fetch_fsmap learned FSMap version 76 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x557fc5ec6640 con 0x557fc5ed2220 2024-05-10T11:19:45.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/1453639182 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0039e50 con 0x557fc5ed2220 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/1453639182 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7ff2d8027020 con 0x557fc5ed2220 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 10 client.7428 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 10 client.7428 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 20 client.7428 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5ed2ae0 0x557fc5ec59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 4 client.7428 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x557fc5df5770 con 0x557fc5ed2ae0 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.029+0000 7ff2de59c640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5ed2ae0 0x557fc5ec59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2bd7fa640 10 client.7428 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2de59c640 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5ed2ae0 0x557fc5ec59e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64bc9f7d2424c0b5 server_cookie=858d169acd5becb1 in_seq=0 out_seq=0 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2bd7fa640 1 -- 172.21.15.66:0/1453639182 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557fc5df5770 con 0x557fc5ed2ae0 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2bd7fa640 10 client.7428 handle_command_reply: tid=0 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2e776f740 1 client.7428 shutdown 2024-05-10T11:19:45.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 msgr2=0x557fc5ec54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.030+0000 7ff2e776f740 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5ec54a0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0072e30 tx=0x7ff2d8007b00 comp rx=0 tx=0).stop 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 shutdown_connections 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557fc5ed2220 0x557fc5ec54a0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fc5eb5340 0x557fc5e88950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x557fc5ed2ae0 0x557fc5ec59e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 --2- 172.21.15.66:0/1453639182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557fc5ea55d0 0x557fc5e88410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2bd7fa640 0 client.7428 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 >> 172.21.15.66:0/1453639182 conn(0x557fc5eb4c00 msgr2=0x557fc5ecfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 shutdown_connections 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 1 -- 172.21.15.66:0/1453639182 wait complete. 2024-05-10T11:19:45.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e776f740 20 client.7428 trim_cache size 0 max 16384 2024-05-10T11:19:45.037 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:45.037 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:19:45.037 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "e1ccaa4c-1f68-4b79-bcf9-61cd696f966b", 2024-05-10T11:19:45.037 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:19:45.037 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2c00762d0 msgr2=0x7ff2c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2c00762d0 0x7ff2c0078790 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009ae0 tx=0x7ff2d0008040 comp rx=0 tx=0).stop 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 msgr2=0x7ff2e00b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 0x7ff2e00b0410 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4034040 tx=0x7ff2d4004730 comp rx=0 tx=0).stop 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 shutdown_connections 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff2c00762d0 0x7ff2c0078790 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2e00b0950 0x7ff2e015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2e01586c0 0x7ff2e00b0410 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 --2- 172.21.15.66:0/743501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c8003f30 0x7ff2e01618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.031+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 >> 172.21.15.66:0/743501207 conn(0x7ff2e00d2e10 msgr2=0x7ff2e00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.032+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 shutdown_connections 2024-05-10T11:19:45.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.032+0000 7ff2e4a54640 1 -- 172.21.15.66:0/743501207 wait complete. 2024-05-10T11:19:45.039 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:19:45.032+0000 7f9b6a7dc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x5651dc87a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:19:45.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:19:45.042 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T11:19:45.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.150+0000 7fbb17472640 1 Processor -- start 2024-05-10T11:19:45.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.151+0000 7fbb17472640 1 -- start start 2024-05-10T11:19:45.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.151+0000 7fbb17472640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb1006f030 0x7fbb10160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.151+0000 7fbb17472640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbb100cf240 0x7fbb100cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.151+0000 7fbb17472640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1015cfb0 con 0x7fbb1006f410 2024-05-10T11:19:45.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.151+0000 7fbb17472640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbb100ccb60 con 0x7fbb1006f030 2024-05-10T11:19:45.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.151+0000 7fbb17472640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1015d290 con 0x7fbb100cf240 2024-05-10T11:19:45.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb1520e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb1006f030 0x7fbb10160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb14a0d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbb1006f410 0x7fbb1015c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:60754/0 (socket says 172.21.15.66:60754) 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb14a0d640 1 -- 172.21.15.66:0/380882806 learned_addr learned my addr 172.21.15.66:0/380882806 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/380882806 >> v2:172.21.15.190:3300/0 conn(0x7fbb100cf240 0x7fbb100cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb1520e640 1 -- 172.21.15.66:0/380882806 >> v2:172.21.15.190:3300/0 conn(0x7fbb100cf240 msgr2=0x7fbb100cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb1520e640 1 --2- 172.21.15.66:0/380882806 >> v2:172.21.15.190:3300/0 conn(0x7fbb100cf240 0x7fbb100cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb1520e640 1 -- 172.21.15.66:0/380882806 >> v1:172.21.15.66:6789/0 conn(0x7fbb1006f410 legacy=0x7fbb1015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb1520e640 1 -- 172.21.15.66:0/380882806 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1015fd30 con 0x7fbb1006f030 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.152+0000 7fbb03fff640 1 -- 172.21.15.66:0/380882806 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664181153 0 0) 0x7fbb1015cfb0 con 0x7fbb1006f410 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.153+0000 7fbb1520e640 1 --2- 172.21.15.66:0/380882806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f030 0x7fbb10160530 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbb10071ef0 tx=0x7fbb0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed1afee15a4fc3e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.153+0000 7fbb03fff640 1 -- 172.21.15.66:0/380882806 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c037070 con 0x7fbb1006f030 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.153+0000 7fbb03fff640 1 -- 172.21.15.66:0/380882806 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c032440 con 0x7fbb1006f030 2024-05-10T11:19:45.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.153+0000 7fbb03fff640 1 -- 172.21.15.66:0/380882806 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c032810 con 0x7fbb1006f030 2024-05-10T11:19:45.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.153+0000 7fbb17472640 1 -- 172.21.15.66:0/380882806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f030 msgr2=0x7fbb10160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.153+0000 7fbb17472640 1 --2- 172.21.15.66:0/380882806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f030 0x7fbb10160530 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbb10071ef0 tx=0x7fbb0c02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.154+0000 7fbb17472640 1 -- 172.21.15.66:0/380882806 shutdown_connections 2024-05-10T11:19:45.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.154+0000 7fbb17472640 1 --2- 172.21.15.66:0/380882806 >> v2:172.21.15.190:3300/0 conn(0x7fbb100cf240 0x7fbb100cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.154+0000 7fbb17472640 1 --2- 172.21.15.66:0/380882806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f030 0x7fbb10160530 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.154+0000 7fbb17472640 1 -- 172.21.15.66:0/380882806 >> 172.21.15.66:0/380882806 conn(0x7fbb100d0c90 msgr2=0x7fbb100d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.154+0000 7fbb17472640 1 -- 172.21.15.66:0/380882806 shutdown_connections 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.154+0000 7fbb17472640 1 -- 172.21.15.66:0/380882806 wait complete. 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.155+0000 7fbb17472640 1 Processor -- start 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.155+0000 7fbb17472640 1 -- start start 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb1006f030 0x7fbb100c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 0x7fbb1015e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb100cf240 0x7fbb1015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb100cb910 con 0x7fbb1006f410 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1015fa40 con 0x7fbb100cf240 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb10159d70 con 0x7fbb1006f030 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 0x7fbb1015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 0x7fbb1015e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36924/0 (socket says 172.21.15.66:36924) 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 -- 172.21.15.66:0/1268245901 learned_addr learned my addr 172.21.15.66:0/1268245901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb1520e640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb1006f030 0x7fbb100c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb100cf240 0x7fbb1015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 -- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb1006f030 msgr2=0x7fbb100c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb1006f030 0x7fbb100c3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 -- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb100cf240 msgr2=0x7fbb1015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb100cf240 0x7fbb1015ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 -- 172.21.15.66:0/1268245901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb100b5bf0 con 0x7fbb1006f410 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 0x7fbb1015e780 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c4d0 tx=0x7fbb0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb01ffb640 1 -- 172.21.15.66:0/1268245901 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04018070 con 0x7fbb1006f410 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb01ffb640 1 -- 172.21.15.66:0/1268245901 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04007500 con 0x7fbb1006f410 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb100b5ed0 con 0x7fbb1006f410 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.156+0000 7fbb01ffb640 1 -- 172.21.15.66:0/1268245901 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04004a20 con 0x7fbb1006f410 2024-05-10T11:19:45.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.157+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb100b6490 con 0x7fbb1006f410 2024-05-10T11:19:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.158+0000 7fbb01ffb640 1 -- 172.21.15.66:0/1268245901 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb0401b070 con 0x7fbb1006f410 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.159+0000 7fbb01ffb640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbaf40762d0 0x7fbaf4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.159+0000 7fbb01ffb640 1 -- 172.21.15.66:0/1268245901 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fbb04096c40 con 0x7fbb1006f410 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.159+0000 7fbb1520e640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbaf40762d0 0x7fbaf4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.160+0000 7fbb1a194740 1 Processor -- start 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.160+0000 7fbb1520e640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbaf40762d0 0x7fbaf4078790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c034000 tx=0x7fbb0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.160+0000 7fbb1a194740 1 -- start start 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596df1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e21600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 0x55e596df6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1a194740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e596dbe690 con 0x55e596e21b40 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e596d5bf30 con 0x55e596e3f160 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e596d14b20 con 0x55e596e22280 2024-05-10T11:19:45.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 0x55e596df6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 0x55e596df6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36940/0 (socket says 172.21.15.66:36940) 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 -- 172.21.15.66:0/785393454 learned_addr learned my addr 172.21.15.66:0/785393454 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1520e640 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596df1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 -- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 msgr2=0x55e596e21600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e21600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 -- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 msgr2=0x55e596df1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596df1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 -- 172.21.15.66:0/785393454 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e596d0ce60 con 0x55e596e21b40 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb1520e640 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596df1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 0x55e596df6950 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fbb08007360 tx=0x7fbb08007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1514f903d3b68e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.161+0000 7fbafaffd640 1 -- 172.21.15.66:0/785393454 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb080147e0 con 0x55e596e21b40 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbafaffd640 1 -- 172.21.15.66:0/785393454 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0801a070 con 0x55e596e21b40 2024-05-10T11:19:45.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbafaffd640 1 -- 172.21.15.66:0/785393454 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08014b80 con 0x55e596e21b40 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 -- 172.21.15.66:0/785393454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 msgr2=0x55e596df6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 0x55e596df6950 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fbb08007360 tx=0x7fbb08007820 comp rx=0 tx=0).stop 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 -- 172.21.15.66:0/785393454 shutdown_connections 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e21b40 0x55e596df6950 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e21600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 --2- 172.21.15.66:0/785393454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596df1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 -- 172.21.15.66:0/785393454 >> 172.21.15.66:0/785393454 conn(0x55e596df3d60 msgr2=0x55e596e3c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 -- 172.21.15.66:0/785393454 shutdown_connections 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.162+0000 7fbb1a194740 1 -- 172.21.15.66:0/785393454 wait complete. 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.163+0000 7fbb1a194740 1 -- start start 2024-05-10T11:19:45.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.163+0000 7fbb1a194740 1 Processor -- start 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e231c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 0x55e596e3d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e596d185e0 con 0x55e596e0b6e0 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e596d57ef0 con 0x55e596e3f160 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e596df5f10 con 0x55e596e22280 2024-05-10T11:19:45.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1a194740 10 client.0 _ll_register_callbacks cb 0x55e596d13320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:45.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 0x55e596e3d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 0x55e596e3d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36944/0 (socket says 172.21.15.66:36944) 2024-05-10T11:19:45.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 -- 172.21.15.66:0/2751067218 learned_addr learned my addr 172.21.15.66:0/2751067218 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb1520e640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 -- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 msgr2=0x55e596e3c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 -- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 msgr2=0x55e596e231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.164+0000 7fbb15a0f640 1 -- 172.21.15.66:0/2751067218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e596b377d0 con 0x55e596e0b6e0 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 0x55e596e3d7a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fbb08017040 tx=0x7fbb08004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2a865a510cdde2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbaeffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbaeffff640 1 -- 172.21.15.66:0/2751067218 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08015470 con 0x55e596e0b6e0 2024-05-10T11:19:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbaeffff640 1 -- 172.21.15.66:0/2751067218 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fbb08015610 con 0x55e596e0b6e0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb0801a070 con 0x55e596e0b6e0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbaeffff640 1 -- 172.21.15.66:0/2751067218 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fbb08015810 con 0x55e596e0b6e0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 10 client.7443 fetch_fsmap learned FSMap version 76 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x55e596a6d3f0 con 0x55e596e0b6e0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbaeffff640 1 -- 172.21.15.66:0/2751067218 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0801a070 con 0x55e596e0b6e0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbaeffff640 1 -- 172.21.15.66:0/2751067218 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7fbb080159b0 con 0x55e596e0b6e0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 10 client.7443 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 10 client.7443 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 20 client.7443 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e3b6d0 0x55e596e0dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 4 client.7443 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e596d69b40 con 0x55e596e3b6d0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.165+0000 7fbb1520e640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e3b6d0 0x55e596e0dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbb1520e640 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e3b6d0 0x55e596e0dc60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1485ea8875b9fba9 server_cookie=fa5c8f2dbc0c0f2 in_seq=0 out_seq=0 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbaeffff640 10 client.7443 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbaeffff640 1 -- 172.21.15.66:0/2751067218 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e596d69b40 con 0x55e596e3b6d0 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbaeffff640 10 client.7443 handle_command_reply: tid=0 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbb1a194740 1 client.7443 shutdown 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 msgr2=0x55e596e3d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.166+0000 7fbb1a194740 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 0x55e596e3d7a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fbb08017040 tx=0x7fbb08004ab0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 shutdown_connections 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e0b6e0 0x55e596e3d7a0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e3b6d0 0x55e596e0dc60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 --2- 172.21.15.66:0/2751067218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbaeffff640 0 client.7443 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 >> 172.21.15.66:0/2751067218 conn(0x55e596e21b40 msgr2=0x55e596df1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 shutdown_connections 2024-05-10T11:19:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 1 -- 172.21.15.66:0/2751067218 wait complete. 2024-05-10T11:19:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.167+0000 7fbb1a194740 20 client.7443 trim_cache size 0 max 16384 2024-05-10T11:19:45.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.185+0000 7fbb1a194740 1 Processor -- start 2024-05-10T11:19:45.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.185+0000 7fbb1a194740 1 -- start start 2024-05-10T11:19:45.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 0x55e596df7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e3f160 0x55e596e3a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596df2830 0x55e596e3a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1a194740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101ffdf0 con 0x55e596e22280 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101fedd0 con 0x55e596df2830 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1006ec20 con 0x55e596e3f160 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 0x55e596df7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 0x55e596df7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36946/0 (socket says 172.21.15.66:36946) 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 -- 172.21.15.66:0/1903805778 learned_addr learned my addr 172.21.15.66:0/1903805778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596df2830 0x55e596e3a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e3f160 0x55e596e3a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 -- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e3f160 msgr2=0x55e596e3a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e3f160 0x55e596e3a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 -- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596df2830 msgr2=0x55e596e3a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596df2830 0x55e596e3a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 -- 172.21.15.66:0/1903805778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e596a2d0f0 con 0x55e596e22280 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.186+0000 7fbb1520e640 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 0x55e596df7590 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c035040 tx=0x7fbb0c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29937ac87ca21c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbafa7fc640 1 -- 172.21.15.66:0/1903805778 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c055070 con 0x55e596e22280 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbafa7fc640 1 -- 172.21.15.66:0/1903805778 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c03e720 con 0x55e596e22280 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbafa7fc640 1 -- 172.21.15.66:0/1903805778 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c037040 con 0x55e596e22280 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 -- 172.21.15.66:0/1903805778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 msgr2=0x55e596df7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 0x55e596df7590 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c035040 tx=0x7fbb0c02c000 comp rx=0 tx=0).stop 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 -- 172.21.15.66:0/1903805778 shutdown_connections 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596df2830 0x55e596e3a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e3f160 0x55e596e3a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 --2- 172.21.15.66:0/1903805778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596e22280 0x55e596df7590 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 -- 172.21.15.66:0/1903805778 >> 172.21.15.66:0/1903805778 conn(0x55e596e21b40 msgr2=0x55e596e240a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 -- 172.21.15.66:0/1903805778 shutdown_connections 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.187+0000 7fbb1a194740 1 -- 172.21.15.66:0/1903805778 wait complete. 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.188+0000 7fbb1a194740 1 -- start start 2024-05-10T11:19:45.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.188+0000 7fbb1a194740 1 Processor -- start 2024-05-10T11:19:45.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 0x55e596eb9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e596e21340 con 0x55e596df2830 2024-05-10T11:19:45.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101fe700 con 0x55e596e3f160 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e596d5e460 con 0x55e596e22280 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1a194740 10 client.0 _ll_register_callbacks cb 0x7fbb08009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1520e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 0x55e596eb9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1520e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 0x55e596eb9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36948/0 (socket says 172.21.15.66:36948) 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1520e640 1 -- 172.21.15.66:0/978488482 learned_addr learned my addr 172.21.15.66:0/978488482 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1520e640 1 -- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 msgr2=0x55e596e3a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.189+0000 7fbb1520e640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1520e640 1 -- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 msgr2=0x55e596e3a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1520e640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e3a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1520e640 1 -- 172.21.15.66:0/978488482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e596e3fad0 con 0x55e596df2830 2024-05-10T11:19:45.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb15a0f640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1520e640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 0x55e596eb9220 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c02a1e0 tx=0x7fbb0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845de3814e91199b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbaeffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbaeffff640 1 -- 172.21.15.66:0/978488482 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c055030 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb0c03e720 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbaeffff640 1 -- 172.21.15.66:0/978488482 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fbb0c03e8d0 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbaeffff640 1 -- 172.21.15.66:0/978488482 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fbb0c05e050 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 10 client.7449 fetch_fsmap learned FSMap version 76 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x55e596e1cfa0 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbaeffff640 1 -- 172.21.15.66:0/978488482 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c03e720 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbaeffff640 1 -- 172.21.15.66:0/978488482 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7fbb0c061020 con 0x55e596df2830 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 10 client.7449 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 10 client.7449 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 20 client.7449 populate_metadata read hostname 'smithi066' 2024-05-10T11:19:45.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.190+0000 7fbb1a194740 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e1e2b0 0x55e596df09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 4 client.7449 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e596d639b0 con 0x55e596e1e2b0 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e1e2b0 0x55e596df09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbaeffff640 10 client.7449 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb14a0d640 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e1e2b0 0x55e596df09a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73e6c477173f6e87 server_cookie=286e3b43983158c8 in_seq=0 out_seq=0 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbaeffff640 1 -- 172.21.15.66:0/978488482 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x55e596d639b0 con 0x55e596e1e2b0 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbaeffff640 10 client.7449 handle_command_reply: tid=0 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 client.7449 shutdown 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 msgr2=0x55e596eb9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 0x55e596eb9220 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c02a1e0 tx=0x7fbb0c004730 comp rx=0 tx=0).stop 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 shutdown_connections 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e596e3f160 0x55e596e3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x55e596e1e2b0 0x55e596df09a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.191+0000 7fbb1a194740 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e596e22280 0x55e596e3a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbaeffff640 0 client.7449 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb1a194740 1 --2- 172.21.15.66:0/978488482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e596df2830 0x55e596eb9220 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 >> 172.21.15.66:0/978488482 conn(0x55e596e21b40 msgr2=0x55e596e3c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 shutdown_connections 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb1a194740 1 -- 172.21.15.66:0/978488482 wait complete. 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb1a194740 20 client.7449 trim_cache size 0 max 16384 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:19:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "e1ccaa4c-1f68-4b79-bcf9-61cd696f966b": { 2024-05-10T11:19:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/dir", 2024-05-10T11:19:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "e1ccaa4c-1f68-4b79-bcf9-61cd696f966b", 2024-05-10T11:19:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair" 2024-05-10T11:19:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:19:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:19:45.198 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbaf40762d0 msgr2=0x7fbaf4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb17472640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbaf40762d0 0x7fbaf4078790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c034000 tx=0x7fbb0c02e000 comp rx=0 tx=0).stop 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 msgr2=0x7fbb1015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.192+0000 7fbb17472640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 0x7fbb1015e780 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c4d0 tx=0x7fbb0400c990 comp rx=0 tx=0).stop 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 shutdown_connections 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbaf40762d0 0x7fbaf4078790 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb100cf240 0x7fbb1015ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1006f410 0x7fbb1015e780 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 --2- 172.21.15.66:0/1268245901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb1006f030 0x7fbb100c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 >> 172.21.15.66:0/1268245901 conn(0x7fbb100d0c90 msgr2=0x7fbb1015d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 shutdown_connections 2024-05-10T11:19:45.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:19:45.193+0000 7fbb17472640 1 -- 172.21.15.66:0/1268245901 wait complete. 2024-05-10T11:19:45.207 INFO:tasks.cephfs.filesystem:scrub status for tag:e1ccaa4c-1f68-4b79-bcf9-61cd696f966b - {'path': '/dir', 'tag': 'e1ccaa4c-1f68-4b79-bcf9-61cd696f966b', 'options': 'recursive,repair'} 2024-05-10T11:19:45.265 INFO:tasks.ceph.mds.a.smithi066.stderr:2024-05-10T11:19:45.266+0000 7f9b6e7e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:20:02.758 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:20:02.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:20:15.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:15.209 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T11:20:15.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.330+0000 7ff9e139d640 1 Processor -- start 2024-05-10T11:20:15.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.330+0000 7ff9e139d640 1 -- start start 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9e139d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 0x7ff9dc0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9e139d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9dc0cf3d0 con 0x7ff9dc159340 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9e139d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9dc0cf6b0 con 0x7ff9dc06e3b0 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9e139d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc0cbf20 con 0x7ff9dc0cb580 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9daffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff9dc159340 0x7ff9dc0ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37770/0 (socket says 172.21.15.66:37770) 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9daffd640 1 -- 172.21.15.66:0/1467441208 learned_addr learned my addr 172.21.15.66:0/1467441208 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 0x7ff9dc0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324155652 0 0) 0x7ff9dc0cf3d0 con 0x7ff9dc159340 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c4003520 con 0x7ff9dc159340 2024-05-10T11:20:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837677145 0 0) 0x7ff9dc0cf6b0 con 0x7ff9dc06e3b0 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9dc0cf3d0 con 0x7ff9dc06e3b0 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2334951254 0 0) 0x7ff9c4003520 con 0x7ff9dc159340 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 msgr2=0x7ff9dc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 0x7ff9dc0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 >> v1:172.21.15.190:6789/0 conn(0x7ff9dc06e3b0 legacy=0x7ff9dc06e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc0cf990 con 0x7ff9dc159340 2024-05-10T11:20:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.331+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7ff9cc001670 con 0x7ff9dc159340 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 >> v1:172.21.15.66:6789/0 conn(0x7ff9dc159340 legacy=0x7ff9dc0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9c4003b70 0x7ff9c4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9c4004800 0x7ff9c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 0x7ff9c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c400ba70 con 0x7ff9c4003b70 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c400bbf0 con 0x7ff9c4004800 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c400bdf0 con 0x7ff9dc0cb580 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9daffd640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9c4003b70 0x7ff9c4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9c4004800 0x7ff9c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 0x7ff9c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9daffd640 1 -- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 msgr2=0x7ff9c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9daffd640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9dc0cb580 0x7ff9c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9daffd640 1 -- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9c4004800 msgr2=0x7ff9c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9daffd640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9c4004800 0x7ff9c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.332+0000 7ff9daffd640 1 -- 172.21.15.66:0/1467441208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c4003520 con 0x7ff9c4003b70 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.333+0000 7ff9daffd640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9c4003b70 0x7ff9c4003f70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c0e0 tx=0x7ff9c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a3a32b05cf8ac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.333+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc007c40 con 0x7ff9c4003b70 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.333+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc005ad0 con 0x7ff9c4003b70 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.333+0000 7ff9d9ffb640 1 -- 172.21.15.66:0/1467441208 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc007070 con 0x7ff9c4003b70 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9e139d640 1 -- 172.21.15.66:0/1467441208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9c4003b70 msgr2=0x7ff9c4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9e139d640 1 --2- 172.21.15.66:0/1467441208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9c4003b70 0x7ff9c4003f70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c0e0 tx=0x7ff9c4005830 comp rx=0 tx=0).stop 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9db7fe640 1 -- 172.21.15.66:0/1467441208 reap_dead start 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9e139d640 1 -- 172.21.15.66:0/1467441208 shutdown_connections 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9e139d640 1 -- 172.21.15.66:0/1467441208 >> 172.21.15.66:0/1467441208 conn(0x7ff9dc0d0c90 msgr2=0x7ff9dc0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9e139d640 1 -- 172.21.15.66:0/1467441208 shutdown_connections 2024-05-10T11:20:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.334+0000 7ff9e139d640 1 -- 172.21.15.66:0/1467441208 wait complete. 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.335+0000 7ff9e139d640 1 Processor -- start 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.335+0000 7ff9e139d640 1 -- start start 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9e139d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9c4003b70 0x7ff9dc06c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9e139d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 0x7ff9dc15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9e139d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9dc0c47c0 0x7ff9dc0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9e139d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc06df20 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9e139d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc159720 con 0x7ff9dc0c47c0 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9e139d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc15bfd0 con 0x7ff9c4003b70 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 0x7ff9dc15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 0x7ff9dc15b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37840/0 (socket says 172.21.15.66:37840) 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 -- 172.21.15.66:0/2412191130 learned_addr learned my addr 172.21.15.66:0/2412191130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9daffd640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9c4003b70 0x7ff9dc06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9dc0c47c0 0x7ff9dc0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 -- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9c4003b70 msgr2=0x7ff9dc06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9c4003b70 0x7ff9dc06c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 -- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9dc0c47c0 msgr2=0x7ff9dc0c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9dc0c47c0 0x7ff9dc0c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.336+0000 7ff9da7fc640 1 -- 172.21.15.66:0/2412191130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc072890 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.337+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 0x7ff9dc15b550 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0011990 tx=0x7ff9d0011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.337+0000 7ff9c37fe640 1 -- 172.21.15.66:0/2412191130 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000fa70 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.337+0000 7ff9c37fe640 1 -- 172.21.15.66:0/2412191130 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d000fc10 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.337+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9dc0b5d10 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.337+0000 7ff9c37fe640 1 -- 172.21.15.66:0/2412191130 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0014440 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.337+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9dc0b62d0 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.339+0000 7ff9c37fe640 1 -- 172.21.15.66:0/2412191130 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9d0012040 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.339+0000 7ff9c37fe640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9c8076300 0x7ff9c80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.339+0000 7ff9c37fe640 1 -- 172.21.15.66:0/2412191130 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff9d0097bf0 con 0x7ff9dc15b0f0 2024-05-10T11:20:15.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.339+0000 7ff9daffd640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9c8076300 0x7ff9c80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.340+0000 7ff9e4193740 1 Processor -- start 2024-05-10T11:20:15.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.340+0000 7ff9daffd640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9c8076300 0x7ff9c80787c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc032000 tx=0x7ff9cc02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.340+0000 7ff9e4193740 1 -- start start 2024-05-10T11:20:15.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7d8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 0x5584eb7ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9e4193740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5584eb775690 con 0x5584eb7d8b40 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5584eb712f30 con 0x5584eb7f6160 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5584eb6cbb20 con 0x5584eb7d9280 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 0x5584eb7ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 0x5584eb7ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37854/0 (socket says 172.21.15.66:37854) 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 -- 172.21.15.66:0/2009419596 learned_addr learned my addr 172.21.15.66:0/2009419596 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7d8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9daffd640 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 -- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 msgr2=0x5584eb7d8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7d8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 -- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 msgr2=0x5584eb7a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 -- 172.21.15.66:0/2009419596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584eb6c3e60 con 0x5584eb7d8b40 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.341+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 0x5584eb7ad950 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4001ef0 tx=0x7ff9d4012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ddf8d5b67fe3a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9c0ff9640 1 -- 172.21.15.66:0/2009419596 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d401a030 con 0x5584eb7d8b40 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9c0ff9640 1 -- 172.21.15.66:0/2009419596 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4006b50 con 0x5584eb7d8b40 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9c0ff9640 1 -- 172.21.15.66:0/2009419596 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4006d00 con 0x5584eb7d8b40 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 -- 172.21.15.66:0/2009419596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 msgr2=0x5584eb7ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 0x5584eb7ad950 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4001ef0 tx=0x7ff9d4012690 comp rx=0 tx=0).stop 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 -- 172.21.15.66:0/2009419596 shutdown_connections 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d8b40 0x5584eb7ad950 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7d8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 --2- 172.21.15.66:0/2009419596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 -- 172.21.15.66:0/2009419596 >> 172.21.15.66:0/2009419596 conn(0x5584eb7aad60 msgr2=0x5584eb7f3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 -- 172.21.15.66:0/2009419596 shutdown_connections 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.342+0000 7ff9e4193740 1 -- 172.21.15.66:0/2009419596 wait complete. 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.343+0000 7ff9e4193740 1 -- start start 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.343+0000 7ff9e4193740 1 Processor -- start 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7effc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb8075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7d9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5584eb6cf5e0 con 0x5584eb7d9280 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5584eb70eef0 con 0x5584eb7d3c30 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5584eb7acf10 con 0x5584eb7f6160 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9e4193740 10 client.0 _ll_register_callbacks cb 0x5584eb6ca320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7effc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37868/0 (socket says 172.21.15.66:37868) 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 -- 172.21.15.66:0/4233455302 learned_addr learned my addr 172.21.15.66:0/4233455302 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb8075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7d9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 -- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 msgr2=0x5584eb8075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb8075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 -- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 msgr2=0x5584eb7d9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7d9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9daffd640 1 -- 172.21.15.66:0/4233455302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584eb4ee7d0 con 0x5584eb7d9280 2024-05-10T11:20:15.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7d9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.344+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb8075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9daffd640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7effc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c200 tx=0x7ff9cc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2581a179ad1a8364 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4233455302 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc043040 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4233455302 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff9cc004c70 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d4006b50 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4233455302 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff9cc037070 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 10 client.7461 fetch_fsmap learned FSMap version 76 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5584eb4243f0 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4233455302 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4006b50 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4233455302 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7ff9cc049050 con 0x5584eb7d9280 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 10 client.7461 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 10 client.7461 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:20:15.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 20 client.7461 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7ad8f0 0x5584eb7add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 4 client.7461 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.345+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584eb720b40 con 0x5584eb7ad8f0 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.346+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7ad8f0 0x5584eb7add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.346+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7ad8f0 0x5584eb7add60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2f820ae1489b49 server_cookie=81c673b1109354d3 in_seq=0 out_seq=0 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.346+0000 7ff9b9ffb640 10 client.7461 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.346+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4233455302 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5584eb720b40 con 0x5584eb7ad8f0 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.346+0000 7ff9b9ffb640 10 client.7461 handle_command_reply: tid=0 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.346+0000 7ff9e4193740 1 client.7461 shutdown 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 msgr2=0x5584eb7effc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7effc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c200 tx=0x7ff9cc02c000 comp rx=0 tx=0).stop 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 shutdown_connections 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7d9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7ad8f0 0x5584eb7add60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb8075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4233455302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7effc0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9b9ffb640 0 client.7461 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 >> 172.21.15.66:0/4233455302 conn(0x5584eb7d8b40 msgr2=0x5584eb7a8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 shutdown_connections 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 1 -- 172.21.15.66:0/4233455302 wait complete. 2024-05-10T11:20:15.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.347+0000 7ff9e4193740 20 client.7461 trim_cache size 0 max 16384 2024-05-10T11:20:15.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.365+0000 7ff9e4193740 1 Processor -- start 2024-05-10T11:20:15.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 -- start start 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb7da240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc2027f0 con 0x5584eb7d9280 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc2017f0 con 0x5584eb7d3c30 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc200c20 con 0x5584eb7f6160 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9da7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9da7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7ef0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37884/0 (socket says 172.21.15.66:37884) 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.366+0000 7ff9da7fc640 1 -- 172.21.15.66:0/427705156 learned_addr learned my addr 172.21.15.66:0/427705156 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9daffd640 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9da7fc640 1 -- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 msgr2=0x5584eb7da240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb7da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb7da240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9da7fc640 1 -- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 msgr2=0x5584eb7dc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7dc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9da7fc640 1 -- 172.21.15.66:0/427705156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584eb7d9ae0 con 0x5584eb7d9280 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7ef0c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000f610 tx=0x7ff9d0006aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578fc94d63943951 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9bbfff640 1 -- 172.21.15.66:0/427705156 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0067040 con 0x5584eb7d9280 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9bbfff640 1 -- 172.21.15.66:0/427705156 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0060ce0 con 0x5584eb7d9280 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.367+0000 7ff9bbfff640 1 -- 172.21.15.66:0/427705156 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0064fe0 con 0x5584eb7d9280 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 -- 172.21.15.66:0/427705156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 msgr2=0x5584eb7ef0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7ef0c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000f610 tx=0x7ff9d0006aa0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 -- 172.21.15.66:0/427705156 shutdown_connections 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7f6160 0x5584eb7da240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d9280 0x5584eb7ef0c0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 --2- 172.21.15.66:0/427705156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7d3c30 0x5584eb7dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 -- 172.21.15.66:0/427705156 >> 172.21.15.66:0/427705156 conn(0x5584eb7d8b40 msgr2=0x5584eb8076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 -- 172.21.15.66:0/427705156 shutdown_connections 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 -- 172.21.15.66:0/427705156 wait complete. 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 -- start start 2024-05-10T11:20:15.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.368+0000 7ff9e4193740 1 Processor -- start 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 0x5584eb7e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7da180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc2011a0 con 0x5584eb7d3c30 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5584eb7ab900 con 0x5584eb7f6160 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5584eb8742b0 con 0x5584eb7d9280 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9e4193740 10 client.0 _ll_register_callbacks cb 0x7ff9d0009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 0x5584eb7e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 0x5584eb7e9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37888/0 (socket says 172.21.15.66:37888) 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 -- 172.21.15.66:0/4145329680 learned_addr learned my addr 172.21.15.66:0/4145329680 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7da180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 -- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 msgr2=0x5584eb7da180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7da180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 -- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 msgr2=0x5584eb7da6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7da6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9daffd640 1 -- 172.21.15.66:0/4145329680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584eb3e40f0 con 0x5584eb7d3c30 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.369+0000 7ff9db7fe640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7da6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9daffd640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 0x5584eb7e9cd0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c1d0 tx=0x7ff9cc001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78563b5e6950487f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4145329680 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc043040 con 0x5584eb7d3c30 2024-05-10T11:20:15.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4145329680 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff9cc04ccb0 con 0x5584eb7d3c30 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d0060ce0 con 0x5584eb7d3c30 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4145329680 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff9cc066050 con 0x5584eb7d3c30 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 10 client.7467 fetch_fsmap learned FSMap version 76 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5584eb873ff0 con 0x5584eb7d3c30 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4145329680 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0060ce0 con 0x5584eb7d3c30 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4145329680 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7ff9cc069020 con 0x5584eb7d3c30 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 10 client.7467 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 10 client.7467 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 20 client.7467 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7a8d50 0x5584eb870a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 4 client.7467 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5584eb71a9b0 con 0x5584eb7a8d50 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.370+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7a8d50 0x5584eb870a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9b9ffb640 10 client.7467 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9da7fc640 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7a8d50 0x5584eb870a40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e210b2c7e46571a server_cookie=202d1ea663ba7249 in_seq=0 out_seq=0 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9b9ffb640 1 -- 172.21.15.66:0/4145329680 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5584eb71a9b0 con 0x5584eb7a8d50 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9b9ffb640 10 client.7467 handle_command_reply: tid=0 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 client.7467 shutdown 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 msgr2=0x5584eb7e9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 0x5584eb7e9cd0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c1d0 tx=0x7ff9cc001da0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 shutdown_connections 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5584eb7f6160 0x5584eb7da6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5584eb7a8d50 0x5584eb870a40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5584eb7d9280 0x5584eb7da180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 --2- 172.21.15.66:0/4145329680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584eb7d3c30 0x5584eb7e9cd0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 >> 172.21.15.66:0/4145329680 conn(0x5584eb7d8b40 msgr2=0x5584eb7dc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9b9ffb640 0 client.7467 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 shutdown_connections 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 1 -- 172.21.15.66:0/4145329680 wait complete. 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.371+0000 7ff9e4193740 20 client.7467 trim_cache size 0 max 16384 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:20:15.380 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:20:15.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9c8076300 msgr2=0x7ff9c80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9c8076300 0x7ff9c80787c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc032000 tx=0x7ff9cc02d000 comp rx=0 tx=0).stop 2024-05-10T11:20:15.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 msgr2=0x7ff9dc15b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 0x7ff9dc15b550 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0011990 tx=0x7ff9d0011e50 comp rx=0 tx=0).stop 2024-05-10T11:20:15.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 shutdown_connections 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff9c8076300 0x7ff9c80787c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9dc0c47c0 0x7ff9dc0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9dc15b0f0 0x7ff9dc15b550 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 --2- 172.21.15.66:0/2412191130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9c4003b70 0x7ff9dc06c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 >> 172.21.15.66:0/2412191130 conn(0x7ff9dc0d0c90 msgr2=0x7ff9dc157060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 shutdown_connections 2024-05-10T11:20:15.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.372+0000 7ff9e139d640 1 -- 172.21.15.66:0/2412191130 wait complete. 2024-05-10T11:20:15.383 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:20:15.383 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:15.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.488+0000 7ffb1e187640 1 Processor -- start 2024-05-10T11:20:15.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.488+0000 7ffb1e187640 1 -- start start 2024-05-10T11:20:15.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb1e187640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb180b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb1e187640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffb180d59d0 0x7ffb180d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb1e187640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb180d2d20 con 0x7ffb18162940 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb1e187640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ffb18162d20 con 0x7ffb180d59d0 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb1e187640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180d3000 con 0x7ffb180d3d80 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb17fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffb180d59d0 0x7ffb180d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb177fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ffb18162940 0x7ffb180d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:36412/0 (socket says 172.21.15.66:36412) 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.489+0000 7ffb16ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb180b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.490+0000 7ffb177fe640 1 -- 172.21.15.66:0/983857746 learned_addr learned my addr 172.21.15.66:0/983857746 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.490+0000 7ffb16ffd640 1 -- 172.21.15.66:0/983857746 >> v2:172.21.15.190:3300/0 conn(0x7ffb180d59d0 msgr2=0x7ffb180d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.490+0000 7ffb16ffd640 1 --2- 172.21.15.66:0/983857746 >> v2:172.21.15.190:3300/0 conn(0x7ffb180d59d0 0x7ffb180d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.490+0000 7ffb16ffd640 1 -- 172.21.15.66:0/983857746 >> v1:172.21.15.190:6789/0 conn(0x7ffb18162940 legacy=0x7ffb180d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.490+0000 7ffb16ffd640 1 -- 172.21.15.66:0/983857746 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb180d32e0 con 0x7ffb180d3d80 2024-05-10T11:20:15.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.490+0000 7ffb17fff640 1 --2- 172.21.15.66:0/983857746 >> v2:172.21.15.190:3300/0 conn(0x7ffb180d59d0 0x7ffb180d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:15.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb16ffd640 1 --2- 172.21.15.66:0/983857746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb180b5e20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0097a0 tx=0x7ffb0c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6885aeda9f21981 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb167fc640 1 -- 172.21.15.66:0/983857746 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c037070 con 0x7ffb180d3d80 2024-05-10T11:20:15.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb167fc640 1 -- 172.21.15.66:0/983857746 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c02ae50 con 0x7ffb180d3d80 2024-05-10T11:20:15.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb167fc640 1 -- 172.21.15.66:0/983857746 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c032660 con 0x7ffb180d3d80 2024-05-10T11:20:15.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 -- 172.21.15.66:0/983857746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 msgr2=0x7ffb180b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 --2- 172.21.15.66:0/983857746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb180b5e20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0097a0 tx=0x7ffb0c02a100 comp rx=0 tx=0).stop 2024-05-10T11:20:15.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 -- 172.21.15.66:0/983857746 shutdown_connections 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 --2- 172.21.15.66:0/983857746 >> v2:172.21.15.190:3300/0 conn(0x7ffb180d59d0 0x7ffb180d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 --2- 172.21.15.66:0/983857746 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb180b5e20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 -- 172.21.15.66:0/983857746 >> 172.21.15.66:0/983857746 conn(0x7ffb1809e380 msgr2=0x7ffb180d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 -- 172.21.15.66:0/983857746 shutdown_connections 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.491+0000 7ffb1e187640 1 -- 172.21.15.66:0/983857746 wait complete. 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 Processor -- start 2024-05-10T11:20:15.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 -- start start 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb18150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 0x7ffb180cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb18162940 0x7ffb180cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d2390 con 0x7ffb180d59d0 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180cfc50 con 0x7ffb18162940 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.493+0000 7ffb1e187640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180d2510 con 0x7ffb180d3d80 2024-05-10T11:20:15.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 0x7ffb180cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 0x7ffb180cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37898/0 (socket says 172.21.15.66:37898) 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 -- 172.21.15.66:0/1918976779 learned_addr learned my addr 172.21.15.66:0/1918976779 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb177fe640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb18150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb17fff640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb18162940 0x7ffb180cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 -- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 msgr2=0x7ffb18150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb18150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 -- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb18162940 msgr2=0x7ffb180cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb18162940 0x7ffb180cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 -- 172.21.15.66:0/1918976779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb180b7f60 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb16ffd640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 0x7ffb180cd860 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c035040 tx=0x7ffb0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c041070 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c03c460 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.494+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb180ce3d0 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.495+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c037040 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.495+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb180ce990 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.495+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1806a220 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.496+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb0c03a070 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.497+0000 7ffafffff640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ffb040762d0 0x7ffb04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.497+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ffb0c0b7730 con 0x7ffb180d59d0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.497+0000 7ffb177fe640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ffb040762d0 0x7ffb04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.497+0000 7ffb177fe640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ffb040762d0 0x7ffb04078790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ffb08007fd0 tx=0x7ffb08007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.501+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ffb0c080820 con 0x7ffb180d59d0 2024-05-10T11:20:15.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.731+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb18162010 con 0x7ffb180d59d0 2024-05-10T11:20:15.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.731+0000 7ffafffff640 1 -- 172.21.15.66:0/1918976779 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5187 (secure 0 0 0) 0x7ffb0c084b20 con 0x7ffb180d59d0 2024-05-10T11:20:15.731 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:15.731 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:42.277004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7323,"qdb_cluster":[7323]},"id":6}]} 2024-05-10T11:20:15.731 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 76 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ffb040762d0 msgr2=0x7ffb04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ffb040762d0 0x7ffb04078790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ffb08007fd0 tx=0x7ffb08007e80 comp rx=0 tx=0).stop 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 msgr2=0x7ffb180cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 0x7ffb180cd860 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c035040 tx=0x7ffb0c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 shutdown_connections 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ffb040762d0 0x7ffb04078790 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb18162940 0x7ffb180cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb180d59d0 0x7ffb180cd860 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 --2- 172.21.15.66:0/1918976779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb180d3d80 0x7ffb18150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 >> 172.21.15.66:0/1918976779 conn(0x7ffb1809e380 msgr2=0x7ffb18075a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 shutdown_connections 2024-05-10T11:20:15.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.733+0000 7ffb1e187640 1 -- 172.21.15.66:0/1918976779 wait complete. 2024-05-10T11:20:15.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T11:20:15.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.851+0000 7fa2400c4640 1 Processor -- start 2024-05-10T11:20:15.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.851+0000 7fa2400c4640 1 -- start start 2024-05-10T11:20:15.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa2400c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa238162ce0 0x7fa2380b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa2400c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2380b4e20 0x7fa2380d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa2400c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2380d4190 con 0x7fa238162900 2024-05-10T11:20:15.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa2400c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa2380cfc40 con 0x7fa238162ce0 2024-05-10T11:20:15.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa2400c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa2380d3eb0 con 0x7fa2380b4e20 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23d65f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa238162ce0 0x7fa2380b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23e661640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2380b4e20 0x7fa2380d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23de60640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa238162900 0x7fa2380d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:36426/0 (socket says 172.21.15.66:36426) 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23de60640 1 -- 172.21.15.66:0/2119152701 learned_addr learned my addr 172.21.15.66:0/2119152701 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23e661640 1 -- 172.21.15.66:0/2119152701 >> v2:172.21.15.190:3300/0 conn(0x7fa238162ce0 msgr2=0x7fa2380b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23e661640 1 --2- 172.21.15.66:0/2119152701 >> v2:172.21.15.190:3300/0 conn(0x7fa238162ce0 0x7fa2380b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23e661640 1 -- 172.21.15.66:0/2119152701 >> v1:172.21.15.190:6789/0 conn(0x7fa238162900 legacy=0x7fa2380d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23ce5e640 1 -- 172.21.15.66:0/2119152701 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954439149 0 0) 0x7fa234001110 con 0x7fa238162900 2024-05-10T11:20:15.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23e661640 1 -- 172.21.15.66:0/2119152701 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2380cfee0 con 0x7fa2380b4e20 2024-05-10T11:20:15.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.852+0000 7fa23d65f640 1 --2- 172.21.15.66:0/2119152701 >> v2:172.21.15.190:3300/0 conn(0x7fa238162ce0 0x7fa2380b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.853+0000 7fa23e661640 1 --2- 172.21.15.66:0/2119152701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2380b4e20 0x7fa2380d09c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa230009d90 tx=0x7fa23002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577bd50fa7d426f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.853+0000 7fa23ce5e640 1 -- 172.21.15.66:0/2119152701 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230031600 con 0x7fa2380b4e20 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.853+0000 7fa23ce5e640 1 -- 172.21.15.66:0/2119152701 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300317a0 con 0x7fa2380b4e20 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.853+0000 7fa23ce5e640 1 -- 172.21.15.66:0/2119152701 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230031b70 con 0x7fa2380b4e20 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 -- 172.21.15.66:0/2119152701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2380b4e20 msgr2=0x7fa2380d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2119152701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2380b4e20 0x7fa2380d09c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa230009d90 tx=0x7fa23002a5d0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 -- 172.21.15.66:0/2119152701 shutdown_connections 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2119152701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2380b4e20 0x7fa2380d09c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2119152701 >> v2:172.21.15.190:3300/0 conn(0x7fa238162ce0 0x7fa2380b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 -- 172.21.15.66:0/2119152701 >> 172.21.15.66:0/2119152701 conn(0x7fa23809e430 msgr2=0x7fa2380d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 -- 172.21.15.66:0/2119152701 shutdown_connections 2024-05-10T11:20:15.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.854+0000 7fa2400c4640 1 -- 172.21.15.66:0/2119152701 wait complete. 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.855+0000 7fa2400c4640 1 Processor -- start 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.855+0000 7fa2400c4640 1 -- start start 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa2400c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2380b4e20 0x7fa238154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa2400c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa238162900 0x7fa2380b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa2400c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 0x7fa2380ba350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa2400c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2380b4180 con 0x7fa238162ce0 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa2400c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa2380d3b20 con 0x7fa2380b4e20 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa2400c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa2380b4300 con 0x7fa238162900 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 0x7fa2380ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 0x7fa2380ba350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37914/0 (socket says 172.21.15.66:37914) 2024-05-10T11:20:15.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 -- 172.21.15.66:0/2475541733 learned_addr learned my addr 172.21.15.66:0/2475541733 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23de60640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2380b4e20 0x7fa238154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23d65f640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa238162900 0x7fa2380b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 -- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa238162900 msgr2=0x7fa2380b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa238162900 0x7fa2380b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 -- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2380b4e20 msgr2=0x7fa238154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2380b4e20 0x7fa238154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.856+0000 7fa23e661640 1 -- 172.21.15.66:0/2475541733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2380b8870 con 0x7fa238162ce0 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa23de60640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2380b4e20 0x7fa238154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa23d65f640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa238162900 0x7fa2380b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa23e661640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 0x7fa2380ba350 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fa230009d90 tx=0x7fa230004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa22a7fc640 1 -- 172.21.15.66:0/2475541733 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23003f070 con 0x7fa238162ce0 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa22a7fc640 1 -- 172.21.15.66:0/2475541733 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230030be0 con 0x7fa238162ce0 2024-05-10T11:20:15.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2380b8b50 con 0x7fa238162ce0 2024-05-10T11:20:15.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa22a7fc640 1 -- 172.21.15.66:0/2475541733 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230009450 con 0x7fa238162ce0 2024-05-10T11:20:15.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.857+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2380b9110 con 0x7fa238162ce0 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.859+0000 7fa22a7fc640 1 -- 172.21.15.66:0/2475541733 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa230003990 con 0x7fa238162ce0 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.859+0000 7fa22a7fc640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa21c0762d0 0x7fa21c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.860+0000 7fa22a7fc640 1 -- 172.21.15.66:0/2475541733 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fa2300b83e0 con 0x7fa238162ce0 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.860+0000 7fa23de60640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa21c0762d0 0x7fa21c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.860+0000 7fa242dd8740 1 Processor -- start 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.860+0000 7fa242dd8740 1 -- start start 2024-05-10T11:20:15.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.860+0000 7fa23de60640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa21c0762d0 0x7fa21c078790 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa234000f60 tx=0x7fa234007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 0x5601601662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x560160195b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601960b0 0x56016016aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa242dd8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560160056920 con 0x5601601b36d0 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5601600cbdd0 con 0x5601601960b0 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56016007c3e0 con 0x5601601967f0 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 0x5601601662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 0x5601601662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37928/0 (socket says 172.21.15.66:37928) 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 -- 172.21.15.66:0/3219982133 learned_addr learned my addr 172.21.15.66:0/3219982133 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23e661640 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601960b0 0x56016016aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23d65f640 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x560160195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 -- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 msgr2=0x560160195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x560160195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 -- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601960b0 msgr2=0x56016016aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601960b0 0x56016016aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.861+0000 7fa23de60640 1 -- 172.21.15.66:0/3219982133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015fead7c0 con 0x5601601b36d0 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa23de60640 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 0x5601601662f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fa234001720 tx=0x7fa234012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02e6f1d904bef1e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa21b7fe640 1 -- 172.21.15.66:0/3219982133 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234015110 con 0x5601601b36d0 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa21b7fe640 1 -- 172.21.15.66:0/3219982133 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2340159c0 con 0x5601601b36d0 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa21b7fe640 1 -- 172.21.15.66:0/3219982133 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234015d70 con 0x5601601b36d0 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 -- 172.21.15.66:0/3219982133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 msgr2=0x5601601662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 0x5601601662f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fa234001720 tx=0x7fa234012000 comp rx=0 tx=0).stop 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 -- 172.21.15.66:0/3219982133 shutdown_connections 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601960b0 0x56016016aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x560160195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3219982133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601b36d0 0x5601601662f0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 -- 172.21.15.66:0/3219982133 >> 172.21.15.66:0/3219982133 conn(0x560160168560 msgr2=0x5601601b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 -- 172.21.15.66:0/3219982133 shutdown_connections 2024-05-10T11:20:15.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.862+0000 7fa242dd8740 1 -- 172.21.15.66:0/3219982133 wait complete. 2024-05-10T11:20:15.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.863+0000 7fa242dd8740 1 -- start start 2024-05-10T11:20:15.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.863+0000 7fa242dd8740 1 Processor -- start 2024-05-10T11:20:15.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160186380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601b36d0 0x560160196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560160197220 0x5601601b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5601600d4440 con 0x5601601967f0 2024-05-10T11:20:15.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5601600cf120 con 0x560160197220 2024-05-10T11:20:15.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5601600dd210 con 0x5601601b36d0 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa242dd8740 10 client.0 _ll_register_callbacks cb 0x560160074690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160186380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160186380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37942/0 (socket says 172.21.15.66:37942) 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 -- 172.21.15.66:0/3867401955 learned_addr learned my addr 172.21.15.66:0/3867401955 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23d65f640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601b36d0 0x560160196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23e661640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560160197220 0x5601601b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 -- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601b36d0 msgr2=0x560160196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601b36d0 0x560160196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 -- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560160197220 msgr2=0x5601601b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560160197220 0x5601601b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23de60640 1 -- 172.21.15.66:0/3867401955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015ff0df50 con 0x5601601967f0 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23e661640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560160197220 0x5601601b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.864+0000 7fa23d65f640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601b36d0 0x560160196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa23de60640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160186380 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fa234001eb0 tx=0x7fa234000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed2cb0026d10573 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa218ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa218ff9640 1 -- 172.21.15.66:0/3867401955 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234015e40 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa218ff9640 1 -- 172.21.15.66:0/3867401955 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fa234021450 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2340159c0 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa218ff9640 1 -- 172.21.15.66:0/3867401955 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa234033050 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 10 client.7479 fetch_fsmap learned FSMap version 76 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x56015fda10b0 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa218ff9640 1 -- 172.21.15.66:0/3867401955 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2340159c0 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa218ff9640 1 -- 172.21.15.66:0/3867401955 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7fa234036020 con 0x5601601967f0 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 10 client.7479 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 10 client.7479 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 20 client.7479 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x560160198a50 0x560160198e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 4 client.7479 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601600dda20 con 0x560160198a50 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.865+0000 7fa23d65f640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x560160198a50 0x560160198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa218ff9640 10 client.7479 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa23d65f640 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x560160198a50 0x560160198e30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e8eb2defac88484 server_cookie=7888327e0936d64d in_seq=0 out_seq=0 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa218ff9640 1 -- 172.21.15.66:0/3867401955 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5601600dda20 con 0x560160198a50 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa218ff9640 10 client.7479 handle_command_reply: tid=0 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa242dd8740 1 client.7479 shutdown 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 msgr2=0x560160186380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160186380 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fa234001eb0 tx=0x7fa234000ed0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 shutdown_connections 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560160197220 0x5601601b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.866+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x560160198a50 0x560160198e30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601b36d0 0x560160196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa242dd8740 1 --2- 172.21.15.66:0/3867401955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160186380 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa218ff9640 0 client.7479 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 >> 172.21.15.66:0/3867401955 conn(0x5601601960b0 msgr2=0x560160165a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 shutdown_connections 2024-05-10T11:20:15.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa242dd8740 1 -- 172.21.15.66:0/3867401955 wait complete. 2024-05-10T11:20:15.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.867+0000 7fa242dd8740 20 client.7479 trim_cache size 0 max 16384 2024-05-10T11:20:15.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.880+0000 7fa242dd8740 1 Processor -- start 2024-05-10T11:20:15.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 -- start start 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x5601601a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 0x560160228510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x560160228a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa238201130 con 0x560160197220 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa238152a40 con 0x5601601b36d0 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa238153090 con 0x5601601967f0 2024-05-10T11:20:15.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 0x560160228510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 0x560160228510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37958/0 (socket says 172.21.15.66:37958) 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 -- 172.21.15.66:0/2524992460 learned_addr learned my addr 172.21.15.66:0/2524992460 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 -- 172.21.15.66:0/2524992460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 msgr2=0x5601601a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x5601601a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 -- 172.21.15.66:0/2524992460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 msgr2=0x560160228a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.881+0000 7fa23d65f640 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x560160228a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa23d65f640 1 -- 172.21.15.66:0/2524992460 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560160197050 con 0x560160197220 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa23d65f640 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 0x560160228510 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa2380a30e0 tx=0x7fa22c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7da895639766468 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa21affd640 1 -- 172.21.15.66:0/2524992460 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c004230 con 0x560160197220 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa21affd640 1 -- 172.21.15.66:0/2524992460 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c025070 con 0x560160197220 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa21affd640 1 -- 172.21.15.66:0/2524992460 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0203a0 con 0x560160197220 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 -- 172.21.15.66:0/2524992460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 msgr2=0x560160228510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 0x560160228510 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa2380a30e0 tx=0x7fa22c008040 comp rx=0 tx=0).stop 2024-05-10T11:20:15.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 -- 172.21.15.66:0/2524992460 shutdown_connections 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x560160228a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560160197220 0x560160228510 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 --2- 172.21.15.66:0/2524992460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5601601967f0 0x5601601a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 -- 172.21.15.66:0/2524992460 >> 172.21.15.66:0/2524992460 conn(0x5601601960b0 msgr2=0x5601601b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 -- 172.21.15.66:0/2524992460 shutdown_connections 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.882+0000 7fa242dd8740 1 -- 172.21.15.66:0/2524992460 wait complete. 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.883+0000 7fa242dd8740 1 -- start start 2024-05-10T11:20:15.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.883+0000 7fa242dd8740 1 Processor -- start 2024-05-10T11:20:15.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160191ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560160197220 0x56016022ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x5601601c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560160199aa0 con 0x5601601967f0 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560160085a20 con 0x5601601b36d0 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5601601c4250 con 0x560160197220 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa242dd8740 10 client.0 _ll_register_callbacks cb 0x7fa23007d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160191ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160191ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37962/0 (socket says 172.21.15.66:37962) 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 -- 172.21.15.66:0/1647375315 learned_addr learned my addr 172.21.15.66:0/1647375315 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23d65f640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560160197220 0x56016022ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23e661640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x5601601c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 -- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560160197220 msgr2=0x56016022ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560160197220 0x56016022ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 -- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 msgr2=0x5601601c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x5601601c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23de60640 1 -- 172.21.15.66:0/1647375315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601601c6f40 con 0x5601601967f0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.884+0000 7fa23e661640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x5601601c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa23de60640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160191ee0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa234000f30 tx=0x7fa234001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dca29366f8dc7f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa218ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa218ff9640 1 -- 172.21.15.66:0/1647375315 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23403b020 con 0x5601601967f0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa218ff9640 1 -- 172.21.15.66:0/1647375315 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fa234001540 con 0x5601601967f0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa22c025070 con 0x5601601967f0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa218ff9640 1 -- 172.21.15.66:0/1647375315 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa234045050 con 0x5601601967f0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 10 client.7485 fetch_fsmap learned FSMap version 76 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x56016022eac0 con 0x5601601967f0 2024-05-10T11:20:15.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa218ff9640 1 -- 172.21.15.66:0/1647375315 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c025070 con 0x5601601967f0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa218ff9640 1 -- 172.21.15.66:0/1647375315 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 76) ==== 3494+0+0 (secure 0 0 0) 0x7fa234048020 con 0x5601601967f0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 10 client.7485 fetch_fsmap finished waiting for FSMap version 76 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 10 client.7485 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 20 client.7485 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5601601c30a0 0x5601601bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 4 client.7485 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 --> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x5601600d7890 con 0x5601601c30a0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.885+0000 7fa23d65f640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5601601c30a0 0x5601601bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa23d65f640 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5601601c30a0 0x5601601bf270 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51b97b3589d294a server_cookie=924fc0449a7302ec in_seq=0 out_seq=0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa218ff9640 10 client.7485 ms_handle_connect on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa218ff9640 1 -- 172.21.15.66:0/1647375315 <== mds.0 v2:172.21.15.66:6834/821296830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601600d7890 con 0x5601601c30a0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa218ff9640 10 client.7485 handle_command_reply: tid=0 2024-05-10T11:20:15.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 client.7485 shutdown 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 msgr2=0x560160191ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160191ee0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa234000f30 tx=0x7fa234001080 comp rx=0 tx=0).stop 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 shutdown_connections 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5601601b36d0 0x5601601c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:6834/821296830,v1:172.21.15.66:6835/821296830] conn(0x5601601c30a0 0x5601601bf270 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560160197220 0x56016022ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa218ff9640 0 client.7485 ms_handle_reset on v2:172.21.15.66:6834/821296830 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 --2- 172.21.15.66:0/1647375315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601601967f0 0x560160191ee0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 >> 172.21.15.66:0/1647375315 conn(0x5601601960b0 msgr2=0x5601601b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 shutdown_connections 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 1 -- 172.21.15.66:0/1647375315 wait complete. 2024-05-10T11:20:15.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.886+0000 7fa242dd8740 20 client.7485 trim_cache size 0 max 16384 2024-05-10T11:20:15.894 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:15.894 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa21c0762d0 msgr2=0x7fa21c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa21c0762d0 0x7fa21c078790 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa234000f60 tx=0x7fa234007a10 comp rx=0 tx=0).stop 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 msgr2=0x7fa2380ba350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 0x7fa2380ba350 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fa230009d90 tx=0x7fa230004a40 comp rx=0 tx=0).stop 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 shutdown_connections 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa21c0762d0 0x7fa21c078790 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238162ce0 0x7fa2380ba350 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa238162900 0x7fa2380b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 --2- 172.21.15.66:0/2475541733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2380b4e20 0x7fa238154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 >> 172.21.15.66:0/2475541733 conn(0x7fa23809e430 msgr2=0x7fa2380b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 shutdown_connections 2024-05-10T11:20:15.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:15.887+0000 7fa2400c4640 1 -- 172.21.15.66:0/2475541733 wait complete. 2024-05-10T11:20:15.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T11:20:16.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.000+0000 7fd7a7872640 1 Processor -- start 2024-05-10T11:20:16.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.000+0000 7fd7a7872640 1 -- start start 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a7872640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd7a015f3b0 0x7fd7a00d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a7872640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd7a015f790 0x7fd7a00d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a7872640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a00c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a7872640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a00d30b0 con 0x7fd7a015f790 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a7872640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a00d3390 con 0x7fd7a015f3b0 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a7872640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a00c8c80 con 0x7fd7a00d5d30 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.001+0000 7fd7a4e0d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd7a015f790 0x7fd7a00d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd7a015f790 0x7fd7a00d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37972/0 (socket says 172.21.15.66:37972) 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 -- 172.21.15.66:0/774993070 learned_addr learned my addr 172.21.15.66:0/774993070 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a5e0f640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a00c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a560e640 1 --2- 172.21.15.66:0/774993070 >> v2:172.21.15.190:3300/0 conn(0x7fd7a015f3b0 0x7fd7a00d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 -- 172.21.15.66:0/774993070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 msgr2=0x7fd7a00c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a00c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 -- 172.21.15.66:0/774993070 >> v2:172.21.15.190:3300/0 conn(0x7fd7a015f3b0 msgr2=0x7fd7a00d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 --2- 172.21.15.66:0/774993070 >> v2:172.21.15.190:3300/0 conn(0x7fd7a015f3b0 0x7fd7a00d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a4e0d640 1 -- 172.21.15.66:0/774993070 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a00c8f60 con 0x7fd7a015f790 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a5e0f640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a00c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.002+0000 7fd7a560e640 1 --2- 172.21.15.66:0/774993070 >> v2:172.21.15.190:3300/0 conn(0x7fd7a015f3b0 0x7fd7a00d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a4e0d640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015f790 0x7fd7a00d3c30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd7a008e820 tx=0x7fd79402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2ad6358400a2be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd79ffff640 1 -- 172.21.15.66:0/774993070 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794037070 con 0x7fd7a015f790 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd79ffff640 1 -- 172.21.15.66:0/774993070 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd794032440 con 0x7fd7a015f790 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd79ffff640 1 -- 172.21.15.66:0/774993070 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794032810 con 0x7fd7a015f790 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 -- 172.21.15.66:0/774993070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015f790 msgr2=0x7fd7a00d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015f790 0x7fd7a00d3c30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd7a008e820 tx=0x7fd79402a1e0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 -- 172.21.15.66:0/774993070 shutdown_connections 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a00c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 --2- 172.21.15.66:0/774993070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015f790 0x7fd7a00d3c30 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 --2- 172.21.15.66:0/774993070 >> v2:172.21.15.190:3300/0 conn(0x7fd7a015f3b0 0x7fd7a00d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 -- 172.21.15.66:0/774993070 >> 172.21.15.66:0/774993070 conn(0x7fd7a00d5130 msgr2=0x7fd7a00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:16.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 -- 172.21.15.66:0/774993070 shutdown_connections 2024-05-10T11:20:16.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.003+0000 7fd7a7872640 1 -- 172.21.15.66:0/774993070 wait complete. 2024-05-10T11:20:16.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 Processor -- start 2024-05-10T11:20:16.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 -- start start 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a015f3b0 0x7fd7a00cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 0x7fd7a00d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a00c9e20 con 0x7fd7a015a580 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a00c9ca0 con 0x7fd7a015f3b0 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a7872640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a00c9fa0 con 0x7fd7a00d5d30 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a5e0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 0x7fd7a00d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.005+0000 7fd7a5e0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 0x7fd7a00d36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37988/0 (socket says 172.21.15.66:37988) 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 -- 172.21.15.66:0/3437396802 learned_addr learned my addr 172.21.15.66:0/3437396802 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a560e640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a4e0d640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a015f3b0 0x7fd7a00cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 -- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 msgr2=0x7fd7a014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a014f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 -- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a015f3b0 msgr2=0x7fd7a00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a015f3b0 0x7fd7a00cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 -- 172.21.15.66:0/3437396802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a00cc970 con 0x7fd7a015a580 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a5e0f640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 0x7fd7a00d36d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e5e0 tx=0x7fd79800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800f040 con 0x7fd7a015a580 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd798004230 con 0x7fd7a015a580 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a00ccc50 con 0x7fd7a015a580 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798003610 con 0x7fd7a015a580 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.006+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a00cd210 con 0x7fd7a015a580 2024-05-10T11:20:16.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.007+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a006a220 con 0x7fd7a015a580 2024-05-10T11:20:16.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.008+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7980037b0 con 0x7fd7a015a580 2024-05-10T11:20:16.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.008+0000 7fd79dffb640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd78c0762d0 0x7fd78c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.009+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fd798097560 con 0x7fd7a015a580 2024-05-10T11:20:16.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.009+0000 7fd7a560e640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd78c0762d0 0x7fd78c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.009+0000 7fd7a560e640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd78c0762d0 0x7fd78c078790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd790009f70 tx=0x7fd79000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:16.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.013+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd798017020 con 0x7fd7a015a580 2024-05-10T11:20:16.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.252+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7a00d0130 con 0x7fd7a015a580 2024-05-10T11:20:16.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.252+0000 7fd79dffb640 1 -- 172.21.15.66:0/3437396802 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd798060c10 con 0x7fd7a015a580 2024-05-10T11:20:16.251 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:16.251 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd78c0762d0 msgr2=0x7fd78c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd78c0762d0 0x7fd78c078790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd790009f70 tx=0x7fd79000b040 comp rx=0 tx=0).stop 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 msgr2=0x7fd7a00d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 0x7fd7a00d36d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e5e0 tx=0x7fd79800eaa0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 shutdown_connections 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd78c0762d0 0x7fd78c078790 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7a015a580 0x7fd7a00d36d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a015f3b0 0x7fd7a00cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 --2- 172.21.15.66:0/3437396802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a00d5d30 0x7fd7a014f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 >> 172.21.15.66:0/3437396802 conn(0x7fd7a00d5130 msgr2=0x7fd7a00d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 shutdown_connections 2024-05-10T11:20:16.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.254+0000 7fd7a7872640 1 -- 172.21.15.66:0/3437396802 wait complete. 2024-05-10T11:20:16.264 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T11:20:16.265 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:20:16.265 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:20:16.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:20:16.356 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:20:16.357 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:20:16.357 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:16.357 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:16.374 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:16.374 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:16.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:20:16.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.576+0000 7f49f75dd640 1 Processor -- start 2024-05-10T11:20:16.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.576+0000 7f49f75dd640 1 -- start start 2024-05-10T11:20:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f75dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f01611e0 0x7f49f00cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f75dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f49f00c65f0 0x7f49f015d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f75dd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f00c6a80 con 0x7f49f015ce60 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f75dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f49f00cd090 con 0x7f49f00c65f0 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f75dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f49f00cd370 con 0x7f49f01611e0 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f5379640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f49f015ce60 0x7f49f0160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37776/0 (socket says 172.21.15.66:37776) 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f5379640 1 -- 172.21.15.66:0/3983410319 learned_addr learned my addr 172.21.15.66:0/3983410319 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.577+0000 7f49f5b7a640 1 --2- 172.21.15.66:0/3983410319 >> v2:172.21.15.190:3300/0 conn(0x7f49f00c65f0 0x7f49f015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49f4b78640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f01611e0 0x7f49f00cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49effff640 1 -- 172.21.15.66:0/3983410319 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057917328 0 0) 0x7f49e0001490 con 0x7f49f015ce60 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49effff640 1 -- 172.21.15.66:0/3983410319 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49d8003520 con 0x7f49f015ce60 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f01611e0 msgr2=0x7f49f00cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49f5b7a640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f01611e0 0x7f49f00cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49effff640 1 -- 172.21.15.66:0/3983410319 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209870910 0 0) 0x7f49d8003520 con 0x7f49f015ce60 2024-05-10T11:20:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3983410319 >> v1:172.21.15.66:6789/0 conn(0x7f49f015ce60 legacy=0x7f49f0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3983410319 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f00cd650 con 0x7f49f00c65f0 2024-05-10T11:20:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.578+0000 7f49f4b78640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f01611e0 0x7f49f00cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f5b7a640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f015d240 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f49e80097a0 tx=0x7f49e802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99137935b6aa142c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49effff640 1 -- 172.21.15.66:0/3983410319 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8037070 con 0x7f49f00c65f0 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49effff640 1 -- 172.21.15.66:0/3983410319 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e802ab10 con 0x7f49f00c65f0 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49effff640 1 -- 172.21.15.66:0/3983410319 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0001bc0 con 0x7f49f00c65f0 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f75dd640 1 -- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 msgr2=0x7f49f015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f015d240 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f49e80097a0 tx=0x7f49e802a080 comp rx=0 tx=0).stop 2024-05-10T11:20:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f75dd640 1 -- 172.21.15.66:0/3983410319 shutdown_connections 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f015d240 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3983410319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f01611e0 0x7f49f00cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.579+0000 7f49f75dd640 1 -- 172.21.15.66:0/3983410319 >> 172.21.15.66:0/3983410319 conn(0x7f49f00b2900 msgr2=0x7f49f00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.580+0000 7f49f75dd640 1 -- 172.21.15.66:0/3983410319 shutdown_connections 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.580+0000 7f49f75dd640 1 -- 172.21.15.66:0/3983410319 wait complete. 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 Processor -- start 2024-05-10T11:20:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 -- start start 2024-05-10T11:20:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f015ce60 0x7f49f00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 0x7f49f0073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f49f00cde50 con 0x7f49f01611e0 2024-05-10T11:20:16.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f49f00ccd60 con 0x7f49f00c65f0 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.581+0000 7f49f75dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f49f00cdfd0 con 0x7f49f015ce60 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 0x7f49f0073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 0x7f49f0073b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37990/0 (socket says 172.21.15.66:37990) 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3174351297 learned_addr learned my addr 172.21.15.66:0/3174351297 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5379640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f4b78640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f015ce60 0x7f49f00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f015ce60 msgr2=0x7f49f00735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f015ce60 0x7f49f00735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 msgr2=0x7f49f014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 -- 172.21.15.66:0/3174351297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f00c8080 con 0x7f49f01611e0 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f4b78640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f015ce60 0x7f49f00735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5379640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f5b7a640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 0x7f49f0073b00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f49e8035040 tx=0x7f49e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8041020 con 0x7f49f01611e0 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e803d620 con 0x7f49f01611e0 2024-05-10T11:20:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f00b45b0 con 0x7f49f01611e0 2024-05-10T11:20:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.582+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8037040 con 0x7f49f01611e0 2024-05-10T11:20:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.583+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f00b4b70 con 0x7f49f01611e0 2024-05-10T11:20:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.584+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f006a220 con 0x7f49f01611e0 2024-05-10T11:20:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.584+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f49e8044020 con 0x7f49f01611e0 2024-05-10T11:20:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.585+0000 7f49edffb640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49dc076300 0x7f49dc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.585+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f49e80b7d40 con 0x7f49f01611e0 2024-05-10T11:20:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.585+0000 7f49f5379640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49dc076300 0x7f49dc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.586+0000 7f49f5379640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49dc076300 0x7f49dc0787c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f49e0001730 tx=0x7f49e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.589+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f49e804b030 con 0x7f49f01611e0 2024-05-10T11:20:16.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.794+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f49f015f9c0 con 0x7f49f01611e0 2024-05-10T11:20:16.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.794+0000 7f49edffb640 1 -- 172.21.15.66:0/3174351297 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v92) ==== 80+0+244 (secure 0 0 0) 0x7f49f00c8080 con 0x7f49f01611e0 2024-05-10T11:20:16.794 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6835/577308965 2024-05-11T11:19:38.256644+0000 2024-05-10T11:20:16.795 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6834/577308965 2024-05-11T11:19:38.256644+0000 2024-05-10T11:20:16.795 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6837/1519468735 2024-05-11T11:18:27.672306+0000 2024-05-10T11:20:16.795 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6835/1519468735 2024-05-11T11:18:27.672306+0000 2024-05-10T11:20:16.797 INFO:teuthology.orchestra.run.smithi066.stderr:listed 4 entries 2024-05-10T11:20:16.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49dc076300 msgr2=0x7f49dc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49dc076300 0x7f49dc0787c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f49e0001730 tx=0x7f49e0009040 comp rx=0 tx=0).stop 2024-05-10T11:20:16.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 msgr2=0x7f49f0073b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:16.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 0x7f49f0073b00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f49e8035040 tx=0x7f49e80046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 shutdown_connections 2024-05-10T11:20:16.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49dc076300 0x7f49dc0787c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49f01611e0 0x7f49f0073b00 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49f015ce60 0x7f49f00735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 --2- 172.21.15.66:0/3174351297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49f00c65f0 0x7f49f014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:16.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 >> 172.21.15.66:0/3174351297 conn(0x7f49f00b2900 msgr2=0x7f49f015ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:16.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 shutdown_connections 2024-05-10T11:20:16.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:16.796+0000 7f49f75dd640 1 -- 172.21.15.66:0/3174351297 wait complete. 2024-05-10T11:20:16.808 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:20:16.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:16.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:16.839 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:20:16.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:16.840 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:20:16.897 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:20:16.897 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:20:16.897 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:16.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:20:16.919 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:20:16.919 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:16.919 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:16.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:20:16.953 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:20:16.954 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:20:16.954 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:16.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:20:16.978 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:17.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.098+0000 7f0cf70e1640 1 Processor -- start 2024-05-10T11:20:17.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.098+0000 7f0cf70e1640 1 -- start start 2024-05-10T11:20:17.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0cf70e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf00d5cb0 0x7f0cf00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0cf70e1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf00b45f0 con 0x7f0cf0162750 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0cf70e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf00b48d0 con 0x7f0cf0162b30 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0cf70e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf00b4f20 con 0x7f0cf00d5cb0 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0cf4e7d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0cf0162750 0x7f0cf00d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37784/0 (socket says 172.21.15.66:37784) 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1923697190 learned_addr learned my addr 172.21.15.66:0/1923697190 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.099+0000 7f0ceffff640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf00d5cb0 0x7f0cf00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518790912 0 0) 0x7f0cf00b45f0 con 0x7f0cf0162750 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd8003520 con 0x7f0cf0162750 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315643303 0 0) 0x7f0cf00b48d0 con 0x7f0cf0162b30 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cf00b45f0 con 0x7f0cf0162b30 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1222121929 0 0) 0x7f0cd8003520 con 0x7f0cf0162750 2024-05-10T11:20:17.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf00d5cb0 msgr2=0x7f0cf00d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf00d5cb0 0x7f0cf00d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 >> v1:172.21.15.190:6789/0 conn(0x7f0cf0162b30 legacy=0x7f0cf00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf00b4bb0 con 0x7f0cf0162750 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f0ce0001670 con 0x7f0cf0162750 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 >> v1:172.21.15.66:6789/0 conn(0x7f0cf0162750 legacy=0x7f0cf00d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cd8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cd8004800 0x7f0cd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cd8005180 0x7f0cd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00b4f20 con 0x7f0cd8003b70 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd800bf00 con 0x7f0cd8005180 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd800c100 con 0x7f0cd8004800 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cd8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf567e640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cd8005180 0x7f0cd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0ceffff640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cd8004800 0x7f0cd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cd8004800 msgr2=0x7f0cd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cd8004800 0x7f0cd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cd8005180 msgr2=0x7f0cd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cd8005180 0x7f0cd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.100+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1923697190 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd8003520 con 0x7f0cd8003b70 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.101+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cd8003f70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0001eb0 tx=0x7f0cd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ec2e5687fe5edd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.101+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0007c00 con 0x7f0cd8003b70 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.101+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0005af0 con 0x7f0cd8003b70 2024-05-10T11:20:17.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.101+0000 7f0cef7fe640 1 -- 172.21.15.66:0/1923697190 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0007070 con 0x7f0cd8003b70 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1923697190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 msgr2=0x7f0cd8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1923697190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cd8003f70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0001eb0 tx=0x7f0cd8005830 comp rx=0 tx=0).stop 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf567e640 1 -- 172.21.15.66:0/1923697190 reap_dead start 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1923697190 shutdown_connections 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1923697190 >> 172.21.15.66:0/1923697190 conn(0x7f0cf009e3b0 msgr2=0x7f0cf00d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1923697190 shutdown_connections 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.102+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1923697190 wait complete. 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.103+0000 7f0cf70e1640 1 Processor -- start 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.103+0000 7f0cf70e1640 1 -- start start 2024-05-10T11:20:17.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf70e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cf00a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf70e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf00b7530 0x7f0cf00a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf70e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf015f590 0x7f0cf00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf70e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00d3a40 con 0x7f0cd8003b70 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf70e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00d38c0 con 0x7f0cf00b7530 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf70e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf00d3bc0 con 0x7f0cf015f590 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cf00a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cf00a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38018/0 (socket says 172.21.15.66:38018) 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1024683733 learned_addr learned my addr 172.21.15.66:0/1024683733 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf567e640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf015f590 0x7f0cf00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0ceffff640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf00b7530 0x7f0cf00a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf015f590 msgr2=0x7f0cf00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf015f590 0x7f0cf00b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf00b7530 msgr2=0x7f0cf00a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf00b7530 0x7f0cf00a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf4e7d640 1 -- 172.21.15.66:0/1024683733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf00a11b0 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0cf567e640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf015f590 0x7f0cf00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.104+0000 7f0ceffff640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf00b7530 0x7f0cf00a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.105+0000 7f0cf4e7d640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cf00a13c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0001400 tx=0x7f0ce0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.105+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0001670 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.105+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0042070 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.105+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00072b0 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.105+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf00b9330 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.105+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf00b7bc0 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.106+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf006a220 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.106+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ce0007450 con 0x7f0cd8003b70 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.107+0000 7f0ced7fa640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0cdc076300 0x7f0cdc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.107+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f0ce00b7870 con 0x7f0cd8003b70 2024-05-10T11:20:17.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.107+0000 7f0ceffff640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0cdc076300 0x7f0cdc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.108+0000 7f0ceffff640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0cdc076300 0x7f0cdc0787c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00cb6a0 tx=0x7f0ce4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.111+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0ce0080fb0 con 0x7f0cd8003b70 2024-05-10T11:20:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.344+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cf00b29c0 con 0x7f0cd8003b70 2024-05-10T11:20:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.344+0000 7f0ced7fa640 1 -- 172.21.15.66:0/1024683733 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5187 (secure 0 0 0) 0x7f0ce00808b0 con 0x7f0cd8003b70 2024-05-10T11:20:17.344 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:17.344 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:42.277004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7323,"qdb_cluster":[7323]},"id":6}]} 2024-05-10T11:20:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 76 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0cdc076300 msgr2=0x7f0cdc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0cdc076300 0x7f0cdc0787c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00cb6a0 tx=0x7f0ce4008040 comp rx=0 tx=0).stop 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 msgr2=0x7f0cf00a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cf00a13c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0001400 tx=0x7f0ce0001970 comp rx=0 tx=0).stop 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 shutdown_connections 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0cdc076300 0x7f0cdc0787c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cf015f590 0x7f0cf00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf00b7530 0x7f0cf00a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 --2- 172.21.15.66:0/1024683733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd8003b70 0x7f0cf00a13c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 >> 172.21.15.66:0/1024683733 conn(0x7f0cf009e3b0 msgr2=0x7f0cf00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.346+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 shutdown_connections 2024-05-10T11:20:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.347+0000 7f0cf70e1640 1 -- 172.21.15.66:0/1024683733 wait complete. 2024-05-10T11:20:17.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:17.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.461+0000 7f9ba89da640 1 Processor -- start 2024-05-10T11:20:17.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.461+0000 7f9ba89da640 1 -- start start 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.462+0000 7f9ba89da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ba415d290 0x7f9ba4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.462+0000 7f9ba89da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba4072330 con 0x7f9ba4071880 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.462+0000 7f9ba89da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba4071d70 con 0x7f9ba40d3510 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.462+0000 7f9ba89da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba4072050 con 0x7f9ba415d290 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.462+0000 7f9ba259c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ba415d290 0x7f9ba4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.463+0000 7f9ba259c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ba415d290 0x7f9ba4071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38022/0 (socket says 172.21.15.66:38022) 2024-05-10T11:20:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.463+0000 7f9ba259c640 1 -- 172.21.15.66:0/2210719541 learned_addr learned my addr 172.21.15.66:0/2210719541 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:17.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.463+0000 7f9ba259c640 1 -- 172.21.15.66:0/2210719541 >> v1:172.21.15.190:6789/0 conn(0x7f9ba40d3510 legacy=0x7f9ba40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:17.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.463+0000 7f9ba259c640 1 -- 172.21.15.66:0/2210719541 >> v1:172.21.15.66:6789/0 conn(0x7f9ba4071880 legacy=0x7f9ba40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.463+0000 7f9ba259c640 1 -- 172.21.15.66:0/2210719541 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba40cda70 con 0x7f9ba415d290 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.463+0000 7f9ba259c640 1 --2- 172.21.15.66:0/2210719541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba415d290 0x7f9ba4071340 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009870 tx=0x7f9b9c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e3e5d4127fa93a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba159a640 1 -- 172.21.15.66:0/2210719541 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c037070 con 0x7f9ba415d290 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba159a640 1 -- 172.21.15.66:0/2210719541 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c032440 con 0x7f9ba415d290 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba159a640 1 -- 172.21.15.66:0/2210719541 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c032810 con 0x7f9ba415d290 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 -- 172.21.15.66:0/2210719541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba415d290 msgr2=0x7f9ba4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 --2- 172.21.15.66:0/2210719541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba415d290 0x7f9ba4071340 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009870 tx=0x7f9b9c02a2a0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 -- 172.21.15.66:0/2210719541 shutdown_connections 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 --2- 172.21.15.66:0/2210719541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba415d290 0x7f9ba4071340 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 -- 172.21.15.66:0/2210719541 >> 172.21.15.66:0/2210719541 conn(0x7f9ba409ba20 msgr2=0x7f9ba409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:17.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 -- 172.21.15.66:0/2210719541 shutdown_connections 2024-05-10T11:20:17.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.464+0000 7f9ba89da640 1 -- 172.21.15.66:0/2210719541 wait complete. 2024-05-10T11:20:17.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 Processor -- start 2024-05-10T11:20:17.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 -- start start 2024-05-10T11:20:17.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 0x7f9ba40ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba40d3510 0x7f9ba40c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba415d290 0x7f9ba40b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40d1c20 con 0x7f9ba4071880 2024-05-10T11:20:17.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40d1aa0 con 0x7f9ba40d3510 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.466+0000 7f9ba89da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40b6880 con 0x7f9ba415d290 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 0x7f9ba40ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 0x7f9ba40ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38032/0 (socket says 172.21.15.66:38032) 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 -- 172.21.15.66:0/1034413801 learned_addr learned my addr 172.21.15.66:0/1034413801 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba2d9d640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba415d290 0x7f9ba40b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 -- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba415d290 msgr2=0x7f9ba40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba1d9b640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba40d3510 0x7f9ba40c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba415d290 0x7f9ba40b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 -- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba40d3510 msgr2=0x7f9ba40c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba40d3510 0x7f9ba40c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 -- 172.21.15.66:0/1034413801 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba40b5c70 con 0x7f9ba4071880 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba259c640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 0x7f9ba40ca480 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009870 tx=0x7f9b9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c041070 con 0x7f9ba4071880 2024-05-10T11:20:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c03c870 con 0x7f9ba4071880 2024-05-10T11:20:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba40b5f50 con 0x7f9ba4071880 2024-05-10T11:20:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c037040 con 0x7f9ba4071880 2024-05-10T11:20:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.467+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba40b6510 con 0x7f9ba4071880 2024-05-10T11:20:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.468+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba40693f0 con 0x7f9ba4071880 2024-05-10T11:20:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.469+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b9c044070 con 0x7f9ba4071880 2024-05-10T11:20:17.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.469+0000 7f9b9affd640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b840762d0 0x7f9b84078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.469+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f9b9c0b8380 con 0x7f9ba4071880 2024-05-10T11:20:17.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.470+0000 7f9ba1d9b640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b840762d0 0x7f9b84078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.470+0000 7f9ba1d9b640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b840762d0 0x7f9b84078790 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40cd620 tx=0x7f9b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.474+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9b9c081a30 con 0x7f9ba4071880 2024-05-10T11:20:17.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.703+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ba40684e0 con 0x7f9ba4071880 2024-05-10T11:20:17.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.704+0000 7f9b9affd640 1 -- 172.21.15.66:0/1034413801 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5187 (secure 0 0 0) 0x7f9b9c081330 con 0x7f9ba4071880 2024-05-10T11:20:17.703 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:17.703 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:42.277004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7323,"qdb_cluster":[7323]},"id":6}]} 2024-05-10T11:20:17.704 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 76 2024-05-10T11:20:17.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b840762d0 msgr2=0x7f9b84078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b840762d0 0x7f9b84078790 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40cd620 tx=0x7f9b8c009040 comp rx=0 tx=0).stop 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 msgr2=0x7f9ba40ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 0x7f9ba40ca480 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009870 tx=0x7f9b9c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 shutdown_connections 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b840762d0 0x7f9b84078790 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba415d290 0x7f9ba40b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba40d3510 0x7f9ba40c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 --2- 172.21.15.66:0/1034413801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ba4071880 0x7f9ba40ca480 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 >> 172.21.15.66:0/1034413801 conn(0x7f9ba409ba20 msgr2=0x7f9ba40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 shutdown_connections 2024-05-10T11:20:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.706+0000 7f9ba89da640 1 -- 172.21.15.66:0/1034413801 wait complete. 2024-05-10T11:20:17.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:20:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.820+0000 7fcb01f12640 1 Processor -- start 2024-05-10T11:20:17.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.821+0000 7fcb01f12640 1 -- start start 2024-05-10T11:20:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.821+0000 7fcb01f12640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcafc15f790 0x7fcafc0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.821+0000 7fcb01f12640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0d5d30 0x7fcafc0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.821+0000 7fcb01f12640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcafc0d30b0 con 0x7fcafc15f3b0 2024-05-10T11:20:17.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.821+0000 7fcb01f12640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fcafc0d3390 con 0x7fcafc15f790 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.821+0000 7fcb01f12640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc0c8c80 con 0x7fcafc0d5d30 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcafc15f790 0x7fcafc0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcafc15f790 0x7fcafc0cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38046/0 (socket says 172.21.15.66:38046) 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafb7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fcafc15f3b0 0x7fcafc0d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37808/0 (socket says 172.21.15.66:37808) 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 -- 172.21.15.66:0/1362262761 learned_addr learned my addr 172.21.15.66:0/1362262761 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafbfff640 1 --2- 172.21.15.66:0/1362262761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0d5d30 0x7fcafc0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 -- 172.21.15.66:0/1362262761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0d5d30 msgr2=0x7fcafc0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 --2- 172.21.15.66:0/1362262761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0d5d30 0x7fcafc0d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 -- 172.21.15.66:0/1362262761 >> v1:172.21.15.66:6789/0 conn(0x7fcafc15f3b0 legacy=0x7fcafc0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafaffd640 1 -- 172.21.15.66:0/1362262761 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc0c8f60 con 0x7fcafc15f790 2024-05-10T11:20:17.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.822+0000 7fcafa7fc640 1 -- 172.21.15.66:0/1362262761 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378424034 0 0) 0x7fcafc0d30b0 con 0x7fcafc15f3b0 2024-05-10T11:20:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcafaffd640 1 --2- 172.21.15.66:0/1362262761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f790 0x7fcafc0cfcd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009870 tx=0x7fcaf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c156fc0f6646c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcafa7fc640 1 -- 172.21.15.66:0/1362262761 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0037070 con 0x7fcafc15f790 2024-05-10T11:20:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcafa7fc640 1 -- 172.21.15.66:0/1362262761 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf0032440 con 0x7fcafc15f790 2024-05-10T11:20:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcafa7fc640 1 -- 172.21.15.66:0/1362262761 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0032810 con 0x7fcafc15f790 2024-05-10T11:20:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 -- 172.21.15.66:0/1362262761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f790 msgr2=0x7fcafc0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 --2- 172.21.15.66:0/1362262761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f790 0x7fcafc0cfcd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009870 tx=0x7fcaf002a270 comp rx=0 tx=0).stop 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 -- 172.21.15.66:0/1362262761 shutdown_connections 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 --2- 172.21.15.66:0/1362262761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0d5d30 0x7fcafc0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 --2- 172.21.15.66:0/1362262761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f790 0x7fcafc0cfcd0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 -- 172.21.15.66:0/1362262761 >> 172.21.15.66:0/1362262761 conn(0x7fcafc0d5130 msgr2=0x7fcafc0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 -- 172.21.15.66:0/1362262761 shutdown_connections 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.823+0000 7fcb01f12640 1 -- 172.21.15.66:0/1362262761 wait complete. 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.825+0000 7fcb01f12640 1 Processor -- start 2024-05-10T11:20:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.825+0000 7fcb01f12640 1 -- start start 2024-05-10T11:20:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.825+0000 7fcb01f12640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcafc0d5d30 0x7fcafc152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.825+0000 7fcb01f12640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 0x7fcafc0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcb01f12640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0b3d10 0x7fcafc0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcb01f12640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0d3f80 con 0x7fcafc15f3b0 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcb01f12640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0d3e00 con 0x7fcafc0d5d30 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcb01f12640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc0ca770 con 0x7fcafc0b3d10 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 0x7fcafc0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 0x7fcafc0b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38062/0 (socket says 172.21.15.66:38062) 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 -- 172.21.15.66:0/323117463 learned_addr learned my addr 172.21.15.66:0/323117463 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 -- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0b3d10 msgr2=0x7fcafc0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0b3d10 0x7fcafc0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 -- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcafc0d5d30 msgr2=0x7fcafc152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcafc0d5d30 0x7fcafc152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 -- 172.21.15.66:0/323117463 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc152b50 con 0x7fcafc15f3b0 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcafaffd640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 0x7fcafc0b37d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0000c00 tx=0x7fcaf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0041020 con 0x7fcafc15f3b0 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf00306c0 con 0x7fcafc15f3b0 2024-05-10T11:20:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc0ce9b0 con 0x7fcafc15f3b0 2024-05-10T11:20:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0037040 con 0x7fcafc15f3b0 2024-05-10T11:20:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.826+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc0cef70 con 0x7fcafc15f3b0 2024-05-10T11:20:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.827+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc161880 con 0x7fcafc15f3b0 2024-05-10T11:20:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.828+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcaf0044020 con 0x7fcafc15f3b0 2024-05-10T11:20:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.828+0000 7fcae3fff640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcae80762d0 0x7fcae8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.829+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fcaf00b7fd0 con 0x7fcafc15f3b0 2024-05-10T11:20:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.829+0000 7fcafb7fe640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcae80762d0 0x7fcae8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.829+0000 7fcafb7fe640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcae80762d0 0x7fcae8078790 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcaec007fd0 tx=0x7fcaec007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:17.833+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcafc161880 con 0x7fcafc15f3b0 2024-05-10T11:20:18.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.026+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcafc06a220 con 0x7fcafc15f3b0 2024-05-10T11:20:18.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.027+0000 7fcae3fff640 1 -- 172.21.15.66:0/323117463 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+17338 (secure 0 0 0) 0x7fcaf004b030 con 0x7fcafc15f3b0 2024-05-10T11:20:18.026 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:18.027 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":92,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:19:38.256669+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:18:11.529408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T11:18:12.815066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.36","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/577308965":"2024-05-11T11:19:38.256644+0000","172.21.15.66:6834/577308965":"2024-05-11T11:19:38.256644+0000","172.21.15.190:6837/1519468735":"2024-05-11T11:18:27.672306+0000","172.21.15.190:6835/1519468735":"2024-05-11T11:18:27.672306+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:20:18.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcae80762d0 msgr2=0x7fcae8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcae80762d0 0x7fcae8078790 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcaec007fd0 tx=0x7fcaec007920 comp rx=0 tx=0).stop 2024-05-10T11:20:18.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 msgr2=0x7fcafc0b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 0x7fcafc0b37d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0000c00 tx=0x7fcaf00046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 shutdown_connections 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcae80762d0 0x7fcae8078790 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcafc0b3d10 0x7fcafc0b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc15f3b0 0x7fcafc0b37d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 --2- 172.21.15.66:0/323117463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcafc0d5d30 0x7fcafc152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 >> 172.21.15.66:0/323117463 conn(0x7fcafc0d5130 msgr2=0x7fcafc0d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 shutdown_connections 2024-05-10T11:20:18.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.029+0000 7fcb01f12640 1 -- 172.21.15.66:0/323117463 wait complete. 2024-05-10T11:20:18.040 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:20:18.040 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.144+0000 7f781c2d1640 1 Processor -- start 2024-05-10T11:20:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.144+0000 7f781c2d1640 1 -- start start 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.145+0000 7f781c2d1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f781415f3b0 0x7f78140d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.145+0000 7f781c2d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f78140d5d30 0x7f78140d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.145+0000 7f781c2d1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78140d30b0 con 0x7f781415f790 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.145+0000 7f781c2d1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f78140d3390 con 0x7f781415f3b0 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.145+0000 7f781c2d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f78140c8c80 con 0x7f78140d5d30 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f781415f3b0 0x7f78140d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f781415f3b0 0x7f78140d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38066/0 (socket says 172.21.15.66:38066) 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781986c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f781415f790 0x7f78140c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37820/0 (socket says 172.21.15.66:37820) 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 -- 172.21.15.66:0/809665299 learned_addr learned my addr 172.21.15.66:0/809665299 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a86e640 1 --2- 172.21.15.66:0/809665299 >> v2:172.21.15.190:3300/0 conn(0x7f78140d5d30 0x7f78140d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 -- 172.21.15.66:0/809665299 >> v2:172.21.15.190:3300/0 conn(0x7f78140d5d30 msgr2=0x7f78140d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 --2- 172.21.15.66:0/809665299 >> v2:172.21.15.190:3300/0 conn(0x7f78140d5d30 0x7f78140d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 -- 172.21.15.66:0/809665299 >> v1:172.21.15.66:6789/0 conn(0x7f781415f790 legacy=0x7f78140c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a06d640 1 -- 172.21.15.66:0/809665299 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78140c8f60 con 0x7f781415f3b0 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781a86e640 1 --2- 172.21.15.66:0/809665299 >> v2:172.21.15.190:3300/0 conn(0x7f78140d5d30 0x7f78140d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.146+0000 7f781906b640 1 -- 172.21.15.66:0/809665299 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4276511411 0 0) 0x7f78140d30b0 con 0x7f781415f790 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781a06d640 1 --2- 172.21.15.66:0/809665299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140d36f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f781408d220 tx=0x7f780c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b56ed65e2b8e7d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781906b640 1 -- 172.21.15.66:0/809665299 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c037070 con 0x7f781415f3b0 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781906b640 1 -- 172.21.15.66:0/809665299 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780c032440 con 0x7f781415f3b0 2024-05-10T11:20:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781906b640 1 -- 172.21.15.66:0/809665299 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c032810 con 0x7f781415f3b0 2024-05-10T11:20:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 -- 172.21.15.66:0/809665299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 msgr2=0x7f78140d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 --2- 172.21.15.66:0/809665299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140d36f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f781408d220 tx=0x7f780c02a270 comp rx=0 tx=0).stop 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 -- 172.21.15.66:0/809665299 shutdown_connections 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 --2- 172.21.15.66:0/809665299 >> v2:172.21.15.190:3300/0 conn(0x7f78140d5d30 0x7f78140d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 --2- 172.21.15.66:0/809665299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140d36f0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 -- 172.21.15.66:0/809665299 >> 172.21.15.66:0/809665299 conn(0x7f78140d5130 msgr2=0x7f78140d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 -- 172.21.15.66:0/809665299 shutdown_connections 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.147+0000 7f781c2d1640 1 -- 172.21.15.66:0/809665299 wait complete. 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.149+0000 7f781c2d1640 1 Processor -- start 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.149+0000 7f781c2d1640 1 -- start start 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.149+0000 7f781c2d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78140d5d30 0x7f78140ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.149+0000 7f781c2d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.149+0000 7f781c2d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f781414fd90 0x7f78140cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.149+0000 7f781c2d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78140d0e60 con 0x7f781415f3b0 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781c2d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f78140d0ce0 con 0x7f781414fd90 2024-05-10T11:20:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781c2d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f78140d0fe0 con 0x7f78140d5d30 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38074/0 (socket says 172.21.15.66:38074) 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 -- 172.21.15.66:0/736600436 learned_addr learned my addr 172.21.15.66:0/736600436 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781a06d640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78140d5d30 0x7f78140ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781a86e640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f781414fd90 0x7f78140cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 -- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78140d5d30 msgr2=0x7f78140ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78140d5d30 0x7f78140ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 -- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f781414fd90 msgr2=0x7f78140cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f781414fd90 0x7f78140cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 -- 172.21.15.66:0/736600436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78140b6c20 con 0x7f781415f3b0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781a86e640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f781414fd90 0x7f78140cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781a06d640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78140d5d30 0x7f78140ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781986c640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140cd3d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f780800c410 tx=0x7f780800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080074e0 con 0x7f781415f3b0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78080047e0 con 0x7f781415f3b0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78140b6f00 con 0x7f781415f3b0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808004bd0 con 0x7f781415f3b0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.150+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78140b74c0 con 0x7f781415f3b0 2024-05-10T11:20:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.151+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781406a220 con 0x7f781415f3b0 2024-05-10T11:20:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.152+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7808011070 con 0x7f781415f3b0 2024-05-10T11:20:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.152+0000 7f7812ffd640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78000762d0 0x7f7800078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.153+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f78080974e0 con 0x7f781415f3b0 2024-05-10T11:20:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.153+0000 7f781a06d640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78000762d0 0x7f7800078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.153+0000 7f781a06d640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78000762d0 0x7f7800078790 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f780c034000 tx=0x7f780c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.157+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7808060b90 con 0x7f781415f3b0 2024-05-10T11:20:18.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.387+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78140d2380 con 0x7f781415f3b0 2024-05-10T11:20:18.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.387+0000 7f7812ffd640 1 -- 172.21.15.66:0/736600436 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5187 (secure 0 0 0) 0x7f7808060490 con 0x7f781415f3b0 2024-05-10T11:20:18.387 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:18.387 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:42.277004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7323,"qdb_cluster":[7323]},"id":6}]} 2024-05-10T11:20:18.387 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 76 2024-05-10T11:20:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.389+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78000762d0 msgr2=0x7f7800078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.389+0000 7f781c2d1640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78000762d0 0x7f7800078790 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f780c034000 tx=0x7f780c02e000 comp rx=0 tx=0).stop 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.389+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 msgr2=0x7f78140cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.389+0000 7f781c2d1640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140cd3d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f780800c410 tx=0x7f780800c8d0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 shutdown_connections 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78000762d0 0x7f7800078790 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f781414fd90 0x7f78140cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f781415f3b0 0x7f78140cd3d0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 --2- 172.21.15.66:0/736600436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78140d5d30 0x7f78140ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 >> 172.21.15.66:0/736600436 conn(0x7f78140d5130 msgr2=0x7f7814161b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 shutdown_connections 2024-05-10T11:20:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.390+0000 7f781c2d1640 1 -- 172.21.15.66:0/736600436 wait complete. 2024-05-10T11:20:18.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:18.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.505+0000 7fe0493dd640 1 Processor -- start 2024-05-10T11:20:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.505+0000 7fe0493dd640 1 -- start start 2024-05-10T11:20:18.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0493dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe0440c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0493dd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0440cd090 con 0x7fe0441611e0 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0493dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0440cd370 con 0x7fe04415ce60 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0493dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe0440cb790 con 0x7fe0440cb300 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe03a7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe0441611e0 0x7fe04415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37832/0 (socket says 172.21.15.66:37832) 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe03a7fc640 1 -- 172.21.15.66:0/1427578464 learned_addr learned my addr 172.21.15.66:0/1427578464 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0437fe640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe0440c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080651227 0 0) 0x7fe0440cd090 con 0x7fe0441611e0 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030003520 con 0x7fe0441611e0 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677524401 0 0) 0x7fe0440cd370 con 0x7fe04415ce60 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.506+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0440cd090 con 0x7fe04415ce60 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 378871640 0 0) 0x7fe030003520 con 0x7fe0441611e0 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 msgr2=0x7fe0440c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:18.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe0440c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 >> v1:172.21.15.190:6789/0 conn(0x7fe04415ce60 legacy=0x7fe044160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0440cd650 con 0x7fe0441611e0 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe02c001670 con 0x7fe0441611e0 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0437fe640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe0440c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 >> v1:172.21.15.66:6789/0 conn(0x7fe0441611e0 legacy=0x7fe04415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe030003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe030004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030004d40 0x7fe0300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe03000baa0 con 0x7fe030003b70 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe03000bc50 con 0x7fe030004d40 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe03000be50 con 0x7fe0440cb300 2024-05-10T11:20:18.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe042ffd640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe030003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe03a7fc640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe030004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe0437fe640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030004d40 0x7fe0300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe042ffd640 1 -- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 msgr2=0x7fe030004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe042ffd640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0440cb300 0x7fe030004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe042ffd640 1 -- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030004d40 msgr2=0x7fe0300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe042ffd640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030004d40 0x7fe0300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.507+0000 7fe042ffd640 1 -- 172.21.15.66:0/1427578464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe030003520 con 0x7fe030003b70 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe042ffd640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe030003f70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fe0340018d0 tx=0x7fe030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df06feb30c84a20 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340014f0 con 0x7fe030003b70 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0340052d0 con 0x7fe030003b70 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0427fc640 1 -- 172.21.15.66:0/1427578464 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03402aca0 con 0x7fe030003b70 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0493dd640 1 -- 172.21.15.66:0/1427578464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 msgr2=0x7fe030003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0493dd640 1 --2- 172.21.15.66:0/1427578464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe030003f70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fe0340018d0 tx=0x7fe030005830 comp rx=0 tx=0).stop 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0437fe640 1 -- 172.21.15.66:0/1427578464 reap_dead start 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0493dd640 1 -- 172.21.15.66:0/1427578464 shutdown_connections 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0493dd640 1 -- 172.21.15.66:0/1427578464 >> 172.21.15.66:0/1427578464 conn(0x7fe0440b2900 msgr2=0x7fe0440b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.508+0000 7fe0493dd640 1 -- 172.21.15.66:0/1427578464 shutdown_connections 2024-05-10T11:20:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.509+0000 7fe0493dd640 1 -- 172.21.15.66:0/1427578464 wait complete. 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.510+0000 7fe0493dd640 1 Processor -- start 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.510+0000 7fe0493dd640 1 -- start start 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe0441f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe04409d8c0 0x7fe0440b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0440b4ff0 0x7fe0440cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe0440cde50 con 0x7fe030003b70 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe0440ccd60 con 0x7fe0440b4ff0 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe0440cdfd0 con 0x7fe04409d8c0 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe0441f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe0441f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38098/0 (socket says 172.21.15.66:38098) 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 -- 172.21.15.66:0/4209440307 learned_addr learned my addr 172.21.15.66:0/4209440307 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0437fe640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0440b4ff0 0x7fe0440cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe03a7fc640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe04409d8c0 0x7fe0440b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 -- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe04409d8c0 msgr2=0x7fe0440b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe04409d8c0 0x7fe0440b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 -- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0440b4ff0 msgr2=0x7fe0440cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0440b4ff0 0x7fe0440cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 -- 172.21.15.66:0/4209440307 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04409dda0 con 0x7fe030003b70 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe042ffd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe0441f5bb0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe034000c00 tx=0x7fe0340012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034037040 con 0x7fe030003b70 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034006e50 con 0x7fe030003b70 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340014f0 con 0x7fe030003b70 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.511+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04409e080 con 0x7fe030003b70 2024-05-10T11:20:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.512+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04409e640 con 0x7fe030003b70 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.512+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04406a220 con 0x7fe030003b70 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.513+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe034044020 con 0x7fe030003b70 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.514+0000 7fe03bfff640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe024076300 0x7fe0240787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.514+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fe0340b7450 con 0x7fe030003b70 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.514+0000 7fe03a7fc640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe024076300 0x7fe0240787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.514+0000 7fe03a7fc640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe024076300 0x7fe0240787c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe02c001200 tx=0x7fe02c001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.518+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe03404b020 con 0x7fe030003b70 2024-05-10T11:20:18.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.750+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0440cefb0 con 0x7fe030003b70 2024-05-10T11:20:18.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.751+0000 7fe03bfff640 1 -- 172.21.15.66:0/4209440307 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5187 (secure 0 0 0) 0x7fe034080b90 con 0x7fe030003b70 2024-05-10T11:20:18.750 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:18.750 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:18:13.858815+0000","modified":"2024-05-10T11:19:42.277004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/821296830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":821296830},{"type":"v1","addr":"172.21.15.66:6835","nonce":821296830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7323,"qdb_cluster":[7323]},"id":6}]} 2024-05-10T11:20:18.750 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 76 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe024076300 msgr2=0x7fe0240787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe024076300 0x7fe0240787c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe02c001200 tx=0x7fe02c001150 comp rx=0 tx=0).stop 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 msgr2=0x7fe0441f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe0441f5bb0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe034000c00 tx=0x7fe0340012d0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 shutdown_connections 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe024076300 0x7fe0240787c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0440b4ff0 0x7fe0440cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe04409d8c0 0x7fe0440b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 --2- 172.21.15.66:0/4209440307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe030003b70 0x7fe0441f5bb0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 >> 172.21.15.66:0/4209440307 conn(0x7fe0440b2900 msgr2=0x7fe04415eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:18.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 shutdown_connections 2024-05-10T11:20:18.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.753+0000 7fe0493dd640 1 -- 172.21.15.66:0/4209440307 wait complete. 2024-05-10T11:20:18.764 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:20:18.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.868+0000 7f25cf17f640 1 Processor -- start 2024-05-10T11:20:18.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.868+0000 7f25cf17f640 1 -- start start 2024-05-10T11:20:18.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cf17f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c8162750 0x7f25c80d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cf17f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f25c8162b30 0x7f25c80b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cf17f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c80b45f0 con 0x7f25c80d5cb0 2024-05-10T11:20:18.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cf17f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f25c80b4f20 con 0x7f25c8162b30 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cf17f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80d0fe0 con 0x7f25c8162750 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f25c8162b30 0x7f25c80b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f25c8162b30 0x7f25c80b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38106/0 (socket says 172.21.15.66:38106) 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 -- 172.21.15.66:0/250254744 learned_addr learned my addr 172.21.15.66:0/250254744 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 -- 172.21.15.66:0/250254744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c8162750 msgr2=0x7f25c80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25ccf1b640 1 --2- 172.21.15.66:0/250254744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c8162750 0x7f25c80d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 --2- 172.21.15.66:0/250254744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c8162750 0x7f25c80d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 -- 172.21.15.66:0/250254744 >> v1:172.21.15.190:6789/0 conn(0x7f25c80d5cb0 legacy=0x7f25c80d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.869+0000 7f25cd71c640 1 -- 172.21.15.66:0/250254744 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c80b48d0 con 0x7f25c8162b30 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.870+0000 7f25cd71c640 1 --2- 172.21.15.66:0/250254744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c80b53b0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009e50 tx=0x7f25c002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63edaff183bf1f0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.870+0000 7f25bf7fe640 1 -- 172.21.15.66:0/250254744 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0036070 con 0x7f25c8162b30 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.870+0000 7f25bf7fe640 1 -- 172.21.15.66:0/250254744 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c0031600 con 0x7f25c8162b30 2024-05-10T11:20:18.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.870+0000 7f25bf7fe640 1 -- 172.21.15.66:0/250254744 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c00319d0 con 0x7f25c8162b30 2024-05-10T11:20:18.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 -- 172.21.15.66:0/250254744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 msgr2=0x7f25c80b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 --2- 172.21.15.66:0/250254744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c80b53b0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009e50 tx=0x7f25c002a630 comp rx=0 tx=0).stop 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 -- 172.21.15.66:0/250254744 shutdown_connections 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 --2- 172.21.15.66:0/250254744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c80b53b0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 --2- 172.21.15.66:0/250254744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c8162750 0x7f25c80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 -- 172.21.15.66:0/250254744 >> 172.21.15.66:0/250254744 conn(0x7f25c809e3b0 msgr2=0x7f25c80d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 -- 172.21.15.66:0/250254744 shutdown_connections 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.871+0000 7f25cf17f640 1 -- 172.21.15.66:0/250254744 wait complete. 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.872+0000 7f25cf17f640 1 Processor -- start 2024-05-10T11:20:18.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.872+0000 7f25cf17f640 1 -- start start 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cf17f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c8162750 0x7f25c81f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cf17f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c8160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cf17f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c81f27f0 0x7f25c8160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cf17f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80d0d30 con 0x7f25c8162b30 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cf17f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80d0bb0 con 0x7f25c8162750 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cf17f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80d3d40 con 0x7f25c81f27f0 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c8160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c8160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38116/0 (socket says 172.21.15.66:38116) 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 -- 172.21.15.66:0/3683686589 learned_addr learned my addr 172.21.15.66:0/3683686589 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cd71c640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c81f27f0 0x7f25c8160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25ccf1b640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c8162750 0x7f25c81f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 -- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c81f27f0 msgr2=0x7f25c8160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c81f27f0 0x7f25c8160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 -- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c8162750 msgr2=0x7f25c81f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c8162750 0x7f25c81f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25bffff640 1 -- 172.21.15.66:0/3683686589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c80c9830 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.873+0000 7f25cd71c640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c81f27f0 0x7f25c8160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.874+0000 7f25bffff640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c8160120 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c430 tx=0x7f25b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.874+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8011790 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.874+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8017070 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.874+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81f5fb0 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.874+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8011bb0 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.874+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c80cd9c0 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.875+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c806a220 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.875+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f25b801c460 con 0x7f25c8162b30 2024-05-10T11:20:18.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.876+0000 7f25bd7fa640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f25b4076300 0x7f25b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:18.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.876+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f25b8097620 con 0x7f25c8162b30 2024-05-10T11:20:18.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.876+0000 7f25ccf1b640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f25b4076300 0x7f25b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:18.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.877+0000 7f25ccf1b640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f25b4076300 0x7f25b40787c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f25c400a970 tx=0x7f25c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:18.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:18.880+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f25c81f5fb0 con 0x7f25c8162b30 2024-05-10T11:20:19.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.074+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25c80c82c0 con 0x7f25c8162b30 2024-05-10T11:20:19.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.075+0000 7f25bd7fa640 1 -- 172.21.15.66:0/3683686589 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+17338 (secure 0 0 0) 0x7f25c80c9830 con 0x7f25c8162b30 2024-05-10T11:20:19.075 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:19.075 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":92,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:19:38.256669+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:18:11.529408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T11:18:12.815066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.36","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/577308965":"2024-05-11T11:19:38.256644+0000","172.21.15.66:6834/577308965":"2024-05-11T11:19:38.256644+0000","172.21.15.190:6837/1519468735":"2024-05-11T11:18:27.672306+0000","172.21.15.190:6835/1519468735":"2024-05-11T11:18:27.672306+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f25b4076300 msgr2=0x7f25b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f25b4076300 0x7f25b40787c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f25c400a970 tx=0x7f25c4008040 comp rx=0 tx=0).stop 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 msgr2=0x7f25c8160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c8160120 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c430 tx=0x7f25b800c8f0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 shutdown_connections 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f25b4076300 0x7f25b40787c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c81f27f0 0x7f25c8160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25c8162b30 0x7f25c8160120 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 --2- 172.21.15.66:0/3683686589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c8162750 0x7f25c81f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 >> 172.21.15.66:0/3683686589 conn(0x7f25c809e3b0 msgr2=0x7f25c80d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:19.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 shutdown_connections 2024-05-10T11:20:19.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.077+0000 7f25cf17f640 1 -- 172.21.15.66:0/3683686589 wait complete. 2024-05-10T11:20:19.089 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:20:19.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.195+0000 7f2372114640 1 Processor -- start 2024-05-10T11:20:19.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.195+0000 7f2372114640 1 -- start start 2024-05-10T11:20:19.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f2372114640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f236c06c990 0x7f236c163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f2372114640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f2372114640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236c163ba0 con 0x7f236c15f620 2024-05-10T11:20:19.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f2372114640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f236c06cd70 con 0x7f236c06c990 2024-05-10T11:20:19.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f2372114640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f236c160190 con 0x7f236c070bd0 2024-05-10T11:20:19.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f236b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f236c06c990 0x7f236c163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f236affd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f236c15f620 0x7f236c0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37844/0 (socket says 172.21.15.66:37844) 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f236b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f236c06c990 0x7f236c163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38124/0 (socket says 172.21.15.66:38124) 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f236affd640 1 -- 172.21.15.66:0/2168761928 learned_addr learned my addr 172.21.15.66:0/2168761928 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.196+0000 7f236bfff640 1 --2- 172.21.15.66:0/2168761928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236b7fe640 1 -- 172.21.15.66:0/2168761928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 msgr2=0x7f236c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236b7fe640 1 --2- 172.21.15.66:0/2168761928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236b7fe640 1 -- 172.21.15.66:0/2168761928 >> v1:172.21.15.66:6789/0 conn(0x7f236c15f620 legacy=0x7f236c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236b7fe640 1 -- 172.21.15.66:0/2168761928 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c160470 con 0x7f236c06c990 2024-05-10T11:20:19.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236b7fe640 1 --2- 172.21.15.66:0/2168761928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c163660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f235c0097a0 tx=0x7f235c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6191b4374357e939 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:19.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236a7fc640 1 -- 172.21.15.66:0/2168761928 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c037070 con 0x7f236c06c990 2024-05-10T11:20:19.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236a7fc640 1 -- 172.21.15.66:0/2168761928 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c032440 con 0x7f236c06c990 2024-05-10T11:20:19.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.197+0000 7f236a7fc640 1 -- 172.21.15.66:0/2168761928 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c032810 con 0x7f236c06c990 2024-05-10T11:20:19.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 -- 172.21.15.66:0/2168761928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 msgr2=0x7f236c163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 --2- 172.21.15.66:0/2168761928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c163660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f235c0097a0 tx=0x7f235c02a180 comp rx=0 tx=0).stop 2024-05-10T11:20:19.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 -- 172.21.15.66:0/2168761928 shutdown_connections 2024-05-10T11:20:19.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 --2- 172.21.15.66:0/2168761928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 --2- 172.21.15.66:0/2168761928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c163660 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 -- 172.21.15.66:0/2168761928 >> 172.21.15.66:0/2168761928 conn(0x7f236c0b3980 msgr2=0x7f236c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 -- 172.21.15.66:0/2168761928 shutdown_connections 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.198+0000 7f2372114640 1 -- 172.21.15.66:0/2168761928 wait complete. 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.199+0000 7f2372114640 1 Processor -- start 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.199+0000 7f2372114640 1 -- start start 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f2372114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f2372114640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f2372114640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236c15f620 0x7f236c0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f2372114640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f236c073e70 con 0x7f236c06c990 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f2372114640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f236c163140 con 0x7f236c15f620 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f2372114640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f236c0cf920 con 0x7f236c070bd0 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f236b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f236b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c0af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38130/0 (socket says 172.21.15.66:38130) 2024-05-10T11:20:19.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.200+0000 7f236b7fe640 1 -- 172.21.15.66:0/2370704887 learned_addr learned my addr 172.21.15.66:0/2370704887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236affd640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236bfff640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236c15f620 0x7f236c0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236b7fe640 1 -- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 msgr2=0x7f236c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236b7fe640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c0b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236b7fe640 1 -- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236c15f620 msgr2=0x7f236c0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236b7fe640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236c15f620 0x7f236c0b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236b7fe640 1 -- 172.21.15.66:0/2370704887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c0afa90 con 0x7f236c06c990 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236affd640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f236b7fe640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c0af550 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f235c0098c0 tx=0x7f235c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c037040 con 0x7f236c06c990 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c030770 con 0x7f236c06c990 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c1f93c0 con 0x7f236c06c990 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c030b40 con 0x7f236c06c990 2024-05-10T11:20:19.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.201+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1f8b20 con 0x7f236c06c990 2024-05-10T11:20:19.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.202+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c06a220 con 0x7f236c06c990 2024-05-10T11:20:19.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.203+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f235c044020 con 0x7f236c06c990 2024-05-10T11:20:19.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.203+0000 7f2353fff640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23580762d0 0x7f2358078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.203+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f235c0b7de0 con 0x7f236c06c990 2024-05-10T11:20:19.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.204+0000 7f236affd640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23580762d0 0x7f2358078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.204+0000 7f236affd640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23580762d0 0x7f2358078790 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f236c0b7220 tx=0x7f2360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:19.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.208+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f235c032e20 con 0x7f236c06c990 2024-05-10T11:20:19.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.438+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f236c073540 con 0x7f236c06c990 2024-05-10T11:20:19.437 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:20:19.438+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:20:19.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.439+0000 7f2353fff640 1 -- 172.21.15.66:0/2370704887 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7f235c081490 con 0x7f236c06c990 2024-05-10T11:20:19.439 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23580762d0 msgr2=0x7f2358078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23580762d0 0x7f2358078790 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f236c0b7220 tx=0x7f2360009040 comp rx=0 tx=0).stop 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 msgr2=0x7f236c0af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c0af550 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f235c0098c0 tx=0x7f235c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 shutdown_connections 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23580762d0 0x7f2358078790 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f236c15f620 0x7f236c0b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f236c070bd0 0x7f236c0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 --2- 172.21.15.66:0/2370704887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f236c06c990 0x7f236c0af550 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.442+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 >> 172.21.15.66:0/2370704887 conn(0x7f236c0b3980 msgr2=0x7f236c0d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:19.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.443+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 shutdown_connections 2024-05-10T11:20:19.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.443+0000 7f2372114640 1 -- 172.21.15.66:0/2370704887 wait complete. 2024-05-10T11:20:19.444 INFO:tasks.ceph.mds.a.smithi066.stderr: -1845> 2024-05-10T11:19:45.032+0000 7f9b6a7dc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x5651dc87a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T11:20:19.445 INFO:tasks.ceph.mds.a.smithi066.stderr: -1796> 2024-05-10T11:19:45.266+0000 7f9b6e7e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:20:19.455 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:20:19.472 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:20:19.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.562+0000 7f5d63ddd640 1 Processor -- start 2024-05-10T11:20:19.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.562+0000 7f5d63ddd640 1 -- start start 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d63ddd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5d5c0d3df0 0x7f5d5c0d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d63ddd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d5c0d2120 0x7f5d5c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d63ddd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d5c0d41d0 con 0x7f5d5c0b4aa0 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d63ddd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5c0cfd50 con 0x7f5d5c0d2120 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d63ddd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5c0b5d90 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d6237a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d5c0d2120 0x7f5d5c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d6237a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d5c0d2120 0x7f5d5c0d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38162/0 (socket says 172.21.15.66:38162) 2024-05-10T11:20:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d6237a640 1 -- 172.21.15.66:0/4193495299 learned_addr learned my addr 172.21.15.66:0/4193495299 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.563+0000 7f5d61b79640 1 --2- 172.21.15.66:0/4193495299 >> v2:172.21.15.190:3300/0 conn(0x7f5d5c0d3df0 0x7f5d5c0d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.564+0000 7f5d6237a640 1 -- 172.21.15.66:0/4193495299 >> v2:172.21.15.190:3300/0 conn(0x7f5d5c0d3df0 msgr2=0x7f5d5c0d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.564+0000 7f5d6237a640 1 --2- 172.21.15.66:0/4193495299 >> v2:172.21.15.190:3300/0 conn(0x7f5d5c0d3df0 0x7f5d5c0d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.564+0000 7f5d6237a640 1 -- 172.21.15.66:0/4193495299 >> v1:172.21.15.190:6789/0 conn(0x7f5d5c0b4aa0 legacy=0x7f5d5c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.564+0000 7f5d6237a640 1 -- 172.21.15.66:0/4193495299 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c0b54f0 con 0x7f5d5c0d2120 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.564+0000 7f5d6237a640 1 --2- 172.21.15.66:0/4193495299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c0d04a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c06cbe0 tx=0x7f5d5402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd99bd75bab406 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.564+0000 7f5d60b77640 1 -- 172.21.15.66:0/4193495299 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54036070 con 0x7f5d5c0d2120 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d60b77640 1 -- 172.21.15.66:0/4193495299 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d54031600 con 0x7f5d5c0d2120 2024-05-10T11:20:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d60b77640 1 -- 172.21.15.66:0/4193495299 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d540319d0 con 0x7f5d5c0d2120 2024-05-10T11:20:19.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 -- 172.21.15.66:0/4193495299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d2120 msgr2=0x7f5d5c0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/4193495299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c0d04a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c06cbe0 tx=0x7f5d5402a6f0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 -- 172.21.15.66:0/4193495299 shutdown_connections 2024-05-10T11:20:19.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/4193495299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c0d04a0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/4193495299 >> v2:172.21.15.190:3300/0 conn(0x7f5d5c0d3df0 0x7f5d5c0d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 -- 172.21.15.66:0/4193495299 >> 172.21.15.66:0/4193495299 conn(0x7f5d5c09e450 msgr2=0x7f5d5c0d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 -- 172.21.15.66:0/4193495299 shutdown_connections 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.565+0000 7f5d63ddd640 1 -- 172.21.15.66:0/4193495299 wait complete. 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.566+0000 7f5d63ddd640 1 Processor -- start 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.566+0000 7f5d63ddd640 1 -- start start 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d63ddd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d5c0b4aa0 0x7f5d5c0b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d63ddd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c1f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d63ddd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 0x7f5d5c1f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d63ddd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c0cff80 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d63ddd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c0b5ab0 con 0x7f5d5c0d2120 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d63ddd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5d5c0b6120 con 0x7f5d5c0b4aa0 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d6237a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 0x7f5d5c1f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d6237a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 0x7f5d5c1f8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38166/0 (socket says 172.21.15.66:38166) 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d6237a640 1 -- 172.21.15.66:0/3080709278 learned_addr learned my addr 172.21.15.66:0/3080709278 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d61378640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c1f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.567+0000 7f5d61b79640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d5c0b4aa0 0x7f5d5c0b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d6237a640 1 -- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d5c0b4aa0 msgr2=0x7f5d5c0b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d6237a640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d5c0b4aa0 0x7f5d5c0b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d6237a640 1 -- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d5c0d2120 msgr2=0x7f5d5c1f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:19.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d6237a640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c1f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d6237a640 1 -- 172.21.15.66:0/3080709278 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c0ba0e0 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d6237a640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 0x7f5d5c1f8520 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5d54034040 tx=0x7f5d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54036050 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d54042070 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5c0ba3c0 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54009510 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.568+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5c0b9ad0 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.569+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5c0ba7b0 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.570+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5d54007bd0 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.570+0000 7f5d527fc640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5d400762d0 0x7f5d40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.570+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6475+0+0 (secure 0 0 0) 0x7f5d540b8630 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.570+0000 7f5d61b79640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5d400762d0 0x7f5d40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:19.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.571+0000 7f5d61b79640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5d400762d0 0x7f5d40078790 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5d580079a0 tx=0x7f5d58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:19.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.574+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5d54081640 con 0x7f5d5c0d3df0 2024-05-10T11:20:19.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:19.806+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5d5c0ba590 con 0x7f5d5c0d3df0 2024-05-10T11:20:20.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.441+0000 7f5d527fc640 1 -- 172.21.15.66:0/3080709278 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7f5d54085940 con 0x7f5d5c0d3df0 2024-05-10T11:20:20.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5d400762d0 msgr2=0x7f5d40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:20.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5d400762d0 0x7f5d40078790 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5d580079a0 tx=0x7f5d58008040 comp rx=0 tx=0).stop 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 msgr2=0x7f5d5c1f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 0x7f5d5c1f8520 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5d54034040 tx=0x7f5d54004a40 comp rx=0 tx=0).stop 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 shutdown_connections 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5d400762d0 0x7f5d40078790 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d5c0d3df0 0x7f5d5c1f8520 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d5c0d2120 0x7f5d5c1f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 --2- 172.21.15.66:0/3080709278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d5c0b4aa0 0x7f5d5c0b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 >> 172.21.15.66:0/3080709278 conn(0x7f5d5c09e450 msgr2=0x7f5d5c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:20.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 shutdown_connections 2024-05-10T11:20:20.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.444+0000 7f5d63ddd640 1 -- 172.21.15.66:0/3080709278 wait complete. 2024-05-10T11:20:20.458 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:20:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.613+0000 7f9213b40640 1 Processor -- start 2024-05-10T11:20:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.614+0000 7f9213b40640 1 -- start start 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.614+0000 7f9213b40640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f920c0d3d50 0x7f920c0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.614+0000 7f9213b40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f920c0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.614+0000 7f9213b40640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0d1080 con 0x7f920c15f490 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.614+0000 7f9213b40640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f920c0b4e70 con 0x7f920c0d3d50 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.614+0000 7f9213b40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0b4820 con 0x7f920c0d5ca0 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92118dc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f920c15f490 0x7f920c0d3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37848/0 (socket says 172.21.15.66:37848) 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92118dc640 1 -- 172.21.15.66:0/1978259393 learned_addr learned my addr 172.21.15.66:0/1978259393 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92120dd640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f920c0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507629294 0 0) 0x7f920c0d1080 con 0x7f920c15f490 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f8003520 con 0x7f920c15f490 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92110db640 1 --2- 172.21.15.66:0/1978259393 >> v2:172.21.15.190:3300/0 conn(0x7f920c0d3d50 0x7f920c0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3071035864 0 0) 0x7f91f8003520 con 0x7f920c15f490 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 msgr2=0x7f920c0b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f920c0b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 >> v2:172.21.15.190:3300/0 conn(0x7f920c0d3d50 msgr2=0x7f920c0d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 --2- 172.21.15.66:0/1978259393 >> v2:172.21.15.190:3300/0 conn(0x7f920c0d3d50 0x7f920c0d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c0b4b00 con 0x7f920c15f490 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f9208001670 con 0x7f920c15f490 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 >> v1:172.21.15.66:6789/0 conn(0x7f920c15f490 legacy=0x7f920c0d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f91f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f91f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f8004d40 0x7f91f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0b4e70 con 0x7f91f8003f30 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0b4820 con 0x7f91f8004d40 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f91f800bac0 con 0x7f920c0d5ca0 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92110db640 1 --2- 172.21.15.66:0/1978259393 >> v2:172.21.15.190:3300/0 conn(0x7f920c0d3d50 0x7f920c0d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92118dc640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f91f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92110db640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f91f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.615+0000 7f92120dd640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f8004d40 0x7f91f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92110db640 1 -- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 msgr2=0x7f91f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92110db640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f91f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92110db640 1 -- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f8004d40 msgr2=0x7f91f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92110db640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f8004d40 0x7f91f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92110db640 1 -- 172.21.15.66:0/1978259393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f8003520 con 0x7f91f8003f30 2024-05-10T11:20:20.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92118dc640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0d5ca0 0x7f91f80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.616+0000 7f92110db640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f91f8004800 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0098d0 tx=0x7f91f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329ba827480b8921 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc037070 con 0x7f91f8003f30 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc02ad50 con 0x7f91f8003f30 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f92108da640 1 -- 172.21.15.66:0/1978259393 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00f040 con 0x7f91f8003f30 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f9213b40640 1 -- 172.21.15.66:0/1978259393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 msgr2=0x7f91f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f9213b40640 1 --2- 172.21.15.66:0/1978259393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f91f8004800 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0098d0 tx=0x7f91f8005830 comp rx=0 tx=0).stop 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f92120dd640 1 -- 172.21.15.66:0/1978259393 reap_dead start 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f9213b40640 1 -- 172.21.15.66:0/1978259393 shutdown_connections 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f9213b40640 1 -- 172.21.15.66:0/1978259393 >> 172.21.15.66:0/1978259393 conn(0x7f920c0d50f0 msgr2=0x7f920c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f9213b40640 1 -- 172.21.15.66:0/1978259393 shutdown_connections 2024-05-10T11:20:20.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.617+0000 7f9213b40640 1 -- 172.21.15.66:0/1978259393 wait complete. 2024-05-10T11:20:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.618+0000 7f9213b40640 1 Processor -- start 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.618+0000 7f9213b40640 1 -- start start 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f9213b40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f920c1e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f9213b40640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920c157f40 0x7f920c0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f9213b40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0b8460 0x7f920c0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f9213b40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f920c15f9f0 con 0x7f91f8003f30 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f9213b40640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f920c15f870 con 0x7f920c157f40 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f9213b40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0b5300 con 0x7f920c0b8460 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f92118dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f920c1e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f92118dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f920c1e80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38194/0 (socket says 172.21.15.66:38194) 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f92118dc640 1 -- 172.21.15.66:0/3936005016 learned_addr learned my addr 172.21.15.66:0/3936005016 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f92120dd640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0b8460 0x7f920c0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.619+0000 7f92110db640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920c157f40 0x7f920c0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92118dc640 1 -- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0b8460 msgr2=0x7f920c0d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92118dc640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0b8460 0x7f920c0d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92118dc640 1 -- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920c157f40 msgr2=0x7f920c0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92118dc640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920c157f40 0x7f920c0c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92118dc640 1 -- 172.21.15.66:0/3936005016 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c1f4c20 con 0x7f91f8003f30 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92120dd640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0b8460 0x7f920c0d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92118dc640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f920c1e80d0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f92080072f0 tx=0x7f92080077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920801a070 con 0x7f91f8003f30 2024-05-10T11:20:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920800fb40 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c1e8720 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208012350 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.620+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c1e8ce0 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.621+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c158320 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.622+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92080124f0 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.622+0000 7f92027fc640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f91f00762d0 0x7f91f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.622+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6475+0+0 (secure 0 0 0) 0x7f9208097500 con 0x7f91f8003f30 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.622+0000 7f92110db640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f91f00762d0 0x7f91f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.623+0000 7f92110db640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f91f00762d0 0x7f91f0078790 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91fc034000 tx=0x7f91fc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.627+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f920c158320 con 0x7f91f8003f30 2024-05-10T11:20:20.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:20.817+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f920c06a220 con 0x7f91f8003f30 2024-05-10T11:20:21.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.449+0000 7f92027fc640 1 -- 172.21.15.66:0/3936005016 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7f9208060b60 con 0x7f91f8003f30 2024-05-10T11:20:21.448 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f91f00762d0 msgr2=0x7f91f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f91f00762d0 0x7f91f0078790 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91fc034000 tx=0x7f91fc02e000 comp rx=0 tx=0).stop 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 msgr2=0x7f920c1e80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f920c1e80d0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f92080072f0 tx=0x7f92080077b0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 shutdown_connections 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f91f00762d0 0x7f91f0078790 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920c0b8460 0x7f920c0d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920c157f40 0x7f920c0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 --2- 172.21.15.66:0/3936005016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f8003f30 0x7f920c1e80d0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.451+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 >> 172.21.15.66:0/3936005016 conn(0x7f920c0d50f0 msgr2=0x7f920c0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:21.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.452+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 shutdown_connections 2024-05-10T11:20:21.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.452+0000 7f9213b40640 1 -- 172.21.15.66:0/3936005016 wait complete. 2024-05-10T11:20:21.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:20:21.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.580+0000 7f3635abd640 1 Processor -- start 2024-05-10T11:20:21.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.580+0000 7f3635abd640 1 -- start start 2024-05-10T11:20:21.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f3635abd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36300cfcb0 0x7f36300b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f3635abd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36300add50 0x7f36300b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f3635abd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f36300d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f3635abd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f363015e380 con 0x7f36300add50 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f3635abd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f363015d4f0 con 0x7f36300cfcb0 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f3635abd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36300d0090 con 0x7f36300d0e30 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36300add50 0x7f36300b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36300add50 0x7f36300b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38198/0 (socket says 172.21.15.66:38198) 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 -- 172.21.15.66:0/1286407256 learned_addr learned my addr 172.21.15.66:0/1286407256 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362f7fe640 1 --2- 172.21.15.66:0/1286407256 >> v2:172.21.15.190:3300/0 conn(0x7f36300cfcb0 0x7f36300b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362ffff640 1 --2- 172.21.15.66:0/1286407256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f36300d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 -- 172.21.15.66:0/1286407256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 msgr2=0x7f36300d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 --2- 172.21.15.66:0/1286407256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f36300d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 -- 172.21.15.66:0/1286407256 >> v2:172.21.15.190:3300/0 conn(0x7f36300cfcb0 msgr2=0x7f36300b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 --2- 172.21.15.66:0/1286407256 >> v2:172.21.15.190:3300/0 conn(0x7f36300cfcb0 0x7f36300b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.581+0000 7f362effd640 1 -- 172.21.15.66:0/1286407256 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363015d770 con 0x7f36300add50 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.582+0000 7f362effd640 1 --2- 172.21.15.66:0/1286407256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300add50 0x7f36300b3c00 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f36300743e0 tx=0x7f362402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fa63a5a35f1c49 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.582+0000 7f362e7fc640 1 -- 172.21.15.66:0/1286407256 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624037070 con 0x7f36300add50 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.582+0000 7f362e7fc640 1 -- 172.21.15.66:0/1286407256 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3624032440 con 0x7f36300add50 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.582+0000 7f362e7fc640 1 -- 172.21.15.66:0/1286407256 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624032810 con 0x7f36300add50 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 -- 172.21.15.66:0/1286407256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300add50 msgr2=0x7f36300b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 --2- 172.21.15.66:0/1286407256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300add50 0x7f36300b3c00 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f36300743e0 tx=0x7f362402a1e0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 -- 172.21.15.66:0/1286407256 shutdown_connections 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 --2- 172.21.15.66:0/1286407256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f36300d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 --2- 172.21.15.66:0/1286407256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300add50 0x7f36300b3c00 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 --2- 172.21.15.66:0/1286407256 >> v2:172.21.15.190:3300/0 conn(0x7f36300cfcb0 0x7f36300b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 -- 172.21.15.66:0/1286407256 >> 172.21.15.66:0/1286407256 conn(0x7f363006c4a0 msgr2=0x7f363006c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 -- 172.21.15.66:0/1286407256 shutdown_connections 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.583+0000 7f3635abd640 1 -- 172.21.15.66:0/1286407256 wait complete. 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.584+0000 7f3635abd640 1 Processor -- start 2024-05-10T11:20:21.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.584+0000 7f3635abd640 1 -- start start 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f3635abd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300add50 0x7f363009dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f3635abd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 0x7f363015e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f3635abd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f363015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f3635abd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f363015e010 con 0x7f36300cfcb0 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f3635abd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f363015dd30 con 0x7f36300add50 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f3635abd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f363006dfa0 con 0x7f36300d0e30 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f362effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 0x7f363015e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f362effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 0x7f363015e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38200/0 (socket says 172.21.15.66:38200) 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f362effd640 1 -- 172.21.15.66:0/3361744093 learned_addr learned my addr 172.21.15.66:0/3361744093 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:21.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f362f7fe640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300add50 0x7f363009dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.585+0000 7f362ffff640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f363015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362effd640 1 -- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 msgr2=0x7f363015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362effd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f363015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362effd640 1 -- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300add50 msgr2=0x7f363009dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362effd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300add50 0x7f363009dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362effd640 1 -- 172.21.15.66:0/3361744093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363009ccc0 con 0x7f36300cfcb0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362ffff640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f363015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f362effd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 0x7f363015e620 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f362402a220 tx=0x7f36240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624041020 con 0x7f36300cfcb0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362403d620 con 0x7f36300cfcb0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363009cfa0 con 0x7f36300cfcb0 2024-05-10T11:20:21.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624037040 con 0x7f36300cfcb0 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.586+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363009d560 con 0x7f36300cfcb0 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.587+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f363006a220 con 0x7f36300cfcb0 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.588+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3624044020 con 0x7f36300cfcb0 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.588+0000 7f3617fff640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f361c0762d0 0x7f361c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.588+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6037+0+0 (secure 0 0 0) 0x7f36240b7da0 con 0x7f36300cfcb0 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.588+0000 7f362f7fe640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f361c0762d0 0x7f361c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:21.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.589+0000 7f362f7fe640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f361c0762d0 0x7f361c078790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3620009b40 tx=0x7f3620009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:21.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.593+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f362404b030 con 0x7f36300cfcb0 2024-05-10T11:20:21.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:21.781+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f36300ceb80 con 0x7f36300cfcb0 2024-05-10T11:20:22.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.456+0000 7f3617fff640 1 -- 172.21.15.66:0/3361744093 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f36240815b0 con 0x7f36300cfcb0 2024-05-10T11:20:22.456 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:20:22.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f361c0762d0 msgr2=0x7f361c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f361c0762d0 0x7f361c078790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3620009b40 tx=0x7f3620009190 comp rx=0 tx=0).stop 2024-05-10T11:20:22.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 msgr2=0x7f363015e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 0x7f363015e620 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f362402a220 tx=0x7f36240046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 shutdown_connections 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f361c0762d0 0x7f361c078790 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36300d0e30 0x7f363015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36300cfcb0 0x7f363015e620 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 --2- 172.21.15.66:0/3361744093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300add50 0x7f363009dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 >> 172.21.15.66:0/3361744093 conn(0x7f363006c4a0 msgr2=0x7f363015c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 shutdown_connections 2024-05-10T11:20:22.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.461+0000 7f3635abd640 1 -- 172.21.15.66:0/3361744093 wait complete. 2024-05-10T11:20:22.479 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:20:22.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.593+0000 7f70ed699640 1 Processor -- start 2024-05-10T11:20:22.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.593+0000 7f70ed699640 1 -- start start 2024-05-10T11:20:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70ed699640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162900 0x7f70e80d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70ed699640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70e8162ce0 0x7f70e80b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70ed699640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f70e80d3950 0x7f70e80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70ed699640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f70e80d4190 con 0x7f70e8162ce0 2024-05-10T11:20:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70ed699640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f70e80cfc40 con 0x7f70e80d3950 2024-05-10T11:20:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70ed699640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80d3eb0 con 0x7f70e8162900 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70e67fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70e8162ce0 0x7f70e80b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70e67fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70e8162ce0 0x7f70e80b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38204/0 (socket says 172.21.15.66:38204) 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70e67fc640 1 -- 172.21.15.66:0/1141037170 learned_addr learned my addr 172.21.15.66:0/1141037170 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70e77fe640 1 --2- 172.21.15.66:0/1141037170 >> v2:172.21.15.190:3300/0 conn(0x7f70e80d3950 0x7f70e80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.594+0000 7f70e6ffd640 1 --2- 172.21.15.66:0/1141037170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162900 0x7f70e80d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e67fc640 1 -- 172.21.15.66:0/1141037170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162900 msgr2=0x7f70e80d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e67fc640 1 --2- 172.21.15.66:0/1141037170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162900 0x7f70e80d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e67fc640 1 -- 172.21.15.66:0/1141037170 >> v2:172.21.15.190:3300/0 conn(0x7f70e80d3950 msgr2=0x7f70e80b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e67fc640 1 --2- 172.21.15.66:0/1141037170 >> v2:172.21.15.190:3300/0 conn(0x7f70e80d3950 0x7f70e80b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e67fc640 1 -- 172.21.15.66:0/1141037170 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80cfee0 con 0x7f70e8162ce0 2024-05-10T11:20:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e67fc640 1 --2- 172.21.15.66:0/1141037170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162ce0 0x7f70e80b48e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f70e808e560 tx=0x7f70d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a4e2643f86afbc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e5ffb640 1 -- 172.21.15.66:0/1141037170 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0037070 con 0x7f70e8162ce0 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.595+0000 7f70e5ffb640 1 -- 172.21.15.66:0/1141037170 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0032440 con 0x7f70e8162ce0 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70e5ffb640 1 -- 172.21.15.66:0/1141037170 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0032810 con 0x7f70e8162ce0 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 -- 172.21.15.66:0/1141037170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162ce0 msgr2=0x7f70e80b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 --2- 172.21.15.66:0/1141037170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162ce0 0x7f70e80b48e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f70e808e560 tx=0x7f70d002a140 comp rx=0 tx=0).stop 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 -- 172.21.15.66:0/1141037170 shutdown_connections 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 --2- 172.21.15.66:0/1141037170 >> v2:172.21.15.190:3300/0 conn(0x7f70e80d3950 0x7f70e80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 --2- 172.21.15.66:0/1141037170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162ce0 0x7f70e80b48e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 --2- 172.21.15.66:0/1141037170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162900 0x7f70e80d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 -- 172.21.15.66:0/1141037170 >> 172.21.15.66:0/1141037170 conn(0x7f70e809e430 msgr2=0x7f70e80d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 -- 172.21.15.66:0/1141037170 shutdown_connections 2024-05-10T11:20:22.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.596+0000 7f70ed699640 1 -- 172.21.15.66:0/1141037170 wait complete. 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.597+0000 7f70ed699640 1 Processor -- start 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 -- start start 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e80d3950 0x7f70e80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 0x7f70e80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162ce0 0x7f70e80b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80b4300 con 0x7f70e8162900 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80b4180 con 0x7f70e80d3950 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70ed699640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80d09c0 con 0x7f70e8162ce0 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 0x7f70e80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 0x7f70e80cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38212/0 (socket says 172.21.15.66:38212) 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70e67fc640 1 -- 172.21.15.66:0/1543511573 learned_addr learned my addr 172.21.15.66:0/1543511573 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.598+0000 7f70e6ffd640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e80d3950 0x7f70e80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e77fe640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162ce0 0x7f70e80b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e67fc640 1 -- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162ce0 msgr2=0x7f70e80b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e67fc640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162ce0 0x7f70e80b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e67fc640 1 -- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e80d3950 msgr2=0x7f70e80cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e67fc640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e80d3950 0x7f70e80cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e67fc640 1 -- 172.21.15.66:0/1543511573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81f5610 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e6ffd640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e80d3950 0x7f70e80cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70e67fc640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 0x7f70e80cba60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f70d0000c00 tx=0x7f70d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0041070 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0032e50 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e81f58f0 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0037040 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.599+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81f5eb0 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.600+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e806a220 con 0x7f70e8162900 2024-05-10T11:20:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.601+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f70d0044070 con 0x7f70e8162900 2024-05-10T11:20:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.601+0000 7f70df7fe640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c8076300 0x7f70c80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.601+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f70d00b7d00 con 0x7f70e8162900 2024-05-10T11:20:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.602+0000 7f70e6ffd640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c8076300 0x7f70c80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.602+0000 7f70e6ffd640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c8076300 0x7f70c80787c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009b90 tx=0x7f70e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:22.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.606+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f70d00817b0 con 0x7f70e8162900 2024-05-10T11:20:22.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.799+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f70e80b3d60 con 0x7f70e8162900 2024-05-10T11:20:22.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.802+0000 7f70df7fe640 1 -- 172.21.15.66:0/1543511573 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f70d00810b0 con 0x7f70e8162900 2024-05-10T11:20:22.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c8076300 msgr2=0x7f70c80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c8076300 0x7f70c80787c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009b90 tx=0x7f70e0008040 comp rx=0 tx=0).stop 2024-05-10T11:20:22.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 msgr2=0x7f70e80cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 0x7f70e80cba60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f70d0000c00 tx=0x7f70d00046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 shutdown_connections 2024-05-10T11:20:22.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70c8076300 0x7f70c80787c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70e8162ce0 0x7f70e80b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8162900 0x7f70e80cba60 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 --2- 172.21.15.66:0/1543511573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e80d3950 0x7f70e80cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 >> 172.21.15.66:0/1543511573 conn(0x7f70e809e430 msgr2=0x7f70e8161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:22.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 shutdown_connections 2024-05-10T11:20:22.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.804+0000 7f70ed699640 1 -- 172.21.15.66:0/1543511573 wait complete. 2024-05-10T11:20:22.815 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-05-10T11:20:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.920+0000 7f62ebaf1640 1 Processor -- start 2024-05-10T11:20:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.920+0000 7f62ebaf1640 1 -- start start 2024-05-10T11:20:22.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62ebaf1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f62e40caf50 0x7f62e406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62ebaf1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e4163bc0 con 0x7f62e406fa60 2024-05-10T11:20:22.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62ebaf1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e4160240 con 0x7f62e4163730 2024-05-10T11:20:22.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62ebaf1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f62e4160520 con 0x7f62e40caf50 2024-05-10T11:20:22.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62ea08e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f62e40caf50 0x7f62e406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62e988d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f62e406fa60 0x7f62e415f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37856/0 (socket says 172.21.15.66:37856) 2024-05-10T11:20:22.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62ea08e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f62e40caf50 0x7f62e406c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38214/0 (socket says 172.21.15.66:38214) 2024-05-10T11:20:22.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.921+0000 7f62e988d640 1 -- 172.21.15.66:0/989588514 learned_addr learned my addr 172.21.15.66:0/989588514 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:22.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62ea08e640 1 -- 172.21.15.66:0/989588514 >> v1:172.21.15.190:6789/0 conn(0x7f62e4163730 legacy=0x7f62e40ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62ea08e640 1 -- 172.21.15.66:0/989588514 >> v1:172.21.15.66:6789/0 conn(0x7f62e406fa60 legacy=0x7f62e415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62ea08e640 1 -- 172.21.15.66:0/989588514 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e4162f30 con 0x7f62e40caf50 2024-05-10T11:20:22.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62e888b640 1 -- 172.21.15.66:0/989588514 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388536322 0 0) 0x7f62e4163bc0 con 0x7f62e406fa60 2024-05-10T11:20:22.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62ea08e640 1 --2- 172.21.15.66:0/989588514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e40caf50 0x7f62e406c560 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009d90 tx=0x7f62d402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be800bce9719df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:22.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62e888b640 1 -- 172.21.15.66:0/989588514 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4007740 con 0x7f62e40caf50 2024-05-10T11:20:22.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62e888b640 1 -- 172.21.15.66:0/989588514 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d40078e0 con 0x7f62e40caf50 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.922+0000 7f62e888b640 1 -- 172.21.15.66:0/989588514 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4007cb0 con 0x7f62e40caf50 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 -- 172.21.15.66:0/989588514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e40caf50 msgr2=0x7f62e406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/989588514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e40caf50 0x7f62e406c560 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009d90 tx=0x7f62d402a660 comp rx=0 tx=0).stop 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 -- 172.21.15.66:0/989588514 shutdown_connections 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/989588514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e40caf50 0x7f62e406c560 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 -- 172.21.15.66:0/989588514 >> 172.21.15.66:0/989588514 conn(0x7f62e40d1510 msgr2=0x7f62e40d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 -- 172.21.15.66:0/989588514 shutdown_connections 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.923+0000 7f62ebaf1640 1 -- 172.21.15.66:0/989588514 wait complete. 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.924+0000 7f62ebaf1640 1 Processor -- start 2024-05-10T11:20:22.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.924+0000 7f62ebaf1640 1 -- start start 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ebaf1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 0x7f62e41e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ebaf1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62e40caf50 0x7f62e40b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ebaf1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62e4163730 0x7f62e4144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ebaf1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62e415fe40 con 0x7f62e406fa60 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ebaf1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f62e406eae0 con 0x7f62e4163730 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ebaf1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f62e415ffc0 con 0x7f62e40caf50 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62e988d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 0x7f62e41e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62e988d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 0x7f62e41e8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38220/0 (socket says 172.21.15.66:38220) 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62e988d640 1 -- 172.21.15.66:0/3018118466 learned_addr learned my addr 172.21.15.66:0/3018118466 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62ea08e640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62e4163730 0x7f62e4144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.925+0000 7f62e908c640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62e40caf50 0x7f62e40b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e988d640 1 -- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62e40caf50 msgr2=0x7f62e40b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e988d640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62e40caf50 0x7f62e40b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e988d640 1 -- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62e4163730 msgr2=0x7f62e4144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e988d640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62e4163730 0x7f62e4144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e988d640 1 -- 172.21.15.66:0/3018118466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41e90c0 con 0x7f62e406fa60 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e908c640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62e40caf50 0x7f62e40b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62ea08e640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62e4163730 0x7f62e4144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e988d640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 0x7f62e41e8b80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c4a0 tx=0x7f62dc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc018070 con 0x7f62e406fa60 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0074e0 con 0x7f62e406fa60 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e40b6040 con 0x7f62e406fa60 2024-05-10T11:20:22.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc004a20 con 0x7f62e406fa60 2024-05-10T11:20:22.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.926+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e40b6600 con 0x7f62e406fa60 2024-05-10T11:20:22.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.927+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e406a220 con 0x7f62e406fa60 2024-05-10T11:20:22.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.928+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f62dc01b070 con 0x7f62e406fa60 2024-05-10T11:20:22.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.928+0000 7f62e27fc640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62d00762d0 0x7f62d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:22.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.928+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f62dc096740 con 0x7f62e406fa60 2024-05-10T11:20:22.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.928+0000 7f62e908c640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62d00762d0 0x7f62d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:22.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.929+0000 7f62e908c640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62d00762d0 0x7f62d0078790 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f62d8007fd0 tx=0x7f62d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:22.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:22.932+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f62dc0601f0 con 0x7f62e406fa60 2024-05-10T11:20:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.204+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f62e406dcc0 con 0x7f62e406fa60 2024-05-10T11:20:23.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.458+0000 7f62e27fc640 1 -- 172.21.15.66:0/3018118466 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v371) ==== 167+0+0 (secure 0 0 0) 0x7f62dc05faf0 con 0x7f62e406fa60 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62d00762d0 msgr2=0x7f62d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62d00762d0 0x7f62d0078790 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f62d8007fd0 tx=0x7f62d8009040 comp rx=0 tx=0).stop 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 msgr2=0x7f62e41e8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 0x7f62e41e8b80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c4a0 tx=0x7f62dc00c960 comp rx=0 tx=0).stop 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 shutdown_connections 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62d00762d0 0x7f62d0078790 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62e4163730 0x7f62e4144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62e40caf50 0x7f62e40b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 --2- 172.21.15.66:0/3018118466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e406fa60 0x7f62e41e8b80 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 >> 172.21.15.66:0/3018118466 conn(0x7f62e40d1510 msgr2=0x7f62e40cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:23.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 shutdown_connections 2024-05-10T11:20:23.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.460+0000 7f62ebaf1640 1 -- 172.21.15.66:0/3018118466 wait complete. 2024-05-10T11:20:23.472 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-05-10T11:20:23.472 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:20:23.472 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:20:23.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.578+0000 7fef4332c640 1 Processor -- start 2024-05-10T11:20:23.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.578+0000 7fef4332c640 1 -- start start 2024-05-10T11:20:23.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef4332c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef3c15ce60 0x7fef3c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef4332c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 0x7fef3c15d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef4332c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3c0c6a60 con 0x7fef3c0c65f0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef4332c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fef3c0cd090 con 0x7fef3c15ce60 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef4332c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c0cd370 con 0x7fef3c1611e0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef408c7640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fef3c0c65f0 0x7fef3c160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37868/0 (socket says 172.21.15.66:37868) 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef408c7640 1 -- 172.21.15.66:0/3845897035 learned_addr learned my addr 172.21.15.66:0/3845897035 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef410c8640 1 --2- 172.21.15.66:0/3845897035 >> v2:172.21.15.190:3300/0 conn(0x7fef3c15ce60 0x7fef3c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef418c9640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 0x7fef3c15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422013230 0 0) 0x7fef3c0c6a60 con 0x7fef3c0c65f0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.579+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef28003520 con 0x7fef3c0c65f0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1878234678 0 0) 0x7fef28003520 con 0x7fef3c0c65f0 2024-05-10T11:20:23.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 msgr2=0x7fef3c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 0x7fef3c15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 >> v2:172.21.15.190:3300/0 conn(0x7fef3c15ce60 msgr2=0x7fef3c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 --2- 172.21.15.66:0/3845897035 >> v2:172.21.15.190:3300/0 conn(0x7fef3c15ce60 0x7fef3c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c0cd650 con 0x7fef3c0c65f0 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fef2c001690 con 0x7fef3c0c65f0 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 >> v1:172.21.15.66:6789/0 conn(0x7fef3c0c65f0 legacy=0x7fef3c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 0x7fef280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef28004d40 0x7fef280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0cd090 con 0x7fef28003f30 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0cd370 con 0x7fef28004d40 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef2800ba10 con 0x7fef3c1611e0 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef408c7640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef410c8640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 0x7fef280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef418c9640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef28004d40 0x7fef280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef408c7640 1 -- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 msgr2=0x7fef280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef408c7640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1611e0 0x7fef280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef408c7640 1 -- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef28004d40 msgr2=0x7fef280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef408c7640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef28004d40 0x7fef280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.580+0000 7fef408c7640 1 -- 172.21.15.66:0/3845897035 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef28003520 con 0x7fef28003f30 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.581+0000 7fef408c7640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef28004800 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c240 tx=0x7fef28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db79edd1d5f4a652 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.581+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c007d60 con 0x7fef28003f30 2024-05-10T11:20:23.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.581+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c005ad0 con 0x7fef28003f30 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.581+0000 7fef33fff640 1 -- 172.21.15.66:0/3845897035 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c007070 con 0x7fef28003f30 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef4332c640 1 -- 172.21.15.66:0/3845897035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 msgr2=0x7fef28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef4332c640 1 --2- 172.21.15.66:0/3845897035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef28004800 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c240 tx=0x7fef28005830 comp rx=0 tx=0).stop 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef418c9640 1 -- 172.21.15.66:0/3845897035 reap_dead start 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef4332c640 1 -- 172.21.15.66:0/3845897035 shutdown_connections 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef4332c640 1 -- 172.21.15.66:0/3845897035 >> 172.21.15.66:0/3845897035 conn(0x7fef3c0b2900 msgr2=0x7fef3c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef4332c640 1 -- 172.21.15.66:0/3845897035 shutdown_connections 2024-05-10T11:20:23.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.582+0000 7fef4332c640 1 -- 172.21.15.66:0/3845897035 wait complete. 2024-05-10T11:20:23.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.583+0000 7fef4332c640 1 Processor -- start 2024-05-10T11:20:23.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.583+0000 7fef4332c640 1 -- start start 2024-05-10T11:20:23.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef4332c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef3c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef4332c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1f2de0 0x7fef3c15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef4332c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef3c15ec30 0x7fef3c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef4332c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0cde50 con 0x7fef28003f30 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef4332c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0ccd60 con 0x7fef3c15ec30 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef4332c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c0cdfd0 con 0x7fef3c1f2de0 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef3c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef3c0d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38238/0 (socket says 172.21.15.66:38238) 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 -- 172.21.15.66:0/4184241834 learned_addr learned my addr 172.21.15.66:0/4184241834 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef418c9640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef3c15ec30 0x7fef3c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef408c7640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1f2de0 0x7fef3c15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 -- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1f2de0 msgr2=0x7fef3c15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1f2de0 0x7fef3c15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 -- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef3c15ec30 msgr2=0x7fef3c15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef3c15ec30 0x7fef3c15a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 -- 172.21.15.66:0/4184241834 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c15b730 con 0x7fef28003f30 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef418c9640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef3c15ec30 0x7fef3c15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef408c7640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1f2de0 0x7fef3c15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.584+0000 7fef410c8640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef3c0d1560 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fef380119a0 tx=0x7fef38011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.585+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3800faf0 con 0x7fef28003f30 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.585+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3800fc90 con 0x7fef28003f30 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.585+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c0b5020 con 0x7fef28003f30 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.585+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38014440 con 0x7fef28003f30 2024-05-10T11:20:23.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.585+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c0b55e0 con 0x7fef28003f30 2024-05-10T11:20:23.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.586+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3c06a220 con 0x7fef28003f30 2024-05-10T11:20:23.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.586+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef38012040 con 0x7fef28003f30 2024-05-10T11:20:23.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.587+0000 7fef31ffb640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef200762d0 0x7fef20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.587+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7fef38097b50 con 0x7fef28003f30 2024-05-10T11:20:23.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.587+0000 7fef408c7640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef200762d0 0x7fef20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.588+0000 7fef408c7640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef200762d0 0x7fef20078790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fef2c033000 tx=0x7fef2c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:23.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.591+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fef38019030 con 0x7fef28003f30 2024-05-10T11:20:23.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.783+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef3c073700 con 0x7fef28003f30 2024-05-10T11:20:23.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.784+0000 7fef31ffb640 1 -- 172.21.15.66:0/4184241834 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+13552 (secure 0 0 0) 0x7fef38061600 con 0x7fef28003f30 2024-05-10T11:20:23.783 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:23.783 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":95,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:20:22.449949+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/821296830":"2024-05-11T11:20:19.438800+0000","172.21.15.66:6834/821296830":"2024-05-11T11:20:19.438800+0000","172.21.15.66:6835/577308965":"2024-05-11T11:19:38.256644+0000","172.21.15.66:6834/577308965":"2024-05-11T11:19:38.256644+0000","172.21.15.190:6837/1519468735":"2024-05-11T11:18:27.672306+0000","172.21.15.190:6835/1519468735":"2024-05-11T11:18:27.672306+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef200762d0 msgr2=0x7fef20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef200762d0 0x7fef20078790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fef2c033000 tx=0x7fef2c007000 comp rx=0 tx=0).stop 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 msgr2=0x7fef3c0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef3c0d1560 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fef380119a0 tx=0x7fef38011e60 comp rx=0 tx=0).stop 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 shutdown_connections 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef200762d0 0x7fef20078790 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef3c15ec30 0x7fef3c15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3c1f2de0 0x7fef3c15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 --2- 172.21.15.66:0/4184241834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef28003f30 0x7fef3c0d1560 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 >> 172.21.15.66:0/4184241834 conn(0x7fef3c0b2900 msgr2=0x7fef3c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 shutdown_connections 2024-05-10T11:20:23.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.786+0000 7fef4332c640 1 -- 172.21.15.66:0/4184241834 wait complete. 2024-05-10T11:20:23.797 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:20:23.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:20:23.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.905+0000 7f523ccda640 1 Processor -- start 2024-05-10T11:20:23.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.905+0000 7f523ccda640 1 -- start start 2024-05-10T11:20:23.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523ccda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52380cf3e0 0x7f52380cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523ccda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d2190 0x7f52380cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523ccda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f523806e720 con 0x7f52380cd500 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523ccda640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f523806de80 con 0x7f52380cf3e0 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523ccda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f523806e160 con 0x7f52380d2190 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52380cf3e0 0x7f52380cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f522ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f52380cd500 0x7f52380b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37884/0 (socket says 172.21.15.66:37884) 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f522ffff640 1 -- 172.21.15.66:0/965298343 learned_addr learned my addr 172.21.15.66:0/965298343 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f5236d9d640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d2190 0x7f52380cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523659c640 1 -- 172.21.15.66:0/965298343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d2190 msgr2=0x7f52380cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523659c640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d2190 0x7f52380cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523659c640 1 -- 172.21.15.66:0/965298343 >> v1:172.21.15.66:6789/0 conn(0x7f52380cd500 legacy=0x7f52380b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f523659c640 1 -- 172.21.15.66:0/965298343 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523806e440 con 0x7f52380cf3e0 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f5235d9b640 1 -- 172.21.15.66:0/965298343 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136037209 0 0) 0x7f523806e720 con 0x7f52380cd500 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.906+0000 7f5236d9d640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d2190 0x7f52380cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.907+0000 7f523659c640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cf3e0 0x7f52380cf8c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f52280097a0 tx=0x7f522802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e97564a491c45b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.907+0000 7f5235d9b640 1 -- 172.21.15.66:0/965298343 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228037070 con 0x7f52380cf3e0 2024-05-10T11:20:23.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.907+0000 7f5235d9b640 1 -- 172.21.15.66:0/965298343 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5228032440 con 0x7f52380cf3e0 2024-05-10T11:20:23.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.907+0000 7f5235d9b640 1 -- 172.21.15.66:0/965298343 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228032810 con 0x7f52380cf3e0 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 -- 172.21.15.66:0/965298343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cf3e0 msgr2=0x7f52380cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cf3e0 0x7f52380cf8c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f52280097a0 tx=0x7f522802a180 comp rx=0 tx=0).stop 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 -- 172.21.15.66:0/965298343 shutdown_connections 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d2190 0x7f52380cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 --2- 172.21.15.66:0/965298343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cf3e0 0x7f52380cf8c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 -- 172.21.15.66:0/965298343 >> 172.21.15.66:0/965298343 conn(0x7f52380d2eb0 msgr2=0x7f52380d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 -- 172.21.15.66:0/965298343 shutdown_connections 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.908+0000 7f523ccda640 1 -- 172.21.15.66:0/965298343 wait complete. 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.909+0000 7f523ccda640 1 Processor -- start 2024-05-10T11:20:23.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.909+0000 7f523ccda640 1 -- start start 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523ccda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 0x7f523809d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523ccda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380cf3e0 0x7f52380c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523ccda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52380d2190 0x7f52380cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523ccda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52380b34e0 con 0x7f52380cd500 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523ccda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f52380b4510 con 0x7f52380d2190 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523ccda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f52380b3660 con 0x7f52380cf3e0 2024-05-10T11:20:23.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 0x7f523809d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 0x7f523809d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38254/0 (socket says 172.21.15.66:38254) 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 -- 172.21.15.66:0/4076723238 learned_addr learned my addr 172.21.15.66:0/4076723238 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f522ffff640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380cf3e0 0x7f52380c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f5236d9d640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52380d2190 0x7f52380cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 -- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380cf3e0 msgr2=0x7f52380c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380cf3e0 0x7f52380c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 -- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52380d2190 msgr2=0x7f52380cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52380d2190 0x7f52380cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.910+0000 7f523659c640 1 -- 172.21.15.66:0/4076723238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52381f5310 con 0x7f52380cd500 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.911+0000 7f523659c640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 0x7f523809d030 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f5228000c00 tx=0x7f52280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.911+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228037040 con 0x7f52380cd500 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.911+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5228042070 con 0x7f52380cd500 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.911+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228030bb0 con 0x7f52380cd500 2024-05-10T11:20:23.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.911+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52381f55f0 con 0x7f52380cd500 2024-05-10T11:20:23.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.911+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52380c7650 con 0x7f52380cd500 2024-05-10T11:20:23.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.912+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52380c69e0 con 0x7f52380cd500 2024-05-10T11:20:23.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.912+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5228047460 con 0x7f52380cd500 2024-05-10T11:20:23.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.913+0000 7f522effd640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5218076300 0x7f52180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:23.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.913+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f52280b8060 con 0x7f52380cd500 2024-05-10T11:20:23.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.913+0000 7f522ffff640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5218076300 0x7f52180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:23.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.914+0000 7f522ffff640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5218076300 0x7f52180787c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f52380c7f10 tx=0x7f5220007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:23.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:23.918+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5228032e20 con 0x7f52380cd500 2024-05-10T11:20:24.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.105+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f523806a220 con 0x7f52380cd500 2024-05-10T11:20:24.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.105+0000 7f522effd640 1 -- 172.21.15.66:0/4076723238 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f5228081a80 con 0x7f52380cd500 2024-05-10T11:20:24.106 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5218076300 msgr2=0x7f52180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5218076300 0x7f52180787c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f52380c7f10 tx=0x7f5220007b50 comp rx=0 tx=0).stop 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 msgr2=0x7f523809d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 0x7f523809d030 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f5228000c00 tx=0x7f52280046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 shutdown_connections 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5218076300 0x7f52180787c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52380d2190 0x7f52380cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380cf3e0 0x7f52380c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 --2- 172.21.15.66:0/4076723238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52380cd500 0x7f523809d030 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 >> 172.21.15.66:0/4076723238 conn(0x7f52380d2eb0 msgr2=0x7f523806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:24.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 shutdown_connections 2024-05-10T11:20:24.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.107+0000 7f523ccda640 1 -- 172.21.15.66:0/4076723238 wait complete. 2024-05-10T11:20:24.119 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-05-10T11:20:24.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.222+0000 7fd508b87640 1 Processor -- start 2024-05-10T11:20:24.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.222+0000 7fd508b87640 1 -- start start 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd508b87640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd5040d5cb0 0x7fd5040d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd508b87640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162b30 0x7fd5040d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd508b87640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5040b45f0 con 0x7fd504162750 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd508b87640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd5040b4f20 con 0x7fd5040d5cb0 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd508b87640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd5040d0fe0 con 0x7fd504162b30 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd50259c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd504162750 0x7fd5040d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37900/0 (socket says 172.21.15.66:37900) 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd50259c640 1 -- 172.21.15.66:0/3143185958 learned_addr learned my addr 172.21.15.66:0/3143185958 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd501d9b640 1 --2- 172.21.15.66:0/3143185958 >> v2:172.21.15.66:3300/0 conn(0x7fd5040d5cb0 0x7fd5040d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd502d9d640 1 --2- 172.21.15.66:0/3143185958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162b30 0x7fd5040d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:24.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.223+0000 7fd50159a640 1 -- 172.21.15.66:0/3143185958 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913993157 0 0) 0x7fd5040b45f0 con 0x7fd504162750 2024-05-10T11:20:24.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd50159a640 1 -- 172.21.15.66:0/3143185958 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f0003520 con 0x7fd504162750 2024-05-10T11:20:24.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd501d9b640 1 -- 172.21.15.66:0/3143185958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162b30 msgr2=0x7fd5040d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:24.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd501d9b640 1 --2- 172.21.15.66:0/3143185958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162b30 0x7fd5040d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd501d9b640 1 -- 172.21.15.66:0/3143185958 >> v1:172.21.15.66:6789/0 conn(0x7fd504162750 legacy=0x7fd5040d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:24.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd501d9b640 1 -- 172.21.15.66:0/3143185958 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5040b48d0 con 0x7fd5040d5cb0 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd501d9b640 1 --2- 172.21.15.66:0/3143185958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5040d5cb0 0x7fd5040d3630 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0097a0 tx=0x7fd4ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542bcb0abd90af1e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.224+0000 7fd50159a640 1 -- 172.21.15.66:0/3143185958 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec037070 con 0x7fd5040d5cb0 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd50159a640 1 -- 172.21.15.66:0/3143185958 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec02ae50 con 0x7fd5040d5cb0 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd50159a640 1 -- 172.21.15.66:0/3143185958 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec032640 con 0x7fd5040d5cb0 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 -- 172.21.15.66:0/3143185958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5040d5cb0 msgr2=0x7fd5040d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 --2- 172.21.15.66:0/3143185958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5040d5cb0 0x7fd5040d3630 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0097a0 tx=0x7fd4ec02a100 comp rx=0 tx=0).stop 2024-05-10T11:20:24.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 -- 172.21.15.66:0/3143185958 shutdown_connections 2024-05-10T11:20:24.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 --2- 172.21.15.66:0/3143185958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162b30 0x7fd5040d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 --2- 172.21.15.66:0/3143185958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5040d5cb0 0x7fd5040d3630 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 -- 172.21.15.66:0/3143185958 >> 172.21.15.66:0/3143185958 conn(0x7fd50409e3b0 msgr2=0x7fd5040d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:24.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 -- 172.21.15.66:0/3143185958 shutdown_connections 2024-05-10T11:20:24.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.225+0000 7fd508b87640 1 -- 172.21.15.66:0/3143185958 wait complete. 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.226+0000 7fd508b87640 1 Processor -- start 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 -- start start 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162750 0x7fd50415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd504162b30 0x7fd504152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 0x7fd504154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040b53b0 con 0x7fd504153240 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040d0d80 con 0x7fd504162b30 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd508b87640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd5040b5530 con 0x7fd504162750 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd502d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 0x7fd504154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd502d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 0x7fd504154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38276/0 (socket says 172.21.15.66:38276) 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.227+0000 7fd502d9d640 1 -- 172.21.15.66:0/2532773020 learned_addr learned my addr 172.21.15.66:0/2532773020 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:24.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd502d9d640 1 -- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162750 msgr2=0x7fd50415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd502d9d640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162750 0x7fd50415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd501d9b640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd504162b30 0x7fd504152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd502d9d640 1 -- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd504162b30 msgr2=0x7fd504152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd502d9d640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd504162b30 0x7fd504152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd502d9d640 1 -- 172.21.15.66:0/2532773020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50415f8c0 con 0x7fd504153240 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd502d9d640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 0x7fd504154a50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00d5d0 tx=0x7fd4fc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0125f0 con 0x7fd504153240 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc019070 con 0x7fd504153240 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50415fb40 con 0x7fd504153240 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0129f0 con 0x7fd504153240 2024-05-10T11:20:24.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.228+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd504160100 con 0x7fd504153240 2024-05-10T11:20:24.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.229+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50406a220 con 0x7fd504153240 2024-05-10T11:20:24.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.230+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd4fc012b90 con 0x7fd504153240 2024-05-10T11:20:24.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.230+0000 7fd4faffd640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4e40762d0 0x7fd4e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:24.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.230+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7fd4fc097900 con 0x7fd504153240 2024-05-10T11:20:24.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.230+0000 7fd50259c640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4e40762d0 0x7fd4e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:24.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.231+0000 7fd50259c640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4e40762d0 0x7fd4e4078790 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40012e0 tx=0x7fd4f4001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:24.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.235+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd50415f8c0 con 0x7fd504153240 2024-05-10T11:20:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:24.498+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7fd504161ad0 con 0x7fd504153240 2024-05-10T11:20:25.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.464+0000 7fd4faffd640 1 -- 172.21.15.66:0/2532773020 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v373) ==== 149+0+0 (secure 0 0 0) 0x7fd4fc061330 con 0x7fd504153240 2024-05-10T11:20:25.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4e40762d0 msgr2=0x7fd4e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4e40762d0 0x7fd4e4078790 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40012e0 tx=0x7fd4f4001650 comp rx=0 tx=0).stop 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 msgr2=0x7fd504154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 0x7fd504154a50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00d5d0 tx=0x7fd4fc00da90 comp rx=0 tx=0).stop 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 shutdown_connections 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd4e40762d0 0x7fd4e4078790 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd504153240 0x7fd504154a50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd504162b30 0x7fd504152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 --2- 172.21.15.66:0/2532773020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd504162750 0x7fd50415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 >> 172.21.15.66:0/2532773020 conn(0x7fd50409e3b0 msgr2=0x7fd5041578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 shutdown_connections 2024-05-10T11:20:25.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.467+0000 7fd508b87640 1 -- 172.21.15.66:0/2532773020 wait complete. 2024-05-10T11:20:25.481 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.594+0000 7f5dd019d640 1 Processor -- start 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.594+0000 7f5dd019d640 1 -- start start 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dd019d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5dc806f030 0x7f5dc8160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dd019d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5dc80cf240 0x7f5dc80cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dd019d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc815cfb0 con 0x7f5dc806f410 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dd019d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc80ccb60 con 0x7f5dc80cf240 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dd019d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc815d290 con 0x7f5dc806f030 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5dc80cf240 0x7f5dc80cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5dc80cf240 0x7f5dc80cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51558/0 (socket says 172.21.15.66:51558) 2024-05-10T11:20:25.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 -- 172.21.15.66:0/1157461733 learned_addr learned my addr 172.21.15.66:0/1157461733 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dcdf39640 1 --2- 172.21.15.66:0/1157461733 >> v2:172.21.15.190:3300/0 conn(0x7f5dc806f030 0x7f5dc8160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 -- 172.21.15.66:0/1157461733 >> v2:172.21.15.190:3300/0 conn(0x7f5dc806f030 msgr2=0x7f5dc8160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 --2- 172.21.15.66:0/1157461733 >> v2:172.21.15.190:3300/0 conn(0x7f5dc806f030 0x7f5dc8160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 -- 172.21.15.66:0/1157461733 >> v1:172.21.15.190:6789/0 conn(0x7f5dc806f410 legacy=0x7f5dc815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.595+0000 7f5dce73a640 1 -- 172.21.15.66:0/1157461733 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc815fd30 con 0x7f5dc80cf240 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.596+0000 7f5dce73a640 1 --2- 172.21.15.66:0/1157461733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc80cf240 0x7f5dc80cf6b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80d1cf0 tx=0x7f5dc002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80e6454918307e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.596+0000 7f5dccf37640 1 -- 172.21.15.66:0/1157461733 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0036070 con 0x7f5dc80cf240 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.596+0000 7f5dccf37640 1 -- 172.21.15.66:0/1157461733 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc0031600 con 0x7f5dc80cf240 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.596+0000 7f5dccf37640 1 -- 172.21.15.66:0/1157461733 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00319d0 con 0x7f5dc80cf240 2024-05-10T11:20:25.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 -- 172.21.15.66:0/1157461733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc80cf240 msgr2=0x7f5dc80cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 --2- 172.21.15.66:0/1157461733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc80cf240 0x7f5dc80cf6b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80d1cf0 tx=0x7f5dc002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 -- 172.21.15.66:0/1157461733 shutdown_connections 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 --2- 172.21.15.66:0/1157461733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc80cf240 0x7f5dc80cf6b0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 --2- 172.21.15.66:0/1157461733 >> v2:172.21.15.190:3300/0 conn(0x7f5dc806f030 0x7f5dc8160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 -- 172.21.15.66:0/1157461733 >> 172.21.15.66:0/1157461733 conn(0x7f5dc80d0c90 msgr2=0x7f5dc80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 -- 172.21.15.66:0/1157461733 shutdown_connections 2024-05-10T11:20:25.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.597+0000 7f5dd019d640 1 -- 172.21.15.66:0/1157461733 wait complete. 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.598+0000 7f5dd019d640 1 Processor -- start 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.598+0000 7f5dd019d640 1 -- start start 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dd019d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5dc806f030 0x7f5dc81f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dd019d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 0x7f5dc806e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dd019d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dc80cf240 0x7f5dc814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dd019d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80cb910 con 0x7f5dc806f410 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dd019d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc815fa40 con 0x7f5dc80cf240 2024-05-10T11:20:25.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dd019d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc8159d70 con 0x7f5dc806f030 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 0x7f5dc806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 0x7f5dc806e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51564/0 (socket says 172.21.15.66:51564) 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 -- 172.21.15.66:0/2439183446 learned_addr learned my addr 172.21.15.66:0/2439183446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcdf39640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5dc806f030 0x7f5dc81f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dce73a640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dc80cf240 0x7f5dc814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 -- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5dc806f030 msgr2=0x7f5dc81f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5dc806f030 0x7f5dc81f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 -- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dc80cf240 msgr2=0x7f5dc814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dc80cf240 0x7f5dc814eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.599+0000 7f5dcd738640 1 -- 172.21.15.66:0/2439183446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc81f3590 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.600+0000 7f5dcd738640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 0x7f5dc806e190 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c430 tx=0x7f5db800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.600+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8011790 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.600+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db8017070 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.600+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc81f3870 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.600+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8011bb0 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.600+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc81f3e30 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.601+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc806a220 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.601+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5db801c460 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.602+0000 7f5dbe7fc640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5dac0762d0 0x7f5dac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.602+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f5db8097310 con 0x7f5dc806f410 2024-05-10T11:20:25.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.602+0000 7f5dcdf39640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5dac0762d0 0x7f5dac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:25.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.603+0000 7f5dcdf39640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5dac0762d0 0x7f5dac078790 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4006fd0 tx=0x7f5dc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:25.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.606+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5db8060660 con 0x7f5dc806f410 2024-05-10T11:20:25.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.796+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5dc80cf020 con 0x7f5dc806f410 2024-05-10T11:20:25.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.799+0000 7f5dbe7fc640 1 -- 172.21.15.66:0/2439183446 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f5db8064960 con 0x7f5dc806f410 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5dac0762d0 msgr2=0x7f5dac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5dac0762d0 0x7f5dac078790 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4006fd0 tx=0x7f5dc4008040 comp rx=0 tx=0).stop 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 msgr2=0x7f5dc806e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 0x7f5dc806e190 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c430 tx=0x7f5db800c8f0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 shutdown_connections 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5dac0762d0 0x7f5dac078790 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dc80cf240 0x7f5dc814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc806f410 0x7f5dc806e190 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 --2- 172.21.15.66:0/2439183446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5dc806f030 0x7f5dc81f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:25.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 >> 172.21.15.66:0/2439183446 conn(0x7f5dc80d0c90 msgr2=0x7f5dc8159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 shutdown_connections 2024-05-10T11:20:25.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:25.801+0000 7f5dd019d640 1 -- 172.21.15.66:0/2439183446 wait complete. 2024-05-10T11:20:25.813 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:20:25.814 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:20:25.853 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:20:25.898 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:20:25.898 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:25.898 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:25.914 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:20:25.915 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:20:25.915 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:25.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:20:25.957 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:25.957 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:25.974 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:20:25.974 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:20:25.974 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:26.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:20:26.015 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:20:26.016 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:26.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.119+0000 7fc2c3119640 1 Processor -- start 2024-05-10T11:20:26.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.119+0000 7fc2c3119640 1 -- start start 2024-05-10T11:20:26.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c3119640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc1598c0 0x7fc2bc06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c3119640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc2bc06ec40 0x7fc2bc0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c3119640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2bc06f1c0 con 0x7fc2bc0c71c0 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c3119640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc2bc06f4a0 con 0x7fc2bc06ec40 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c3119640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2bc06f780 con 0x7fc2bc1598c0 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2bbfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc2bc06ec40 0x7fc2bc0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c16b6640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc2bc0c71c0 0x7fc2bc15fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55618/0 (socket says 172.21.15.66:55618) 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c16b6640 1 -- 172.21.15.66:0/1283690428 learned_addr learned my addr 172.21.15.66:0/1283690428 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:26.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2c0eb5640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc1598c0 0x7fc2bc06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2bbfff640 1 -- 172.21.15.66:0/1283690428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc1598c0 msgr2=0x7fc2bc06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2bbfff640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc1598c0 0x7fc2bc06e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2bbfff640 1 -- 172.21.15.66:0/1283690428 >> v1:172.21.15.66:6789/0 conn(0x7fc2bc0c71c0 legacy=0x7fc2bc15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.120+0000 7fc2bb7fe640 1 -- 172.21.15.66:0/1283690428 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314455240 0 0) 0x7fc2bc06f1c0 con 0x7fc2bc0c71c0 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2bbfff640 1 -- 172.21.15.66:0/1283690428 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc06fa60 con 0x7fc2bc06ec40 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2c0eb5640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc1598c0 0x7fc2bc06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2bbfff640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc0c6c80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00097a0 tx=0x7fc2b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16deb2211186b9a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2bb7fe640 1 -- 172.21.15.66:0/1283690428 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0037070 con 0x7fc2bc06ec40 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2bb7fe640 1 -- 172.21.15.66:0/1283690428 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b0032440 con 0x7fc2bc06ec40 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.121+0000 7fc2bb7fe640 1 -- 172.21.15.66:0/1283690428 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0032810 con 0x7fc2bc06ec40 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 -- 172.21.15.66:0/1283690428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 msgr2=0x7fc2bc0c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc0c6c80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00097a0 tx=0x7fc2b002a180 comp rx=0 tx=0).stop 2024-05-10T11:20:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 -- 172.21.15.66:0/1283690428 shutdown_connections 2024-05-10T11:20:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc0c6c80 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 --2- 172.21.15.66:0/1283690428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc1598c0 0x7fc2bc06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 -- 172.21.15.66:0/1283690428 >> 172.21.15.66:0/1283690428 conn(0x7fc2bc0b2900 msgr2=0x7fc2bc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 -- 172.21.15.66:0/1283690428 shutdown_connections 2024-05-10T11:20:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.122+0000 7fc2c3119640 1 -- 172.21.15.66:0/1283690428 wait complete. 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.123+0000 7fc2c3119640 1 Processor -- start 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.123+0000 7fc2c3119640 1 -- start start 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c3119640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c3119640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc0c71c0 0x7fc2bc15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c3119640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc1598c0 0x7fc2bc072690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c3119640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc159ca0 con 0x7fc2bc06ec40 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c3119640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc15c6e0 con 0x7fc2bc1598c0 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c3119640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2bc159e20 con 0x7fc2bc0c71c0 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc1490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51570/0 (socket says 172.21.15.66:51570) 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 -- 172.21.15.66:0/2010924006 learned_addr learned my addr 172.21.15.66:0/2010924006 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2bbfff640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc0c71c0 0x7fc2bc15ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c16b6640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc1598c0 0x7fc2bc072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 -- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc0c71c0 msgr2=0x7fc2bc15ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc0c71c0 0x7fc2bc15ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 -- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc1598c0 msgr2=0x7fc2bc072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc1598c0 0x7fc2bc072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.124+0000 7fc2c0eb5640 1 -- 172.21.15.66:0/2010924006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc0cbf20 con 0x7fc2bc06ec40 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.125+0000 7fc2c0eb5640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc1490d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00cf60 tx=0x7fc2ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.125+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac01a070 con 0x7fc2bc06ec40 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.125+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00d840 con 0x7fc2bc06ec40 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.125+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc15b860 con 0x7fc2bc06ec40 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.125+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00dc10 con 0x7fc2bc06ec40 2024-05-10T11:20:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.125+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc0cc4a0 con 0x7fc2bc06ec40 2024-05-10T11:20:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.126+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2bc06a220 con 0x7fc2bc06ec40 2024-05-10T11:20:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.126+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc2ac01d070 con 0x7fc2bc06ec40 2024-05-10T11:20:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.127+0000 7fc2b97fa640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2a80762d0 0x7fc2a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.127+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7fc2ac097cc0 con 0x7fc2bc06ec40 2024-05-10T11:20:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.127+0000 7fc2bbfff640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2a80762d0 0x7fc2a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.128+0000 7fc2bbfff640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2a80762d0 0x7fc2a8078790 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0034000 tx=0x7fc2b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:26.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.131+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc2ac061090 con 0x7fc2bc06ec40 2024-05-10T11:20:26.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.367+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2bc06e4e0 con 0x7fc2bc06ec40 2024-05-10T11:20:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.367+0000 7fc2b97fa640 1 -- 172.21.15.66:0/2010924006 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3875 (secure 0 0 0) 0x7fc2ac065390 con 0x7fc2bc06ec40 2024-05-10T11:20:26.368 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:26.368 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1675683288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1675683288},{"type":"v1","addr":"172.21.15.66:6833","nonce":1675683288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3837867835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3837867835},{"type":"v1","addr":"172.21.15.190:6836","nonce":3837867835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3014134449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3014134449},{"type":"v1","addr":"172.21.15.190:6837","nonce":3014134449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7557,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3792695507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":3792695507},{"type":"v1","addr":"172.21.15.66:6835","nonce":3792695507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-05-10T11:20:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 78 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.369+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2a80762d0 msgr2=0x7fc2a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.369+0000 7fc2c3119640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2a80762d0 0x7fc2a8078790 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0034000 tx=0x7fc2b002e000 comp rx=0 tx=0).stop 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.369+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 msgr2=0x7fc2bc1490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.369+0000 7fc2c3119640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc1490d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00cf60 tx=0x7fc2ac00cf90 comp rx=0 tx=0).stop 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 shutdown_connections 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2a80762d0 0x7fc2a8078790 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc1598c0 0x7fc2bc072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2bc0c71c0 0x7fc2bc15ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 --2- 172.21.15.66:0/2010924006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2bc06ec40 0x7fc2bc1490d0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 >> 172.21.15.66:0/2010924006 conn(0x7fc2bc0b2900 msgr2=0x7fc2bc157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:26.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 shutdown_connections 2024-05-10T11:20:26.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.370+0000 7fc2c3119640 1 -- 172.21.15.66:0/2010924006 wait complete. 2024-05-10T11:20:26.381 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:20:26.381 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:20:26.382 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:20:26.382 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:20:26.382 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:20:26.382 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:20:26.382 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:20:26.382 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:20:26.383 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:20:26.383 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:20:26.383 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:20:26.383 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:20:26.383 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:20:26.383 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:20:26.383 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:20:26.384 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:20:26.393 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:20:26.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:20:26.394 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:20:26.395 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:20:26.396 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:20:26.396 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:20:26.397 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:20:26.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:20:26.437 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:20:26.437 DEBUG:teuthology.parallel:result is None 2024-05-10T11:20:26.438 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:20:26.438 DEBUG:teuthology.parallel:result is None 2024-05-10T11:20:26.439 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:20:26.439 DEBUG:teuthology.parallel:result is None 2024-05-10T11:20:26.440 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:20:26.440 DEBUG:teuthology.parallel:result is None 2024-05-10T11:20:26.440 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:20:26.517 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:20:26.517 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:20:26.522 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:20:26.523 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:20:26.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.549+0000 7f16bbe45640 1 Processor -- start 2024-05-10T11:20:26.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.549+0000 7f16bbe45640 1 -- start start 2024-05-10T11:20:26.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16bbe45640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16b40702e0 0x7f16b40d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16bbe45640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b406f3c0 con 0x7f16b415f290 2024-05-10T11:20:26.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16bbe45640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b40d16f0 con 0x7f16b40d3450 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16bbe45640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f16b40d14c0 con 0x7f16b40702e0 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16ba3e2640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16b40702e0 0x7f16b40d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16b9be1640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f16b415f290 0x7f16b40d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55638/0 (socket says 172.21.15.66:55638) 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.550+0000 7f16b9be1640 1 -- 172.21.15.66:0/2128216292 learned_addr learned my addr 172.21.15.66:0/2128216292 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.551+0000 7f16b8bdf640 1 -- 172.21.15.66:0/2128216292 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703356453 0 0) 0x7f16b406f3c0 con 0x7f16b415f290 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.551+0000 7f16b8bdf640 1 -- 172.21.15.66:0/2128216292 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16a0003520 con 0x7f16b415f290 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.551+0000 7f16ba3e2640 1 -- 172.21.15.66:0/2128216292 >> v1:172.21.15.190:6789/0 conn(0x7f16b40d3450 legacy=0x7f16b406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.551+0000 7f16ba3e2640 1 -- 172.21.15.66:0/2128216292 >> v1:172.21.15.66:6789/0 conn(0x7f16b415f290 legacy=0x7f16b40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.551+0000 7f16ba3e2640 1 -- 172.21.15.66:0/2128216292 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b40d19d0 con 0x7f16b40702e0 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16ba3e2640 1 --2- 172.21.15.66:0/2128216292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b40702e0 0x7f16b40d0f80 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009d90 tx=0x7f16ac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a94d84819b56471 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16b8bdf640 1 -- 172.21.15.66:0/2128216292 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac007740 con 0x7f16b40702e0 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16b8bdf640 1 -- 172.21.15.66:0/2128216292 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac0078e0 con 0x7f16b40702e0 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16b8bdf640 1 -- 172.21.15.66:0/2128216292 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac007c90 con 0x7f16b40702e0 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 -- 172.21.15.66:0/2128216292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b40702e0 msgr2=0x7f16b40d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 --2- 172.21.15.66:0/2128216292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b40702e0 0x7f16b40d0f80 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009d90 tx=0x7f16ac02a730 comp rx=0 tx=0).stop 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 -- 172.21.15.66:0/2128216292 shutdown_connections 2024-05-10T11:20:26.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 --2- 172.21.15.66:0/2128216292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b40702e0 0x7f16b40d0f80 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 -- 172.21.15.66:0/2128216292 >> 172.21.15.66:0/2128216292 conn(0x7f16b409ba20 msgr2=0x7f16b409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:26.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 -- 172.21.15.66:0/2128216292 shutdown_connections 2024-05-10T11:20:26.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.552+0000 7f16bbe45640 1 -- 172.21.15.66:0/2128216292 wait complete. 2024-05-10T11:20:26.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 Processor -- start 2024-05-10T11:20:26.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 -- start start 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16b40702e0 0x7f16b41f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16b40d3450 0x7f16b4161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 0x7f16b41621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16b40d1f90 con 0x7f16b415f290 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16b40d2300 con 0x7f16b40702e0 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.554+0000 7f16bbe45640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f16b415f670 con 0x7f16b40d3450 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 0x7f16b41621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 0x7f16b41621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51618/0 (socket says 172.21.15.66:51618) 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 -- 172.21.15.66:0/3234471748 learned_addr learned my addr 172.21.15.66:0/3234471748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16b9be1640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16b40702e0 0x7f16b41f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16b93e0640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16b40d3450 0x7f16b4161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 -- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16b40d3450 msgr2=0x7f16b4161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16b40d3450 0x7f16b4161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 -- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16b40702e0 msgr2=0x7f16b41f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16b40702e0 0x7f16b41f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 -- 172.21.15.66:0/3234471748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b41f54e0 con 0x7f16b415f290 2024-05-10T11:20:26.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16ba3e2640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 0x7f16b41621c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009eb0 tx=0x7f16ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac03f070 con 0x7f16b415f290 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac031be0 con 0x7f16b415f290 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac009450 con 0x7f16b415f290 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16bbe45640 1 -- 172.21.15.66:0/3234471748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b409f5f0 con 0x7f16b415f290 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.555+0000 7f16bbe45640 1 -- 172.21.15.66:0/3234471748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b41f5e40 con 0x7f16b415f290 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.556+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b40693f0 con 0x7f16b415f290 2024-05-10T11:20:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.557+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16ac03b410 con 0x7f16b415f290 2024-05-10T11:20:26.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.557+0000 7f16a67fc640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16980762d0 0x7f1698078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:26.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.557+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f16ac0b8790 con 0x7f16b415f290 2024-05-10T11:20:26.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.558+0000 7f16b9be1640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16980762d0 0x7f1698078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:26.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.558+0000 7f16b9be1640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16980762d0 0x7f1698078790 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f16a8005880 tx=0x7f16a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:26.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.562+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f16ac081bf0 con 0x7f16b415f290 2024-05-10T11:20:26.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:26.764+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f16b415e220 con 0x7f16b415f290 2024-05-10T11:20:27.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.814+0000 7f16a67fc640 1 -- 172.21.15.66:0/3234471748 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) ==== 97+0+0 (secure 0 0 0) 0x7f16ac085ef0 con 0x7f16b415f290 2024-05-10T11:20:27.815 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16980762d0 msgr2=0x7f1698078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16980762d0 0x7f1698078790 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f16a8005880 tx=0x7f16a8009040 comp rx=0 tx=0).stop 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 msgr2=0x7f16b41621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 0x7f16b41621c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009eb0 tx=0x7f16ac004a40 comp rx=0 tx=0).stop 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 shutdown_connections 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f16980762d0 0x7f1698078790 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16b415f290 0x7f16b41621c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16b40d3450 0x7f16b4161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 --2- 172.21.15.66:0/3234471748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16b40702e0 0x7f16b41f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.817+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 >> 172.21.15.66:0/3234471748 conn(0x7f16b409ba20 msgr2=0x7f16b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:27.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.818+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 shutdown_connections 2024-05-10T11:20:27.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.818+0000 7f1697fff640 1 -- 172.21.15.66:0/3234471748 wait complete. 2024-05-10T11:20:27.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:20:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.942+0000 7f3cd4edc640 1 Processor -- start 2024-05-10T11:20:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.942+0000 7f3cd4edc640 1 -- start start 2024-05-10T11:20:27.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cd4edc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3cd015f3b0 0x7f3cd00d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:27.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cd4edc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3cd00d5d30 0x7f3cd00d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cd4edc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00d30b0 con 0x7f3cd015f790 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cd4edc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00d3390 con 0x7f3cd015f3b0 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cd4edc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00c8c80 con 0x7f3cd00d5d30 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cce59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3cd015f3b0 0x7f3cd00d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cc7fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3cd015f790 0x7f3cd00c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55654/0 (socket says 172.21.15.66:55654) 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cc7fff640 1 -- 172.21.15.66:0/1111335093 learned_addr learned my addr 172.21.15.66:0/1111335093 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cce59c640 1 -- 172.21.15.66:0/1111335093 >> v2:172.21.15.190:3300/0 conn(0x7f3cd00d5d30 msgr2=0x7f3cd00d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cced9d640 1 --2- 172.21.15.66:0/1111335093 >> v2:172.21.15.190:3300/0 conn(0x7f3cd00d5d30 0x7f3cd00d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3ccdd9b640 1 -- 172.21.15.66:0/1111335093 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491036727 0 0) 0x7f3cd00d30b0 con 0x7f3cd015f790 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cce59c640 1 --2- 172.21.15.66:0/1111335093 >> v2:172.21.15.190:3300/0 conn(0x7f3cd00d5d30 0x7f3cd00d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cce59c640 1 -- 172.21.15.66:0/1111335093 >> v1:172.21.15.66:6789/0 conn(0x7f3cd015f790 legacy=0x7f3cd00c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cce59c640 1 -- 172.21.15.66:0/1111335093 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00c8f60 con 0x7f3cd015f3b0 2024-05-10T11:20:27.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.943+0000 7f3cced9d640 1 --2- 172.21.15.66:0/1111335093 >> v2:172.21.15.190:3300/0 conn(0x7f3cd00d5d30 0x7f3cd00d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.944+0000 7f3cce59c640 1 --2- 172.21.15.66:0/1111335093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd015f3b0 0x7f3cd00d36f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3cd008d220 tx=0x7f3cc002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc8a639c9101af8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.944+0000 7f3ccdd9b640 1 -- 172.21.15.66:0/1111335093 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0037070 con 0x7f3cd015f3b0 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.944+0000 7f3ccdd9b640 1 -- 172.21.15.66:0/1111335093 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc0032440 con 0x7f3cd015f3b0 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.944+0000 7f3ccdd9b640 1 -- 172.21.15.66:0/1111335093 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0032810 con 0x7f3cd015f3b0 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 -- 172.21.15.66:0/1111335093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd015f3b0 msgr2=0x7f3cd00d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/1111335093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd015f3b0 0x7f3cd00d36f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3cd008d220 tx=0x7f3cc002a1a0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 -- 172.21.15.66:0/1111335093 shutdown_connections 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/1111335093 >> v2:172.21.15.190:3300/0 conn(0x7f3cd00d5d30 0x7f3cd00d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/1111335093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd015f3b0 0x7f3cd00d36f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 -- 172.21.15.66:0/1111335093 >> 172.21.15.66:0/1111335093 conn(0x7f3cd00d5130 msgr2=0x7f3cd00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 -- 172.21.15.66:0/1111335093 shutdown_connections 2024-05-10T11:20:27.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.945+0000 7f3cd4edc640 1 -- 172.21.15.66:0/1111335093 wait complete. 2024-05-10T11:20:27.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.946+0000 7f3cd4edc640 1 Processor -- start 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.946+0000 7f3cd4edc640 1 -- start start 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cd4edc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 0x7f3cd01547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cd4edc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cd015f3b0 0x7f3cd0155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cd4edc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cd014b370 0x7f3cd015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cd4edc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00d0e60 con 0x7f3cd00d5d30 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cd4edc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00d0ce0 con 0x7f3cd014b370 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cd4edc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd00d0fe0 con 0x7f3cd015f3b0 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 0x7f3cd01547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 0x7f3cd01547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51642/0 (socket says 172.21.15.66:51642) 2024-05-10T11:20:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 -- 172.21.15.66:0/3701563793 learned_addr learned my addr 172.21.15.66:0/3701563793 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cced9d640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cd014b370 0x7f3cd015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cc7fff640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cd015f3b0 0x7f3cd0155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 -- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cd015f3b0 msgr2=0x7f3cd0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cd015f3b0 0x7f3cd0155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 -- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cd014b370 msgr2=0x7f3cd015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cd014b370 0x7f3cd015cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 -- 172.21.15.66:0/3701563793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd01f5570 con 0x7f3cd00d5d30 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.947+0000 7f3cce59c640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 0x7f3cd01547f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0000c00 tx=0x7f3cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.948+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0037040 con 0x7f3cd00d5d30 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.948+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc0042070 con 0x7f3cd00d5d30 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.948+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd01f5850 con 0x7f3cd00d5d30 2024-05-10T11:20:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.948+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0030bb0 con 0x7f3cd00d5d30 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.948+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd01f5e10 con 0x7f3cd00d5d30 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.949+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd006a220 con 0x7f3cd00d5d30 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.949+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3cc0047460 con 0x7f3cd00d5d30 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.950+0000 7f3cc6ffd640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3cb0076300 0x7f3cb00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.950+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5249+0+0 (secure 0 0 0) 0x7f3cc00b7f50 con 0x7f3cd00d5d30 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.950+0000 7f3cc7fff640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3cb0076300 0x7f3cb00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.951+0000 7f3cc7fff640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3cb0076300 0x7f3cb00787c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3cd01f54a0 tx=0x7f3cb8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:27.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:27.954+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3cc0032e20 con 0x7f3cd00d5d30 2024-05-10T11:20:28.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.220+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3cd006ebb0 con 0x7f3cd00d5d30 2024-05-10T11:20:28.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.221+0000 7f3cc6ffd640 1 -- 172.21.15.66:0/3701563793 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f3cc0081420 con 0x7f3cd00d5d30 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.222 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:20:28.223 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:20:28.224 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:20:28.225 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.226 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:20:28.227 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.228 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.229 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.230 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.231 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.232 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.233 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow r", 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.234 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:20:28.236 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:20:28.237 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.238 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:20:28.239 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:20:28.240 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.240 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.240 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:20:28.240 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3cb0076300 msgr2=0x7f3cb00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3cb0076300 0x7f3cb00787c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3cd01f54a0 tx=0x7f3cb8007de0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 msgr2=0x7f3cd01547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 0x7f3cd01547f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0000c00 tx=0x7f3cc00046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 shutdown_connections 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3cb0076300 0x7f3cb00787c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cd014b370 0x7f3cd015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cd015f3b0 0x7f3cd0155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 --2- 172.21.15.66:0/3701563793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cd00d5d30 0x7f3cd01547f0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 >> 172.21.15.66:0/3701563793 conn(0x7f3cd00d5130 msgr2=0x7f3cd0075920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:28.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 shutdown_connections 2024-05-10T11:20:28.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.223+0000 7f3cd4edc640 1 -- 172.21.15.66:0/3701563793 wait complete. 2024-05-10T11:20:28.243 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:20:28.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.347+0000 7fe563475640 1 Processor -- start 2024-05-10T11:20:28.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.347+0000 7fe563475640 1 -- start start 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe563475640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe55c0d5cb0 0x7fe55c0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe563475640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0b45f0 con 0x7fe55c162b30 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe563475640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0b48d0 con 0x7fe55c162750 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe563475640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c0b4f20 con 0x7fe55c0d5cb0 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe561a12640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe55c162b30 0x7fe55c0b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55660/0 (socket says 172.21.15.66:55660) 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe561a12640 1 -- 172.21.15.66:0/2076914152 learned_addr learned my addr 172.21.15.66:0/2076914152 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe560a10640 1 --2- 172.21.15.66:0/2076914152 >> v2:172.21.15.190:3300/0 conn(0x7fe55c0d5cb0 0x7fe55c0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe55bfff640 1 -- 172.21.15.66:0/2076914152 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3059456482 0 0) 0x7fe55c0b45f0 con 0x7fe55c162b30 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.348+0000 7fe55bfff640 1 -- 172.21.15.66:0/2076914152 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe544003520 con 0x7fe55c162b30 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.349+0000 7fe560a10640 1 -- 172.21.15.66:0/2076914152 >> v1:172.21.15.190:6789/0 conn(0x7fe55c162750 legacy=0x7fe55c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.349+0000 7fe560a10640 1 -- 172.21.15.66:0/2076914152 >> v1:172.21.15.66:6789/0 conn(0x7fe55c162b30 legacy=0x7fe55c0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.349+0000 7fe560a10640 1 -- 172.21.15.66:0/2076914152 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c0b4bb0 con 0x7fe55c0d5cb0 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe560a10640 1 --2- 172.21.15.66:0/2076914152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c0d5cb0 0x7fe55c0d3630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe5500097a0 tx=0x7fe55002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ba06bebf39b50fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe55bfff640 1 -- 172.21.15.66:0/2076914152 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550037070 con 0x7fe55c0d5cb0 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe55bfff640 1 -- 172.21.15.66:0/2076914152 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe550032440 con 0x7fe55c0d5cb0 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe55bfff640 1 -- 172.21.15.66:0/2076914152 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550032810 con 0x7fe55c0d5cb0 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 -- 172.21.15.66:0/2076914152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c0d5cb0 msgr2=0x7fe55c0d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 --2- 172.21.15.66:0/2076914152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c0d5cb0 0x7fe55c0d3630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe5500097a0 tx=0x7fe55002a1a0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 -- 172.21.15.66:0/2076914152 shutdown_connections 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 --2- 172.21.15.66:0/2076914152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c0d5cb0 0x7fe55c0d3630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 -- 172.21.15.66:0/2076914152 >> 172.21.15.66:0/2076914152 conn(0x7fe55c09e3b0 msgr2=0x7fe55c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:28.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 -- 172.21.15.66:0/2076914152 shutdown_connections 2024-05-10T11:20:28.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.350+0000 7fe563475640 1 -- 172.21.15.66:0/2076914152 wait complete. 2024-05-10T11:20:28.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 Processor -- start 2024-05-10T11:20:28.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 -- start start 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe55c162750 0x7fe55c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c162b30 0x7fe55c0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 0x7fe55c0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c0d3f40 con 0x7fe55c0c8b80 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c0d3dc0 con 0x7fe55c162b30 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.352+0000 7fe563475640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c0d0fe0 con 0x7fe55c162750 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 0x7fe55c0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 0x7fe55c0c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51646/0 (socket says 172.21.15.66:51646) 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 -- 172.21.15.66:0/939161168 learned_addr learned my addr 172.21.15.66:0/939161168 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe560a10640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c162b30 0x7fe55c0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561211640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe55c162750 0x7fe55c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 -- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe55c162750 msgr2=0x7fe55c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe55c162750 0x7fe55c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 -- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c162b30 msgr2=0x7fe55c0cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c162b30 0x7fe55c0cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 -- 172.21.15.66:0/939161168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c160680 con 0x7fe55c0c8b80 2024-05-10T11:20:28.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe560a10640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c162b30 0x7fe55c0cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:28.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561211640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe55c162750 0x7fe55c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:28.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe561a12640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 0x7fe55c0c9010 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c3c0 tx=0x7fe55400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:28.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554017070 con 0x7fe55c0c8b80 2024-05-10T11:20:28.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe554005ce0 con 0x7fe55c0c8b80 2024-05-10T11:20:28.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c0ca970 con 0x7fe55c0c8b80 2024-05-10T11:20:28.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554007310 con 0x7fe55c0c8b80 2024-05-10T11:20:28.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.353+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c1603a0 con 0x7fe55c0c8b80 2024-05-10T11:20:28.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.354+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55c0cbde0 con 0x7fe55c0c8b80 2024-05-10T11:20:28.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.355+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe55401a070 con 0x7fe55c0c8b80 2024-05-10T11:20:28.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.355+0000 7fe559ffb640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5480762d0 0x7fe548078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.356+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5249+0+0 (secure 0 0 0) 0x7fe554096770 con 0x7fe55c0c8b80 2024-05-10T11:20:28.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.356+0000 7fe561211640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5480762d0 0x7fe548078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.356+0000 7fe561211640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5480762d0 0x7fe548078790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe54c001e00 tx=0x7fe54c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:28.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.360+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe55c0cbde0 con 0x7fe55c0c8b80 2024-05-10T11:20:28.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.553+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe55c06a220 con 0x7fe55c0c8b80 2024-05-10T11:20:28.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.554+0000 7fe559ffb640 1 -- 172.21.15.66:0/939161168 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7fe5540602a0 con 0x7fe55c0c8b80 2024-05-10T11:20:28.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:28.554 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:20:28.554 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:20:28.555 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:20:28.555 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:20:28.555 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:28.555 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:20:28.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5480762d0 msgr2=0x7fe548078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5480762d0 0x7fe548078790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe54c001e00 tx=0x7fe54c009040 comp rx=0 tx=0).stop 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 msgr2=0x7fe55c0c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 0x7fe55c0c9010 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c3c0 tx=0x7fe55400c880 comp rx=0 tx=0).stop 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 shutdown_connections 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe5480762d0 0x7fe548078790 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe55c0c8b80 0x7fe55c0c9010 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe55c162b30 0x7fe55c0cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 --2- 172.21.15.66:0/939161168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe55c162750 0x7fe55c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 >> 172.21.15.66:0/939161168 conn(0x7fe55c09e3b0 msgr2=0x7fe55c0d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 shutdown_connections 2024-05-10T11:20:28.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.556+0000 7fe563475640 1 -- 172.21.15.66:0/939161168 wait complete. 2024-05-10T11:20:28.567 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:20:28.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:20:28.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.675+0000 7f20c3eda640 1 Processor -- start 2024-05-10T11:20:28.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.675+0000 7f20c3eda640 1 -- start start 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c3eda640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f20bc15f690 0x7f20bc0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c3eda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f20bc0cec70 0x7f20bc0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c3eda640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20bc0cc1a0 con 0x7f20bc072d20 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c3eda640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f20bc0cd660 con 0x7f20bc0cec70 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c3eda640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f20bc0cf1e0 con 0x7f20bc15f690 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c1475640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f20bc0cec70 0x7f20bc0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c1475640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f20bc0cec70 0x7f20bc0727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51652/0 (socket says 172.21.15.66:51652) 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c1475640 1 -- 172.21.15.66:0/2553459888 learned_addr learned my addr 172.21.15.66:0/2553459888 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.676+0000 7f20c1c76640 1 --2- 172.21.15.66:0/2553459888 >> v2:172.21.15.190:3300/0 conn(0x7f20bc15f690 0x7f20bc0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c1475640 1 -- 172.21.15.66:0/2553459888 >> v2:172.21.15.190:3300/0 conn(0x7f20bc15f690 msgr2=0x7f20bc0d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c1475640 1 --2- 172.21.15.66:0/2553459888 >> v2:172.21.15.190:3300/0 conn(0x7f20bc15f690 0x7f20bc0d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c1475640 1 -- 172.21.15.66:0/2553459888 >> v1:172.21.15.190:6789/0 conn(0x7f20bc072d20 legacy=0x7f20bc15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c1475640 1 -- 172.21.15.66:0/2553459888 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc0d06b0 con 0x7f20bc0cec70 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c1475640 1 --2- 172.21.15.66:0/2553459888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0727e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f20bc069fd0 tx=0x7f20ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf539c5bb762650 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c0c74640 1 -- 172.21.15.66:0/2553459888 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac037070 con 0x7f20bc0cec70 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.677+0000 7f20c0c74640 1 -- 172.21.15.66:0/2553459888 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac032440 con 0x7f20bc0cec70 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c0c74640 1 -- 172.21.15.66:0/2553459888 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac032810 con 0x7f20bc0cec70 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 -- 172.21.15.66:0/2553459888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 msgr2=0x7f20bc0727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2553459888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0727e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f20bc069fd0 tx=0x7f20ac02a270 comp rx=0 tx=0).stop 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 -- 172.21.15.66:0/2553459888 shutdown_connections 2024-05-10T11:20:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2553459888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0727e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2553459888 >> v2:172.21.15.190:3300/0 conn(0x7f20bc15f690 0x7f20bc0d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 -- 172.21.15.66:0/2553459888 >> 172.21.15.66:0/2553459888 conn(0x7f20bc0d10a0 msgr2=0x7f20bc0d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 -- 172.21.15.66:0/2553459888 shutdown_connections 2024-05-10T11:20:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.678+0000 7f20c3eda640 1 -- 172.21.15.66:0/2553459888 wait complete. 2024-05-10T11:20:28.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.679+0000 7f20c3eda640 1 Processor -- start 2024-05-10T11:20:28.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.679+0000 7f20c3eda640 1 -- start start 2024-05-10T11:20:28.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c3eda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20bc072d20 0x7f20bc0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c3eda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c3eda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20bc15f690 0x7f20bc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c3eda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc15d920 con 0x7f20bc0cec70 2024-05-10T11:20:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c3eda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc0735a0 con 0x7f20bc072d20 2024-05-10T11:20:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c3eda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc0d0c70 con 0x7f20bc15f690 2024-05-10T11:20:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c1475640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c1475640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51654/0 (socket says 172.21.15.66:51654) 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c1475640 1 -- 172.21.15.66:0/2351701194 learned_addr learned my addr 172.21.15.66:0/2351701194 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c1c76640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20bc072d20 0x7f20bc0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.680+0000 7f20c2477640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20bc15f690 0x7f20bc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1475640 1 -- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20bc15f690 msgr2=0x7f20bc0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1475640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20bc15f690 0x7f20bc0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1475640 1 -- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20bc072d20 msgr2=0x7f20bc0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1475640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20bc072d20 0x7f20bc0c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1475640 1 -- 172.21.15.66:0/2351701194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc156580 con 0x7f20bc0cec70 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c2477640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20bc15f690 0x7f20bc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1c76640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20bc072d20 0x7f20bc0c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c1475640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0c96e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f20ac000c00 tx=0x7f20ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac041070 con 0x7f20bc0cec70 2024-05-10T11:20:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac03c870 con 0x7f20bc0cec70 2024-05-10T11:20:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac037040 con 0x7f20bc0cec70 2024-05-10T11:20:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc156860 con 0x7f20bc0cec70 2024-05-10T11:20:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.681+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc1557c0 con 0x7f20bc0cec70 2024-05-10T11:20:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.682+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20bc15e450 con 0x7f20bc0cec70 2024-05-10T11:20:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.683+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20ac044070 con 0x7f20bc0cec70 2024-05-10T11:20:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.683+0000 7f20b27fc640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f20a00762d0 0x7f20a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.683+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5249+0+0 (secure 0 0 0) 0x7f20ac0b7df0 con 0x7f20bc0cec70 2024-05-10T11:20:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.684+0000 7f20c1c76640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f20a00762d0 0x7f20a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.684+0000 7f20c1c76640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f20a00762d0 0x7f20a0078790 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006fd0 tx=0x7f20b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.688+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f20bc15e450 con 0x7f20bc0cec70 2024-05-10T11:20:28.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:28.878+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f20bc0b7020 con 0x7f20bc0cec70 2024-05-10T11:20:29.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.484+0000 7f20b27fc640 1 -- 172.21.15.66:0/2351701194 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7f20ac0819a0 con 0x7f20bc0cec70 2024-05-10T11:20:29.485 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:20:29.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f20a00762d0 msgr2=0x7f20a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f20a00762d0 0x7f20a0078790 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006fd0 tx=0x7f20b8008040 comp rx=0 tx=0).stop 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 msgr2=0x7f20bc0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0c96e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f20ac000c00 tx=0x7f20ac0046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 shutdown_connections 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f20a00762d0 0x7f20a0078790 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20bc15f690 0x7f20bc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20bc0cec70 0x7f20bc0c96e0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 --2- 172.21.15.66:0/2351701194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20bc072d20 0x7f20bc0c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 >> 172.21.15.66:0/2351701194 conn(0x7f20bc0d10a0 msgr2=0x7f20bc06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 shutdown_connections 2024-05-10T11:20:29.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.487+0000 7f20c3eda640 1 -- 172.21.15.66:0/2351701194 wait complete. 2024-05-10T11:20:29.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:20:29.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.618+0000 7fb790f51640 1 Processor -- start 2024-05-10T11:20:29.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.618+0000 7fb790f51640 1 -- start start 2024-05-10T11:20:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb790f51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 0x7fb78c0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb790f51640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb78c0cd500 0x7fb78c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb790f51640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c06e720 con 0x7fb78c0b2dd0 2024-05-10T11:20:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb790f51640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb78c06de80 con 0x7fb78c0cd500 2024-05-10T11:20:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb790f51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb78c06e160 con 0x7fb78c0cf3e0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb78ad9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb78c0b2dd0 0x7fb78c0b3260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55664/0 (socket says 172.21.15.66:55664) 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb78ad9d640 1 -- 172.21.15.66:0/3702423142 learned_addr learned my addr 172.21.15.66:0/3702423142 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb78a59c640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 0x7fb78c0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb789d9b640 1 --2- 172.21.15.66:0/3702423142 >> v2:172.21.15.190:3300/0 conn(0x7fb78c0cd500 0x7fb78c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137906972 0 0) 0x7fb78c06e720 con 0x7fb78c0b2dd0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.619+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb774003520 con 0x7fb78c0b2dd0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73887675 0 0) 0x7fb774003520 con 0x7fb78c0b2dd0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 msgr2=0x7fb78c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 0x7fb78c0cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 >> v2:172.21.15.190:3300/0 conn(0x7fb78c0cd500 msgr2=0x7fb78c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 --2- 172.21.15.66:0/3702423142 >> v2:172.21.15.190:3300/0 conn(0x7fb78c0cd500 0x7fb78c0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c06e440 con 0x7fb78c0b2dd0 2024-05-10T11:20:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fb784001670 con 0x7fb78c0b2dd0 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 >> v1:172.21.15.66:6789/0 conn(0x7fb78c0b2dd0 legacy=0x7fb78c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7740039b0 0x7fb774003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 0x7fb774004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb774004d40 0x7fb7740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c06de80 con 0x7fb7740039b0 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c06e160 con 0x7fb774004d40 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb77400b9c0 con 0x7fb78c0cf3e0 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb789d9b640 1 --2- 172.21.15.66:0/3702423142 >> v2:172.21.15.190:3300/0 conn(0x7fb78c0cd500 0x7fb78c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78a59c640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7740039b0 0x7fb774003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78ad9d640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb774004d40 0x7fb7740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb789d9b640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 0x7fb774004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78a59c640 1 -- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 msgr2=0x7fb774004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78a59c640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c0cf3e0 0x7fb774004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78a59c640 1 -- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb774004d40 msgr2=0x7fb7740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78a59c640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb774004d40 0x7fb7740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.620+0000 7fb78a59c640 1 -- 172.21.15.66:0/3702423142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb774003520 con 0x7fb7740039b0 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.621+0000 7fb78a59c640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7740039b0 0x7fb774003dd0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009fc0 tx=0x7fb774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30d7e9589b0d2c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.621+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c009c10 con 0x7fb7740039b0 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.621+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c036070 con 0x7fb7740039b0 2024-05-10T11:20:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.621+0000 7fb78959a640 1 -- 172.21.15.66:0/3702423142 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c031880 con 0x7fb7740039b0 2024-05-10T11:20:29.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb790f51640 1 -- 172.21.15.66:0/3702423142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7740039b0 msgr2=0x7fb774003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb790f51640 1 --2- 172.21.15.66:0/3702423142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7740039b0 0x7fb774003dd0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009fc0 tx=0x7fb774005830 comp rx=0 tx=0).stop 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb78ad9d640 1 -- 172.21.15.66:0/3702423142 reap_dead start 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb790f51640 1 -- 172.21.15.66:0/3702423142 shutdown_connections 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb790f51640 1 -- 172.21.15.66:0/3702423142 >> 172.21.15.66:0/3702423142 conn(0x7fb78c0d2eb0 msgr2=0x7fb78c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb790f51640 1 -- 172.21.15.66:0/3702423142 shutdown_connections 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.622+0000 7fb790f51640 1 -- 172.21.15.66:0/3702423142 wait complete. 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.623+0000 7fb790f51640 1 Processor -- start 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.623+0000 7fb790f51640 1 -- start start 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb790f51640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7740039b0 0x7fb78c0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb790f51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c14fca0 0x7fb78c1f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb790f51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 0x7fb78c1f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb790f51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c0cf8c0 con 0x7fb78c150120 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb790f51640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c0b4510 con 0x7fb7740039b0 2024-05-10T11:20:29.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb790f51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb78c0cfa40 con 0x7fb78c14fca0 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 0x7fb78c1f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 0x7fb78c1f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51674/0 (socket says 172.21.15.66:51674) 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 -- 172.21.15.66:0/1817718837 learned_addr learned my addr 172.21.15.66:0/1817718837 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb789d9b640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c14fca0 0x7fb78c1f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78a59c640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7740039b0 0x7fb78c0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 -- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c14fca0 msgr2=0x7fb78c1f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c14fca0 0x7fb78c1f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 -- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7740039b0 msgr2=0x7fb78c0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7740039b0 0x7fb78c0ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.624+0000 7fb78ad9d640 1 -- 172.21.15.66:0/1817718837 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c0cd220 con 0x7fb78c150120 2024-05-10T11:20:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.625+0000 7fb78ad9d640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 0x7fb78c1f8cf0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb784000fb0 tx=0x7fb784007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.625+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78400f910 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.625+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb784018070 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.625+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78400fd50 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.625+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c0c8700 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.625+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78c15f9e0 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.626+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78c06a220 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.627+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb78401d460 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.627+0000 7fb77affd640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb76c0762d0 0x7fb76c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.627+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5619+0+0 (secure 0 0 0) 0x7fb784097410 con 0x7fb78c150120 2024-05-10T11:20:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.627+0000 7fb78a59c640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb76c0762d0 0x7fb76c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.628+0000 7fb78a59c640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb76c0762d0 0x7fb76c078790 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb77c035000 tx=0x7fb77c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.632+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb784060dc0 con 0x7fb78c150120 2024-05-10T11:20:29.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:29.823+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb78c0b2230 con 0x7fb78c150120 2024-05-10T11:20:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.491+0000 7fb77affd640 1 -- 172.21.15.66:0/1817718837 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7fb7840606c0 con 0x7fb78c150120 2024-05-10T11:20:30.492 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb76c0762d0 msgr2=0x7fb76c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb76c0762d0 0x7fb76c078790 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb77c035000 tx=0x7fb77c02f000 comp rx=0 tx=0).stop 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 msgr2=0x7fb78c1f8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 0x7fb78c1f8cf0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb784000fb0 tx=0x7fb784007720 comp rx=0 tx=0).stop 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 shutdown_connections 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb76c0762d0 0x7fb76c078790 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb78c150120 0x7fb78c1f8cf0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb78c14fca0 0x7fb78c1f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 --2- 172.21.15.66:0/1817718837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7740039b0 0x7fb78c0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 >> 172.21.15.66:0/1817718837 conn(0x7fb78c0d2eb0 msgr2=0x7fb78c071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 shutdown_connections 2024-05-10T11:20:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.494+0000 7fb790f51640 1 -- 172.21.15.66:0/1817718837 wait complete. 2024-05-10T11:20:30.516 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:20:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.625+0000 7f572ed19640 1 Processor -- start 2024-05-10T11:20:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.625+0000 7f572ed19640 1 -- start start 2024-05-10T11:20:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572ed19640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57280cf3e0 0x7f57280cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572ed19640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280d2190 0x7f57280cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572ed19640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572806e720 con 0x7f57280cd500 2024-05-10T11:20:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572ed19640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f572806de80 con 0x7f57280cf3e0 2024-05-10T11:20:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572ed19640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f572806e160 con 0x7f57280d2190 2024-05-10T11:20:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572cab5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57280cf3e0 0x7f57280cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572cab5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57280cf3e0 0x7f57280cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51678/0 (socket says 172.21.15.66:51678) 2024-05-10T11:20:30.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f5727fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f57280cd500 0x7f57280b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55668/0 (socket says 172.21.15.66:55668) 2024-05-10T11:20:30.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572cab5640 1 -- 172.21.15.66:0/3581879019 learned_addr learned my addr 172.21.15.66:0/3581879019 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:30.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.626+0000 7f572d2b6640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280d2190 0x7f57280cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:30.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f572cab5640 1 -- 172.21.15.66:0/3581879019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280d2190 msgr2=0x7f57280cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:30.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f572cab5640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280d2190 0x7f57280cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f572cab5640 1 -- 172.21.15.66:0/3581879019 >> v1:172.21.15.66:6789/0 conn(0x7f57280cd500 legacy=0x7f57280b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f572cab5640 1 -- 172.21.15.66:0/3581879019 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572806e440 con 0x7f57280cf3e0 2024-05-10T11:20:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f57277fe640 1 -- 172.21.15.66:0/3581879019 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921247692 0 0) 0x7f572806e720 con 0x7f57280cd500 2024-05-10T11:20:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f572d2b6640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280d2190 0x7f57280cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f572cab5640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280cf3e0 0x7f57280cf8c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5718009870 tx=0x7f571802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7e25db7fd9b595 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f57277fe640 1 -- 172.21.15.66:0/3581879019 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718037070 con 0x7f57280cf3e0 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f57277fe640 1 -- 172.21.15.66:0/3581879019 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5718032440 con 0x7f57280cf3e0 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.627+0000 7f57277fe640 1 -- 172.21.15.66:0/3581879019 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718032810 con 0x7f57280cf3e0 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 -- 172.21.15.66:0/3581879019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280cf3e0 msgr2=0x7f57280cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280cf3e0 0x7f57280cf8c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5718009870 tx=0x7f571802a270 comp rx=0 tx=0).stop 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 -- 172.21.15.66:0/3581879019 shutdown_connections 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280d2190 0x7f57280cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 --2- 172.21.15.66:0/3581879019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280cf3e0 0x7f57280cf8c0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 -- 172.21.15.66:0/3581879019 >> 172.21.15.66:0/3581879019 conn(0x7f57280d2eb0 msgr2=0x7f57280d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 -- 172.21.15.66:0/3581879019 shutdown_connections 2024-05-10T11:20:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.628+0000 7f572ed19640 1 -- 172.21.15.66:0/3581879019 wait complete. 2024-05-10T11:20:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.629+0000 7f572ed19640 1 Processor -- start 2024-05-10T11:20:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.629+0000 7f572ed19640 1 -- start start 2024-05-10T11:20:30.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572ed19640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280cd500 0x7f572814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:30.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572ed19640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57280cf3e0 0x7f57280c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:30.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572ed19640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 0x7f57280cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:30.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572ed19640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57280b34e0 con 0x7f57280d2190 2024-05-10T11:20:30.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572ed19640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57280b4510 con 0x7f57280cf3e0 2024-05-10T11:20:30.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572ed19640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57280b3660 con 0x7f57280cd500 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572d2b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 0x7f57280cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572d2b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 0x7f57280cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51688/0 (socket says 172.21.15.66:51688) 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572d2b6640 1 -- 172.21.15.66:0/2416862691 learned_addr learned my addr 172.21.15.66:0/2416862691 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f572cab5640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280cd500 0x7f572814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.630+0000 7f5727fff640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57280cf3e0 0x7f57280c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572d2b6640 1 -- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280cd500 msgr2=0x7f572814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572d2b6640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280cd500 0x7f572814cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572d2b6640 1 -- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57280cf3e0 msgr2=0x7f57280c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572d2b6640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57280cf3e0 0x7f57280c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572d2b6640 1 -- 172.21.15.66:0/2416862691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57280ca4c0 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f5727fff640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57280cf3e0 0x7f57280c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572d2b6640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 0x7f57280cd950 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f572000cd50 tx=0x7f572000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572000f680 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572000f840 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f572814fe70 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572000fc30 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.631+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57280cbaf0 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.632+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f572814cc00 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.633+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57200213f0 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.633+0000 7f57257fa640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57140762d0 0x7f5714078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.633+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6001+0+0 (secure 0 0 0) 0x7f5720098360 con 0x7f57280d2190 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.633+0000 7f572cab5640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57140762d0 0x7f5714078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:30.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.634+0000 7f572cab5640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57140762d0 0x7f5714078790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5718034000 tx=0x7f571802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:30.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.638+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f572814cc00 con 0x7f57280d2190 2024-05-10T11:20:30.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:30.864+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f572806a220 con 0x7f57280d2190 2024-05-10T11:20:31.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.493+0000 7f57257fa640 1 -- 172.21.15.66:0/2416862691 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v80) ==== 174+0+0 (secure 0 0 0) 0x7f5720014030 con 0x7f57280d2190 2024-05-10T11:20:31.493 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 15 and data pool 16 2024-05-10T11:20:31.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.502+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57140762d0 msgr2=0x7f5714078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.502+0000 7f572ed19640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57140762d0 0x7f5714078790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5718034000 tx=0x7f571802e000 comp rx=0 tx=0).stop 2024-05-10T11:20:31.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.502+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 msgr2=0x7f57280cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.502+0000 7f572ed19640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 0x7f57280cd950 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f572000cd50 tx=0x7f572000a650 comp rx=0 tx=0).stop 2024-05-10T11:20:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.514+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 shutdown_connections 2024-05-10T11:20:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.514+0000 7f572ed19640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57140762d0 0x7f5714078790 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.514+0000 7f572ed19640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57280d2190 0x7f57280cd950 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.514+0000 7f572ed19640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57280cf3e0 0x7f57280c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.514+0000 7f572ed19640 1 --2- 172.21.15.66:0/2416862691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57280cd500 0x7f572814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.514+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 >> 172.21.15.66:0/2416862691 conn(0x7f57280d2eb0 msgr2=0x7f57280cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.515+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 shutdown_connections 2024-05-10T11:20:31.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.516+0000 7f572ed19640 1 -- 172.21.15.66:0/2416862691 wait complete. 2024-05-10T11:20:31.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:20:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.645+0000 7f067e19e640 1 Processor -- start 2024-05-10T11:20:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.645+0000 7f067e19e640 1 -- start start 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067e19e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06780d0500 0x7f06780d5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067e19e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06780d0b90 con 0x7f067815f1f0 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067e19e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06780b4470 con 0x7f06780d3bd0 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067e19e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f06780d2ff0 con 0x7f06780d0500 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067d19c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f067815f1f0 0x7f06780d34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55670/0 (socket says 172.21.15.66:55670) 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067d99d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06780d0500 0x7f06780d5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.646+0000 7f067d19c640 1 -- 172.21.15.66:0/3363159695 learned_addr learned my addr 172.21.15.66:0/3363159695 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f067d99d640 1 -- 172.21.15.66:0/3363159695 >> v1:172.21.15.190:6789/0 conn(0x7f06780d3bd0 legacy=0x7f06780b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f067d99d640 1 -- 172.21.15.66:0/3363159695 >> v1:172.21.15.66:6789/0 conn(0x7f067815f1f0 legacy=0x7f06780d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f067d99d640 1 -- 172.21.15.66:0/3363159695 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06780b4750 con 0x7f06780d0500 2024-05-10T11:20:31.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f066ffff640 1 -- 172.21.15.66:0/3363159695 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966064962 0 0) 0x7f06780d0b90 con 0x7f067815f1f0 2024-05-10T11:20:31.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f067d99d640 1 --2- 172.21.15.66:0/3363159695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06780d0500 0x7f06780d5a00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0670009d90 tx=0x7f067002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb40aa6037e47541 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:31.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f066ffff640 1 -- 172.21.15.66:0/3363159695 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670031600 con 0x7f06780d0500 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f066ffff640 1 -- 172.21.15.66:0/3363159695 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06700317a0 con 0x7f06780d0500 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.647+0000 7f066ffff640 1 -- 172.21.15.66:0/3363159695 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670031b70 con 0x7f06780d0500 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 -- 172.21.15.66:0/3363159695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06780d0500 msgr2=0x7f06780d5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 --2- 172.21.15.66:0/3363159695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06780d0500 0x7f06780d5a00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0670009d90 tx=0x7f067002a610 comp rx=0 tx=0).stop 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 -- 172.21.15.66:0/3363159695 shutdown_connections 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 --2- 172.21.15.66:0/3363159695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06780d0500 0x7f06780d5a00 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 -- 172.21.15.66:0/3363159695 >> 172.21.15.66:0/3363159695 conn(0x7f06780d4ee0 msgr2=0x7f06780d52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 -- 172.21.15.66:0/3363159695 shutdown_connections 2024-05-10T11:20:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.648+0000 7f067e19e640 1 -- 172.21.15.66:0/3363159695 wait complete. 2024-05-10T11:20:31.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.649+0000 7f067e19e640 1 Processor -- start 2024-05-10T11:20:31.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 -- start start 2024-05-10T11:20:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06780d0500 0x7f067815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06780d3bd0 0x7f06780b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 0x7f06780b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f06780b57e0 con 0x7f067815f1f0 2024-05-10T11:20:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06780b5660 con 0x7f06780d3bd0 2024-05-10T11:20:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067e19e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f06780b5960 con 0x7f06780d0500 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067d99d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 0x7f06780b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067d99d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 0x7f06780b8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51706/0 (socket says 172.21.15.66:51706) 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.650+0000 7f067d99d640 1 -- 172.21.15.66:0/907556737 learned_addr learned my addr 172.21.15.66:0/907556737 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067c99b640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06780d3bd0 0x7f06780b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d19c640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06780d0500 0x7f067815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d99d640 1 -- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06780d0500 msgr2=0x7f067815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d99d640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06780d0500 0x7f067815cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d99d640 1 -- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06780d3bd0 msgr2=0x7f06780b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d99d640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06780d3bd0 0x7f06780b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d99d640 1 -- 172.21.15.66:0/907556737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0678161160 con 0x7f067815f1f0 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d19c640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06780d0500 0x7f067815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067d99d640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 0x7f06780b8e10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f0670009d90 tx=0x7f0670004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670040070 con 0x7f067815f1f0 2024-05-10T11:20:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0670030be0 con 0x7f067815f1f0 2024-05-10T11:20:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0678161440 con 0x7f067815f1f0 2024-05-10T11:20:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670009450 con 0x7f067815f1f0 2024-05-10T11:20:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.651+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067815d4f0 con 0x7f067815f1f0 2024-05-10T11:20:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.652+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067806a220 con 0x7f067815f1f0 2024-05-10T11:20:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.653+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0670039040 con 0x7f067815f1f0 2024-05-10T11:20:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.653+0000 7f066dffb640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f065c0762d0 0x7f065c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.654+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f06700b8550 con 0x7f067815f1f0 2024-05-10T11:20:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.654+0000 7f067d19c640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f065c0762d0 0x7f065c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.654+0000 7f067d19c640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f065c0762d0 0x7f065c078790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0674000f60 tx=0x7f0674009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.658+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0670081d20 con 0x7f067815f1f0 2024-05-10T11:20:31.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.850+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0678161a90 con 0x7f067815f1f0 2024-05-10T11:20:31.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.851+0000 7f066dffb640 1 -- 172.21.15.66:0/907556737 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16897 (secure 0 0 0) 0x7f0670081620 con 0x7f067815f1f0 2024-05-10T11:20:31.852 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:31.853 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":103,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:20:30.866431+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:20:28.883807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T11:20:29.828634+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f065c0762d0 msgr2=0x7f065c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f065c0762d0 0x7f065c078790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0674000f60 tx=0x7f0674009040 comp rx=0 tx=0).stop 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 msgr2=0x7f06780b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 0x7f06780b8e10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f0670009d90 tx=0x7f0670004a40 comp rx=0 tx=0).stop 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 shutdown_connections 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f065c0762d0 0x7f065c078790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f067815f1f0 0x7f06780b8e10 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06780d3bd0 0x7f06780b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 --2- 172.21.15.66:0/907556737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06780d0500 0x7f067815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 >> 172.21.15.66:0/907556737 conn(0x7f06780d4ee0 msgr2=0x7f06780d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:31.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 shutdown_connections 2024-05-10T11:20:31.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.853+0000 7f067e19e640 1 -- 172.21.15.66:0/907556737 wait complete. 2024-05-10T11:20:31.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:20:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.970+0000 7f8b866e1640 1 Processor -- start 2024-05-10T11:20:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.970+0000 7f8b866e1640 1 -- start start 2024-05-10T11:20:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b866e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162750 0x7f8b800d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b866e1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b800d5cb0 0x7f8b800d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b866e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b800b45f0 con 0x7f8b80162b30 2024-05-10T11:20:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b866e1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8b800b4f20 con 0x7f8b800d5cb0 2024-05-10T11:20:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b866e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800d0fe0 con 0x7f8b80162750 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b800d5cb0 0x7f8b800d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b800d5cb0 0x7f8b800d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51722/0 (socket says 172.21.15.66:51722) 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 -- 172.21.15.66:0/3246722459 learned_addr learned my addr 172.21.15.66:0/3246722459 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 -- 172.21.15.66:0/3246722459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162750 msgr2=0x7f8b800d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7ffff640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162750 0x7f8b800d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162750 0x7f8b800d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 -- 172.21.15.66:0/3246722459 >> v1:172.21.15.190:6789/0 conn(0x7f8b80162b30 legacy=0x7f8b800d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7f7fe640 1 -- 172.21.15.66:0/3246722459 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800b48d0 con 0x7f8b800d5cb0 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.971+0000 7f8b7ffff640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162750 0x7f8b800d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.972+0000 7f8b7f7fe640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b800d5cb0 0x7f8b800d3630 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009870 tx=0x7f8b7402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0c2bc8e9ece393 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:31.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.972+0000 7f8b7effd640 1 -- 172.21.15.66:0/3246722459 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74037070 con 0x7f8b800d5cb0 2024-05-10T11:20:31.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.972+0000 7f8b7effd640 1 -- 172.21.15.66:0/3246722459 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b74032440 con 0x7f8b800d5cb0 2024-05-10T11:20:31.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.972+0000 7f8b7effd640 1 -- 172.21.15.66:0/3246722459 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74032810 con 0x7f8b800d5cb0 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 -- 172.21.15.66:0/3246722459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b800d5cb0 msgr2=0x7f8b800d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b800d5cb0 0x7f8b800d3630 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009870 tx=0x7f8b7402a180 comp rx=0 tx=0).stop 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 -- 172.21.15.66:0/3246722459 shutdown_connections 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b800d5cb0 0x7f8b800d3630 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 --2- 172.21.15.66:0/3246722459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162750 0x7f8b800d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 -- 172.21.15.66:0/3246722459 >> 172.21.15.66:0/3246722459 conn(0x7f8b8009e3b0 msgr2=0x7f8b800d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 -- 172.21.15.66:0/3246722459 shutdown_connections 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.973+0000 7f8b866e1640 1 -- 172.21.15.66:0/3246722459 wait complete. 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.974+0000 7f8b866e1640 1 Processor -- start 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.974+0000 7f8b866e1640 1 -- start start 2024-05-10T11:20:31.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b866e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 0x7f8b800cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b866e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162b30 0x7f8b801570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b866e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b80157620 0x7f8b801f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b866e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b800d0d30 con 0x7f8b80162750 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b866e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8b800d0bb0 con 0x7f8b80157620 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b866e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800b63c0 con 0x7f8b80162b30 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 0x7f8b800cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 0x7f8b800cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51736/0 (socket says 172.21.15.66:51736) 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 -- 172.21.15.66:0/2479253414 learned_addr learned my addr 172.21.15.66:0/2479253414 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b84c7e640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b80157620 0x7f8b801f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7f7fe640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162b30 0x7f8b801570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 -- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162b30 msgr2=0x7f8b801570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162b30 0x7f8b801570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 -- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b80157620 msgr2=0x7f8b801f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b80157620 0x7f8b801f85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 -- 172.21.15.66:0/2479253414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800ba4a0 con 0x7f8b80162750 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.975+0000 7f8b7ffff640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 0x7f8b800cae50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c7f0 tx=0x7f8b7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.976+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70015070 con 0x7f8b80162750 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.976+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70007a30 con 0x7f8b80162750 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.976+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b800b9440 con 0x7f8b80162750 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.976+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70007e00 con 0x7f8b80162750 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.976+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b800b99c0 con 0x7f8b80162750 2024-05-10T11:20:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.977+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8006a220 con 0x7f8b80162750 2024-05-10T11:20:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.977+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b70018070 con 0x7f8b80162750 2024-05-10T11:20:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.978+0000 7f8b7cff9640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b6c0762d0 0x7f8b6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.978+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f8b70097650 con 0x7f8b80162750 2024-05-10T11:20:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.978+0000 7f8b7f7fe640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b6c0762d0 0x7f8b6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.979+0000 7f8b7f7fe640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b6c0762d0 0x7f8b6c078790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8b74034000 tx=0x7f8b7402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:31.982+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8b70060eb0 con 0x7f8b80162750 2024-05-10T11:20:32.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.178+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b800d15e0 con 0x7f8b80162750 2024-05-10T11:20:32.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.179+0000 7f8b7cff9640 1 -- 172.21.15.66:0/2479253414 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16897 (secure 0 0 0) 0x7f8b700607b0 con 0x7f8b80162750 2024-05-10T11:20:32.179 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:32.179 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":103,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:20:30.866431+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:20:28.883807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T11:20:29.828634+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:20:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b6c0762d0 msgr2=0x7f8b6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b6c0762d0 0x7f8b6c078790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8b74034000 tx=0x7f8b7402e000 comp rx=0 tx=0).stop 2024-05-10T11:20:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 msgr2=0x7f8b800cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 0x7f8b800cae50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c7f0 tx=0x7f8b7000cbf0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 shutdown_connections 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b6c0762d0 0x7f8b6c078790 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b80157620 0x7f8b801f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b80162b30 0x7f8b801570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 --2- 172.21.15.66:0/2479253414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b80162750 0x7f8b800cae50 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 >> 172.21.15.66:0/2479253414 conn(0x7f8b8009e3b0 msgr2=0x7f8b8006e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 shutdown_connections 2024-05-10T11:20:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.181+0000 7f8b866e1640 1 -- 172.21.15.66:0/2479253414 wait complete. 2024-05-10T11:20:32.193 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:20:32.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.300+0000 7f6d682a0640 1 Processor -- start 2024-05-10T11:20:32.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.300+0000 7f6d682a0640 1 -- start start 2024-05-10T11:20:32.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d682a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6006f030 0x7f6d60160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d682a0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d6006f410 0x7f6d6015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d682a0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6d6015c9e0 0x7f6d600cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d682a0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f6d600ccb60 con 0x7f6d6006f410 2024-05-10T11:20:32.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d682a0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6d6015cfb0 con 0x7f6d6015c9e0 2024-05-10T11:20:32.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d682a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6015d290 con 0x7f6d6006f030 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d6583b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d6006f410 0x7f6d6015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d6583b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d6006f410 0x7f6d6015c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51752/0 (socket says 172.21.15.66:51752) 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.301+0000 7f6d6583b640 1 -- 172.21.15.66:0/3551699157 learned_addr learned my addr 172.21.15.66:0/3551699157 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6683d640 1 --2- 172.21.15.66:0/3551699157 >> v2:172.21.15.190:3300/0 conn(0x7f6d6015c9e0 0x7f6d600cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6603c640 1 --2- 172.21.15.66:0/3551699157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6006f030 0x7f6d60160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6583b640 1 -- 172.21.15.66:0/3551699157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6006f030 msgr2=0x7f6d60160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6583b640 1 --2- 172.21.15.66:0/3551699157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6006f030 0x7f6d60160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6583b640 1 -- 172.21.15.66:0/3551699157 >> v2:172.21.15.190:3300/0 conn(0x7f6d6015c9e0 msgr2=0x7f6d600cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6583b640 1 --2- 172.21.15.66:0/3551699157 >> v2:172.21.15.190:3300/0 conn(0x7f6d6015c9e0 0x7f6d600cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6583b640 1 -- 172.21.15.66:0/3551699157 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6015fd30 con 0x7f6d6006f410 2024-05-10T11:20:32.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.302+0000 7f6d6583b640 1 --2- 172.21.15.66:0/3551699157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f410 0x7f6d6015c4a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f6d600b06c0 tx=0x7f6d5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b308221aed1701 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d6503a640 1 -- 172.21.15.66:0/3551699157 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50037070 con 0x7f6d6006f410 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d6503a640 1 -- 172.21.15.66:0/3551699157 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d50032440 con 0x7f6d6006f410 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d6503a640 1 -- 172.21.15.66:0/3551699157 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50032810 con 0x7f6d6006f410 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 -- 172.21.15.66:0/3551699157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f410 msgr2=0x7f6d6015c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 --2- 172.21.15.66:0/3551699157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f410 0x7f6d6015c4a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f6d600b06c0 tx=0x7f6d5002a1e0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 -- 172.21.15.66:0/3551699157 shutdown_connections 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 --2- 172.21.15.66:0/3551699157 >> v2:172.21.15.190:3300/0 conn(0x7f6d6015c9e0 0x7f6d600cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 --2- 172.21.15.66:0/3551699157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f410 0x7f6d6015c4a0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 --2- 172.21.15.66:0/3551699157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6006f030 0x7f6d60160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 -- 172.21.15.66:0/3551699157 >> 172.21.15.66:0/3551699157 conn(0x7f6d600d0c90 msgr2=0x7f6d600d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 -- 172.21.15.66:0/3551699157 shutdown_connections 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.303+0000 7f6d682a0640 1 -- 172.21.15.66:0/3551699157 wait complete. 2024-05-10T11:20:32.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.304+0000 7f6d682a0640 1 Processor -- start 2024-05-10T11:20:32.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 -- start start 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 0x7f6d60158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6006f410 0x7f6d600ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6015c9e0 0x7f6d601e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d600cb910 con 0x7f6d6006f030 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6015fa40 con 0x7f6d6006f410 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d682a0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60159d70 con 0x7f6d6015c9e0 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d6603c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 0x7f6d60158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d6603c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 0x7f6d60158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51768/0 (socket says 172.21.15.66:51768) 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.305+0000 7f6d6603c640 1 -- 172.21.15.66:0/663056376 learned_addr learned my addr 172.21.15.66:0/663056376 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6583b640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6006f410 0x7f6d600ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6683d640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6015c9e0 0x7f6d601e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6603c640 1 -- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6015c9e0 msgr2=0x7f6d601e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6603c640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6015c9e0 0x7f6d601e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6603c640 1 -- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6006f410 msgr2=0x7f6d600ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6603c640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6006f410 0x7f6d600ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6603c640 1 -- 172.21.15.66:0/663056376 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d60159530 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d6603c640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 0x7f6d60158ff0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00d830 tx=0x7f6d5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c018020 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0096a0 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c009a70 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d600cad00 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.306+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601e82f0 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.307+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6006a220 con 0x7f6d6006f030 2024-05-10T11:20:32.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.308+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d5c01b020 con 0x7f6d6006f030 2024-05-10T11:20:32.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.308+0000 7f6d56ffd640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d44076300 0x7f6d440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:32.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.308+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f6d5c097b60 con 0x7f6d6006f030 2024-05-10T11:20:32.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.308+0000 7f6d6583b640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d44076300 0x7f6d440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:32.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.309+0000 7f6d6583b640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d44076300 0x7f6d440787c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6d50034000 tx=0x7f6d5002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:32.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.313+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6d5c022030 con 0x7f6d6006f030 2024-05-10T11:20:32.474 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:20:32.474+0000 7f93c737b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:20:32.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:32.543+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6d60073970 con 0x7f6d6006f030 2024-05-10T11:20:32.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:20:32.931 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:20:33.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.511+0000 7f6d56ffd640 1 -- 172.21.15.66:0/663056376 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7f6d5c009e20 con 0x7f6d6006f030 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d44076300 msgr2=0x7f6d440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d44076300 0x7f6d440787c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6d50034000 tx=0x7f6d5002e000 comp rx=0 tx=0).stop 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 msgr2=0x7f6d60158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 0x7f6d60158ff0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00d830 tx=0x7f6d5c00dcf0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 shutdown_connections 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d44076300 0x7f6d440787c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d6015c9e0 0x7f6d601e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6006f410 0x7f6d600ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 --2- 172.21.15.66:0/663056376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d6006f030 0x7f6d60158ff0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 >> 172.21.15.66:0/663056376 conn(0x7f6d600d0c90 msgr2=0x7f6d600cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 shutdown_connections 2024-05-10T11:20:33.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.514+0000 7f6d682a0640 1 -- 172.21.15.66:0/663056376 wait complete. 2024-05-10T11:20:33.529 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:20:33.529 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:20:33.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.642+0000 7f57c3746640 1 Processor -- start 2024-05-10T11:20:33.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.642+0000 7f57c3746640 1 -- start start 2024-05-10T11:20:33.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c3746640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 0x7f57bc0b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c3746640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f57bc0d36d0 0x7f57bc0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c3746640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57bc0d2800 con 0x7f57bc15f410 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c3746640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f57bc0d2ae0 con 0x7f57bc0d36d0 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c3746640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57bc0d01d0 con 0x7f57bc0b4f90 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c14e2640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f57bc15f410 0x7f57bc0d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55682/0 (socket says 172.21.15.66:55682) 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c14e2640 1 -- 172.21.15.66:0/3776680813 learned_addr learned my addr 172.21.15.66:0/3776680813 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263348414 0 0) 0x7f57bc0d2800 con 0x7f57bc15f410 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a8003520 con 0x7f57bc15f410 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c1ce3640 1 --2- 172.21.15.66:0/3776680813 >> v2:172.21.15.190:3300/0 conn(0x7f57bc0d36d0 0x7f57bc0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.643+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 0x7f57bc0b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1850474043 0 0) 0x7f57a8003520 con 0x7f57bc15f410 2024-05-10T11:20:33.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 msgr2=0x7f57bc0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 0x7f57bc0b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 >> v2:172.21.15.190:3300/0 conn(0x7f57bc0d36d0 msgr2=0x7f57bc0d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 --2- 172.21.15.66:0/3776680813 >> v2:172.21.15.190:3300/0 conn(0x7f57bc0d36d0 0x7f57bc0d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57bc0d04b0 con 0x7f57bc15f410 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f57b8001670 con 0x7f57bc15f410 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 >> v1:172.21.15.66:6789/0 conn(0x7f57bc15f410 legacy=0x7f57bc0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 0x7f57a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a8003f30 0x7f57a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8004d40 0x7f57a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc0d2ae0 con 0x7f57a8003f30 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc0d01d0 con 0x7f57a8004d40 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57a800ba10 con 0x7f57bc0b4f90 2024-05-10T11:20:33.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a8003f30 0x7f57a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c14e2640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 0x7f57a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c1ce3640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8004d40 0x7f57a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c0ce1640 1 -- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 msgr2=0x7f57a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc0b4f90 0x7f57a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c0ce1640 1 -- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8004d40 msgr2=0x7f57a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8004d40 0x7f57a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.644+0000 7f57c0ce1640 1 -- 172.21.15.66:0/3776680813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a8003520 con 0x7f57a8003f30 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.645+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a8003f30 0x7f57a8004800 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009af0 tx=0x7f57a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1ba50099710c14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.645+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac036070 con 0x7f57a8003f30 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.645+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ac031400 con 0x7f57a8003f30 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.645+0000 7f57b3fff640 1 -- 172.21.15.66:0/3776680813 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac009690 con 0x7f57a8003f30 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c3746640 1 -- 172.21.15.66:0/3776680813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a8003f30 msgr2=0x7f57a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c3746640 1 --2- 172.21.15.66:0/3776680813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a8003f30 0x7f57a8004800 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009af0 tx=0x7f57a8005830 comp rx=0 tx=0).stop 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c1ce3640 1 -- 172.21.15.66:0/3776680813 reap_dead start 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c3746640 1 -- 172.21.15.66:0/3776680813 shutdown_connections 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c3746640 1 -- 172.21.15.66:0/3776680813 >> 172.21.15.66:0/3776680813 conn(0x7f57bc08ed30 msgr2=0x7f57bc09e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c3746640 1 -- 172.21.15.66:0/3776680813 shutdown_connections 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.646+0000 7f57c3746640 1 -- 172.21.15.66:0/3776680813 wait complete. 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.647+0000 7f57c3746640 1 Processor -- start 2024-05-10T11:20:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.647+0000 7f57c3746640 1 -- start start 2024-05-10T11:20:33.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c3746640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8003f30 0x7f57bc15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c3746640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 0x7f57bc0b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c3746640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc1616a0 0x7f57bc161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c3746640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc0cffb0 con 0x7f57bc15b410 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c3746640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc0cfe30 con 0x7f57a8003f30 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c3746640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57bc0d10e0 con 0x7f57bc1616a0 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 0x7f57bc0b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 0x7f57bc0b8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51778/0 (socket says 172.21.15.66:51778) 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 -- 172.21.15.66:0/1100035074 learned_addr learned my addr 172.21.15.66:0/1100035074 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c1ce3640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc1616a0 0x7f57bc161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c14e2640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8003f30 0x7f57bc15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 -- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc1616a0 msgr2=0x7f57bc161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc1616a0 0x7f57bc161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 -- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8003f30 msgr2=0x7f57bc15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8003f30 0x7f57bc15ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 -- 172.21.15.66:0/1100035074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57bc15bc60 con 0x7f57bc15b410 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.648+0000 7f57c0ce1640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 0x7f57bc0b8ee0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009af0 tx=0x7f57ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.649+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac040020 con 0x7f57bc15b410 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.649+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ac003810 con 0x7f57bc15b410 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.649+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57bc0ce7e0 con 0x7f57bc15b410 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.649+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac036040 con 0x7f57bc15b410 2024-05-10T11:20:33.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.649+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57bc0b6080 con 0x7f57bc15b410 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.650+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57bc06a220 con 0x7f57bc15b410 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.650+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57ac043020 con 0x7f57bc15b410 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.651+0000 7f57b1ffb640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57a0076300 0x7f57a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.651+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f57ac0b7060 con 0x7f57bc15b410 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.651+0000 7f57c14e2640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57a0076300 0x7f57a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.652+0000 7f57c14e2640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57a0076300 0x7f57a00787c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57b8001050 tx=0x7f57b8007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:33.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.655+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f57ac0801e0 con 0x7f57bc15b410 2024-05-10T11:20:33.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:33.884+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f57bc0b3400 con 0x7f57bc15b410 2024-05-10T11:20:34.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.522+0000 7f57b1ffb640 1 -- 172.21.15.66:0/1100035074 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f57ac0844e0 con 0x7f57bc15b410 2024-05-10T11:20:34.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57a0076300 msgr2=0x7f57a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57a0076300 0x7f57a00787c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57b8001050 tx=0x7f57b8007970 comp rx=0 tx=0).stop 2024-05-10T11:20:34.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 msgr2=0x7f57bc0b8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 0x7f57bc0b8ee0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009af0 tx=0x7f57ac004730 comp rx=0 tx=0).stop 2024-05-10T11:20:34.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 shutdown_connections 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f57a0076300 0x7f57a00787c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57bc1616a0 0x7f57bc161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc15b410 0x7f57bc0b8ee0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 --2- 172.21.15.66:0/1100035074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57a8003f30 0x7f57bc15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 >> 172.21.15.66:0/1100035074 conn(0x7f57bc08ed30 msgr2=0x7f57bc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 shutdown_connections 2024-05-10T11:20:34.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.525+0000 7f57c3746640 1 -- 172.21.15.66:0/1100035074 wait complete. 2024-05-10T11:20:34.538 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:20:34.539 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:34.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.646+0000 7f83b2ba4640 1 Processor -- start 2024-05-10T11:20:34.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.647+0000 7f83b2ba4640 1 -- start start 2024-05-10T11:20:34.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.647+0000 7f83b2ba4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83ac15f3b0 0x7f83ac0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:34.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.647+0000 7f83b2ba4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f83ac15f790 0x7f83ac0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:34.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.647+0000 7f83b2ba4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ac0d30b0 con 0x7f83ac0d5d30 2024-05-10T11:20:34.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.647+0000 7f83b2ba4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f83ac0d3390 con 0x7f83ac15f3b0 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.647+0000 7f83b2ba4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f83ac0c8c80 con 0x7f83ac15f790 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83ac15f3b0 0x7f83ac0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f83ac15f3b0 0x7f83ac0d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54624/0 (socket says 172.21.15.66:54624) 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 -- 172.21.15.66:0/2604002127 learned_addr learned my addr 172.21.15.66:0/2604002127 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83abfff640 1 --2- 172.21.15.66:0/2604002127 >> v2:172.21.15.190:3300/0 conn(0x7f83ac15f790 0x7f83ac0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 -- 172.21.15.66:0/2604002127 >> v2:172.21.15.190:3300/0 conn(0x7f83ac15f790 msgr2=0x7f83ac0d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 --2- 172.21.15.66:0/2604002127 >> v2:172.21.15.190:3300/0 conn(0x7f83ac15f790 0x7f83ac0d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 -- 172.21.15.66:0/2604002127 >> v1:172.21.15.190:6789/0 conn(0x7f83ac0d5d30 legacy=0x7f83ac0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.648+0000 7f83b0940640 1 -- 172.21.15.66:0/2604002127 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0c8f60 con 0x7f83ac15f3b0 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b0940640 1 --2- 172.21.15.66:0/2604002127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac15f3b0 0x7f83ac0d36f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0c8c00 tx=0x7f83a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc1f3a86fc0fd8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83ab7fe640 1 -- 172.21.15.66:0/2604002127 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4036070 con 0x7f83ac15f3b0 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83ab7fe640 1 -- 172.21.15.66:0/2604002127 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4031600 con 0x7f83ac15f3b0 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83ab7fe640 1 -- 172.21.15.66:0/2604002127 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a40319d0 con 0x7f83ac15f3b0 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 -- 172.21.15.66:0/2604002127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac15f3b0 msgr2=0x7f83ac0d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/2604002127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac15f3b0 0x7f83ac0d36f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0c8c00 tx=0x7f83a402a730 comp rx=0 tx=0).stop 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 -- 172.21.15.66:0/2604002127 shutdown_connections 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/2604002127 >> v2:172.21.15.190:3300/0 conn(0x7f83ac15f790 0x7f83ac0d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/2604002127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac15f3b0 0x7f83ac0d36f0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 -- 172.21.15.66:0/2604002127 >> 172.21.15.66:0/2604002127 conn(0x7f83ac0d5130 msgr2=0x7f83ac0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 -- 172.21.15.66:0/2604002127 shutdown_connections 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.649+0000 7f83b2ba4640 1 -- 172.21.15.66:0/2604002127 wait complete. 2024-05-10T11:20:34.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 Processor -- start 2024-05-10T11:20:34.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 -- start start 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83ac0d5d30 0x7f83ac0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac15f3b0 0x7f83ac1f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 0x7f83ac1f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0d0e60 con 0x7f83ac1f5980 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0d0ce0 con 0x7f83ac15f3b0 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.651+0000 7f83b2ba4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac0d0fe0 con 0x7f83ac0d5d30 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 0x7f83ac1f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 0x7f83ac1f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54638/0 (socket says 172.21.15.66:54638) 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 -- 172.21.15.66:0/4253631064 learned_addr learned my addr 172.21.15.66:0/4253631064 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83abfff640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac15f3b0 0x7f83ac1f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b0940640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83ac0d5d30 0x7f83ac0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 -- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83ac0d5d30 msgr2=0x7f83ac0d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83ac0d5d30 0x7f83ac0d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 -- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac15f3b0 msgr2=0x7f83ac1f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac15f3b0 0x7f83ac1f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 -- 172.21.15.66:0/4253631064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac1f8f40 con 0x7f83ac1f5980 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83abfff640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac15f3b0 0x7f83ac1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b1141640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 0x7f83ac1f87c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c400 tx=0x7f839c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c017070 con 0x7f83ac1f5980 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c0052d0 con 0x7f83ac1f5980 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.652+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac1f4ea0 con 0x7f83ac1f5980 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.653+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c003810 con 0x7f83ac1f5980 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.653+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac1f5460 con 0x7f83ac1f5980 2024-05-10T11:20:34.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.653+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac1f5660 con 0x7f83ac1f5980 2024-05-10T11:20:34.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.654+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f839c01a070 con 0x7f83ac1f5980 2024-05-10T11:20:34.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.655+0000 7f83a97fa640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83980762d0 0x7f8398078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:34.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.655+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f839c096b00 con 0x7f83ac1f5980 2024-05-10T11:20:34.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.655+0000 7f83b0940640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83980762d0 0x7f8398078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:34.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.655+0000 7f83b0940640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83980762d0 0x7f8398078790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83a4033000 tx=0x7f83a4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:34.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.659+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f839c0602d0 con 0x7f83ac1f5980 2024-05-10T11:20:34.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.888+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83ac06a220 con 0x7f83ac1f5980 2024-05-10T11:20:34.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.889+0000 7f83a97fa640 1 -- 172.21.15.66:0/4253631064 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5183 (secure 0 0 0) 0x7f839c0682c0 con 0x7f83ac1f5980 2024-05-10T11:20:34.889 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:34.889 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":83,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:20:33.886520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/159674733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":159674733},{"type":"v1","addr":"172.21.15.66:6835","nonce":159674733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7647,"qdb_cluster":[7647]},"id":7}]} 2024-05-10T11:20:34.889 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 83 2024-05-10T11:20:34.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83980762d0 msgr2=0x7f8398078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83980762d0 0x7f8398078790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83a4033000 tx=0x7f83a4009000 comp rx=0 tx=0).stop 2024-05-10T11:20:34.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 msgr2=0x7f83ac1f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:34.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 0x7f83ac1f87c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c400 tx=0x7f839c00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 shutdown_connections 2024-05-10T11:20:34.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f83980762d0 0x7f8398078790 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83ac1f5980 0x7f83ac1f87c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac15f3b0 0x7f83ac1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 --2- 172.21.15.66:0/4253631064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83ac0d5d30 0x7f83ac0d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:34.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 >> 172.21.15.66:0/4253631064 conn(0x7f83ac0d5130 msgr2=0x7f83ac0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:34.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 shutdown_connections 2024-05-10T11:20:34.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:34.891+0000 7f83b2ba4640 1 -- 172.21.15.66:0/4253631064 wait complete. 2024-05-10T11:20:34.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:20:35.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.007+0000 7f3b0ef5f640 1 Processor -- start 2024-05-10T11:20:35.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.007+0000 7f3b0ef5f640 1 -- start start 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0ef5f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3b0815d650 0x7f3b080cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0ef5f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b080ce590 con 0x7f3b080b43a0 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0ef5f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b080d0500 con 0x7f3b080d3980 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0ef5f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0815da30 con 0x7f3b0815d650 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0d4fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3b080b43a0 0x7f3b080b2160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55796/0 (socket says 172.21.15.66:55796) 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0d4fc640 1 -- 172.21.15.66:0/1998315501 learned_addr learned my addr 172.21.15.66:0/1998315501 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1998315501 >> v2:172.21.15.190:3300/0 conn(0x7f3b0815d650 0x7f3b080cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.008+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706134067 0 0) 0x7f3b00001490 con 0x7f3b080b43a0 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3af0003520 con 0x7f3b080b43a0 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743173304 0 0) 0x7f3af0003520 con 0x7f3b080b43a0 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 >> v2:172.21.15.190:3300/0 conn(0x7f3b0815d650 msgr2=0x7f3b080cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 --2- 172.21.15.66:0/1998315501 >> v2:172.21.15.190:3300/0 conn(0x7f3b0815d650 0x7f3b080cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 >> v1:172.21.15.190:6789/0 conn(0x7f3b080d3980 legacy=0x7f3b080cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b080ce810 con 0x7f3b080b43a0 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f3b00001bc0 con 0x7f3b080b43a0 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 >> v1:172.21.15.66:6789/0 conn(0x7f3b080b43a0 legacy=0x7f3b080b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3af00039b0 0x7f3af0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af0004800 0x7f3af0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3af00051c0 0x7f3af000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3af000c030 con 0x7f3af00039b0 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3af000c1e0 con 0x7f3af0004800 2024-05-10T11:20:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3af000c3e0 con 0x7f3af00051c0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3af00039b0 0x7f3af0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0d4fc640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3af00051c0 0x7f3af000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b07fff640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af0004800 0x7f3af0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0ccfb640 1 -- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3af00051c0 msgr2=0x7f3af000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3af00051c0 0x7f3af000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0ccfb640 1 -- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af0004800 msgr2=0x7f3af0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af0004800 0x7f3af0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0ccfb640 1 -- 172.21.15.66:0/1998315501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af0003520 con 0x7f3af00039b0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.009+0000 7f3b0d4fc640 1 -- 172.21.15.66:0/1998315501 reap_dead start 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.010+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3af00039b0 0x7f3af0003dd0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009ac0 tx=0x7f3af0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fe082cef9eb160 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.010+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8036070 con 0x7f3af00039b0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.010+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af8031400 con 0x7f3af00039b0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.010+0000 7f3b077fe640 1 -- 172.21.15.66:0/1998315501 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8009690 con 0x7f3af00039b0 2024-05-10T11:20:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1998315501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3af00039b0 msgr2=0x7f3af0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3af00039b0 0x7f3af0003dd0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009ac0 tx=0x7f3af0005830 comp rx=0 tx=0).stop 2024-05-10T11:20:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1998315501 shutdown_connections 2024-05-10T11:20:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1998315501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3af00039b0 0x7f3af0003dd0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1998315501 >> 172.21.15.66:0/1998315501 conn(0x7f3b080d2df0 msgr2=0x7f3b080d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1998315501 shutdown_connections 2024-05-10T11:20:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.011+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1998315501 wait complete. 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.012+0000 7f3b0ef5f640 1 Processor -- start 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.012+0000 7f3b0ef5f640 1 -- start start 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ef5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af00039b0 0x7f3b081f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ef5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b080b7300 0x7f3b080b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ef5f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 0x7f3b080b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ef5f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b080cf540 con 0x7f3b080b3160 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ef5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b080cedd0 con 0x7f3af00039b0 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ef5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3b080cf6c0 con 0x7f3b080b7300 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 0x7f3b080b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 0x7f3b080b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54654/0 (socket says 172.21.15.66:54654) 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 -- 172.21.15.66:0/1388035527 learned_addr learned my addr 172.21.15.66:0/1388035527 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:35.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af00039b0 0x7f3b081f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b07fff640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b080b7300 0x7f3b080b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 -- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b080b7300 msgr2=0x7f3b080b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b080b7300 0x7f3b080b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 -- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af00039b0 msgr2=0x7f3b081f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af00039b0 0x7f3b081f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b0d4fc640 1 -- 172.21.15.66:0/1388035527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b080b7da0 con 0x7f3b080b3160 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.013+0000 7f3b07fff640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b080b7300 0x7f3b080b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.014+0000 7f3b0d4fc640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 0x7f3b080b35e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3b080b4850 tx=0x7f3b00007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.014+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00019070 con 0x7f3b080b3160 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.014+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0000ea80 con 0x7f3b080b3160 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.014+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000ee50 con 0x7f3b080b3160 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.014+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b080b8080 con 0x7f3b080b3160 2024-05-10T11:20:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.014+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b080b8640 con 0x7f3b080b3160 2024-05-10T11:20:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.015+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0806a220 con 0x7f3b080b3160 2024-05-10T11:20:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.015+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3b0001c070 con 0x7f3b080b3160 2024-05-10T11:20:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.016+0000 7f3b057fa640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3af40762d0 0x7f3af4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.016+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f3b00097380 con 0x7f3b080b3160 2024-05-10T11:20:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.016+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3af40762d0 0x7f3af4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.017+0000 7f3b0ccfb640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3af40762d0 0x7f3af4078790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3af8033000 tx=0x7f3af8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.020+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3b080ce590 con 0x7f3b080b3160 2024-05-10T11:20:35.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.211+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b080d1f10 con 0x7f3b080b3160 2024-05-10T11:20:35.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.212+0000 7f3b057fa640 1 -- 172.21.15.66:0/1388035527 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16884 (secure 0 0 0) 0x7f3b00060ab0 con 0x7f3b080b3160 2024-05-10T11:20:35.213 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:35.214 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":104,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:20:32.502242+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:20:28.883807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T11:20:29.828634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:20:35.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.214+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3af40762d0 msgr2=0x7f3af4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.214+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3af40762d0 0x7f3af4078790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3af8033000 tx=0x7f3af8008030 comp rx=0 tx=0).stop 2024-05-10T11:20:35.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.214+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 msgr2=0x7f3b080b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.214+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 0x7f3b080b35e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3b080b4850 tx=0x7f3b00007bc0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 shutdown_connections 2024-05-10T11:20:35.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3af40762d0 0x7f3af4078790 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b080b3160 0x7f3b080b35e0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b080b7300 0x7f3b080b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 --2- 172.21.15.66:0/1388035527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3af00039b0 0x7f3b081f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 >> 172.21.15.66:0/1388035527 conn(0x7f3b080d2df0 msgr2=0x7f3b08070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:35.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 shutdown_connections 2024-05-10T11:20:35.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.215+0000 7f3b0ef5f640 1 -- 172.21.15.66:0/1388035527 wait complete. 2024-05-10T11:20:35.227 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:20:35.227 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:20:35.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.331+0000 7f43b6faf640 1 Processor -- start 2024-05-10T11:20:35.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.331+0000 7f43b6faf640 1 -- start start 2024-05-10T11:20:35.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b6faf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43b015f790 0x7f43b00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b6faf640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b00d30b0 con 0x7f43b00d5d30 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b6faf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b00d3390 con 0x7f43b015f3b0 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b6faf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00c8c80 con 0x7f43b015f790 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b554c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f43b00d5d30 0x7f43b00d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55802/0 (socket says 172.21.15.66:55802) 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b554c640 1 -- 172.21.15.66:0/2988134403 learned_addr learned my addr 172.21.15.66:0/2988134403 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43affff640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43b015f790 0x7f43b00cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006064655 0 0) 0x7f43b00d30b0 con 0x7f43b00d5d30 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43a0003520 con 0x7f43b00d5d30 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3533028581 0 0) 0x7f43a0003520 con 0x7f43b00d5d30 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43b015f790 msgr2=0x7f43b00cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43b015f790 0x7f43b00cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 >> v1:172.21.15.190:6789/0 conn(0x7f43b015f3b0 legacy=0x7f43b00d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b00c8f60 con 0x7f43b00d5d30 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f43a80019f0 con 0x7f43b00d5d30 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 >> v1:172.21.15.66:6789/0 conn(0x7f43b00d5d30 legacy=0x7f43b00d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a00039e0 0x7f43a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43a0004800 0x7f43a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00051c0 0x7f43a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00c8c80 con 0x7f43a00039e0 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43a000bf00 con 0x7f43a0004800 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43a000c080 con 0x7f43a00051c0 2024-05-10T11:20:35.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a00039e0 0x7f43a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.332+0000 7f43affff640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43a0004800 0x7f43a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b554c640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00051c0 0x7f43a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b4d4b640 1 -- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00051c0 msgr2=0x7f43a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00051c0 0x7f43a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b4d4b640 1 -- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43a0004800 msgr2=0x7f43a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43a0004800 0x7f43a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b4d4b640 1 -- 172.21.15.66:0/2988134403 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a0003520 con 0x7f43a00039e0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43affff640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43a0004800 0x7f43a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.333+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a00039e0 0x7f43a0003e00 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f43a4001750 tx=0x7f43a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27edd89e409a23ed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4001370 con 0x7f43a00039e0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a40052d0 con 0x7f43a00039e0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43af7fe640 1 -- 172.21.15.66:0/2988134403 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a402abe0 con 0x7f43a00039e0 2024-05-10T11:20:35.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b6faf640 1 -- 172.21.15.66:0/2988134403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a00039e0 msgr2=0x7f43a0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b6faf640 1 --2- 172.21.15.66:0/2988134403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a00039e0 0x7f43a0003e00 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f43a4001750 tx=0x7f43a0005830 comp rx=0 tx=0).stop 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b554c640 1 -- 172.21.15.66:0/2988134403 reap_dead start 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b6faf640 1 -- 172.21.15.66:0/2988134403 shutdown_connections 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b6faf640 1 -- 172.21.15.66:0/2988134403 >> 172.21.15.66:0/2988134403 conn(0x7f43b00d5130 msgr2=0x7f43b00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b6faf640 1 -- 172.21.15.66:0/2988134403 shutdown_connections 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.334+0000 7f43b6faf640 1 -- 172.21.15.66:0/2988134403 wait complete. 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.335+0000 7f43b6faf640 1 Processor -- start 2024-05-10T11:20:35.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.335+0000 7f43b6faf640 1 -- start start 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b6faf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00039e0 0x7f43b00ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b6faf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43b01f5340 0x7f43b00ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b6faf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 0x7f43b00b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b6faf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d3f80 con 0x7f43b00cec50 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b6faf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d3e00 con 0x7f43b01f5340 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b6faf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00ca770 con 0x7f43a00039e0 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b554c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 0x7f43b00b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b554c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 0x7f43b00b8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54678/0 (socket says 172.21.15.66:54678) 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b554c640 1 -- 172.21.15.66:0/1093852357 learned_addr learned my addr 172.21.15.66:0/1093852357 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00039e0 0x7f43b00ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.336+0000 7f43affff640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43b01f5340 0x7f43b00ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b554c640 1 -- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00039e0 msgr2=0x7f43b00ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b554c640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00039e0 0x7f43b00ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b554c640 1 -- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43b01f5340 msgr2=0x7f43b00ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b554c640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43b01f5340 0x7f43b00ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b554c640 1 -- 172.21.15.66:0/1093852357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b00cf0e0 con 0x7f43b00cec50 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b554c640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 0x7f43b00b8d70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f43b008d5b0 tx=0x7f43a8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a800ebc0 con 0x7f43b00cec50 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8018070 con 0x7f43b00cec50 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b00cd410 con 0x7f43b00cec50 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8013420 con 0x7f43b00cec50 2024-05-10T11:20:35.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.337+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b00cd9d0 con 0x7f43b00cec50 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.338+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b006a220 con 0x7f43b00cec50 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.339+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43a80135c0 con 0x7f43b00cec50 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.339+0000 7f43ad7fa640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43940762d0 0x7f4394078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.339+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f43a8097860 con 0x7f43b00cec50 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.340+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43940762d0 0x7f4394078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.340+0000 7f43b4d4b640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43940762d0 0x7f4394078790 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f43a4032000 tx=0x7f43a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.343+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f43b00cf0e0 con 0x7f43b00cec50 2024-05-10T11:20:35.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.531+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43b015d980 con 0x7f43940762d0 2024-05-10T11:20:35.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.537+0000 7f43ad7fa640 1 -- 172.21.15.66:0/1093852357 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246986 (secure 0 0 0) 0x7f43a407e4e0 con 0x7f43940762d0 2024-05-10T11:20:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:35.542 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:20:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43940762d0 msgr2=0x7f4394078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43940762d0 0x7f4394078790 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f43a4032000 tx=0x7f43a402e000 comp rx=0 tx=0).stop 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 msgr2=0x7f43b00b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 0x7f43b00b8d70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f43b008d5b0 tx=0x7f43a8007bc0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 shutdown_connections 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43940762d0 0x7f4394078790 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43b00cec50 0x7f43b00b8d70 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43b01f5340 0x7f43b00ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 --2- 172.21.15.66:0/1093852357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43a00039e0 0x7f43b00ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 >> 172.21.15.66:0/1093852357 conn(0x7f43b00d5130 msgr2=0x7f43b00757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.540+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 shutdown_connections 2024-05-10T11:20:35.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.541+0000 7f43b6faf640 1 -- 172.21.15.66:0/1093852357 wait complete. 2024-05-10T11:20:35.552 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-05-10T11:20:33.807585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":119,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":126,"acting":126,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":260456,"kb_used_data":10976,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714264,"statfs":{"total":773094113280,"available":772827406336,"internally_reserved":0,"allocated":11239424,"data_stored":5806493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.320789"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.507980+0000","last_change":"2024-05-10T11:20:31.506272+0000","last_active":"2024-05-10T11:20:31.507980+0000","last_peered":"2024-05-10T11:20:31.507980+0000","last_clean":"2024-05-10T11:20:31.507980+0000","last_became_active":"2024-05-10T11:20:31.505974+0000","last_became_peered":"2024-05-10T11:20:31.505974+0000","last_unstale":"2024-05-10T11:20:31.507980+0000","last_undegraded":"2024-05-10T11:20:31.507980+0000","last_fullsized":"2024-05-10T11:20:31.507980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:02:53.391632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.513167+0000","last_change":"2024-05-10T11:20:31.508864+0000","last_active":"2024-05-10T11:20:31.513167+0000","last_peered":"2024-05-10T11:20:31.513167+0000","last_clean":"2024-05-10T11:20:31.513167+0000","last_became_active":"2024-05-10T11:20:31.507265+0000","last_became_peered":"2024-05-10T11:20:31.507265+0000","last_unstale":"2024-05-10T11:20:31.513167+0000","last_undegraded":"2024-05-10T11:20:31.513167+0000","last_fullsized":"2024-05-10T11:20:31.513167+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:34.647851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654692+0000","last_change":"2024-05-10T11:20:31.520886+0000","last_active":"2024-05-10T11:20:32.654692+0000","last_peered":"2024-05-10T11:20:32.654692+0000","last_clean":"2024-05-10T11:20:32.654692+0000","last_became_active":"2024-05-10T11:20:31.520594+0000","last_became_peered":"2024-05-10T11:20:31.520594+0000","last_unstale":"2024-05-10T11:20:32.654692+0000","last_undegraded":"2024-05-10T11:20:32.654692+0000","last_fullsized":"2024-05-10T11:20:32.654692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:50.390413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515111+0000","last_change":"2024-05-10T11:20:31.523451+0000","last_active":"2024-05-10T11:20:32.515111+0000","last_peered":"2024-05-10T11:20:32.515111+0000","last_clean":"2024-05-10T11:20:32.515111+0000","last_became_active":"2024-05-10T11:20:31.523134+0000","last_became_peered":"2024-05-10T11:20:31.523134+0000","last_unstale":"2024-05-10T11:20:32.515111+0000","last_undegraded":"2024-05-10T11:20:32.515111+0000","last_fullsized":"2024-05-10T11:20:32.515111+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:50.390413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529336+0000","last_change":"2024-05-10T11:20:31.526312+0000","last_active":"2024-05-10T11:20:31.529336+0000","last_peered":"2024-05-10T11:20:31.529336+0000","last_clean":"2024-05-10T11:20:31.529336+0000","last_became_active":"2024-05-10T11:20:31.525784+0000","last_became_peered":"2024-05-10T11:20:31.525784+0000","last_unstale":"2024-05-10T11:20:31.529336+0000","last_undegraded":"2024-05-10T11:20:31.529336+0000","last_fullsized":"2024-05-10T11:20:31.529336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:57.325512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515269+0000","last_change":"2024-05-10T11:20:31.520910+0000","last_active":"2024-05-10T11:20:32.515269+0000","last_peered":"2024-05-10T11:20:32.515269+0000","last_clean":"2024-05-10T11:20:32.515269+0000","last_became_active":"2024-05-10T11:20:31.520646+0000","last_became_peered":"2024-05-10T11:20:31.520646+0000","last_unstale":"2024-05-10T11:20:32.515269+0000","last_undegraded":"2024-05-10T11:20:32.515269+0000","last_fullsized":"2024-05-10T11:20:32.515269+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:00:09.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.516120+0000","last_change":"2024-05-10T11:20:31.510702+0000","last_active":"2024-05-10T11:20:31.516120+0000","last_peered":"2024-05-10T11:20:31.516120+0000","last_clean":"2024-05-10T11:20:31.516120+0000","last_became_active":"2024-05-10T11:20:31.510189+0000","last_became_peered":"2024-05-10T11:20:31.510189+0000","last_unstale":"2024-05-10T11:20:31.516120+0000","last_undegraded":"2024-05-10T11:20:31.516120+0000","last_fullsized":"2024-05-10T11:20:31.516120+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:48.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654506+0000","last_change":"2024-05-10T11:20:31.512494+0000","last_active":"2024-05-10T11:20:32.654506+0000","last_peered":"2024-05-10T11:20:32.654506+0000","last_clean":"2024-05-10T11:20:32.654506+0000","last_became_active":"2024-05-10T11:20:31.512203+0000","last_became_peered":"2024-05-10T11:20:31.512203+0000","last_unstale":"2024-05-10T11:20:32.654506+0000","last_undegraded":"2024-05-10T11:20:32.654506+0000","last_fullsized":"2024-05-10T11:20:32.654506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:04:32.826685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.517314+0000","last_change":"2024-05-10T11:20:31.514777+0000","last_active":"2024-05-10T11:20:31.517314+0000","last_peered":"2024-05-10T11:20:31.517314+0000","last_clean":"2024-05-10T11:20:31.517314+0000","last_became_active":"2024-05-10T11:20:31.511207+0000","last_became_peered":"2024-05-10T11:20:31.511207+0000","last_unstale":"2024-05-10T11:20:31.517314+0000","last_undegraded":"2024-05-10T11:20:31.517314+0000","last_fullsized":"2024-05-10T11:20:31.517314+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.979955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.513188+0000","last_change":"2024-05-10T11:20:31.511070+0000","last_active":"2024-05-10T11:20:31.513188+0000","last_peered":"2024-05-10T11:20:31.513188+0000","last_clean":"2024-05-10T11:20:31.513188+0000","last_became_active":"2024-05-10T11:20:31.510730+0000","last_became_peered":"2024-05-10T11:20:31.510730+0000","last_unstale":"2024-05-10T11:20:31.513188+0000","last_undegraded":"2024-05-10T11:20:31.513188+0000","last_fullsized":"2024-05-10T11:20:31.513188+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:00.675263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528339+0000","last_change":"2024-05-10T11:20:31.517672+0000","last_active":"2024-05-10T11:20:31.528339+0000","last_peered":"2024-05-10T11:20:31.528339+0000","last_clean":"2024-05-10T11:20:31.528339+0000","last_became_active":"2024-05-10T11:20:31.517381+0000","last_became_peered":"2024-05-10T11:20:31.517381+0000","last_unstale":"2024-05-10T11:20:31.528339+0000","last_undegraded":"2024-05-10T11:20:31.528339+0000","last_fullsized":"2024-05-10T11:20:31.528339+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:57.441966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515408+0000","last_change":"2024-05-10T11:20:31.519504+0000","last_active":"2024-05-10T11:20:32.515408+0000","last_peered":"2024-05-10T11:20:32.515408+0000","last_clean":"2024-05-10T11:20:32.515408+0000","last_became_active":"2024-05-10T11:20:31.518989+0000","last_became_peered":"2024-05-10T11:20:31.518989+0000","last_unstale":"2024-05-10T11:20:32.515408+0000","last_undegraded":"2024-05-10T11:20:32.515408+0000","last_fullsized":"2024-05-10T11:20:32.515408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:21.775187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.508537+0000","last_change":"2024-05-10T11:20:31.505672+0000","last_active":"2024-05-10T11:20:31.508537+0000","last_peered":"2024-05-10T11:20:31.508537+0000","last_clean":"2024-05-10T11:20:31.508537+0000","last_became_active":"2024-05-10T11:20:31.505220+0000","last_became_peered":"2024-05-10T11:20:31.505220+0000","last_unstale":"2024-05-10T11:20:31.508537+0000","last_undegraded":"2024-05-10T11:20:31.508537+0000","last_fullsized":"2024-05-10T11:20:31.508537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:09:54.091893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.514864+0000","last_change":"2024-05-10T11:20:31.517131+0000","last_active":"2024-05-10T11:20:32.514864+0000","last_peered":"2024-05-10T11:20:32.514864+0000","last_clean":"2024-05-10T11:20:32.514864+0000","last_became_active":"2024-05-10T11:20:31.516841+0000","last_became_peered":"2024-05-10T11:20:31.516841+0000","last_unstale":"2024-05-10T11:20:32.514864+0000","last_undegraded":"2024-05-10T11:20:32.514864+0000","last_fullsized":"2024-05-10T11:20:32.514864+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:55.683207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.516098+0000","last_change":"2024-05-10T11:20:31.510470+0000","last_active":"2024-05-10T11:20:31.516098+0000","last_peered":"2024-05-10T11:20:31.516098+0000","last_clean":"2024-05-10T11:20:31.516098+0000","last_became_active":"2024-05-10T11:20:31.509810+0000","last_became_peered":"2024-05-10T11:20:31.509810+0000","last_unstale":"2024-05-10T11:20:31.516098+0000","last_undegraded":"2024-05-10T11:20:31.516098+0000","last_fullsized":"2024-05-10T11:20:31.516098+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:29.786185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528378+0000","last_change":"2024-05-10T11:20:31.522335+0000","last_active":"2024-05-10T11:20:31.528378+0000","last_peered":"2024-05-10T11:20:31.528378+0000","last_clean":"2024-05-10T11:20:31.528378+0000","last_became_active":"2024-05-10T11:20:31.521714+0000","last_became_peered":"2024-05-10T11:20:31.521714+0000","last_unstale":"2024-05-10T11:20:31.528378+0000","last_undegraded":"2024-05-10T11:20:31.528378+0000","last_fullsized":"2024-05-10T11:20:31.528378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:55.550364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528515+0000","last_change":"2024-05-10T11:20:31.523957+0000","last_active":"2024-05-10T11:20:31.528515+0000","last_peered":"2024-05-10T11:20:31.528515+0000","last_clean":"2024-05-10T11:20:31.528515+0000","last_became_active":"2024-05-10T11:20:31.521344+0000","last_became_peered":"2024-05-10T11:20:31.521344+0000","last_unstale":"2024-05-10T11:20:31.528515+0000","last_undegraded":"2024-05-10T11:20:31.528515+0000","last_fullsized":"2024-05-10T11:20:31.528515+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:05.456964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.515221+0000","last_change":"2024-05-10T11:20:31.509624+0000","last_active":"2024-05-10T11:20:31.515221+0000","last_peered":"2024-05-10T11:20:31.515221+0000","last_clean":"2024-05-10T11:20:31.515221+0000","last_became_active":"2024-05-10T11:20:31.509324+0000","last_became_peered":"2024-05-10T11:20:31.509324+0000","last_unstale":"2024-05-10T11:20:31.515221+0000","last_undegraded":"2024-05-10T11:20:31.515221+0000","last_fullsized":"2024-05-10T11:20:31.515221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:19.530435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"103'4","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654720+0000","last_change":"2024-05-10T11:20:30.509198+0000","last_active":"2024-05-10T11:20:32.654720+0000","last_peered":"2024-05-10T11:20:32.654720+0000","last_clean":"2024-05-10T11:20:32.654720+0000","last_became_active":"2024-05-10T11:20:30.508930+0000","last_became_peered":"2024-05-10T11:20:30.508930+0000","last_unstale":"2024-05-10T11:20:32.654720+0000","last_undegraded":"2024-05-10T11:20:32.654720+0000","last_fullsized":"2024-05-10T11:20:32.654720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:23.143821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529446+0000","last_change":"2024-05-10T11:20:31.525656+0000","last_active":"2024-05-10T11:20:31.529446+0000","last_peered":"2024-05-10T11:20:31.529446+0000","last_clean":"2024-05-10T11:20:31.529446+0000","last_became_active":"2024-05-10T11:20:31.525338+0000","last_became_peered":"2024-05-10T11:20:31.525338+0000","last_unstale":"2024-05-10T11:20:31.529446+0000","last_undegraded":"2024-05-10T11:20:31.529446+0000","last_fullsized":"2024-05-10T11:20:31.529446+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:55.024780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"103'1","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528371+0000","last_change":"2024-05-10T11:20:30.513644+0000","last_active":"2024-05-10T11:20:31.528371+0000","last_peered":"2024-05-10T11:20:31.528371+0000","last_clean":"2024-05-10T11:20:31.528371+0000","last_became_active":"2024-05-10T11:20:30.513295+0000","last_became_peered":"2024-05-10T11:20:30.513295+0000","last_unstale":"2024-05-10T11:20:31.528371+0000","last_undegraded":"2024-05-10T11:20:31.528371+0000","last_fullsized":"2024-05-10T11:20:31.528371+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:40.359141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.524372+0000","last_change":"2024-05-10T11:20:31.520210+0000","last_active":"2024-05-10T11:20:31.524372+0000","last_peered":"2024-05-10T11:20:31.524372+0000","last_clean":"2024-05-10T11:20:31.524372+0000","last_became_active":"2024-05-10T11:20:31.519907+0000","last_became_peered":"2024-05-10T11:20:31.519907+0000","last_unstale":"2024-05-10T11:20:31.524372+0000","last_undegraded":"2024-05-10T11:20:31.524372+0000","last_fullsized":"2024-05-10T11:20:31.524372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:56.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515070+0000","last_change":"2024-05-10T11:20:30.510547+0000","last_active":"2024-05-10T11:20:32.515070+0000","last_peered":"2024-05-10T11:20:32.515070+0000","last_clean":"2024-05-10T11:20:32.515070+0000","last_became_active":"2024-05-10T11:20:30.510268+0000","last_became_peered":"2024-05-10T11:20:30.510268+0000","last_unstale":"2024-05-10T11:20:32.515070+0000","last_undegraded":"2024-05-10T11:20:32.515070+0000","last_fullsized":"2024-05-10T11:20:32.515070+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:48.472113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654787+0000","last_change":"2024-05-10T11:20:31.515417+0000","last_active":"2024-05-10T11:20:32.654787+0000","last_peered":"2024-05-10T11:20:32.654787+0000","last_clean":"2024-05-10T11:20:32.654787+0000","last_became_active":"2024-05-10T11:20:31.515123+0000","last_became_peered":"2024-05-10T11:20:31.515123+0000","last_unstale":"2024-05-10T11:20:32.654787+0000","last_undegraded":"2024-05-10T11:20:32.654787+0000","last_fullsized":"2024-05-10T11:20:32.654787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.941937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.515940+0000","last_change":"2024-05-10T11:20:31.510842+0000","last_active":"2024-05-10T11:20:31.515940+0000","last_peered":"2024-05-10T11:20:31.515940+0000","last_clean":"2024-05-10T11:20:31.515940+0000","last_became_active":"2024-05-10T11:20:31.510339+0000","last_became_peered":"2024-05-10T11:20:31.510339+0000","last_unstale":"2024-05-10T11:20:31.515940+0000","last_undegraded":"2024-05-10T11:20:31.515940+0000","last_fullsized":"2024-05-10T11:20:31.515940+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:24:21.870694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"103'1","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.521650+0000","last_change":"2024-05-10T11:20:30.508016+0000","last_active":"2024-05-10T11:20:31.521650+0000","last_peered":"2024-05-10T11:20:31.521650+0000","last_clean":"2024-05-10T11:20:31.521650+0000","last_became_active":"2024-05-10T11:20:30.507739+0000","last_became_peered":"2024-05-10T11:20:30.507739+0000","last_unstale":"2024-05-10T11:20:31.521650+0000","last_undegraded":"2024-05-10T11:20:31.521650+0000","last_fullsized":"2024-05-10T11:20:31.521650+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:23.143821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654652+0000","last_change":"2024-05-10T11:20:31.511359+0000","last_active":"2024-05-10T11:20:32.654652+0000","last_peered":"2024-05-10T11:20:32.654652+0000","last_clean":"2024-05-10T11:20:32.654652+0000","last_became_active":"2024-05-10T11:20:31.511087+0000","last_became_peered":"2024-05-10T11:20:31.511087+0000","last_unstale":"2024-05-10T11:20:32.654652+0000","last_undegraded":"2024-05-10T11:20:32.654652+0000","last_fullsized":"2024-05-10T11:20:32.654652+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:06.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654391+0000","last_change":"2024-05-10T11:20:30.505041+0000","last_active":"2024-05-10T11:20:32.654391+0000","last_peered":"2024-05-10T11:20:32.654391+0000","last_clean":"2024-05-10T11:20:32.654391+0000","last_became_active":"2024-05-10T11:20:30.504761+0000","last_became_peered":"2024-05-10T11:20:30.504761+0000","last_unstale":"2024-05-10T11:20:32.654391+0000","last_undegraded":"2024-05-10T11:20:32.654391+0000","last_fullsized":"2024-05-10T11:20:32.654391+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:28:13.501556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.515197+0000","last_change":"2024-05-10T11:20:31.508306+0000","last_active":"2024-05-10T11:20:31.515197+0000","last_peered":"2024-05-10T11:20:31.515197+0000","last_clean":"2024-05-10T11:20:31.515197+0000","last_became_active":"2024-05-10T11:20:31.508023+0000","last_became_peered":"2024-05-10T11:20:31.508023+0000","last_unstale":"2024-05-10T11:20:31.515197+0000","last_undegraded":"2024-05-10T11:20:31.515197+0000","last_fullsized":"2024-05-10T11:20:31.515197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:20:22.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.514960+0000","last_change":"2024-05-10T11:20:31.517880+0000","last_active":"2024-05-10T11:20:32.514960+0000","last_peered":"2024-05-10T11:20:32.514960+0000","last_clean":"2024-05-10T11:20:32.514960+0000","last_became_active":"2024-05-10T11:20:31.517480+0000","last_became_peered":"2024-05-10T11:20:31.517480+0000","last_unstale":"2024-05-10T11:20:32.514960+0000","last_undegraded":"2024-05-10T11:20:32.514960+0000","last_fullsized":"2024-05-10T11:20:32.514960+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:06.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.497859+0000","last_change":"2024-05-10T11:20:30.508410+0000","last_active":"2024-05-10T11:20:31.497859+0000","last_peered":"2024-05-10T11:20:31.497859+0000","last_clean":"2024-05-10T11:20:31.497859+0000","last_became_active":"2024-05-10T11:20:30.508150+0000","last_became_peered":"2024-05-10T11:20:30.508150+0000","last_unstale":"2024-05-10T11:20:31.497859+0000","last_undegraded":"2024-05-10T11:20:31.497859+0000","last_fullsized":"2024-05-10T11:20:31.497859+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:09.751122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529671+0000","last_change":"2024-05-10T11:20:31.525784+0000","last_active":"2024-05-10T11:20:31.529671+0000","last_peered":"2024-05-10T11:20:31.529671+0000","last_clean":"2024-05-10T11:20:31.529671+0000","last_became_active":"2024-05-10T11:20:31.525270+0000","last_became_peered":"2024-05-10T11:20:31.525270+0000","last_unstale":"2024-05-10T11:20:31.529671+0000","last_undegraded":"2024-05-10T11:20:31.529671+0000","last_fullsized":"2024-05-10T11:20:31.529671+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:16.834169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515273+0000","last_change":"2024-05-10T11:20:31.520013+0000","last_active":"2024-05-10T11:20:32.515273+0000","last_peered":"2024-05-10T11:20:32.515273+0000","last_clean":"2024-05-10T11:20:32.515273+0000","last_became_active":"2024-05-10T11:20:31.519756+0000","last_became_peered":"2024-05-10T11:20:31.519756+0000","last_unstale":"2024-05-10T11:20:32.515273+0000","last_undegraded":"2024-05-10T11:20:32.515273+0000","last_fullsized":"2024-05-10T11:20:32.515273+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:36.853116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.517454+0000","last_change":"2024-05-10T11:20:31.515905+0000","last_active":"2024-05-10T11:20:31.517454+0000","last_peered":"2024-05-10T11:20:31.517454+0000","last_clean":"2024-05-10T11:20:31.517454+0000","last_became_active":"2024-05-10T11:20:31.515614+0000","last_became_peered":"2024-05-10T11:20:31.515614+0000","last_unstale":"2024-05-10T11:20:31.517454+0000","last_undegraded":"2024-05-10T11:20:31.517454+0000","last_fullsized":"2024-05-10T11:20:31.517454+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:35:35.827862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515245+0000","last_change":"2024-05-10T11:20:30.515017+0000","last_active":"2024-05-10T11:20:32.515245+0000","last_peered":"2024-05-10T11:20:32.515245+0000","last_clean":"2024-05-10T11:20:32.515245+0000","last_became_active":"2024-05-10T11:20:30.514757+0000","last_became_peered":"2024-05-10T11:20:30.514757+0000","last_unstale":"2024-05-10T11:20:32.515245+0000","last_undegraded":"2024-05-10T11:20:32.515245+0000","last_fullsized":"2024-05-10T11:20:32.515245+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:28.778159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654464+0000","last_change":"2024-05-10T11:20:30.511062+0000","last_active":"2024-05-10T11:20:32.654464+0000","last_peered":"2024-05-10T11:20:32.654464+0000","last_clean":"2024-05-10T11:20:32.654464+0000","last_became_active":"2024-05-10T11:20:30.510727+0000","last_became_peered":"2024-05-10T11:20:30.510727+0000","last_unstale":"2024-05-10T11:20:32.654464+0000","last_undegraded":"2024-05-10T11:20:32.654464+0000","last_fullsized":"2024-05-10T11:20:32.654464+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:35.670363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528451+0000","last_change":"2024-05-10T11:20:31.522300+0000","last_active":"2024-05-10T11:20:31.528451+0000","last_peered":"2024-05-10T11:20:31.528451+0000","last_clean":"2024-05-10T11:20:31.528451+0000","last_became_active":"2024-05-10T11:20:31.521988+0000","last_became_peered":"2024-05-10T11:20:31.521988+0000","last_unstale":"2024-05-10T11:20:31.528451+0000","last_undegraded":"2024-05-10T11:20:31.528451+0000","last_fullsized":"2024-05-10T11:20:31.528451+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:34.293180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.509075+0000","last_change":"2024-05-10T11:20:30.514950+0000","last_active":"2024-05-10T11:20:31.509075+0000","last_peered":"2024-05-10T11:20:31.509075+0000","last_clean":"2024-05-10T11:20:31.509075+0000","last_became_active":"2024-05-10T11:20:30.514671+0000","last_became_peered":"2024-05-10T11:20:30.514671+0000","last_unstale":"2024-05-10T11:20:31.509075+0000","last_undegraded":"2024-05-10T11:20:31.509075+0000","last_fullsized":"2024-05-10T11:20:31.509075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:41.871808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.514912+0000","last_change":"2024-05-10T11:20:31.510347+0000","last_active":"2024-05-10T11:20:31.514912+0000","last_peered":"2024-05-10T11:20:31.514912+0000","last_clean":"2024-05-10T11:20:31.514912+0000","last_became_active":"2024-05-10T11:20:31.510057+0000","last_became_peered":"2024-05-10T11:20:31.510057+0000","last_unstale":"2024-05-10T11:20:31.514912+0000","last_undegraded":"2024-05-10T11:20:31.514912+0000","last_fullsized":"2024-05-10T11:20:31.514912+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:51.466860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528493+0000","last_change":"2024-05-10T11:20:31.519899+0000","last_active":"2024-05-10T11:20:31.528493+0000","last_peered":"2024-05-10T11:20:31.528493+0000","last_clean":"2024-05-10T11:20:31.528493+0000","last_became_active":"2024-05-10T11:20:31.519642+0000","last_became_peered":"2024-05-10T11:20:31.519642+0000","last_unstale":"2024-05-10T11:20:31.528493+0000","last_undegraded":"2024-05-10T11:20:31.528493+0000","last_fullsized":"2024-05-10T11:20:31.528493+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:27:11.252244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515149+0000","last_change":"2024-05-10T11:20:31.517384+0000","last_active":"2024-05-10T11:20:32.515149+0000","last_peered":"2024-05-10T11:20:32.515149+0000","last_clean":"2024-05-10T11:20:32.515149+0000","last_became_active":"2024-05-10T11:20:31.517076+0000","last_became_peered":"2024-05-10T11:20:31.517076+0000","last_unstale":"2024-05-10T11:20:32.515149+0000","last_undegraded":"2024-05-10T11:20:32.515149+0000","last_fullsized":"2024-05-10T11:20:32.515149+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.941937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.499470+0000","last_change":"2024-05-10T11:20:30.507551+0000","last_active":"2024-05-10T11:20:31.499470+0000","last_peered":"2024-05-10T11:20:31.499470+0000","last_clean":"2024-05-10T11:20:31.499470+0000","last_became_active":"2024-05-10T11:20:30.507252+0000","last_became_peered":"2024-05-10T11:20:30.507252+0000","last_unstale":"2024-05-10T11:20:31.499470+0000","last_undegraded":"2024-05-10T11:20:31.499470+0000","last_fullsized":"2024-05-10T11:20:31.499470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:35.670363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.508393+0000","last_change":"2024-05-10T11:20:31.506090+0000","last_active":"2024-05-10T11:20:31.508393+0000","last_peered":"2024-05-10T11:20:31.508393+0000","last_clean":"2024-05-10T11:20:31.508393+0000","last_became_active":"2024-05-10T11:20:31.505691+0000","last_became_peered":"2024-05-10T11:20:31.505691+0000","last_unstale":"2024-05-10T11:20:31.508393+0000","last_undegraded":"2024-05-10T11:20:31.508393+0000","last_fullsized":"2024-05-10T11:20:31.508393+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:29.306415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"103'2","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529309+0000","last_change":"2024-05-10T11:20:30.514537+0000","last_active":"2024-05-10T11:20:31.529309+0000","last_peered":"2024-05-10T11:20:31.529309+0000","last_clean":"2024-05-10T11:20:31.529309+0000","last_became_active":"2024-05-10T11:20:30.514219+0000","last_became_peered":"2024-05-10T11:20:30.514219+0000","last_unstale":"2024-05-10T11:20:31.529309+0000","last_undegraded":"2024-05-10T11:20:31.529309+0000","last_fullsized":"2024-05-10T11:20:31.529309+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:03.979628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528552+0000","last_change":"2024-05-10T11:20:31.519332+0000","last_active":"2024-05-10T11:20:31.528552+0000","last_peered":"2024-05-10T11:20:31.528552+0000","last_clean":"2024-05-10T11:20:31.528552+0000","last_became_active":"2024-05-10T11:20:31.518857+0000","last_became_peered":"2024-05-10T11:20:31.518857+0000","last_unstale":"2024-05-10T11:20:31.528552+0000","last_undegraded":"2024-05-10T11:20:31.528552+0000","last_fullsized":"2024-05-10T11:20:31.528552+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:25.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.509441+0000","last_change":"2024-05-10T11:20:30.515724+0000","last_active":"2024-05-10T11:20:31.509441+0000","last_peered":"2024-05-10T11:20:31.509441+0000","last_clean":"2024-05-10T11:20:31.509441+0000","last_became_active":"2024-05-10T11:20:30.515454+0000","last_became_peered":"2024-05-10T11:20:30.515454+0000","last_unstale":"2024-05-10T11:20:31.509441+0000","last_undegraded":"2024-05-10T11:20:31.509441+0000","last_fullsized":"2024-05-10T11:20:31.509441+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:45:07.044207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654581+0000","last_change":"2024-05-10T11:20:31.513676+0000","last_active":"2024-05-10T11:20:32.654581+0000","last_peered":"2024-05-10T11:20:32.654581+0000","last_clean":"2024-05-10T11:20:32.654581+0000","last_became_active":"2024-05-10T11:20:31.513404+0000","last_became_peered":"2024-05-10T11:20:31.513404+0000","last_unstale":"2024-05-10T11:20:32.654581+0000","last_undegraded":"2024-05-10T11:20:32.654581+0000","last_fullsized":"2024-05-10T11:20:32.654581+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:55.683207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529584+0000","last_change":"2024-05-10T11:20:31.528691+0000","last_active":"2024-05-10T11:20:31.529584+0000","last_peered":"2024-05-10T11:20:31.529584+0000","last_clean":"2024-05-10T11:20:31.529584+0000","last_became_active":"2024-05-10T11:20:31.528373+0000","last_became_peered":"2024-05-10T11:20:31.528373+0000","last_unstale":"2024-05-10T11:20:31.529584+0000","last_undegraded":"2024-05-10T11:20:31.529584+0000","last_fullsized":"2024-05-10T11:20:31.529584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:15:41.121148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.512697+0000","last_change":"2024-05-10T11:20:30.511816+0000","last_active":"2024-05-10T11:20:31.512697+0000","last_peered":"2024-05-10T11:20:31.512697+0000","last_clean":"2024-05-10T11:20:31.512697+0000","last_became_active":"2024-05-10T11:20:30.511392+0000","last_became_peered":"2024-05-10T11:20:30.511392+0000","last_unstale":"2024-05-10T11:20:31.512697+0000","last_undegraded":"2024-05-10T11:20:31.512697+0000","last_fullsized":"2024-05-10T11:20:31.512697+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:48.954197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.508460+0000","last_change":"2024-05-10T11:20:31.505847+0000","last_active":"2024-05-10T11:20:31.508460+0000","last_peered":"2024-05-10T11:20:31.508460+0000","last_clean":"2024-05-10T11:20:31.508460+0000","last_became_active":"2024-05-10T11:20:31.505405+0000","last_became_peered":"2024-05-10T11:20:31.505405+0000","last_unstale":"2024-05-10T11:20:31.508460+0000","last_undegraded":"2024-05-10T11:20:31.508460+0000","last_fullsized":"2024-05-10T11:20:31.508460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:42:04.424569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515054+0000","last_change":"2024-05-10T11:20:30.515117+0000","last_active":"2024-05-10T11:20:32.515054+0000","last_peered":"2024-05-10T11:20:32.515054+0000","last_clean":"2024-05-10T11:20:32.515054+0000","last_became_active":"2024-05-10T11:20:30.514849+0000","last_became_peered":"2024-05-10T11:20:30.514849+0000","last_unstale":"2024-05-10T11:20:32.515054+0000","last_undegraded":"2024-05-10T11:20:32.515054+0000","last_fullsized":"2024-05-10T11:20:32.515054+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:35.670363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"103'1","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.508717+0000","last_change":"2024-05-10T11:20:30.507661+0000","last_active":"2024-05-10T11:20:32.508717+0000","last_peered":"2024-05-10T11:20:32.508717+0000","last_clean":"2024-05-10T11:20:32.508717+0000","last_became_active":"2024-05-10T11:20:30.507391+0000","last_became_peered":"2024-05-10T11:20:30.507391+0000","last_unstale":"2024-05-10T11:20:32.508717+0000","last_undegraded":"2024-05-10T11:20:32.508717+0000","last_fullsized":"2024-05-10T11:20:32.508717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:09.304697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654521+0000","last_change":"2024-05-10T11:20:31.514107+0000","last_active":"2024-05-10T11:20:32.654521+0000","last_peered":"2024-05-10T11:20:32.654521+0000","last_clean":"2024-05-10T11:20:32.654521+0000","last_became_active":"2024-05-10T11:20:31.513795+0000","last_became_peered":"2024-05-10T11:20:31.513795+0000","last_unstale":"2024-05-10T11:20:32.654521+0000","last_undegraded":"2024-05-10T11:20:32.654521+0000","last_fullsized":"2024-05-10T11:20:32.654521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:30.999521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.524350+0000","last_change":"2024-05-10T11:20:31.519360+0000","last_active":"2024-05-10T11:20:31.524350+0000","last_peered":"2024-05-10T11:20:31.524350+0000","last_clean":"2024-05-10T11:20:31.524350+0000","last_became_active":"2024-05-10T11:20:31.519023+0000","last_became_peered":"2024-05-10T11:20:31.519023+0000","last_unstale":"2024-05-10T11:20:31.524350+0000","last_undegraded":"2024-05-10T11:20:31.524350+0000","last_fullsized":"2024-05-10T11:20:31.524350+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:59.324923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515225+0000","last_change":"2024-05-10T11:20:30.513583+0000","last_active":"2024-05-10T11:20:32.515225+0000","last_peered":"2024-05-10T11:20:32.515225+0000","last_clean":"2024-05-10T11:20:32.515225+0000","last_became_active":"2024-05-10T11:20:30.513343+0000","last_became_peered":"2024-05-10T11:20:30.513343+0000","last_unstale":"2024-05-10T11:20:32.515225+0000","last_undegraded":"2024-05-10T11:20:32.515225+0000","last_fullsized":"2024-05-10T11:20:32.515225+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:23.143821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.531062+0000","last_change":"2024-05-10T11:20:31.529781+0000","last_active":"2024-05-10T11:20:31.531062+0000","last_peered":"2024-05-10T11:20:31.531062+0000","last_clean":"2024-05-10T11:20:31.531062+0000","last_became_active":"2024-05-10T11:20:31.529406+0000","last_became_peered":"2024-05-10T11:20:31.529406+0000","last_unstale":"2024-05-10T11:20:31.531062+0000","last_undegraded":"2024-05-10T11:20:31.531062+0000","last_fullsized":"2024-05-10T11:20:31.531062+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:51.172423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529364+0000","last_change":"2024-05-10T11:20:31.525562+0000","last_active":"2024-05-10T11:20:31.529364+0000","last_peered":"2024-05-10T11:20:31.529364+0000","last_clean":"2024-05-10T11:20:31.529364+0000","last_became_active":"2024-05-10T11:20:31.525229+0000","last_became_peered":"2024-05-10T11:20:31.525229+0000","last_unstale":"2024-05-10T11:20:31.529364+0000","last_undegraded":"2024-05-10T11:20:31.529364+0000","last_fullsized":"2024-05-10T11:20:31.529364+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:23.594202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.509629+0000","last_change":"2024-05-10T11:20:30.515119+0000","last_active":"2024-05-10T11:20:31.509629+0000","last_peered":"2024-05-10T11:20:31.509629+0000","last_clean":"2024-05-10T11:20:31.509629+0000","last_became_active":"2024-05-10T11:20:30.514851+0000","last_became_peered":"2024-05-10T11:20:30.514851+0000","last_unstale":"2024-05-10T11:20:31.509629+0000","last_undegraded":"2024-05-10T11:20:31.509629+0000","last_fullsized":"2024-05-10T11:20:31.509629+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:52.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:30.486426+0000","last_change":"2024-05-10T11:20:30.486426+0000","last_active":"2024-05-10T11:20:30.486426+0000","last_peered":"2024-05-10T11:20:30.486426+0000","last_clean":"2024-05-10T11:20:30.486426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:30.486426+0000","last_undegraded":"2024-05-10T11:20:30.486426+0000","last_fullsized":"2024-05-10T11:20:30.486426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T11:20:29.478400+0000","last_change":"2024-05-10T11:20:29.478400+0000","last_active":"2024-05-10T11:20:29.478400+0000","last_peered":"2024-05-10T11:20:29.478400+0000","last_clean":"2024-05-10T11:20:29.478400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T11:20:29.478400+0000","last_undegraded":"2024-05-10T11:20:29.478400+0000","last_fullsized":"2024-05-10T11:20:29.478400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.513603+0000","last_change":"2024-05-10T11:20:31.509347+0000","last_active":"2024-05-10T11:20:31.513603+0000","last_peered":"2024-05-10T11:20:31.513603+0000","last_clean":"2024-05-10T11:20:31.513603+0000","last_became_active":"2024-05-10T11:20:31.509074+0000","last_became_peered":"2024-05-10T11:20:31.509074+0000","last_unstale":"2024-05-10T11:20:31.513603+0000","last_undegraded":"2024-05-10T11:20:31.513603+0000","last_fullsized":"2024-05-10T11:20:31.513603+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:49.480139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.512865+0000","last_change":"2024-05-10T11:20:30.517489+0000","last_active":"2024-05-10T11:20:31.512865+0000","last_peered":"2024-05-10T11:20:31.512865+0000","last_clean":"2024-05-10T11:20:31.512865+0000","last_became_active":"2024-05-10T11:20:30.517293+0000","last_became_peered":"2024-05-10T11:20:30.517293+0000","last_unstale":"2024-05-10T11:20:31.512865+0000","last_undegraded":"2024-05-10T11:20:31.512865+0000","last_fullsized":"2024-05-10T11:20:31.512865+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:49.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.521250+0000","last_change":"2024-05-10T11:20:31.516844+0000","last_active":"2024-05-10T11:20:31.521250+0000","last_peered":"2024-05-10T11:20:31.521250+0000","last_clean":"2024-05-10T11:20:31.521250+0000","last_became_active":"2024-05-10T11:20:31.516570+0000","last_became_peered":"2024-05-10T11:20:31.516570+0000","last_unstale":"2024-05-10T11:20:31.521250+0000","last_undegraded":"2024-05-10T11:20:31.521250+0000","last_fullsized":"2024-05-10T11:20:31.521250+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:56.625250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"103'2","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528305+0000","last_change":"2024-05-10T11:20:30.511011+0000","last_active":"2024-05-10T11:20:31.528305+0000","last_peered":"2024-05-10T11:20:31.528305+0000","last_clean":"2024-05-10T11:20:31.528305+0000","last_became_active":"2024-05-10T11:20:30.510713+0000","last_became_peered":"2024-05-10T11:20:30.510713+0000","last_unstale":"2024-05-10T11:20:31.528305+0000","last_undegraded":"2024-05-10T11:20:31.528305+0000","last_fullsized":"2024-05-10T11:20:31.528305+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:34.505493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":259,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-10T11:20:28.157681+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:20:28.157681+0000","last_peered":"2024-05-10T11:20:28.157681+0000","last_clean":"2024-05-10T11:20:28.157681+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:20:28.157681+0000","last_undegraded":"2024-05-10T11:20:28.157681+0000","last_fullsized":"2024-05-10T11:20:28.157681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1826816,"data_stored":1157370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1220608,"data_stored":561343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":567002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542247,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":587627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542248,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":587079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542247,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":587079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542247,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1880064,"data_stored":1179115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1257472,"data_stored":579878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:20:35.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:20:35.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.696+0000 7fd79b5f0640 1 Processor -- start 2024-05-10T11:20:35.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.696+0000 7fd79b5f0640 1 -- start start 2024-05-10T11:20:35.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd79b5f0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd79415f620 0x7fd79415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd79b5f0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd794160190 con 0x7fd7940704c0 2024-05-10T11:20:35.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd79b5f0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd794160470 con 0x7fd79406c990 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd79b5f0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd79406cd70 con 0x7fd79415f620 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd798b8b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd79415f620 0x7fd79415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd798b8b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd79415f620 0x7fd79415fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54686/0 (socket says 172.21.15.66:54686) 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd798b8b640 1 -- 172.21.15.66:0/1049017440 learned_addr learned my addr 172.21.15.66:0/1049017440 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd798b8b640 1 -- 172.21.15.66:0/1049017440 >> v1:172.21.15.190:6789/0 conn(0x7fd79406c990 legacy=0x7fd794163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd798b8b640 1 -- 172.21.15.66:0/1049017440 >> v1:172.21.15.66:6789/0 conn(0x7fd7940704c0 legacy=0x7fd794070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.697+0000 7fd798b8b640 1 -- 172.21.15.66:0/1049017440 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd794162e60 con 0x7fd79415f620 2024-05-10T11:20:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.698+0000 7fd798b8b640 1 --2- 172.21.15.66:0/1049017440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd79415fa80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd784009870 tx=0x7fd78402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23f3198dca86541 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.698+0000 7fd78bfff640 1 -- 172.21.15.66:0/1049017440 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784037070 con 0x7fd79415f620 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.698+0000 7fd78bfff640 1 -- 172.21.15.66:0/1049017440 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd784032440 con 0x7fd79415f620 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.698+0000 7fd78bfff640 1 -- 172.21.15.66:0/1049017440 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784032810 con 0x7fd79415f620 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 -- 172.21.15.66:0/1049017440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 msgr2=0x7fd79415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/1049017440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd79415fa80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd784009870 tx=0x7fd78402a2a0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 -- 172.21.15.66:0/1049017440 shutdown_connections 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/1049017440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd79415fa80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 -- 172.21.15.66:0/1049017440 >> 172.21.15.66:0/1049017440 conn(0x7fd7940b3980 msgr2=0x7fd7940b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 -- 172.21.15.66:0/1049017440 shutdown_connections 2024-05-10T11:20:35.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.699+0000 7fd79b5f0640 1 -- 172.21.15.66:0/1049017440 wait complete. 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.700+0000 7fd79b5f0640 1 Processor -- start 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.700+0000 7fd79b5f0640 1 -- start start 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79b5f0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd79406c990 0x7fd794160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79b5f0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7940704c0 0x7fd79415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79b5f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd7940b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79b5f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd7940cf920 con 0x7fd79415f620 2024-05-10T11:20:35.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79b5f0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd794073e70 con 0x7fd7940704c0 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79b5f0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd7940cfaa0 con 0x7fd79406c990 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd7940b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd7940b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54694/0 (socket says 172.21.15.66:54694) 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 -- 172.21.15.66:0/4212036485 learned_addr learned my addr 172.21.15.66:0/4212036485 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd798b8b640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7940704c0 0x7fd79415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79938c640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd79406c990 0x7fd794160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 -- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd79406c990 msgr2=0x7fd794160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd79406c990 0x7fd794160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 -- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7940704c0 msgr2=0x7fd79415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7940704c0 0x7fd79415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 -- 172.21.15.66:0/4212036485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940cdd50 con 0x7fd79415f620 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd79938c640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd79406c990 0x7fd794160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.701+0000 7fd799b8d640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd7940b52e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c7a0 tx=0x7fd78c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.702+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c003b70 con 0x7fd79415f620 2024-05-10T11:20:35.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.702+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c003d30 con 0x7fd79415f620 2024-05-10T11:20:35.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.702+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7941616f0 con 0x7fd79415f620 2024-05-10T11:20:35.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.702+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00aa90 con 0x7fd79415f620 2024-05-10T11:20:35.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.702+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd794161cb0 con 0x7fd79415f620 2024-05-10T11:20:35.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.703+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79406a220 con 0x7fd79415f620 2024-05-10T11:20:35.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.703+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd78c00ac30 con 0x7fd79415f620 2024-05-10T11:20:35.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.704+0000 7fd789ffb640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd7780762d0 0x7fd778078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:35.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.704+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fd78c097630 con 0x7fd79415f620 2024-05-10T11:20:35.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.704+0000 7fd79938c640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd7780762d0 0x7fd778078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:35.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.705+0000 7fd79938c640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd7780762d0 0x7fd778078790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd790007fd0 tx=0x7fd790009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:35.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.708+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd78c060e90 con 0x7fd79415f620 2024-05-10T11:20:35.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.896+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd794073540 con 0x7fd7780762d0 2024-05-10T11:20:35.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.902+0000 7fd789ffb640 1 -- 172.21.15.66:0/4212036485 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252442 (secure 0 0 0) 0x7fd794073540 con 0x7fd7780762d0 2024-05-10T11:20:35.905 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:35.906 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd7780762d0 msgr2=0x7fd778078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd7780762d0 0x7fd778078790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd790007fd0 tx=0x7fd790009040 comp rx=0 tx=0).stop 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 msgr2=0x7fd7940b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd7940b52e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c7a0 tx=0x7fd78c00cc60 comp rx=0 tx=0).stop 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 shutdown_connections 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd7780762d0 0x7fd778078790 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd79415f620 0x7fd7940b52e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7940704c0 0x7fd79415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 --2- 172.21.15.66:0/4212036485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd79406c990 0x7fd794160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:35.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 >> 172.21.15.66:0/4212036485 conn(0x7fd7940b3980 msgr2=0x7fd79415c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:35.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 shutdown_connections 2024-05-10T11:20:35.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:35.905+0000 7fd79b5f0640 1 -- 172.21.15.66:0/4212036485 wait complete. 2024-05-10T11:20:35.917 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-05-10T11:20:35.808213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260656,"kb_used_data":11168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714064,"statfs":{"total":773094113280,"available":772827201536,"internally_reserved":0,"allocated":11436032,"data_stored":5894825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001615"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.507980+0000","last_change":"2024-05-10T11:20:31.506272+0000","last_active":"2024-05-10T11:20:31.507980+0000","last_peered":"2024-05-10T11:20:31.507980+0000","last_clean":"2024-05-10T11:20:31.507980+0000","last_became_active":"2024-05-10T11:20:31.505974+0000","last_became_peered":"2024-05-10T11:20:31.505974+0000","last_unstale":"2024-05-10T11:20:31.507980+0000","last_undegraded":"2024-05-10T11:20:31.507980+0000","last_fullsized":"2024-05-10T11:20:31.507980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:02:53.391632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755349+0000","last_change":"2024-05-10T11:20:31.512304+0000","last_active":"2024-05-10T11:20:32.755349+0000","last_peered":"2024-05-10T11:20:32.755349+0000","last_clean":"2024-05-10T11:20:32.755349+0000","last_became_active":"2024-05-10T11:20:31.511813+0000","last_became_peered":"2024-05-10T11:20:31.511813+0000","last_unstale":"2024-05-10T11:20:32.755349+0000","last_undegraded":"2024-05-10T11:20:32.755349+0000","last_fullsized":"2024-05-10T11:20:32.755349+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:47.371556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.513167+0000","last_change":"2024-05-10T11:20:31.508864+0000","last_active":"2024-05-10T11:20:31.513167+0000","last_peered":"2024-05-10T11:20:31.513167+0000","last_clean":"2024-05-10T11:20:31.513167+0000","last_became_active":"2024-05-10T11:20:31.507265+0000","last_became_peered":"2024-05-10T11:20:31.507265+0000","last_unstale":"2024-05-10T11:20:31.513167+0000","last_undegraded":"2024-05-10T11:20:31.513167+0000","last_fullsized":"2024-05-10T11:20:31.513167+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:34.647851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654692+0000","last_change":"2024-05-10T11:20:31.520886+0000","last_active":"2024-05-10T11:20:32.654692+0000","last_peered":"2024-05-10T11:20:32.654692+0000","last_clean":"2024-05-10T11:20:32.654692+0000","last_became_active":"2024-05-10T11:20:31.520594+0000","last_became_peered":"2024-05-10T11:20:31.520594+0000","last_unstale":"2024-05-10T11:20:32.654692+0000","last_undegraded":"2024-05-10T11:20:32.654692+0000","last_fullsized":"2024-05-10T11:20:32.654692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:50.390413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515111+0000","last_change":"2024-05-10T11:20:31.523451+0000","last_active":"2024-05-10T11:20:32.515111+0000","last_peered":"2024-05-10T11:20:32.515111+0000","last_clean":"2024-05-10T11:20:32.515111+0000","last_became_active":"2024-05-10T11:20:31.523134+0000","last_became_peered":"2024-05-10T11:20:31.523134+0000","last_unstale":"2024-05-10T11:20:32.515111+0000","last_undegraded":"2024-05-10T11:20:32.515111+0000","last_fullsized":"2024-05-10T11:20:32.515111+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:50.390413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.754856+0000","last_change":"2024-05-10T11:20:31.519390+0000","last_active":"2024-05-10T11:20:32.754856+0000","last_peered":"2024-05-10T11:20:32.754856+0000","last_clean":"2024-05-10T11:20:32.754856+0000","last_became_active":"2024-05-10T11:20:31.519123+0000","last_became_peered":"2024-05-10T11:20:31.519123+0000","last_unstale":"2024-05-10T11:20:32.754856+0000","last_undegraded":"2024-05-10T11:20:32.754856+0000","last_fullsized":"2024-05-10T11:20:32.754856+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:29.549330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.754808+0000","last_change":"2024-05-10T11:20:31.520022+0000","last_active":"2024-05-10T11:20:32.754808+0000","last_peered":"2024-05-10T11:20:32.754808+0000","last_clean":"2024-05-10T11:20:32.754808+0000","last_became_active":"2024-05-10T11:20:31.519758+0000","last_became_peered":"2024-05-10T11:20:31.519758+0000","last_unstale":"2024-05-10T11:20:32.754808+0000","last_undegraded":"2024-05-10T11:20:32.754808+0000","last_fullsized":"2024-05-10T11:20:32.754808+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:22.005774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529336+0000","last_change":"2024-05-10T11:20:31.526312+0000","last_active":"2024-05-10T11:20:31.529336+0000","last_peered":"2024-05-10T11:20:31.529336+0000","last_clean":"2024-05-10T11:20:31.529336+0000","last_became_active":"2024-05-10T11:20:31.525784+0000","last_became_peered":"2024-05-10T11:20:31.525784+0000","last_unstale":"2024-05-10T11:20:31.529336+0000","last_undegraded":"2024-05-10T11:20:31.529336+0000","last_fullsized":"2024-05-10T11:20:31.529336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:57.325512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755300+0000","last_change":"2024-05-10T11:20:31.520929+0000","last_active":"2024-05-10T11:20:32.755300+0000","last_peered":"2024-05-10T11:20:32.755300+0000","last_clean":"2024-05-10T11:20:32.755300+0000","last_became_active":"2024-05-10T11:20:31.520660+0000","last_became_peered":"2024-05-10T11:20:31.520660+0000","last_unstale":"2024-05-10T11:20:32.755300+0000","last_undegraded":"2024-05-10T11:20:32.755300+0000","last_fullsized":"2024-05-10T11:20:32.755300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:05.276674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515269+0000","last_change":"2024-05-10T11:20:31.520910+0000","last_active":"2024-05-10T11:20:32.515269+0000","last_peered":"2024-05-10T11:20:32.515269+0000","last_clean":"2024-05-10T11:20:32.515269+0000","last_became_active":"2024-05-10T11:20:31.520646+0000","last_became_peered":"2024-05-10T11:20:31.520646+0000","last_unstale":"2024-05-10T11:20:32.515269+0000","last_undegraded":"2024-05-10T11:20:32.515269+0000","last_fullsized":"2024-05-10T11:20:32.515269+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:00:09.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.516120+0000","last_change":"2024-05-10T11:20:31.510702+0000","last_active":"2024-05-10T11:20:31.516120+0000","last_peered":"2024-05-10T11:20:31.516120+0000","last_clean":"2024-05-10T11:20:31.516120+0000","last_became_active":"2024-05-10T11:20:31.510189+0000","last_became_peered":"2024-05-10T11:20:31.510189+0000","last_unstale":"2024-05-10T11:20:31.516120+0000","last_undegraded":"2024-05-10T11:20:31.516120+0000","last_fullsized":"2024-05-10T11:20:31.516120+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:48.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955896+0000","last_change":"2024-05-10T11:20:31.523059+0000","last_active":"2024-05-10T11:20:32.955896+0000","last_peered":"2024-05-10T11:20:32.955896+0000","last_clean":"2024-05-10T11:20:32.955896+0000","last_became_active":"2024-05-10T11:20:31.522666+0000","last_became_peered":"2024-05-10T11:20:31.522666+0000","last_unstale":"2024-05-10T11:20:32.955896+0000","last_undegraded":"2024-05-10T11:20:32.955896+0000","last_fullsized":"2024-05-10T11:20:32.955896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:05.596922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654506+0000","last_change":"2024-05-10T11:20:31.512494+0000","last_active":"2024-05-10T11:20:32.654506+0000","last_peered":"2024-05-10T11:20:32.654506+0000","last_clean":"2024-05-10T11:20:32.654506+0000","last_became_active":"2024-05-10T11:20:31.512203+0000","last_became_peered":"2024-05-10T11:20:31.512203+0000","last_unstale":"2024-05-10T11:20:32.654506+0000","last_undegraded":"2024-05-10T11:20:32.654506+0000","last_fullsized":"2024-05-10T11:20:32.654506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:04:32.826685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857332+0000","last_change":"2024-05-10T11:20:31.517984+0000","last_active":"2024-05-10T11:20:32.857332+0000","last_peered":"2024-05-10T11:20:32.857332+0000","last_clean":"2024-05-10T11:20:32.857332+0000","last_became_active":"2024-05-10T11:20:31.517704+0000","last_became_peered":"2024-05-10T11:20:31.517704+0000","last_unstale":"2024-05-10T11:20:32.857332+0000","last_undegraded":"2024-05-10T11:20:32.857332+0000","last_fullsized":"2024-05-10T11:20:32.857332+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:47.371556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857253+0000","last_change":"2024-05-10T11:20:31.508956+0000","last_active":"2024-05-10T11:20:32.857253+0000","last_peered":"2024-05-10T11:20:32.857253+0000","last_clean":"2024-05-10T11:20:32.857253+0000","last_became_active":"2024-05-10T11:20:31.508680+0000","last_became_peered":"2024-05-10T11:20:31.508680+0000","last_unstale":"2024-05-10T11:20:32.857253+0000","last_undegraded":"2024-05-10T11:20:32.857253+0000","last_fullsized":"2024-05-10T11:20:32.857253+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:26:13.567492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857245+0000","last_change":"2024-05-10T11:20:31.519071+0000","last_active":"2024-05-10T11:20:32.857245+0000","last_peered":"2024-05-10T11:20:32.857245+0000","last_clean":"2024-05-10T11:20:32.857245+0000","last_became_active":"2024-05-10T11:20:31.518777+0000","last_became_peered":"2024-05-10T11:20:31.518777+0000","last_unstale":"2024-05-10T11:20:32.857245+0000","last_undegraded":"2024-05-10T11:20:32.857245+0000","last_fullsized":"2024-05-10T11:20:32.857245+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:05.276674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.517314+0000","last_change":"2024-05-10T11:20:31.514777+0000","last_active":"2024-05-10T11:20:31.517314+0000","last_peered":"2024-05-10T11:20:31.517314+0000","last_clean":"2024-05-10T11:20:31.517314+0000","last_became_active":"2024-05-10T11:20:31.511207+0000","last_became_peered":"2024-05-10T11:20:31.511207+0000","last_unstale":"2024-05-10T11:20:31.517314+0000","last_undegraded":"2024-05-10T11:20:31.517314+0000","last_fullsized":"2024-05-10T11:20:31.517314+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:28:51.979955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755333+0000","last_change":"2024-05-10T11:20:31.520728+0000","last_active":"2024-05-10T11:20:32.755333+0000","last_peered":"2024-05-10T11:20:32.755333+0000","last_clean":"2024-05-10T11:20:32.755333+0000","last_became_active":"2024-05-10T11:20:31.520440+0000","last_became_peered":"2024-05-10T11:20:31.520440+0000","last_unstale":"2024-05-10T11:20:32.755333+0000","last_undegraded":"2024-05-10T11:20:32.755333+0000","last_fullsized":"2024-05-10T11:20:32.755333+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:26:13.567492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.513188+0000","last_change":"2024-05-10T11:20:31.511070+0000","last_active":"2024-05-10T11:20:31.513188+0000","last_peered":"2024-05-10T11:20:31.513188+0000","last_clean":"2024-05-10T11:20:31.513188+0000","last_became_active":"2024-05-10T11:20:31.510730+0000","last_became_peered":"2024-05-10T11:20:31.510730+0000","last_unstale":"2024-05-10T11:20:31.513188+0000","last_undegraded":"2024-05-10T11:20:31.513188+0000","last_fullsized":"2024-05-10T11:20:31.513188+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:00.675263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.956006+0000","last_change":"2024-05-10T11:20:31.514811+0000","last_active":"2024-05-10T11:20:32.956006+0000","last_peered":"2024-05-10T11:20:32.956006+0000","last_clean":"2024-05-10T11:20:32.956006+0000","last_became_active":"2024-05-10T11:20:31.514219+0000","last_became_peered":"2024-05-10T11:20:31.514219+0000","last_unstale":"2024-05-10T11:20:32.956006+0000","last_undegraded":"2024-05-10T11:20:32.956006+0000","last_fullsized":"2024-05-10T11:20:32.956006+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:47.371556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528339+0000","last_change":"2024-05-10T11:20:31.517672+0000","last_active":"2024-05-10T11:20:31.528339+0000","last_peered":"2024-05-10T11:20:31.528339+0000","last_clean":"2024-05-10T11:20:31.528339+0000","last_became_active":"2024-05-10T11:20:31.517381+0000","last_became_peered":"2024-05-10T11:20:31.517381+0000","last_unstale":"2024-05-10T11:20:31.528339+0000","last_undegraded":"2024-05-10T11:20:31.528339+0000","last_fullsized":"2024-05-10T11:20:31.528339+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:57.441966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515408+0000","last_change":"2024-05-10T11:20:31.519504+0000","last_active":"2024-05-10T11:20:32.515408+0000","last_peered":"2024-05-10T11:20:32.515408+0000","last_clean":"2024-05-10T11:20:32.515408+0000","last_became_active":"2024-05-10T11:20:31.518989+0000","last_became_peered":"2024-05-10T11:20:31.518989+0000","last_unstale":"2024-05-10T11:20:32.515408+0000","last_undegraded":"2024-05-10T11:20:32.515408+0000","last_fullsized":"2024-05-10T11:20:32.515408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:18:21.775187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.508537+0000","last_change":"2024-05-10T11:20:31.505672+0000","last_active":"2024-05-10T11:20:31.508537+0000","last_peered":"2024-05-10T11:20:31.508537+0000","last_clean":"2024-05-10T11:20:31.508537+0000","last_became_active":"2024-05-10T11:20:31.505220+0000","last_became_peered":"2024-05-10T11:20:31.505220+0000","last_unstale":"2024-05-10T11:20:31.508537+0000","last_undegraded":"2024-05-10T11:20:31.508537+0000","last_fullsized":"2024-05-10T11:20:31.508537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:09:54.091893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.514864+0000","last_change":"2024-05-10T11:20:31.517131+0000","last_active":"2024-05-10T11:20:32.514864+0000","last_peered":"2024-05-10T11:20:32.514864+0000","last_clean":"2024-05-10T11:20:32.514864+0000","last_became_active":"2024-05-10T11:20:31.516841+0000","last_became_peered":"2024-05-10T11:20:31.516841+0000","last_unstale":"2024-05-10T11:20:32.514864+0000","last_undegraded":"2024-05-10T11:20:32.514864+0000","last_fullsized":"2024-05-10T11:20:32.514864+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:55.683207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955854+0000","last_change":"2024-05-10T11:20:31.521985+0000","last_active":"2024-05-10T11:20:32.955854+0000","last_peered":"2024-05-10T11:20:32.955854+0000","last_clean":"2024-05-10T11:20:32.955854+0000","last_became_active":"2024-05-10T11:20:31.521386+0000","last_became_peered":"2024-05-10T11:20:31.521386+0000","last_unstale":"2024-05-10T11:20:32.955854+0000","last_undegraded":"2024-05-10T11:20:32.955854+0000","last_fullsized":"2024-05-10T11:20:32.955854+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:55.345468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955943+0000","last_change":"2024-05-10T11:20:31.523766+0000","last_active":"2024-05-10T11:20:32.955943+0000","last_peered":"2024-05-10T11:20:32.955943+0000","last_clean":"2024-05-10T11:20:32.955943+0000","last_became_active":"2024-05-10T11:20:31.523167+0000","last_became_peered":"2024-05-10T11:20:31.523167+0000","last_unstale":"2024-05-10T11:20:32.955943+0000","last_undegraded":"2024-05-10T11:20:32.955943+0000","last_fullsized":"2024-05-10T11:20:32.955943+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:26:13.567492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.516098+0000","last_change":"2024-05-10T11:20:31.510470+0000","last_active":"2024-05-10T11:20:31.516098+0000","last_peered":"2024-05-10T11:20:31.516098+0000","last_clean":"2024-05-10T11:20:31.516098+0000","last_became_active":"2024-05-10T11:20:31.509810+0000","last_became_peered":"2024-05-10T11:20:31.509810+0000","last_unstale":"2024-05-10T11:20:31.516098+0000","last_undegraded":"2024-05-10T11:20:31.516098+0000","last_fullsized":"2024-05-10T11:20:31.516098+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:29.786185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755024+0000","last_change":"2024-05-10T11:20:31.509004+0000","last_active":"2024-05-10T11:20:32.755024+0000","last_peered":"2024-05-10T11:20:32.755024+0000","last_clean":"2024-05-10T11:20:32.755024+0000","last_became_active":"2024-05-10T11:20:31.508694+0000","last_became_peered":"2024-05-10T11:20:31.508694+0000","last_unstale":"2024-05-10T11:20:32.755024+0000","last_undegraded":"2024-05-10T11:20:32.755024+0000","last_fullsized":"2024-05-10T11:20:32.755024+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:15.574388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528378+0000","last_change":"2024-05-10T11:20:31.522335+0000","last_active":"2024-05-10T11:20:31.528378+0000","last_peered":"2024-05-10T11:20:31.528378+0000","last_clean":"2024-05-10T11:20:31.528378+0000","last_became_active":"2024-05-10T11:20:31.521714+0000","last_became_peered":"2024-05-10T11:20:31.521714+0000","last_unstale":"2024-05-10T11:20:31.528378+0000","last_undegraded":"2024-05-10T11:20:31.528378+0000","last_fullsized":"2024-05-10T11:20:31.528378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:55.550364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955904+0000","last_change":"2024-05-10T11:20:31.518136+0000","last_active":"2024-05-10T11:20:32.955904+0000","last_peered":"2024-05-10T11:20:32.955904+0000","last_clean":"2024-05-10T11:20:32.955904+0000","last_became_active":"2024-05-10T11:20:31.517881+0000","last_became_peered":"2024-05-10T11:20:31.517881+0000","last_unstale":"2024-05-10T11:20:32.955904+0000","last_undegraded":"2024-05-10T11:20:32.955904+0000","last_fullsized":"2024-05-10T11:20:32.955904+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:05.276674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.754803+0000","last_change":"2024-05-10T11:20:31.509634+0000","last_active":"2024-05-10T11:20:32.754803+0000","last_peered":"2024-05-10T11:20:32.754803+0000","last_clean":"2024-05-10T11:20:32.754803+0000","last_became_active":"2024-05-10T11:20:31.509348+0000","last_became_peered":"2024-05-10T11:20:31.509348+0000","last_unstale":"2024-05-10T11:20:32.754803+0000","last_undegraded":"2024-05-10T11:20:32.754803+0000","last_fullsized":"2024-05-10T11:20:32.754803+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:57.499526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528515+0000","last_change":"2024-05-10T11:20:31.523957+0000","last_active":"2024-05-10T11:20:31.528515+0000","last_peered":"2024-05-10T11:20:31.528515+0000","last_clean":"2024-05-10T11:20:31.528515+0000","last_became_active":"2024-05-10T11:20:31.521344+0000","last_became_peered":"2024-05-10T11:20:31.521344+0000","last_unstale":"2024-05-10T11:20:31.528515+0000","last_undegraded":"2024-05-10T11:20:31.528515+0000","last_fullsized":"2024-05-10T11:20:31.528515+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:05.456964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.515221+0000","last_change":"2024-05-10T11:20:31.509624+0000","last_active":"2024-05-10T11:20:31.515221+0000","last_peered":"2024-05-10T11:20:31.515221+0000","last_clean":"2024-05-10T11:20:31.515221+0000","last_became_active":"2024-05-10T11:20:31.509324+0000","last_became_peered":"2024-05-10T11:20:31.509324+0000","last_unstale":"2024-05-10T11:20:31.515221+0000","last_undegraded":"2024-05-10T11:20:31.515221+0000","last_fullsized":"2024-05-10T11:20:31.515221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:19.530435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"103'4","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654720+0000","last_change":"2024-05-10T11:20:30.509198+0000","last_active":"2024-05-10T11:20:32.654720+0000","last_peered":"2024-05-10T11:20:32.654720+0000","last_clean":"2024-05-10T11:20:32.654720+0000","last_became_active":"2024-05-10T11:20:30.508930+0000","last_became_peered":"2024-05-10T11:20:30.508930+0000","last_unstale":"2024-05-10T11:20:32.654720+0000","last_undegraded":"2024-05-10T11:20:32.654720+0000","last_fullsized":"2024-05-10T11:20:32.654720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:23.143821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529446+0000","last_change":"2024-05-10T11:20:31.525656+0000","last_active":"2024-05-10T11:20:31.529446+0000","last_peered":"2024-05-10T11:20:31.529446+0000","last_clean":"2024-05-10T11:20:31.529446+0000","last_became_active":"2024-05-10T11:20:31.525338+0000","last_became_peered":"2024-05-10T11:20:31.525338+0000","last_unstale":"2024-05-10T11:20:31.529446+0000","last_undegraded":"2024-05-10T11:20:31.529446+0000","last_fullsized":"2024-05-10T11:20:31.529446+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:55.024780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"103'1","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528371+0000","last_change":"2024-05-10T11:20:30.513644+0000","last_active":"2024-05-10T11:20:31.528371+0000","last_peered":"2024-05-10T11:20:31.528371+0000","last_clean":"2024-05-10T11:20:31.528371+0000","last_became_active":"2024-05-10T11:20:30.513295+0000","last_became_peered":"2024-05-10T11:20:30.513295+0000","last_unstale":"2024-05-10T11:20:31.528371+0000","last_undegraded":"2024-05-10T11:20:31.528371+0000","last_fullsized":"2024-05-10T11:20:31.528371+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:40.359141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955656+0000","last_change":"2024-05-10T11:20:31.526118+0000","last_active":"2024-05-10T11:20:32.955656+0000","last_peered":"2024-05-10T11:20:32.955656+0000","last_clean":"2024-05-10T11:20:32.955656+0000","last_became_active":"2024-05-10T11:20:31.525854+0000","last_became_peered":"2024-05-10T11:20:31.525854+0000","last_unstale":"2024-05-10T11:20:32.955656+0000","last_undegraded":"2024-05-10T11:20:32.955656+0000","last_fullsized":"2024-05-10T11:20:32.955656+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:15.574388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955829+0000","last_change":"2024-05-10T11:20:30.510015+0000","last_active":"2024-05-10T11:20:32.955829+0000","last_peered":"2024-05-10T11:20:32.955829+0000","last_clean":"2024-05-10T11:20:32.955829+0000","last_became_active":"2024-05-10T11:20:30.509732+0000","last_became_peered":"2024-05-10T11:20:30.509732+0000","last_unstale":"2024-05-10T11:20:32.955829+0000","last_undegraded":"2024-05-10T11:20:32.955829+0000","last_fullsized":"2024-05-10T11:20:32.955829+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:58.704005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.524372+0000","last_change":"2024-05-10T11:20:31.520210+0000","last_active":"2024-05-10T11:20:31.524372+0000","last_peered":"2024-05-10T11:20:31.524372+0000","last_clean":"2024-05-10T11:20:31.524372+0000","last_became_active":"2024-05-10T11:20:31.519907+0000","last_became_peered":"2024-05-10T11:20:31.519907+0000","last_unstale":"2024-05-10T11:20:31.524372+0000","last_undegraded":"2024-05-10T11:20:31.524372+0000","last_fullsized":"2024-05-10T11:20:31.524372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:56.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515070+0000","last_change":"2024-05-10T11:20:30.510547+0000","last_active":"2024-05-10T11:20:32.515070+0000","last_peered":"2024-05-10T11:20:32.515070+0000","last_clean":"2024-05-10T11:20:32.515070+0000","last_became_active":"2024-05-10T11:20:30.510268+0000","last_became_peered":"2024-05-10T11:20:30.510268+0000","last_unstale":"2024-05-10T11:20:32.515070+0000","last_undegraded":"2024-05-10T11:20:32.515070+0000","last_fullsized":"2024-05-10T11:20:32.515070+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:48.472113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654787+0000","last_change":"2024-05-10T11:20:31.515417+0000","last_active":"2024-05-10T11:20:32.654787+0000","last_peered":"2024-05-10T11:20:32.654787+0000","last_clean":"2024-05-10T11:20:32.654787+0000","last_became_active":"2024-05-10T11:20:31.515123+0000","last_became_peered":"2024-05-10T11:20:31.515123+0000","last_unstale":"2024-05-10T11:20:32.654787+0000","last_undegraded":"2024-05-10T11:20:32.654787+0000","last_fullsized":"2024-05-10T11:20:32.654787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.941937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857316+0000","last_change":"2024-05-10T11:20:30.511111+0000","last_active":"2024-05-10T11:20:32.857316+0000","last_peered":"2024-05-10T11:20:32.857316+0000","last_clean":"2024-05-10T11:20:32.857316+0000","last_became_active":"2024-05-10T11:20:30.510859+0000","last_became_peered":"2024-05-10T11:20:30.510859+0000","last_unstale":"2024-05-10T11:20:32.857316+0000","last_undegraded":"2024-05-10T11:20:32.857316+0000","last_fullsized":"2024-05-10T11:20:32.857316+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:26.863312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.515940+0000","last_change":"2024-05-10T11:20:31.510842+0000","last_active":"2024-05-10T11:20:31.515940+0000","last_peered":"2024-05-10T11:20:31.515940+0000","last_clean":"2024-05-10T11:20:31.515940+0000","last_became_active":"2024-05-10T11:20:31.510339+0000","last_became_peered":"2024-05-10T11:20:31.510339+0000","last_unstale":"2024-05-10T11:20:31.515940+0000","last_undegraded":"2024-05-10T11:20:31.515940+0000","last_fullsized":"2024-05-10T11:20:31.515940+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:24:21.870694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"103'1","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.521650+0000","last_change":"2024-05-10T11:20:30.508016+0000","last_active":"2024-05-10T11:20:31.521650+0000","last_peered":"2024-05-10T11:20:31.521650+0000","last_clean":"2024-05-10T11:20:31.521650+0000","last_became_active":"2024-05-10T11:20:30.507739+0000","last_became_peered":"2024-05-10T11:20:30.507739+0000","last_unstale":"2024-05-10T11:20:31.521650+0000","last_undegraded":"2024-05-10T11:20:31.521650+0000","last_fullsized":"2024-05-10T11:20:31.521650+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:23.143821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755417+0000","last_change":"2024-05-10T11:20:31.511461+0000","last_active":"2024-05-10T11:20:32.755417+0000","last_peered":"2024-05-10T11:20:32.755417+0000","last_clean":"2024-05-10T11:20:32.755417+0000","last_became_active":"2024-05-10T11:20:31.509754+0000","last_became_peered":"2024-05-10T11:20:31.509754+0000","last_unstale":"2024-05-10T11:20:32.755417+0000","last_undegraded":"2024-05-10T11:20:32.755417+0000","last_fullsized":"2024-05-10T11:20:32.755417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:52.244427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955702+0000","last_change":"2024-05-10T11:20:30.511594+0000","last_active":"2024-05-10T11:20:32.955702+0000","last_peered":"2024-05-10T11:20:32.955702+0000","last_clean":"2024-05-10T11:20:32.955702+0000","last_became_active":"2024-05-10T11:20:30.509645+0000","last_became_peered":"2024-05-10T11:20:30.509645+0000","last_unstale":"2024-05-10T11:20:32.955702+0000","last_undegraded":"2024-05-10T11:20:32.955702+0000","last_fullsized":"2024-05-10T11:20:32.955702+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:28.117980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654652+0000","last_change":"2024-05-10T11:20:31.511359+0000","last_active":"2024-05-10T11:20:32.654652+0000","last_peered":"2024-05-10T11:20:32.654652+0000","last_clean":"2024-05-10T11:20:32.654652+0000","last_became_active":"2024-05-10T11:20:31.511087+0000","last_became_peered":"2024-05-10T11:20:31.511087+0000","last_unstale":"2024-05-10T11:20:32.654652+0000","last_undegraded":"2024-05-10T11:20:32.654652+0000","last_fullsized":"2024-05-10T11:20:32.654652+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:06.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654391+0000","last_change":"2024-05-10T11:20:30.505041+0000","last_active":"2024-05-10T11:20:32.654391+0000","last_peered":"2024-05-10T11:20:32.654391+0000","last_clean":"2024-05-10T11:20:32.654391+0000","last_became_active":"2024-05-10T11:20:30.504761+0000","last_became_peered":"2024-05-10T11:20:30.504761+0000","last_unstale":"2024-05-10T11:20:32.654391+0000","last_undegraded":"2024-05-10T11:20:32.654391+0000","last_fullsized":"2024-05-10T11:20:32.654391+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:28:13.501556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.515197+0000","last_change":"2024-05-10T11:20:31.508306+0000","last_active":"2024-05-10T11:20:31.515197+0000","last_peered":"2024-05-10T11:20:31.515197+0000","last_clean":"2024-05-10T11:20:31.515197+0000","last_became_active":"2024-05-10T11:20:31.508023+0000","last_became_peered":"2024-05-10T11:20:31.508023+0000","last_unstale":"2024-05-10T11:20:31.515197+0000","last_undegraded":"2024-05-10T11:20:31.515197+0000","last_fullsized":"2024-05-10T11:20:31.515197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:20:22.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955869+0000","last_change":"2024-05-10T11:20:30.510685+0000","last_active":"2024-05-10T11:20:32.955869+0000","last_peered":"2024-05-10T11:20:32.955869+0000","last_clean":"2024-05-10T11:20:32.955869+0000","last_became_active":"2024-05-10T11:20:30.510410+0000","last_became_peered":"2024-05-10T11:20:30.510410+0000","last_unstale":"2024-05-10T11:20:32.955869+0000","last_undegraded":"2024-05-10T11:20:32.955869+0000","last_fullsized":"2024-05-10T11:20:32.955869+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:58.267094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.514960+0000","last_change":"2024-05-10T11:20:31.517880+0000","last_active":"2024-05-10T11:20:32.514960+0000","last_peered":"2024-05-10T11:20:32.514960+0000","last_clean":"2024-05-10T11:20:32.514960+0000","last_became_active":"2024-05-10T11:20:31.517480+0000","last_became_peered":"2024-05-10T11:20:31.517480+0000","last_unstale":"2024-05-10T11:20:32.514960+0000","last_undegraded":"2024-05-10T11:20:32.514960+0000","last_fullsized":"2024-05-10T11:20:32.514960+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:06.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.497859+0000","last_change":"2024-05-10T11:20:30.508410+0000","last_active":"2024-05-10T11:20:31.497859+0000","last_peered":"2024-05-10T11:20:31.497859+0000","last_clean":"2024-05-10T11:20:31.497859+0000","last_became_active":"2024-05-10T11:20:30.508150+0000","last_became_peered":"2024-05-10T11:20:30.508150+0000","last_unstale":"2024-05-10T11:20:31.497859+0000","last_undegraded":"2024-05-10T11:20:31.497859+0000","last_fullsized":"2024-05-10T11:20:31.497859+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:09.751122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529671+0000","last_change":"2024-05-10T11:20:31.525784+0000","last_active":"2024-05-10T11:20:31.529671+0000","last_peered":"2024-05-10T11:20:31.529671+0000","last_clean":"2024-05-10T11:20:31.529671+0000","last_became_active":"2024-05-10T11:20:31.525270+0000","last_became_peered":"2024-05-10T11:20:31.525270+0000","last_unstale":"2024-05-10T11:20:31.529671+0000","last_undegraded":"2024-05-10T11:20:31.529671+0000","last_fullsized":"2024-05-10T11:20:31.529671+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:16.834169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"103'3","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857336+0000","last_change":"2024-05-10T11:20:30.510252+0000","last_active":"2024-05-10T11:20:32.857336+0000","last_peered":"2024-05-10T11:20:32.857336+0000","last_clean":"2024-05-10T11:20:32.857336+0000","last_became_active":"2024-05-10T11:20:30.509997+0000","last_became_peered":"2024-05-10T11:20:30.509997+0000","last_unstale":"2024-05-10T11:20:32.857336+0000","last_undegraded":"2024-05-10T11:20:32.857336+0000","last_fullsized":"2024-05-10T11:20:32.857336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:05.035938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515273+0000","last_change":"2024-05-10T11:20:31.520013+0000","last_active":"2024-05-10T11:20:32.515273+0000","last_peered":"2024-05-10T11:20:32.515273+0000","last_clean":"2024-05-10T11:20:32.515273+0000","last_became_active":"2024-05-10T11:20:31.519756+0000","last_became_peered":"2024-05-10T11:20:31.519756+0000","last_unstale":"2024-05-10T11:20:32.515273+0000","last_undegraded":"2024-05-10T11:20:32.515273+0000","last_fullsized":"2024-05-10T11:20:32.515273+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:36.853116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"103'6","reported_seq":20,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755026+0000","last_change":"2024-05-10T11:20:30.512673+0000","last_active":"2024-05-10T11:20:32.755026+0000","last_peered":"2024-05-10T11:20:32.755026+0000","last_clean":"2024-05-10T11:20:32.755026+0000","last_became_active":"2024-05-10T11:20:30.512372+0000","last_became_peered":"2024-05-10T11:20:30.512372+0000","last_unstale":"2024-05-10T11:20:32.755026+0000","last_undegraded":"2024-05-10T11:20:32.755026+0000","last_fullsized":"2024-05-10T11:20:32.755026+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:21.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.517454+0000","last_change":"2024-05-10T11:20:31.515905+0000","last_active":"2024-05-10T11:20:31.517454+0000","last_peered":"2024-05-10T11:20:31.517454+0000","last_clean":"2024-05-10T11:20:31.517454+0000","last_became_active":"2024-05-10T11:20:31.515614+0000","last_became_peered":"2024-05-10T11:20:31.515614+0000","last_unstale":"2024-05-10T11:20:31.517454+0000","last_undegraded":"2024-05-10T11:20:31.517454+0000","last_fullsized":"2024-05-10T11:20:31.517454+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:35:35.827862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515245+0000","last_change":"2024-05-10T11:20:30.515017+0000","last_active":"2024-05-10T11:20:32.515245+0000","last_peered":"2024-05-10T11:20:32.515245+0000","last_clean":"2024-05-10T11:20:32.515245+0000","last_became_active":"2024-05-10T11:20:30.514757+0000","last_became_peered":"2024-05-10T11:20:30.514757+0000","last_unstale":"2024-05-10T11:20:32.515245+0000","last_undegraded":"2024-05-10T11:20:32.515245+0000","last_fullsized":"2024-05-10T11:20:32.515245+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:28.778159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755187+0000","last_change":"2024-05-10T11:20:31.522240+0000","last_active":"2024-05-10T11:20:32.755187+0000","last_peered":"2024-05-10T11:20:32.755187+0000","last_clean":"2024-05-10T11:20:32.755187+0000","last_became_active":"2024-05-10T11:20:31.521972+0000","last_became_peered":"2024-05-10T11:20:31.521972+0000","last_unstale":"2024-05-10T11:20:32.755187+0000","last_undegraded":"2024-05-10T11:20:32.755187+0000","last_fullsized":"2024-05-10T11:20:32.755187+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:05.596922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654464+0000","last_change":"2024-05-10T11:20:30.511062+0000","last_active":"2024-05-10T11:20:32.654464+0000","last_peered":"2024-05-10T11:20:32.654464+0000","last_clean":"2024-05-10T11:20:32.654464+0000","last_became_active":"2024-05-10T11:20:30.510727+0000","last_became_peered":"2024-05-10T11:20:30.510727+0000","last_unstale":"2024-05-10T11:20:32.654464+0000","last_undegraded":"2024-05-10T11:20:32.654464+0000","last_fullsized":"2024-05-10T11:20:32.654464+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:35.670363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528451+0000","last_change":"2024-05-10T11:20:31.522300+0000","last_active":"2024-05-10T11:20:31.528451+0000","last_peered":"2024-05-10T11:20:31.528451+0000","last_clean":"2024-05-10T11:20:31.528451+0000","last_became_active":"2024-05-10T11:20:31.521988+0000","last_became_peered":"2024-05-10T11:20:31.521988+0000","last_unstale":"2024-05-10T11:20:31.528451+0000","last_undegraded":"2024-05-10T11:20:31.528451+0000","last_fullsized":"2024-05-10T11:20:31.528451+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:34.293180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.509075+0000","last_change":"2024-05-10T11:20:30.514950+0000","last_active":"2024-05-10T11:20:31.509075+0000","last_peered":"2024-05-10T11:20:31.509075+0000","last_clean":"2024-05-10T11:20:31.509075+0000","last_became_active":"2024-05-10T11:20:30.514671+0000","last_became_peered":"2024-05-10T11:20:30.514671+0000","last_unstale":"2024-05-10T11:20:31.509075+0000","last_undegraded":"2024-05-10T11:20:31.509075+0000","last_fullsized":"2024-05-10T11:20:31.509075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:41.871808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.514912+0000","last_change":"2024-05-10T11:20:31.510347+0000","last_active":"2024-05-10T11:20:31.514912+0000","last_peered":"2024-05-10T11:20:31.514912+0000","last_clean":"2024-05-10T11:20:31.514912+0000","last_became_active":"2024-05-10T11:20:31.510057+0000","last_became_peered":"2024-05-10T11:20:31.510057+0000","last_unstale":"2024-05-10T11:20:31.514912+0000","last_undegraded":"2024-05-10T11:20:31.514912+0000","last_fullsized":"2024-05-10T11:20:31.514912+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:51.466860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"103'8","reported_seq":22,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955521+0000","last_change":"2024-05-10T11:20:30.511916+0000","last_active":"2024-05-10T11:20:32.955521+0000","last_peered":"2024-05-10T11:20:32.955521+0000","last_clean":"2024-05-10T11:20:32.955521+0000","last_became_active":"2024-05-10T11:20:30.511105+0000","last_became_peered":"2024-05-10T11:20:30.511105+0000","last_unstale":"2024-05-10T11:20:32.955521+0000","last_undegraded":"2024-05-10T11:20:32.955521+0000","last_fullsized":"2024-05-10T11:20:32.955521+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:19.839144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528493+0000","last_change":"2024-05-10T11:20:31.519899+0000","last_active":"2024-05-10T11:20:31.528493+0000","last_peered":"2024-05-10T11:20:31.528493+0000","last_clean":"2024-05-10T11:20:31.528493+0000","last_became_active":"2024-05-10T11:20:31.519642+0000","last_became_peered":"2024-05-10T11:20:31.519642+0000","last_unstale":"2024-05-10T11:20:31.528493+0000","last_undegraded":"2024-05-10T11:20:31.528493+0000","last_fullsized":"2024-05-10T11:20:31.528493+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:27:11.252244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755320+0000","last_change":"2024-05-10T11:20:30.512541+0000","last_active":"2024-05-10T11:20:32.755320+0000","last_peered":"2024-05-10T11:20:32.755320+0000","last_clean":"2024-05-10T11:20:32.755320+0000","last_became_active":"2024-05-10T11:20:30.512203+0000","last_became_peered":"2024-05-10T11:20:30.512203+0000","last_unstale":"2024-05-10T11:20:32.755320+0000","last_undegraded":"2024-05-10T11:20:32.755320+0000","last_fullsized":"2024-05-10T11:20:32.755320+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:25:09.637239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755040+0000","last_change":"2024-05-10T11:20:31.512507+0000","last_active":"2024-05-10T11:20:32.755040+0000","last_peered":"2024-05-10T11:20:32.755040+0000","last_clean":"2024-05-10T11:20:32.755040+0000","last_became_active":"2024-05-10T11:20:31.512236+0000","last_became_peered":"2024-05-10T11:20:31.512236+0000","last_unstale":"2024-05-10T11:20:32.755040+0000","last_undegraded":"2024-05-10T11:20:32.755040+0000","last_fullsized":"2024-05-10T11:20:32.755040+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:55.345468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857458+0000","last_change":"2024-05-10T11:20:30.509680+0000","last_active":"2024-05-10T11:20:32.857458+0000","last_peered":"2024-05-10T11:20:32.857458+0000","last_clean":"2024-05-10T11:20:32.857458+0000","last_became_active":"2024-05-10T11:20:30.509415+0000","last_became_peered":"2024-05-10T11:20:30.509415+0000","last_unstale":"2024-05-10T11:20:32.857458+0000","last_undegraded":"2024-05-10T11:20:32.857458+0000","last_fullsized":"2024-05-10T11:20:32.857458+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:20.997748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515149+0000","last_change":"2024-05-10T11:20:31.517384+0000","last_active":"2024-05-10T11:20:32.515149+0000","last_peered":"2024-05-10T11:20:32.515149+0000","last_clean":"2024-05-10T11:20:32.515149+0000","last_became_active":"2024-05-10T11:20:31.517076+0000","last_became_peered":"2024-05-10T11:20:31.517076+0000","last_unstale":"2024-05-10T11:20:32.515149+0000","last_undegraded":"2024-05-10T11:20:32.515149+0000","last_fullsized":"2024-05-10T11:20:32.515149+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.941937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.499470+0000","last_change":"2024-05-10T11:20:30.507551+0000","last_active":"2024-05-10T11:20:31.499470+0000","last_peered":"2024-05-10T11:20:31.499470+0000","last_clean":"2024-05-10T11:20:31.499470+0000","last_became_active":"2024-05-10T11:20:30.507252+0000","last_became_peered":"2024-05-10T11:20:30.507252+0000","last_unstale":"2024-05-10T11:20:31.499470+0000","last_undegraded":"2024-05-10T11:20:31.499470+0000","last_fullsized":"2024-05-10T11:20:31.499470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:35.670363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.508393+0000","last_change":"2024-05-10T11:20:31.506090+0000","last_active":"2024-05-10T11:20:31.508393+0000","last_peered":"2024-05-10T11:20:31.508393+0000","last_clean":"2024-05-10T11:20:31.508393+0000","last_became_active":"2024-05-10T11:20:31.505691+0000","last_became_peered":"2024-05-10T11:20:31.505691+0000","last_unstale":"2024-05-10T11:20:31.508393+0000","last_undegraded":"2024-05-10T11:20:31.508393+0000","last_fullsized":"2024-05-10T11:20:31.508393+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:29.306415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"103'2","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529309+0000","last_change":"2024-05-10T11:20:30.514537+0000","last_active":"2024-05-10T11:20:31.529309+0000","last_peered":"2024-05-10T11:20:31.529309+0000","last_clean":"2024-05-10T11:20:31.529309+0000","last_became_active":"2024-05-10T11:20:30.514219+0000","last_became_peered":"2024-05-10T11:20:30.514219+0000","last_unstale":"2024-05-10T11:20:31.529309+0000","last_undegraded":"2024-05-10T11:20:31.529309+0000","last_fullsized":"2024-05-10T11:20:31.529309+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:03.979628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528552+0000","last_change":"2024-05-10T11:20:31.519332+0000","last_active":"2024-05-10T11:20:31.528552+0000","last_peered":"2024-05-10T11:20:31.528552+0000","last_clean":"2024-05-10T11:20:31.528552+0000","last_became_active":"2024-05-10T11:20:31.518857+0000","last_became_peered":"2024-05-10T11:20:31.518857+0000","last_unstale":"2024-05-10T11:20:31.528552+0000","last_undegraded":"2024-05-10T11:20:31.528552+0000","last_fullsized":"2024-05-10T11:20:31.528552+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:25.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.509441+0000","last_change":"2024-05-10T11:20:30.515724+0000","last_active":"2024-05-10T11:20:31.509441+0000","last_peered":"2024-05-10T11:20:31.509441+0000","last_clean":"2024-05-10T11:20:31.509441+0000","last_became_active":"2024-05-10T11:20:30.515454+0000","last_became_peered":"2024-05-10T11:20:30.515454+0000","last_unstale":"2024-05-10T11:20:31.509441+0000","last_undegraded":"2024-05-10T11:20:31.509441+0000","last_fullsized":"2024-05-10T11:20:31.509441+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:45:07.044207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654581+0000","last_change":"2024-05-10T11:20:31.513676+0000","last_active":"2024-05-10T11:20:32.654581+0000","last_peered":"2024-05-10T11:20:32.654581+0000","last_clean":"2024-05-10T11:20:32.654581+0000","last_became_active":"2024-05-10T11:20:31.513404+0000","last_became_peered":"2024-05-10T11:20:31.513404+0000","last_unstale":"2024-05-10T11:20:32.654581+0000","last_undegraded":"2024-05-10T11:20:32.654581+0000","last_fullsized":"2024-05-10T11:20:32.654581+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:55.683207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.754930+0000","last_change":"2024-05-10T11:20:30.512720+0000","last_active":"2024-05-10T11:20:32.754930+0000","last_peered":"2024-05-10T11:20:32.754930+0000","last_clean":"2024-05-10T11:20:32.754930+0000","last_became_active":"2024-05-10T11:20:30.512091+0000","last_became_peered":"2024-05-10T11:20:30.512091+0000","last_unstale":"2024-05-10T11:20:32.754930+0000","last_undegraded":"2024-05-10T11:20:32.754930+0000","last_fullsized":"2024-05-10T11:20:32.754930+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:24.846103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529584+0000","last_change":"2024-05-10T11:20:31.528691+0000","last_active":"2024-05-10T11:20:31.529584+0000","last_peered":"2024-05-10T11:20:31.529584+0000","last_clean":"2024-05-10T11:20:31.529584+0000","last_became_active":"2024-05-10T11:20:31.528373+0000","last_became_peered":"2024-05-10T11:20:31.528373+0000","last_unstale":"2024-05-10T11:20:31.529584+0000","last_undegraded":"2024-05-10T11:20:31.529584+0000","last_fullsized":"2024-05-10T11:20:31.529584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:15:41.121148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.512697+0000","last_change":"2024-05-10T11:20:30.511816+0000","last_active":"2024-05-10T11:20:31.512697+0000","last_peered":"2024-05-10T11:20:31.512697+0000","last_clean":"2024-05-10T11:20:31.512697+0000","last_became_active":"2024-05-10T11:20:30.511392+0000","last_became_peered":"2024-05-10T11:20:30.511392+0000","last_unstale":"2024-05-10T11:20:31.512697+0000","last_undegraded":"2024-05-10T11:20:31.512697+0000","last_fullsized":"2024-05-10T11:20:31.512697+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:48.954197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.508460+0000","last_change":"2024-05-10T11:20:31.505847+0000","last_active":"2024-05-10T11:20:31.508460+0000","last_peered":"2024-05-10T11:20:31.508460+0000","last_clean":"2024-05-10T11:20:31.508460+0000","last_became_active":"2024-05-10T11:20:31.505405+0000","last_became_peered":"2024-05-10T11:20:31.505405+0000","last_unstale":"2024-05-10T11:20:31.508460+0000","last_undegraded":"2024-05-10T11:20:31.508460+0000","last_fullsized":"2024-05-10T11:20:31.508460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:42:04.424569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515054+0000","last_change":"2024-05-10T11:20:30.515117+0000","last_active":"2024-05-10T11:20:32.515054+0000","last_peered":"2024-05-10T11:20:32.515054+0000","last_clean":"2024-05-10T11:20:32.515054+0000","last_became_active":"2024-05-10T11:20:30.514849+0000","last_became_peered":"2024-05-10T11:20:30.514849+0000","last_unstale":"2024-05-10T11:20:32.515054+0000","last_undegraded":"2024-05-10T11:20:32.515054+0000","last_fullsized":"2024-05-10T11:20:32.515054+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:35.670363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955543+0000","last_change":"2024-05-10T11:20:31.521268+0000","last_active":"2024-05-10T11:20:32.955543+0000","last_peered":"2024-05-10T11:20:32.955543+0000","last_clean":"2024-05-10T11:20:32.955543+0000","last_became_active":"2024-05-10T11:20:31.520943+0000","last_became_peered":"2024-05-10T11:20:31.520943+0000","last_unstale":"2024-05-10T11:20:32.955543+0000","last_undegraded":"2024-05-10T11:20:32.955543+0000","last_fullsized":"2024-05-10T11:20:32.955543+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:29.549330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"103'1","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.508717+0000","last_change":"2024-05-10T11:20:30.507661+0000","last_active":"2024-05-10T11:20:32.508717+0000","last_peered":"2024-05-10T11:20:32.508717+0000","last_clean":"2024-05-10T11:20:32.508717+0000","last_became_active":"2024-05-10T11:20:30.507391+0000","last_became_peered":"2024-05-10T11:20:30.507391+0000","last_unstale":"2024-05-10T11:20:32.508717+0000","last_undegraded":"2024-05-10T11:20:32.508717+0000","last_fullsized":"2024-05-10T11:20:32.508717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:09.304697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.654521+0000","last_change":"2024-05-10T11:20:31.514107+0000","last_active":"2024-05-10T11:20:32.654521+0000","last_peered":"2024-05-10T11:20:32.654521+0000","last_clean":"2024-05-10T11:20:32.654521+0000","last_became_active":"2024-05-10T11:20:31.513795+0000","last_became_peered":"2024-05-10T11:20:31.513795+0000","last_unstale":"2024-05-10T11:20:32.654521+0000","last_undegraded":"2024-05-10T11:20:32.654521+0000","last_fullsized":"2024-05-10T11:20:32.654521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:30.999521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.755207+0000","last_change":"2024-05-10T11:20:30.511388+0000","last_active":"2024-05-10T11:20:32.755207+0000","last_peered":"2024-05-10T11:20:32.755207+0000","last_clean":"2024-05-10T11:20:32.755207+0000","last_became_active":"2024-05-10T11:20:30.511120+0000","last_became_peered":"2024-05-10T11:20:30.511120+0000","last_unstale":"2024-05-10T11:20:32.755207+0000","last_undegraded":"2024-05-10T11:20:32.755207+0000","last_fullsized":"2024-05-10T11:20:32.755207+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:42:53.040494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.524350+0000","last_change":"2024-05-10T11:20:31.519360+0000","last_active":"2024-05-10T11:20:31.524350+0000","last_peered":"2024-05-10T11:20:31.524350+0000","last_clean":"2024-05-10T11:20:31.524350+0000","last_became_active":"2024-05-10T11:20:31.519023+0000","last_became_peered":"2024-05-10T11:20:31.519023+0000","last_unstale":"2024-05-10T11:20:31.524350+0000","last_undegraded":"2024-05-10T11:20:31.524350+0000","last_fullsized":"2024-05-10T11:20:31.524350+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:59.324923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.515225+0000","last_change":"2024-05-10T11:20:30.513583+0000","last_active":"2024-05-10T11:20:32.515225+0000","last_peered":"2024-05-10T11:20:32.515225+0000","last_clean":"2024-05-10T11:20:32.515225+0000","last_became_active":"2024-05-10T11:20:30.513343+0000","last_became_peered":"2024-05-10T11:20:30.513343+0000","last_unstale":"2024-05-10T11:20:32.515225+0000","last_undegraded":"2024-05-10T11:20:32.515225+0000","last_fullsized":"2024-05-10T11:20:32.515225+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:23.143821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.531062+0000","last_change":"2024-05-10T11:20:31.529781+0000","last_active":"2024-05-10T11:20:31.531062+0000","last_peered":"2024-05-10T11:20:31.531062+0000","last_clean":"2024-05-10T11:20:31.531062+0000","last_became_active":"2024-05-10T11:20:31.529406+0000","last_became_peered":"2024-05-10T11:20:31.529406+0000","last_unstale":"2024-05-10T11:20:31.531062+0000","last_undegraded":"2024-05-10T11:20:31.531062+0000","last_fullsized":"2024-05-10T11:20:31.531062+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:56:51.172423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.955978+0000","last_change":"2024-05-10T11:20:30.511750+0000","last_active":"2024-05-10T11:20:32.955978+0000","last_peered":"2024-05-10T11:20:32.955978+0000","last_clean":"2024-05-10T11:20:32.955978+0000","last_became_active":"2024-05-10T11:20:30.511456+0000","last_became_peered":"2024-05-10T11:20:30.511456+0000","last_unstale":"2024-05-10T11:20:32.955978+0000","last_undegraded":"2024-05-10T11:20:32.955978+0000","last_fullsized":"2024-05-10T11:20:32.955978+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:05.884334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.529364+0000","last_change":"2024-05-10T11:20:31.525562+0000","last_active":"2024-05-10T11:20:31.529364+0000","last_peered":"2024-05-10T11:20:31.529364+0000","last_clean":"2024-05-10T11:20:31.529364+0000","last_became_active":"2024-05-10T11:20:31.525229+0000","last_became_peered":"2024-05-10T11:20:31.525229+0000","last_unstale":"2024-05-10T11:20:31.529364+0000","last_undegraded":"2024-05-10T11:20:31.529364+0000","last_fullsized":"2024-05-10T11:20:31.529364+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:23.594202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.509629+0000","last_change":"2024-05-10T11:20:30.515119+0000","last_active":"2024-05-10T11:20:31.509629+0000","last_peered":"2024-05-10T11:20:31.509629+0000","last_clean":"2024-05-10T11:20:31.509629+0000","last_became_active":"2024-05-10T11:20:30.514851+0000","last_became_peered":"2024-05-10T11:20:30.514851+0000","last_unstale":"2024-05-10T11:20:31.509629+0000","last_undegraded":"2024-05-10T11:20:31.509629+0000","last_fullsized":"2024-05-10T11:20:31.509629+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:52.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857530+0000","last_change":"2024-05-10T11:20:31.511715+0000","last_active":"2024-05-10T11:20:32.857530+0000","last_peered":"2024-05-10T11:20:32.857530+0000","last_clean":"2024-05-10T11:20:32.857530+0000","last_became_active":"2024-05-10T11:20:31.511419+0000","last_became_peered":"2024-05-10T11:20:31.511419+0000","last_unstale":"2024-05-10T11:20:32.857530+0000","last_undegraded":"2024-05-10T11:20:32.857530+0000","last_fullsized":"2024-05-10T11:20:32.857530+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:52.244427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.754994+0000","last_change":"2024-05-10T11:20:30.510911+0000","last_active":"2024-05-10T11:20:32.754994+0000","last_peered":"2024-05-10T11:20:32.754994+0000","last_clean":"2024-05-10T11:20:32.754994+0000","last_became_active":"2024-05-10T11:20:30.510603+0000","last_became_peered":"2024-05-10T11:20:30.510603+0000","last_unstale":"2024-05-10T11:20:32.754994+0000","last_undegraded":"2024-05-10T11:20:32.754994+0000","last_fullsized":"2024-05-10T11:20:32.754994+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:46.150382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.513603+0000","last_change":"2024-05-10T11:20:31.509347+0000","last_active":"2024-05-10T11:20:31.513603+0000","last_peered":"2024-05-10T11:20:31.513603+0000","last_clean":"2024-05-10T11:20:31.513603+0000","last_became_active":"2024-05-10T11:20:31.509074+0000","last_became_peered":"2024-05-10T11:20:31.509074+0000","last_unstale":"2024-05-10T11:20:31.513603+0000","last_undegraded":"2024-05-10T11:20:31.513603+0000","last_fullsized":"2024-05-10T11:20:31.513603+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:49.480139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.512865+0000","last_change":"2024-05-10T11:20:30.517489+0000","last_active":"2024-05-10T11:20:31.512865+0000","last_peered":"2024-05-10T11:20:31.512865+0000","last_clean":"2024-05-10T11:20:31.512865+0000","last_became_active":"2024-05-10T11:20:30.517293+0000","last_became_peered":"2024-05-10T11:20:30.517293+0000","last_unstale":"2024-05-10T11:20:31.512865+0000","last_undegraded":"2024-05-10T11:20:31.512865+0000","last_fullsized":"2024-05-10T11:20:31.512865+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:49.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.521250+0000","last_change":"2024-05-10T11:20:31.516844+0000","last_active":"2024-05-10T11:20:31.521250+0000","last_peered":"2024-05-10T11:20:31.521250+0000","last_clean":"2024-05-10T11:20:31.521250+0000","last_became_active":"2024-05-10T11:20:31.516570+0000","last_became_peered":"2024-05-10T11:20:31.516570+0000","last_unstale":"2024-05-10T11:20:31.521250+0000","last_undegraded":"2024-05-10T11:20:31.521250+0000","last_fullsized":"2024-05-10T11:20:31.521250+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:30.486426+0000","last_clean_scrub_stamp":"2024-05-10T11:20:30.486426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:56.625250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"103'2","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T11:20:31.528305+0000","last_change":"2024-05-10T11:20:30.511011+0000","last_active":"2024-05-10T11:20:31.528305+0000","last_peered":"2024-05-10T11:20:31.528305+0000","last_clean":"2024-05-10T11:20:31.528305+0000","last_became_active":"2024-05-10T11:20:30.510713+0000","last_became_peered":"2024-05-10T11:20:30.510713+0000","last_unstale":"2024-05-10T11:20:31.528305+0000","last_undegraded":"2024-05-10T11:20:31.528305+0000","last_fullsized":"2024-05-10T11:20:31.528305+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:20:29.478400+0000","last_clean_scrub_stamp":"2024-05-10T11:20:29.478400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:34.505493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":267,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-10T11:20:32.857256+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:20:32.857256+0000","last_peered":"2024-05-10T11:20:32.857256+0000","last_clean":"2024-05-10T11:20:32.857256+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:20:32.857256+0000","last_undegraded":"2024-05-10T11:20:32.857256+0000","last_fullsized":"2024-05-10T11:20:32.857256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1884160,"data_stored":1184265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1302528,"data_stored":595953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":593829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542247,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":587627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542248,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":587079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542247,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":587079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542247,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1880064,"data_stored":1179115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1257472,"data_stored":579878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:20:35.921 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:20:35.921 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:20:36.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.068+0000 7f76dbb24640 1 Processor -- start 2024-05-10T11:20:36.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.069+0000 7f76dbb24640 1 -- start start 2024-05-10T11:20:36.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.069+0000 7f76dbb24640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76d40cf3e0 0x7f76d40cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.069+0000 7f76dbb24640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.069+0000 7f76dbb24640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d406e720 con 0x7f76d40cd500 2024-05-10T11:20:36.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.069+0000 7f76dbb24640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f76d406de80 con 0x7f76d40cf3e0 2024-05-10T11:20:36.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.069+0000 7f76dbb24640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76d406e160 con 0x7f76d40d2190 2024-05-10T11:20:36.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d90bf640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f76d40cd500 0x7f76d40b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55814/0 (socket says 172.21.15.66:55814) 2024-05-10T11:20:36.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d90bf640 1 -- 172.21.15.66:0/220268392 learned_addr learned my addr 172.21.15.66:0/220268392 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:36.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76da0c1640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d98c0640 1 --2- 172.21.15.66:0/220268392 >> v2:172.21.15.190:3300/0 conn(0x7f76d40cf3e0 0x7f76d40cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d88be640 1 -- 172.21.15.66:0/220268392 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625640899 0 0) 0x7f76d406e720 con 0x7f76d40cd500 2024-05-10T11:20:36.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d88be640 1 -- 172.21.15.66:0/220268392 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc003520 con 0x7f76d40cd500 2024-05-10T11:20:36.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d98c0640 1 -- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 msgr2=0x7f76d40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:36.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d98c0640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d98c0640 1 -- 172.21.15.66:0/220268392 >> v1:172.21.15.66:6789/0 conn(0x7f76d40cd500 legacy=0x7f76d40b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76d98c0640 1 -- 172.21.15.66:0/220268392 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d406e440 con 0x7f76d40cf3e0 2024-05-10T11:20:36.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.070+0000 7f76da0c1640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:36.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.071+0000 7f76d98c0640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40cf8c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83be1a305c5c748d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:36.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.071+0000 7f76d88be640 1 -- 172.21.15.66:0/220268392 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007740 con 0x7f76d40cf3e0 2024-05-10T11:20:36.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.071+0000 7f76d88be640 1 -- 172.21.15.66:0/220268392 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40078e0 con 0x7f76d40cf3e0 2024-05-10T11:20:36.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.071+0000 7f76d88be640 1 -- 172.21.15.66:0/220268392 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007cb0 con 0x7f76d40cf3e0 2024-05-10T11:20:36.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 -- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 msgr2=0x7f76d40cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40cf8c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c402a660 comp rx=0 tx=0).stop 2024-05-10T11:20:36.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 -- 172.21.15.66:0/220268392 shutdown_connections 2024-05-10T11:20:36.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 --2- 172.21.15.66:0/220268392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40cf8c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 -- 172.21.15.66:0/220268392 >> 172.21.15.66:0/220268392 conn(0x7f76d40d2eb0 msgr2=0x7f76d40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:36.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 -- 172.21.15.66:0/220268392 shutdown_connections 2024-05-10T11:20:36.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.072+0000 7f76dbb24640 1 -- 172.21.15.66:0/220268392 wait complete. 2024-05-10T11:20:36.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.073+0000 7f76dbb24640 1 Processor -- start 2024-05-10T11:20:36.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.073+0000 7f76dbb24640 1 -- start start 2024-05-10T11:20:36.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76dbb24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 0x7f76d41f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76dbb24640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76dbb24640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76dbb24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40b34e0 con 0x7f76d40cd500 2024-05-10T11:20:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76dbb24640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40b4510 con 0x7f76d40cf3e0 2024-05-10T11:20:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76dbb24640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76d40b3660 con 0x7f76d40d2190 2024-05-10T11:20:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 0x7f76d41f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 0x7f76d41f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54696/0 (socket says 172.21.15.66:54696) 2024-05-10T11:20:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 -- 172.21.15.66:0/2214537911 learned_addr learned my addr 172.21.15.66:0/2214537911 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d90bf640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 -- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 msgr2=0x7f76d40a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76da0c1640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 -- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 msgr2=0x7f76d40c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 -- 172.21.15.66:0/2214537911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d41f8460 con 0x7f76d40cd500 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d90bf640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76da0c1640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.074+0000 7f76d98c0640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 0x7f76d41f43b0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.075+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4040070 con 0x7f76d40cd500 2024-05-10T11:20:36.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.075+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4031c40 con 0x7f76d40cd500 2024-05-10T11:20:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.075+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d41f8740 con 0x7f76d40cd500 2024-05-10T11:20:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.075+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4009450 con 0x7f76d40cd500 2024-05-10T11:20:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.075+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41f8d00 con 0x7f76d40cd500 2024-05-10T11:20:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.076+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d406a220 con 0x7f76d40cd500 2024-05-10T11:20:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.076+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f76c4039040 con 0x7f76d40cd500 2024-05-10T11:20:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.077+0000 7f76d27fc640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76c00762d0 0x7f76c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.077+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f76c40b8f80 con 0x7f76d40cd500 2024-05-10T11:20:36.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.077+0000 7f76d90bf640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76c00762d0 0x7f76c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.077+0000 7f76d90bf640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76c00762d0 0x7f76c0078790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f76d40ccf90 tx=0x7f76c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:36.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.081+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f76c4082750 con 0x7f76d40cd500 2024-05-10T11:20:36.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.346+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f76d40b2dd0 con 0x7f76d40cd500 2024-05-10T11:20:36.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.348+0000 7f76d27fc640 1 -- 172.21.15.66:0/2214537911 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f76c4082050 con 0x7f76d40cd500 2024-05-10T11:20:36.349 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:20:36.349 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:20:36.349 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:20:36.349 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:20:36.349 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:20:36.349 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76c00762d0 msgr2=0x7f76c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76c00762d0 0x7f76c0078790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f76d40ccf90 tx=0x7f76c8009040 comp rx=0 tx=0).stop 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 msgr2=0x7f76d41f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 0x7f76d41f43b0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c4004a40 comp rx=0 tx=0).stop 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 shutdown_connections 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f76c00762d0 0x7f76c0078790 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76d40d2190 0x7f76d40a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76d40cf3e0 0x7f76d40c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 --2- 172.21.15.66:0/2214537911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d40cd500 0x7f76d41f43b0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 >> 172.21.15.66:0/2214537911 conn(0x7f76d40d2eb0 msgr2=0x7f76d40711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:36.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 shutdown_connections 2024-05-10T11:20:36.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.351+0000 7f76dbb24640 1 -- 172.21.15.66:0/2214537911 wait complete. 2024-05-10T11:20:36.363 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:36.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.466+0000 7fe509a45640 1 Processor -- start 2024-05-10T11:20:36.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.466+0000 7fe509a45640 1 -- start start 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.467+0000 7fe509a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 0x7fe5040d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.467+0000 7fe509a45640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5040d30b0 con 0x7fe50415f790 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.467+0000 7fe509a45640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5040d3390 con 0x7fe5040d5d30 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.467+0000 7fe509a45640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5040c8c80 con 0x7fe50415f3b0 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.467+0000 7fe5027fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe50415f790 0x7fe5040c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55828/0 (socket says 172.21.15.66:55828) 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe5027fc640 1 -- 172.21.15.66:0/682697723 learned_addr learned my addr 172.21.15.66:0/682697723 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:36.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe502ffd640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 0x7fe5040d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650643063 0 0) 0x7fe5040d30b0 con 0x7fe50415f790 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f0003520 con 0x7fe50415f790 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615471586 0 0) 0x7fe5040d3390 con 0x7fe5040d5d30 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5040d30b0 con 0x7fe5040d5d30 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316119512 0 0) 0x7fe4f0003520 con 0x7fe50415f790 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 msgr2=0x7fe5040d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 0x7fe5040d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 >> v1:172.21.15.190:6789/0 conn(0x7fe5040d5d30 legacy=0x7fe5040d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5040c8f60 con 0x7fe50415f790 2024-05-10T11:20:36.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe4ec001670 con 0x7fe50415f790 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 >> v1:172.21.15.66:6789/0 conn(0x7fe50415f790 legacy=0x7fe5040c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 0x7fe4f0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f00040d0 0x7fe4f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe4f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5040c8c80 con 0x7fe4f0004d40 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f000baa0 con 0x7fe4f00040d0 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f000bca0 con 0x7fe50415f3b0 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe5037fe640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe4f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe502ffd640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 0x7fe4f0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.468+0000 7fe5027fc640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f00040d0 0x7fe4f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.469+0000 7fe5037fe640 1 -- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 msgr2=0x7fe4f0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.469+0000 7fe5037fe640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe50415f3b0 0x7fe4f0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.469+0000 7fe5037fe640 1 -- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f00040d0 msgr2=0x7fe4f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.469+0000 7fe5037fe640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f00040d0 0x7fe4f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.469+0000 7fe5037fe640 1 -- 172.21.15.66:0/682697723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f0003520 con 0x7fe4f0004d40 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.469+0000 7fe5037fe640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe4f00051c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc001fa0 tx=0x7fe4f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcbefc084a58c8e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc001bf0 con 0x7fe4f0004d40 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4fc003b70 con 0x7fe4f0004d40 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe501ffb640 1 -- 172.21.15.66:0/682697723 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0050d0 con 0x7fe4f0004d40 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe509a45640 1 -- 172.21.15.66:0/682697723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 msgr2=0x7fe4f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe509a45640 1 --2- 172.21.15.66:0/682697723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe4f00051c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc001fa0 tx=0x7fe4f0005830 comp rx=0 tx=0).stop 2024-05-10T11:20:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe5037fe640 1 -- 172.21.15.66:0/682697723 reap_dead start 2024-05-10T11:20:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe509a45640 1 -- 172.21.15.66:0/682697723 shutdown_connections 2024-05-10T11:20:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe509a45640 1 -- 172.21.15.66:0/682697723 >> 172.21.15.66:0/682697723 conn(0x7fe5040d5130 msgr2=0x7fe5040d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe509a45640 1 -- 172.21.15.66:0/682697723 shutdown_connections 2024-05-10T11:20:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.470+0000 7fe509a45640 1 -- 172.21.15.66:0/682697723 wait complete. 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.471+0000 7fe509a45640 1 Processor -- start 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 -- start start 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe5041f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5041f8640 0x7fe5041f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5041f5470 0x7fe5041586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5040d3870 con 0x7fe4f0004d40 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5040d36f0 con 0x7fe5041f8640 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe509a45640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5040d39f0 con 0x7fe5041f5470 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe502ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe5041f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe502ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe5041f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54710/0 (socket says 172.21.15.66:54710) 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.472+0000 7fe502ffd640 1 -- 172.21.15.66:0/883790495 learned_addr learned my addr 172.21.15.66:0/883790495 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:36.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe5027fc640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5041f8640 0x7fe5041f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe502ffd640 1 -- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5041f5470 msgr2=0x7fe5041586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe502ffd640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5041f5470 0x7fe5041586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe502ffd640 1 -- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5041f8640 msgr2=0x7fe5041f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe502ffd640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5041f8640 0x7fe5041f4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe502ffd640 1 -- 172.21.15.66:0/883790495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5041f5ef0 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe502ffd640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe5041f8ee0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4011920 tx=0x7fe4f4011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400faf0 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f400fc90 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5041f5930 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4014440 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.473+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe504160c70 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.474+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50406a220 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.475+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe4f4012040 con 0x7fe4f0004d40 2024-05-10T11:20:36.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.475+0000 7fe4fbfff640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4e4076300 0x7fe4e40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:36.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.475+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fe4f4097d30 con 0x7fe4f0004d40 2024-05-10T11:20:36.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.475+0000 7fe5027fc640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4e4076300 0x7fe4e40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:36.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.476+0000 7fe5027fc640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4e4076300 0x7fe4e40787c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe504154db0 tx=0x7fe4ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:36.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.479+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe4f4019030 con 0x7fe4f0004d40 2024-05-10T11:20:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.714+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe50415c250 con 0x7fe4f0004d40 2024-05-10T11:20:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.715+0000 7fe4fbfff640 1 -- 172.21.15.66:0/883790495 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5183 (secure 0 0 0) 0x7fe4f4061500 con 0x7fe4f0004d40 2024-05-10T11:20:36.716 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:36.716 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":83,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:20:33.886520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/159674733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":159674733},{"type":"v1","addr":"172.21.15.66:6835","nonce":159674733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7647,"qdb_cluster":[7647]},"id":7}]} 2024-05-10T11:20:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 83 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4e4076300 msgr2=0x7fe4e40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4e4076300 0x7fe4e40787c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe504154db0 tx=0x7fe4ec009040 comp rx=0 tx=0).stop 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 msgr2=0x7fe5041f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe5041f8ee0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4011920 tx=0x7fe4f4011de0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 shutdown_connections 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe4e4076300 0x7fe4e40787c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5041f5470 0x7fe5041586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5041f8640 0x7fe5041f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 --2- 172.21.15.66:0/883790495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4f0004d40 0x7fe5041f8ee0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 >> 172.21.15.66:0/883790495 conn(0x7fe5040d5130 msgr2=0x7fe5040d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 shutdown_connections 2024-05-10T11:20:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:36.717+0000 7fe509a45640 1 -- 172.21.15.66:0/883790495 wait complete. 2024-05-10T11:20:37.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:20:30.866393+0000', 'modified': '2024-05-10T11:20:33.886520+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7647}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7647': {'gid': 7647, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6835/159674733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 159674733}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 159674733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7647, 'qdb_cluster': [7647]} 2024-05-10T11:20:37.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:20:37.133 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T11:20:37.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.241+0000 7f1163778640 1 Processor -- start 2024-05-10T11:20:37.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.241+0000 7f1163778640 1 -- start start 2024-05-10T11:20:37.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1163778640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f115c06c990 0x7f115c163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1163778640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c163ba0 con 0x7f115c070bd0 2024-05-10T11:20:37.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1163778640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c160190 con 0x7f115c15f620 2024-05-10T11:20:37.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1163778640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f115c06cd70 con 0x7f115c06c990 2024-05-10T11:20:37.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161514640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f115c06c990 0x7f115c163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161514640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f115c06c990 0x7f115c163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54716/0 (socket says 172.21.15.66:54716) 2024-05-10T11:20:37.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161514640 1 -- 172.21.15.66:0/1081767288 learned_addr learned my addr 172.21.15.66:0/1081767288 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161d15640 1 --1- 172.21.15.66:0/1081767288 >> v1:172.21.15.66:6789/0 conn(0x7f115c070bd0 0x7f115c0cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55830/0 (socket says 172.21.15.66:55830) 2024-05-10T11:20:37.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161514640 1 -- 172.21.15.66:0/1081767288 >> v1:172.21.15.190:6789/0 conn(0x7f115c15f620 legacy=0x7f115c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161514640 1 -- 172.21.15.66:0/1081767288 >> v1:172.21.15.66:6789/0 conn(0x7f115c070bd0 legacy=0x7f115c0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1153fff640 1 -- 172.21.15.66:0/1081767288 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329695532 0 0) 0x7f115c163ba0 con 0x7f115c070bd0 2024-05-10T11:20:37.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.242+0000 7f1161514640 1 -- 172.21.15.66:0/1081767288 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c160470 con 0x7f115c06c990 2024-05-10T11:20:37.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.243+0000 7f1161514640 1 --2- 172.21.15.66:0/1081767288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c163660 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1158009870 tx=0x7f115802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cd56aafeb54bfe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.243+0000 7f1153fff640 1 -- 172.21.15.66:0/1081767288 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158037070 con 0x7f115c06c990 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.243+0000 7f1153fff640 1 -- 172.21.15.66:0/1081767288 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1158032440 con 0x7f115c06c990 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.243+0000 7f1153fff640 1 -- 172.21.15.66:0/1081767288 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158032810 con 0x7f115c06c990 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 -- 172.21.15.66:0/1081767288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 msgr2=0x7f115c163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 --2- 172.21.15.66:0/1081767288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c163660 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1158009870 tx=0x7f115802a2a0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 -- 172.21.15.66:0/1081767288 shutdown_connections 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 --2- 172.21.15.66:0/1081767288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c163660 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 -- 172.21.15.66:0/1081767288 >> 172.21.15.66:0/1081767288 conn(0x7f115c0b3980 msgr2=0x7f115c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 -- 172.21.15.66:0/1081767288 shutdown_connections 2024-05-10T11:20:37.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.244+0000 7f1163778640 1 -- 172.21.15.66:0/1081767288 wait complete. 2024-05-10T11:20:37.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.245+0000 7f1163778640 1 Processor -- start 2024-05-10T11:20:37.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.245+0000 7f1163778640 1 -- start start 2024-05-10T11:20:37.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1163778640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1163778640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f115c070bd0 0x7f115c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1163778640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f115c15f620 0x7f115c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1163778640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f115c073e70 con 0x7f115c06c990 2024-05-10T11:20:37.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1163778640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f115c163140 con 0x7f115c070bd0 2024-05-10T11:20:37.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1163778640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f115c15fab0 con 0x7f115c15f620 2024-05-10T11:20:37.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c0b05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54726/0 (socket says 172.21.15.66:54726) 2024-05-10T11:20:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 -- 172.21.15.66:0/1408009191 learned_addr learned my addr 172.21.15.66:0/1408009191 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161d15640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f115c15f620 0x7f115c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1160d13640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f115c070bd0 0x7f115c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 -- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f115c15f620 msgr2=0x7f115c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f115c15f620 0x7f115c15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 -- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f115c070bd0 msgr2=0x7f115c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f115c070bd0 0x7f115c1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1161514640 1 -- 172.21.15.66:0/1408009191 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c15a800 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.246+0000 7f1160d13640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f115c070bd0 0x7f115c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.247+0000 7f1161514640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c0b05b0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1158000c00 tx=0x7f11580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.247+0000 7f1151ffb640 1 -- 172.21.15.66:0/1408009191 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158041070 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.247+0000 7f1151ffb640 1 -- 172.21.15.66:0/1408009191 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115803c870 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.247+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c15aae0 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.247+0000 7f1151ffb640 1 -- 172.21.15.66:0/1408009191 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158037040 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.247+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c15b0a0 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.249+0000 7f1151ffb640 1 -- 172.21.15.66:0/1408009191 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1158044070 con 0x7f115c06c990 2024-05-10T11:20:37.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.249+0000 7f1151ffb640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11400762d0 0x7f1140078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.249+0000 7f1151ffb640 1 -- 172.21.15.66:0/1408009191 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f11580b8260 con 0x7f115c06c990 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.249+0000 7f1160d13640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11400762d0 0x7f1140078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.250+0000 7f1166569740 1 Processor -- start 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.250+0000 7f1160d13640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11400762d0 0x7f1140078790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f114c006fd0 tx=0x7f114c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.250+0000 7f1166569740 1 -- start start 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1166569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 0x5623565af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565ad330 0x5623565afca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56235657fbb0 0x5623565833c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1166569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5623564e98d0 con 0x5623565acf50 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5623564a2c10 con 0x5623565ad330 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5623564e5890 con 0x56235657fbb0 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 0x5623565af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 0x5623565af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54732/0 (socket says 172.21.15.66:54732) 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 -- 172.21.15.66:0/632584477 learned_addr learned my addr 172.21.15.66:0/632584477 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1160d13640 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565ad330 0x5623565afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161d15640 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56235657fbb0 0x5623565833c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 -- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56235657fbb0 msgr2=0x5623565833c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56235657fbb0 0x5623565833c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 -- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565ad330 msgr2=0x5623565afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565ad330 0x5623565afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 -- 172.21.15.66:0/632584477 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623564aa5d0 con 0x5623565acf50 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1160d13640 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565ad330 0x5623565afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1161514640 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 0x5623565af760 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f115807d920 tx=0x7f115807d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e412d73b919965c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1146ffd640 1 -- 172.21.15.66:0/632584477 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115804b040 con 0x5623565acf50 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1146ffd640 1 -- 172.21.15.66:0/632584477 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1158081a30 con 0x5623565acf50 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.251+0000 7f1146ffd640 1 -- 172.21.15.66:0/632584477 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158081790 con 0x5623565acf50 2024-05-10T11:20:37.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 -- 172.21.15.66:0/632584477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 msgr2=0x5623565af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 0x5623565af760 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f115807d920 tx=0x7f115807d320 comp rx=0 tx=0).stop 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 -- 172.21.15.66:0/632584477 shutdown_connections 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56235657fbb0 0x5623565833c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565ad330 0x5623565afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 --2- 172.21.15.66:0/632584477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565acf50 0x5623565af760 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 -- 172.21.15.66:0/632584477 >> 172.21.15.66:0/632584477 conn(0x562356581e20 msgr2=0x5623565ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 -- 172.21.15.66:0/632584477 shutdown_connections 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.252+0000 7f1166569740 1 -- 172.21.15.66:0/632584477 wait complete. 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.253+0000 7f1166569740 1 -- start start 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.253+0000 7f1166569740 1 Processor -- start 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x5623565c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562356584fd0 con 0x5623565ad330 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5623564a6760 con 0x5623565c6df0 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5623565852b0 con 0x5623565acf50 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 10 client.0 _ll_register_callbacks cb 0x5623564dfcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54742/0 (socket says 172.21.15.66:54742) 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 -- 172.21.15.66:0/3873107590 learned_addr learned my addr 172.21.15.66:0/3873107590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1161d15640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1161514640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x5623565c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 -- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 msgr2=0x5623565c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x5623565c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 -- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 msgr2=0x5623565ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 -- 172.21.15.66:0/3873107590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623561fb2d0 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1160d13640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c5190 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f114c00de80 tx=0x7f114c004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecd2393008383b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f113bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f113bfff640 1 -- 172.21.15.66:0/3873107590 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c014e40 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f113bfff640 1 -- 172.21.15.66:0/3873107590 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f114c0125f0 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.254+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1158081a30 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f113bfff640 1 -- 172.21.15.66:0/3873107590 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f114c005910 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 10 client.7779 fetch_fsmap learned FSMap version 83 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5623562c56b0 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f113bfff640 1 -- 172.21.15.66:0/3873107590 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1158081a30 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f113bfff640 1 -- 172.21.15.66:0/3873107590 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f114c02f080 con 0x5623565ad330 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 10 client.7779 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 10 client.7779 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 20 client.7779 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:37.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565cdfe0 0x5623565ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 4 client.7779 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56235646d760 con 0x5623565cdfe0 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1161514640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565cdfe0 0x5623565ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f113bfff640 10 client.7779 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.255+0000 7f1161514640 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565cdfe0 0x5623565ce3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68648a739fead336 server_cookie=593b3d731b94885 in_seq=0 out_seq=0 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f113bfff640 1 -- 172.21.15.66:0/3873107590 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56235646d760 con 0x5623565cdfe0 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f113bfff640 10 client.7779 handle_command_reply: tid=0 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 client.7779 shutdown 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 msgr2=0x5623565c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c5190 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f114c00de80 tx=0x7f114c004680 comp rx=0 tx=0).stop 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 shutdown_connections 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565cdfe0 0x5623565ce3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c5190 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 --2- 172.21.15.66:0/3873107590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x5623565c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f113bfff640 0 client.7779 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 >> 172.21.15.66:0/3873107590 conn(0x56235657fbb0 msgr2=0x562356584670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 shutdown_connections 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.256+0000 7f1166569740 1 -- 172.21.15.66:0/3873107590 wait complete. 2024-05-10T11:20:37.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.257+0000 7f1166569740 20 client.7779 trim_cache size 0 max 16384 2024-05-10T11:20:37.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.275+0000 7f1166569740 1 Processor -- start 2024-05-10T11:20:37.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.275+0000 7f1166569740 1 -- start start 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565acf50 0x56235663f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1166569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565c6df0 0x5623565c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1166569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f115c200e40 con 0x5623565ad330 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f115c15ebf0 con 0x5623565acf50 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f115c200820 con 0x5623565c6df0 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54754/0 (socket says 172.21.15.66:54754) 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 -- 172.21.15.66:0/2466903371 learned_addr learned my addr 172.21.15.66:0/2466903371 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1161514640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565acf50 0x56235663f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1161d15640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565c6df0 0x5623565c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 -- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565c6df0 msgr2=0x5623565c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565c6df0 0x5623565c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 -- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565acf50 msgr2=0x56235663f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565acf50 0x56235663f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1160d13640 1 -- 172.21.15.66:0/2466903371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623565c2490 con 0x5623565ad330 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1161514640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565acf50 0x56235663f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.276+0000 7f1161d15640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565c6df0 0x5623565c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1160d13640 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c1640 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f114c012750 tx=0x7f114c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce660d61e26d556 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f11467fc640 1 -- 172.21.15.66:0/2466903371 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c0129f0 con 0x5623565ad330 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f11467fc640 1 -- 172.21.15.66:0/2466903371 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c024070 con 0x5623565ad330 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f11467fc640 1 -- 172.21.15.66:0/2466903371 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c012db0 con 0x5623565ad330 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 -- 172.21.15.66:0/2466903371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 msgr2=0x5623565c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c1640 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f114c012750 tx=0x7f114c01d000 comp rx=0 tx=0).stop 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 -- 172.21.15.66:0/2466903371 shutdown_connections 2024-05-10T11:20:37.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565c6df0 0x5623565c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565c1640 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 --2- 172.21.15.66:0/2466903371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565acf50 0x56235663f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 -- 172.21.15.66:0/2466903371 >> 172.21.15.66:0/2466903371 conn(0x56235657fbb0 msgr2=0x562356585be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 -- 172.21.15.66:0/2466903371 shutdown_connections 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.277+0000 7f1166569740 1 -- 172.21.15.66:0/2466903371 wait complete. 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.278+0000 7f1166569740 1 -- start start 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.278+0000 7f1166569740 1 Processor -- start 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x56235663d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5623565a3f80 con 0x5623565ad330 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5623565cc380 con 0x5623565c6df0 2024-05-10T11:20:37.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5623565a3710 con 0x5623565acf50 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1166569740 10 client.0 _ll_register_callbacks cb 0x7f114c0095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565d23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54766/0 (socket says 172.21.15.66:54766) 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 -- 172.21.15.66:0/2007546438 learned_addr learned my addr 172.21.15.66:0/2007546438 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1161514640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x56235663d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1161d15640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 -- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 msgr2=0x56235663d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x56235663d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 -- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 msgr2=0x5623565d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.279+0000 7f1160d13640 1 -- 172.21.15.66:0/2007546438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623565ef0d0 con 0x5623565ad330 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1160d13640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565d23e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f114c016010 tx=0x7f114c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785a1c28e676e28c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f113bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:37.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f113bfff640 1 -- 172.21.15.66:0/2007546438 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c037880 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f113bfff640 1 -- 172.21.15.66:0/2007546438 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f114c042cc0 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f114c024070 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f113bfff640 1 -- 172.21.15.66:0/2007546438 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f114c037a20 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 10 client.7785 fetch_fsmap learned FSMap version 83 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x56235657af40 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f113bfff640 1 -- 172.21.15.66:0/2007546438 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c024070 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f113bfff640 1 -- 172.21.15.66:0/2007546438 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f114c02f040 con 0x5623565ad330 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 10 client.7785 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 10 client.7785 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 20 client.7785 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565b2ce0 0x5623565ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 4 client.7785 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "status"}) -- 0x5623565ca550 con 0x5623565b2ce0 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.280+0000 7f1161514640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565b2ce0 0x5623565ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f113bfff640 10 client.7785 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1161514640 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565b2ce0 0x5623565ca760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=630be01eb5201228 server_cookie=1a4b833f3dfdcb7b in_seq=0 out_seq=0 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f113bfff640 1 -- 172.21.15.66:0/2007546438 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5623565ca550 con 0x5623565b2ce0 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f113bfff640 10 client.7785 handle_command_reply: tid=0 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 client.7785 shutdown 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 msgr2=0x5623565d23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565d23e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f114c016010 tx=0x7f114c014000 comp rx=0 tx=0).stop 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 shutdown_connections 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5623565b2ce0 0x5623565ca760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623565c6df0 0x5623565d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623565ad330 0x5623565d23e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f113bfff640 0 client.7785 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 --2- 172.21.15.66:0/2007546438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623565acf50 0x56235663d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 >> 172.21.15.66:0/2007546438 conn(0x56235657fbb0 msgr2=0x5623565c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 shutdown_connections 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 1 -- 172.21.15.66:0/2007546438 wait complete. 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.281+0000 7f1166569740 20 client.7785 trim_cache size 0 max 16384 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:20:37.290 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 7647, 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 5.7874494509999996, 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 83, 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 104, 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 104, 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 10.761207097 2024-05-10T11:20:37.291 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11400762d0 msgr2=0x7f1140078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11400762d0 0x7f1140078790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f114c006fd0 tx=0x7f114c008040 comp rx=0 tx=0).stop 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 msgr2=0x7f115c0b05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c0b05b0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1158000c00 tx=0x7f11580046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 shutdown_connections 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f11400762d0 0x7f1140078790 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f115c15f620 0x7f115c15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f115c070bd0 0x7f115c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 --2- 172.21.15.66:0/1408009191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f115c06c990 0x7f115c0b05b0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 >> 172.21.15.66:0/1408009191 conn(0x7f115c0b3980 msgr2=0x7f115c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 shutdown_connections 2024-05-10T11:20:37.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.282+0000 7f1163778640 1 -- 172.21.15.66:0/1408009191 wait complete. 2024-05-10T11:20:37.294 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:20:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.400+0000 7f33a870a640 1 Processor -- start 2024-05-10T11:20:37.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.400+0000 7f33a870a640 1 -- start start 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.401+0000 7f33a870a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f33a015f3b0 0x7f33a00d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.401+0000 7f33a870a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33a015f790 0x7f33a00d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.401+0000 7f33a870a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d5d30 0x7f33a00c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.401+0000 7f33a870a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f33a00d30b0 con 0x7f33a015f3b0 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.401+0000 7f33a870a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f33a00d3390 con 0x7f33a015f790 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.401+0000 7f33a870a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00c8c80 con 0x7f33a00d5d30 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f33a015f3b0 0x7f33a00d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f33a015f3b0 0x7f33a00d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54778/0 (socket says 172.21.15.66:54778) 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 -- 172.21.15.66:0/3636387721 learned_addr learned my addr 172.21.15.66:0/3636387721 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a5ca5640 1 --2- 172.21.15.66:0/3636387721 >> v2:172.21.15.190:3300/0 conn(0x7f33a015f790 0x7f33a00d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a6ca7640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d5d30 0x7f33a00c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 -- 172.21.15.66:0/3636387721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d5d30 msgr2=0x7f33a00c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d5d30 0x7f33a00c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 -- 172.21.15.66:0/3636387721 >> v2:172.21.15.190:3300/0 conn(0x7f33a015f790 msgr2=0x7f33a00d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 --2- 172.21.15.66:0/3636387721 >> v2:172.21.15.190:3300/0 conn(0x7f33a015f790 0x7f33a00d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a64a6640 1 -- 172.21.15.66:0/3636387721 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00c8f60 con 0x7f33a015f3b0 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a5ca5640 1 --2- 172.21.15.66:0/3636387721 >> v2:172.21.15.190:3300/0 conn(0x7f33a015f790 0x7f33a00d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.402+0000 7f33a6ca7640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d5d30 0x7f33a00c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a64a6640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a015f3b0 0x7f33a00d36f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f33a00c8c00 tx=0x7f339c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e92fe5eaee03ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a54a4640 1 -- 172.21.15.66:0/3636387721 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c037070 con 0x7f33a015f3b0 2024-05-10T11:20:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a54a4640 1 -- 172.21.15.66:0/3636387721 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c032440 con 0x7f33a015f3b0 2024-05-10T11:20:37.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a54a4640 1 -- 172.21.15.66:0/3636387721 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c032810 con 0x7f33a015f3b0 2024-05-10T11:20:37.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 -- 172.21.15.66:0/3636387721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a015f3b0 msgr2=0x7f33a00d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a015f3b0 0x7f33a00d36f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f33a00c8c00 tx=0x7f339c02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 -- 172.21.15.66:0/3636387721 shutdown_connections 2024-05-10T11:20:37.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d5d30 0x7f33a00c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 --2- 172.21.15.66:0/3636387721 >> v2:172.21.15.190:3300/0 conn(0x7f33a015f790 0x7f33a00d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 --2- 172.21.15.66:0/3636387721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a015f3b0 0x7f33a00d36f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 -- 172.21.15.66:0/3636387721 >> 172.21.15.66:0/3636387721 conn(0x7f33a00d5130 msgr2=0x7f33a00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 -- 172.21.15.66:0/3636387721 shutdown_connections 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.403+0000 7f33a870a640 1 -- 172.21.15.66:0/3636387721 wait complete. 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 Processor -- start 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 -- start start 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 0x7f33a01f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a015f3b0 0x7f33a00d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d3c10 0x7f33a00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00c9e20 con 0x7f33a00d5d30 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00c9ca0 con 0x7f33a015f3b0 2024-05-10T11:20:37.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.405+0000 7f33a870a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00c9fa0 con 0x7f33a00d3c10 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 0x7f33a01f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 0x7f33a01f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54782/0 (socket says 172.21.15.66:54782) 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 -- 172.21.15.66:0/88169134 learned_addr learned my addr 172.21.15.66:0/88169134 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 -- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d3c10 msgr2=0x7f33a00cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d3c10 0x7f33a00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 -- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a015f3b0 msgr2=0x7f33a00d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a015f3b0 0x7f33a00d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 -- 172.21.15.66:0/88169134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00ce060 con 0x7f33a00d5d30 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a64a6640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 0x7f33a01f5580 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f339c02a220 tx=0x7f339c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c037040 con 0x7f33a00d5d30 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c042070 con 0x7f33a00d5d30 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00ce340 con 0x7f33a00d5d30 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c030bd0 con 0x7f33a00d5d30 2024-05-10T11:20:37.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.406+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a00ce900 con 0x7f33a00d5d30 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.407+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a006a220 con 0x7f33a00d5d30 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.408+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f339c047460 con 0x7f33a00d5d30 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.409+0000 7f3396ffd640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33840762d0 0x7f3384078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.409+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f339c0b83d0 con 0x7f33a00d5d30 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.409+0000 7f33a5ca5640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33840762d0 0x7f3384078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.409+0000 7f33a5ca5640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33840762d0 0x7f3384078790 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3390006fd0 tx=0x7f3390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:37.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.413+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f339c081ba0 con 0x7f33a00d5d30 2024-05-10T11:20:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.645+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f33a0158fb0 con 0x7f33a00d5d30 2024-05-10T11:20:37.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.645+0000 7f3396ffd640 1 -- 172.21.15.66:0/88169134 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f339c0814a0 con 0x7f33a00d5d30 2024-05-10T11:20:37.646 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33840762d0 msgr2=0x7f3384078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33840762d0 0x7f3384078790 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3390006fd0 tx=0x7f3390008040 comp rx=0 tx=0).stop 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 msgr2=0x7f33a01f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 0x7f33a01f5580 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f339c02a220 tx=0x7f339c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 shutdown_connections 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f33840762d0 0x7f3384078790 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a00d3c10 0x7f33a00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a015f3b0 0x7f33a00d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 --2- 172.21.15.66:0/88169134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33a00d5d30 0x7f33a01f5580 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 >> 172.21.15.66:0/88169134 conn(0x7f33a00d5130 msgr2=0x7f33a00d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 shutdown_connections 2024-05-10T11:20:37.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37.647+0000 7f33a870a640 1 -- 172.21.15.66:0/88169134 wait complete. 2024-05-10T11:20:37.659 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:20:37.660 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:20:37.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:37.660 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:20:37.684 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:20:37.684 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:20:37.685 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42256sec preferred_lft 42256sec 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:20:37.686 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:20:37.687 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.687 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:20:37.687 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:20:37.687 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:20:37.687 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:37.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:37.687 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:20:37.765 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:20:37.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:37.767 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:20:37.833 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:20:37.833 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:20:37.833 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:20:37.833 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:20:37.833 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:20:37.834 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:20:37.834 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:20:37.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:20:37.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:20:37.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:20:37.834 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:20:37.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:20:37.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:37.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:37.972 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:20:37.998 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:20:37.998 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:20:37.998 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:20:37.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:37.998 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:20:38.073 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:20:38.073 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:38.140 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:20:38.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:20:38.141 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:38.204 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:20:38.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:38.205 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:38.296 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:38.296 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:20:38.296 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:20:38.305 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:38.305 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:20:38.305 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:20:38.306 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:20:38.306 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:20:38.314 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:38.314 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:20:38.314 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:20:38.314 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:20:38.314 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:20:38.315 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:20:38.315 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:20:38.315 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:20:38.322 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:20:38.322 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:20:38.322 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:20:38.322 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:20:38.322 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:20:38.323 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:20:38.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:38.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:38.391 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:20:38.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:20:38.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:38.500 INFO:teuthology.orchestra.run.smithi066.stdout:client6763 2024-05-10T11:20:38.501 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:38.501 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:38.525 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:38.525 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:38.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:38.583 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-05-10T11:20:38.683 INFO:teuthology.orchestra.run.smithi066.stderr:6+0 records in 2024-05-10T11:20:38.684 INFO:teuthology.orchestra.run.smithi066.stderr:6+0 records out 2024-05-10T11:20:38.684 INFO:teuthology.orchestra.run.smithi066.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.03608 s, 174 MB/s 2024-05-10T11:20:38.684 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:38.684 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:38.700 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:38.701 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:38.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:20:38.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.907+0000 7f22c8672640 1 Processor -- start 2024-05-10T11:20:38.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.907+0000 7f22c8672640 1 -- start start 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c8672640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22c015ce60 0x7f22c00cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c8672640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c00c6a60 con 0x7f22c01611e0 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c8672640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c00cd090 con 0x7f22c00c65f0 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c8672640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f22c00cd370 con 0x7f22c015ce60 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c640e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22c015ce60 0x7f22c00cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c6c0f640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f22c01611e0 0x7f22c015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55846/0 (socket says 172.21.15.66:55846) 2024-05-10T11:20:38.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c6c0f640 1 -- 172.21.15.66:0/1199757716 learned_addr learned my addr 172.21.15.66:0/1199757716 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:38.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c640e640 1 -- 172.21.15.66:0/1199757716 >> v1:172.21.15.190:6789/0 conn(0x7f22c00c65f0 legacy=0x7f22c0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:38.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c640e640 1 -- 172.21.15.66:0/1199757716 >> v1:172.21.15.66:6789/0 conn(0x7f22c01611e0 legacy=0x7f22c015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:38.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c640e640 1 -- 172.21.15.66:0/1199757716 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c00cd650 con 0x7f22c015ce60 2024-05-10T11:20:38.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.908+0000 7f22c540c640 1 -- 172.21.15.66:0/1199757716 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285468929 0 0) 0x7f22c00c6a60 con 0x7f22c01611e0 2024-05-10T11:20:38.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.909+0000 7f22c640e640 1 --2- 172.21.15.66:0/1199757716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c015ce60 0x7f22c00cb300 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0097a0 tx=0x7f22bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86326828960b38c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:38.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.909+0000 7f22c540c640 1 -- 172.21.15.66:0/1199757716 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc037070 con 0x7f22c015ce60 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.909+0000 7f22c540c640 1 -- 172.21.15.66:0/1199757716 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22bc02ae50 con 0x7f22c015ce60 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.909+0000 7f22c540c640 1 -- 172.21.15.66:0/1199757716 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc032660 con 0x7f22c015ce60 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 -- 172.21.15.66:0/1199757716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c015ce60 msgr2=0x7f22c00cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 --2- 172.21.15.66:0/1199757716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c015ce60 0x7f22c00cb300 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0097a0 tx=0x7f22bc02a140 comp rx=0 tx=0).stop 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 -- 172.21.15.66:0/1199757716 shutdown_connections 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 --2- 172.21.15.66:0/1199757716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c015ce60 0x7f22c00cb300 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 -- 172.21.15.66:0/1199757716 >> 172.21.15.66:0/1199757716 conn(0x7f22c00b2900 msgr2=0x7f22c00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 -- 172.21.15.66:0/1199757716 shutdown_connections 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.910+0000 7f22c8672640 1 -- 172.21.15.66:0/1199757716 wait complete. 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.911+0000 7f22c8672640 1 Processor -- start 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.911+0000 7f22c8672640 1 -- start start 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c8672640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22c00c65f0 0x7f22c00b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:38.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c8672640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22c015ce60 0x7f22c00ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c8672640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 0x7f22c00c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c8672640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22c00cde50 con 0x7f22c01611e0 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c8672640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f22c00ccd60 con 0x7f22c015ce60 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c8672640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f22c00cdfd0 con 0x7f22c00c65f0 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 0x7f22c00c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 0x7f22c00c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54806/0 (socket says 172.21.15.66:54806) 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 -- 172.21.15.66:0/2143411916 learned_addr learned my addr 172.21.15.66:0/2143411916 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:38.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c5c0d640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22c015ce60 0x7f22c00ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c640e640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22c00c65f0 0x7f22c00b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 -- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22c00c65f0 msgr2=0x7f22c00b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22c00c65f0 0x7f22c00b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 -- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22c015ce60 msgr2=0x7f22c00ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22c015ce60 0x7f22c00ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 -- 172.21.15.66:0/2143411916 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c009cba0 con 0x7f22c01611e0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22c6c0f640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 0x7f22c00c7ff0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c780 tx=0x7f22b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.912+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8018070 con 0x7f22c01611e0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.913+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b800a640 con 0x7f22c01611e0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.913+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c009ce80 con 0x7f22c01611e0 2024-05-10T11:20:38.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.913+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b800aab0 con 0x7f22c01611e0 2024-05-10T11:20:38.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.913+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c009d440 con 0x7f22c01611e0 2024-05-10T11:20:38.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.914+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c006a220 con 0x7f22c01611e0 2024-05-10T11:20:38.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.914+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f22b801b070 con 0x7f22c01611e0 2024-05-10T11:20:38.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.915+0000 7f22b6ffd640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f22a40762d0 0x7f22a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:38.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.915+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f22b8096d20 con 0x7f22c01611e0 2024-05-10T11:20:38.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.915+0000 7f22c640e640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f22a40762d0 0x7f22a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:38.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.916+0000 7f22c640e640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f22a40762d0 0x7f22a4078790 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f22bc034000 tx=0x7f22bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:38.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:38.919+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f22b8060580 con 0x7f22c01611e0 2024-05-10T11:20:39.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.125+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f22c00c77f0 con 0x7f22c01611e0 2024-05-10T11:20:39.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.126+0000 7f22b6ffd640 1 -- 172.21.15.66:0/2143411916 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f22b805fe80 con 0x7f22c01611e0 2024-05-10T11:20:39.126 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:20:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f22a40762d0 msgr2=0x7f22a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f22a40762d0 0x7f22a4078790 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f22bc034000 tx=0x7f22bc02e000 comp rx=0 tx=0).stop 2024-05-10T11:20:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 msgr2=0x7f22c00c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 0x7f22c00c7ff0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c780 tx=0x7f22b800cc40 comp rx=0 tx=0).stop 2024-05-10T11:20:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 shutdown_connections 2024-05-10T11:20:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f22a40762d0 0x7f22a4078790 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22c01611e0 0x7f22c00c7ff0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22c015ce60 0x7f22c00ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 --2- 172.21.15.66:0/2143411916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22c00c65f0 0x7f22c00b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 >> 172.21.15.66:0/2143411916 conn(0x7f22c00b2900 msgr2=0x7f22c015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 shutdown_connections 2024-05-10T11:20:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.128+0000 7f22c8672640 1 -- 172.21.15.66:0/2143411916 wait complete. 2024-05-10T11:20:39.140 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:20:39.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:39.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:39.174 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:20:39.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:39.174 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:20:39.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:39.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.382+0000 7f2babbc8640 1 Processor -- start 2024-05-10T11:20:39.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.382+0000 7f2babbc8640 1 -- start start 2024-05-10T11:20:39.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2babbc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba415f3b0 0x7f2ba40d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2babbc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2ba415f790 0x7f2ba40d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2babbc8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ba40d30b0 con 0x7f2ba40d5d30 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2babbc8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba40d3390 con 0x7f2ba415f790 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2babbc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba40c8c80 con 0x7f2ba415f3b0 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2ba9163640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2ba415f790 0x7f2ba40d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2ba9163640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2ba415f790 0x7f2ba40d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54816/0 (socket says 172.21.15.66:54816) 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2ba9163640 1 -- 172.21.15.66:0/2980516196 learned_addr learned my addr 172.21.15.66:0/2980516196 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.383+0000 7f2baa165640 1 --1- 172.21.15.66:0/2980516196 >> v1:172.21.15.66:6789/0 conn(0x7f2ba40d5d30 0x7f2ba40c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55860/0 (socket says 172.21.15.66:55860) 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba9964640 1 --2- 172.21.15.66:0/2980516196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba415f3b0 0x7f2ba40d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba9163640 1 -- 172.21.15.66:0/2980516196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba415f3b0 msgr2=0x7f2ba40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba9163640 1 --2- 172.21.15.66:0/2980516196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba415f3b0 0x7f2ba40d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba9163640 1 -- 172.21.15.66:0/2980516196 >> v1:172.21.15.66:6789/0 conn(0x7f2ba40d5d30 legacy=0x7f2ba40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba9163640 1 -- 172.21.15.66:0/2980516196 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba40c8f60 con 0x7f2ba415f790 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba8962640 1 -- 172.21.15.66:0/2980516196 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602685002 0 0) 0x7f2ba40d30b0 con 0x7f2ba40d5d30 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.384+0000 7f2ba9163640 1 --2- 172.21.15.66:0/2980516196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f790 0x7f2ba40d3c30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009870 tx=0x7f2b9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c8ce87b7bd5f77 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2ba8962640 1 -- 172.21.15.66:0/2980516196 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94037070 con 0x7f2ba415f790 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2ba8962640 1 -- 172.21.15.66:0/2980516196 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b94032440 con 0x7f2ba415f790 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2ba8962640 1 -- 172.21.15.66:0/2980516196 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94032810 con 0x7f2ba415f790 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 -- 172.21.15.66:0/2980516196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f790 msgr2=0x7f2ba40d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 --2- 172.21.15.66:0/2980516196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f790 0x7f2ba40d3c30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009870 tx=0x7f2b9402a270 comp rx=0 tx=0).stop 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 -- 172.21.15.66:0/2980516196 shutdown_connections 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 --2- 172.21.15.66:0/2980516196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f790 0x7f2ba40d3c30 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 --2- 172.21.15.66:0/2980516196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba415f3b0 0x7f2ba40d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 -- 172.21.15.66:0/2980516196 >> 172.21.15.66:0/2980516196 conn(0x7f2ba40d5130 msgr2=0x7f2ba40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 -- 172.21.15.66:0/2980516196 shutdown_connections 2024-05-10T11:20:39.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.385+0000 7f2babbc8640 1 -- 172.21.15.66:0/2980516196 wait complete. 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.386+0000 7f2babbc8640 1 Processor -- start 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 -- start start 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba40d5d30 0x7f2ba4154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 0x7f2ba40c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ba40c9b80 0x7f2ba4155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40d0e60 con 0x7f2ba415f3b0 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40d0ce0 con 0x7f2ba40c9b80 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2babbc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba40d0fe0 con 0x7f2ba40d5d30 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2ba9163640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 0x7f2ba40c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2ba9163640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 0x7f2ba40c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54820/0 (socket says 172.21.15.66:54820) 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.387+0000 7f2ba9163640 1 -- 172.21.15.66:0/64513812 learned_addr learned my addr 172.21.15.66:0/64513812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2baa165640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ba40c9b80 0x7f2ba4155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9964640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba40d5d30 0x7f2ba4154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9163640 1 -- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba40d5d30 msgr2=0x7f2ba4154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9163640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba40d5d30 0x7f2ba4154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9163640 1 -- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ba40c9b80 msgr2=0x7f2ba4155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9163640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ba40c9b80 0x7f2ba4155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9163640 1 -- 172.21.15.66:0/64513812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba4154b90 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2ba9163640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 0x7f2ba40c9640 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009870 tx=0x7f2b940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94037040 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b94004030 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba4156700 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94004400 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.388+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba4156cc0 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.389+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba406a220 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.390+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b9403a070 con 0x7f2ba415f3b0 2024-05-10T11:20:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.390+0000 7f2b9a7fc640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2b880762d0 0x7f2b88078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.390+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f2b940b7c90 con 0x7f2ba415f3b0 2024-05-10T11:20:39.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.391+0000 7f2ba9964640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2b880762d0 0x7f2b88078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.391+0000 7f2ba9964640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2b880762d0 0x7f2b88078790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009a10 tx=0x7f2ba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:39.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.395+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2b94041020 con 0x7f2ba415f3b0 2024-05-10T11:20:39.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.628+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ba406dcf0 con 0x7f2ba415f3b0 2024-05-10T11:20:39.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.629+0000 7f2b9a7fc640 1 -- 172.21.15.66:0/64513812 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5183 (secure 0 0 0) 0x7f2b94081460 con 0x7f2ba415f3b0 2024-05-10T11:20:39.631 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:39.632 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":83,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:20:33.886520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/159674733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":159674733},{"type":"v1","addr":"172.21.15.66:6835","nonce":159674733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7647,"qdb_cluster":[7647]},"id":7}]} 2024-05-10T11:20:39.633 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 83 2024-05-10T11:20:39.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2b880762d0 msgr2=0x7f2b88078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2b880762d0 0x7f2b88078790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009a10 tx=0x7f2ba0008040 comp rx=0 tx=0).stop 2024-05-10T11:20:39.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 msgr2=0x7f2ba40c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 0x7f2ba40c9640 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009870 tx=0x7f2b940046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 shutdown_connections 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2b880762d0 0x7f2b88078790 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ba40c9b80 0x7f2ba4155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ba415f3b0 0x7f2ba40c9640 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 --2- 172.21.15.66:0/64513812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ba40d5d30 0x7f2ba4154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 >> 172.21.15.66:0/64513812 conn(0x7f2ba40d5130 msgr2=0x7f2ba40cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 shutdown_connections 2024-05-10T11:20:39.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.631+0000 7f2babbc8640 1 -- 172.21.15.66:0/64513812 wait complete. 2024-05-10T11:20:39.643 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T11:20:39.777 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:20:39.777 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:20:39.777 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.882+0000 7fb14ecb4640 1 Processor -- start 2024-05-10T11:20:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.882+0000 7fb14ecb4640 1 -- start start 2024-05-10T11:20:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.883+0000 7fb14ecb4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 0x7fb1480cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.883+0000 7fb14ecb4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1480d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.883+0000 7fb14ecb4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1480d30b0 con 0x7fb14815f3b0 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.883+0000 7fb14ecb4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb1480d3390 con 0x7fb14815f790 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.883+0000 7fb14ecb4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb1480c8c80 con 0x7fb1480d5d30 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb147fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 0x7fb1480cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14d251640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1480d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb147fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 0x7fb1480cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:53218/0 (socket says 172.21.15.66:53218) 2024-05-10T11:20:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14ca50640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb14815f3b0 0x7fb1480d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:42656/0 (socket says 172.21.15.66:42656) 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14d251640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1480d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:49118/0 (socket says 172.21.15.66:49118) 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb147fff640 1 -- 172.21.15.66:0/1293821539 learned_addr learned my addr 172.21.15.66:0/1293821539 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14d251640 1 -- 172.21.15.66:0/1293821539 >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 msgr2=0x7fb1480cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14d251640 1 --2- 172.21.15.66:0/1293821539 >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 0x7fb1480cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14d251640 1 -- 172.21.15.66:0/1293821539 >> v1:172.21.15.190:6789/0 conn(0x7fb14815f3b0 legacy=0x7fb1480d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb14d251640 1 -- 172.21.15.66:0/1293821539 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1480c8f60 con 0x7fb1480d5d30 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb1477fe640 1 -- 172.21.15.66:0/1293821539 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268619806 0 0) 0x7fb1480d30b0 con 0x7fb14815f3b0 2024-05-10T11:20:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.884+0000 7fb147fff640 1 --2- 172.21.15.66:0/1293821539 >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 0x7fb1480cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:39.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.885+0000 7fb14d251640 1 --2- 172.21.15.66:0/1293821539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1480d0210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1380097a0 tx=0x7fb13802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f13dfc4c7630b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:39.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.885+0000 7fb1477fe640 1 -- 172.21.15.66:0/1293821539 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138037070 con 0x7fb1480d5d30 2024-05-10T11:20:39.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.885+0000 7fb1477fe640 1 -- 172.21.15.66:0/1293821539 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138032440 con 0x7fb1480d5d30 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.885+0000 7fb1477fe640 1 -- 172.21.15.66:0/1293821539 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138032810 con 0x7fb1480d5d30 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 -- 172.21.15.66:0/1293821539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 msgr2=0x7fb1480d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/1293821539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1480d0210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1380097a0 tx=0x7fb13802a180 comp rx=0 tx=0).stop 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 -- 172.21.15.66:0/1293821539 shutdown_connections 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/1293821539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1480d0210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/1293821539 >> v2:172.21.15.190:3300/0 conn(0x7fb14815f790 0x7fb1480cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 -- 172.21.15.66:0/1293821539 >> 172.21.15.66:0/1293821539 conn(0x7fb1480d5130 msgr2=0x7fb1480d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 -- 172.21.15.66:0/1293821539 shutdown_connections 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.886+0000 7fb14ecb4640 1 -- 172.21.15.66:0/1293821539 wait complete. 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.887+0000 7fb14ecb4640 1 Processor -- start 2024-05-10T11:20:39.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.887+0000 7fb14ecb4640 1 -- start start 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ecb4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1481f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ecb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 0x7fb1481e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ecb4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1481e9540 0x7fb1481e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ecb4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1480d3f80 con 0x7fb14815f3b0 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ecb4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb1480d3e00 con 0x7fb1481e9540 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ecb4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb1480ca770 con 0x7fb1480d5d30 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 0x7fb1481e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 0x7fb1481e9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54832/0 (socket says 172.21.15.66:54832) 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 -- 172.21.15.66:0/2706890776 learned_addr learned my addr 172.21.15.66:0/2706890776 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:39.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14ca50640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1481f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb14d251640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1481e9540 0x7fb1481e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 -- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 msgr2=0x7fb1481f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1481f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 -- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1481e9540 msgr2=0x7fb1481e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1481e9540 0x7fb1481e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.888+0000 7fb147fff640 1 -- 172.21.15.66:0/2706890776 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1480cc450 con 0x7fb14815f3b0 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.889+0000 7fb147fff640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 0x7fb1481e9000 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb13000e9b0 tx=0x7fb13000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:39.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.889+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130017070 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.889+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13000c9a0 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.889+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1480cc730 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.889+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13000cd50 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.889+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1480cccf0 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.890+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1480cc1e0 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.891+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb13001a070 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.891+0000 7fb1457fa640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb1280762d0 0x7fb128078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.891+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fb1300975a0 con 0x7fb14815f3b0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.891+0000 7fb14ca50640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb1280762d0 0x7fb128078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:39.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.892+0000 7fb14ca50640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb1280762d0 0x7fb128078790 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb1400012e0 tx=0x7fb140007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:39.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:39.895+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb130060e00 con 0x7fb14815f3b0 2024-05-10T11:20:40.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.128+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1481e9920 con 0x7fb14815f3b0 2024-05-10T11:20:40.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.128+0000 7fb1457fa640 1 -- 172.21.15.66:0/2706890776 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5183 (secure 0 0 0) 0x7fb130060700 con 0x7fb14815f3b0 2024-05-10T11:20:40.129 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:40.129 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":83,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:20:33.886520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/159674733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":159674733},{"type":"v1","addr":"172.21.15.66:6835","nonce":159674733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7647,"qdb_cluster":[7647]},"id":7}]} 2024-05-10T11:20:40.130 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 83 2024-05-10T11:20:40.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb1280762d0 msgr2=0x7fb128078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb1280762d0 0x7fb128078790 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb1400012e0 tx=0x7fb140007ef0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 msgr2=0x7fb1481e9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 0x7fb1481e9000 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb13000e9b0 tx=0x7fb13000ee70 comp rx=0 tx=0).stop 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 shutdown_connections 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb1280762d0 0x7fb128078790 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1481e9540 0x7fb1481e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14815f3b0 0x7fb1481e9000 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 --2- 172.21.15.66:0/2706890776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1480d5d30 0x7fb1481f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 >> 172.21.15.66:0/2706890776 conn(0x7fb1480d5130 msgr2=0x7fb1480d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 shutdown_connections 2024-05-10T11:20:40.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.131+0000 7fb14ecb4640 1 -- 172.21.15.66:0/2706890776 wait complete. 2024-05-10T11:20:40.142 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-05-10T11:20:40.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.190+0000 7fc4a020ef40 1 Processor -- start 2024-05-10T11:20:40.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.190+0000 7fc4a020ef40 1 -- start start 2024-05-10T11:20:40.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc4a020ef40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd420 0x5609d696edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc4a020ef40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 0x5609d6971ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc4a020ef40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d69873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc4a020ef40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5609d698a300 con 0x5609d68bd8a0 2024-05-10T11:20:40.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc4a020ef40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5609d6861f50 con 0x5609d68bd420 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc4a020ef40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5609d68bde50 con 0x5609d6989f20 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc49d507640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 0x5609d6971ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc49d507640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 0x5609d6971ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54842/0 (socket says 172.21.15.66:54842) 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc49d507640 1 -- 172.21.15.66:0/3267442039 learned_addr learned my addr 172.21.15.66:0/3267442039 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc49dd08640 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd420 0x5609d696edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.191+0000 7fc49e509640 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d69873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc49d507640 1 -- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 msgr2=0x5609d69873e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc49d507640 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d69873e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc49d507640 1 -- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd420 msgr2=0x5609d696edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc49d507640 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd420 0x5609d696edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc49d507640 1 -- 172.21.15.66:0/3267442039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609d698bb00 con 0x5609d68bd8a0 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc49d507640 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 0x5609d6971ae0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fc49400a7a0 tx=0x7fc49400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73616f4fb621dbb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc48ffff640 1 -- 172.21.15.66:0/3267442039 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494019070 con 0x5609d68bd8a0 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc48ffff640 1 -- 172.21.15.66:0/3267442039 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc494007600 con 0x5609d68bd8a0 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc48ffff640 1 -- 172.21.15.66:0/3267442039 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4940079d0 con 0x5609d68bd8a0 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3267442039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 msgr2=0x5609d6971ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 0x5609d6971ae0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fc49400a7a0 tx=0x7fc49400a890 comp rx=0 tx=0).stop 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3267442039 shutdown_connections 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d69873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd8a0 0x5609d6971ae0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3267442039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd420 0x5609d696edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3267442039 >> 172.21.15.66:0/3267442039 conn(0x5609d68e7930 msgr2=0x5609d6989130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3267442039 shutdown_connections 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.192+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3267442039 wait complete. 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.193+0000 7fc4a020ef40 1 Processor -- start 2024-05-10T11:20:40.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.193+0000 7fc4a020ef40 1 -- start start 2024-05-10T11:20:40.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd420 0x5609d6a25970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd8a0 0x5609d698ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d698f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5609d698be50 con 0x5609d68bd420 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5609d6988bb0 con 0x5609d68bd8a0 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5609d698b7c0 con 0x5609d6989f20 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd420 0x5609d6a25970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd420 0x5609d6a25970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54850/0 (socket says 172.21.15.66:54850) 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 -- 172.21.15.66:0/3287597153 learned_addr learned my addr 172.21.15.66:0/3287597153 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49e509640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d698f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49d507640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd8a0 0x5609d698ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 -- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 msgr2=0x5609d698f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d698f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 -- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd8a0 msgr2=0x5609d698ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd8a0 0x5609d698ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 -- 172.21.15.66:0/3287597153 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609d6982420 con 0x5609d68bd420 2024-05-10T11:20:40.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49e509640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5609d6989f20 0x5609d698f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49d507640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609d68bd8a0 0x5609d698ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc49dd08640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd420 0x5609d6a25970 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fc49000d3c0 tx=0x7fc49000d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc48effd640 1 -- 172.21.15.66:0/3287597153 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4900125f0 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc48effd640 1 -- 172.21.15.66:0/3287597153 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc490018070 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609d6982700 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.194+0000 7fc48effd640 1 -- 172.21.15.66:0/3287597153 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4900129b0 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.195+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609d697fb30 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.196+0000 7fc48effd640 1 -- 172.21.15.66:0/3287597153 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc490012b50 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.196+0000 7fc48effd640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc480074cb0 0x7fc480077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc48effd640 1 -- 172.21.15.66:0/3287597153 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fc4900964f0 con 0x5609d68bd420 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5609d6980840 0x5609d6980c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x5609d6981160 con 0x5609d6980840 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc49e509640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5609d6980840 0x5609d6980c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc49d507640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc480074cb0 0x7fc480077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc49e509640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5609d6980840 0x5609d6980c20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.197+0000 7fc49d507640 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc480074cb0 0x7fc480077170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x5609d68bcaa0 tx=0x7fc49400c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc49e509640 1 -- 172.21.15.66:0/3287597153 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7fc498054970 con 0x5609d6980840 2024-05-10T11:20:40.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5609d6980840 msgr2=0x5609d6980c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x5609d6980840 0x5609d6980c20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc480074cb0 msgr2=0x7fc480077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc480074cb0 0x7fc480077170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x5609d68bcaa0 tx=0x7fc49400c000 comp rx=0 tx=0).stop 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd420 msgr2=0x5609d6a25970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 --2- 172.21.15.66:0/3287597153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609d68bd420 0x5609d6a25970 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fc49000d3c0 tx=0x7fc49000d880 comp rx=0 tx=0).stop 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc49e509640 1 -- 172.21.15.66:0/3287597153 reap_dead start 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 shutdown_connections 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 >> 172.21.15.66:0/3287597153 conn(0x5609d68e7930 msgr2=0x5609d69710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 shutdown_connections 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.198+0000 7fc4a020ef40 1 -- 172.21.15.66:0/3287597153 wait complete. 2024-05-10T11:20:40.203 INFO:teuthology.orchestra.run.smithi066.stdout:����� 2024-05-10T11:20:40.203 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:20:40.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.307+0000 7f3945114640 1 Processor -- start 2024-05-10T11:20:40.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.307+0000 7f3945114640 1 -- start start 2024-05-10T11:20:40.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f3945114640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f394006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f3945114640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f394006e620 0x7f39400d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f3945114640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39400b0a90 con 0x7f394015f4e0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f3945114640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f39400b23f0 con 0x7f394006e620 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f3945114640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39400b4150 con 0x7f394015f8c0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393ed9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f394015f4e0 0x7f394006d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55866/0 (socket says 172.21.15.66:55866) 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393ed9d640 1 -- 172.21.15.66:0/4108823600 learned_addr learned my addr 172.21.15.66:0/4108823600 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552617582 0 0) 0x7f39400b0a90 con 0x7f394015f4e0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393e59c640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f394006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393f59e640 1 --2- 172.21.15.66:0/4108823600 >> v2:172.21.15.190:3300/0 conn(0x7f394006e620 0x7f39400d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003520 con 0x7f394015f4e0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3389879358 0 0) 0x7f3928003520 con 0x7f394015f4e0 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 msgr2=0x7f394006e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f394006e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 >> v2:172.21.15.190:3300/0 conn(0x7f394006e620 msgr2=0x7f39400d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 --2- 172.21.15.66:0/4108823600 >> v2:172.21.15.190:3300/0 conn(0x7f394006e620 0x7f39400d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400b3540 con 0x7f394015f4e0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f3930001670 con 0x7f394015f4e0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 >> v1:172.21.15.66:6789/0 conn(0x7f394015f4e0 legacy=0x7f394006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f39280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b23f0 con 0x7f39280039b0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b4150 con 0x7f3928004800 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f392800b9c0 con 0x7f394015f8c0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.308+0000 7f393ed9d640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393e59c640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393f59e640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f39280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393ed9d640 1 -- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 msgr2=0x7f39280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393ed9d640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f39280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393ed9d640 1 -- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3928004800 msgr2=0x7f3928004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393ed9d640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393ed9d640 1 -- 172.21.15.66:0/4108823600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928003520 con 0x7f39280039b0 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393f59e640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f394015f8c0 0x7f39280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393e59c640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393ed9d640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f393000c240 tx=0x7f3928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dc1f9b4dd11d34 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.309+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930007d50 con 0x7f39280039b0 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393002e070 con 0x7f39280039b0 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f393dd9b640 1 -- 172.21.15.66:0/4108823600 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930005d30 con 0x7f39280039b0 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f3945114640 1 -- 172.21.15.66:0/4108823600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39280039b0 msgr2=0x7f3928003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f3945114640 1 --2- 172.21.15.66:0/4108823600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f393000c240 tx=0x7f3928005830 comp rx=0 tx=0).stop 2024-05-10T11:20:40.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f393f59e640 1 -- 172.21.15.66:0/4108823600 reap_dead start 2024-05-10T11:20:40.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f3945114640 1 -- 172.21.15.66:0/4108823600 shutdown_connections 2024-05-10T11:20:40.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f3945114640 1 -- 172.21.15.66:0/4108823600 >> 172.21.15.66:0/4108823600 conn(0x7f39400d2df0 msgr2=0x7f39400d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:40.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f3945114640 1 -- 172.21.15.66:0/4108823600 shutdown_connections 2024-05-10T11:20:40.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.310+0000 7f3945114640 1 -- 172.21.15.66:0/4108823600 wait complete. 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 Processor -- start 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 -- start start 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39280039b0 0x7f39401501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39401623b0 0x7f39400b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 0x7f39400b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b3de0 con 0x7f39400b7010 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b3b00 con 0x7f39280039b0 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f3945114640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39400b45e0 con 0x7f39401623b0 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f393f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 0x7f39400b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f393f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 0x7f39400b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54862/0 (socket says 172.21.15.66:54862) 2024-05-10T11:20:40.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.312+0000 7f393f59e640 1 -- 172.21.15.66:0/1833393473 learned_addr learned my addr 172.21.15.66:0/1833393473 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393e59c640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39401623b0 0x7f39400b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393ed9d640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39280039b0 0x7f39401501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393f59e640 1 -- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39401623b0 msgr2=0x7f39400b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393f59e640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39401623b0 0x7f39400b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393f59e640 1 -- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39280039b0 msgr2=0x7f39401501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393f59e640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39280039b0 0x7f39401501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393f59e640 1 -- 172.21.15.66:0/1833393473 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400b5b80 con 0x7f39400b7010 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f393f59e640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 0x7f39400b7490 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f394006ea90 tx=0x7f393800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393801c070 con 0x7f39400b7010 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3938017400 con 0x7f39400b7010 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39400b5e60 con 0x7f39400b7010 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39380177d0 con 0x7f39400b7010 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.313+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39400b6420 con 0x7f39400b7010 2024-05-10T11:20:40.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.314+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394006a220 con 0x7f39400b7010 2024-05-10T11:20:40.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.315+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f393801f070 con 0x7f39400b7010 2024-05-10T11:20:40.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.315+0000 7f39277fe640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f392c0762d0 0x7f392c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:40.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.316+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f39380977a0 con 0x7f39400b7010 2024-05-10T11:20:40.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.316+0000 7f393ed9d640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f392c0762d0 0x7f392c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:40.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.316+0000 7f393ed9d640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f392c0762d0 0x7f392c078790 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3930033000 tx=0x7f3930009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:40.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.320+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3938012070 con 0x7f39400b7010 2024-05-10T11:20:40.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.549+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f394006d460 con 0x7f39400b7010 2024-05-10T11:20:40.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.549+0000 7f39277fe640 1 -- 172.21.15.66:0/1833393473 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f3938060f70 con 0x7f39400b7010 2024-05-10T11:20:40.549 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f392c0762d0 msgr2=0x7f392c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f392c0762d0 0x7f392c078790 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3930033000 tx=0x7f3930009030 comp rx=0 tx=0).stop 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 msgr2=0x7f39400b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 0x7f39400b7490 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f394006ea90 tx=0x7f393800f4a0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 shutdown_connections 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f392c0762d0 0x7f392c078790 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b7010 0x7f39400b7490 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39401623b0 0x7f39400b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 --2- 172.21.15.66:0/1833393473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39280039b0 0x7f39401501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 >> 172.21.15.66:0/1833393473 conn(0x7f39400d2df0 msgr2=0x7f394006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 shutdown_connections 2024-05-10T11:20:40.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40.551+0000 7f3945114640 1 -- 172.21.15.66:0/1833393473 wait complete. 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:20:40.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:20:40.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:40.564 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:20:40.581 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42253sec preferred_lft 42253sec 2024-05-10T11:20:40.582 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:20:40.583 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.584 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:20:40.584 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:20:40.584 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:20:40.584 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:20:40.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:40.584 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:20:40.646 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:20:40.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:40.648 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:20:40.705 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:20:40.705 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:20:40.705 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:20:40.705 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:20:40.705 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:20:40.706 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:20:40.706 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:20:40.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:20:40.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:20:40.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:20:40.706 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:20:40.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:20:40.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:40.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:40.836 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:20:40.852 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:20:40.852 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:20:40.852 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:20:40.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:40.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:20:40.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:20:40.918 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:40.974 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:20:40.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:20:40.974 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:41.029 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:20:41.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:41.030 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:41.115 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:41.115 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:20:41.115 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:20:41.124 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:41.124 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:20:41.124 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:20:41.124 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:20:41.124 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:20:41.129 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:20:41.133 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:20:41.134 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:20:41.134 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:20:41.134 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:20:41.134 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:20:41.134 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:20:41.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:41.134 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:41.165 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:20:41.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:20:41.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:41.263 INFO:teuthology.orchestra.run.smithi066.stdout:client6787 2024-05-10T11:20:41.264 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:41.264 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:41.281 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:41.282 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:41.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:41.338 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-05-10T11:20:41.430 INFO:teuthology.orchestra.run.smithi066.stderr:6+0 records in 2024-05-10T11:20:41.430 INFO:teuthology.orchestra.run.smithi066.stderr:6+0 records out 2024-05-10T11:20:41.430 INFO:teuthology.orchestra.run.smithi066.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0335862 s, 187 MB/s 2024-05-10T11:20:41.431 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:41.431 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:41.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:41.447 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-05-10T11:20:41.538 INFO:teuthology.orchestra.run.smithi066.stderr:6+0 records in 2024-05-10T11:20:41.539 INFO:teuthology.orchestra.run.smithi066.stderr:6+0 records out 2024-05-10T11:20:41.539 INFO:teuthology.orchestra.run.smithi066.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0327515 s, 192 MB/s 2024-05-10T11:20:41.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:41.539 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T11:20:41.557 INFO:teuthology.orchestra.run.smithi066.stdout:./ 2024-05-10T11:20:41.557 INFO:teuthology.orchestra.run.smithi066.stdout:./file2_sixmegs 2024-05-10T11:20:41.557 INFO:teuthology.orchestra.run.smithi066.stdout:./file3_sixmegs 2024-05-10T11:20:41.557 INFO:teuthology.orchestra.run.smithi066.stdout:./file1_sixmegs 2024-05-10T11:20:41.557 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:20:41.557 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:20:41.558 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:20:41.558 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:20:41.558 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T11:20:41.558 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:20:41.665 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:20:41.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:41.674 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:20:41.674 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:20:41.675 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:20:41.675 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:20:41.675 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-05-10T11:20:41.675 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:20:41.783 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:20:41.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:41.793 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:20:41.793 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:20:41.793 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:20:41.793 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:20:41.793 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-05-10T11:20:41.793 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:20:41.901 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627778 2024-05-10T11:20:41.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:41.913 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:20:41.914 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:20:41.914 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:20:41.914 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:20:41.914 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-05-10T11:20:41.914 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:20:42.021 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:20:42.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:20:42.030 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:42.031 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:42.089 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:42.089 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:42.146 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:20:42.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.291+0000 7f6307064640 1 Processor -- start 2024-05-10T11:20:42.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.291+0000 7f6307064640 1 -- start start 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6307064640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f630006e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6307064640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630015fc90 con 0x7f63000cfd80 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6307064640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000b8c40 con 0x7f63000d0230 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6307064640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f630006ee50 con 0x7f63000b8860 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6305601640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f63000cfd80 0x7f63000ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55868/0 (socket says 172.21.15.66:55868) 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6305601640 1 -- 172.21.15.66:0/3033288342 learned_addr learned my addr 172.21.15.66:0/3033288342 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:42.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f6304e00640 1 --2- 172.21.15.66:0/3033288342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f630006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274007949 0 0) 0x7f630015fc90 con 0x7f63000cfd80 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.292+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f0003520 con 0x7f63000cfd80 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789597992 0 0) 0x7f63000b8c40 con 0x7f63000d0230 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f630015fc90 con 0x7f63000d0230 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f6304e00640 1 -- 172.21.15.66:0/3033288342 >> v1:172.21.15.190:6789/0 conn(0x7f63000d0230 legacy=0x7f63000cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3945145308 0 0) 0x7f62f0003520 con 0x7f63000cfd80 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f6304e00640 1 -- 172.21.15.66:0/3033288342 >> v1:172.21.15.66:6789/0 conn(0x7f63000cfd80 legacy=0x7f63000ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f6304e00640 1 -- 172.21.15.66:0/3033288342 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63000cd570 con 0x7f63000b8860 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.293+0000 7f6304e00640 1 --2- 172.21.15.66:0/3033288342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f630006e520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f62f40097d0 tx=0x7f62f402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb67a5e0b5dbea0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4037070 con 0x7f63000b8860 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f402ab90 con 0x7f63000b8860 2024-05-10T11:20:42.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f62ff7fe640 1 -- 172.21.15.66:0/3033288342 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f80019f0 con 0x7f63000b8860 2024-05-10T11:20:42.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 -- 172.21.15.66:0/3033288342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 msgr2=0x7f630006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 --2- 172.21.15.66:0/3033288342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f630006e520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f62f40097d0 tx=0x7f62f402a100 comp rx=0 tx=0).stop 2024-05-10T11:20:42.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 -- 172.21.15.66:0/3033288342 shutdown_connections 2024-05-10T11:20:42.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 --2- 172.21.15.66:0/3033288342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f630006e520 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 -- 172.21.15.66:0/3033288342 >> 172.21.15.66:0/3033288342 conn(0x7f63000d2df0 msgr2=0x7f63000d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:42.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 -- 172.21.15.66:0/3033288342 shutdown_connections 2024-05-10T11:20:42.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.294+0000 7f6307064640 1 -- 172.21.15.66:0/3033288342 wait complete. 2024-05-10T11:20:42.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 Processor -- start 2024-05-10T11:20:42.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 -- start start 2024-05-10T11:20:42.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f63000c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 0x7f63000b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63000d0230 0x7f63001f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63000cde10 con 0x7f63000cfd80 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f63000cdb30 con 0x7f63000d0230 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.296+0000 7f6307064640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f630006ea60 con 0x7f63000b8860 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 0x7f63000b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 0x7f63000b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54868/0 (socket says 172.21.15.66:54868) 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 -- 172.21.15.66:0/835099766 learned_addr learned my addr 172.21.15.66:0/835099766 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f6304e00640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f63000c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f6305601640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63000d0230 0x7f63001f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 -- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 msgr2=0x7f63000c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f63000c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 -- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63000d0230 msgr2=0x7f63001f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63000d0230 0x7f63001f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 -- 172.21.15.66:0/835099766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63001f5bf0 con 0x7f63000cfd80 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f6305601640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63000d0230 0x7f63001f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fffff640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 0x7f63000b63a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c430 tx=0x7f62ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec017070 con 0x7f63000cfd80 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec0052f0 con 0x7f63000cfd80 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63001f5ed0 con 0x7f63000cfd80 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec003830 con 0x7f63000cfd80 2024-05-10T11:20:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.297+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63000c7800 con 0x7f63000cfd80 2024-05-10T11:20:42.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.298+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630006a220 con 0x7f63000cfd80 2024-05-10T11:20:42.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.299+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f62ec01a070 con 0x7f63000cfd80 2024-05-10T11:20:42.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.299+0000 7f62fd7fa640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62e40762d0 0x7f62e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.299+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f62ec096b60 con 0x7f63000cfd80 2024-05-10T11:20:42.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.300+0000 7f6304e00640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62e40762d0 0x7f62e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.300+0000 7f6304e00640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62e40762d0 0x7f62e4078790 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62f4034000 tx=0x7f62f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:42.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.304+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f62ec060330 con 0x7f63000cfd80 2024-05-10T11:20:42.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.508+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63000d1e20 con 0x7f63000cfd80 2024-05-10T11:20:42.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.508+0000 7f62fd7fa640 1 -- 172.21.15.66:0/835099766 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f62ec068320 con 0x7f63000cfd80 2024-05-10T11:20:42.509 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:20:42.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62e40762d0 msgr2=0x7f62e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62e40762d0 0x7f62e4078790 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62f4034000 tx=0x7f62f402e000 comp rx=0 tx=0).stop 2024-05-10T11:20:42.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 msgr2=0x7f63000b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 0x7f63000b63a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c430 tx=0x7f62ec00c8f0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 shutdown_connections 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f62e40762d0 0x7f62e4078790 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63000d0230 0x7f63001f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63000cfd80 0x7f63000b63a0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 --2- 172.21.15.66:0/835099766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63000b8860 0x7f63000c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 >> 172.21.15.66:0/835099766 conn(0x7f63000d2df0 msgr2=0x7f63000b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 shutdown_connections 2024-05-10T11:20:42.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.510+0000 7f6307064640 1 -- 172.21.15.66:0/835099766 wait complete. 2024-05-10T11:20:42.522 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:20:42.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:42.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:20:42.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:20:42.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:42.571 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:20:42.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:20:42.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.744+0000 7f9d839a4640 1 Processor -- start 2024-05-10T11:20:42.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.744+0000 7f9d839a4640 1 -- start start 2024-05-10T11:20:42.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d839a4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9d7c15f830 0x7f9d7c06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d839a4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7c0c74c0 con 0x7f9d7c0cf170 2024-05-10T11:20:42.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d839a4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7c0c5d10 con 0x7f9d7c15b6d0 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d839a4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7c0cc380 con 0x7f9d7c15f830 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d81f41640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9d7c15f830 0x7f9d7c06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d80f3f640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9d7c0cf170 0x7f9d7c15f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55878/0 (socket says 172.21.15.66:55878) 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d80f3f640 1 -- 172.21.15.66:0/4152568903 learned_addr learned my addr 172.21.15.66:0/4152568903 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d81f41640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9d7c15f830 0x7f9d7c06dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54878/0 (socket says 172.21.15.66:54878) 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d81f41640 1 -- 172.21.15.66:0/4152568903 >> v1:172.21.15.190:6789/0 conn(0x7f9d7c15b6d0 legacy=0x7f9d7c0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d81f41640 1 -- 172.21.15.66:0/4152568903 >> v1:172.21.15.66:6789/0 conn(0x7f9d7c0cf170 legacy=0x7f9d7c15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.745+0000 7f9d81f41640 1 -- 172.21.15.66:0/4152568903 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c0c5ff0 con 0x7f9d7c15f830 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.746+0000 7f9d81f41640 1 --2- 172.21.15.66:0/4152568903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c06dd90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400ba40 tx=0x7f9d7402c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdfbaa573306fc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.746+0000 7f9d73fff640 1 -- 172.21.15.66:0/4152568903 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400a770 con 0x7f9d7c15f830 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.746+0000 7f9d73fff640 1 -- 172.21.15.66:0/4152568903 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7400a910 con 0x7f9d7c15f830 2024-05-10T11:20:42.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.746+0000 7f9d73fff640 1 -- 172.21.15.66:0/4152568903 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400ace0 con 0x7f9d7c15f830 2024-05-10T11:20:42.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 -- 172.21.15.66:0/4152568903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 msgr2=0x7f9d7c06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 --2- 172.21.15.66:0/4152568903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c06dd90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400ba40 tx=0x7f9d7402c760 comp rx=0 tx=0).stop 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 -- 172.21.15.66:0/4152568903 shutdown_connections 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 --2- 172.21.15.66:0/4152568903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c06dd90 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 -- 172.21.15.66:0/4152568903 >> 172.21.15.66:0/4152568903 conn(0x7f9d7c0b2900 msgr2=0x7f9d7c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 -- 172.21.15.66:0/4152568903 shutdown_connections 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.747+0000 7f9d839a4640 1 -- 172.21.15.66:0/4152568903 wait complete. 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.748+0000 7f9d839a4640 1 Processor -- start 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.748+0000 7f9d839a4640 1 -- start start 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d839a4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7c0cf170 0x7f9d7c0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d839a4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7c15b6d0 0x7f9d7c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d839a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c09e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d839a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c6890 con 0x7f9d7c15f830 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d839a4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c65b0 con 0x7f9d7c0cf170 2024-05-10T11:20:42.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d839a4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0cd170 con 0x7f9d7c15b6d0 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c09e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c09e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54894/0 (socket says 172.21.15.66:54894) 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 -- 172.21.15.66:0/3958989407 learned_addr learned my addr 172.21.15.66:0/3958989407 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d80f3f640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7c15b6d0 0x7f9d7c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 -- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7c15b6d0 msgr2=0x7f9d7c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81740640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7c0cf170 0x7f9d7c0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7c15b6d0 0x7f9d7c1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 -- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7c0cf170 msgr2=0x7f9d7c0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7c0cf170 0x7f9d7c0c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 -- 172.21.15.66:0/3958989407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c0c8140 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d80f3f640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7c15b6d0 0x7f9d7c1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81740640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7c0cf170 0x7f9d7c0c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d81f41640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c09e2a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bb60 tx=0x7f9d74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.749+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74043020 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.750+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74036b80 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.750+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c0c8420 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.750+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7403b040 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.750+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c0c89e0 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.751+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c06a220 con 0x7f9d7c15f830 2024-05-10T11:20:42.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.751+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d74046020 con 0x7f9d7c15f830 2024-05-10T11:20:42.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.752+0000 7f9d71ffb640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d60076300 0x7f9d600787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:42.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.752+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f9d740ba6d0 con 0x7f9d7c15f830 2024-05-10T11:20:42.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.752+0000 7f9d81740640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d60076300 0x7f9d600787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:42.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.753+0000 7f9d81740640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d60076300 0x7f9d600787c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9d78001d70 tx=0x7f9d78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:42.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.756+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9d7404d030 con 0x7f9d7c15f830 2024-05-10T11:20:42.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.986+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d7c0c7b40 con 0x7f9d7c15f830 2024-05-10T11:20:42.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.986+0000 7f9d71ffb640 1 -- 172.21.15.66:0/3958989407 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5183 (secure 0 0 0) 0x7f9d74083f30 con 0x7f9d7c15f830 2024-05-10T11:20:42.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:42.987 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":83,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:20:33.886520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6835/159674733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":159674733},{"type":"v1","addr":"172.21.15.66:6835","nonce":159674733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7647,"qdb_cluster":[7647]},"id":7}]} 2024-05-10T11:20:42.987 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 83 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d60076300 msgr2=0x7f9d600787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d60076300 0x7f9d600787c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9d78001d70 tx=0x7f9d78009040 comp rx=0 tx=0).stop 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 msgr2=0x7f9d7c09e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c09e2a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bb60 tx=0x7f9d74004730 comp rx=0 tx=0).stop 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 shutdown_connections 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9d60076300 0x7f9d600787c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d7c15f830 0x7f9d7c09e2a0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7c15b6d0 0x7f9d7c1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 --2- 172.21.15.66:0/3958989407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7c0cf170 0x7f9d7c0c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:42.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.988+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 >> 172.21.15.66:0/3958989407 conn(0x7f9d7c0b2900 msgr2=0x7f9d7c158530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:42.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.989+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 shutdown_connections 2024-05-10T11:20:42.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:42.989+0000 7f9d839a4640 1 -- 172.21.15.66:0/3958989407 wait complete. 2024-05-10T11:20:43.000 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T11:20:43.134 INFO:teuthology.orchestra.run.smithi066.stdout:{"message":"","return_code":0} 2024-05-10T11:20:43.138 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T11:20:43.139 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:20:43.139 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:20:43.156 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:20:43.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:20:43.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:43.156 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:20:43.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:20:43.212 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-10T11:20:43.213 DEBUG:teuthology.orchestra.run.smithi066:> sudo daemon-helper kill ceph --cluster ceph -w 2024-05-10T11:20:43.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:43.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-05-10T11:20:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.363+0000 7fa1efe1d640 1 Processor -- start 2024-05-10T11:20:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.363+0000 7fa1efe1d640 1 -- start start 2024-05-10T11:20:43.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1efe1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1e80d3d50 0x7fa1e80d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1efe1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e80d5ca0 0x7fa1e80b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1efe1d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e80d1080 con 0x7fa1e815f490 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1efe1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e80b4e70 con 0x7fa1e80d3d50 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1efe1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80b4820 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1edbb9640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa1e815f490 0x7fa1e80d3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:55892/0 (socket says 172.21.15.66:55892) 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1edbb9640 1 -- 172.21.15.66:0/774039640 learned_addr learned my addr 172.21.15.66:0/774039640 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1ee3ba640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e80d5ca0 0x7fa1e80b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.364+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/774039640 >> v2:172.21.15.190:3300/0 conn(0x7fa1e80d3d50 0x7fa1e80d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ecbb7640 1 -- 172.21.15.66:0/774039640 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729612664 0 0) 0x7fa1e80d1080 con 0x7fa1e815f490 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ecbb7640 1 -- 172.21.15.66:0/774039640 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d4003520 con 0x7fa1e815f490 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e80d5ca0 msgr2=0x7fa1e80b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e80d5ca0 0x7fa1e80b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/774039640 >> v1:172.21.15.66:6789/0 conn(0x7fa1e815f490 legacy=0x7fa1e80d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/774039640 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80b4b00 con 0x7fa1e80d3d50 2024-05-10T11:20:43.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.365+0000 7fa1ee3ba640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e80d5ca0 0x7fa1e80b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:20:43.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.366+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e80d2f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80097a0 tx=0x7fa1d802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742a447635422d28 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.366+0000 7fa1ecbb7640 1 -- 172.21.15.66:0/774039640 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8037070 con 0x7fa1e80d3d50 2024-05-10T11:20:43.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.366+0000 7fa1ecbb7640 1 -- 172.21.15.66:0/774039640 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d802ae50 con 0x7fa1e80d3d50 2024-05-10T11:20:43.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.366+0000 7fa1ecbb7640 1 -- 172.21.15.66:0/774039640 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8032640 con 0x7fa1e80d3d50 2024-05-10T11:20:43.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.366+0000 7fa1efe1d640 1 -- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 msgr2=0x7fa1e80d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.366+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e80d2f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80097a0 tx=0x7fa1d802a100 comp rx=0 tx=0).stop 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.367+0000 7fa1efe1d640 1 -- 172.21.15.66:0/774039640 shutdown_connections 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.367+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e80d5ca0 0x7fa1e80b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.367+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/774039640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e80d2f60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.367+0000 7fa1efe1d640 1 -- 172.21.15.66:0/774039640 >> 172.21.15.66:0/774039640 conn(0x7fa1e80d50f0 msgr2=0x7fa1e80d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.367+0000 7fa1efe1d640 1 -- 172.21.15.66:0/774039640 shutdown_connections 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.367+0000 7fa1efe1d640 1 -- 172.21.15.66:0/774039640 wait complete. 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.368+0000 7fa1efe1d640 1 Processor -- start 2024-05-10T11:20:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.368+0000 7fa1efe1d640 1 -- start start 2024-05-10T11:20:43.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1efe1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1efe1d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 0x7fa1e81e88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1efe1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e815f490 0x7fa1e815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1efe1d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e815f9f0 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1efe1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e815f870 con 0x7fa1e80d3d50 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1efe1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80b5840 con 0x7fa1e815f490 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 0x7fa1e81e88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 0x7fa1e81e88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54902/0 (socket says 172.21.15.66:54902) 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/3403279525 learned_addr learned my addr 172.21.15.66:0/3403279525 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ee3ba640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e815f490 0x7fa1e815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e815f490 msgr2=0x7fa1e815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e815f490 0x7fa1e815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 msgr2=0x7fa1e815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e815bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.369+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/3403279525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e81f88c0 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.370+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 0x7fa1e81e88f0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8035040 tx=0x7fa1d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.370+0000 7fa1de7fc640 1 -- 172.21.15.66:0/3403279525 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8037050 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.370+0000 7fa1de7fc640 1 -- 172.21.15.66:0/3403279525 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8038040 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.370+0000 7fa1de7fc640 1 -- 172.21.15.66:0/3403279525 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80044c0 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.370+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e81f8ba0 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.370+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e81f9160 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.372+0000 7fa1de7fc640 1 -- 172.21.15.66:0/3403279525 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1d8045020 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.373+0000 7fa1de7fc640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa1cc0762d0 0x7fa1cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.373+0000 7fa1f2c0c740 1 Processor -- start 2024-05-10T11:20:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.373+0000 7fa1f2c0c740 1 -- start start 2024-05-10T11:20:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.373+0000 7fa1de7fc640 1 -- 172.21.15.66:0/3403279525 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fa1d80b7750 con 0x7fa1e80d5ca0 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.373+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa1cc0762d0 0x7fa1cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea61abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea64a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64ac00 0x5587ea61fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5587ea583cf0 con 0x5587ea64b340 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5587ea53ce10 con 0x5587ea64ac00 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5587ea57fcb0 con 0x5587ea668220 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa1cc0762d0 0x7fa1cc078790 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4005880 tx=0x7fa1e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea64a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea64a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54916/0 (socket says 172.21.15.66:54916) 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/946447314 learned_addr learned my addr 172.21.15.66:0/946447314 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea61abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ee3ba640 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64ac00 0x5587ea61fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 msgr2=0x5587ea61abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea61abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64ac00 msgr2=0x5587ea61fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64ac00 0x5587ea61fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/946447314 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ea35d7e0 con 0x5587ea64b340 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea61abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.374+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea64a6c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80b5a90 tx=0x7fa1d8080760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b32fc9ff42872e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1cb7fe640 1 -- 172.21.15.66:0/946447314 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80803e0 con 0x5587ea64b340 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1cb7fe640 1 -- 172.21.15.66:0/946447314 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d80808d0 con 0x5587ea64b340 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1cb7fe640 1 -- 172.21.15.66:0/946447314 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8084bd0 con 0x5587ea64b340 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/946447314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 msgr2=0x5587ea64a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea64a6c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80b5a90 tx=0x7fa1d8080760 comp rx=0 tx=0).stop 2024-05-10T11:20:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/946447314 shutdown_connections 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64ac00 0x5587ea61fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea64a6c0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/946447314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea61abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/946447314 >> 172.21.15.66:0/946447314 conn(0x5587ea61ce20 msgr2=0x5587ea6656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/946447314 shutdown_connections 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.375+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/946447314 wait complete. 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.376+0000 7fa1f2c0c740 1 -- start start 2024-05-10T11:20:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.376+0000 7fa1f2c0c740 1 Processor -- start 2024-05-10T11:20:43.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64b340 0x5587ea646020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 0x5587ea649f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea64a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5587ea583cf0 con 0x5587ea668220 2024-05-10T11:20:43.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5587ea540940 con 0x5587ea64b340 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5587ea61efd0 con 0x5587ea6679e0 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1f2c0c740 10 client.0 _ll_register_callbacks cb 0x5587ea543440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 0x5587ea649f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 0x5587ea649f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54922/0 (socket says 172.21.15.66:54922) 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ee3ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea64a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64b340 0x5587ea646020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/743794979 learned_addr learned my addr 172.21.15.66:0/743794979 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 msgr2=0x5587ea64a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea64a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64b340 msgr2=0x5587ea646020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64b340 0x5587ea646020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.377+0000 7fa1ed3b8640 1 -- 172.21.15.66:0/743794979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587ea3bdf70 con 0x5587ea668220 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 0x5587ea649f40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8080860 tx=0x7fa1d80b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a9e9c2adbcbf8d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/743794979 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80b5060 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/743794979 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fa1d8089160 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1d80808d0 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/743794979 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa1d80803e0 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 10 client.7854 fetch_fsmap learned FSMap version 83 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5587ea255170 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/743794979 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d80808d0 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/743794979 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7fa1d8081b50 con 0x5587ea668220 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 10 client.7854 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 10 client.7854 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 20 client.7854 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:43.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea64bc10 0x5587ea64c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 4 client.7854 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587ea591900 con 0x5587ea64bc10 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.378+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea64bc10 0x5587ea64c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.379+0000 7fa1c8ff9640 10 client.7854 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.379+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea64bc10 0x5587ea64c020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcdeab9a8a317fad server_cookie=6ccf9f24b27565e8 in_seq=0 out_seq=0 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.379+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/743794979 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5587ea591900 con 0x5587ea64bc10 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.379+0000 7fa1c8ff9640 10 client.7854 handle_command_reply: tid=0 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.379+0000 7fa1f2c0c740 1 client.7854 shutdown 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 msgr2=0x5587ea649f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 0x5587ea649f40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8080860 tx=0x7fa1d80b7040 comp rx=0 tx=0).stop 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 shutdown_connections 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea64bc10 0x5587ea64c020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea64a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea668220 0x5587ea649f40 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1c8ff9640 0 client.7854 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/743794979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea64b340 0x5587ea646020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 >> 172.21.15.66:0/743794979 conn(0x5587ea64ac00 msgr2=0x5587ea61a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 shutdown_connections 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/743794979 wait complete. 2024-05-10T11:20:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.380+0000 7fa1f2c0c740 20 client.7854 trim_cache size 0 max 16384 2024-05-10T11:20:43.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.387+0000 7f56549dd640 1 Processor -- start 2024-05-10T11:20:43.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.387+0000 7f56549dd640 1 -- start start 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f56549dd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f565006f4c0 0x7f565015cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f56549dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f565015fb30 0x7f56500d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f56549dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565006f9a0 con 0x7f56500732b0 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f56549dd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f56500705b0 con 0x7f565006f4c0 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f56549dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f565006fc80 con 0x7f565015fb30 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f565006f4c0 0x7f565015cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f565006f4c0 0x7f565015cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54934/0 (socket says 172.21.15.66:54934) 2024-05-10T11:20:43.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 -- 172.21.15.66:0/725894818 learned_addr learned my addr 172.21.15.66:0/725894818 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f564ed9d640 1 --2- 172.21.15.66:0/725894818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f565015fb30 0x7f56500d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 -- 172.21.15.66:0/725894818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f565015fb30 msgr2=0x7f56500d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 --2- 172.21.15.66:0/725894818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f565015fb30 0x7f56500d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 -- 172.21.15.66:0/725894818 >> v1:172.21.15.190:6789/0 conn(0x7f56500732b0 legacy=0x7f56500cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.388+0000 7f5647fff640 1 -- 172.21.15.66:0/725894818 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565006ff60 con 0x7f565006f4c0 2024-05-10T11:20:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.389+0000 7f5647fff640 1 --2- 172.21.15.66:0/725894818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565006f4c0 0x7f565015cda0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5638009870 tx=0x7f563802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fb771990a5d98b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f564dd9b640 1 -- 172.21.15.66:0/725894818 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638037070 con 0x7f565006f4c0 2024-05-10T11:20:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f564dd9b640 1 -- 172.21.15.66:0/725894818 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5638032440 con 0x7f565006f4c0 2024-05-10T11:20:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f564dd9b640 1 -- 172.21.15.66:0/725894818 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638032810 con 0x7f565006f4c0 2024-05-10T11:20:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 -- 172.21.15.66:0/725894818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565006f4c0 msgr2=0x7f565015cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 --2- 172.21.15.66:0/725894818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565006f4c0 0x7f565015cda0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5638009870 tx=0x7f563802a270 comp rx=0 tx=0).stop 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 -- 172.21.15.66:0/725894818 shutdown_connections 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 --2- 172.21.15.66:0/725894818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f565015fb30 0x7f56500d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 --2- 172.21.15.66:0/725894818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565006f4c0 0x7f565015cda0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 -- 172.21.15.66:0/725894818 >> 172.21.15.66:0/725894818 conn(0x7f56500b3980 msgr2=0x7f56500b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 -- 172.21.15.66:0/725894818 shutdown_connections 2024-05-10T11:20:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.390+0000 7f56549dd640 1 -- 172.21.15.66:0/725894818 wait complete. 2024-05-10T11:20:43.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.392+0000 7f56549dd640 1 Processor -- start 2024-05-10T11:20:43.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.393+0000 7f56549dd640 1 -- start start 2024-05-10T11:20:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f56549dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f565006f4c0 0x7f565014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f56549dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56500732b0 0x7f5650150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f56549dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565015fb30 0x7f5650152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f56549dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f565015d2e0 con 0x7f565015fb30 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f56549dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5650070240 con 0x7f565006f4c0 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f56549dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f565015d460 con 0x7f56500732b0 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565015fb30 0x7f5650152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565015fb30 0x7f5650152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54948/0 (socket says 172.21.15.66:54948) 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 -- 172.21.15.66:0/373303925 learned_addr learned my addr 172.21.15.66:0/373303925 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f5647fff640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56500732b0 0x7f5650150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564e59c640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f565006f4c0 0x7f565014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 -- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56500732b0 msgr2=0x7f5650150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56500732b0 0x7f5650150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 -- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f565006f4c0 msgr2=0x7f565014f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f565006f4c0 0x7f565014f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.394+0000 7f564ed9d640 1 -- 172.21.15.66:0/373303925 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56501515a0 con 0x7f565015fb30 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.395+0000 7f564ed9d640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f565015fb30 0x7f5650152a10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5648009cb0 tx=0x7f564800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.395+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648018020 con 0x7f565015fb30 2024-05-10T11:20:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.395+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5648014480 con 0x7f565015fb30 2024-05-10T11:20:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.395+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648014870 con 0x7f565015fb30 2024-05-10T11:20:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.395+0000 7f56549dd640 1 -- 172.21.15.66:0/373303925 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5650151880 con 0x7f565015fb30 2024-05-10T11:20:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.395+0000 7f56549dd640 1 -- 172.21.15.66:0/373303925 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56500aef70 con 0x7f565015fb30 2024-05-10T11:20:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.396+0000 7f56549dd640 1 -- 172.21.15.66:0/373303925 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f56500aed60 con 0x7f565015fb30 2024-05-10T11:20:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.396+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5648005d10 con 0x7f565015fb30 2024-05-10T11:20:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.397+0000 7f5646ffd640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f56300762d0 0x7f5630078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.397+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f5648098c40 con 0x7f565015fb30 2024-05-10T11:20:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.397+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+501 (secure 0 0 0) 0x7f5648022030 con 0x7f565015fb30 2024-05-10T11:20:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.397+0000 7f564e59c640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f56300762d0 0x7f5630078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.397+0000 7f56549dd640 1 -- 172.21.15.66:0/373303925 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f56500693f0 con 0x7f565015fb30 2024-05-10T11:20:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.398+0000 7f564e59c640 1 --2- 172.21.15.66:0/373303925 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f56300762d0 0x7f5630078790 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5640001760 tx=0x7f5640009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 Processor -- start 2024-05-10T11:20:43.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 -- start start 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea63f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea6679e0 0x5587ea61e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea689340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e8201d50 con 0x5587ea64b340 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e8200dd0 con 0x5587ea6679e0 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.405+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80c9530 con 0x5587ea668220 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea63f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea63f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54950/0 (socket says 172.21.15.66:54950) 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 -- 172.21.15.66:0/2669606354 learned_addr learned my addr 172.21.15.66:0/2669606354 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea6679e0 0x5587ea61e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1ee3ba640 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea689340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 -- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 msgr2=0x5587ea689340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea689340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 -- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea6679e0 msgr2=0x5587ea61e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea6679e0 0x5587ea61e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 -- 172.21.15.66:0/2669606354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ea645800 con 0x5587ea64b340 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea6679e0 0x5587ea61e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea63f8d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400f770 tx=0x7fa1e4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac0fe2c1ddaabdf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1caffd640 1 -- 172.21.15.66:0/2669606354 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e402b070 con 0x5587ea64b340 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1caffd640 1 -- 172.21.15.66:0/2669606354 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4014920 con 0x5587ea64b340 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.406+0000 7fa1caffd640 1 -- 172.21.15.66:0/2669606354 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4014ad0 con 0x5587ea64b340 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/2669606354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 msgr2=0x5587ea63f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea63f8d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400f770 tx=0x7fa1e4000ed0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/2669606354 shutdown_connections 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea668220 0x5587ea689340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea6679e0 0x5587ea61e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/2669606354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea63f8d0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/2669606354 >> 172.21.15.66:0/2669606354 conn(0x5587ea64ac00 msgr2=0x5587ea648680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/2669606354 shutdown_connections 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.407+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/2669606354 wait complete. 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.408+0000 7fa1f2c0c740 1 -- start start 2024-05-10T11:20:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.408+0000 7fa1f2c0c740 1 Processor -- start 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.408+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea662480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea649980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea668220 0x5587ea649ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80c9b80 con 0x5587ea64b340 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5587ea662c80 con 0x5587ea668220 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5587ea6899c0 con 0x5587ea6679e0 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 10 client.0 _ll_register_callbacks cb 0x7fa1d8084070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea662480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea662480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54952/0 (socket says 172.21.15.66:54952) 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 -- 172.21.15.66:0/4206578327 learned_addr learned my addr 172.21.15.66:0/4206578327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1ee3ba640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea668220 0x5587ea649ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea649980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 -- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 msgr2=0x5587ea649980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea649980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 -- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea668220 msgr2=0x5587ea649ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea668220 0x5587ea649ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 -- 172.21.15.66:0/4206578327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587ea6629c0 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1edbb9640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea662480 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4010010 tx=0x7fa1e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a366dc26e10aca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/4206578327 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4035060 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/4206578327 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fa1e4004cb0 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e4014920 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.409+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/4206578327 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa1e403b050 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 10 client.7866 fetch_fsmap learned FSMap version 83 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5587ea689700 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/4206578327 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4014920 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/4206578327 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7fa1e403e020 con 0x5587ea64b340 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 10 client.7866 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:20:43.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 10 client.7866 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 20 client.7866 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea645e30 0x5587ea64a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 4 client.7866 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x5587ea58b770 con 0x5587ea645e30 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.410+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea645e30 0x5587ea64a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.411+0000 7fa1ed3b8640 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea645e30 0x5587ea64a400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c3145e95d0e4bf server_cookie=3204f7307fedfc20 in_seq=0 out_seq=0 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.411+0000 7fa1c8ff9640 10 client.7866 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.411+0000 7fa1c8ff9640 1 -- 172.21.15.66:0/4206578327 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5587ea58b770 con 0x5587ea645e30 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.411+0000 7fa1c8ff9640 10 client.7866 handle_command_reply: tid=0 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.411+0000 7fa1f2c0c740 1 client.7866 shutdown 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 msgr2=0x5587ea662480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea662480 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4010010 tx=0x7fa1e4000bc0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 shutdown_connections 2024-05-10T11:20:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5587ea645e30 0x5587ea64a400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587ea668220 0x5587ea649ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587ea6679e0 0x5587ea649980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 --2- 172.21.15.66:0/4206578327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ea64b340 0x5587ea662480 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1c8ff9640 0 client.7866 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 >> 172.21.15.66:0/4206578327 conn(0x5587ea64ac00 msgr2=0x5587ea65bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 shutdown_connections 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 1 -- 172.21.15.66:0/4206578327 wait complete. 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1f2c0c740 20 client.7866 trim_cache size 0 max 16384 2024-05-10T11:20:43.418 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:20:43.419 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:20:43.419 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "b924891e-5120-4db8-93a4-d8f9fe8a5f5f", 2024-05-10T11:20:43.419 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:20:43.419 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa1cc0762d0 msgr2=0x7fa1cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa1cc0762d0 0x7fa1cc078790 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4005880 tx=0x7fa1e4009040 comp rx=0 tx=0).stop 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 msgr2=0x7fa1e81e88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 0x7fa1e81e88f0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8035040 tx=0x7fa1d80046c0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 shutdown_connections 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.412+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa1cc0762d0 0x7fa1cc078790 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.413+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1e815f490 0x7fa1e815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.413+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1e80d5ca0 0x7fa1e81e88f0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.413+0000 7fa1efe1d640 1 --2- 172.21.15.66:0/3403279525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1e80d3d50 0x7fa1e815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.413+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 >> 172.21.15.66:0/3403279525 conn(0x7fa1e80d50f0 msgr2=0x7fa1e815e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.413+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 shutdown_connections 2024-05-10T11:20:43.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.413+0000 7fa1efe1d640 1 -- 172.21.15.66:0/3403279525 wait complete. 2024-05-10T11:20:43.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:20:43.423 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T11:20:43.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.529+0000 7f0849d87640 1 Processor -- start 2024-05-10T11:20:43.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.529+0000 7f0849d87640 1 -- start start 2024-05-10T11:20:43.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f0849d87640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f08440cf3e0 0x7f08440cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f0849d87640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08440cd500 0x7f08440cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f0849d87640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084406e720 con 0x7f08440b2dd0 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f0849d87640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f084406de80 con 0x7f08440cf3e0 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f0849d87640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f084406e160 con 0x7f08440cd500 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f08437fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f08440cf3e0 0x7f08440cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f08437fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f08440cf3e0 0x7f08440cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54964/0 (socket says 172.21.15.66:54964) 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f08437fe640 1 -- 172.21.15.66:0/1766549646 learned_addr learned my addr 172.21.15.66:0/1766549646 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.530+0000 7f083affd640 1 --2- 172.21.15.66:0/1766549646 >> v2:172.21.15.190:3300/0 conn(0x7f08440cd500 0x7f08440cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f08437fe640 1 -- 172.21.15.66:0/1766549646 >> v2:172.21.15.190:3300/0 conn(0x7f08440cd500 msgr2=0x7f08440cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f08437fe640 1 --2- 172.21.15.66:0/1766549646 >> v2:172.21.15.190:3300/0 conn(0x7f08440cd500 0x7f08440cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f08437fe640 1 -- 172.21.15.66:0/1766549646 >> v1:172.21.15.190:6789/0 conn(0x7f08440b2dd0 legacy=0x7f08440b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f08437fe640 1 -- 172.21.15.66:0/1766549646 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084406e440 con 0x7f08440cf3e0 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f083affd640 1 --2- 172.21.15.66:0/1766549646 >> v2:172.21.15.190:3300/0 conn(0x7f08440cd500 0x7f08440cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f08437fe640 1 --2- 172.21.15.66:0/1766549646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08440cf8c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f08440731b0 tx=0x7f083402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c7736739b8c145 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f0842ffd640 1 -- 172.21.15.66:0/1766549646 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834037070 con 0x7f08440cf3e0 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f0842ffd640 1 -- 172.21.15.66:0/1766549646 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0834032440 con 0x7f08440cf3e0 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.531+0000 7f0842ffd640 1 -- 172.21.15.66:0/1766549646 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834032810 con 0x7f08440cf3e0 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 -- 172.21.15.66:0/1766549646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 msgr2=0x7f08440cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 --2- 172.21.15.66:0/1766549646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08440cf8c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f08440731b0 tx=0x7f083402a230 comp rx=0 tx=0).stop 2024-05-10T11:20:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 -- 172.21.15.66:0/1766549646 shutdown_connections 2024-05-10T11:20:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 --2- 172.21.15.66:0/1766549646 >> v2:172.21.15.190:3300/0 conn(0x7f08440cd500 0x7f08440cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 --2- 172.21.15.66:0/1766549646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08440cf8c0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 -- 172.21.15.66:0/1766549646 >> 172.21.15.66:0/1766549646 conn(0x7f08440d2eb0 msgr2=0x7f08440d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 -- 172.21.15.66:0/1766549646 shutdown_connections 2024-05-10T11:20:43.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.532+0000 7f0849d87640 1 -- 172.21.15.66:0/1766549646 wait complete. 2024-05-10T11:20:43.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.533+0000 7f0849d87640 1 Processor -- start 2024-05-10T11:20:43.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.533+0000 7f0849d87640 1 -- start start 2024-05-10T11:20:43.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0849d87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08440b2dd0 0x7f08440cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0849d87640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08440cd500 0x7f08440c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0849d87640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08441f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0849d87640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f08440d2190 con 0x7f08440cf3e0 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0849d87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f08440b4510 con 0x7f08440b2dd0 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0849d87640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f08440d2310 con 0x7f08440cd500 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0843fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08441f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0843fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08441f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54972/0 (socket says 172.21.15.66:54972) 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.534+0000 7f0843fff640 1 -- 172.21.15.66:0/322368738 learned_addr learned my addr 172.21.15.66:0/322368738 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f08437fe640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08440b2dd0 0x7f08440cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f083affd640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08440cd500 0x7f08440c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0843fff640 1 -- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08440cd500 msgr2=0x7f08440c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0843fff640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08440cd500 0x7f08440c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0843fff640 1 -- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08440b2dd0 msgr2=0x7f08440cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0843fff640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08440b2dd0 0x7f08440cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0843fff640 1 -- 172.21.15.66:0/322368738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084415c590 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0843fff640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08441f8600 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f083c00c780 tx=0x7f083c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0840ff9640 1 -- 172.21.15.66:0/322368738 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c017070 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0840ff9640 1 -- 172.21.15.66:0/322368738 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c003da0 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0840ff9640 1 -- 172.21.15.66:0/322368738 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0052b0 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08441f90c0 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.535+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084415c850 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.537+0000 7f0840ff9640 1 -- 172.21.15.66:0/322368738 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f083c01a070 con 0x7f08440cf3e0 2024-05-10T11:20:43.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.537+0000 7f0840ff9640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f08240762d0 0x7f0824078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.537+0000 7f0840ff9640 1 -- 172.21.15.66:0/322368738 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f083c096db0 con 0x7f08440cf3e0 2024-05-10T11:20:43.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.538+0000 7f08437fe640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f08240762d0 0x7f0824078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.538+0000 7f084cb77740 1 Processor -- start 2024-05-10T11:20:43.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.538+0000 7f084cb77740 1 -- start start 2024-05-10T11:20:43.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.538+0000 7f08437fe640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f08240762d0 0x7f0824078790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0834034000 tx=0x7f083402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f084cb77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb65af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb96280 0x55e82bb95600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb95b40 0x55e82bb6a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f084cb77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e82bb32690 con 0x55e82bbb3160 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e82bacff30 con 0x55e82bb96280 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e82ba88b20 con 0x55e82bb95b40 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb65af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb65af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54978/0 (socket says 172.21.15.66:54978) 2024-05-10T11:20:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 -- 172.21.15.66:0/3146278216 learned_addr learned my addr 172.21.15.66:0/3146278216 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f083affd640 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb96280 0x55e82bb95600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f0843fff640 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb95b40 0x55e82bb6a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 -- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb95b40 msgr2=0x55e82bb6a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb95b40 0x55e82bb6a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 -- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb96280 msgr2=0x55e82bb95600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb96280 0x55e82bb95600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.539+0000 7f08437fe640 1 -- 172.21.15.66:0/3146278216 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82ba80e60 con 0x55e82bbb3160 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f08437fe640 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb65af0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0834009930 tx=0x7f083402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361ecee268c66fc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f08397fa640 1 -- 172.21.15.66:0/3146278216 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083404c070 con 0x55e82bbb3160 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f08397fa640 1 -- 172.21.15.66:0/3146278216 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0834032e50 con 0x55e82bbb3160 2024-05-10T11:20:43.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f08397fa640 1 -- 172.21.15.66:0/3146278216 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834037040 con 0x55e82bbb3160 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 -- 172.21.15.66:0/3146278216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 msgr2=0x55e82bb65af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb65af0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0834009930 tx=0x7f083402c000 comp rx=0 tx=0).stop 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 -- 172.21.15.66:0/3146278216 shutdown_connections 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb95b40 0x55e82bb6a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb96280 0x55e82bb95600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 --2- 172.21.15.66:0/3146278216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb65af0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.540+0000 7f084cb77740 1 -- 172.21.15.66:0/3146278216 >> 172.21.15.66:0/3146278216 conn(0x55e82bb67d60 msgr2=0x55e82bbb0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.541+0000 7f084cb77740 1 -- 172.21.15.66:0/3146278216 shutdown_connections 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.541+0000 7f084cb77740 1 -- 172.21.15.66:0/3146278216 wait complete. 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.541+0000 7f084cb77740 1 -- start start 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.541+0000 7f084cb77740 1 Processor -- start 2024-05-10T11:20:43.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 0x55e82bb979a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bbb3160 0x55e82bb97ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb923d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e82ba8c5e0 con 0x55e82bb96280 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e82bacbef0 con 0x55e82bb83010 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e82bb69f10 con 0x55e82bbb3160 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f084cb77740 10 client.0 _ll_register_callbacks cb 0x55e82ba87320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 0x55e82bb979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 0x55e82bb979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54992/0 (socket says 172.21.15.66:54992) 2024-05-10T11:20:43.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 -- 172.21.15.66:0/2300066169 learned_addr learned my addr 172.21.15.66:0/2300066169 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f083affd640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bbb3160 0x55e82bb97ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f0843fff640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 -- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bbb3160 msgr2=0x55e82bb97ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bbb3160 0x55e82bb97ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 -- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 msgr2=0x55e82bb923d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb923d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.542+0000 7f08437fe640 1 -- 172.21.15.66:0/2300066169 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82b8ab7d0 con 0x55e82bb96280 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08437fe640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 0x55e82bb979a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f083404a040 tx=0x7f0834004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6dffec17c418c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08227fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:43.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08227fc640 1 -- 172.21.15.66:0/2300066169 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083404c030 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08227fc640 1 -- 172.21.15.66:0/2300066169 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f0834053c70 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0834032e50 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08227fc640 1 -- 172.21.15.66:0/2300066169 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f0834037040 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 10 client.7878 fetch_fsmap learned FSMap version 83 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55e82b7e13f0 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08227fc640 1 -- 172.21.15.66:0/2300066169 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0834032e50 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f08227fc640 1 -- 172.21.15.66:0/2300066169 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f0834046070 con 0x55e82bb96280 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 10 client.7878 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 10 client.7878 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 20 client.7878 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bb96770 0x55e82bb96b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 4 client.7878 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e82baddb40 con 0x55e82bb96770 2024-05-10T11:20:43.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.543+0000 7f083affd640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bb96770 0x55e82bb96b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f083affd640 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bb96770 0x55e82bb96b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f9a168d1c155fe2 server_cookie=4597a918b9628ac in_seq=0 out_seq=0 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f08227fc640 10 client.7878 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f08227fc640 1 -- 172.21.15.66:0/2300066169 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e82baddb40 con 0x55e82bb96770 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f08227fc640 10 client.7878 handle_command_reply: tid=0 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f084cb77740 1 client.7878 shutdown 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 msgr2=0x55e82bb979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f084cb77740 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 0x55e82bb979a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f083404a040 tx=0x7f0834004730 comp rx=0 tx=0).stop 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.544+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 shutdown_connections 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bb96770 0x55e82bb96b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb923d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bbb3160 0x55e82bb97ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f08227fc640 0 client.7878 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 --2- 172.21.15.66:0/2300066169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bb96280 0x55e82bb979a0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 >> 172.21.15.66:0/2300066169 conn(0x55e82bb95b40 msgr2=0x55e82bb695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 shutdown_connections 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 1 -- 172.21.15.66:0/2300066169 wait complete. 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.545+0000 7f084cb77740 20 client.7878 trim_cache size 0 max 16384 2024-05-10T11:20:43.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.550+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 7 ==== log(4 entries from seq 1 at 2024-05-10T11:20:43.412796+0000) ==== 695+0+0 (secure 0 0 0) 0x7f56480970f0 con 0x7f565015fb30 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: cluster: 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: id: 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: health: HEALTH_OK 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: services: 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: mgr: x(active, since 8m), standbys: y 2024-05-10T11:20:43.561 INFO:teuthology.orchestra.run.smithi066.stdout: mds: 1/1 daemons up, 3 standby 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: data: 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: volumes: 1/1 healthy 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: pools: 3 pools, 97 pgs 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: objects: 25 objects, 4.6 MiB 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: usage: 257 MiB used, 720 GiB / 720 GiB avail 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: pgs: 97 active+clean 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: io: 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: client: 412 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:20:43.562 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:20:43.412796+0000 mds.c [INF] scrub queued for path: / 2024-05-10T11:20:43.563 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:20:43.412799+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-05-10T11:20:43.563 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:20:43.412804+0000 mds.c [INF] scrub summary: active paths [/] 2024-05-10T11:20:43.563 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:20:43.414030+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.563+0000 7f084cb77740 1 Processor -- start 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.563+0000 7f084cb77740 1 -- start start 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bbb4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb6b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f084cb77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bba8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f084cb77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0844201d20 con 0x55e82bbb3160 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0844200d40 con 0x55e82bb83010 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f084414f900 con 0x55e82bb96280 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bba8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bba8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55002/0 (socket says 172.21.15.66:55002) 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 -- 172.21.15.66:0/2975300378 learned_addr learned my addr 172.21.15.66:0/2975300378 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 -- 172.21.15.66:0/2975300378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 msgr2=0x55e82bb6b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb6b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 -- 172.21.15.66:0/2975300378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 msgr2=0x55e82bbb4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bbb4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 -- 172.21.15.66:0/2975300378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82b7a10f0 con 0x55e82bbb3160 2024-05-10T11:20:43.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.564+0000 7f0843fff640 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bba8ee0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f083c05fb80 tx=0x7f083c05c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902fee6634db7aed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f0838ff9640 1 -- 172.21.15.66:0/2975300378 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c094070 con 0x55e82bbb3160 2024-05-10T11:20:43.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f0838ff9640 1 -- 172.21.15.66:0/2975300378 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c064230 con 0x55e82bbb3160 2024-05-10T11:20:43.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f0838ff9640 1 -- 172.21.15.66:0/2975300378 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0689e0 con 0x55e82bbb3160 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 -- 172.21.15.66:0/2975300378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 msgr2=0x55e82bba8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bba8ee0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f083c05fb80 tx=0x7f083c05c600 comp rx=0 tx=0).stop 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 -- 172.21.15.66:0/2975300378 shutdown_connections 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bba8ee0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb6b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 --2- 172.21.15.66:0/2975300378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bbb4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 -- 172.21.15.66:0/2975300378 >> 172.21.15.66:0/2975300378 conn(0x55e82bb95b40 msgr2=0x55e82bbaf790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 -- 172.21.15.66:0/2975300378 shutdown_connections 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.565+0000 7f084cb77740 1 -- 172.21.15.66:0/2975300378 wait complete. 2024-05-10T11:20:43.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.566+0000 7f084cb77740 1 -- start start 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.566+0000 7f084cb77740 1 Processor -- start 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb83680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb91db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb922f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e82bbb0730 con 0x55e82bbb3160 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f08441f5e10 con 0x55e82bb83010 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e82bbaf030 con 0x55e82bb96280 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 10 client.0 _ll_register_callbacks cb 0x7f083404a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb922f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55012/0 (socket says 172.21.15.66:55012) 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 -- 172.21.15.66:0/3127717379 learned_addr learned my addr 172.21.15.66:0/3127717379 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f08437fe640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb83680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f083affd640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb91db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 -- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 msgr2=0x55e82bb91db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb91db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 -- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 msgr2=0x55e82bb83680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb83680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 -- 172.21.15.66:0/3127717379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82bb96cf0 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f0843fff640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb922f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f083c05fe10 tx=0x7f083c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6834e3df30226eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f08227fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f08227fc640 1 -- 172.21.15.66:0/3127717379 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c07d070 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f08227fc640 1 -- 172.21.15.66:0/3127717379 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f083c0813f0 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.567+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f083c064230 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f08227fc640 1 -- 172.21.15.66:0/3127717379 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f083c06f050 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 10 client.7884 fetch_fsmap learned FSMap version 83 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55e82bbb20a0 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f08227fc640 1 -- 172.21.15.66:0/3127717379 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c064230 con 0x55e82bbb3160 2024-05-10T11:20:43.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f08227fc640 1 -- 172.21.15.66:0/3127717379 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f083c08f030 con 0x55e82bbb3160 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 10 client.7884 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 10 client.7884 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 20 client.7884 populate_metadata read hostname 'smithi066' 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bc2d960 0x55e82bb6a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 4 client.7884 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e82bad79b0 con 0x55e82bc2d960 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f08437fe640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bc2d960 0x55e82bb6a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f08227fc640 10 client.7884 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.568+0000 7f08437fe640 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bc2d960 0x55e82bb6a1d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a066d8e6fed4bb1 server_cookie=ec51d5b7b0087215 in_seq=0 out_seq=0 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f08227fc640 1 -- 172.21.15.66:0/3127717379 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55e82bad79b0 con 0x55e82bc2d960 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f08227fc640 10 client.7884 handle_command_reply: tid=0 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 client.7884 shutdown 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 msgr2=0x55e82bb922f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb922f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f083c05fe10 tx=0x7f083c003f90 comp rx=0 tx=0).stop 2024-05-10T11:20:43.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 shutdown_connections 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x55e82bc2d960 0x55e82bb6a1d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e82bbb3160 0x55e82bb922f0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e82bb96280 0x55e82bb91db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 --2- 172.21.15.66:0/3127717379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e82bb83010 0x55e82bb83680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f08227fc640 0 client.7884 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 >> 172.21.15.66:0/3127717379 conn(0x55e82bb95b40 msgr2=0x55e82bb6b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 shutdown_connections 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 1 -- 172.21.15.66:0/3127717379 wait complete. 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f084cb77740 20 client.7884 trim_cache size 0 max 16384 2024-05-10T11:20:43.576 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: "b924891e-5120-4db8-93a4-d8f9fe8a5f5f": { 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "b924891e-5120-4db8-93a4-d8f9fe8a5f5f", 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair" 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:20:43.577 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f08240762d0 msgr2=0x7f0824078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f08240762d0 0x7f0824078790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0834034000 tx=0x7f083402e000 comp rx=0 tx=0).stop 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 msgr2=0x7f08441f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08441f8600 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f083c00c780 tx=0x7f083c00cc40 comp rx=0 tx=0).stop 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 shutdown_connections 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f08240762d0 0x7f0824078790 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08440cf3e0 0x7f08441f8600 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08440cd500 0x7f08440c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 --2- 172.21.15.66:0/322368738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08440b2dd0 0x7f08440cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:20:43.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.569+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 >> 172.21.15.66:0/322368738 conn(0x7f08440d2eb0 msgr2=0x7f084406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:20:43.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.570+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 shutdown_connections 2024-05-10T11:20:43.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:43.570+0000 7f0849d87640 1 -- 172.21.15.66:0/322368738 wait complete. 2024-05-10T11:20:43.580 INFO:tasks.cephfs.filesystem:scrub status for tag:b924891e-5120-4db8-93a4-d8f9fe8a5f5f - {'path': '/', 'tag': 'b924891e-5120-4db8-93a4-d8f9fe8a5f5f', 'options': 'recursive,repair'} 2024-05-10T11:20:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:20:48.142+0000 7f5646ffd640 1 -- 172.21.15.66:0/373303925 <== mon.0 v2:172.21.15.66:3300/0 8 ==== log(1 entries from seq 5 at 2024-05-10T11:20:46.524702+0000) ==== 189+0+0 (secure 0 0 0) 0x7f56480620b0 con 0x7f565015fb30 2024-05-10T11:20:48.143 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:20:46.524702+0000 mds.c [INF] scrub summary: idle 2024-05-10T11:21:03.079 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:21:03.082 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:21:13.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:21:13.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T11:21:13.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.701+0000 7fd456dc8640 1 Processor -- start 2024-05-10T11:21:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.701+0000 7fd456dc8640 1 -- start start 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd456dc8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd45006c2c0 0x7fd45006df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd456dc8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd45006c6a0 0x7fd4500739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd456dc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450073f20 0x7fd45015d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd456dc8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd450161990 con 0x7fd45006c6a0 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd456dc8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd450157a40 con 0x7fd45006c2c0 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd456dc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd450160d80 con 0x7fd450073f20 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd45006c6a0 0x7fd4500739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd45006c6a0 0x7fd4500739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48288/0 (socket says 172.21.15.66:48288) 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 -- 172.21.15.66:0/367239470 learned_addr learned my addr 172.21.15.66:0/367239470 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd455365640 1 --2- 172.21.15.66:0/367239470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450073f20 0x7fd45015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd454b64640 1 --2- 172.21.15.66:0/367239470 >> v2:172.21.15.190:3300/0 conn(0x7fd45006c2c0 0x7fd45006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 -- 172.21.15.66:0/367239470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450073f20 msgr2=0x7fd45015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 --2- 172.21.15.66:0/367239470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450073f20 0x7fd45015d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 -- 172.21.15.66:0/367239470 >> v2:172.21.15.190:3300/0 conn(0x7fd45006c2c0 msgr2=0x7fd45006df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 --2- 172.21.15.66:0/367239470 >> v2:172.21.15.190:3300/0 conn(0x7fd45006c2c0 0x7fd45006df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.702+0000 7fd44ffff640 1 -- 172.21.15.66:0/367239470 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd450161060 con 0x7fd45006c6a0 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.703+0000 7fd44ffff640 1 --2- 172.21.15.66:0/367239470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c6a0 0x7fd4500739e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fd45006d2a0 tx=0x7fd44402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f51ddabf219797f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.703+0000 7fd44f7fe640 1 -- 172.21.15.66:0/367239470 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444036070 con 0x7fd45006c6a0 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.703+0000 7fd44f7fe640 1 -- 172.21.15.66:0/367239470 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444031600 con 0x7fd45006c6a0 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.703+0000 7fd44f7fe640 1 -- 172.21.15.66:0/367239470 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4440319d0 con 0x7fd45006c6a0 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 -- 172.21.15.66:0/367239470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c6a0 msgr2=0x7fd4500739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 --2- 172.21.15.66:0/367239470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c6a0 0x7fd4500739e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fd45006d2a0 tx=0x7fd44402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 -- 172.21.15.66:0/367239470 shutdown_connections 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 --2- 172.21.15.66:0/367239470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450073f20 0x7fd45015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 --2- 172.21.15.66:0/367239470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c6a0 0x7fd4500739e0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 --2- 172.21.15.66:0/367239470 >> v2:172.21.15.190:3300/0 conn(0x7fd45006c2c0 0x7fd45006df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 -- 172.21.15.66:0/367239470 >> 172.21.15.66:0/367239470 conn(0x7fd4500d0c90 msgr2=0x7fd4500d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 -- 172.21.15.66:0/367239470 shutdown_connections 2024-05-10T11:21:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.704+0000 7fd456dc8640 1 -- 172.21.15.66:0/367239470 wait complete. 2024-05-10T11:21:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.705+0000 7fd456dc8640 1 Processor -- start 2024-05-10T11:21:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.705+0000 7fd456dc8640 1 -- start start 2024-05-10T11:21:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd456dc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 0x7fd4501e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd456dc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006c6a0 0x7fd45015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd456dc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450073f20 0x7fd4500b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd456dc8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500cd440 con 0x7fd45006c2c0 2024-05-10T11:21:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd456dc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd450161620 con 0x7fd450073f20 2024-05-10T11:21:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd456dc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd45006cb20 con 0x7fd45006c6a0 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd454b64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 0x7fd4501e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd454b64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 0x7fd4501e6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48290/0 (socket says 172.21.15.66:48290) 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.706+0000 7fd454b64640 1 -- 172.21.15.66:0/3833832281 learned_addr learned my addr 172.21.15.66:0/3833832281 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd455365640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450073f20 0x7fd4500b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd44ffff640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006c6a0 0x7fd45015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd454b64640 1 -- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006c6a0 msgr2=0x7fd45015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd454b64640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006c6a0 0x7fd45015dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd454b64640 1 -- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450073f20 msgr2=0x7fd4500b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd454b64640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450073f20 0x7fd4500b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd454b64640 1 -- 172.21.15.66:0/3833832281 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4501443b0 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd454b64640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 0x7fd4501e6bd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d830 tx=0x7fd44000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd44d7fa640 1 -- 172.21.15.66:0/3833832281 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440018030 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd44d7fa640 1 -- 172.21.15.66:0/3833832281 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44000be10 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd450144690 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd44d7fa640 1 -- 172.21.15.66:0/3833832281 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400098b0 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.707+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd450144c50 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.709+0000 7fd44d7fa640 1 -- 172.21.15.66:0/3833832281 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd44001b070 con 0x7fd45006c2c0 2024-05-10T11:21:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.710+0000 7fd44d7fa640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd43c0762d0 0x7fd43c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.710+0000 7fd44d7fa640 1 -- 172.21.15.66:0/3833832281 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fd440097870 con 0x7fd45006c2c0 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.710+0000 7fd44ffff640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd43c0762d0 0x7fd43c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd44ffff640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd43c0762d0 0x7fd43c078790 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd444033000 tx=0x7fd444009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 Processor -- start 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 -- start start 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d5ffcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d602c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 0x5644d6001950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5644d5fc9690 con 0x5644d602cb40 2024-05-10T11:21:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5644d5f66f30 con 0x5644d602d280 2024-05-10T11:21:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.711+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5644d5f1fb20 con 0x5644d604a160 2024-05-10T11:21:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 0x5644d6001950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 0x5644d6001950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48294/0 (socket says 172.21.15.66:48294) 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 -- 172.21.15.66:0/2849278254 learned_addr learned my addr 172.21.15.66:0/2849278254 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd454b64640 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d5ffcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd44ffff640 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d602c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 -- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 msgr2=0x5644d5ffcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d5ffcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 -- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 msgr2=0x5644d602c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d602c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 -- 172.21.15.66:0/2849278254 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d5f17e60 con 0x5644d602cb40 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd455365640 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 0x5644d6001950 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fd448007930 tx=0x7fd448007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c751d4ca7d93e1a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd4367fc640 1 -- 172.21.15.66:0/2849278254 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448018070 con 0x5644d602cb40 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd4367fc640 1 -- 172.21.15.66:0/2849278254 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd448010bc0 con 0x5644d602cb40 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.712+0000 7fd4367fc640 1 -- 172.21.15.66:0/2849278254 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448014430 con 0x5644d602cb40 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 -- 172.21.15.66:0/2849278254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 msgr2=0x5644d6001950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 0x5644d6001950 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fd448007930 tx=0x7fd448007df0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 -- 172.21.15.66:0/2849278254 shutdown_connections 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d602cb40 0x5644d6001950 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d602c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2849278254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d5ffcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 -- 172.21.15.66:0/2849278254 >> 172.21.15.66:0/2849278254 conn(0x5644d5ffed60 msgr2=0x5644d6047600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 -- 172.21.15.66:0/2849278254 shutdown_connections 2024-05-10T11:21:13.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.713+0000 7fd459bc0740 1 -- 172.21.15.66:0/2849278254 wait complete. 2024-05-10T11:21:13.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.714+0000 7fd459bc0740 1 -- start start 2024-05-10T11:21:13.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.714+0000 7fd459bc0740 1 Processor -- start 2024-05-10T11:21:13.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d6046150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d605ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d603fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5644d5f235e0 con 0x5644d603f720 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5644d5f62ef0 con 0x5644d602d280 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5644d6000f10 con 0x5644d604a160 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd459bc0740 10 client.0 _ll_register_callbacks cb 0x5644d5f1e320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d603fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d603fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48304/0 (socket says 172.21.15.66:48304) 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 -- 172.21.15.66:0/2393478838 learned_addr learned my addr 172.21.15.66:0/2393478838 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd454b64640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d6046150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd44ffff640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d605ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 -- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 msgr2=0x5644d605ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d605ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 -- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 msgr2=0x5644d6046150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d6046150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 -- 172.21.15.66:0/2393478838 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d5d427d0 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd455365640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d603fb80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fd448017000 tx=0x7fd448004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67f080f21dbbfe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd42f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.715+0000 7fd42f7fe640 1 -- 172.21.15.66:0/2393478838 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44802b060 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd42f7fe640 1 -- 172.21.15.66:0/2393478838 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fd44801e950 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd448010bc0 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd42f7fe640 1 -- 172.21.15.66:0/2393478838 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fd448018040 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 10 client.7896 fetch_fsmap learned FSMap version 83 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5644d5c783f0 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd42f7fe640 1 -- 172.21.15.66:0/2393478838 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd448010bc0 con 0x5644d603f720 2024-05-10T11:21:13.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd42f7fe640 1 -- 172.21.15.66:0/2393478838 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7fd44801eb50 con 0x5644d603f720 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 10 client.7896 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 10 client.7896 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 20 client.7896 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d602f080 0x5644d602f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 4 client.7896 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644d5f74b40 con 0x5644d602f080 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd454b64640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d602f080 0x5644d602f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.716+0000 7fd454b64640 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d602f080 0x5644d602f460 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d040276906c0b3a server_cookie=a9a4a59d4a59f195 in_seq=0 out_seq=0 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd42f7fe640 10 client.7896 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd42f7fe640 1 -- 172.21.15.66:0/2393478838 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5644d5f74b40 con 0x5644d602f080 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd42f7fe640 10 client.7896 handle_command_reply: tid=0 2024-05-10T11:21:13.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 client.7896 shutdown 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 msgr2=0x5644d603fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d603fb80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fd448017000 tx=0x7fd448004730 comp rx=0 tx=0).stop 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 shutdown_connections 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d602f080 0x5644d602f460 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d603fb80 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d605ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd42f7fe640 0 client.7896 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 --2- 172.21.15.66:0/2393478838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d6046150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 >> 172.21.15.66:0/2393478838 conn(0x5644d602cb40 msgr2=0x5644d5ffc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 shutdown_connections 2024-05-10T11:21:13.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.717+0000 7fd459bc0740 1 -- 172.21.15.66:0/2393478838 wait complete. 2024-05-10T11:21:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.718+0000 7fd459bc0740 20 client.7896 trim_cache size 0 max 16384 2024-05-10T11:21:13.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.736+0000 7fd459bc0740 1 Processor -- start 2024-05-10T11:21:13.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.736+0000 7fd459bc0740 1 -- start start 2024-05-10T11:21:13.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d606bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d60015a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d6001ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd459bc0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4501ffd90 con 0x5644d603f720 2024-05-10T11:21:13.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4501fed70 con 0x5644d602d280 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd450146e80 con 0x5644d604a160 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d60015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d60015a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48318/0 (socket says 172.21.15.66:48318) 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 -- 172.21.15.66:0/999244129 learned_addr learned my addr 172.21.15.66:0/999244129 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 -- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 msgr2=0x5644d6001ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d6001ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 -- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 msgr2=0x5644d606bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd454b64640 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d606bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d606bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 -- 172.21.15.66:0/999244129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d5c380f0 con 0x5644d603f720 2024-05-10T11:21:13.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd44ffff640 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d60015a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd44402ac90 tx=0x7fd44402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeee03f8dd0b59b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd435ffb640 1 -- 172.21.15.66:0/999244129 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44404f070 con 0x5644d603f720 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd435ffb640 1 -- 172.21.15.66:0/999244129 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444037040 con 0x5644d603f720 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.737+0000 7fd435ffb640 1 -- 172.21.15.66:0/999244129 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444036040 con 0x5644d603f720 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 -- 172.21.15.66:0/999244129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 msgr2=0x5644d60015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d60015a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd44402ac90 tx=0x7fd44402e000 comp rx=0 tx=0).stop 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 -- 172.21.15.66:0/999244129 shutdown_connections 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d604a160 0x5644d6001ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d60015a0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 --2- 172.21.15.66:0/999244129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d602d280 0x5644d606bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 -- 172.21.15.66:0/999244129 >> 172.21.15.66:0/999244129 conn(0x5644d602cb40 msgr2=0x5644d605b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 -- 172.21.15.66:0/999244129 shutdown_connections 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 -- 172.21.15.66:0/999244129 wait complete. 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.738+0000 7fd459bc0740 1 -- start start 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 Processor -- start 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d602d280 0x5644d60c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d5ffbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d604a160 0x5644d6056dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5644d6041330 con 0x5644d603f720 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5644d5ffd8a0 con 0x5644d604a160 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.739+0000 7fd459bc0740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5644d5f1b6d0 con 0x5644d602d280 2024-05-10T11:21:13.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd459bc0740 10 client.0 _ll_register_callbacks cb 0x7fd444009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d5ffbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d5ffbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48330/0 (socket says 172.21.15.66:48330) 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 -- 172.21.15.66:0/476035198 learned_addr learned my addr 172.21.15.66:0/476035198 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd455365640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d604a160 0x5644d6056dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 -- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d602d280 msgr2=0x5644d60c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd454b64640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d602d280 0x5644d60c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d602d280 0x5644d60c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 -- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d604a160 msgr2=0x5644d6056dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d604a160 0x5644d6056dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 -- 172.21.15.66:0/476035198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d5ffc330 con 0x5644d603f720 2024-05-10T11:21:13.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd44ffff640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d5ffbdf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd44403e000 tx=0x7fd44402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8283e073b5fc4d4e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd42f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd42f7fe640 1 -- 172.21.15.66:0/476035198 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44404f040 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd42f7fe640 1 -- 172.21.15.66:0/476035198 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fd44403cdb0 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd444037040 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd42f7fe640 1 -- 172.21.15.66:0/476035198 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fd444060050 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd459bc0740 10 client.7902 fetch_fsmap learned FSMap version 83 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.740+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5644d604abb0 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd42f7fe640 1 -- 172.21.15.66:0/476035198 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444037040 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd42f7fe640 1 -- 172.21.15.66:0/476035198 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7fd444063020 con 0x5644d603f720 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 10 client.7902 fetch_fsmap finished waiting for FSMap version 83 2024-05-10T11:21:13.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 10 client.7902 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 20 client.7902 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d6057310 0x5644d6000c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 4 client.7902 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 --> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644d5f6e9b0 con 0x5644d6057310 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd454b64640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d6057310 0x5644d6000c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd42f7fe640 10 client.7902 ms_handle_connect on v2:172.21.15.66:6834/159674733 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd454b64640 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d6057310 0x5644d6000c10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f7e7ba833d80eb3 server_cookie=b21e7c27165a9c2b in_seq=0 out_seq=0 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd42f7fe640 1 -- 172.21.15.66:0/476035198 <== mds.0 v2:172.21.15.66:6834/159674733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5644d5f6e9b0 con 0x5644d6057310 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd42f7fe640 10 client.7902 handle_command_reply: tid=0 2024-05-10T11:21:13.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 1 client.7902 shutdown 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 msgr2=0x5644d5ffbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.741+0000 7fd459bc0740 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d5ffbdf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd44403e000 tx=0x7fd44402c000 comp rx=0 tx=0).stop 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 shutdown_connections 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:6834/159674733,v1:172.21.15.66:6835/159674733] conn(0x5644d6057310 0x5644d6000c10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5644d604a160 0x5644d6056dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644d603f720 0x5644d5ffbdf0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd42f7fe640 0 client.7902 ms_handle_reset on v2:172.21.15.66:6834/159674733 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 --2- 172.21.15.66:0/476035198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5644d602d280 0x5644d60c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 >> 172.21.15.66:0/476035198 conn(0x5644d602cb40 msgr2=0x5644d60617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 shutdown_connections 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 1 -- 172.21.15.66:0/476035198 wait complete. 2024-05-10T11:21:13.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd459bc0740 20 client.7902 trim_cache size 0 max 16384 2024-05-10T11:21:13.752 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:21:13.752 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:21:13.752 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:21:13.752 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:21:13.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd43c0762d0 msgr2=0x7fd43c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd43c0762d0 0x7fd43c078790 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd444033000 tx=0x7fd444009000 comp rx=0 tx=0).stop 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 msgr2=0x7fd4501e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 0x7fd4501e6bd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d830 tx=0x7fd44000dcf0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 shutdown_connections 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd43c0762d0 0x7fd43c078790 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450073f20 0x7fd4500b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006c6a0 0x7fd45015dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 --2- 172.21.15.66:0/3833832281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd45006c2c0 0x7fd4501e6bd0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 >> 172.21.15.66:0/3833832281 conn(0x7fd4500d0c90 msgr2=0x7fd4500c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 shutdown_connections 2024-05-10T11:21:13.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.742+0000 7fd456dc8640 1 -- 172.21.15.66:0/3833832281 wait complete. 2024-05-10T11:21:13.756 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:21:13.857 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:21:13.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.963+0000 7f58b65da640 1 Processor -- start 2024-05-10T11:21:13.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.963+0000 7f58b65da640 1 -- start start 2024-05-10T11:21:13.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58b65da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f58b015f4e0 0x7f58b006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58b65da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b00b0a90 con 0x7f58b006e620 2024-05-10T11:21:13.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58b65da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b00b3540 con 0x7f58b015f8c0 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58b65da640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f58b00b23f0 con 0x7f58b015f4e0 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58b4b77640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f58b006e620 0x7f58b00d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43840/0 (socket says 172.21.15.66:43840) 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58b4b77640 1 -- 172.21.15.66:0/1272805320 learned_addr learned my addr 172.21.15.66:0/1272805320 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58affff640 1 --2- 172.21.15.66:0/1272805320 >> v2:172.21.15.190:3300/0 conn(0x7f58b015f4e0 0x7f58b006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869704014 0 0) 0x7f58b00b0a90 con 0x7f58b006e620 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.964+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589c003520 con 0x7f58b006e620 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977025465 0 0) 0x7f58b00b3540 con 0x7f58b015f8c0 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b00b0a90 con 0x7f58b015f8c0 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695186095 0 0) 0x7f589c003520 con 0x7f58b006e620 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58affff640 1 -- 172.21.15.66:0/1272805320 >> v1:172.21.15.190:6789/0 conn(0x7f58b015f8c0 legacy=0x7f58b006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58affff640 1 -- 172.21.15.66:0/1272805320 >> v1:172.21.15.66:6789/0 conn(0x7f58b006e620 legacy=0x7f58b00d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58affff640 1 -- 172.21.15.66:0/1272805320 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b00b3820 con 0x7f58b015f4e0 2024-05-10T11:21:13.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.965+0000 7f58affff640 1 --2- 172.21.15.66:0/1272805320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f4e0 0x7f58b006d9d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f58a00097a0 tx=0x7f58a002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7866338b1a985a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0037070 con 0x7f58b015f4e0 2024-05-10T11:21:13.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a002abc0 con 0x7f58b015f4e0 2024-05-10T11:21:13.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58af7fe640 1 -- 172.21.15.66:0/1272805320 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a80019f0 con 0x7f58b015f4e0 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 -- 172.21.15.66:0/1272805320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f4e0 msgr2=0x7f58b006d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 --2- 172.21.15.66:0/1272805320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f4e0 0x7f58b006d9d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f58a00097a0 tx=0x7f58a002a130 comp rx=0 tx=0).stop 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 -- 172.21.15.66:0/1272805320 shutdown_connections 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 --2- 172.21.15.66:0/1272805320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f4e0 0x7f58b006d9d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 -- 172.21.15.66:0/1272805320 >> 172.21.15.66:0/1272805320 conn(0x7f58b00d2df0 msgr2=0x7f58b00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 -- 172.21.15.66:0/1272805320 shutdown_connections 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.966+0000 7f58b65da640 1 -- 172.21.15.66:0/1272805320 wait complete. 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.967+0000 7f58b65da640 1 Processor -- start 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.967+0000 7f58b65da640 1 -- start start 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58b65da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 0x7f58b01f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58b65da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b015f4e0 0x7f58b0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58b65da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f8c0 0x7f58b0161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58b65da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00b3de0 con 0x7f58b006e620 2024-05-10T11:21:13.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58b65da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00b4150 con 0x7f58b015f8c0 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58b65da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f58b00b45e0 con 0x7f58b015f4e0 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 0x7f58b01f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 0x7f58b01f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48336/0 (socket says 172.21.15.66:48336) 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.968+0000 7f58affff640 1 -- 172.21.15.66:0/3432739351 learned_addr learned my addr 172.21.15.66:0/3432739351 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58b4b77640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f8c0 0x7f58b0161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58a7fff640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b015f4e0 0x7f58b0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58affff640 1 -- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b015f4e0 msgr2=0x7f58b0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58affff640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b015f4e0 0x7f58b0157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58affff640 1 -- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f8c0 msgr2=0x7f58b0161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58affff640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f8c0 0x7f58b0161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58affff640 1 -- 172.21.15.66:0/3432739351 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b0157d30 con 0x7f58b006e620 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58b4b77640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f8c0 0x7f58b0161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:13.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58affff640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 0x7f58b01f45f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f58a0035040 tx=0x7f58a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0041070 con 0x7f58b006e620 2024-05-10T11:21:13.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a003c660 con 0x7f58b006e620 2024-05-10T11:21:13.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b0158010 con 0x7f58b006e620 2024-05-10T11:21:13.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0037040 con 0x7f58b006e620 2024-05-10T11:21:13.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.969+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b0147c20 con 0x7f58b006e620 2024-05-10T11:21:13.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.970+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b006a220 con 0x7f58b006e620 2024-05-10T11:21:13.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.971+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58a0044070 con 0x7f58b006e620 2024-05-10T11:21:13.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.971+0000 7f58ad7fa640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58900762d0 0x7f5890078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:13.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.971+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f58a00b7e40 con 0x7f58b006e620 2024-05-10T11:21:13.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.971+0000 7f58a7fff640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58900762d0 0x7f5890078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:13.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.972+0000 7f58a7fff640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58900762d0 0x7f5890078790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58980010e0 tx=0x7f5898009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:13.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:13.976+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f58a00816a0 con 0x7f58b006e620 2024-05-10T11:21:14.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.206+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f58b00008d0 con 0x7f58b006e620 2024-05-10T11:21:14.207 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:21:14.207+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:21:14.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.208+0000 7f58ad7fa640 1 -- 172.21.15.66:0/3432739351 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7f58a0080fa0 con 0x7f58b006e620 2024-05-10T11:21:14.209 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:21:14.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58900762d0 msgr2=0x7f5890078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58900762d0 0x7f5890078790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58980010e0 tx=0x7f5898009040 comp rx=0 tx=0).stop 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 msgr2=0x7f58b01f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 0x7f58b01f45f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f58a0035040 tx=0x7f58a00046c0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 shutdown_connections 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f58900762d0 0x7f5890078790 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b015f8c0 0x7f58b0161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b015f4e0 0x7f58b0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 --2- 172.21.15.66:0/3432739351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58b006e620 0x7f58b01f45f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 >> 172.21.15.66:0/3432739351 conn(0x7f58b00d2df0 msgr2=0x7f58b00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 shutdown_connections 2024-05-10T11:21:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.211+0000 7f58b65da640 1 -- 172.21.15.66:0/3432739351 wait complete. 2024-05-10T11:21:14.214 INFO:tasks.ceph.mds.c.smithi066.stderr: -7130> 2024-05-10T11:20:32.474+0000 7f93c737b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:21:14.224 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-05-10T11:21:14.247 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:21:14.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 -- start start 2024-05-10T11:21:14.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 Processor -- start 2024-05-10T11:21:14.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 0x55f4736d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f472905800 0x55f4736d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f472905c00 0x55f4736d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f4736a2300 con 0x55f472904c00 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f4736a2480 con 0x55f472905c00 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932f20b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f4736a2600 con 0x55f472905800 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932d9b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 0x55f4736d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932d9b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 0x55f4736d2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48362/0 (socket says 172.21.15.66:48362) 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932d9b7640 1 -- 172.21.15.66:0/1261341134 learned_addr learned my addr 172.21.15.66:0/1261341134 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932e1b8640 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f472905c00 0x55f4736d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.269+0000 7f932d1b6640 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f472905800 0x55f4736d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932d9b7640 1 -- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f472905800 msgr2=0x55f4736d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932d9b7640 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f472905800 0x55f4736d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932d9b7640 1 -- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f472905c00 msgr2=0x55f4736d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932d9b7640 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f472905c00 0x55f4736d2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932d9b7640 1 -- 172.21.15.66:0/1261341134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47293a780 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932d9b7640 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 0x55f4736d2000 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x55f47372b740 tx=0x55f4736a4a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b073643a0ed603 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932b1b2640 1 -- 172.21.15.66:0/1261341134 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f47292a9c0 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932b1b2640 1 -- 172.21.15.66:0/1261341134 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f472930fc0 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932b1b2640 1 -- 172.21.15.66:0/1261341134 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f47292a680 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f47293b4a0 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55f47293a000 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932f20b280 4 waiting for MDS map... 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932b1b2640 1 -- 172.21.15.66:0/1261341134 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(106..106 src has 1..106) ==== 6216+0+0 (secure 0 0 0) 0x55f473710200 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932b1b2640 1 -- 172.21.15.66:0/1261341134 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 84) ==== 2885+0+0 (secure 0 0 0) 0x55f47295f180 con 0x55f472904c00 2024-05-10T11:21:14.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932f20b280 4 Got MDS map 84 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932f20b280 10 main: JournalTool::main 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.270+0000 7f932f20b280 4 main: JournalTool: connecting to RADOS... 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.271+0000 7f932f20b280 1 Processor -- start 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.271+0000 7f932f20b280 1 -- start start 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.271+0000 7f932f20b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932f20b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932f20b280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932f20b280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f4736a2780 con 0x55f473842800 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932f20b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f472966180 con 0x55f473842000 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932f20b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f472966900 con 0x55f473842400 2024-05-10T11:21:14.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48376/0 (socket says 172.21.15.66:48376) 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 -- 172.21.15.66:0/867592404 learned_addr learned my addr 172.21.15.66:0/867592404 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932e1b8640 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d9b7640 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 -- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842400 msgr2=0x55f4736d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 -- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 msgr2=0x55f4736d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 -- 172.21.15.66:0/867592404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47293a3c0 con 0x55f473842800 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932e1b8640 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:14.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f932d1b6640 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 0x55f4736d3b80 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x55f4737e2810 tx=0x55f4737e7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b789e5989e5dfca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f93291ae640 1 -- 172.21.15.66:0/867592404 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f47292a9c0 con 0x55f473842800 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f93291ae640 1 -- 172.21.15.66:0/867592404 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f472930a80 con 0x55f473842800 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.272+0000 7f93291ae640 1 -- 172.21.15.66:0/867592404 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f47292a680 con 0x55f473842800 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 -- 172.21.15.66:0/867592404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 msgr2=0x55f4736d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 0x55f4736d3b80 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x55f4737e2810 tx=0x55f4737e7800 comp rx=0 tx=0).stop 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 -- 172.21.15.66:0/867592404 shutdown_connections 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 --2- 172.21.15.66:0/867592404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 -- 172.21.15.66:0/867592404 >> 172.21.15.66:0/867592404 conn(0x55f4736edc00 msgr2=0x55f4729ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 -- 172.21.15.66:0/867592404 shutdown_connections 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 -- 172.21.15.66:0/867592404 wait complete. 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 Processor -- start 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.273+0000 7f932f20b280 1 -- start start 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932f20b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932f20b280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932f20b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932f20b280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f4736a3380 con 0x55f473842400 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932f20b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f4736a2780 con 0x55f473842000 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932f20b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f4736a3500 con 0x55f473842800 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48390/0 (socket says 172.21.15.66:48390) 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 -- 172.21.15.66:0/3488165429 learned_addr learned my addr 172.21.15.66:0/3488165429 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932e1b8640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d1b6640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 -- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842800 msgr2=0x55f4736d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f473842800 0x55f4736d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 -- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 msgr2=0x55f4736d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f473842000 0x55f4736d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47293a960 con 0x55f473842400 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.274+0000 7f932d9b7640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 0x55f4736d3600 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x55f47372bd40 tx=0x55f4729bcd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.275+0000 7f93279ab640 1 -- 172.21.15.66:0/3488165429 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f47292ab60 con 0x55f473842400 2024-05-10T11:21:14.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.275+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f47293b680 con 0x55f473842400 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.275+0000 7f93279ab640 1 -- 172.21.15.66:0/3488165429 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f472930e00 con 0x55f473842400 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.275+0000 7f93279ab640 1 -- 172.21.15.66:0/3488165429 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f47292a820 con 0x55f473842400 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.275+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f47293b860 con 0x55f473842400 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.275+0000 7f932f20b280 4 main: JournalTool: resolving pool 15 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f93279ab640 1 -- 172.21.15.66:0/3488165429 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55f47385ac00 con 0x55f473842400 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f93279ab640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55f47385d000 0x55f4736d4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f93279ab640 1 -- 172.21.15.66:0/3488165429 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6216+0+0 (secure 0 0 0) 0x55f473849200 con 0x55f473842400 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f932f20b280 4 main: JournalTool: creating IoCtx.. 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f932f20b280 4 main: Executing for rank 0 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f932f20b280 4 Filtering by inode '1099511627777' 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55f473842c00 0x55f4736d4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x55f473843000 con 0x55f473842c00 2024-05-10T11:21:14.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.276+0000 7f932e1b8640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55f47385d000 0x55f4736d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.277+0000 7f932d1b6640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55f473842c00 0x55f4736d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.277+0000 7f932e1b8640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55f47385d000 0x55f4736d4100 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x55f473692cf0 tx=0x55f472c2ac60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.277+0000 7f932d1b6640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55f473842c00 0x55f4736d4680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.280+0000 7f932d1b6640 1 -- 172.21.15.66:0/3488165429 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55f472a12000 con 0x55f473842c00 2024-05-10T11:21:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.280+0000 7f932f20b280 4 Pointer 400.00000000 is readable 2024-05-10T11:21:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.280+0000 7f932f20b280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-10T11:21:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.280+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x55f473843c00 con 0x55f473842c00 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.281+0000 7f932d1b6640 1 -- 172.21.15.66:0/3488165429 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55f472a12000 con 0x55f473842c00 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.281+0000 7f932f20b280 10 Header 0x400000 0x407d21 0x40809d 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.281+0000 7f932f20b280 10 Starting journal scan from offset 0x407d21 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.281+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x55f473843400 con 0x55f473842c00 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932d1b6640 1 -- 172.21.15.66:0/3488165429 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x55f472a12000 con 0x55f473842c00 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 10 Parsing data, 0x37c bytes available 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 10 Attempting decode at 0x407d21 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 10 Consumed 0x37c bytes 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 10 Valid entry at 0x407d21 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55f473843800 0x55f4736d4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x55f473843000 con 0x55f473843800 2024-05-10T11:21:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932e1b8640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55f473843800 0x55f4736d4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932e1b8640 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55f473843800 0x55f4736d4c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932e1b8640 1 -- 172.21.15.66:0/3488165429 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f472a12500 con 0x55f473843800 2024-05-10T11:21:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 Reached end of journal objects 2024-05-10T11:21:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 Scanned objects, 0 missing, 1 valid 2024-05-10T11:21:14.292 INFO:teuthology.orchestra.run.smithi066.stdout:Events by type: 2024-05-10T11:21:14.292 INFO:teuthology.orchestra.run.smithi066.stdout:Errors: 0 2024-05-10T11:21:14.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 Events scanned, 0 gaps 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 Found 1 valid events 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 Selected 0 events events for processing 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.282+0000 7f932f20b280 4 0 events 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55f473842c00 msgr2=0x55f4736d4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55f473842c00 0x55f4736d4680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55f473843800 msgr2=0x55f4736d4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55f473843800 0x55f4736d4c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55f47385d000 msgr2=0x55f4736d4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55f47385d000 0x55f4736d4100 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x55f473692cf0 tx=0x55f472c2ac60 comp rx=0 tx=0).stop 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 msgr2=0x55f4736d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 0x55f4736d3600 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x55f47372bd40 tx=0x55f4729bcd80 comp rx=0 tx=0).stop 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932d1b6640 1 -- 172.21.15.66:0/3488165429 reap_dead start 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 shutdown_connections 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/3488165429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f473842400 0x55f4736d3600 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 >> 172.21.15.66:0/3488165429 conn(0x55f4736edc00 msgr2=0x55f4729ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 shutdown_connections 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/3488165429 wait complete. 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 msgr2=0x55f4736d2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 0x55f4736d2000 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x55f47372b740 tx=0x55f4736a4a80 comp rx=0 tx=0).stop 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 shutdown_connections 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f472905c00 0x55f4736d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f472905800 0x55f4736d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 --2- 172.21.15.66:0/1261341134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f472904c00 0x55f4736d2000 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 >> 172.21.15.66:0/1261341134 conn(0x55f472905000 msgr2=0x55f4729fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 shutdown_connections 2024-05-10T11:21:14.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.283+0000 7f932f20b280 1 -- 172.21.15.66:0/1261341134 wait complete. 2024-05-10T11:21:14.299 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.075009, result: Events by type: Errors: 0 2024-05-10T11:21:14.299 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-05-10T11:21:14.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.380+0000 7f6af1f60280 1 -- start start 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.380+0000 7f6af1f60280 1 Processor -- start 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed6402c00 0x558ed71c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 0x558ed71c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed6403c00 0x558ed71c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af1f60280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558ed657c180 con 0x558ed6403800 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af1f60280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558ed657c300 con 0x558ed6403c00 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af1f60280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558ed657c480 con 0x558ed6402c00 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 0x558ed71c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 0x558ed71c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48394/0 (socket says 172.21.15.66:48394) 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 -- 172.21.15.66:0/151825590 learned_addr learned my addr 172.21.15.66:0/151825590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed6403c00 0x558ed71c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af070c640 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed6402c00 0x558ed71c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 -- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed6402c00 msgr2=0x558ed71c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed6402c00 0x558ed71c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 -- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed6403c00 msgr2=0x558ed71c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed6403c00 0x558ed71c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 -- 172.21.15.66:0/151825590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed6438780 con 0x558ed6403800 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed6403c00 0x558ed71c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 0x558ed71c8580 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x558ed7223740 tx=0x558ed71a2a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50478dd3d244dae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aedf07640 1 -- 172.21.15.66:0/151825590 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ed64289c0 con 0x558ed6403800 2024-05-10T11:21:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aedf07640 1 -- 172.21.15.66:0/151825590 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558ed642efc0 con 0x558ed6403800 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.381+0000 7f6aedf07640 1 -- 172.21.15.66:0/151825590 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ed6428680 con 0x558ed6403800 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed64383c0 con 0x558ed6403800 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558ed6439680 con 0x558ed6403800 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 4 waiting for MDS map... 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6aedf07640 1 -- 172.21.15.66:0/151825590 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(106..106 src has 1..106) ==== 6216+0+0 (secure 0 0 0) 0x558ed72e6200 con 0x558ed6403800 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6aedf07640 1 -- 172.21.15.66:0/151825590 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 84) ==== 2885+0+0 (secure 0 0 0) 0x558ed645d180 con 0x558ed6403800 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 4 Got MDS map 84 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 10 main: JournalTool::main 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 4 main: JournalTool: connecting to RADOS... 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 1 Processor -- start 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.382+0000 7f6af1f60280 1 -- start start 2024-05-10T11:21:14.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af1f60280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558ed657c600 con 0x558ed732e800 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af1f60280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558ed657c780 con 0x558ed732e400 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af1f60280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558ed657c900 con 0x558ed732e000 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48396/0 (socket says 172.21.15.66:48396) 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 -- 172.21.15.66:0/2300759023 learned_addr learned my addr 172.21.15.66:0/2300759023 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6af070c640 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 -- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e000 msgr2=0x558ed71c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 -- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 msgr2=0x558ed71c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.383+0000 7f6aeff0b640 1 -- 172.21.15.66:0/2300759023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed64394a0 con 0x558ed732e800 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 0x558ed71c9b80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x558ed7223d40 tx=0x558ed71a3f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3b30dcdd1de894 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6aebf03640 1 -- 172.21.15.66:0/2300759023 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ed6428b60 con 0x558ed732e800 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6aebf03640 1 -- 172.21.15.66:0/2300759023 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558ed642ee00 con 0x558ed732e800 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6aebf03640 1 -- 172.21.15.66:0/2300759023 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ed6428820 con 0x558ed732e800 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 -- 172.21.15.66:0/2300759023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 msgr2=0x558ed71c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 0x558ed71c9b80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x558ed7223d40 tx=0x558ed71a3f20 comp rx=0 tx=0).stop 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 -- 172.21.15.66:0/2300759023 shutdown_connections 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 --2- 172.21.15.66:0/2300759023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 -- 172.21.15.66:0/2300759023 >> 172.21.15.66:0/2300759023 conn(0x558ed71a1c00 msgr2=0x558ed64fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 -- 172.21.15.66:0/2300759023 shutdown_connections 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.384+0000 7f6af1f60280 1 -- 172.21.15.66:0/2300759023 wait complete. 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 Processor -- start 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 -- start start 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558ed657d500 con 0x558ed732e000 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558ed657ca80 con 0x558ed732e400 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af1f60280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558ed657d680 con 0x558ed732e800 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af0f0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af0f0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e000 0x558ed71c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48402/0 (socket says 172.21.15.66:48402) 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af0f0d640 1 -- 172.21.15.66:0/1192683048 learned_addr learned my addr 172.21.15.66:0/1192683048 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.385+0000 7f6af070c640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af0f0d640 1 -- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e800 msgr2=0x558ed71c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af0f0d640 1 -- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 msgr2=0x558ed71c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed732e400 0x558ed71c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af0f0d640 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed6438000 con 0x558ed732e000 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed732e800 0x558ed71c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e000 0x558ed71c9080 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x558ed72e9bf0 tx=0x558ed72ef800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6aea700640 1 -- 172.21.15.66:0/1192683048 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ed6428b60 con 0x558ed732e000 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6aea700640 1 -- 172.21.15.66:0/1192683048 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558ed642ea80 con 0x558ed732e000 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ed6438960 con 0x558ed732e000 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6aea700640 1 -- 172.21.15.66:0/1192683048 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ed6428820 con 0x558ed732e000 2024-05-10T11:21:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed6439860 con 0x558ed732e000 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.386+0000 7f6af1f60280 4 main: JournalTool: resolving pool 15 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.387+0000 7f6aea700640 1 -- 172.21.15.66:0/1192683048 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x558ed7346c00 con 0x558ed732e000 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6aea700640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x558ed7354c00 0x558ed71ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6aea700640 1 -- 172.21.15.66:0/1192683048 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6216+0+0 (secure 0 0 0) 0x558ed7335000 con 0x558ed732e000 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af1f60280 4 main: JournalTool: creating IoCtx.. 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af1f60280 4 main: Executing for rank 0 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af1f60280 4 Filtering by inode '1099511627778' 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af1f60280 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x558ed732ec00 0x558ed71ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558ed732f000 con 0x558ed732ec00 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af070c640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x558ed7354c00 0x558ed71ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x558ed732ec00 0x558ed71ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6af070c640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x558ed7354c00 0x558ed71ca100 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x558ed7190d80 tx=0x558ed671cba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.388+0000 7f6aeff0b640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x558ed732ec00 0x558ed71ca680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6aeff0b640 1 -- 172.21.15.66:0/1192683048 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x558ed6510000 con 0x558ed732ec00 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 4 Pointer 400.00000000 is readable 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558ed7355c00 con 0x558ed732ec00 2024-05-10T11:21:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6aeff0b640 1 -- 172.21.15.66:0/1192683048 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x558ed6510000 con 0x558ed732ec00 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 10 Header 0x400000 0x407d21 0x40809d 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 10 Starting journal scan from offset 0x407d21 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558ed670e000 con 0x558ed732ec00 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6aeff0b640 1 -- 172.21.15.66:0/1192683048 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x558ed6510000 con 0x558ed732ec00 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 10 Parsing data, 0x37c bytes available 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 10 Attempting decode at 0x407d21 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 10 Consumed 0x37c bytes 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 10 Valid entry at 0x407d21 2024-05-10T11:21:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x558ed670e400 0x558ed71cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.389+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558ed670e800 con 0x558ed670e400 2024-05-10T11:21:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x558ed670e400 0x558ed71cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af0f0d640 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x558ed670e400 0x558ed71cac00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af0f0d640 1 -- 172.21.15.66:0/1192683048 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x558ed6510500 con 0x558ed670e400 2024-05-10T11:21:14.402 INFO:teuthology.orchestra.run.smithi066.stdout:Events by type: 2024-05-10T11:21:14.403 INFO:teuthology.orchestra.run.smithi066.stdout:Errors: 0 2024-05-10T11:21:14.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 4 Reached end of journal objects 2024-05-10T11:21:14.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 4 Scanned objects, 0 missing, 1 valid 2024-05-10T11:21:14.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 4 Events scanned, 0 gaps 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 4 Found 1 valid events 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 4 Selected 0 events events for processing 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 4 0 events 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x558ed732ec00 msgr2=0x558ed71ca680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x558ed732ec00 0x558ed71ca680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x558ed670e400 msgr2=0x558ed71cac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x558ed670e400 0x558ed71cac00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x558ed7354c00 msgr2=0x558ed71ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x558ed7354c00 0x558ed71ca100 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x558ed7190d80 tx=0x558ed671cba0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e000 msgr2=0x558ed71c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 --2- 172.21.15.66:0/1192683048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed732e000 0x558ed71c9080 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x558ed72e9bf0 tx=0x558ed72ef800 comp rx=0 tx=0).stop 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af070c640 1 -- 172.21.15.66:0/1192683048 reap_dead start 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 shutdown_connections 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 >> 172.21.15.66:0/1192683048 conn(0x558ed71a1c00 msgr2=0x558ed64fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.390+0000 7f6af070c640 1 -- 172.21.15.66:0/1192683048 reap_dead start 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 shutdown_connections 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/1192683048 wait complete. 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 msgr2=0x558ed71c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 0x558ed71c8580 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x558ed7223740 tx=0x558ed71a2a20 comp rx=0 tx=0).stop 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 shutdown_connections 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ed6403c00 0x558ed71c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed6403800 0x558ed71c8580 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 --2- 172.21.15.66:0/151825590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ed6402c00 0x558ed71c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 >> 172.21.15.66:0/151825590 conn(0x558ed6403000 msgr2=0x558ed64fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 shutdown_connections 2024-05-10T11:21:14.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.391+0000 7f6af1f60280 1 -- 172.21.15.66:0/151825590 wait complete. 2024-05-10T11:21:14.408 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.108842, result: Events by type: Errors: 0 2024-05-10T11:21:14.408 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-05-10T11:21:14.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.454+0000 7ff5c365cf40 1 Processor -- start 2024-05-10T11:21:14.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.454+0000 7ff5c365cf40 1 -- start start 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c365cf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a9cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c365cf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a9d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c365cf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa29cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c365cf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ffa29fdc40 con 0x55ffa2aa3230 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c365cf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ffa2976f50 con 0x55ffa2aa3610 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c365cf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ffa29fce80 con 0x55ffa2a19380 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a9d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a9d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48406/0 (socket says 172.21.15.66:48406) 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 -- 172.21.15.66:0/466483608 learned_addr learned my addr 172.21.15.66:0/466483608 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c1156640 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a9cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c1957640 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa29cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 -- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 msgr2=0x55ffa2a9cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a9cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 -- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 msgr2=0x55ffa29cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa29cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 -- 172.21.15.66:0/466483608 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffa2aa20e0 con 0x55ffa2aa3230 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5c0955640 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a9d850 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8025bc0 tx=0x7ff5b804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6009d40fca5ce5bc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5b37fe640 1 -- 172.21.15.66:0/466483608 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8059040 con 0x55ffa2aa3230 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5b37fe640 1 -- 172.21.15.66:0/466483608 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b8065070 con 0x55ffa2aa3230 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.455+0000 7ff5b37fe640 1 -- 172.21.15.66:0/466483608 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8054c30 con 0x55ffa2aa3230 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 -- 172.21.15.66:0/466483608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 msgr2=0x55ffa2a9d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a9d850 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8025bc0 tx=0x7ff5b804e000 comp rx=0 tx=0).stop 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 -- 172.21.15.66:0/466483608 shutdown_connections 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa29cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a9d850 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/466483608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a9cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 -- 172.21.15.66:0/466483608 >> 172.21.15.66:0/466483608 conn(0x55ffa29cf040 msgr2=0x55ffa29cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 -- 172.21.15.66:0/466483608 shutdown_connections 2024-05-10T11:21:14.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.456+0000 7ff5c365cf40 1 -- 172.21.15.66:0/466483608 wait complete. 2024-05-10T11:21:14.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 Processor -- start 2024-05-10T11:21:14.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 -- start start 2024-05-10T11:21:14.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a8be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a14930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa2a8b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ffa2a9d0c0 con 0x55ffa2aa3230 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ffa29cd290 con 0x55ffa2aa3610 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c365cf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ffa2aa1b20 con 0x55ffa2a19380 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c0955640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a14930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c0955640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a14930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48410/0 (socket says 172.21.15.66:48410) 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.457+0000 7ff5c0955640 1 -- 172.21.15.66:0/833029629 learned_addr learned my addr 172.21.15.66:0/833029629 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c1156640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a8be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c1957640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa2a8b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c0955640 1 -- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 msgr2=0x55ffa2a8be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c0955640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ffa2a19380 0x55ffa2a8be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c0955640 1 -- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 msgr2=0x55ffa2a8b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c0955640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffa2aa3610 0x55ffa2a8b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c0955640 1 -- 172.21.15.66:0/833029629 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffa2a8c380 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c0955640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a14930 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8061000 tx=0x7ff5b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5b27fc640 1 -- 172.21.15.66:0/833029629 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8070070 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5b27fc640 1 -- 172.21.15.66:0/833029629 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b8054c90 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffa2b40b10 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5b27fc640 1 -- 172.21.15.66:0/833029629 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8059040 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.458+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffa2b410d0 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.460+0000 7ff5b27fc640 1 -- 172.21.15.66:0/833029629 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff5b8073070 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.460+0000 7ff5b27fc640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5a4074cb0 0x7ff5a4077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.460+0000 7ff5b27fc640 1 -- 172.21.15.66:0/833029629 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6216+0+0 (secure 0 0 0) 0x7ff5b80dab90 con 0x55ffa2aa3230 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.461+0000 7ff5c1156640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5a4074cb0 0x7ff5a4077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.461+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55ffa2a15760 0x55ffa2aa5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.461+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x55ffa2aa5980 con 0x55ffa2a15760 2024-05-10T11:21:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.461+0000 7ff5c1957640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55ffa2a15760 0x55ffa2aa5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.461+0000 7ff5c1156640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5a4074cb0 0x7ff5a4077170 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40056f0 tx=0x7ff5b400c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.461+0000 7ff5c1957640 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55ffa2a15760 0x55ffa2aa5440 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.462+0000 7ff5c1957640 1 -- 172.21.15.66:0/833029629 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v106'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc003450 con 0x55ffa2a15760 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.462+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55ffa2a15760 msgr2=0x55ffa2aa5440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.462+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55ffa2a15760 0x55ffa2aa5440 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.462+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5a4074cb0 msgr2=0x7ff5a4077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5a4074cb0 0x7ff5a4077170 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40056f0 tx=0x7ff5b400c040 comp rx=0 tx=0).stop 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 msgr2=0x55ffa2a14930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 --2- 172.21.15.66:0/833029629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ffa2aa3230 0x55ffa2a14930 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8061000 tx=0x7ff5b8002fb0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c1957640 1 -- 172.21.15.66:0/833029629 reap_dead start 2024-05-10T11:21:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 shutdown_connections 2024-05-10T11:21:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 >> 172.21.15.66:0/833029629 conn(0x55ffa29cf040 msgr2=0x55ffa29cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 shutdown_connections 2024-05-10T11:21:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.463+0000 7ff5c365cf40 1 -- 172.21.15.66:0/833029629 wait complete. 2024-05-10T11:21:14.467 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T11:21:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.614+0000 7f8c37e85640 1 Processor -- start 2024-05-10T11:21:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.614+0000 7f8c37e85640 1 -- start start 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c37e85640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c300d3df0 0x7f8c300d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c37e85640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c300d41d0 con 0x7f8c300d2120 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c37e85640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c300b54f0 con 0x7f8c300b4aa0 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c37e85640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8c300cfd50 con 0x7f8c300d3df0 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c35c21640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c300d3df0 0x7f8c300d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c36422640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8c300d2120 0x7f8c300d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:43866/0 (socket says 172.21.15.66:43866) 2024-05-10T11:21:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.615+0000 7f8c36422640 1 -- 172.21.15.66:0/3823028241 learned_addr learned my addr 172.21.15.66:0/3823028241 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:14.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c35c21640 1 -- 172.21.15.66:0/3823028241 >> v1:172.21.15.190:6789/0 conn(0x7f8c300b4aa0 legacy=0x7f8c300d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c35c21640 1 -- 172.21.15.66:0/3823028241 >> v1:172.21.15.66:6789/0 conn(0x7f8c300d2120 legacy=0x7f8c300d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c35c21640 1 -- 172.21.15.66:0/3823028241 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c300b57d0 con 0x7f8c300d3df0 2024-05-10T11:21:14.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c34c1f640 1 -- 172.21.15.66:0/3823028241 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236044313 0 0) 0x7f8c300d41d0 con 0x7f8c300d2120 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c35c21640 1 --2- 172.21.15.66:0/3823028241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300d2d10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097a0 tx=0x7f8c2c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2486a0e0f33e4cce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c34c1f640 1 -- 172.21.15.66:0/3823028241 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c037070 con 0x7f8c300d3df0 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c34c1f640 1 -- 172.21.15.66:0/3823028241 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c032440 con 0x7f8c300d3df0 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.616+0000 7f8c34c1f640 1 -- 172.21.15.66:0/3823028241 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c032810 con 0x7f8c300d3df0 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 -- 172.21.15.66:0/3823028241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 msgr2=0x7f8c300d2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3823028241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300d2d10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097a0 tx=0x7f8c2c02a230 comp rx=0 tx=0).stop 2024-05-10T11:21:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 -- 172.21.15.66:0/3823028241 shutdown_connections 2024-05-10T11:21:14.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3823028241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300d2d10 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 -- 172.21.15.66:0/3823028241 >> 172.21.15.66:0/3823028241 conn(0x7f8c3009e450 msgr2=0x7f8c300d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:14.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 -- 172.21.15.66:0/3823028241 shutdown_connections 2024-05-10T11:21:14.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.617+0000 7f8c37e85640 1 -- 172.21.15.66:0/3823028241 wait complete. 2024-05-10T11:21:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.618+0000 7f8c37e85640 1 Processor -- start 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.618+0000 7f8c37e85640 1 -- start start 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c37e85640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c300b4aa0 0x7f8c300d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c37e85640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c300d2120 0x7f8c300cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c37e85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300ba620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c37e85640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c300cff80 con 0x7f8c300d3df0 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c37e85640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8c300b5d90 con 0x7f8c300b4aa0 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c37e85640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8c300b6120 con 0x7f8c300d2120 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c36422640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300ba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c36422640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300ba620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48418/0 (socket says 172.21.15.66:48418) 2024-05-10T11:21:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c36422640 1 -- 172.21.15.66:0/3534403926 learned_addr learned my addr 172.21.15.66:0/3534403926 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c35c21640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c300b4aa0 0x7f8c300d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c36422640 1 -- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c300d2120 msgr2=0x7f8c300cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.619+0000 7f8c35420640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c300d2120 0x7f8c300cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c36422640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c300d2120 0x7f8c300cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c36422640 1 -- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c300b4aa0 msgr2=0x7f8c300d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c36422640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c300b4aa0 0x7f8c300d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c36422640 1 -- 172.21.15.66:0/3534403926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c300d1550 con 0x7f8c300d3df0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c36422640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300ba620 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c780 tx=0x7f8c2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28018070 con 0x7f8c300d3df0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2800a640 con 0x7f8c300d3df0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800aab0 con 0x7f8c300d3df0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c300b9860 con 0x7f8c300d3df0 2024-05-10T11:21:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.620+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c300b9e20 con 0x7f8c300d3df0 2024-05-10T11:21:14.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.621+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3006a220 con 0x7f8c300d3df0 2024-05-10T11:21:14.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.622+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c2800ac50 con 0x7f8c300d3df0 2024-05-10T11:21:14.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.622+0000 7f8c267fc640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c140762d0 0x7f8c14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:14.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.622+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6216+0+0 (secure 0 0 0) 0x7f8c28096dd0 con 0x7f8c300d3df0 2024-05-10T11:21:14.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.622+0000 7f8c35c21640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c140762d0 0x7f8c14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:14.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.623+0000 7f8c35c21640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c140762d0 0x7f8c14078790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c034000 tx=0x7f8c2c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:14.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.626+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8c280605c0 con 0x7f8c300d3df0 2024-05-10T11:21:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:14.857+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f8c300d27c0 con 0x7f8c300d3df0 2024-05-10T11:21:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.210+0000 7f8c267fc640 1 -- 172.21.15.66:0/3534403926 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v85) ==== 162+0+0 (secure 0 0 0) 0x7f8c280980b0 con 0x7f8c300d3df0 2024-05-10T11:21:15.211 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c140762d0 msgr2=0x7f8c14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c140762d0 0x7f8c14078790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c034000 tx=0x7f8c2c02e000 comp rx=0 tx=0).stop 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 msgr2=0x7f8c300ba620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300ba620 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c780 tx=0x7f8c2800cc40 comp rx=0 tx=0).stop 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 shutdown_connections 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8c140762d0 0x7f8c14078790 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c300d3df0 0x7f8c300ba620 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c300d2120 0x7f8c300cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 --2- 172.21.15.66:0/3534403926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c300b4aa0 0x7f8c300d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 >> 172.21.15.66:0/3534403926 conn(0x7f8c3009e450 msgr2=0x7f8c301ea510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 shutdown_connections 2024-05-10T11:21:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.213+0000 7f8c37e85640 1 -- 172.21.15.66:0/3534403926 wait complete. 2024-05-10T11:21:15.230 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.334+0000 7f14647e4640 1 Processor -- start 2024-05-10T11:21:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.334+0000 7f14647e4640 1 -- start start 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f14647e4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f145c15f3b0 0x7f145c0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f14647e4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c15f790 0x7f145c0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f14647e4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f145c0d5d30 0x7f145c0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f14647e4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f145c0d30b0 con 0x7f145c0d5d30 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f14647e4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f145c0d3390 con 0x7f145c15f3b0 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f14647e4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f145c0c8c80 con 0x7f145c15f790 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f1462d81640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f145c0d5d30 0x7f145c0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f1462d81640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f145c0d5d30 0x7f145c0c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42620/0 (socket says 172.21.15.66:42620) 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.335+0000 7f1462d81640 1 -- 172.21.15.66:0/2468651540 learned_addr learned my addr 172.21.15.66:0/2468651540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1461d7f640 1 --2- 172.21.15.66:0/2468651540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c15f790 0x7f145c0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462580640 1 --2- 172.21.15.66:0/2468651540 >> v2:172.21.15.190:3300/0 conn(0x7f145c15f3b0 0x7f145c0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462d81640 1 -- 172.21.15.66:0/2468651540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c15f790 msgr2=0x7f145c0d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462d81640 1 --2- 172.21.15.66:0/2468651540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c15f790 0x7f145c0d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462d81640 1 -- 172.21.15.66:0/2468651540 >> v2:172.21.15.190:3300/0 conn(0x7f145c15f3b0 msgr2=0x7f145c0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462d81640 1 --2- 172.21.15.66:0/2468651540 >> v2:172.21.15.190:3300/0 conn(0x7f145c15f3b0 0x7f145c0d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462d81640 1 -- 172.21.15.66:0/2468651540 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c0c8f60 con 0x7f145c0d5d30 2024-05-10T11:21:15.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.336+0000 7f1462d81640 1 --2- 172.21.15.66:0/2468651540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c0d5d30 0x7f145c0c9760 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f145c08e820 tx=0x7f144c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890782fcf435ac3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f146157e640 1 -- 172.21.15.66:0/2468651540 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c037070 con 0x7f145c0d5d30 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f146157e640 1 -- 172.21.15.66:0/2468651540 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144c032440 con 0x7f145c0d5d30 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f146157e640 1 -- 172.21.15.66:0/2468651540 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c032810 con 0x7f145c0d5d30 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 -- 172.21.15.66:0/2468651540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c0d5d30 msgr2=0x7f145c0c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 --2- 172.21.15.66:0/2468651540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c0d5d30 0x7f145c0c9760 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f145c08e820 tx=0x7f144c02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 -- 172.21.15.66:0/2468651540 shutdown_connections 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 --2- 172.21.15.66:0/2468651540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c0d5d30 0x7f145c0c9760 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 --2- 172.21.15.66:0/2468651540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c15f790 0x7f145c0d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 --2- 172.21.15.66:0/2468651540 >> v2:172.21.15.190:3300/0 conn(0x7f145c15f3b0 0x7f145c0d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 -- 172.21.15.66:0/2468651540 >> 172.21.15.66:0/2468651540 conn(0x7f145c0d5130 msgr2=0x7f145c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 -- 172.21.15.66:0/2468651540 shutdown_connections 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.337+0000 7f14647e4640 1 -- 172.21.15.66:0/2468651540 wait complete. 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.338+0000 7f14647e4640 1 Processor -- start 2024-05-10T11:21:15.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.338+0000 7f14647e4640 1 -- start start 2024-05-10T11:21:15.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f14647e4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c0d5d30 0x7f145c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f14647e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 0x7f145c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f14647e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f145c0ce2d0 0x7f145c09ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f14647e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f145c0c9e20 con 0x7f145c15f3b0 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f14647e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f145c0c9ca0 con 0x7f145c0ce2d0 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f14647e4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f145c0c9fa0 con 0x7f145c0d5d30 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f1461d7f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 0x7f145c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f1461d7f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 0x7f145c0cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42634/0 (socket says 172.21.15.66:42634) 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f1461d7f640 1 -- 172.21.15.66:0/4614927 learned_addr learned my addr 172.21.15.66:0/4614927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f1462580640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c0d5d30 0x7f145c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.339+0000 7f1462d81640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f145c0ce2d0 0x7f145c09ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f1461d7f640 1 -- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c0d5d30 msgr2=0x7f145c14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f1461d7f640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c0d5d30 0x7f145c14d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f1461d7f640 1 -- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f145c0ce2d0 msgr2=0x7f145c09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f1461d7f640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f145c0ce2d0 0x7f145c09ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f1461d7f640 1 -- 172.21.15.66:0/4614927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c09fa20 con 0x7f145c15f3b0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f1461d7f640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 0x7f145c0cdd90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f145000d600 tx=0x7f145000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450004240 con 0x7f145c15f3b0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14500043e0 con 0x7f145c15f3b0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c09fd00 con 0x7f145c15f3b0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450003830 con 0x7f145c15f3b0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.340+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c14e320 con 0x7f145c15f3b0 2024-05-10T11:21:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.341+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145c0ce6e0 con 0x7f145c15f3b0 2024-05-10T11:21:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.342+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f14500039d0 con 0x7f145c15f3b0 2024-05-10T11:21:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.342+0000 7f145affd640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14480762d0 0x7f1448078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.342+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f1450097a00 con 0x7f145c15f3b0 2024-05-10T11:21:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.342+0000 7f1462580640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14480762d0 0x7f1448078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.343+0000 7f1462580640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14480762d0 0x7f1448078790 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1454003aa0 tx=0x7f1454009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:15.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.346+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f145c0ce6e0 con 0x7f145c15f3b0 2024-05-10T11:21:15.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.583+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f145c06a220 con 0x7f145c15f3b0 2024-05-10T11:21:15.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.583+0000 7f145affd640 1 -- 172.21.15.66:0/4614927 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5181 (secure 0 0 0) 0x7f1450060a80 con 0x7f145c15f3b0 2024-05-10T11:21:15.584 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:15.584 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":86,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:15.214211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":86,"state":"up:replay","state_seq":1,"addr":"172.21.15.66:6835/3403431174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":3403431174},{"type":"v1","addr":"172.21.15.66:6835","nonce":3403431174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T11:21:15.584 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 86 2024-05-10T11:21:15.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14480762d0 msgr2=0x7f1448078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14480762d0 0x7f1448078790 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1454003aa0 tx=0x7f1454009830 comp rx=0 tx=0).stop 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 msgr2=0x7f145c0cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 0x7f145c0cdd90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f145000d600 tx=0x7f145000dac0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 shutdown_connections 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f14480762d0 0x7f1448078790 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f145c0ce2d0 0x7f145c09ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145c15f3b0 0x7f145c0cdd90 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 --2- 172.21.15.66:0/4614927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f145c0d5d30 0x7f145c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 >> 172.21.15.66:0/4614927 conn(0x7f145c0d5130 msgr2=0x7f145c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 shutdown_connections 2024-05-10T11:21:15.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:15.585+0000 7f14647e4640 1 -- 172.21.15.66:0/4614927 wait complete. 2024-05-10T11:21:16.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:20:30.866393+0000', 'modified': '2024-05-10T11:21:15.214211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7917': {'gid': 7917, 'name': 'c', 'rank': 0, 'incarnation': 86, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/3403431174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 3403431174}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 3403431174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:21:16.000 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7917:up:replay 2024-05-10T11:21:17.001 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 Processor -- start 2024-05-10T11:21:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 -- start start 2024-05-10T11:21:17.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f819c15f390 0x7f819c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:17.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f819c0d5190 0x7f819c0d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819c0cfd10 con 0x7f819c0b4c00 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f819c0cff90 con 0x7f819c0d5190 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.118+0000 7f81a2a47640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f819c163d00 con 0x7f819c15f390 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f819c0d5190 0x7f819c0d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f819c0d5190 0x7f819c0d55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42642/0 (socket says 172.21.15.66:42642) 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 -- 172.21.15.66:0/2828656290 learned_addr learned my addr 172.21.15.66:0/2828656290 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f819bfff640 1 --2- 172.21.15.66:0/2828656290 >> v2:172.21.15.190:3300/0 conn(0x7f819c15f390 0x7f819c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 -- 172.21.15.66:0/2828656290 >> v2:172.21.15.190:3300/0 conn(0x7f819c15f390 msgr2=0x7f819c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 --2- 172.21.15.66:0/2828656290 >> v2:172.21.15.190:3300/0 conn(0x7f819c15f390 0x7f819c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 -- 172.21.15.66:0/2828656290 >> v1:172.21.15.190:6789/0 conn(0x7f819c0b4c00 legacy=0x7f819c0b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.119+0000 7f8193fff640 1 -- 172.21.15.66:0/2828656290 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c0d0250 con 0x7f819c0d5190 2024-05-10T11:21:17.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.120+0000 7f8193fff640 1 --2- 172.21.15.66:0/2828656290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0d5190 0x7f819c0d55e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f819c0d2d60 tx=0x7f818402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38df7bc7ccf1dd73 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.120+0000 7f819b7fe640 1 -- 172.21.15.66:0/2828656290 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184037070 con 0x7f819c0d5190 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.120+0000 7f819b7fe640 1 -- 172.21.15.66:0/2828656290 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8184032440 con 0x7f819c0d5190 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.120+0000 7f819b7fe640 1 -- 172.21.15.66:0/2828656290 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184032810 con 0x7f819c0d5190 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 -- 172.21.15.66:0/2828656290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0d5190 msgr2=0x7f819c0d55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 --2- 172.21.15.66:0/2828656290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0d5190 0x7f819c0d55e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f819c0d2d60 tx=0x7f818402a270 comp rx=0 tx=0).stop 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 -- 172.21.15.66:0/2828656290 shutdown_connections 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 --2- 172.21.15.66:0/2828656290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0d5190 0x7f819c0d55e0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 --2- 172.21.15.66:0/2828656290 >> v2:172.21.15.190:3300/0 conn(0x7f819c15f390 0x7f819c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 -- 172.21.15.66:0/2828656290 >> 172.21.15.66:0/2828656290 conn(0x7f819c08ecb0 msgr2=0x7f819c09e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:17.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 -- 172.21.15.66:0/2828656290 shutdown_connections 2024-05-10T11:21:17.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.121+0000 7f81a2a47640 1 -- 172.21.15.66:0/2828656290 wait complete. 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.122+0000 7f81a2a47640 1 Processor -- start 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.122+0000 7f81a2a47640 1 -- start start 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a2a47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 0x7f819c15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a2a47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f819c0d5190 0x7f819c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a2a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819c15f390 0x7f819c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a2a47640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f819c0d0f90 con 0x7f819c0b4c00 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a2a47640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f819c0d5b20 con 0x7f819c0d5190 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a2a47640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f819c0d1110 con 0x7f819c15f390 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 0x7f819c15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:17.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 0x7f819c15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42648/0 (socket says 172.21.15.66:42648) 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 -- 172.21.15.66:0/754660496 learned_addr learned my addr 172.21.15.66:0/754660496 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f81a0fe4640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819c15f390 0x7f819c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 -- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819c15f390 msgr2=0x7f819c0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f8193fff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f819c0d5190 0x7f819c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819c15f390 0x7f819c0b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 -- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f819c0d5190 msgr2=0x7f819c15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f819c0d5190 0x7f819c15a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 -- 172.21.15.66:0/754660496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c0b8a30 con 0x7f819c0b4c00 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f8193fff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f819c0d5190 0x7f819c15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.123+0000 7f819bfff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 0x7f819c15f770 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f818c00d620 tx=0x7f818c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.124+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c00b620 con 0x7f819c0b4c00 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.124+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818c019070 con 0x7f819c0b4c00 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.124+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819c0b8d10 con 0x7f819c0b4c00 2024-05-10T11:21:17.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.124+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c00ba00 con 0x7f819c0b4c00 2024-05-10T11:21:17.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.124+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819c0b92d0 con 0x7f819c0b4c00 2024-05-10T11:21:17.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.125+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f819c06a220 con 0x7f819c0b4c00 2024-05-10T11:21:17.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.125+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f818c00bba0 con 0x7f819c0b4c00 2024-05-10T11:21:17.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.126+0000 7f81997fa640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f817c076300 0x7f817c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:17.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.126+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f818c097b40 con 0x7f819c0b4c00 2024-05-10T11:21:17.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.126+0000 7f8193fff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f817c076300 0x7f817c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:17.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.127+0000 7f8193fff640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f817c076300 0x7f817c0787c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8184034000 tx=0x7f818402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:17.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.130+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f818c061330 con 0x7f819c0b4c00 2024-05-10T11:21:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.363+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f819c0d4310 con 0x7f819c0b4c00 2024-05-10T11:21:17.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.364+0000 7f81997fa640 1 -- 172.21.15.66:0/754660496 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5181 (secure 0 0 0) 0x7f818c060c30 con 0x7f819c0b4c00 2024-05-10T11:21:17.364 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:17.364 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":88,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:16.228945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":86,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.66:6835/3403431174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":3403431174},{"type":"v1","addr":"172.21.15.66:6835","nonce":3403431174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T11:21:17.365 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 88 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f817c076300 msgr2=0x7f817c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f817c076300 0x7f817c0787c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8184034000 tx=0x7f818402e000 comp rx=0 tx=0).stop 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 msgr2=0x7f819c15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 0x7f819c15f770 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f818c00d620 tx=0x7f818c00dae0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 shutdown_connections 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f817c076300 0x7f817c0787c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819c15f390 0x7f819c0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f819c0d5190 0x7f819c15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 --2- 172.21.15.66:0/754660496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f819c0b4c00 0x7f819c15f770 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 >> 172.21.15.66:0/754660496 conn(0x7f819c08ecb0 msgr2=0x7f819c0d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:17.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 shutdown_connections 2024-05-10T11:21:17.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:17.366+0000 7f81a2a47640 1 -- 172.21.15.66:0/754660496 wait complete. 2024-05-10T11:21:17.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:20:30.866393+0000', 'modified': '2024-05-10T11:21:16.228945+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7917': {'gid': 7917, 'name': 'c', 'rank': 0, 'incarnation': 86, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.66:6835/3403431174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 3403431174}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 3403431174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:21:17.781 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7917:up:rejoin 2024-05-10T11:21:18.782 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:18.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 Processor -- start 2024-05-10T11:21:18.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 -- start start 2024-05-10T11:21:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f710015f3b0 0x7f71000d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f71000d5d30 0x7f71000d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71000d30b0 con 0x7f710015f790 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f71000d3390 con 0x7f71000d5d30 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.899+0000 7f7106c1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f71000c8c80 con 0x7f710015f3b0 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f71051ba640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f71000d5d30 0x7f71000d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f70fffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f710015f790 0x7f71000c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37536/0 (socket says 172.21.15.66:37536) 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f70fffff640 1 -- 172.21.15.66:0/1380845960 learned_addr learned my addr 172.21.15.66:0/1380845960 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f71049b9640 1 --2- 172.21.15.66:0/1380845960 >> v2:172.21.15.190:3300/0 conn(0x7f710015f3b0 0x7f71000d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f71051ba640 1 -- 172.21.15.66:0/1380845960 >> v2:172.21.15.190:3300/0 conn(0x7f710015f3b0 msgr2=0x7f71000d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f71051ba640 1 --2- 172.21.15.66:0/1380845960 >> v2:172.21.15.190:3300/0 conn(0x7f710015f3b0 0x7f71000d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f71051ba640 1 -- 172.21.15.66:0/1380845960 >> v1:172.21.15.66:6789/0 conn(0x7f710015f790 legacy=0x7f71000c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f70ff7fe640 1 -- 172.21.15.66:0/1380845960 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699364873 0 0) 0x7f71000d30b0 con 0x7f710015f790 2024-05-10T11:21:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.900+0000 7f71051ba640 1 -- 172.21.15.66:0/1380845960 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71000c8f60 con 0x7f71000d5d30 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.901+0000 7f71051ba640 1 --2- 172.21.15.66:0/1380845960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71000d3c30 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f710008e820 tx=0x7f70f802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2c2cb5e9a7645e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.901+0000 7f70ff7fe640 1 -- 172.21.15.66:0/1380845960 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8007740 con 0x7f71000d5d30 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.901+0000 7f70ff7fe640 1 -- 172.21.15.66:0/1380845960 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f80078e0 con 0x7f71000d5d30 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.901+0000 7f70ff7fe640 1 -- 172.21.15.66:0/1380845960 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8007cb0 con 0x7f71000d5d30 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.901+0000 7f7106c1d640 1 -- 172.21.15.66:0/1380845960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 msgr2=0x7f71000d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.901+0000 7f7106c1d640 1 --2- 172.21.15.66:0/1380845960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71000d3c30 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f710008e820 tx=0x7f70f802a680 comp rx=0 tx=0).stop 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.902+0000 7f7106c1d640 1 -- 172.21.15.66:0/1380845960 shutdown_connections 2024-05-10T11:21:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.902+0000 7f7106c1d640 1 --2- 172.21.15.66:0/1380845960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71000d3c30 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.902+0000 7f7106c1d640 1 --2- 172.21.15.66:0/1380845960 >> v2:172.21.15.190:3300/0 conn(0x7f710015f3b0 0x7f71000d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.902+0000 7f7106c1d640 1 -- 172.21.15.66:0/1380845960 >> 172.21.15.66:0/1380845960 conn(0x7f71000d5130 msgr2=0x7f71000d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.902+0000 7f7106c1d640 1 -- 172.21.15.66:0/1380845960 shutdown_connections 2024-05-10T11:21:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.902+0000 7f7106c1d640 1 -- 172.21.15.66:0/1380845960 wait complete. 2024-05-10T11:21:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.903+0000 7f7106c1d640 1 Processor -- start 2024-05-10T11:21:18.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.903+0000 7f7106c1d640 1 -- start start 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f7106c1d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71001567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f7106c1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f710015f3b0 0x7f71001f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f7106c1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71000cdd40 0x7f71001f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f7106c1d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f71000d0e60 con 0x7f71000d5d30 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f7106c1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f71000d0ce0 con 0x7f71000cdd40 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f7106c1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f71000d0fe0 con 0x7f710015f3b0 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71001567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71001567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42662/0 (socket says 172.21.15.66:42662) 2024-05-10T11:21:18.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 -- 172.21.15.66:0/516886433 learned_addr learned my addr 172.21.15.66:0/516886433 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71051ba640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71000cdd40 0x7f71001f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f70fffff640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f710015f3b0 0x7f71001f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 -- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f710015f3b0 msgr2=0x7f71001f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f710015f3b0 0x7f71001f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 -- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71000cdd40 msgr2=0x7f71001f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71000cdd40 0x7f71001f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f71049b9640 1 -- 172.21.15.66:0/516886433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7100156f50 con 0x7f71000d5d30 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.904+0000 7f70fffff640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f710015f3b0 0x7f71001f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.905+0000 7f71049b9640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71001567c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f70f400d800 tx=0x7f70f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.905+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f400b6c0 con 0x7f71000d5d30 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.905+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f4019070 con 0x7f71000d5d30 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.905+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7100157230 con 0x7f71000d5d30 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.905+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f400ba80 con 0x7f71000d5d30 2024-05-10T11:21:18.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.905+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71001577f0 con 0x7f71000d5d30 2024-05-10T11:21:18.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.906+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710006a220 con 0x7f71000d5d30 2024-05-10T11:21:18.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.906+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f70f400bc20 con 0x7f71000d5d30 2024-05-10T11:21:18.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.907+0000 7f70fd7fa640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70e40762d0 0x7f70e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:18.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.907+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f70f4097c40 con 0x7f71000d5d30 2024-05-10T11:21:18.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.907+0000 7f70fffff640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70e40762d0 0x7f70e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:18.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.908+0000 7f70fffff640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70e40762d0 0x7f70e4078790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71000a2fe0 tx=0x7f70ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:18.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:18.911+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f70f4061430 con 0x7f71000d5d30 2024-05-10T11:21:19.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.140+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f710006d5c0 con 0x7f71000d5d30 2024-05-10T11:21:19.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.141+0000 7f70fd7fa640 1 -- 172.21.15.66:0/516886433 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5188 (secure 0 0 0) 0x7f70f4060d30 con 0x7f71000d5d30 2024-05-10T11:21:19.141 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:19.141 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:18.234646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6835/3403431174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":3403431174},{"type":"v1","addr":"172.21.15.66:6835","nonce":3403431174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":7}]} 2024-05-10T11:21:19.141 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 89 2024-05-10T11:21:19.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70e40762d0 msgr2=0x7f70e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70e40762d0 0x7f70e4078790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71000a2fe0 tx=0x7f70ec009040 comp rx=0 tx=0).stop 2024-05-10T11:21:19.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 msgr2=0x7f71001567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71001567c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f70f400d800 tx=0x7f70f400dcc0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 shutdown_connections 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f70e40762d0 0x7f70e4078790 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71000cdd40 0x7f71001f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f710015f3b0 0x7f71001f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 --2- 172.21.15.66:0/516886433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71000d5d30 0x7f71001567c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 >> 172.21.15.66:0/516886433 conn(0x7f71000d5130 msgr2=0x7f71000cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 shutdown_connections 2024-05-10T11:21:19.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.143+0000 7f7106c1d640 1 -- 172.21.15.66:0/516886433 wait complete. 2024-05-10T11:21:19.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:20:30.866393+0000', 'modified': '2024-05-10T11:21:18.234646+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7917': {'gid': 7917, 'name': 'c', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6835/3403431174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 3403431174}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 3403431174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7917, 'qdb_cluster': [7917]} 2024-05-10T11:21:19.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:21:19.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T11:21:19.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.664+0000 7f396f3f7640 1 Processor -- start 2024-05-10T11:21:19.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.664+0000 7f396f3f7640 1 -- start start 2024-05-10T11:21:19.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396f3f7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39680b6a10 0x7f3968161550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396f3f7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39680b0a90 con 0x7f39680b6df0 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396f3f7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39680b0d70 con 0x7f396806d720 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396f3f7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f396806dc10 con 0x7f39680b6a10 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396d193640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39680b6a10 0x7f3968161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396c992640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f39680b6df0 0x7f39680cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37538/0 (socket says 172.21.15.66:37538) 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396c992640 1 -- 172.21.15.66:0/912164561 learned_addr learned my addr 172.21.15.66:0/912164561 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396d193640 1 -- 172.21.15.66:0/912164561 >> v1:172.21.15.190:6789/0 conn(0x7f396806d720 legacy=0x7f396815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396d193640 1 -- 172.21.15.66:0/912164561 >> v1:172.21.15.66:6789/0 conn(0x7f39680b6df0 legacy=0x7f39680cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f395ffff640 1 -- 172.21.15.66:0/912164561 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084608759 0 0) 0x7f39680b0a90 con 0x7f39680b6df0 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.665+0000 7f396d193640 1 -- 172.21.15.66:0/912164561 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39680cbd10 con 0x7f39680b6a10 2024-05-10T11:21:19.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.666+0000 7f396d193640 1 --2- 172.21.15.66:0/912164561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39680b6a10 0x7f3968161550 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f39640097d0 tx=0x7f396402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c7f7d5f5a2dc13 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.666+0000 7f395ffff640 1 -- 172.21.15.66:0/912164561 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964037070 con 0x7f39680b6a10 2024-05-10T11:21:19.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.666+0000 7f395ffff640 1 -- 172.21.15.66:0/912164561 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964032440 con 0x7f39680b6a10 2024-05-10T11:21:19.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.666+0000 7f395ffff640 1 -- 172.21.15.66:0/912164561 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964032810 con 0x7f39680b6a10 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 -- 172.21.15.66:0/912164561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39680b6a10 msgr2=0x7f3968161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 --2- 172.21.15.66:0/912164561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39680b6a10 0x7f3968161550 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f39640097d0 tx=0x7f396402a210 comp rx=0 tx=0).stop 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 -- 172.21.15.66:0/912164561 shutdown_connections 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 --2- 172.21.15.66:0/912164561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39680b6a10 0x7f3968161550 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 -- 172.21.15.66:0/912164561 >> 172.21.15.66:0/912164561 conn(0x7f39680d1510 msgr2=0x7f39680d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 -- 172.21.15.66:0/912164561 shutdown_connections 2024-05-10T11:21:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.667+0000 7f396f3f7640 1 -- 172.21.15.66:0/912164561 wait complete. 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.668+0000 7f396f3f7640 1 Processor -- start 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.668+0000 7f396f3f7640 1 -- start start 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396f3f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 0x7f39680cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396f3f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39680b6a10 0x7f3968145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396f3f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39680b6df0 0x7f3968148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396f3f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f396815dde0 con 0x7f396806d720 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396f3f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f396815dc60 con 0x7f39680b6df0 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396f3f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3968072850 con 0x7f39680b6a10 2024-05-10T11:21:19.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 0x7f39680cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 0x7f39680cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42678/0 (socket says 172.21.15.66:42678) 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 -- 172.21.15.66:0/3168964541 learned_addr learned my addr 172.21.15.66:0/3168964541 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d994640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39680b6df0 0x7f3968148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396c992640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39680b6a10 0x7f3968145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 -- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39680b6a10 msgr2=0x7f3968145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39680b6a10 0x7f3968145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 -- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39680b6df0 msgr2=0x7f3968148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39680b6df0 0x7f3968148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 -- 172.21.15.66:0/3168964541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39680cf0e0 con 0x7f396806d720 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.669+0000 7f396d193640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 0x7f39680cb2e0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f39640097d0 tx=0x7f39640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.670+0000 7f395dffb640 1 -- 172.21.15.66:0/3168964541 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964037040 con 0x7f396806d720 2024-05-10T11:21:19.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.670+0000 7f395dffb640 1 -- 172.21.15.66:0/3168964541 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964004230 con 0x7f396806d720 2024-05-10T11:21:19.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.670+0000 7f395dffb640 1 -- 172.21.15.66:0/3168964541 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396403c730 con 0x7f396806d720 2024-05-10T11:21:19.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.670+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3968148ba0 con 0x7f396806d720 2024-05-10T11:21:19.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.670+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3968149160 con 0x7f396806d720 2024-05-10T11:21:19.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.671+0000 7f395dffb640 1 -- 172.21.15.66:0/3168964541 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f396403a070 con 0x7f396806d720 2024-05-10T11:21:19.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.672+0000 7f395dffb640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f394c0762d0 0x7f394c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.672+0000 7f395dffb640 1 -- 172.21.15.66:0/3168964541 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f39640b8190 con 0x7f396806d720 2024-05-10T11:21:19.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.673+0000 7f396c992640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f394c0762d0 0x7f394c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.673+0000 7f396c992640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f394c0762d0 0x7f394c078790 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f39680b2b90 tx=0x7f3958007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.673+0000 7f39721ef740 1 Processor -- start 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.673+0000 7f39721ef740 1 -- start start 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f39721ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 0x5593f98a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f9877bb0 0x5593f987b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f39721ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593f97e18d0 con 0x5593f98a5330 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5593f979ac10 con 0x5593f9877bb0 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5593f97dd890 con 0x5593f98a4f50 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 0x5593f98a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 0x5593f98a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42692/0 (socket says 172.21.15.66:42692) 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 -- 172.21.15.66:0/3096038018 learned_addr learned my addr 172.21.15.66:0/3096038018 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396d193640 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396d994640 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f9877bb0 0x5593f987b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 -- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 msgr2=0x5593f98a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 -- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f9877bb0 msgr2=0x5593f987b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f9877bb0 0x5593f987b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 -- 172.21.15.66:0/3096038018 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f97a25d0 con 0x5593f98a5330 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396d994640 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f9877bb0 0x5593f987b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.674+0000 7f396c992640 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 0x5593f98a7ca0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f3958005d80 tx=0x7f3958012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e292628366bd3d68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f394affd640 1 -- 172.21.15.66:0/3096038018 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958015110 con 0x5593f98a5330 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f394affd640 1 -- 172.21.15.66:0/3096038018 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39580159c0 con 0x5593f98a5330 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f394affd640 1 -- 172.21.15.66:0/3096038018 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958015d70 con 0x5593f98a5330 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 -- 172.21.15.66:0/3096038018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 msgr2=0x5593f98a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 0x5593f98a7ca0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f3958005d80 tx=0x7f3958012000 comp rx=0 tx=0).stop 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 -- 172.21.15.66:0/3096038018 shutdown_connections 2024-05-10T11:21:19.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f9877bb0 0x5593f987b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98a5330 0x5593f98a7ca0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 --2- 172.21.15.66:0/3096038018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 -- 172.21.15.66:0/3096038018 >> 172.21.15.66:0/3096038018 conn(0x5593f9879e20 msgr2=0x5593f98c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 -- 172.21.15.66:0/3096038018 shutdown_connections 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.675+0000 7f39721ef740 1 -- 172.21.15.66:0/3096038018 wait complete. 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.676+0000 7f39721ef740 1 -- start start 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.676+0000 7f39721ef740 1 Processor -- start 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f98c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f98c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593f987cfd0 con 0x5593f98d6b30 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5593f979e760 con 0x5593f98a5330 2024-05-10T11:21:19.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5593f987d2b0 con 0x5593f98a4f50 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f39721ef740 10 client.0 _ll_register_callbacks cb 0x5593f97d7cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f98c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f98c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42694/0 (socket says 172.21.15.66:42694) 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 -- 172.21.15.66:0/1378338530 learned_addr learned my addr 172.21.15.66:0/1378338530 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d193640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396c992640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f98c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 -- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 msgr2=0x5593f98a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 -- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 msgr2=0x5593f98c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f98c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 -- 172.21.15.66:0/1378338530 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f94f32d0 con 0x5593f98d6b30 2024-05-10T11:21:19.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f396d994640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f98c61c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f3960010510 tx=0x7f39600109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb936bfca8f782f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.677+0000 7f3943fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f3943fff640 1 -- 172.21.15.66:0/1378338530 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960019030 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f3943fff640 1 -- 172.21.15.66:0/1378338530 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f3960003be0 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39580159c0 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f3943fff640 1 -- 172.21.15.66:0/1378338530 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f3960022050 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 10 client.7992 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5593f95bd6b0 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f3943fff640 1 -- 172.21.15.66:0/1378338530 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39580159c0 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f3943fff640 1 -- 172.21.15.66:0/1378338530 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f3960025020 con 0x5593f98d6b30 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 10 client.7992 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 10 client.7992 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 20 client.7992 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:19.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f98d5f90 0x5593f98a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 4 client.7992 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593f9765760 con 0x5593f98d5f90 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.678+0000 7f396d193640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f98d5f90 0x5593f98a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f396d193640 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f98d5f90 0x5593f98a29c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bab6e8ed922d906 server_cookie=7408f36c9f28a221 in_seq=0 out_seq=0 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f3943fff640 10 client.7992 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f3943fff640 1 -- 172.21.15.66:0/1378338530 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5593f9765760 con 0x5593f98d5f90 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f3943fff640 10 client.7992 handle_command_reply: tid=0 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 client.7992 shutdown 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 msgr2=0x5593f98c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f98c61c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f3960010510 tx=0x7f39600109d0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 shutdown_connections 2024-05-10T11:21:19.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f98d5f90 0x5593f98a29c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f98c61c0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f98c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 --2- 172.21.15.66:0/1378338530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f3943fff640 0 client.7992 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.679+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 >> 172.21.15.66:0/1378338530 conn(0x5593f9877bb0 msgr2=0x5593f9878860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.680+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 shutdown_connections 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.680+0000 7f39721ef740 1 -- 172.21.15.66:0/1378338530 wait complete. 2024-05-10T11:21:19.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.680+0000 7f39721ef740 20 client.7992 trim_cache size 0 max 16384 2024-05-10T11:21:19.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.698+0000 7f39721ef740 1 Processor -- start 2024-05-10T11:21:19.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.698+0000 7f39721ef740 1 -- start start 2024-05-10T11:21:19.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f993b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f39721ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f987b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f39721ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3968201d40 con 0x5593f98d6b30 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3968200d60 con 0x5593f98a5330 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39680d0af0 con 0x5593f98a4f50 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396d994640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f987b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396d994640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f987b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42696/0 (socket says 172.21.15.66:42696) 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396d994640 1 -- 172.21.15.66:0/35122365 learned_addr learned my addr 172.21.15.66:0/35122365 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396d994640 1 -- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 msgr2=0x5593f98c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396d994640 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396d994640 1 -- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 msgr2=0x5593f993b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.699+0000 7f396c992640 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f993b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f396d994640 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f993b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f396d994640 1 -- 172.21.15.66:0/35122365 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f98730e0 con 0x5593f98d6b30 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f396d994640 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f987b740 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f3960002230 tx=0x7f396000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f568f82dab4fc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f394a7fc640 1 -- 172.21.15.66:0/35122365 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960019070 con 0x5593f98d6b30 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f394a7fc640 1 -- 172.21.15.66:0/35122365 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960003be0 con 0x5593f98d6b30 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f394a7fc640 1 -- 172.21.15.66:0/35122365 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960006d90 con 0x5593f98d6b30 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 -- 172.21.15.66:0/35122365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 msgr2=0x5593f987b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f987b740 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f3960002230 tx=0x7f396000a000 comp rx=0 tx=0).stop 2024-05-10T11:21:19.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 -- 172.21.15.66:0/35122365 shutdown_connections 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f987b740 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a5330 0x5593f993b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 --2- 172.21.15.66:0/35122365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a4f50 0x5593f98c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.700+0000 7f39721ef740 1 -- 172.21.15.66:0/35122365 >> 172.21.15.66:0/35122365 conn(0x5593f9877bb0 msgr2=0x5593f98d5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.701+0000 7f39721ef740 1 -- 172.21.15.66:0/35122365 shutdown_connections 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.701+0000 7f39721ef740 1 -- 172.21.15.66:0/35122365 wait complete. 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.701+0000 7f39721ef740 1 -- start start 2024-05-10T11:21:19.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.701+0000 7f39721ef740 1 Processor -- start 2024-05-10T11:21:19.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a4f50 0x5593f987b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a5330 0x5593f987ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f99447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593f98a8c20 con 0x5593f98d6b30 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3968200710 con 0x5593f98a4f50 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5593f98d6410 con 0x5593f98a5330 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f39721ef740 10 client.0 _ll_register_callbacks cb 0x7f3960004e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f99447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f99447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42710/0 (socket says 172.21.15.66:42710) 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 -- 172.21.15.66:0/834178495 learned_addr learned my addr 172.21.15.66:0/834178495 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396c992640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a5330 0x5593f987ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d193640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a4f50 0x5593f987b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 -- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a5330 msgr2=0x5593f987ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a5330 0x5593f987ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 -- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a4f50 msgr2=0x5593f987b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a4f50 0x5593f987b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.702+0000 7f396d994640 1 -- 172.21.15.66:0/834178495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f98dcb70 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f396d994640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f99447c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3960007fd0 tx=0x7f3960003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f12d488be69d6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f3943fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f3943fff640 1 -- 172.21.15.66:0/834178495 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396002a020 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3960003be0 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f3943fff640 1 -- 172.21.15.66:0/834178495 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f3960006b50 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f3943fff640 1 -- 172.21.15.66:0/834178495 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f3960034050 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 10 client.7998 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5593f98c4f30 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f3943fff640 1 -- 172.21.15.66:0/834178495 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960003be0 con 0x5593f98d6b30 2024-05-10T11:21:19.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f3943fff640 1 -- 172.21.15.66:0/834178495 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f3960037020 con 0x5593f98d6b30 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 10 client.7998 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 10 client.7998 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 20 client.7998 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f9944dc0 0x5593f9878090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 4 client.7998 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "status"}) -- 0x5593f97ef4e0 con 0x5593f9944dc0 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.703+0000 7f396d193640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f9944dc0 0x5593f9878090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f3943fff640 10 client.7998 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f396d193640 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f9944dc0 0x5593f9878090 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33128cebc17a37e8 server_cookie=1b2b2526ee7c0fcb in_seq=0 out_seq=0 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f3943fff640 1 -- 172.21.15.66:0/834178495 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5593f97ef4e0 con 0x5593f9944dc0 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f3943fff640 10 client.7998 handle_command_reply: tid=0 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 client.7998 shutdown 2024-05-10T11:21:19.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 msgr2=0x5593f99447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f99447c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3960007fd0 tx=0x7f3960003ae0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 shutdown_connections 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5593f9944dc0 0x5593f9878090 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593f98d6b30 0x5593f99447c0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593f98a5330 0x5593f987ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 --2- 172.21.15.66:0/834178495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593f98a4f50 0x5593f987b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f3943fff640 0 client.7998 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 >> 172.21.15.66:0/834178495 conn(0x5593f9877bb0 msgr2=0x5593f98a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 shutdown_connections 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 1 -- 172.21.15.66:0/834178495 wait complete. 2024-05-10T11:21:19.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.704+0000 7f39721ef740 20 client.7998 trim_cache size 0 max 16384 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 7917, 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 4.4870734859999999, 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 89, 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 107, 2024-05-10T11:21:19.713 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 107, 2024-05-10T11:21:19.714 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 5.4554951760000003 2024-05-10T11:21:19.714 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:21:19.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f394c0762d0 msgr2=0x7f394c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f394c0762d0 0x7f394c078790 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f39680b2b90 tx=0x7f3958007c00 comp rx=0 tx=0).stop 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 msgr2=0x7f39680cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 0x7f39680cb2e0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f39640097d0 tx=0x7f39640046c0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 shutdown_connections 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f394c0762d0 0x7f394c078790 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39680b6df0 0x7f3968148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39680b6a10 0x7f3968145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 --2- 172.21.15.66:0/3168964541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396806d720 0x7f39680cb2e0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 >> 172.21.15.66:0/3168964541 conn(0x7f39680d1510 msgr2=0x7f39680d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 shutdown_connections 2024-05-10T11:21:19.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.705+0000 7f396f3f7640 1 -- 172.21.15.66:0/3168964541 wait complete. 2024-05-10T11:21:19.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo daemon-helper kill ceph --cluster ceph -w 2024-05-10T11:21:19.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:21:19.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-05-10T11:21:19.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.827+0000 7fa8e6324640 1 Processor -- start 2024-05-10T11:21:19.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.827+0000 7fa8e6324640 1 -- start start 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.827+0000 7fa8e6324640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 0x7fa8e00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8e6324640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8e015f410 0x7fa8e006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8e6324640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e0163ce0 con 0x7fa8e00afb10 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8e6324640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e0162f20 con 0x7fa8e015f410 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8e6324640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e0163200 con 0x7fa8e015f030 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 0x7fa8e00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8d7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8e015f410 0x7fa8e006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 0x7fa8e00b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:45470/0 (socket says 172.21.15.66:45470) 2024-05-10T11:21:19.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8e48c1640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa8e00afb10 0x7fa8e0073090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:34924/0 (socket says 172.21.15.66:34924) 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8d7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8e015f410 0x7fa8e006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:46644/0 (socket says 172.21.15.66:46644) 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 -- 172.21.15.66:0/1436268423 learned_addr learned my addr 172.21.15.66:0/1436268423 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 -- 172.21.15.66:0/1436268423 >> v2:172.21.15.190:3300/0 conn(0x7fa8e015f410 msgr2=0x7fa8e006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 --2- 172.21.15.66:0/1436268423 >> v2:172.21.15.190:3300/0 conn(0x7fa8e015f410 0x7fa8e006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 -- 172.21.15.66:0/1436268423 >> v1:172.21.15.190:6789/0 conn(0x7fa8e00afb10 legacy=0x7fa8e0073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8df7fe640 1 -- 172.21.15.66:0/1436268423 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295973606 0 0) 0x7fa8e0163ce0 con 0x7fa8e00afb10 2024-05-10T11:21:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.828+0000 7fa8dffff640 1 -- 172.21.15.66:0/1436268423 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e01634e0 con 0x7fa8e015f030 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.829+0000 7fa8dffff640 1 --2- 172.21.15.66:0/1436268423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 0x7fa8e00b11a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009870 tx=0x7fa8d002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=758ba3266edb9d72 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.829+0000 7fa8df7fe640 1 -- 172.21.15.66:0/1436268423 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0037070 con 0x7fa8e015f030 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.829+0000 7fa8df7fe640 1 -- 172.21.15.66:0/1436268423 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d0032440 con 0x7fa8e015f030 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.829+0000 7fa8df7fe640 1 -- 172.21.15.66:0/1436268423 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0032810 con 0x7fa8e015f030 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 -- 172.21.15.66:0/1436268423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 msgr2=0x7fa8e00b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 --2- 172.21.15.66:0/1436268423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 0x7fa8e00b11a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009870 tx=0x7fa8d002a270 comp rx=0 tx=0).stop 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 -- 172.21.15.66:0/1436268423 shutdown_connections 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 --2- 172.21.15.66:0/1436268423 >> v2:172.21.15.190:3300/0 conn(0x7fa8e015f410 0x7fa8e006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 --2- 172.21.15.66:0/1436268423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e015f030 0x7fa8e00b11a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 -- 172.21.15.66:0/1436268423 >> 172.21.15.66:0/1436268423 conn(0x7fa8e00b4530 msgr2=0x7fa8e00d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 -- 172.21.15.66:0/1436268423 shutdown_connections 2024-05-10T11:21:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.830+0000 7fa8e6324640 1 -- 172.21.15.66:0/1436268423 wait complete. 2024-05-10T11:21:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.831+0000 7fa8e6324640 1 Processor -- start 2024-05-10T11:21:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.831+0000 7fa8e6324640 1 -- start start 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e6324640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e00afb10 0x7fa8e01410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e6324640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 0x7fa8e01eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e6324640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e0143900 0x7fa8e0143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e6324640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e00716a0 con 0x7fa8e015f030 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e6324640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e00b6190 con 0x7fa8e00afb10 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e6324640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e0071820 con 0x7fa8e0143900 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 0x7fa8e01eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 0x7fa8e01eb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42716/0 (socket says 172.21.15.66:42716) 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2117065274 learned_addr learned my addr 172.21.15.66:0/2117065274 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8dffff640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e00afb10 0x7fa8e01410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.832+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e0143900 0x7fa8e0143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e0143900 msgr2=0x7fa8e0143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e0143900 0x7fa8e0143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e00afb10 msgr2=0x7fa8e01410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e00afb10 0x7fa8e01410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2117065274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e01eb590 con 0x7fa8e015f030 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 0x7fa8e01eb050 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e9b0 tx=0x7fa8c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8dd7fa640 1 -- 172.21.15.66:0/2117065274 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8017070 con 0x7fa8e015f030 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8dd7fa640 1 -- 172.21.15.66:0/2117065274 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c800c9a0 con 0x7fa8e015f030 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e0158b80 con 0x7fa8e015f030 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8dd7fa640 1 -- 172.21.15.66:0/2117065274 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800cd90 con 0x7fa8e015f030 2024-05-10T11:21:19.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.833+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e0159120 con 0x7fa8e015f030 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.836+0000 7fa8dd7fa640 1 -- 172.21.15.66:0/2117065274 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8c801a070 con 0x7fa8e015f030 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.836+0000 7fa8dd7fa640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8c00762d0 0x7fa8c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.836+0000 7fa8e9044740 1 Processor -- start 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 -- start start 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8dd7fa640 1 -- 172.21.15.66:0/2117065274 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7fa8c8097890 con 0x7fa8e015f030 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8dffff640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8c00762d0 0x7fa8c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8dffff640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8c00762d0 0x7fa8c0078790 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0034000 tx=0x7fa8d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932681220 0x560932633bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x5609326636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932663c00 0x560932638a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56093259ccf0 con 0x560932664340 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560932555e10 con 0x560932681220 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560932598cb0 con 0x560932663c00 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x5609326636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x5609326636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42728/0 (socket says 172.21.15.66:42728) 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2176413496 learned_addr learned my addr 172.21.15.66:0/2176413496 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8dffff640 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932681220 0x560932633bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.837+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932663c00 0x560932638a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932663c00 msgr2=0x560932638a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932663c00 0x560932638a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932681220 msgr2=0x560932633bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932681220 0x560932633bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d7fff640 1 -- 172.21.15.66:0/2176413496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609323767e0 con 0x560932664340 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x5609326636c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa8c805ceb0 tx=0x7fa8c8060340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533fa49ba1a28370 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d5ffb640 1 -- 172.21.15.66:0/2176413496 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8021070 con 0x560932664340 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d5ffb640 1 -- 172.21.15.66:0/2176413496 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80608c0 con 0x560932664340 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.838+0000 7fa8d5ffb640 1 -- 172.21.15.66:0/2176413496 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8061d40 con 0x560932664340 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 -- 172.21.15.66:0/2176413496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 msgr2=0x5609326636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x5609326636c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa8c805ceb0 tx=0x7fa8c8060340 comp rx=0 tx=0).stop 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 -- 172.21.15.66:0/2176413496 shutdown_connections 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932663c00 0x560932638a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x5609326636c0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2176413496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932681220 0x560932633bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 -- 172.21.15.66:0/2176413496 >> 172.21.15.66:0/2176413496 conn(0x560932635e20 msgr2=0x56093267e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 -- 172.21.15.66:0/2176413496 shutdown_connections 2024-05-10T11:21:19.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 -- 172.21.15.66:0/2176413496 wait complete. 2024-05-10T11:21:19.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.839+0000 7fa8e9044740 1 -- start start 2024-05-10T11:21:19.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 Processor -- start 2024-05-10T11:21:19.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x560932680760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x56093268e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932665dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560932637fd0 con 0x560932664340 2024-05-10T11:21:19.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560932559940 con 0x56093265f690 2024-05-10T11:21:19.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5609326373c0 con 0x560932681220 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8e9044740 10 client.0 _ll_register_callbacks cb 0x56093255c440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x560932680760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x560932680760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42732/0 (socket says 172.21.15.66:42732) 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.840+0000 7fa8dffff640 1 -- 172.21.15.66:0/270276411 learned_addr learned my addr 172.21.15.66:0/270276411 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932665dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x56093268e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8dffff640 1 -- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 msgr2=0x56093268e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8dffff640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x56093268e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8dffff640 1 -- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 msgr2=0x560932665dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8dffff640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932665dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8dffff640 1 -- 172.21.15.66:0/270276411 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609323d6f70 con 0x560932664340 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932665dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8dffff640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x560932680760 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009870 tx=0x7fa8d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae09b29f4551e6d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8beffd640 1 -- 172.21.15.66:0/270276411 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d004d070 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8beffd640 1 -- 172.21.15.66:0/270276411 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7fa8d003c850 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c80608c0 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8beffd640 1 -- 172.21.15.66:0/270276411 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa8d0037040 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8e9044740 10 client.8007 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.841+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x56093226e170 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8beffd640 1 -- 172.21.15.66:0/270276411 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80608c0 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8beffd640 1 -- 172.21.15.66:0/270276411 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7fa8d0046070 con 0x560932664340 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8e9044740 10 client.8007 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8e9044740 10 client.8007 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8e9044740 20 client.8007 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8e9044740 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x560932662c40 0x56093267e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8e9044740 4 client.8007 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609325aa900 con 0x560932662c40 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x560932662c40 0x56093267e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8beffd640 10 client.8007 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.842+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x560932662c40 0x56093267e6c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a0c5f7d3cc32f server_cookie=b84ce0b31d3756fa in_seq=0 out_seq=0 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.843+0000 7fa8beffd640 1 -- 172.21.15.66:0/270276411 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5609325aa900 con 0x560932662c40 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.843+0000 7fa8beffd640 10 client.8007 handle_command_reply: tid=0 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.843+0000 7fa8e9044740 1 client.8007 shutdown 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.843+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 msgr2=0x560932680760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.843+0000 7fa8e9044740 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x560932680760 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009870 tx=0x7fa8d0004730 comp rx=0 tx=0).stop 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 shutdown_connections 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x560932662c40 0x56093267e6c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932665dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x56093268e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 --2- 172.21.15.66:0/270276411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932664340 0x560932680760 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 >> 172.21.15.66:0/270276411 conn(0x560932663c00 msgr2=0x5609326332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8beffd640 0 client.8007 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 shutdown_connections 2024-05-10T11:21:19.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 1 -- 172.21.15.66:0/270276411 wait complete. 2024-05-10T11:21:19.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.844+0000 7fa8e9044740 20 client.8007 trim_cache size 0 max 16384 2024-05-10T11:21:19.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.849+0000 7f29e1009640 1 Processor -- start 2024-05-10T11:21:19.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.849+0000 7f29e1009640 1 -- start start 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29e1009640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f29dc15f420 0x7f29dc070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29e1009640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc06d500 con 0x7f29dc163a20 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29e1009640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc06d7e0 con 0x7f29dc163570 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29e1009640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc071500 con 0x7f29dc15f420 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29da59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f29dc163a20 0x7f29dc162e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37550/0 (socket says 172.21.15.66:37550) 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29da59c640 1 -- 172.21.15.66:0/2965319619 learned_addr learned my addr 172.21.15.66:0/2965319619 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29dad9d640 1 --2- 172.21.15.66:0/2965319619 >> v2:172.21.15.190:3300/0 conn(0x7f29dc15f420 0x7f29dc070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.850+0000 7f29d9d9b640 1 -- 172.21.15.66:0/2965319619 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202738715 0 0) 0x7f29dc06d500 con 0x7f29dc163a20 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.851+0000 7f29d9d9b640 1 -- 172.21.15.66:0/2965319619 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c4003520 con 0x7f29dc163a20 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.851+0000 7f29dad9d640 1 -- 172.21.15.66:0/2965319619 >> v1:172.21.15.190:6789/0 conn(0x7f29dc163570 legacy=0x7f29dc06e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.851+0000 7f29dad9d640 1 -- 172.21.15.66:0/2965319619 >> v1:172.21.15.66:6789/0 conn(0x7f29dc163a20 legacy=0x7f29dc162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.851+0000 7f29dad9d640 1 -- 172.21.15.66:0/2965319619 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc06dac0 con 0x7f29dc15f420 2024-05-10T11:21:19.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.851+0000 7f29dad9d640 1 --2- 172.21.15.66:0/2965319619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc15f420 0x7f29dc070b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009d90 tx=0x7f29cc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c7bdc081d7b9bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29d9d9b640 1 -- 172.21.15.66:0/2965319619 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc007740 con 0x7f29dc15f420 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29d9d9b640 1 -- 172.21.15.66:0/2965319619 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc0078e0 con 0x7f29dc15f420 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29d9d9b640 1 -- 172.21.15.66:0/2965319619 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc007c90 con 0x7f29dc15f420 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 -- 172.21.15.66:0/2965319619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc15f420 msgr2=0x7f29dc070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 --2- 172.21.15.66:0/2965319619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc15f420 0x7f29dc070b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009d90 tx=0x7f29cc02a660 comp rx=0 tx=0).stop 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 -- 172.21.15.66:0/2965319619 shutdown_connections 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 --2- 172.21.15.66:0/2965319619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc15f420 0x7f29dc070b60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 -- 172.21.15.66:0/2965319619 >> 172.21.15.66:0/2965319619 conn(0x7f29dc0d2ec0 msgr2=0x7f29dc0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 -- 172.21.15.66:0/2965319619 shutdown_connections 2024-05-10T11:21:19.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.852+0000 7f29e1009640 1 -- 172.21.15.66:0/2965319619 wait complete. 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.855+0000 7f29e1009640 1 Processor -- start 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.855+0000 7f29e1009640 1 -- start start 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29e1009640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29dc15f420 0x7f29dc15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29e1009640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc163570 0x7f29dc0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29e1009640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc163a20 0x7f29dc0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29e1009640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0afbf0 con 0x7f29dc163a20 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29e1009640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc06dda0 con 0x7f29dc163570 2024-05-10T11:21:19.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29e1009640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc0710a0 con 0x7f29dc15f420 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29db59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc163a20 0x7f29dc0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29db59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc163a20 0x7f29dc0b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42744/0 (socket says 172.21.15.66:42744) 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29db59e640 1 -- 172.21.15.66:0/221892799 learned_addr learned my addr 172.21.15.66:0/221892799 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29da59c640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc163570 0x7f29dc0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.856+0000 7f29dad9d640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29dc15f420 0x7f29dc15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29db59e640 1 -- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29dc15f420 msgr2=0x7f29dc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29db59e640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29dc15f420 0x7f29dc15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29db59e640 1 -- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc163570 msgr2=0x7f29dc0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29db59e640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29dc163570 0x7f29dc0b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29db59e640 1 -- 172.21.15.66:0/221892799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0a0050 con 0x7f29dc163a20 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29db59e640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc163a20 0x7f29dc0b3190 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001eb0 tx=0x7f29d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4017070 con 0x7f29dc163a20 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d40052d0 con 0x7f29dc163a20 2024-05-10T11:21:19.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4003810 con 0x7f29dc163a20 2024-05-10T11:21:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29e1009640 1 -- 172.21.15.66:0/221892799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc15f8a0 con 0x7f29dc163a20 2024-05-10T11:21:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.857+0000 7f29e1009640 1 -- 172.21.15.66:0/221892799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc15a980 con 0x7f29dc163a20 2024-05-10T11:21:19.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.858+0000 7f29e1009640 1 -- 172.21.15.66:0/221892799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f29dc15fa70 con 0x7f29dc163a20 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.859+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29d401a070 con 0x7f29dc163a20 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.859+0000 7f29c37fe640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29c8076300 0x7f29c80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.860+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f29d4097260 con 0x7f29dc163a20 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.860+0000 7f29dad9d640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29c8076300 0x7f29c80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.860+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+511 (secure 0 0 0) 0x7f29d4021070 con 0x7f29dc163a20 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.860+0000 7f29e1009640 1 -- 172.21.15.66:0/221892799 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f29dc0693f0 con 0x7f29dc163a20 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.860+0000 7f29dad9d640 1 --2- 172.21.15.66:0/221892799 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f29c8076300 0x7f29c80787c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f29cc034000 tx=0x7f29cc02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.860+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 7 ==== log(2 entries from seq 937 at 2024-05-10T11:21:18.234702+0000) ==== 389+0+0 (secure 0 0 0) 0x7f29d40956a0 con 0x7f29dc163a20 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: cluster: 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: id: 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: health: HEALTH_OK 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: services: 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: mgr: x(active, since 9m), standbys: y 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: mds: 1/1 daemons up, 3 standby 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-05-10T11:21:19.862 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: data: 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: volumes: 1/1 healthy 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: pools: 3 pools, 97 pgs 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: objects: 30 objects, 19 MiB 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: usage: 289 MiB used, 720 GiB / 720 GiB avail 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: pgs: 97 active+clean 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: io: 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: client: 1023 B/s rd, 170 B/s wr, 0 op/s rd, 0 op/s wr 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:18.234702+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T11:21:19.863 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:18.234727+0000 mon.a [INF] Cluster is now healthy 2024-05-10T11:21:19.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 Processor -- start 2024-05-10T11:21:19.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 -- start start 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932662090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932664340 0x56093267aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 0x560932665db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0201e00 con 0x560932681220 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0200e30 con 0x56093265f690 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.867+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e015bc10 con 0x560932664340 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 0x560932665db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 0x560932665db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42750/0 (socket says 172.21.15.66:42750) 2024-05-10T11:21:19.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 -- 172.21.15.66:0/2274870238 learned_addr learned my addr 172.21.15.66:0/2274870238 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8dffff640 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932662090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932664340 0x56093267aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 -- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932664340 msgr2=0x56093267aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932664340 0x56093267aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 -- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 msgr2=0x560932662090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932662090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 -- 172.21.15.66:0/2274870238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560932676110 con 0x560932681220 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932664340 0x56093267aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 0x560932665db0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0071430 tx=0x7fa8d8004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82b80cfff80763a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8d57fa640 1 -- 172.21.15.66:0/2274870238 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007730 con 0x560932681220 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8d57fa640 1 -- 172.21.15.66:0/2274870238 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d801b020 con 0x560932681220 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.868+0000 7fa8d57fa640 1 -- 172.21.15.66:0/2274870238 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007930 con 0x560932681220 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 -- 172.21.15.66:0/2274870238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 msgr2=0x560932665db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 0x560932665db0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0071430 tx=0x7fa8d8004c70 comp rx=0 tx=0).stop 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 -- 172.21.15.66:0/2274870238 shutdown_connections 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560932681220 0x560932665db0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932664340 0x56093267aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 --2- 172.21.15.66:0/2274870238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56093265f690 0x560932662090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 -- 172.21.15.66:0/2274870238 >> 172.21.15.66:0/2274870238 conn(0x560932663c00 msgr2=0x560932681f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 -- 172.21.15.66:0/2274870238 shutdown_connections 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.869+0000 7fa8e9044740 1 -- 172.21.15.66:0/2274870238 wait complete. 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.870+0000 7fa8e9044740 1 -- start start 2024-05-10T11:21:19.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.870+0000 7fa8e9044740 1 Processor -- start 2024-05-10T11:21:19.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 0x560932697580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932664340 0x560932697ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x560932698000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e02007e0 con 0x56093265f690 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560932682680 con 0x560932664340 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56093267ac20 con 0x560932681220 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 0x560932697580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 10 client.0 _ll_register_callbacks cb 0x7fa8d00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 0x560932697580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42760/0 (socket says 172.21.15.66:42760) 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 -- 172.21.15.66:0/1818155578 learned_addr learned my addr 172.21.15.66:0/1818155578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932664340 0x560932697ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x560932698000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 -- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 msgr2=0x560932698000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x560932698000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 -- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932664340 msgr2=0x560932697ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932664340 0x560932697ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 -- 172.21.15.66:0/1818155578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560932633940 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e48c1640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x560932698000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8dffff640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 0x560932697580 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009210 tx=0x7fa8d0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a587ce51d7d80f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8beffd640 1 -- 172.21.15.66:0/1818155578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0060060 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8beffd640 1 -- 172.21.15.66:0/1818155578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7fa8d0004040 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d801b020 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.871+0000 7fa8beffd640 1 -- 172.21.15.66:0/1818155578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa8d0066050 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 10 client.8019 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x56093267d7e0 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8beffd640 1 -- 172.21.15.66:0/1818155578 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d801b020 con 0x56093265f690 2024-05-10T11:21:19.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8beffd640 1 -- 172.21.15.66:0/1818155578 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7fa8d0069020 con 0x56093265f690 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 10 client.8019 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 10 client.8019 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 20 client.8019 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5609326f3c10 0x560932665c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 4 client.8019 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x5609325a4770 con 0x5609326f3c10 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5609326f3c10 0x560932665c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8beffd640 10 client.8019 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.872+0000 7fa8d7fff640 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5609326f3c10 0x560932665c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23d21b53deb848ad server_cookie=2e388e70cd3db260 in_seq=0 out_seq=0 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8beffd640 1 -- 172.21.15.66:0/1818155578 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5609325a4770 con 0x5609326f3c10 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8beffd640 10 client.8019 handle_command_reply: tid=0 2024-05-10T11:21:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 client.8019 shutdown 2024-05-10T11:21:19.879 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-05-10T11:21:19.879 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-05-10T11:21:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 msgr2=0x560932697580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 0x560932697580 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009210 tx=0x7fa8d0009240 comp rx=0 tx=0).stop 2024-05-10T11:21:19.880 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-05-10T11:21:19.880 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 shutdown_connections 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x5609326f3c10 0x560932665c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560932681220 0x560932698000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560932664340 0x560932697ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 --2- 172.21.15.66:0/1818155578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56093265f690 0x560932697580 secure :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009210 tx=0x7fa8d0009240 comp rx=0 tx=0).stop 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 >> 172.21.15.66:0/1818155578 conn(0x560932663c00 msgr2=0x56093265fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8beffd640 0 client.8019 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.873+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 shutdown_connections 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.874+0000 7fa8e9044740 1 -- 172.21.15.66:0/1818155578 wait complete. 2024-05-10T11:21:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.874+0000 7fa8e9044740 20 client.8019 trim_cache size 0 max 16384 2024-05-10T11:21:19.882 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:21:19.882 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-05-10T11:21:19.882 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "211911df-0341-4bd7-af32-212dc06dd714", 2024-05-10T11:21:19.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-05-10T11:21:19.882 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.874+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8c00762d0 msgr2=0x7fa8c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.874+0000 7fa8e6324640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8c00762d0 0x7fa8c0078790 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0034000 tx=0x7fa8d002e000 comp rx=0 tx=0).stop 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.874+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 msgr2=0x7fa8e01eb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.874+0000 7fa8e6324640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 0x7fa8e01eb050 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e9b0 tx=0x7fa8c800ee70 comp rx=0 tx=0).stop 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 shutdown_connections 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa8c00762d0 0x7fa8c0078790 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e0143900 0x7fa8e0143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8e015f030 0x7fa8e01eb050 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 --2- 172.21.15.66:0/2117065274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e00afb10 0x7fa8e01410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 >> 172.21.15.66:0/2117065274 conn(0x7fa8e00b4530 msgr2=0x7fa8e006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 shutdown_connections 2024-05-10T11:21:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.875+0000 7fa8e6324640 1 -- 172.21.15.66:0/2117065274 wait complete. 2024-05-10T11:21:19.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:21:19.886 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T11:21:19.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.992+0000 7efeb8d32640 1 Processor -- start 2024-05-10T11:21:19.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.992+0000 7efeb8d32640 1 -- start start 2024-05-10T11:21:19.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb8d32640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efeb40cf3e0 0x7efeb40cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb8d32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:19.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb8d32640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb406e720 con 0x7efeb40cd500 2024-05-10T11:21:19.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb8d32640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7efeb406de80 con 0x7efeb40cf3e0 2024-05-10T11:21:19.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb8d32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efeb406e160 con 0x7efeb40d2190 2024-05-10T11:21:19.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb259c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efeb40cf3e0 0x7efeb40cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efea9d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7efeb40cd500 0x7efeb40b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:37566/0 (socket says 172.21.15.66:37566) 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb259c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efeb40cf3e0 0x7efeb40cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42768/0 (socket says 172.21.15.66:42768) 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efea9d9b640 1 -- 172.21.15.66:0/2596867626 learned_addr learned my addr 172.21.15.66:0/2596867626 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb259c640 1 -- 172.21.15.66:0/2596867626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 msgr2=0x7efeb40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb259c640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb1d9b640 1 -- 172.21.15.66:0/2596867626 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225544210 0 0) 0x7efeb406e720 con 0x7efeb40cd500 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb259c640 1 -- 172.21.15.66:0/2596867626 >> v1:172.21.15.66:6789/0 conn(0x7efeb40cd500 legacy=0x7efeb40b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb259c640 1 -- 172.21.15.66:0/2596867626 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb406e440 con 0x7efeb40cf3e0 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.993+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.994+0000 7efeb259c640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cf3e0 0x7efeb40cf8c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7efea40097a0 tx=0x7efea402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b0e6a00b2951cf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.994+0000 7efeb1d9b640 1 -- 172.21.15.66:0/2596867626 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4037070 con 0x7efeb40cf3e0 2024-05-10T11:21:19.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.994+0000 7efeb1d9b640 1 -- 172.21.15.66:0/2596867626 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4032440 con 0x7efeb40cf3e0 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.994+0000 7efeb1d9b640 1 -- 172.21.15.66:0/2596867626 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4032810 con 0x7efeb40cf3e0 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 -- 172.21.15.66:0/2596867626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cf3e0 msgr2=0x7efeb40cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cf3e0 0x7efeb40cf8c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7efea40097a0 tx=0x7efea402a180 comp rx=0 tx=0).stop 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 -- 172.21.15.66:0/2596867626 shutdown_connections 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 --2- 172.21.15.66:0/2596867626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cf3e0 0x7efeb40cf8c0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 -- 172.21.15.66:0/2596867626 >> 172.21.15.66:0/2596867626 conn(0x7efeb40d2eb0 msgr2=0x7efeb40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 -- 172.21.15.66:0/2596867626 shutdown_connections 2024-05-10T11:21:19.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.995+0000 7efeb8d32640 1 -- 172.21.15.66:0/2596867626 wait complete. 2024-05-10T11:21:19.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.996+0000 7efeb8d32640 1 Processor -- start 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.996+0000 7efeb8d32640 1 -- start start 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb8d32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 0x7efeb40c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb8d32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb40cf3e0 0x7efeb4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb8d32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb8d32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efeb40b34e0 con 0x7efeb40cd500 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb8d32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efeb40b4510 con 0x7efeb40cf3e0 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb8d32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efeb40b3660 con 0x7efeb40d2190 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 0x7efeb40c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 0x7efeb40c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42774/0 (socket says 172.21.15.66:42774) 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 -- 172.21.15.66:0/4096327668 learned_addr learned my addr 172.21.15.66:0/4096327668 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efea9d9b640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb40cf3e0 0x7efeb4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 -- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 msgr2=0x7efeb40c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 -- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb40cf3e0 msgr2=0x7efeb4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb40cf3e0 0x7efeb4157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.997+0000 7efeb259c640 1 -- 172.21.15.66:0/4096327668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb40c8bf0 con 0x7efeb40cd500 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.998+0000 7efeb259c640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 0x7efeb40c74a0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7efea4000c00 tx=0x7efea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.998+0000 7efeab7fe640 1 -- 172.21.15.66:0/4096327668 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4037050 con 0x7efeb40cd500 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.998+0000 7efeab7fe640 1 -- 172.21.15.66:0/4096327668 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4038040 con 0x7efeb40cd500 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.998+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb40c8ed0 con 0x7efeb40cd500 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.998+0000 7efeab7fe640 1 -- 172.21.15.66:0/4096327668 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4004470 con 0x7efeb40cd500 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:19.998+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb40c6ca0 con 0x7efeb40cd500 2024-05-10T11:21:20.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.000+0000 7efeab7fe640 1 -- 172.21.15.66:0/4096327668 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efea4030980 con 0x7efeb40cd500 2024-05-10T11:21:20.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.000+0000 7efeab7fe640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe940762d0 0x7efe94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.000+0000 7efeab7fe640 1 -- 172.21.15.66:0/4096327668 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7efea40b8270 con 0x7efeb40cd500 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.000+0000 7efea9d9b640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe940762d0 0x7efe94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efebba4f740 1 Processor -- start 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efea9d9b640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe940762d0 0x7efe94078790 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efeb4071e80 tx=0x7efe9c007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efebba4f740 1 -- start start 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57e1160 0x556ee5793af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efebba4f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 0x556ee5798950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.001+0000 7efebba4f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556ee5760690 con 0x556ee57c3b40 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556ee56fdf30 con 0x556ee57e1160 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556ee56b6b20 con 0x556ee57c4280 2024-05-10T11:21:20.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 0x556ee5798950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 0x556ee5798950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42776/0 (socket says 172.21.15.66:42776) 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 -- 172.21.15.66:0/2165878156 learned_addr learned my addr 172.21.15.66:0/2165878156 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb259c640 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57e1160 0x556ee5793af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efea9d9b640 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 -- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 msgr2=0x556ee57c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 -- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57e1160 msgr2=0x556ee5793af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57e1160 0x556ee5793af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 -- 172.21.15.66:0/2165878156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee56aee60 con 0x556ee57c3b40 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 0x556ee5798950 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7efeac00f550 tx=0x7efeac00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933a58e4ea5d43c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efe93fff640 1 -- 172.21.15.66:0/2165878156 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac00da00 con 0x556ee57c3b40 2024-05-10T11:21:20.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efe93fff640 1 -- 172.21.15.66:0/2165878156 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac00dba0 con 0x556ee57c3b40 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.002+0000 7efe93fff640 1 -- 172.21.15.66:0/2165878156 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac018440 con 0x556ee57c3b40 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 -- 172.21.15.66:0/2165878156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 msgr2=0x556ee5798950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 0x556ee5798950 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7efeac00f550 tx=0x7efeac00fa10 comp rx=0 tx=0).stop 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 -- 172.21.15.66:0/2165878156 shutdown_connections 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c3b40 0x556ee5798950 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 --2- 172.21.15.66:0/2165878156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57e1160 0x556ee5793af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 -- 172.21.15.66:0/2165878156 >> 172.21.15.66:0/2165878156 conn(0x556ee5795d60 msgr2=0x556ee57de600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 -- 172.21.15.66:0/2165878156 shutdown_connections 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.003+0000 7efebba4f740 1 -- 172.21.15.66:0/2165878156 wait complete. 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.004+0000 7efebba4f740 1 -- start start 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.004+0000 7efebba4f740 1 Processor -- start 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c4280 0x556ee57c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c66e0 0x556ee57c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556ee56ba5e0 con 0x556ee57e1160 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556ee56f9ef0 con 0x556ee57c4280 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556ee5797f10 con 0x556ee57c66e0 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efebba4f740 10 client.0 _ll_register_callbacks cb 0x556ee56b5320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42790/0 (socket says 172.21.15.66:42790) 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 -- 172.21.15.66:0/2981467084 learned_addr learned my addr 172.21.15.66:0/2981467084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efeb259c640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c4280 0x556ee57c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c66e0 0x556ee57c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 -- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c66e0 msgr2=0x556ee57c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c66e0 0x556ee57c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 -- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c4280 msgr2=0x556ee57c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c4280 0x556ee57c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 -- 172.21.15.66:0/2981467084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee54d97d0 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efea9d9b640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57b0e70 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7efeb40cd920 tx=0x7efe9c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d4f9a7235406ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.005+0000 7efe917fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efe917fa640 1 -- 172.21.15.66:0/2981467084 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c027060 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efe917fa640 1 -- 172.21.15.66:0/2981467084 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7efe9c022cb0 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeac00dba0 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efe917fa640 1 -- 172.21.15.66:0/2981467084 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7efe9c012560 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 10 client.8034 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x556ee540f3f0 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efe917fa640 1 -- 172.21.15.66:0/2981467084 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac00dba0 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efe917fa640 1 -- 172.21.15.66:0/2981467084 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7efe9c012700 con 0x556ee57e1160 2024-05-10T11:21:20.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 10 client.8034 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 10 client.8034 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 20 client.8034 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c09a0 0x556ee57eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 4 client.8034 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ee570bb40 con 0x556ee57c09a0 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efeb259c640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c09a0 0x556ee57eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efeb259c640 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c09a0 0x556ee57eeb80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=563c456944f26c0d server_cookie=641014baa7431c4b in_seq=0 out_seq=0 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.006+0000 7efe917fa640 10 client.8034 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efe917fa640 1 -- 172.21.15.66:0/2981467084 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556ee570bb40 con 0x556ee57c09a0 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efe917fa640 10 client.8034 handle_command_reply: tid=0 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 client.8034 shutdown 2024-05-10T11:21:20.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 msgr2=0x556ee57b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57b0e70 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7efeb40cd920 tx=0x7efe9c000ed0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 shutdown_connections 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c09a0 0x556ee57eeb80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c66e0 0x556ee57c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57b0e70 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efe917fa640 0 client.8034 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 --2- 172.21.15.66:0/2981467084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c4280 0x556ee57c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 >> 172.21.15.66:0/2981467084 conn(0x556ee57c3b40 msgr2=0x556ee5793230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 shutdown_connections 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.007+0000 7efebba4f740 1 -- 172.21.15.66:0/2981467084 wait complete. 2024-05-10T11:21:20.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.008+0000 7efebba4f740 20 client.8034 trim_cache size 0 max 16384 2024-05-10T11:21:20.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 Processor -- start 2024-05-10T11:21:20.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 -- start start 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 0x556ee57d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57e1160 0x556ee5798df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4201e20 con 0x556ee57c4280 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4200ec0 con 0x556ee57c66e0 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.026+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efeb41f9670 con 0x556ee57e1160 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 0x556ee57d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 0x556ee57d4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42798/0 (socket says 172.21.15.66:42798) 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 -- 172.21.15.66:0/613377947 learned_addr learned my addr 172.21.15.66:0/613377947 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57e1160 0x556ee5798df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efea9d9b640 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 -- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57e1160 msgr2=0x556ee5798df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57e1160 0x556ee5798df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 -- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 msgr2=0x556ee57d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57d4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 -- 172.21.15.66:0/613377947 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee53cf0f0 con 0x556ee57c4280 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efeb259c640 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 0x556ee57d4690 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7efea4081080 tx=0x7efea4049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79a945f0c9e3992 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efe937fe640 1 -- 172.21.15.66:0/613377947 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4080e90 con 0x556ee57c4280 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efe937fe640 1 -- 172.21.15.66:0/613377947 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4081380 con 0x556ee57c4280 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.027+0000 7efe937fe640 1 -- 172.21.15.66:0/613377947 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4085680 con 0x556ee57c4280 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 -- 172.21.15.66:0/613377947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 msgr2=0x556ee57d4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 0x556ee57d4690 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7efea4081080 tx=0x7efea4049040 comp rx=0 tx=0).stop 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 -- 172.21.15.66:0/613377947 shutdown_connections 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57e1160 0x556ee5798df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 --2- 172.21.15.66:0/613377947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57c4280 0x556ee57d4690 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 -- 172.21.15.66:0/613377947 >> 172.21.15.66:0/613377947 conn(0x556ee57c3b40 msgr2=0x556ee57dea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 -- 172.21.15.66:0/613377947 shutdown_connections 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 -- 172.21.15.66:0/613377947 wait complete. 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 -- start start 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.028+0000 7efebba4f740 1 Processor -- start 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57df510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556ee57c6150 con 0x556ee57e1160 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efeb409d710 con 0x556ee57c66e0 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556ee5796380 con 0x556ee57c4280 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efebba4f740 10 client.0 _ll_register_callbacks cb 0x7efe9c0073c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efeb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efeb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57dfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42800/0 (socket says 172.21.15.66:42800) 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efeb2d9d640 1 -- 172.21.15.66:0/3204553286 learned_addr learned my addr 172.21.15.66:0/3204553286 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efeb259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.029+0000 7efea9d9b640 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57df510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efeb2d9d640 1 -- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 msgr2=0x556ee57c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efeb2d9d640 1 -- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 msgr2=0x556ee57df510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:20.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57df510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efeb2d9d640 1 -- 172.21.15.66:0/3204553286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee5801c00 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efeb2d9d640 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57dfa50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7efeac00f520 tx=0x7efeac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f188ca24d29b41 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efe917fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efe917fa640 1 -- 172.21.15.66:0/3204553286 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac003c20 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea4081380 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efe917fa640 1 -- 172.21.15.66:0/3204553286 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7efeac003dc0 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efe917fa640 1 -- 172.21.15.66:0/3204553286 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7efeac031050 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efebba4f740 10 client.8040 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x556ee5802210 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.030+0000 7efe917fa640 1 -- 172.21.15.66:0/3204553286 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4081380 con 0x556ee57e1160 2024-05-10T11:21:20.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efe917fa640 1 -- 172.21.15.66:0/3204553286 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7efeac034020 con 0x556ee57e1160 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 10 client.8040 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 10 client.8040 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 20 client.8040 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c0d80 0x556ee57c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 4 client.8040 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556ee57059b0 con 0x556ee57c0d80 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efeb259c640 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c0d80 0x556ee57c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efeb259c640 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c0d80 0x556ee57c1800 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c625057fb8873117 server_cookie=1e4735df312751d1 in_seq=0 out_seq=0 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efe917fa640 10 client.8040 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efe917fa640 1 -- 172.21.15.66:0/3204553286 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x556ee57059b0 con 0x556ee57c0d80 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efe917fa640 10 client.8040 handle_command_reply: tid=0 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 client.8040 shutdown 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 msgr2=0x556ee57dfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57dfa50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7efeac00f520 tx=0x7efeac004ab0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 shutdown_connections 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x556ee57c0d80 0x556ee57c1800 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556ee57e1160 0x556ee57dfa50 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556ee57c66e0 0x556ee57df510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 --2- 172.21.15.66:0/3204553286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556ee57c4280 0x556ee57c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 >> 172.21.15.66:0/3204553286 conn(0x556ee57c3b40 msgr2=0x556ee57edda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efe917fa640 0 client.8040 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.031+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 shutdown_connections 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efebba4f740 1 -- 172.21.15.66:0/3204553286 wait complete. 2024-05-10T11:21:20.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efebba4f740 20 client.8040 trim_cache size 0 max 16384 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: "211911df-0341-4bd7-af32-212dc06dd714": { 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "211911df-0341-4bd7-af32-212dc06dd714", 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,repair" 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:21:20.041 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:21:20.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe940762d0 msgr2=0x7efe94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe940762d0 0x7efe94078790 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efeb4071e80 tx=0x7efe9c007d50 comp rx=0 tx=0).stop 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 msgr2=0x7efeb40c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 0x7efeb40c74a0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7efea4000c00 tx=0x7efea40046c0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 shutdown_connections 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efe940762d0 0x7efe94078790 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb40d2190 0x7efeb40c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb40cf3e0 0x7efeb4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 --2- 172.21.15.66:0/4096327668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efeb40cd500 0x7efeb40c74a0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 >> 172.21.15.66:0/4096327668 conn(0x7efeb40d2eb0 msgr2=0x7efeb40b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 shutdown_connections 2024-05-10T11:21:20.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:20.032+0000 7efeb8d32640 1 -- 172.21.15.66:0/4096327668 wait complete. 2024-05-10T11:21:20.044 INFO:tasks.cephfs.filesystem:scrub status for tag:211911df-0341-4bd7-af32-212dc06dd714 - {'path': '/', 'tag': '211911df-0341-4bd7-af32-212dc06dd714', 'options': 'recursive,repair'} 2024-05-10T11:21:20.219 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:21:20.218+0000 7fbf945a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:21:21.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:21.246+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 8 ==== log(8 entries from seq 1 at 2024-05-10T11:21:19.874340+0000) ==== 1407+0+0 (secure 0 0 0) 0x7f29d405c570 con 0x7f29dc163a20 2024-05-10T11:21:21.247 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.874340+0000 mds.c [INF] scrub queued for path: / 2024-05-10T11:21:21.247 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.874342+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-05-10T11:21:21.247 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.874347+0000 mds.c [INF] scrub summary: active paths [/] 2024-05-10T11:21:21.247 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.874904+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-05-10T11:21:21.248 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.874911+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2024-05-10T11:21:21.248 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.875045+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-05-10T11:21:21.248 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.875052+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2024-05-10T11:21:21.248 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:19.875526+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-05-10T11:21:26.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:26.256+0000 7f29c37fe640 1 -- 172.21.15.66:0/221892799 <== mon.0 v2:172.21.15.66:3300/0 9 ==== log(1 entries from seq 9 at 2024-05-10T11:21:24.252185+0000) ==== 189+0+0 (secure 0 0 0) 0x7f29d4060540 con 0x7f29dc163a20 2024-05-10T11:21:26.256 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:21:24.252185+0000 mds.c [INF] scrub summary: idle 2024-05-10T11:21:33.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:21:33.178 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:21:50.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:21:50.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T11:21:50.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.166+0000 7fd8a9589640 1 Processor -- start 2024-05-10T11:21:50.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.166+0000 7fd8a9589640 1 -- start start 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a9589640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8a40cfe90 0x7fd8a40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a9589640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8a40b2960 0x7fd8a40b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a9589640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a4160c50 con 0x7fd8a4160870 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a9589640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a40d39d0 con 0x7fd8a40b2960 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a9589640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a40d3cb0 con 0x7fd8a40cfe90 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8a40b2960 0x7fd8a40b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a37fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8a40b2960 0x7fd8a40b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35356/0 (socket says 172.21.15.66:35356) 2024-05-10T11:21:50.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a37fe640 1 -- 172.21.15.66:0/2888800202 learned_addr learned my addr 172.21.15.66:0/2888800202 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2888800202 >> v2:172.21.15.190:3300/0 conn(0x7fd8a40cfe90 0x7fd8a40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a37fe640 1 -- 172.21.15.66:0/2888800202 >> v2:172.21.15.190:3300/0 conn(0x7fd8a40cfe90 msgr2=0x7fd8a40cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.167+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2888800202 >> v2:172.21.15.190:3300/0 conn(0x7fd8a40cfe90 0x7fd8a40cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.168+0000 7fd8a37fe640 1 -- 172.21.15.66:0/2888800202 >> v1:172.21.15.190:6789/0 conn(0x7fd8a4160870 legacy=0x7fd8a40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.168+0000 7fd8a37fe640 1 -- 172.21.15.66:0/2888800202 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a40d1770 con 0x7fd8a40b2960 2024-05-10T11:21:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.168+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2888800202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40b2960 0x7fd8a40b2d90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4073a80 tx=0x7fd89c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc5a81cf62ce254 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.168+0000 7fd8a27fc640 1 -- 172.21.15.66:0/2888800202 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c036070 con 0x7fd8a40b2960 2024-05-10T11:21:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.168+0000 7fd8a27fc640 1 -- 172.21.15.66:0/2888800202 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c031600 con 0x7fd8a40b2960 2024-05-10T11:21:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.168+0000 7fd8a27fc640 1 -- 172.21.15.66:0/2888800202 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0319d0 con 0x7fd8a40b2960 2024-05-10T11:21:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 -- 172.21.15.66:0/2888800202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40b2960 msgr2=0x7fd8a40b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2888800202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40b2960 0x7fd8a40b2d90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4073a80 tx=0x7fd89c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 -- 172.21.15.66:0/2888800202 shutdown_connections 2024-05-10T11:21:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2888800202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40b2960 0x7fd8a40b2d90 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2888800202 >> v2:172.21.15.190:3300/0 conn(0x7fd8a40cfe90 0x7fd8a40cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 -- 172.21.15.66:0/2888800202 >> 172.21.15.66:0/2888800202 conn(0x7fd8a40d2eb0 msgr2=0x7fd8a40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 -- 172.21.15.66:0/2888800202 shutdown_connections 2024-05-10T11:21:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.169+0000 7fd8a9589640 1 -- 172.21.15.66:0/2888800202 wait complete. 2024-05-10T11:21:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 Processor -- start 2024-05-10T11:21:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 -- start start 2024-05-10T11:21:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a40b2960 0x7fd8a40c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 0x7fd8a4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a4160870 0x7fd8a40cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40d1460 con 0x7fd8a40cfe90 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40d1d30 con 0x7fd8a40b2960 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.171+0000 7fd8a9589640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a40b32d0 con 0x7fd8a4160870 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 0x7fd8a4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 0x7fd8a4158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35362/0 (socket says 172.21.15.66:35362) 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 -- 172.21.15.66:0/2410488342 learned_addr learned my addr 172.21.15.66:0/2410488342 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a40b2960 0x7fd8a40c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a4160870 0x7fd8a40cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 -- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a4160870 msgr2=0x7fd8a40cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a4160870 0x7fd8a40cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 -- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a40b2960 msgr2=0x7fd8a40c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a40b2960 0x7fd8a40c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 -- 172.21.15.66:0/2410488342 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a406ee70 con 0x7fd8a40cfe90 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a4160870 0x7fd8a40cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:50.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 0x7fd8a4158dd0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e9b0 tx=0x7fd88c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89b7fe640 1 -- 172.21.15.66:0/2410488342 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c017070 con 0x7fd8a40cfe90 2024-05-10T11:21:50.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89b7fe640 1 -- 172.21.15.66:0/2410488342 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c00c9a0 con 0x7fd8a40cfe90 2024-05-10T11:21:50.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd89b7fe640 1 -- 172.21.15.66:0/2410488342 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00cd90 con 0x7fd8a40cfe90 2024-05-10T11:21:50.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a406f150 con 0x7fd8a40cfe90 2024-05-10T11:21:50.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.172+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a40ca390 con 0x7fd8a40cfe90 2024-05-10T11:21:50.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.174+0000 7fd89b7fe640 1 -- 172.21.15.66:0/2410488342 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd88c01a070 con 0x7fd8a40cfe90 2024-05-10T11:21:50.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.174+0000 7fd89b7fe640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8840762d0 0x7fd884078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.175+0000 7fd89b7fe640 1 -- 172.21.15.66:0/2410488342 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7fd88c0977b0 con 0x7fd8a40cfe90 2024-05-10T11:21:50.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.175+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8840762d0 0x7fd884078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.175+0000 7fd8ac37d740 1 Processor -- start 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.175+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8840762d0 0x7fd884078790 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd894007fd0 tx=0x7fd894009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.175+0000 7fd8ac37d740 1 -- start start 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184abc160 0x55e184a6eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184a9f280 0x55e184a9e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 0x55e184a73950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e184a3b690 con 0x55e184a9eb40 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e1849d8f30 con 0x55e184abc160 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e184991b20 con 0x55e184a9f280 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 0x55e184a73950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 0x55e184a73950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35364/0 (socket says 172.21.15.66:35364) 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8a37fe640 1 -- 172.21.15.66:0/3724292731 learned_addr learned my addr 172.21.15.66:0/3724292731 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184abc160 0x55e184a6eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.176+0000 7fd89bfff640 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184a9f280 0x55e184a9e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd8a37fe640 1 -- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184a9f280 msgr2=0x55e184a9e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184a9f280 0x55e184a9e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd8a37fe640 1 -- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184abc160 msgr2=0x55e184a6eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184abc160 0x55e184a6eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd8a37fe640 1 -- 172.21.15.66:0/3724292731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e184989e60 con 0x55e184a9eb40 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd89bfff640 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184a9f280 0x55e184a9e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 0x55e184a73950 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd89c02ac90 tx=0x7fd89c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bb5df1ff3dad86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd898ff9640 1 -- 172.21.15.66:0/3724292731 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c036040 con 0x55e184a9eb40 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd898ff9640 1 -- 172.21.15.66:0/3724292731 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c042070 con 0x55e184a9eb40 2024-05-10T11:21:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.177+0000 7fd898ff9640 1 -- 172.21.15.66:0/3724292731 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c03c870 con 0x55e184a9eb40 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 -- 172.21.15.66:0/3724292731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 msgr2=0x55e184a73950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 0x55e184a73950 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd89c02ac90 tx=0x7fd89c02e000 comp rx=0 tx=0).stop 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 -- 172.21.15.66:0/3724292731 shutdown_connections 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9eb40 0x55e184a73950 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184a9f280 0x55e184a9e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/3724292731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184abc160 0x55e184a6eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 -- 172.21.15.66:0/3724292731 >> 172.21.15.66:0/3724292731 conn(0x55e184a70d60 msgr2=0x55e184ab9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 -- 172.21.15.66:0/3724292731 shutdown_connections 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 -- 172.21.15.66:0/3724292731 wait complete. 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 -- start start 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.178+0000 7fd8ac37d740 1 Processor -- start 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184a99f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 0x55e184ac9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184ab0f30 0x55e184ab13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e1849955e0 con 0x55e184abc160 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e1849d4ef0 con 0x55e184a9f280 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e184a72f10 con 0x55e184ab0f30 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8ac37d740 10 client.0 _ll_register_callbacks cb 0x55e184990320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 0x55e184ac9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 0x55e184ac9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35380/0 (socket says 172.21.15.66:35380) 2024-05-10T11:21:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd89bfff640 1 -- 172.21.15.66:0/2004577050 learned_addr learned my addr 172.21.15.66:0/2004577050 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184ab0f30 0x55e184ab13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.179+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184a99f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd89bfff640 1 -- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184ab0f30 msgr2=0x55e184ab13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184ab0f30 0x55e184ab13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd89bfff640 1 -- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 msgr2=0x55e184a99f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184a99f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd89bfff640 1 -- 172.21.15.66:0/2004577050 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1847b47d0 con 0x55e184abc160 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184ab0f30 0x55e184ab13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 0x55e184ac9820 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd88c05db10 tx=0x7fd88c060e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d344fda15fcf8ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd881ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd881ffb640 1 -- 172.21.15.66:0/2004577050 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c021040 con 0x55e184abc160 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd881ffb640 1 -- 172.21.15.66:0/2004577050 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7fd88c061dd0 con 0x55e184abc160 2024-05-10T11:21:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd89c042070 con 0x55e184abc160 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd881ffb640 1 -- 172.21.15.66:0/2004577050 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fd88c095050 con 0x55e184abc160 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 10 client.8052 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55e1846ea3f0 con 0x55e184abc160 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd881ffb640 1 -- 172.21.15.66:0/2004577050 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c042070 con 0x55e184abc160 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd881ffb640 1 -- 172.21.15.66:0/2004577050 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7fd88c024060 con 0x55e184abc160 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 10 client.8052 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 10 client.8052 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 20 client.8052 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.180+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184abab70 0x55e184aa1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.181+0000 7fd8ac37d740 4 client.8052 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.181+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1849e6b40 con 0x55e184abab70 2024-05-10T11:21:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.181+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184abab70 0x55e184aa1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.181+0000 7fd881ffb640 10 client.8052 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.181+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184abab70 0x55e184aa1bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2553ae0a9c7b11a server_cookie=dc9005f374b0c59e in_seq=0 out_seq=0 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd881ffb640 1 -- 172.21.15.66:0/2004577050 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e1849e6b40 con 0x55e184abab70 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd881ffb640 10 client.8052 handle_command_reply: tid=0 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 client.8052 shutdown 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 msgr2=0x55e184ac9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 0x55e184ac9820 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd88c05db10 tx=0x7fd88c060e00 comp rx=0 tx=0).stop 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 shutdown_connections 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184abab70 0x55e184aa1bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184ab0f30 0x55e184ab13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184abc160 0x55e184ac9820 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd881ffb640 0 client.8052 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2004577050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184a99f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 >> 172.21.15.66:0/2004577050 conn(0x55e184a9eb40 msgr2=0x55e184a6e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 shutdown_connections 2024-05-10T11:21:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2004577050 wait complete. 2024-05-10T11:21:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.182+0000 7fd8ac37d740 20 client.8052 trim_cache size 0 max 16384 2024-05-10T11:21:50.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.200+0000 7fd8ac37d740 1 Processor -- start 2024-05-10T11:21:50.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.200+0000 7fd8ac37d740 1 -- start start 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184abd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 0x55e184aa1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a99d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a42020b0 con 0x55e184ab0f30 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a4201090 con 0x55e184a9f280 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a40cb670 con 0x55e184abc160 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 0x55e184aa1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 0x55e184aa1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35382/0 (socket says 172.21.15.66:35382) 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 -- 172.21.15.66:0/325439819 learned_addr learned my addr 172.21.15.66:0/325439819 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184abd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a99d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 -- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 msgr2=0x55e184a99d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a99d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 -- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 msgr2=0x55e184abd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184abd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.201+0000 7fd89bfff640 1 -- 172.21.15.66:0/325439819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e184a71ea0 con 0x55e184ab0f30 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd89bfff640 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 0x55e184aa1b90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0605a0 tx=0x7fd88c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceb43887f932dee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd883fff640 1 -- 172.21.15.66:0/325439819 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c021040 con 0x55e184ab0f30 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd883fff640 1 -- 172.21.15.66:0/325439819 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c069670 con 0x55e184ab0f30 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd883fff640 1 -- 172.21.15.66:0/325439819 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c061df0 con 0x55e184ab0f30 2024-05-10T11:21:50.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 -- 172.21.15.66:0/325439819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 msgr2=0x55e184aa1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 0x55e184aa1b90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0605a0 tx=0x7fd88c01e000 comp rx=0 tx=0).stop 2024-05-10T11:21:50.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 -- 172.21.15.66:0/325439819 shutdown_connections 2024-05-10T11:21:50.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a99d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184ab0f30 0x55e184aa1b90 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/325439819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184a9f280 0x55e184abd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 -- 172.21.15.66:0/325439819 >> 172.21.15.66:0/325439819 conn(0x55e184a9eb40 msgr2=0x55e184aa2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 -- 172.21.15.66:0/325439819 shutdown_connections 2024-05-10T11:21:50.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.202+0000 7fd8ac37d740 1 -- 172.21.15.66:0/325439819 wait complete. 2024-05-10T11:21:50.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.203+0000 7fd8ac37d740 1 -- start start 2024-05-10T11:21:50.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.203+0000 7fd8ac37d740 1 Processor -- start 2024-05-10T11:21:50.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 0x55e184b20860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184ab0f30 0x55e184a72b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a73060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e184a9e660 con 0x55e184a9f280 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a406dfd0 con 0x55e184ab0f30 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e184a9c100 con 0x55e184abc160 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8ac37d740 10 client.0 _ll_register_callbacks cb 0x7fd88c069050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 0x55e184b20860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 0x55e184b20860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35392/0 (socket says 172.21.15.66:35392) 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 -- 172.21.15.66:0/2115000827 learned_addr learned my addr 172.21.15.66:0/2115000827 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a73060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184ab0f30 0x55e184a72b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 -- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 msgr2=0x55e184a73060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a73060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 -- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184ab0f30 msgr2=0x55e184a72b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184ab0f30 0x55e184a72b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 -- 172.21.15.66:0/2115000827 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1846aa0f0 con 0x55e184a9f280 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a37fe640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a73060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd8a2ffd640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 0x55e184b20860 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x55e184aa2150 tx=0x7fd894000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5317ec0142d9a23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd881ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.204+0000 7fd881ffb640 1 -- 172.21.15.66:0/2115000827 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894003e40 con 0x55e184a9f280 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd881ffb640 1 -- 172.21.15.66:0/2115000827 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7fd89401e040 con 0x55e184a9f280 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd88c069670 con 0x55e184a9f280 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd881ffb640 1 -- 172.21.15.66:0/2115000827 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fd894033050 con 0x55e184a9f280 2024-05-10T11:21:50.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 10 client.8058 fetch_fsmap learned FSMap version 89 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55e184b3b750 con 0x55e184a9f280 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd881ffb640 1 -- 172.21.15.66:0/2115000827 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c069670 con 0x55e184a9f280 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd881ffb640 1 -- 172.21.15.66:0/2115000827 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7fd894036020 con 0x55e184a9f280 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 10 client.8058 fetch_fsmap finished waiting for FSMap version 89 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 10 client.8058 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 20 client.8058 populate_metadata read hostname 'smithi066' 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184a72590 0x55e184b37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 4 client.8058 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 --> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e1849e09b0 con 0x55e184a72590 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184a72590 0x55e184b37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd89bfff640 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184a72590 0x55e184b37880 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7121076d9a5aea70 server_cookie=d56409d95ff890bf in_seq=0 out_seq=0 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.205+0000 7fd881ffb640 10 client.8058 ms_handle_connect on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd881ffb640 1 -- 172.21.15.66:0/2115000827 <== mds.0 v2:172.21.15.66:6834/3403431174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e1849e09b0 con 0x55e184a72590 2024-05-10T11:21:50.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd881ffb640 10 client.8058 handle_command_reply: tid=0 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 client.8058 shutdown 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 msgr2=0x55e184b20860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 0x55e184b20860 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x55e184aa2150 tx=0x7fd894000bc0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 shutdown_connections 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:6834/3403431174,v1:172.21.15.66:6835/3403431174] conn(0x55e184a72590 0x55e184b37880 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e184abc160 0x55e184a73060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e184ab0f30 0x55e184a72b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 --2- 172.21.15.66:0/2115000827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e184a9f280 0x55e184b20860 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd881ffb640 0 client.8058 ms_handle_reset on v2:172.21.15.66:6834/3403431174 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 >> 172.21.15.66:0/2115000827 conn(0x55e184a9eb40 msgr2=0x55e184abd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 shutdown_connections 2024-05-10T11:21:50.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 1 -- 172.21.15.66:0/2115000827 wait complete. 2024-05-10T11:21:50.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8ac37d740 20 client.8058 trim_cache size 0 max 16384 2024-05-10T11:21:50.215 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:21:50.215 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-05-10T11:21:50.215 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-05-10T11:21:50.215 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8840762d0 msgr2=0x7fd884078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8840762d0 0x7fd884078790 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd894007fd0 tx=0x7fd894009040 comp rx=0 tx=0).stop 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 msgr2=0x7fd8a4158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 0x7fd8a4158dd0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e9b0 tx=0x7fd88c00ee70 comp rx=0 tx=0).stop 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 shutdown_connections 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd8840762d0 0x7fd884078790 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a4160870 0x7fd8a40cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a40cfe90 0x7fd8a4158dd0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 --2- 172.21.15.66:0/2410488342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a40b2960 0x7fd8a40c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.206+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 >> 172.21.15.66:0/2410488342 conn(0x7fd8a40d2eb0 msgr2=0x7fd8a40d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.207+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 shutdown_connections 2024-05-10T11:21:50.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.207+0000 7fd8a9589640 1 -- 172.21.15.66:0/2410488342 wait complete. 2024-05-10T11:21:50.218 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T11:21:50.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:21:50.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.425+0000 7f6f3d859640 1 Processor -- start 2024-05-10T11:21:50.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.425+0000 7f6f3d859640 1 -- start start 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.426+0000 7f6f3d859640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f380b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.426+0000 7f6f3d859640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f380d41f0 con 0x7f6f380d1fb0 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.426+0000 7f6f3d859640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f380d5eb0 con 0x7f6f380b5520 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.426+0000 7f6f3d859640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6f380d5c60 con 0x7f6f380b5900 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.426+0000 7f6f367fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6f380d1fb0 0x7f6f380b8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47726/0 (socket says 172.21.15.66:47726) 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.426+0000 7f6f367fc640 1 -- 172.21.15.66:0/1068809401 learned_addr learned my addr 172.21.15.66:0/1068809401 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f377fe640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f380b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9450847 0 0) 0x7f6f380d41f0 con 0x7f6f380d1fb0 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f24003520 con 0x7f6f380d1fb0 2024-05-10T11:21:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695734213 0 0) 0x7f6f380d5eb0 con 0x7f6f380b5520 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f380d41f0 con 0x7f6f380b5520 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4027711339 0 0) 0x7f6f24003520 con 0x7f6f380d1fb0 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 msgr2=0x7f6f380b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f380b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 >> v1:172.21.15.190:6789/0 conn(0x7f6f380b5520 legacy=0x7f6f380d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f380d0a30 con 0x7f6f380d1fb0 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f6f20001670 con 0x7f6f380d1fb0 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f377fe640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f380b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 >> v1:172.21.15.66:6789/0 conn(0x7f6f380d1fb0 legacy=0x7f6f380b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f24003b70 0x7f6f24003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f24004800 0x7f6f24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f380d5c60 con 0x7f6f24004800 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2400b9f0 con 0x7f6f24003b70 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2400bbf0 con 0x7f6f380b5900 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f367fc640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f24004800 0x7f6f24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f36ffd640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f24003b70 0x7f6f24003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.427+0000 7f6f377fe640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f367fc640 1 -- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 msgr2=0x7f6f240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f367fc640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f380b5900 0x7f6f240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f367fc640 1 -- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f24003b70 msgr2=0x7f6f24003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f367fc640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f24003b70 0x7f6f24003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f367fc640 1 -- 172.21.15.66:0/1068809401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f24003520 con 0x7f6f24004800 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f367fc640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f24004800 0x7f6f24004c80 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c160 tx=0x7f6f24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758bb347772129fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007cc0 con 0x7f6f24004800 2024-05-10T11:21:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f20005af0 con 0x7f6f24004800 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.428+0000 7f6f35ffb640 1 -- 172.21.15.66:0/1068809401 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007070 con 0x7f6f24004800 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f3d859640 1 -- 172.21.15.66:0/1068809401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f24004800 msgr2=0x7f6f24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f3d859640 1 --2- 172.21.15.66:0/1068809401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f24004800 0x7f6f24004c80 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c160 tx=0x7f6f24005830 comp rx=0 tx=0).stop 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f377fe640 1 -- 172.21.15.66:0/1068809401 reap_dead start 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f3d859640 1 -- 172.21.15.66:0/1068809401 shutdown_connections 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f3d859640 1 -- 172.21.15.66:0/1068809401 >> 172.21.15.66:0/1068809401 conn(0x7f6f380d5170 msgr2=0x7f6f380d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f3d859640 1 -- 172.21.15.66:0/1068809401 shutdown_connections 2024-05-10T11:21:50.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.429+0000 7f6f3d859640 1 -- 172.21.15.66:0/1068809401 wait complete. 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.430+0000 7f6f3d859640 1 Processor -- start 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.430+0000 7f6f3d859640 1 -- start start 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f3d859640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f24004800 0x7f6f381f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f3d859640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 0x7f6f381555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f3d859640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38158700 0x7f6f38158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f3d859640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f380b6460 con 0x7f6f380b46d0 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f3d859640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6f380b62e0 con 0x7f6f38158700 2024-05-10T11:21:50.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f3d859640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6f380b65e0 con 0x7f6f24004800 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f367fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 0x7f6f381555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f367fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 0x7f6f381555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35418/0 (socket says 172.21.15.66:35418) 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.431+0000 7f6f367fc640 1 -- 172.21.15.66:0/636674851 learned_addr learned my addr 172.21.15.66:0/636674851 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f377fe640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38158700 0x7f6f38158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f36ffd640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f24004800 0x7f6f381f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f367fc640 1 -- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f24004800 msgr2=0x7f6f381f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f367fc640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f24004800 0x7f6f381f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f367fc640 1 -- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38158700 msgr2=0x7f6f38158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f367fc640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38158700 0x7f6f38158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f367fc640 1 -- 172.21.15.66:0/636674851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f380b3390 con 0x7f6f380b46d0 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f377fe640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38158700 0x7f6f38158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f36ffd640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f24004800 0x7f6f381f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:50.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f367fc640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 0x7f6f381555a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c1c0 tx=0x7f6f380b7d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20001670 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f20042070 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f381f6060 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007290 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.432+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f380b3bf0 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.433+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f380d4c30 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.434+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6f20007430 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.434+0000 7f6f2ffff640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f18076300 0x7f6f180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.434+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6216+0+0 (secure 0 0 0) 0x7f6f200b7ca0 con 0x7f6f380b46d0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.435+0000 7f6f36ffd640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f18076300 0x7f6f180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.435+0000 7f6f36ffd640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f18076300 0x7f6f180787c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6f381584f0 tx=0x7f6f28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.439+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6f380d4c30 con 0x7f6f380b46d0 2024-05-10T11:21:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.670+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6f380d2540 con 0x7f6f380b46d0 2024-05-10T11:21:50.670 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:21:50.671+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:21:50.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.674+0000 7f6f2ffff640 1 -- 172.21.15.66:0/636674851 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7f6f20005ac0 con 0x7f6f380b46d0 2024-05-10T11:21:50.673 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f18076300 msgr2=0x7f6f180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f18076300 0x7f6f180787c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6f381584f0 tx=0x7f6f28009040 comp rx=0 tx=0).stop 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 msgr2=0x7f6f381555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 0x7f6f381555a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c1c0 tx=0x7f6f380b7d20 comp rx=0 tx=0).stop 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 shutdown_connections 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6f18076300 0x7f6f180787c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38158700 0x7f6f38158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f380b46d0 0x7f6f381555a0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 --2- 172.21.15.66:0/636674851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f24004800 0x7f6f381f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 >> 172.21.15.66:0/636674851 conn(0x7f6f380d5170 msgr2=0x7f6f380d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 shutdown_connections 2024-05-10T11:21:50.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.677+0000 7f6f3d859640 1 -- 172.21.15.66:0/636674851 wait complete. 2024-05-10T11:21:50.678 INFO:tasks.ceph.mds.c.smithi066.stderr: -1154> 2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-05-10T11:21:50.678 INFO:tasks.ceph.mds.c.smithi066.stderr: -1151> 2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-05-10T11:21:50.678 INFO:tasks.ceph.mds.c.smithi066.stderr: -1134> 2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-05-10T11:21:50.678 INFO:tasks.ceph.mds.c.smithi066.stderr: -1131> 2024-05-10T11:21:19.873+0000 7fbf9059d640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-05-10T11:21:50.678 INFO:tasks.ceph.mds.c.smithi066.stderr: -1000> 2024-05-10T11:21:20.218+0000 7fbf945a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:21:50.689 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-05-10T11:21:50.706 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:21:50.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.732+0000 7ff644dfd280 1 -- start start 2024-05-10T11:21:50.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.732+0000 7ff644dfd280 1 Processor -- start 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 0x56058cf80b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058cf9bc00 0x56058cf81080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082000 0x56058cf80000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff644dfd280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56058cf42600 con 0x56058cf9a400 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff644dfd280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56058cf42180 con 0x56058cf9bc00 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff644dfd280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56058c206180 con 0x56058d082000 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 0x56058cf80b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 0x56058cf80b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35448/0 (socket says 172.21.15.66:35448) 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 -- 172.21.15.66:0/473965907 learned_addr learned my addr 172.21.15.66:0/473965907 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff642daa640 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058cf9bc00 0x56058cf81080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff643dac640 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082000 0x56058cf80000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 -- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082000 msgr2=0x56058cf80000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082000 0x56058cf80000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 -- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058cf9bc00 msgr2=0x56058cf81080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058cf9bc00 0x56058cf81080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.733+0000 7ff6435ab640 1 -- 172.21.15.66:0/473965907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058c1da780 con 0x56058cf9a400 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff643dac640 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082000 0x56058cf80000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff6435ab640 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 0x56058cf80b00 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x56058cfeb2f0 tx=0x56058cf46180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63104f397b4300fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff640da6640 1 -- 172.21.15.66:0/473965907 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56058c1cad00 con 0x56058cf9a400 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff640da6640 1 -- 172.21.15.66:0/473965907 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56058c1d0e00 con 0x56058cf9a400 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff640da6640 1 -- 172.21.15.66:0/473965907 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56058c1ca680 con 0x56058cf9a400 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058c1db860 con 0x56058cf9a400 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56058c1db680 con 0x56058cf9a400 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff644dfd280 4 waiting for MDS map... 2024-05-10T11:21:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff640da6640 1 -- 172.21.15.66:0/473965907 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x56058d092600 con 0x56058cf9a400 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff640da6640 1 -- 172.21.15.66:0/473965907 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x56058c1ff180 con 0x56058cf9a400 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff644dfd280 4 Got MDS map 90 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff644dfd280 10 main: main 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.734+0000 7ff644dfd280 4 main: connecting to RADOS... 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 Processor -- start 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 -- start start 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56058c206480 con 0x56058d082c00 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56058c206900 con 0x56058d082800 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.735+0000 7ff644dfd280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56058cf43080 con 0x56058d083000 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35462/0 (socket says 172.21.15.66:35462) 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 -- 172.21.15.66:0/622172501 learned_addr learned my addr 172.21.15.66:0/622172501 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff642daa640 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff643dac640 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 -- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d083000 msgr2=0x56058cf82100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 -- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d082800 msgr2=0x56058cf81600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 -- 172.21.15.66:0/622172501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058c1db4a0 con 0x56058d082c00 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff6435ab640 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x56058d0b0720 tx=0x56058cf44ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3f1a8f6901048 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff63eda2640 1 -- 172.21.15.66:0/622172501 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56058c1ca820 con 0x56058d082c00 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff63eda2640 1 -- 172.21.15.66:0/622172501 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56058c1d0a80 con 0x56058d082c00 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff63eda2640 1 -- 172.21.15.66:0/622172501 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56058c1cad00 con 0x56058d082c00 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff644dfd280 1 -- 172.21.15.66:0/622172501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 msgr2=0x56058cf81b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.736+0000 7ff644dfd280 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x56058d0b0720 tx=0x56058cf44ae0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 -- 172.21.15.66:0/622172501 shutdown_connections 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 --2- 172.21.15.66:0/622172501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 -- 172.21.15.66:0/622172501 >> 172.21.15.66:0/622172501 conn(0x56058d082400 msgr2=0x56058c29d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 -- 172.21.15.66:0/622172501 shutdown_connections 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 -- 172.21.15.66:0/622172501 wait complete. 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 Processor -- start 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.737+0000 7ff644dfd280 1 -- start start 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff644dfd280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff644dfd280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56058cf43380 con 0x56058d082c00 2024-05-10T11:21:50.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff644dfd280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56058cf43200 con 0x56058d083000 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff644dfd280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56058cf43500 con 0x56058d082800 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35466/0 (socket says 172.21.15.66:35466) 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 -- 172.21.15.66:0/2745658204 learned_addr learned my addr 172.21.15.66:0/2745658204 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff642daa640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff643dac640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 -- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082800 msgr2=0x56058cf81600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 -- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d083000 msgr2=0x56058cf82100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 -- 172.21.15.66:0/2745658204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058c1da780 con 0x56058d082c00 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff642daa640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058d083000 0x56058cf82100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff643dac640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082800 0x56058cf81600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.738+0000 7ff6435ab640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x56058d0b19e0 tx=0x56058d0b3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.739+0000 7ff63d59f640 1 -- 172.21.15.66:0/2745658204 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56058c1ca680 con 0x56058d082c00 2024-05-10T11:21:50.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.739+0000 7ff63d59f640 1 -- 172.21.15.66:0/2745658204 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56058c1d0c40 con 0x56058d082c00 2024-05-10T11:21:50.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.739+0000 7ff63d59f640 1 -- 172.21.15.66:0/2745658204 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56058c1ca4e0 con 0x56058d082c00 2024-05-10T11:21:50.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.739+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56058c1db860 con 0x56058d082c00 2024-05-10T11:21:50.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.739+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058c1db680 con 0x56058d082c00 2024-05-10T11:21:50.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.739+0000 7ff644dfd280 4 main: resolving pool 15 2024-05-10T11:21:50.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.740+0000 7ff63d59f640 1 -- 172.21.15.66:0/2745658204 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x56058d104c00 con 0x56058d082c00 2024-05-10T11:21:50.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.740+0000 7ff63d59f640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x56058d0ab000 0x56058cf82680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.740+0000 7ff63d59f640 1 -- 172.21.15.66:0/2745658204 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x56058d108600 con 0x56058d082c00 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.740+0000 7ff644dfd280 4 main: creating IoCtx.. 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.740+0000 7ff644dfd280 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56058d0ab400 0x56058cf82c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.740+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x56058d0ab800 con 0x56058d0ab400 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff642daa640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56058d0ab400 0x56058cf82c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff643dac640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x56058d0ab000 0x56058cf82680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff642daa640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56058d0ab400 0x56058cf82c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff643dac640 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x56058d0ab000 0x56058cf82680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x56058c1ddef0 tx=0x56058c4d8840 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff642daa640 1 -- 172.21.15.66:0/2745658204 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x56058cf32000 con 0x56058d0ab400 2024-05-10T11:21:50.747 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "0": { 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "data": { 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 5, 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "inotable": { 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "projected_free": [ 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "start": 1099511627779, 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "len": 1099511627773 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "free": [ 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:21:50.748 INFO:teuthology.orchestra.run.smithi066.stdout: "start": 1099511627779, 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: "len": 1099511627773 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: "result": 0 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:21:50.749 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56058d0ab400 msgr2=0x56058cf82c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x56058d0ab400 0x56058cf82c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x56058d0ab000 msgr2=0x56058cf82680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x56058d0ab000 0x56058cf82680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x56058c1ddef0 tx=0x56058c4d8840 comp rx=0 tx=0).stop 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 msgr2=0x56058cf81b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 --2- 172.21.15.66:0/2745658204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058d082c00 0x56058cf81b80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x56058d0b19e0 tx=0x56058d0b3800 comp rx=0 tx=0).stop 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff642daa640 1 -- 172.21.15.66:0/2745658204 reap_dead start 2024-05-10T11:21:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 shutdown_connections 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.741+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 >> 172.21.15.66:0/2745658204 conn(0x56058d082400 msgr2=0x56058c29d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 shutdown_connections 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/2745658204 wait complete. 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 msgr2=0x56058cf80b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 0x56058cf80b00 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x56058cfeb2f0 tx=0x56058cf46180 comp rx=0 tx=0).stop 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 shutdown_connections 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56058d082000 0x56058cf80000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56058cf9bc00 0x56058cf81080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 --2- 172.21.15.66:0/473965907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56058cf9a400 0x56058cf80b00 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 >> 172.21.15.66:0/473965907 conn(0x56058c1a5000 msgr2=0x56058c29c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 shutdown_connections 2024-05-10T11:21:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:50.742+0000 7ff644dfd280 1 -- 172.21.15.66:0/473965907 wait complete. 2024-05-10T11:21:50.753 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.063383, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-05-10T11:21:50.753 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:21:50.753 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:21:50.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:21:50.872 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:21:50.872 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:21:50.872 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:21:50.872 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:21:50.889 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:21:50.889 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:21:50.889 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:21:50.889 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:21:50.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:21:50.908 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:21:50.909 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:21:50.909 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:21:50.945 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:21:50.945 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:21:50.945 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:21:50.945 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:21:50.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:21:50.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.090+0000 7f3d3f2cf640 1 Processor -- start 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.090+0000 7f3d3f2cf640 1 -- start start 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3f2cf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d380d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3f2cf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d380d1230 0x7f3d380d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3f2cf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3d380b2900 0x7f3d380b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3f2cf640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3d38160c90 con 0x7f3d380d1230 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3f2cf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3d380ce5f0 con 0x7f3d380b2900 2024-05-10T11:21:51.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3f2cf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3d380ce8d0 con 0x7f3d381608b0 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3c86a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d380d1230 0x7f3d380d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3c86a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d380d1230 0x7f3d380d16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35478/0 (socket says 172.21.15.66:35478) 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3c86a640 1 -- 172.21.15.66:0/4120700702 learned_addr learned my addr 172.21.15.66:0/4120700702 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3d86c640 1 --2- 172.21.15.66:0/4120700702 >> v2:172.21.15.190:3300/0 conn(0x7f3d380b2900 0x7f3d380b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.091+0000 7f3d3d06b640 1 --2- 172.21.15.66:0/4120700702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d380d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.092+0000 7f3d3c86a640 1 -- 172.21.15.66:0/4120700702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 msgr2=0x7f3d380d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.092+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/4120700702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d380d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.092+0000 7f3d3c86a640 1 -- 172.21.15.66:0/4120700702 >> v2:172.21.15.190:3300/0 conn(0x7f3d380b2900 msgr2=0x7f3d380b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.092+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/4120700702 >> v2:172.21.15.190:3300/0 conn(0x7f3d380b2900 0x7f3d380b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.092+0000 7f3d3c86a640 1 -- 172.21.15.66:0/4120700702 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d380cebb0 con 0x7f3d380d1230 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.092+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/4120700702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380d1230 0x7f3d380d16b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3d380c64b0 tx=0x7f3d2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f102b4e08d5af3bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d2ffff640 1 -- 172.21.15.66:0/4120700702 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28037070 con 0x7f3d380d1230 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d2ffff640 1 -- 172.21.15.66:0/4120700702 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28032440 con 0x7f3d380d1230 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d2ffff640 1 -- 172.21.15.66:0/4120700702 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28032810 con 0x7f3d380d1230 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/4120700702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380d1230 msgr2=0x7f3d380d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/4120700702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380d1230 0x7f3d380d16b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3d380c64b0 tx=0x7f3d2802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/4120700702 shutdown_connections 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/4120700702 >> v2:172.21.15.190:3300/0 conn(0x7f3d380b2900 0x7f3d380b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/4120700702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380d1230 0x7f3d380d16b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/4120700702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d380d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/4120700702 >> 172.21.15.66:0/4120700702 conn(0x7f3d380d2df0 msgr2=0x7f3d380d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:51.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/4120700702 shutdown_connections 2024-05-10T11:21:51.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.093+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/4120700702 wait complete. 2024-05-10T11:21:51.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.094+0000 7f3d3f2cf640 1 Processor -- start 2024-05-10T11:21:51.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 -- start start 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 0x7f3d381f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d380d1230 0x7f3d381582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d38154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380d1f10 con 0x7f3d380b2900 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380d1d90 con 0x7f3d380d1230 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3f2cf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3d380b32d0 con 0x7f3d381608b0 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3d06b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 0x7f3d381f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3d06b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 0x7f3d381f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35482/0 (socket says 172.21.15.66:35482) 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.095+0000 7f3d3d06b640 1 -- 172.21.15.66:0/579669762 learned_addr learned my addr 172.21.15.66:0/579669762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3d06b640 1 -- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 msgr2=0x7f3d38154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3d06b640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d38154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3d06b640 1 -- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d380d1230 msgr2=0x7f3d381582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d380d1230 0x7f3d381582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3d06b640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d380d1230 0x7f3d381582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3d06b640 1 -- 172.21.15.66:0/579669762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d38154870 con 0x7f3d380b2900 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d380d1230 0x7f3d381582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3d06b640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 0x7f3d381f3860 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400efc0 tx=0x7f3d3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34018020 con 0x7f3d380b2900 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d34014480 con 0x7f3d380b2900 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d381f3f60 con 0x7f3d380b2900 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34014850 con 0x7f3d380b2900 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.096+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d381f4520 con 0x7f3d380b2900 2024-05-10T11:21:51.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.097+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d381f4760 con 0x7f3d380b2900 2024-05-10T11:21:51.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.098+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d34005d10 con 0x7f3d380b2900 2024-05-10T11:21:51.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.098+0000 7f3d2dffb640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d1c0762d0 0x7f3d1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.099+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f3d340981e0 con 0x7f3d380b2900 2024-05-10T11:21:51.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.099+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d1c0762d0 0x7f3d1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.099+0000 7f3d3c86a640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d1c0762d0 0x7f3d1c078790 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3d28034000 tx=0x7f3d2802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.103+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3d381f4760 con 0x7f3d380b2900 2024-05-10T11:21:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.332+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d380b8b90 con 0x7f3d380b2900 2024-05-10T11:21:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.332+0000 7f3d2dffb640 1 -- 172.21.15.66:0/579669762 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+4348 (secure 0 0 0) 0x7f3d380b8b90 con 0x7f3d380b2900 2024-05-10T11:21:51.331 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:51.332 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":90,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":90,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:50.671645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T11:21:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 90 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d1c0762d0 msgr2=0x7f3d1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d1c0762d0 0x7f3d1c078790 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3d28034000 tx=0x7f3d2802e000 comp rx=0 tx=0).stop 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 msgr2=0x7f3d381f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 0x7f3d381f3860 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400efc0 tx=0x7f3d3400c490 comp rx=0 tx=0).stop 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 shutdown_connections 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d1c0762d0 0x7f3d1c078790 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d381608b0 0x7f3d38154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d380d1230 0x7f3d381582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 --2- 172.21.15.66:0/579669762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d380b2900 0x7f3d381f3860 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 >> 172.21.15.66:0/579669762 conn(0x7f3d380d2df0 msgr2=0x7f3d3815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 shutdown_connections 2024-05-10T11:21:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.334+0000 7f3d3f2cf640 1 -- 172.21.15.66:0/579669762 wait complete. 2024-05-10T11:21:51.345 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:51.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.450+0000 7f89476da640 1 Processor -- start 2024-05-10T11:21:51.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.451+0000 7f89476da640 1 -- start start 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.451+0000 7f89476da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8940168220 0x7f894016a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.451+0000 7f89476da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89400b0a90 con 0x7f894015f4e0 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.451+0000 7f89476da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89400b3540 con 0x7f894015f8c0 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.451+0000 7f89476da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f89400b23f0 con 0x7f8940168220 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f8945c77640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8940168220 0x7f894016a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f8945476640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f894015f4e0 0x7f894006d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47754/0 (socket says 172.21.15.66:47754) 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f8945476640 1 -- 172.21.15.66:0/2009719244 learned_addr learned my addr 172.21.15.66:0/2009719244 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f8945c77640 1 -- 172.21.15.66:0/2009719244 >> v1:172.21.15.190:6789/0 conn(0x7f894015f8c0 legacy=0x7f894006e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:51.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f8945c77640 1 -- 172.21.15.66:0/2009719244 >> v1:172.21.15.66:6789/0 conn(0x7f894015f4e0 legacy=0x7f894006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f8945c77640 1 -- 172.21.15.66:0/2009719244 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89400b3820 con 0x7f8940168220 2024-05-10T11:21:51.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.452+0000 7f893ffff640 1 -- 172.21.15.66:0/2009719244 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379137017 0 0) 0x7f89400b0a90 con 0x7f894015f4e0 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f8945c77640 1 --2- 172.21.15.66:0/2009719244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894016a610 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f89380097a0 tx=0x7f893802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f235376942868c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f893ffff640 1 -- 172.21.15.66:0/2009719244 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938037070 con 0x7f8940168220 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f893ffff640 1 -- 172.21.15.66:0/2009719244 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893802ae50 con 0x7f8940168220 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f893ffff640 1 -- 172.21.15.66:0/2009719244 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938032660 con 0x7f8940168220 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 -- 172.21.15.66:0/2009719244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 msgr2=0x7f894016a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 --2- 172.21.15.66:0/2009719244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894016a610 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f89380097a0 tx=0x7f893802a140 comp rx=0 tx=0).stop 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 -- 172.21.15.66:0/2009719244 shutdown_connections 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 --2- 172.21.15.66:0/2009719244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894016a610 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 -- 172.21.15.66:0/2009719244 >> 172.21.15.66:0/2009719244 conn(0x7f89400d2df0 msgr2=0x7f89400d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:51.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 -- 172.21.15.66:0/2009719244 shutdown_connections 2024-05-10T11:21:51.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.453+0000 7f89476da640 1 -- 172.21.15.66:0/2009719244 wait complete. 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 Processor -- start 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 -- start start 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f894015f4e0 0x7f8940156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f894015f8c0 0x7f894015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f89400b3de0 con 0x7f8940168220 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f89400b4150 con 0x7f894015f8c0 2024-05-10T11:21:51.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f89476da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f894006e7f0 con 0x7f894015f4e0 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f8945c77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f8945c77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894015e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35514/0 (socket says 172.21.15.66:35514) 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.455+0000 7f8945c77640 1 -- 172.21.15.66:0/3473259809 learned_addr learned my addr 172.21.15.66:0/3473259809 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945476640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f894015f4e0 0x7f8940156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8944c75640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f894015f8c0 0x7f894015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945c77640 1 -- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f894015f4e0 msgr2=0x7f8940156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945c77640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f894015f4e0 0x7f8940156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945c77640 1 -- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f894015f8c0 msgr2=0x7f894015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945c77640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f894015f8c0 0x7f894015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945c77640 1 -- 172.21.15.66:0/3473259809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8940161ca0 con 0x7f8940168220 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8944c75640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f894015f8c0 0x7f894015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f8945c77640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894015e1a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f89380097a0 tx=0x7f89380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938042070 con 0x7f8940168220 2024-05-10T11:21:51.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938032e10 con 0x7f8940168220 2024-05-10T11:21:51.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8940161f80 con 0x7f8940168220 2024-05-10T11:21:51.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938037040 con 0x7f8940168220 2024-05-10T11:21:51.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.456+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8940162540 con 0x7f8940168220 2024-05-10T11:21:51.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.457+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894006a220 con 0x7f8940168220 2024-05-10T11:21:51.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.458+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8938045070 con 0x7f8940168220 2024-05-10T11:21:51.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.458+0000 7f893dffb640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f892c0762d0 0x7f892c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.459+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f89380b7e90 con 0x7f8940168220 2024-05-10T11:21:51.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.459+0000 7f8945476640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f892c0762d0 0x7f892c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.459+0000 7f8945476640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f892c0762d0 0x7f892c078790 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8930000f60 tx=0x7f8930007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.463+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f89380815a0 con 0x7f8940168220 2024-05-10T11:21:51.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.699+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89400d0d90 con 0x7f8940168220 2024-05-10T11:21:51.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.699+0000 7f893dffb640 1 -- 172.21.15.66:0/3473259809 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5173 (secure 0 0 0) 0x7f8938080ea0 con 0x7f8940168220 2024-05-10T11:21:51.699 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:51.699 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":91,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1427513472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1427513472},{"type":"v1","addr":"172.21.15.66:6835","nonce":1427513472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":90,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:50.671645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T11:21:51.699 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 91 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f892c0762d0 msgr2=0x7f892c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f892c0762d0 0x7f892c078790 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8930000f60 tx=0x7f8930007b50 comp rx=0 tx=0).stop 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 msgr2=0x7f894015e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894015e1a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f89380097a0 tx=0x7f89380046c0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 shutdown_connections 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f892c0762d0 0x7f892c078790 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8940168220 0x7f894015e1a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f894015f8c0 0x7f894015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 --2- 172.21.15.66:0/3473259809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f894015f4e0 0x7f8940156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 >> 172.21.15.66:0/3473259809 conn(0x7f89400d2df0 msgr2=0x7f89400d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:51.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 shutdown_connections 2024-05-10T11:21:51.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.701+0000 7f89476da640 1 -- 172.21.15.66:0/3473259809 wait complete. 2024-05-10T11:21:51.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:21:51.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.816+0000 7f3840f32640 1 Processor -- start 2024-05-10T11:21:51.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.816+0000 7f3840f32640 1 -- start start 2024-05-10T11:21:51.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.817+0000 7f3840f32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.817+0000 7f3840f32640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f383c0d0230 0x7f383c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.817+0000 7f3840f32640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f383c15fc90 con 0x7f383c0cfbb0 2024-05-10T11:21:51.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.817+0000 7f3840f32640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f383c06ee50 con 0x7f383c0d0230 2024-05-10T11:21:51.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.817+0000 7f3840f32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f383c0b8c40 con 0x7f383c0b8860 2024-05-10T11:21:51.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f383c0d0230 0x7f383c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f383a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f383c0d0230 0x7f383c0cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:48174/0 (socket says 172.21.15.66:48174) 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 -- 172.21.15.66:0/3151634677 learned_addr learned my addr 172.21.15.66:0/3151634677 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f383ad9d640 1 --1- 172.21.15.66:0/3151634677 >> v1:172.21.15.190:6789/0 conn(0x7f383c0cfbb0 0x7f383c0d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:50132/0 (socket says 172.21.15.66:50132) 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 -- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 msgr2=0x7f383c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 --2- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 -- 172.21.15.66:0/3151634677 >> v1:172.21.15.190:6789/0 conn(0x7f383c0cfbb0 legacy=0x7f383c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f3839d9b640 1 -- 172.21.15.66:0/3151634677 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c0cd570 con 0x7f383c0d0230 2024-05-10T11:21:51.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.818+0000 7f383a59c640 1 --2- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.819+0000 7f3839d9b640 1 --2- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0d0230 0x7f383c0cf670 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3824009870 tx=0x7f382402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592f7f3995d69533 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.819+0000 7f383959a640 1 -- 172.21.15.66:0/3151634677 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824037070 con 0x7f383c0d0230 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.819+0000 7f383959a640 1 -- 172.21.15.66:0/3151634677 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3824032440 con 0x7f383c0d0230 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.819+0000 7f383959a640 1 -- 172.21.15.66:0/3151634677 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824032810 con 0x7f383c0d0230 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.819+0000 7f3840f32640 1 -- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0d0230 msgr2=0x7f383c0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.819+0000 7f3840f32640 1 --2- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0d0230 0x7f383c0cf670 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3824009870 tx=0x7f382402a1c0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.820+0000 7f3840f32640 1 -- 172.21.15.66:0/3151634677 shutdown_connections 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.820+0000 7f3840f32640 1 --2- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0d0230 0x7f383c0cf670 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.820+0000 7f3840f32640 1 --2- 172.21.15.66:0/3151634677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.820+0000 7f3840f32640 1 -- 172.21.15.66:0/3151634677 >> 172.21.15.66:0/3151634677 conn(0x7f383c0d2df0 msgr2=0x7f383c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:51.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.820+0000 7f3840f32640 1 -- 172.21.15.66:0/3151634677 shutdown_connections 2024-05-10T11:21:51.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.820+0000 7f3840f32640 1 -- 172.21.15.66:0/3151634677 wait complete. 2024-05-10T11:21:51.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.821+0000 7f3840f32640 1 Processor -- start 2024-05-10T11:21:51.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.821+0000 7f3840f32640 1 -- start start 2024-05-10T11:21:51.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3840f32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3840f32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0cfbb0 0x7f383c0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3840f32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 0x7f383c0b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3840f32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f383c0cde10 con 0x7f383c0d0230 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3840f32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f383c0cdb30 con 0x7f383c0cfbb0 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3840f32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f383c06ea60 con 0x7f383c0b8860 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 0x7f383c0b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 0x7f383c0b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35522/0 (socket says 172.21.15.66:35522) 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 -- 172.21.15.66:0/1198817535 learned_addr learned my addr 172.21.15.66:0/1198817535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f3839d9b640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0cfbb0 0x7f383c0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383a59c640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 -- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 msgr2=0x7f383c154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 -- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0cfbb0 msgr2=0x7f383c0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0cfbb0 0x7f383c0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 -- 172.21.15.66:0/1198817535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c0cd190 con 0x7f383c0d0230 2024-05-10T11:21:51.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383a59c640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.822+0000 7f383ad9d640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 0x7f383c0b6770 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c430 tx=0x7f382c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.823+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c0074e0 con 0x7f383c0d0230 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.823+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c007680 con 0x7f383c0d0230 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.823+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c0049e0 con 0x7f383c0d0230 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.823+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383c0cafb0 con 0x7f383c0d0230 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.823+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383c0ca960 con 0x7f383c0d0230 2024-05-10T11:21:51.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.824+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383c06a220 con 0x7f383c0d0230 2024-05-10T11:21:51.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.824+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f382c01a020 con 0x7f383c0d0230 2024-05-10T11:21:51.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.825+0000 7f3832ffd640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f381c0762d0 0x7f381c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:51.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.825+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f382c096f20 con 0x7f383c0d0230 2024-05-10T11:21:51.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.825+0000 7f383a59c640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f381c0762d0 0x7f381c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:51.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.826+0000 7f383a59c640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f381c0762d0 0x7f381c078790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3834009fd0 tx=0x7f383400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:51.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:51.829+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f383c0cd190 con 0x7f383c0d0230 2024-05-10T11:21:52.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.024+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f383c0c80d0 con 0x7f383c0d0230 2024-05-10T11:21:52.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.025+0000 7f3832ffd640 1 -- 172.21.15.66:0/1198817535 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+17191 (secure 0 0 0) 0x7f382c0606c0 con 0x7f383c0d0230 2024-05-10T11:21:52.024 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:52.025 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":108,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:21:50.671476+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:20:28.883807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T11:20:29.828634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6834/3403431174":"2024-05-11T11:21:50.671451+0000","172.21.15.66:6835/3403431174":"2024-05-11T11:21:50.671451+0000","172.21.15.66:6835/159674733":"2024-05-11T11:21:14.208523+0000","172.21.15.66:6834/159674733":"2024-05-11T11:21:14.208523+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:21:52.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f381c0762d0 msgr2=0x7f381c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f381c0762d0 0x7f381c078790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3834009fd0 tx=0x7f383400b040 comp rx=0 tx=0).stop 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 msgr2=0x7f383c0b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 0x7f383c0b6770 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c430 tx=0x7f382c00c8f0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 shutdown_connections 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f381c0762d0 0x7f381c078790 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f383c0d0230 0x7f383c0b6770 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f383c0cfbb0 0x7f383c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 --2- 172.21.15.66:0/1198817535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f383c0b8860 0x7f383c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 >> 172.21.15.66:0/1198817535 conn(0x7f383c0d2df0 msgr2=0x7f383c070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 shutdown_connections 2024-05-10T11:21:52.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.027+0000 7f3840f32640 1 -- 172.21.15.66:0/1198817535 wait complete. 2024-05-10T11:21:52.038 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:21:52.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:52.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.142+0000 7f0b7c91c640 1 Processor -- start 2024-05-10T11:21:52.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.142+0000 7f0b7c91c640 1 -- start start 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.143+0000 7f0b7c91c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0b7815f3b0 0x7f0b780d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.143+0000 7f0b7c91c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f790 0x7f0b780d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.143+0000 7f0b7c91c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0b780d5d30 0x7f0b780c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.143+0000 7f0b7c91c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0b780d30b0 con 0x7f0b7815f3b0 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.143+0000 7f0b7c91c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0b780d3390 con 0x7f0b780d5d30 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.143+0000 7f0b7c91c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b780c8c80 con 0x7f0b7815f790 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0b7815f3b0 0x7f0b780d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0b7815f3b0 0x7f0b780d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35538/0 (socket says 172.21.15.66:35538) 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 -- 172.21.15.66:0/2356671477 learned_addr learned my addr 172.21.15.66:0/2356671477 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:52.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b76d9d640 1 --2- 172.21.15.66:0/2356671477 >> v2:172.21.15.190:3300/0 conn(0x7f0b780d5d30 0x7f0b780c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b75d9b640 1 --2- 172.21.15.66:0/2356671477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f790 0x7f0b780d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 -- 172.21.15.66:0/2356671477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f790 msgr2=0x7f0b780d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 --2- 172.21.15.66:0/2356671477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f790 0x7f0b780d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 -- 172.21.15.66:0/2356671477 >> v2:172.21.15.190:3300/0 conn(0x7f0b780d5d30 msgr2=0x7f0b780c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 --2- 172.21.15.66:0/2356671477 >> v2:172.21.15.190:3300/0 conn(0x7f0b780d5d30 0x7f0b780c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.144+0000 7f0b7659c640 1 -- 172.21.15.66:0/2356671477 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b780c8f60 con 0x7f0b7815f3b0 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7659c640 1 --2- 172.21.15.66:0/2356671477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b7815f3b0 0x7f0b780d36f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0b780d36a0 tx=0x7f0b7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437ea48ad0cfbb5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7559a640 1 -- 172.21.15.66:0/2356671477 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70036070 con 0x7f0b7815f3b0 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7559a640 1 -- 172.21.15.66:0/2356671477 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b70031600 con 0x7f0b7815f3b0 2024-05-10T11:21:52.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7559a640 1 -- 172.21.15.66:0/2356671477 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b700319d0 con 0x7f0b7815f3b0 2024-05-10T11:21:52.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 -- 172.21.15.66:0/2356671477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b7815f3b0 msgr2=0x7f0b780d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/2356671477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b7815f3b0 0x7f0b780d36f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0b780d36a0 tx=0x7f0b7002a6a0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 -- 172.21.15.66:0/2356671477 shutdown_connections 2024-05-10T11:21:52.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/2356671477 >> v2:172.21.15.190:3300/0 conn(0x7f0b780d5d30 0x7f0b780c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/2356671477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f790 0x7f0b780d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/2356671477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b7815f3b0 0x7f0b780d36f0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.145+0000 7f0b7c91c640 1 -- 172.21.15.66:0/2356671477 >> 172.21.15.66:0/2356671477 conn(0x7f0b780d5130 msgr2=0x7f0b780d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.146+0000 7f0b7c91c640 1 -- 172.21.15.66:0/2356671477 shutdown_connections 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.146+0000 7f0b7c91c640 1 -- 172.21.15.66:0/2356671477 wait complete. 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.147+0000 7f0b7c91c640 1 Processor -- start 2024-05-10T11:21:52.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.147+0000 7f0b7c91c640 1 -- start start 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b780d5d30 0x7f0b7814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f3b0 0x7f0b781579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 0x7f0b780ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0b780c9e20 con 0x7f0b78157f10 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0b780c9ca0 con 0x7f0b780d5d30 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b780c9fa0 con 0x7f0b7815f3b0 2024-05-10T11:21:52.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 0x7f0b780ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 0x7f0b780ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35554/0 (socket says 172.21.15.66:35554) 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 -- 172.21.15.66:0/3048597576 learned_addr learned my addr 172.21.15.66:0/3048597576 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7659c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b780d5d30 0x7f0b7814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b75d9b640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f3b0 0x7f0b781579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 -- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f3b0 msgr2=0x7f0b781579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f3b0 0x7f0b781579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 -- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b780d5d30 msgr2=0x7f0b7814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b780d5d30 0x7f0b7814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 -- 172.21.15.66:0/3048597576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b780cc930 con 0x7f0b78157f10 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b76d9d640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 0x7f0b780ce500 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e800 tx=0x7f0b6800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68017070 con 0x7f0b78157f10 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6800c940 con 0x7f0b78157f10 2024-05-10T11:21:52.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b780ccc10 con 0x7f0b78157f10 2024-05-10T11:21:52.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.148+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800cd30 con 0x7f0b78157f10 2024-05-10T11:21:52.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.149+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b78160bd0 con 0x7f0b78157f10 2024-05-10T11:21:52.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.149+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7806a220 con 0x7f0b78157f10 2024-05-10T11:21:52.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.150+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b6801a070 con 0x7f0b78157f10 2024-05-10T11:21:52.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.151+0000 7f0b6effd640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0b58076300 0x7f0b580787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.151+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f0b68097a80 con 0x7f0b78157f10 2024-05-10T11:21:52.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.151+0000 7f0b7659c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0b58076300 0x7f0b580787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.151+0000 7f0b7659c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0b58076300 0x7f0b580787c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0b70033000 tx=0x7f0b70009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.155+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0b68061220 con 0x7f0b78157f10 2024-05-10T11:21:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.387+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b7806e4e0 con 0x7f0b78157f10 2024-05-10T11:21:52.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.387+0000 7f0b6effd640 1 -- 172.21.15.66:0/3048597576 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5173 (secure 0 0 0) 0x7f0b68060b20 con 0x7f0b78157f10 2024-05-10T11:21:52.386 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:52.387 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":91,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1427513472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1427513472},{"type":"v1","addr":"172.21.15.66:6835","nonce":1427513472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":90,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:50.671645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T11:21:52.387 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 91 2024-05-10T11:21:52.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0b58076300 msgr2=0x7f0b580787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0b58076300 0x7f0b580787c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0b70033000 tx=0x7f0b70009000 comp rx=0 tx=0).stop 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 msgr2=0x7f0b780ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 0x7f0b780ce500 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e800 tx=0x7f0b6800ecc0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 shutdown_connections 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0b58076300 0x7f0b580787c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b78157f10 0x7f0b780ce500 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b7815f3b0 0x7f0b781579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 --2- 172.21.15.66:0/3048597576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b780d5d30 0x7f0b7814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 >> 172.21.15.66:0/3048597576 conn(0x7f0b780d5130 msgr2=0x7f0b7806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 shutdown_connections 2024-05-10T11:21:52.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.389+0000 7f0b7c91c640 1 -- 172.21.15.66:0/3048597576 wait complete. 2024-05-10T11:21:52.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:21:52.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.504+0000 7f2f05037640 1 Processor -- start 2024-05-10T11:21:52.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.504+0000 7f2f05037640 1 -- start start 2024-05-10T11:21:52.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.504+0000 7f2f05037640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f0015f790 0x7f2f000cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.504+0000 7f2f05037640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f000d30b0 con 0x7f2f0015f3b0 2024-05-10T11:21:52.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.504+0000 7f2f05037640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f000d3390 con 0x7f2f000d5d30 2024-05-10T11:21:52.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.504+0000 7f2f05037640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2f000c8c80 con 0x7f2f0015f790 2024-05-10T11:21:52.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2ef7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f0015f790 0x7f2f000cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2efed9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2f0015f3b0 0x7f2f000d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47756/0 (socket says 172.21.15.66:47756) 2024-05-10T11:21:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2ef7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f0015f790 0x7f2f000cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35564/0 (socket says 172.21.15.66:35564) 2024-05-10T11:21:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2efed9d640 1 -- 172.21.15.66:0/288155922 learned_addr learned my addr 172.21.15.66:0/288155922 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2ef7fff640 1 -- 172.21.15.66:0/288155922 >> v1:172.21.15.190:6789/0 conn(0x7f2f000d5d30 legacy=0x7f2f000d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2ef7fff640 1 -- 172.21.15.66:0/288155922 >> v1:172.21.15.66:6789/0 conn(0x7f2f0015f3b0 legacy=0x7f2f000d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2ef7fff640 1 -- 172.21.15.66:0/288155922 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f000c8f60 con 0x7f2f0015f790 2024-05-10T11:21:52.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.505+0000 7f2efe59c640 1 -- 172.21.15.66:0/288155922 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262739614 0 0) 0x7f2f000d30b0 con 0x7f2f0015f3b0 2024-05-10T11:21:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2ef7fff640 1 --2- 172.21.15.66:0/288155922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f0015f790 0x7f2f000cfcd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80097a0 tx=0x7f2ee802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5d857fc45b81e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2efe59c640 1 -- 172.21.15.66:0/288155922 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8037070 con 0x7f2f0015f790 2024-05-10T11:21:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2efe59c640 1 -- 172.21.15.66:0/288155922 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8032440 con 0x7f2f0015f790 2024-05-10T11:21:52.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2efe59c640 1 -- 172.21.15.66:0/288155922 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8032810 con 0x7f2f0015f790 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 -- 172.21.15.66:0/288155922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f0015f790 msgr2=0x7f2f000cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 --2- 172.21.15.66:0/288155922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f0015f790 0x7f2f000cfcd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80097a0 tx=0x7f2ee802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 -- 172.21.15.66:0/288155922 shutdown_connections 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 --2- 172.21.15.66:0/288155922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f0015f790 0x7f2f000cfcd0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 -- 172.21.15.66:0/288155922 >> 172.21.15.66:0/288155922 conn(0x7f2f000d5130 msgr2=0x7f2f000d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 -- 172.21.15.66:0/288155922 shutdown_connections 2024-05-10T11:21:52.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.506+0000 7f2f05037640 1 -- 172.21.15.66:0/288155922 wait complete. 2024-05-10T11:21:52.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.508+0000 7f2f05037640 1 Processor -- start 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.508+0000 7f2f05037640 1 -- start start 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 0x7f2f00158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f0015f3b0 0x7f2f00162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f000cdc60 0x7f2f0015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000d3f80 con 0x7f2f000d5d30 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000d3e00 con 0x7f2f000cdc60 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000ca770 con 0x7f2f0015f3b0 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 0x7f2f00158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 0x7f2f00158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35570/0 (socket says 172.21.15.66:35570) 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 -- 172.21.15.66:0/1565866999 learned_addr learned my addr 172.21.15.66:0/1565866999 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2ef7fff640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f0015f3b0 0x7f2f00162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2eff59e640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f000cdc60 0x7f2f0015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 -- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f0015f3b0 msgr2=0x7f2f00162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f0015f3b0 0x7f2f00162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 -- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f000cdc60 msgr2=0x7f2f0015a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f000cdc60 0x7f2f0015a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 -- 172.21.15.66:0/1565866999 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f000ce1b0 con 0x7f2f000d5d30 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2ef7fff640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f0015f3b0 0x7f2f00162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2eff59e640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f000cdc60 0x7f2f0015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2efed9d640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 0x7f2f00158c50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000c500 tx=0x7f2ef000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0018070 con 0x7f2f000d5d30 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef0007580 con 0x7f2f000d5d30 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f000ce490 con 0x7f2f000d5d30 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.509+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0004a20 con 0x7f2f000d5d30 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.510+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f000cea50 con 0x7f2f000d5d30 2024-05-10T11:21:52.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.510+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0006a220 con 0x7f2f000d5d30 2024-05-10T11:21:52.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.511+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ef001b070 con 0x7f2f000d5d30 2024-05-10T11:21:52.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.512+0000 7f2ef77fe640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2ee00762d0 0x7f2ee0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.512+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f2ef0096b30 con 0x7f2f000d5d30 2024-05-10T11:21:52.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.512+0000 7f2ef7fff640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2ee00762d0 0x7f2ee0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.512+0000 7f2ef7fff640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2ee00762d0 0x7f2ee0078790 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8034000 tx=0x7f2ee802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.516+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2ef00602d0 con 0x7f2f000d5d30 2024-05-10T11:21:52.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.746+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f000cb820 con 0x7f2f000d5d30 2024-05-10T11:21:52.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.746+0000 7f2ef77fe640 1 -- 172.21.15.66:0/1565866999 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5173 (secure 0 0 0) 0x7f2ef00682c0 con 0x7f2f000d5d30 2024-05-10T11:21:52.746 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:52.746 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":91,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1427513472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1427513472},{"type":"v1","addr":"172.21.15.66:6835","nonce":1427513472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":90,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:20:30.866393+0000","modified":"2024-05-10T11:21:50.671645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T11:21:52.746 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 91 2024-05-10T11:21:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2ee00762d0 msgr2=0x7f2ee0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2ee00762d0 0x7f2ee0078790 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8034000 tx=0x7f2ee802e000 comp rx=0 tx=0).stop 2024-05-10T11:21:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 msgr2=0x7f2f00158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 0x7f2f00158c50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000c500 tx=0x7f2ef000c9c0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 shutdown_connections 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2ee00762d0 0x7f2ee0078790 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f000cdc60 0x7f2f0015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f0015f3b0 0x7f2f00162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 --2- 172.21.15.66:0/1565866999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f000d5d30 0x7f2f00158c50 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 >> 172.21.15.66:0/1565866999 conn(0x7f2f000d5130 msgr2=0x7f2f000d36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 shutdown_connections 2024-05-10T11:21:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.748+0000 7f2f05037640 1 -- 172.21.15.66:0/1565866999 wait complete. 2024-05-10T11:21:52.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:21:52.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.863+0000 7f048b366640 1 Processor -- start 2024-05-10T11:21:52.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.864+0000 7f048b366640 1 -- start start 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.864+0000 7f048b366640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f04841598c0 0x7f048406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.864+0000 7f048b366640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840c7390 0x7f04840cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.864+0000 7f048b366640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048406f1c0 con 0x7f048406ec40 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.864+0000 7f048b366640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f048406f4a0 con 0x7f04841598c0 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.864+0000 7f048b366640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f048406f780 con 0x7f04840c7390 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489102640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f04841598c0 0x7f048406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0488901640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f048406ec40 0x7f04840c6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47760/0 (socket says 172.21.15.66:47760) 2024-05-10T11:21:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489102640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f04841598c0 0x7f048406e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35576/0 (socket says 172.21.15.66:35576) 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0488901640 1 -- 172.21.15.66:0/972180751 learned_addr learned my addr 172.21.15.66:0/972180751 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489903640 1 --2- 172.21.15.66:0/972180751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840c7390 0x7f04840cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489102640 1 -- 172.21.15.66:0/972180751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840c7390 msgr2=0x7f04840cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489102640 1 --2- 172.21.15.66:0/972180751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840c7390 0x7f04840cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489102640 1 -- 172.21.15.66:0/972180751 >> v1:172.21.15.66:6789/0 conn(0x7f048406ec40 legacy=0x7f04840c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f0489102640 1 -- 172.21.15.66:0/972180751 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048406fa60 con 0x7f04841598c0 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.865+0000 7f047bfff640 1 -- 172.21.15.66:0/972180751 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910072822 0 0) 0x7f048406f1c0 con 0x7f048406ec40 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f0489102640 1 --2- 172.21.15.66:0/972180751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04841598c0 0x7f048406e700 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f04800097a0 tx=0x7f048002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cde8152b4814772 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f047bfff640 1 -- 172.21.15.66:0/972180751 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480037070 con 0x7f04841598c0 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f047bfff640 1 -- 172.21.15.66:0/972180751 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0480032440 con 0x7f04841598c0 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f047bfff640 1 -- 172.21.15.66:0/972180751 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480032810 con 0x7f04841598c0 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f048b366640 1 -- 172.21.15.66:0/972180751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04841598c0 msgr2=0x7f048406e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f048b366640 1 --2- 172.21.15.66:0/972180751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04841598c0 0x7f048406e700 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f04800097a0 tx=0x7f048002a180 comp rx=0 tx=0).stop 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f048b366640 1 -- 172.21.15.66:0/972180751 shutdown_connections 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f048b366640 1 --2- 172.21.15.66:0/972180751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840c7390 0x7f04840cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f048b366640 1 --2- 172.21.15.66:0/972180751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04841598c0 0x7f048406e700 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.866+0000 7f048b366640 1 -- 172.21.15.66:0/972180751 >> 172.21.15.66:0/972180751 conn(0x7f04840b2900 msgr2=0x7f04840b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.867+0000 7f048b366640 1 -- 172.21.15.66:0/972180751 shutdown_connections 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.867+0000 7f048b366640 1 -- 172.21.15.66:0/972180751 wait complete. 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 Processor -- start 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 -- start start 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048406ec40 0x7f04840cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 0x7f04841563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04841598c0 0x7f04840aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0484159ca0 con 0x7f04840c7390 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f048415c6e0 con 0x7f048406ec40 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f048b366640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0484159e20 con 0x7f04841598c0 2024-05-10T11:21:52.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.868+0000 7f0488901640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 0x7f04841563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 0x7f04841563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35580/0 (socket says 172.21.15.66:35580) 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 -- 172.21.15.66:0/2319182983 learned_addr learned my addr 172.21.15.66:0/2319182983 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 -- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04841598c0 msgr2=0x7f04840aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04841598c0 0x7f04840aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 -- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048406ec40 msgr2=0x7f04840cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048406ec40 0x7f04840cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 -- 172.21.15.66:0/2319182983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04840cc360 con 0x7f04840c7390 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0488901640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 0x7f04841563d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f047400c4d0 tx=0x7f047400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474018070 con 0x7f04840c7390 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0474007500 con 0x7f04840c7390 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04840cc640 con 0x7f04840c7390 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474004a20 con 0x7f04840c7390 2024-05-10T11:21:52.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.869+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04840ccc00 con 0x7f04840c7390 2024-05-10T11:21:52.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.870+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048406a220 con 0x7f04840c7390 2024-05-10T11:21:52.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.871+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f047401b070 con 0x7f04840c7390 2024-05-10T11:21:52.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.871+0000 7f0479ffb640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f04680762d0 0x7f0468078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:52.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.871+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f0474096b10 con 0x7f04840c7390 2024-05-10T11:21:52.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.872+0000 7f0489102640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f04680762d0 0x7f0468078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:52.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.872+0000 7f0489102640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f04680762d0 0x7f0468078790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0480034000 tx=0x7f048002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:52.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:52.876+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f04740602b0 con 0x7f04840c7390 2024-05-10T11:21:53.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.069+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f048406e4e0 con 0x7f04840c7390 2024-05-10T11:21:53.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.070+0000 7f0479ffb640 1 -- 172.21.15.66:0/2319182983 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+17191 (secure 0 0 0) 0x7f047405fbb0 con 0x7f04840c7390 2024-05-10T11:21:53.070 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:53.070 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":108,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:21:50.671476+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:20:28.883807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T11:20:29.828634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6834/3403431174":"2024-05-11T11:21:50.671451+0000","172.21.15.66:6835/3403431174":"2024-05-11T11:21:50.671451+0000","172.21.15.66:6835/159674733":"2024-05-11T11:21:14.208523+0000","172.21.15.66:6834/159674733":"2024-05-11T11:21:14.208523+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f04680762d0 msgr2=0x7f0468078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f04680762d0 0x7f0468078790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0480034000 tx=0x7f048002c000 comp rx=0 tx=0).stop 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 msgr2=0x7f04841563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 0x7f04841563d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f047400c4d0 tx=0x7f047400c990 comp rx=0 tx=0).stop 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 shutdown_connections 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f04680762d0 0x7f0468078790 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04841598c0 0x7f04840aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04840c7390 0x7f04841563d0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 --2- 172.21.15.66:0/2319182983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048406ec40 0x7f04840cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.072+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 >> 172.21.15.66:0/2319182983 conn(0x7f04840b2900 msgr2=0x7f04840c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:53.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.073+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 shutdown_connections 2024-05-10T11:21:53.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.073+0000 7f048b366640 1 -- 172.21.15.66:0/2319182983 wait complete. 2024-05-10T11:21:53.083 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:21:53.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.189+0000 7f78d12bb640 1 Processor -- start 2024-05-10T11:21:53.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.189+0000 7f78d12bb640 1 -- start start 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78d12bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f78cc162940 0x7f78cc0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78d12bb640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78cc0d2d20 con 0x7f78cc0d59d0 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78d12bb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78cc0d3000 con 0x7f78cc0d3d80 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78d12bb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f78cc162d20 con 0x7f78cc162940 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78ca7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f78cc0d59d0 0x7f78cc0d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47764/0 (socket says 172.21.15.66:47764) 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78ca7fc640 1 -- 172.21.15.66:0/1349878889 learned_addr learned my addr 172.21.15.66:0/1349878889 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78caffd640 1 --2- 172.21.15.66:0/1349878889 >> v2:172.21.15.190:3300/0 conn(0x7f78cc162940 0x7f78cc0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78c9ffb640 1 -- 172.21.15.66:0/1349878889 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888928473 0 0) 0x7f78cc0d2d20 con 0x7f78cc0d59d0 2024-05-10T11:21:53.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.190+0000 7f78c9ffb640 1 -- 172.21.15.66:0/1349878889 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b8003520 con 0x7f78cc0d59d0 2024-05-10T11:21:53.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.191+0000 7f78c9ffb640 1 -- 172.21.15.66:0/1349878889 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 536018938 0 0) 0x7f78b8003520 con 0x7f78cc0d59d0 2024-05-10T11:21:53.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.191+0000 7f78caffd640 1 -- 172.21.15.66:0/1349878889 >> v1:172.21.15.190:6789/0 conn(0x7f78cc0d3d80 legacy=0x7f78cc0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.191+0000 7f78caffd640 1 -- 172.21.15.66:0/1349878889 >> v1:172.21.15.66:6789/0 conn(0x7f78cc0d59d0 legacy=0x7f78cc0d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.191+0000 7f78caffd640 1 -- 172.21.15.66:0/1349878889 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc0d32e0 con 0x7f78cc162940 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.191+0000 7f78caffd640 1 --2- 172.21.15.66:0/1349878889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc162940 0x7f78cc0b5e20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f78c40097a0 tx=0x7f78c402a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5f757a4cb979eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78c9ffb640 1 -- 172.21.15.66:0/1349878889 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4037070 con 0x7f78cc162940 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78c9ffb640 1 -- 172.21.15.66:0/1349878889 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c402aad0 con 0x7f78cc162940 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78c9ffb640 1 -- 172.21.15.66:0/1349878889 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4001670 con 0x7f78cc162940 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 -- 172.21.15.66:0/1349878889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc162940 msgr2=0x7f78cc0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1349878889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc162940 0x7f78cc0b5e20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f78c40097a0 tx=0x7f78c402a040 comp rx=0 tx=0).stop 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 -- 172.21.15.66:0/1349878889 shutdown_connections 2024-05-10T11:21:53.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1349878889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc162940 0x7f78cc0b5e20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 -- 172.21.15.66:0/1349878889 >> 172.21.15.66:0/1349878889 conn(0x7f78cc09e380 msgr2=0x7f78cc0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:53.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 -- 172.21.15.66:0/1349878889 shutdown_connections 2024-05-10T11:21:53.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.192+0000 7f78d12bb640 1 -- 172.21.15.66:0/1349878889 wait complete. 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.193+0000 7f78d12bb640 1 Processor -- start 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 -- start start 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc0d3d80 0x7f78cc0ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 0x7f78cc0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78cc162940 0x7f78cc1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc0d2390 con 0x7f78cc0d59d0 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc0cfc50 con 0x7f78cc0d3d80 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78d12bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f78cc0d2510 con 0x7f78cc162940 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78ca7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 0x7f78cc0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78ca7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 0x7f78cc0b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35594/0 (socket says 172.21.15.66:35594) 2024-05-10T11:21:53.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.194+0000 7f78ca7fc640 1 -- 172.21.15.66:0/1246190189 learned_addr learned my addr 172.21.15.66:0/1246190189 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78cb7fe640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78cc162940 0x7f78cc1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78caffd640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc0d3d80 0x7f78cc0ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78ca7fc640 1 -- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78cc162940 msgr2=0x7f78cc1585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78ca7fc640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78cc162940 0x7f78cc1585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78ca7fc640 1 -- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc0d3d80 msgr2=0x7f78cc0ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78ca7fc640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc0d3d80 0x7f78cc0ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78ca7fc640 1 -- 172.21.15.66:0/1246190189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc0b91d0 con 0x7f78cc0d59d0 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78caffd640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc0d3d80 0x7f78cc0ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78cb7fe640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78cc162940 0x7f78cc1585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78ca7fc640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 0x7f78cc0b3080 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c780 tx=0x7f78b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4018070 con 0x7f78cc0d59d0 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b40072d0 con 0x7f78cc0d59d0 2024-05-10T11:21:53.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc0b94d0 con 0x7f78cc0d59d0 2024-05-10T11:21:53.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b40047e0 con 0x7f78cc0d59d0 2024-05-10T11:21:53.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.195+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc0b9d10 con 0x7f78cc0d59d0 2024-05-10T11:21:53.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.196+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78cc075f00 con 0x7f78cc0d59d0 2024-05-10T11:21:53.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.197+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f78b401b070 con 0x7f78cc0d59d0 2024-05-10T11:21:53.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.197+0000 7f78c37fe640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78ac0762d0 0x7f78ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:53.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.197+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f78b4096c80 con 0x7f78cc0d59d0 2024-05-10T11:21:53.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.198+0000 7f78caffd640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78ac0762d0 0x7f78ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:53.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.198+0000 7f78caffd640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78ac0762d0 0x7f78ac078790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f78c4034000 tx=0x7f78c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:53.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.202+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f78cc075f00 con 0x7f78cc0d59d0 2024-05-10T11:21:53.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:53.436+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f78cc06a220 con 0x7f78cc0d59d0 2024-05-10T11:21:54.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.300+0000 7f78c37fe640 1 -- 172.21.15.66:0/1246190189 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) ==== 161+0+0 (secure 0 0 0) 0x7f78cc0b94d0 con 0x7f78cc0d59d0 2024-05-10T11:21:54.300 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:21:54.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78ac0762d0 msgr2=0x7f78ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78ac0762d0 0x7f78ac078790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f78c4034000 tx=0x7f78c402e000 comp rx=0 tx=0).stop 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 msgr2=0x7f78cc0b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 0x7f78cc0b3080 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c780 tx=0x7f78b400cc40 comp rx=0 tx=0).stop 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 shutdown_connections 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f78ac0762d0 0x7f78ac078790 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78cc162940 0x7f78cc1585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78cc0d59d0 0x7f78cc0b3080 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 --2- 172.21.15.66:0/1246190189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78cc0d3d80 0x7f78cc0ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 >> 172.21.15.66:0/1246190189 conn(0x7f78cc09e380 msgr2=0x7f78cc0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 shutdown_connections 2024-05-10T11:21:54.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.303+0000 7f78d12bb640 1 -- 172.21.15.66:0/1246190189 wait complete. 2024-05-10T11:21:54.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:21:54.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.430+0000 7f8b49ed1640 1 Processor -- start 2024-05-10T11:21:54.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.430+0000 7f8b49ed1640 1 -- start start 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b49ed1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8b44162900 0x7f8b440d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b49ed1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b440d3950 0x7f8b440d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b49ed1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b440d4190 con 0x7f8b44162ce0 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b49ed1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8b440cfc40 con 0x7f8b440d3950 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b49ed1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8b440d3eb0 con 0x7f8b44162900 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b43fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b440d3950 0x7f8b440d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b3bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f8b44162ce0 0x7f8b440b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:47780/0 (socket says 172.21.15.66:47780) 2024-05-10T11:21:54.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b3bfff640 1 -- 172.21.15.66:0/3320908200 learned_addr learned my addr 172.21.15.66:0/3320908200 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b43fff640 1 -- 172.21.15.66:0/3320908200 >> v2:172.21.15.190:3300/0 conn(0x7f8b44162900 msgr2=0x7f8b440d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b437fe640 1 --2- 172.21.15.66:0/3320908200 >> v2:172.21.15.190:3300/0 conn(0x7f8b44162900 0x7f8b440d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b42ffd640 1 -- 172.21.15.66:0/3320908200 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208541214 0 0) 0x7f8b2c001110 con 0x7f8b44162ce0 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b43fff640 1 --2- 172.21.15.66:0/3320908200 >> v2:172.21.15.190:3300/0 conn(0x7f8b44162900 0x7f8b440d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b43fff640 1 -- 172.21.15.66:0/3320908200 >> v1:172.21.15.66:6789/0 conn(0x7f8b44162ce0 legacy=0x7f8b440b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b43fff640 1 -- 172.21.15.66:0/3320908200 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b440cfee0 con 0x7f8b440d3950 2024-05-10T11:21:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.431+0000 7f8b437fe640 1 --2- 172.21.15.66:0/3320908200 >> v2:172.21.15.190:3300/0 conn(0x7f8b44162900 0x7f8b440d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:54.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.432+0000 7f8b43fff640 1 --2- 172.21.15.66:0/3320908200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b440d09c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f8b4406c520 tx=0x7f8b3c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a808c57b8f9a01c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:54.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.432+0000 7f8b42ffd640 1 -- 172.21.15.66:0/3320908200 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c007740 con 0x7f8b440d3950 2024-05-10T11:21:54.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.432+0000 7f8b42ffd640 1 -- 172.21.15.66:0/3320908200 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0078e0 con 0x7f8b440d3950 2024-05-10T11:21:54.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.432+0000 7f8b42ffd640 1 -- 172.21.15.66:0/3320908200 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c007cb0 con 0x7f8b440d3950 2024-05-10T11:21:54.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 -- 172.21.15.66:0/3320908200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 msgr2=0x7f8b440d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:54.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/3320908200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b440d09c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f8b4406c520 tx=0x7f8b3c02a5f0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 -- 172.21.15.66:0/3320908200 shutdown_connections 2024-05-10T11:21:54.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/3320908200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b440d09c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/3320908200 >> v2:172.21.15.190:3300/0 conn(0x7f8b44162900 0x7f8b440d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 -- 172.21.15.66:0/3320908200 >> 172.21.15.66:0/3320908200 conn(0x7f8b4409e430 msgr2=0x7f8b440d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:54.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 -- 172.21.15.66:0/3320908200 shutdown_connections 2024-05-10T11:21:54.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.433+0000 7f8b49ed1640 1 -- 172.21.15.66:0/3320908200 wait complete. 2024-05-10T11:21:54.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.434+0000 7f8b49ed1640 1 Processor -- start 2024-05-10T11:21:54.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.434+0000 7f8b49ed1640 1 -- start start 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b49ed1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b4414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b49ed1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b44162900 0x7f8b4415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b49ed1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b44162ce0 0x7f8b4415e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b49ed1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b440b4300 con 0x7f8b440d3950 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b49ed1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8b440b4180 con 0x7f8b44162900 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b49ed1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8b440b4ff0 con 0x7f8b44162ce0 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b4414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b4414f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35614/0 (socket says 172.21.15.66:35614) 2024-05-10T11:21:54.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 -- 172.21.15.66:0/4096316285 learned_addr learned my addr 172.21.15.66:0/4096316285 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b3bfff640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b44162900 0x7f8b4415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b43fff640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b44162ce0 0x7f8b4415e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 -- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b44162ce0 msgr2=0x7f8b4415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b44162ce0 0x7f8b4415e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 -- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b44162900 msgr2=0x7f8b4415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b44162900 0x7f8b4415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.435+0000 7f8b437fe640 1 -- 172.21.15.66:0/4096316285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4415f2e0 con 0x7f8b440d3950 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.436+0000 7f8b437fe640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b4414f4b0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c820 tx=0x7f8b3400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.436+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34015070 con 0x7f8b440d3950 2024-05-10T11:21:54.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.436+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b34007a30 con 0x7f8b440d3950 2024-05-10T11:21:54.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.436+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b440ccc60 con 0x7f8b440d3950 2024-05-10T11:21:54.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.436+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34007e00 con 0x7f8b440d3950 2024-05-10T11:21:54.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.436+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b440c8fe0 con 0x7f8b440d3950 2024-05-10T11:21:54.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.437+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4406a220 con 0x7f8b440d3950 2024-05-10T11:21:54.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.437+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b34018070 con 0x7f8b440d3950 2024-05-10T11:21:54.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.438+0000 7f8b40ff9640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b240762d0 0x7f8b24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:54.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.438+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7f8b340977a0 con 0x7f8b440d3950 2024-05-10T11:21:54.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.438+0000 7f8b3bfff640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b240762d0 0x7f8b24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:54.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.439+0000 7f8b3bfff640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b240762d0 0x7f8b24078790 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ccb90 tx=0x7f8b2c007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:54.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.442+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8b340607d0 con 0x7f8b440d3950 2024-05-10T11:21:54.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:54.675+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8b440b62b0 con 0x7f8b440d3950 2024-05-10T11:21:55.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.302+0000 7f8b40ff9640 1 -- 172.21.15.66:0/4096316285 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) ==== 104+0+0 (secure 0 0 0) 0x7f8b34064ad0 con 0x7f8b440d3950 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b240762d0 msgr2=0x7f8b24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b240762d0 0x7f8b24078790 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ccb90 tx=0x7f8b2c007b50 comp rx=0 tx=0).stop 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 msgr2=0x7f8b4414f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b4414f4b0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c820 tx=0x7f8b3400cc20 comp rx=0 tx=0).stop 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 shutdown_connections 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8b240762d0 0x7f8b24078790 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b44162ce0 0x7f8b4415e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b44162900 0x7f8b4415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 --2- 172.21.15.66:0/4096316285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b440d3950 0x7f8b4414f4b0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.304+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 >> 172.21.15.66:0/4096316285 conn(0x7f8b4409e430 msgr2=0x7f8b4406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.305+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 shutdown_connections 2024-05-10T11:21:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.305+0000 7f8b49ed1640 1 -- 172.21.15.66:0/4096316285 wait complete. 2024-05-10T11:21:55.317 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:21:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.429+0000 7fc2f0ac8640 1 Processor -- start 2024-05-10T11:21:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.429+0000 7fc2f0ac8640 1 -- start start 2024-05-10T11:21:55.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.430+0000 7fc2f0ac8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2ec0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.430+0000 7fc2f0ac8640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2ec0d1080 con 0x7fc2ec0d3d50 2024-05-10T11:21:55.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.430+0000 7fc2f0ac8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2ec0b4820 con 0x7fc2ec15f490 2024-05-10T11:21:55.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.430+0000 7fc2f0ac8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec0b4e70 con 0x7fc2ec0d5ca0 2024-05-10T11:21:55.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.430+0000 7fc2e9d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc2ec0d3d50 0x7fc2ec0b5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40160/0 (socket says 172.21.15.66:40160) 2024-05-10T11:21:55.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.430+0000 7fc2e9d9b640 1 -- 172.21.15.66:0/417032517 learned_addr learned my addr 172.21.15.66:0/417032517 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2ec0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069629834 0 0) 0x7fc2ec0d1080 con 0x7fc2ec0d3d50 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2d8003520 con 0x7fc2ec0d3d50 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769654608 0 0) 0x7fc2ec0b4820 con 0x7fc2ec15f490 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2ec0d1080 con 0x7fc2ec15f490 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 380730750 0 0) 0x7fc2d8003520 con 0x7fc2ec0d3d50 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 msgr2=0x7fc2ec0d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2ec0d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 >> v1:172.21.15.190:6789/0 conn(0x7fc2ec15f490 legacy=0x7fc2ec0d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec0b4b00 con 0x7fc2ec0d3d50 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fc2d4001670 con 0x7fc2ec0d3d50 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 >> v1:172.21.15.66:6789/0 conn(0x7fc2ec0d3d50 legacy=0x7fc2ec0b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2d8003b70 0x7fc2d8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d8004d40 0x7fc2d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec0b4e70 con 0x7fc2d8004d40 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d800bb50 con 0x7fc2d8003b70 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d800bd20 con 0x7fc2ec0d5ca0 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d8004d40 0x7fc2d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ea59c640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2d8003b70 0x7fc2d8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e9d9b640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 -- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 msgr2=0x7fc2d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 -- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2d8003b70 msgr2=0x7fc2d8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2d8003b70 0x7fc2d8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ead9d640 1 -- 172.21.15.66:0/417032517 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8003520 con 0x7fc2d8004d40 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2e9d9b640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2ec0d5ca0 0x7fc2d8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.431+0000 7fc2ea59c640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2d8003b70 0x7fc2d8003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.432+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d8004d40 0x7fc2d80051c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009ac0 tx=0x7fc2d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1dbd7678902c16 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.432+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4036070 con 0x7fc2d8004d40 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.432+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e4031400 con 0x7fc2d8004d40 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.432+0000 7fc2e959a640 1 -- 172.21.15.66:0/417032517 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4009690 con 0x7fc2d8004d40 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/417032517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d8004d40 msgr2=0x7fc2d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/417032517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d8004d40 0x7fc2d80051c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009ac0 tx=0x7fc2d8005830 comp rx=0 tx=0).stop 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2ead9d640 1 -- 172.21.15.66:0/417032517 reap_dead start 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/417032517 shutdown_connections 2024-05-10T11:21:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/417032517 >> 172.21.15.66:0/417032517 conn(0x7fc2ec0d50f0 msgr2=0x7fc2ec0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/417032517 shutdown_connections 2024-05-10T11:21:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.433+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/417032517 wait complete. 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.434+0000 7fc2f0ac8640 1 Processor -- start 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.434+0000 7fc2f0ac8640 1 -- start start 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2f0ac8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2d8004d40 0x7fc2ec0ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2f0ac8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 0x7fc2ec0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2f0ac8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2ec15dfe0 0x7fc2ec0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2f0ac8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec15f9f0 con 0x7fc2ec15db60 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2f0ac8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec15f870 con 0x7fc2ec15dfe0 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2f0ac8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec0d2f60 con 0x7fc2d8004d40 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2e9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 0x7fc2ec0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2e9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 0x7fc2ec0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43506/0 (socket says 172.21.15.66:43506) 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2e9d9b640 1 -- 172.21.15.66:0/84848881 learned_addr learned my addr 172.21.15.66:0/84848881 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2ec15dfe0 0x7fc2ec0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.435+0000 7fc2ea59c640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2d8004d40 0x7fc2ec0ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e9d9b640 1 -- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2d8004d40 msgr2=0x7fc2ec0ba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e9d9b640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2d8004d40 0x7fc2ec0ba2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e9d9b640 1 -- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2ec15dfe0 msgr2=0x7fc2ec0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e9d9b640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2ec15dfe0 0x7fc2ec0cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e9d9b640 1 -- 172.21.15.66:0/84848881 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec0c96a0 con 0x7fc2ec15db60 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2ead9d640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2ec15dfe0 0x7fc2ec0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e9d9b640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 0x7fc2ec0cc1c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e730 tx=0x7fc2d400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400c6c0 con 0x7fc2ec15db60 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d4018070 con 0x7fc2ec15db60 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec0c9980 con 0x7fc2ec15db60 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400ca80 con 0x7fc2ec15db60 2024-05-10T11:21:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.436+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec0c9f40 con 0x7fc2ec15db60 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.437+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec06a220 con 0x7fc2ec15db60 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.438+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc2d400cc20 con 0x7fc2ec15db60 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.438+0000 7fc2e2ffd640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2cc076300 0x7fc2cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.438+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6302+0+0 (secure 0 0 0) 0x7fc2d4097670 con 0x7fc2ec15db60 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.438+0000 7fc2ea59c640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2cc076300 0x7fc2cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.439+0000 7fc2ea59c640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2cc076300 0x7fc2cc0787c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0051f0 tx=0x7fc2dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.442+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc2d4060d80 con 0x7fc2ec15db60 2024-05-10T11:21:55.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:55.632+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc2ec0b5e60 con 0x7fc2ec15db60 2024-05-10T11:21:56.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.310+0000 7fc2e2ffd640 1 -- 172.21.15.66:0/84848881 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7fc2d4060680 con 0x7fc2ec15db60 2024-05-10T11:21:56.309 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:21:56.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2cc076300 msgr2=0x7fc2cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:56.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2cc076300 0x7fc2cc0787c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0051f0 tx=0x7fc2dc009040 comp rx=0 tx=0).stop 2024-05-10T11:21:56.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 msgr2=0x7fc2ec0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:56.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 0x7fc2ec0cc1c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e730 tx=0x7fc2d400eb30 comp rx=0 tx=0).stop 2024-05-10T11:21:56.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 shutdown_connections 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2cc076300 0x7fc2cc0787c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.312+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2ec15dfe0 0x7fc2ec0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.313+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ec15db60 0x7fc2ec0cc1c0 secure :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e730 tx=0x7fc2d400eb30 comp rx=0 tx=0).stop 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.313+0000 7fc2f0ac8640 1 --2- 172.21.15.66:0/84848881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2d8004d40 0x7fc2ec0ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.313+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 >> 172.21.15.66:0/84848881 conn(0x7fc2ec0d50f0 msgr2=0x7fc2ec157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.313+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 shutdown_connections 2024-05-10T11:21:56.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.313+0000 7fc2f0ac8640 1 -- 172.21.15.66:0/84848881 wait complete. 2024-05-10T11:21:56.327 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:21:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.437+0000 7f9f0bbda640 1 Processor -- start 2024-05-10T11:21:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.437+0000 7f9f0bbda640 1 -- start start 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0bbda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 0x7f9f040d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0bbda640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f041639a0 0x7f9f04070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0bbda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f040d2510 con 0x7f9f04071520 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0bbda640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9f04070220 con 0x7f9f041639a0 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0bbda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9f04070500 con 0x7f9f0415f370 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0a177640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9f04071520 0x7f9f04162e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40172/0 (socket says 172.21.15.66:40172) 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f0a177640 1 -- 172.21.15.66:0/2936129701 learned_addr learned my addr 172.21.15.66:0/2936129701 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.438+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333731353 0 0) 0x7f9f040d2510 con 0x7f9f04071520 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef0003520 con 0x7f9f04071520 2024-05-10T11:21:56.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09175640 1 --2- 172.21.15.66:0/2936129701 >> v2:172.21.15.190:3300/0 conn(0x7f9f041639a0 0x7f9f04070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 0x7f9f040d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2828940311 0 0) 0x7f9ef0003520 con 0x7f9f04071520 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 msgr2=0x7f9f040d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 0x7f9f040d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 >> v2:172.21.15.190:3300/0 conn(0x7f9f041639a0 msgr2=0x7f9f04070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 --2- 172.21.15.66:0/2936129701 >> v2:172.21.15.190:3300/0 conn(0x7f9f041639a0 0x7f9f04070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f040707e0 con 0x7f9f04071520 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f9efc0019f0 con 0x7f9f04071520 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09175640 1 --2- 172.21.15.66:0/2936129701 >> v2:172.21.15.190:3300/0 conn(0x7f9f041639a0 0x7f9f04070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 >> v1:172.21.15.66:6789/0 conn(0x7f9f04071520 legacy=0x7f9f04162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef00039b0 0x7f9ef0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 0x7f9ef0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef0004d40 0x7f9ef00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f04070220 con 0x7f9ef00039b0 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f04070500 con 0x7f9ef0004d40 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef000baf0 con 0x7f9f0415f370 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef00039b0 0x7f9ef0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09175640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 0x7f9ef0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f0a177640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef0004d40 0x7f9ef00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 -- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 msgr2=0x7f9ef0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0415f370 0x7f9ef0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 -- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef0004d40 msgr2=0x7f9ef00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef0004d40 0x7f9ef00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.439+0000 7f9f09976640 1 -- 172.21.15.66:0/2936129701 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef0003520 con 0x7f9ef00039b0 2024-05-10T11:21:56.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.440+0000 7f9f09976640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef00039b0 0x7f9ef0003dd0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000ba30 tx=0x7f9ef0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd6c2c4f1c18757 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.440+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00030070 con 0x7f9ef00039b0 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.440+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0002ade0 con 0x7f9ef00039b0 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.440+0000 7f9f08974640 1 -- 172.21.15.66:0/2936129701 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000b600 con 0x7f9ef00039b0 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2936129701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef00039b0 msgr2=0x7f9ef0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2936129701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef00039b0 0x7f9ef0003dd0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000ba30 tx=0x7f9ef0005830 comp rx=0 tx=0).stop 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0a177640 1 -- 172.21.15.66:0/2936129701 reap_dead start 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2936129701 shutdown_connections 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2936129701 >> 172.21.15.66:0/2936129701 conn(0x7f9f040d2e10 msgr2=0x7f9f040d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2936129701 shutdown_connections 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.441+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2936129701 wait complete. 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.442+0000 7f9f0bbda640 1 Processor -- start 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.442+0000 7f9f0bbda640 1 -- start start 2024-05-10T11:21:56.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0bbda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef00039b0 0x7f9f04151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0bbda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0409d6e0 0x7f9f041616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0bbda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 0x7f9f040c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0bbda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f04163690 con 0x7f9f04161c30 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0bbda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f04163510 con 0x7f9ef00039b0 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0bbda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9f040d1cc0 con 0x7f9f0409d6e0 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 0x7f9f040c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 0x7f9f040c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43522/0 (socket says 172.21.15.66:43522) 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 -- 172.21.15.66:0/2998814340 learned_addr learned my addr 172.21.15.66:0/2998814340 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f09175640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0409d6e0 0x7f9f041616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f09976640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef00039b0 0x7f9f04151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 -- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0409d6e0 msgr2=0x7f9f041616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0409d6e0 0x7f9f041616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 -- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef00039b0 msgr2=0x7f9f04151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef00039b0 0x7f9f04151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 -- 172.21.15.66:0/2998814340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f041518d0 con 0x7f9f04161c30 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9f0a177640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 0x7f9f040c8290 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9efc002230 tx=0x7f9efc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.443+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00eb90 con 0x7f9f04161c30 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.444+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9efc018070 con 0x7f9f04161c30 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.444+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc013420 con 0x7f9f04161c30 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.444+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f04162140 con 0x7f9f04161c30 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.444+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0409cee0 con 0x7f9f04161c30 2024-05-10T11:21:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.444+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0406a220 con 0x7f9f04161c30 2024-05-10T11:21:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.445+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9efc0135c0 con 0x7f9f04161c30 2024-05-10T11:21:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.446+0000 7f9efa7fc640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ee8076300 0x7f9ee80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.446+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5864+0+0 (secure 0 0 0) 0x7f9efc0977d0 con 0x7f9f04161c30 2024-05-10T11:21:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.446+0000 7f9f09976640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ee8076300 0x7f9ee80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.446+0000 7f9f09976640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ee8076300 0x7f9ee80787c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000ba00 tx=0x7f9f00030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.450+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9f041518d0 con 0x7f9f04161c30 2024-05-10T11:21:56.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:56.639+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f040b8d90 con 0x7f9f04161c30 2024-05-10T11:21:57.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.316+0000 7f9efa7fc640 1 -- 172.21.15.66:0/2998814340 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f9efc069110 con 0x7f9f04161c30 2024-05-10T11:21:57.316 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:21:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ee8076300 msgr2=0x7f9ee80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ee8076300 0x7f9ee80787c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000ba00 tx=0x7f9f00030000 comp rx=0 tx=0).stop 2024-05-10T11:21:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 msgr2=0x7f9f040c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 0x7f9f040c8290 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9efc002230 tx=0x7f9efc00e530 comp rx=0 tx=0).stop 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 shutdown_connections 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9ee8076300 0x7f9ee80787c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f04161c30 0x7f9f040c8290 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f0409d6e0 0x7f9f041616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 --2- 172.21.15.66:0/2998814340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ef00039b0 0x7f9f04151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 >> 172.21.15.66:0/2998814340 conn(0x7f9f040d2e10 msgr2=0x7f9f040d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 shutdown_connections 2024-05-10T11:21:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.319+0000 7f9f0bbda640 1 -- 172.21.15.66:0/2998814340 wait complete. 2024-05-10T11:21:57.339 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:21:57.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.453+0000 7f3d612d1640 1 Processor -- start 2024-05-10T11:21:57.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.453+0000 7f3d612d1640 1 -- start start 2024-05-10T11:21:57.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d612d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 0x7f3d5c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d612d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3d5c0b4e20 0x7f3d5c0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d612d1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5c0d4190 con 0x7f3d5c162900 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d612d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c0cfc40 con 0x7f3d5c0b4e20 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d612d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c0d3eb0 con 0x7f3d5c162ce0 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d5affd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3d5c162900 0x7f3d5c0d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40186/0 (socket says 172.21.15.66:40186) 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d5affd640 1 -- 172.21.15.66:0/4036546199 learned_addr learned my addr 172.21.15.66:0/4036546199 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680305577 0 0) 0x7f3d4c001110 con 0x7f3d5c162900 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d48003520 con 0x7f3d5c162900 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d5a7fc640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 0x7f3d5c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.454+0000 7f3d5b7fe640 1 --2- 172.21.15.66:0/4036546199 >> v2:172.21.15.190:3300/0 conn(0x7f3d5c0b4e20 0x7f3d5c0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2205384635 0 0) 0x7f3d48003520 con 0x7f3d5c162900 2024-05-10T11:21:57.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 msgr2=0x7f3d5c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:57.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 0x7f3d5c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 >> v2:172.21.15.190:3300/0 conn(0x7f3d5c0b4e20 msgr2=0x7f3d5c0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:57.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 --2- 172.21.15.66:0/4036546199 >> v2:172.21.15.190:3300/0 conn(0x7f3d5c0b4e20 0x7f3d5c0d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c0cfee0 con 0x7f3d5c162900 2024-05-10T11:21:57.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f3d4c001840 con 0x7f3d5c162900 2024-05-10T11:21:57.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 >> v1:172.21.15.66:6789/0 conn(0x7f3d5c162900 legacy=0x7f3d5c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d480039b0 0x7f3d48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 0x7f3d48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0cfc40 con 0x7f3d48004d40 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0d3eb0 con 0x7f3d480039b0 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4800b9c0 con 0x7f3d5c162ce0 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5b7fe640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5affd640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d480039b0 0x7f3d48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5a7fc640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 0x7f3d48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5b7fe640 1 -- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 msgr2=0x7f3d48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5b7fe640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c162ce0 0x7f3d48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5b7fe640 1 -- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d480039b0 msgr2=0x7f3d48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5b7fe640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d480039b0 0x7f3d48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.455+0000 7f3d5b7fe640 1 -- 172.21.15.66:0/4036546199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d48003520 con 0x7f3d48004d40 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.456+0000 7f3d5b7fe640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d480051c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009fc0 tx=0x7f3d48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a460885669ae20a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.456+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d54009c10 con 0x7f3d48004d40 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.456+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d54036070 con 0x7f3d48004d40 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.456+0000 7f3d59ffb640 1 -- 172.21.15.66:0/4036546199 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5402d070 con 0x7f3d48004d40 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d612d1640 1 -- 172.21.15.66:0/4036546199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 msgr2=0x7f3d480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d612d1640 1 --2- 172.21.15.66:0/4036546199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d480051c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009fc0 tx=0x7f3d48005830 comp rx=0 tx=0).stop 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d5b7fe640 1 -- 172.21.15.66:0/4036546199 reap_dead start 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d612d1640 1 -- 172.21.15.66:0/4036546199 shutdown_connections 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d612d1640 1 -- 172.21.15.66:0/4036546199 >> 172.21.15.66:0/4036546199 conn(0x7f3d5c09e430 msgr2=0x7f3d5c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:57.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d612d1640 1 -- 172.21.15.66:0/4036546199 shutdown_connections 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.457+0000 7f3d612d1640 1 -- 172.21.15.66:0/4036546199 wait complete. 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.458+0000 7f3d612d1640 1 Processor -- start 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.458+0000 7f3d612d1640 1 -- start start 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d612d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d5c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d612d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d5c0b8c50 0x7f3d5c0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d612d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c0ce790 0x7f3d5c0b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d612d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0b4180 con 0x7f3d48004d40 2024-05-10T11:21:57.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d612d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0d3b20 con 0x7f3d5c0b8c50 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d612d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c0b4300 con 0x7f3d5c0ce790 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d5c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d5c15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43536/0 (socket says 172.21.15.66:43536) 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 -- 172.21.15.66:0/1859043026 learned_addr learned my addr 172.21.15.66:0/1859043026 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5a7fc640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d5c0b8c50 0x7f3d5c0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 -- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c0ce790 msgr2=0x7f3d5c0b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5b7fe640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c0ce790 0x7f3d5c0b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c0ce790 0x7f3d5c0b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 -- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d5c0b8c50 msgr2=0x7f3d5c0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d5c0b8c50 0x7f3d5c0ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 -- 172.21.15.66:0/1859043026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c0b7eb0 con 0x7f3d48004d40 2024-05-10T11:21:57.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5a7fc640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d5c0b8c50 0x7f3d5c0ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.459+0000 7f3d5affd640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d5c15c740 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c001c40 tx=0x7f3d4c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.460+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00f930 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.460+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c018070 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.460+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00fd50 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.460+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5c0b8190 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.460+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5c0b8750 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.461+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d5c06a220 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.461+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d4c01d460 con 0x7f3d48004d40 2024-05-10T11:21:57.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.462+0000 7f3d537fe640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d3c0762d0 0x7f3d3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.462+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f3d4c0976d0 con 0x7f3d48004d40 2024-05-10T11:21:57.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.462+0000 7f3d5a7fc640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d3c0762d0 0x7f3d3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.462+0000 7f3d5a7fc640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d3c0762d0 0x7f3d3c078790 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c15f6a0 tx=0x7f3d44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:57.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.466+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3d5c0d4190 con 0x7f3d48004d40 2024-05-10T11:21:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.657+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3d5c0ceb70 con 0x7f3d48004d40 2024-05-10T11:21:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.661+0000 7f3d537fe640 1 -- 172.21.15.66:0/1859043026 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f3d4c0610c0 con 0x7f3d48004d40 2024-05-10T11:21:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.663+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d3c0762d0 msgr2=0x7f3d3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.663+0000 7f3d612d1640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d3c0762d0 0x7f3d3c078790 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c15f6a0 tx=0x7f3d44008040 comp rx=0 tx=0).stop 2024-05-10T11:21:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 msgr2=0x7f3d5c15c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d5c15c740 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c001c40 tx=0x7f3d4c0077a0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 shutdown_connections 2024-05-10T11:21:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3d3c0762d0 0x7f3d3c078790 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d5c0ce790 0x7f3d5c0b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d5c0b8c50 0x7f3d5c0ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 --2- 172.21.15.66:0/1859043026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48004d40 0x7f3d5c15c740 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 >> 172.21.15.66:0/1859043026 conn(0x7f3d5c09e430 msgr2=0x7f3d5c161e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 shutdown_connections 2024-05-10T11:21:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.664+0000 7f3d612d1640 1 -- 172.21.15.66:0/1859043026 wait complete. 2024-05-10T11:21:57.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-05-10T11:21:57.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.779+0000 7fa514b0a640 1 Processor -- start 2024-05-10T11:21:57.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.779+0000 7fa514b0a640 1 -- start start 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa514b0a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa51015d290 0x7fa510071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa514b0a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa5100d3510 0x7fa5100ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa514b0a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa510072330 con 0x7fa510071880 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa514b0a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa510071d70 con 0x7fa5100d3510 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa514b0a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa510072050 con 0x7fa51015d290 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa50ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa5100d3510 0x7fa5100ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa50ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa5100d3510 0x7fa5100ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43542/0 (socket says 172.21.15.66:43542) 2024-05-10T11:21:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa50dd9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa510071880 0x7fa5100d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40202/0 (socket says 172.21.15.66:40202) 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.780+0000 7fa50ed9d640 1 -- 172.21.15.66:0/3124357669 learned_addr learned my addr 172.21.15.66:0/3124357669 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50e59c640 1 --2- 172.21.15.66:0/3124357669 >> v2:172.21.15.190:3300/0 conn(0x7fa51015d290 0x7fa510071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50ed9d640 1 -- 172.21.15.66:0/3124357669 >> v2:172.21.15.190:3300/0 conn(0x7fa51015d290 msgr2=0x7fa510071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50ed9d640 1 --2- 172.21.15.66:0/3124357669 >> v2:172.21.15.190:3300/0 conn(0x7fa51015d290 0x7fa510071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50ed9d640 1 -- 172.21.15.66:0/3124357669 >> v1:172.21.15.66:6789/0 conn(0x7fa510071880 legacy=0x7fa5100d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50ed9d640 1 -- 172.21.15.66:0/3124357669 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5100cda70 con 0x7fa5100d3510 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50d59a640 1 -- 172.21.15.66:0/3124357669 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830269711 0 0) 0x7fa510072330 con 0x7fa510071880 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50e59c640 1 --2- 172.21.15.66:0/3124357669 >> v2:172.21.15.190:3300/0 conn(0x7fa51015d290 0x7fa510071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.781+0000 7fa50ed9d640 1 --2- 172.21.15.66:0/3124357669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5100d3510 0x7fa5100ce270 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fa5100701d0 tx=0x7fa50002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb992cf29c4a24dd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa50d59a640 1 -- 172.21.15.66:0/3124357669 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500037070 con 0x7fa5100d3510 2024-05-10T11:21:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa50d59a640 1 -- 172.21.15.66:0/3124357669 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa500032440 con 0x7fa5100d3510 2024-05-10T11:21:57.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa50d59a640 1 -- 172.21.15.66:0/3124357669 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500032810 con 0x7fa5100d3510 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 -- 172.21.15.66:0/3124357669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5100d3510 msgr2=0x7fa5100ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3124357669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5100d3510 0x7fa5100ce270 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fa5100701d0 tx=0x7fa50002a270 comp rx=0 tx=0).stop 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 -- 172.21.15.66:0/3124357669 shutdown_connections 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3124357669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5100d3510 0x7fa5100ce270 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3124357669 >> v2:172.21.15.190:3300/0 conn(0x7fa51015d290 0x7fa510071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 -- 172.21.15.66:0/3124357669 >> 172.21.15.66:0/3124357669 conn(0x7fa51009ba20 msgr2=0x7fa51009be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 -- 172.21.15.66:0/3124357669 shutdown_connections 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.782+0000 7fa514b0a640 1 -- 172.21.15.66:0/3124357669 wait complete. 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 Processor -- start 2024-05-10T11:21:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 -- start start 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 0x7fa510155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5100d3510 0x7fa5100cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa51015d290 0x7fa5100cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5100d1c20 con 0x7fa510071880 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa5100d1aa0 con 0x7fa5100d3510 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.784+0000 7fa514b0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa5100c6880 con 0x7fa51015d290 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 0x7fa510155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 0x7fa510155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43552/0 (socket says 172.21.15.66:43552) 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 -- 172.21.15.66:0/3920466415 learned_addr learned my addr 172.21.15.66:0/3920466415 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50dd9b640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5100d3510 0x7fa5100cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50ed9d640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa51015d290 0x7fa5100cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 -- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa51015d290 msgr2=0x7fa5100cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa51015d290 0x7fa5100cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 -- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5100d3510 msgr2=0x7fa5100cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5100d3510 0x7fa5100cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 -- 172.21.15.66:0/3920466415 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5100c6b60 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa50e59c640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 0x7fa510155440 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fa50800ce30 tx=0x7fa50800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50800f890 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50800fa30 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5100c6e40 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50800fe00 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.785+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5100c7400 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.786+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5100693f0 con 0x7fa510071880 2024-05-10T11:21:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.787+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa508018400 con 0x7fa510071880 2024-05-10T11:21:57.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.787+0000 7fa506ffd640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4f00762d0 0x7fa4f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:57.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.787+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fa508098230 con 0x7fa510071880 2024-05-10T11:21:57.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.788+0000 7fa50dd9b640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4f00762d0 0x7fa4f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:57.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.788+0000 7fa50dd9b640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4f00762d0 0x7fa4f0078790 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa51015b5f0 tx=0x7fa4f8007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:57.792+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa508014030 con 0x7fa510071880 2024-05-10T11:21:58.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.056+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7fa5100b56c0 con 0x7fa510071880 2024-05-10T11:21:58.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.317+0000 7fa506ffd640 1 -- 172.21.15.66:0/3920466415 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v438) ==== 146+0+0 (secure 0 0 0) 0x7fa50800ae20 con 0x7fa510071880 2024-05-10T11:21:58.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.319+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4f00762d0 msgr2=0x7fa4f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.319+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4f00762d0 0x7fa4f0078790 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa51015b5f0 tx=0x7fa4f8007b50 comp rx=0 tx=0).stop 2024-05-10T11:21:58.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.319+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 msgr2=0x7fa510155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.319+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 0x7fa510155440 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fa50800ce30 tx=0x7fa50800a650 comp rx=0 tx=0).stop 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 shutdown_connections 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa4f00762d0 0x7fa4f0078790 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa51015d290 0x7fa5100cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5100d3510 0x7fa5100cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 --2- 172.21.15.66:0/3920466415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa510071880 0x7fa510155440 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 >> 172.21.15.66:0/3920466415 conn(0x7fa51009ba20 msgr2=0x7fa5100b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 shutdown_connections 2024-05-10T11:21:58.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.320+0000 7fa514b0a640 1 -- 172.21.15.66:0/3920466415 wait complete. 2024-05-10T11:21:58.331 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-05-10T11:21:58.331 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T11:21:58.332 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:21:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.438+0000 7f2fade37640 1 Processor -- start 2024-05-10T11:21:58.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.438+0000 7f2fade37640 1 -- start start 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fade37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2fa806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fade37640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2fa806ec40 0x7f2fa80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fade37640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa806f1c0 con 0x7f2fa80c71c0 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fade37640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa806f4a0 con 0x7f2fa806ec40 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fade37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa806f780 con 0x7f2fa81598c0 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa7fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2fa80c71c0 0x7f2fa815fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40208/0 (socket says 172.21.15.66:40208) 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa7fff640 1 -- 172.21.15.66:0/2208288358 learned_addr learned my addr 172.21.15.66:0/2208288358 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa6ffd640 1 --2- 172.21.15.66:0/2208288358 >> v2:172.21.15.190:3300/0 conn(0x7f2fa806ec40 0x7f2fa80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314356020 0 0) 0x7f2fa806f1c0 con 0x7f2fa80c71c0 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2fa806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f90003520 con 0x7f2fa80c71c0 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1107888399 0 0) 0x7f2f90003520 con 0x7f2fa80c71c0 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 msgr2=0x7f2fa806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2fa806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 >> v2:172.21.15.190:3300/0 conn(0x7f2fa806ec40 msgr2=0x7f2fa80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 --2- 172.21.15.66:0/2208288358 >> v2:172.21.15.190:3300/0 conn(0x7f2fa806ec40 0x7f2fa80c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa806fa60 con 0x7f2fa80c71c0 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f2fa00019f0 con 0x7f2fa80c71c0 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.439+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 >> v1:172.21.15.66:6789/0 conn(0x7f2fa80c71c0 legacy=0x7f2fa815fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa67fc640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2f90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa67fc640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2f90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa67fc640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f90004d40 0x7f2f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa806f4a0 con 0x7f2f900039b0 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa806f780 con 0x7f2f90004d40 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9000b9c0 con 0x7f2fa81598c0 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2f90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa6ffd640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2f90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa7fff640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f90004d40 0x7f2f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa77fe640 1 -- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 msgr2=0x7f2f90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2f90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa77fe640 1 -- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f90004d40 msgr2=0x7f2f900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f90004d40 0x7f2f900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa77fe640 1 -- 172.21.15.66:0/2208288358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f90003520 con 0x7f2f900039b0 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.440+0000 7f2fa6ffd640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa81598c0 0x7f2f90004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2f90003dd0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009ac0 tx=0x7f2f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128c54c52bf1a49f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98036070 con 0x7f2f900039b0 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f98031400 con 0x7f2f900039b0 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fa67fc640 1 -- 172.21.15.66:0/2208288358 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98009690 con 0x7f2f900039b0 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fade37640 1 -- 172.21.15.66:0/2208288358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 msgr2=0x7f2f90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fade37640 1 --2- 172.21.15.66:0/2208288358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2f90003dd0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009ac0 tx=0x7f2f90005830 comp rx=0 tx=0).stop 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fa7fff640 1 -- 172.21.15.66:0/2208288358 reap_dead start 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fade37640 1 -- 172.21.15.66:0/2208288358 shutdown_connections 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.441+0000 7f2fade37640 1 -- 172.21.15.66:0/2208288358 >> 172.21.15.66:0/2208288358 conn(0x7f2fa80b2900 msgr2=0x7f2fa80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.442+0000 7f2fade37640 1 -- 172.21.15.66:0/2208288358 shutdown_connections 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.442+0000 7f2fade37640 1 -- 172.21.15.66:0/2208288358 wait complete. 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.443+0000 7f2fade37640 1 Processor -- start 2024-05-10T11:21:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.443+0000 7f2fade37640 1 -- start start 2024-05-10T11:21:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2fa8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fa80ca1e0 0x7f2fa8072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa8073460 0x7f2fa80c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8159ca0 con 0x7f2f900039b0 2024-05-10T11:21:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa815c6e0 con 0x7f2fa80ca1e0 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa8159e20 con 0x7f2fa8073460 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2fa8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2fa8156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43570/0 (socket says 172.21.15.66:43570) 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 -- 172.21.15.66:0/3378943048 learned_addr learned my addr 172.21.15.66:0/3378943048 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa7fff640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa8073460 0x7f2fa80c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa6ffd640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fa80ca1e0 0x7f2fa8072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 -- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa8073460 msgr2=0x7f2fa80c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa8073460 0x7f2fa80c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 -- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fa80ca1e0 msgr2=0x7f2fa8072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fa80ca1e0 0x7f2fa8072f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 -- 172.21.15.66:0/3378943048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa80c8ea0 con 0x7f2f900039b0 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fa77fe640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2fa8156990 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2f98034040 tx=0x7f2f98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:58.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98040020 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f98003940 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa80c9140 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98036040 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.444+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa80c9700 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.445+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa806a220 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.446+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f98043020 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.447+0000 7f2f8ffff640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2f940762d0 0x7f2f94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.447+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f2f980b7960 con 0x7f2f900039b0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.447+0000 7f2fa6ffd640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2f940762d0 0x7f2f94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.447+0000 7f2fa6ffd640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2f940762d0 0x7f2f94078790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8073dd0 tx=0x7f2f9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.451+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2f9804a030 con 0x7f2f900039b0 2024-05-10T11:21:58.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.642+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fa806e4e0 con 0x7f2f900039b0 2024-05-10T11:21:58.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.643+0000 7f2f8ffff640 1 -- 172.21.15.66:0/3378943048 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+13431 (secure 0 0 0) 0x7f2f98081470 con 0x7f2f900039b0 2024-05-10T11:21:58.642 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:21:58.642 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":110,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:21:57.310941+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6834/3403431174":"2024-05-11T11:21:50.671451+0000","172.21.15.66:6835/3403431174":"2024-05-11T11:21:50.671451+0000","172.21.15.66:6835/159674733":"2024-05-11T11:21:14.208523+0000","172.21.15.66:6834/159674733":"2024-05-11T11:21:14.208523+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:21:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2f940762d0 msgr2=0x7f2f94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2f940762d0 0x7f2f94078790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8073dd0 tx=0x7f2f9c008040 comp rx=0 tx=0).stop 2024-05-10T11:21:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 msgr2=0x7f2fa8156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2fa8156990 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2f98034040 tx=0x7f2f98004730 comp rx=0 tx=0).stop 2024-05-10T11:21:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 shutdown_connections 2024-05-10T11:21:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2f940762d0 0x7f2f94078790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fa8073460 0x7f2fa80c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fa80ca1e0 0x7f2fa8072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 --2- 172.21.15.66:0/3378943048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f900039b0 0x7f2fa8156990 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 >> 172.21.15.66:0/3378943048 conn(0x7f2fa80b2900 msgr2=0x7f2fa80b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 shutdown_connections 2024-05-10T11:21:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.645+0000 7f2fade37640 1 -- 172.21.15.66:0/3378943048 wait complete. 2024-05-10T11:21:58.656 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T11:12:17.696465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:21:58.656 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:21:58.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.765+0000 7f5cd62bd640 1 Processor -- start 2024-05-10T11:21:58.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.765+0000 7f5cd62bd640 1 -- start start 2024-05-10T11:21:58.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.765+0000 7f5cd62bd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5cd006f030 0x7f5cd0160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5cd62bd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd015cfb0 con 0x7f5cd006f410 2024-05-10T11:21:58.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5cd62bd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd015d290 con 0x7f5cd00cf240 2024-05-10T11:21:58.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5cd62bd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd00ccb60 con 0x7f5cd006f030 2024-05-10T11:21:58.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5ccffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5cd006f030 0x7f5cd0160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5ccf7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5cd006f410 0x7f5cd015c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40214/0 (socket says 172.21.15.66:40214) 2024-05-10T11:21:58.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5ccf7fe640 1 -- 172.21.15.66:0/2371471279 learned_addr learned my addr 172.21.15.66:0/2371471279 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:21:58.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5ccffff640 1 -- 172.21.15.66:0/2371471279 >> v1:172.21.15.190:6789/0 conn(0x7f5cd00cf240 legacy=0x7f5cd00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:58.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5ccffff640 1 -- 172.21.15.66:0/2371471279 >> v1:172.21.15.66:6789/0 conn(0x7f5cd006f410 legacy=0x7f5cd015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.766+0000 7f5ccffff640 1 -- 172.21.15.66:0/2371471279 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd015fd30 con 0x7f5cd006f030 2024-05-10T11:21:58.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5ccffff640 1 --2- 172.21.15.66:0/2371471279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd006f030 0x7f5cd0160530 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00097a0 tx=0x7f5cc002c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1b197fe9e34206 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cceffd640 1 -- 172.21.15.66:0/2371471279 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0039070 con 0x7f5cd006f030 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cceffd640 1 -- 172.21.15.66:0/2371471279 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc0034640 con 0x7f5cd006f030 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cceffd640 1 -- 172.21.15.66:0/2371471279 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0034a10 con 0x7f5cd006f030 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cd62bd640 1 -- 172.21.15.66:0/2371471279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd006f030 msgr2=0x7f5cd0160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/2371471279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd006f030 0x7f5cd0160530 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00097a0 tx=0x7f5cc002c3f0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cd62bd640 1 -- 172.21.15.66:0/2371471279 shutdown_connections 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/2371471279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd006f030 0x7f5cd0160530 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.767+0000 7f5cd62bd640 1 -- 172.21.15.66:0/2371471279 >> 172.21.15.66:0/2371471279 conn(0x7f5cd00d0c90 msgr2=0x7f5cd00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:58.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.768+0000 7f5cd62bd640 1 -- 172.21.15.66:0/2371471279 shutdown_connections 2024-05-10T11:21:58.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.768+0000 7f5cd62bd640 1 -- 172.21.15.66:0/2371471279 wait complete. 2024-05-10T11:21:58.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.769+0000 7f5cd62bd640 1 Processor -- start 2024-05-10T11:21:58.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.769+0000 7f5cd62bd640 1 -- start start 2024-05-10T11:21:58.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cd006f030 0x7f5cd01f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cd006f410 0x7f5cd00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 0x7f5cd00ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00cb910 con 0x7f5cd00cf240 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd015fa40 con 0x7f5cd006f410 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd0159d70 con 0x7f5cd006f030 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 0x7f5cd00ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 0x7f5cd00ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43584/0 (socket says 172.21.15.66:43584) 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 -- 172.21.15.66:0/1670309927 learned_addr learned my addr 172.21.15.66:0/1670309927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5ccffff640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cd006f030 0x7f5cd01f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5ccf7fe640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cd006f410 0x7f5cd00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 -- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cd006f030 msgr2=0x7f5cd01f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cd006f030 0x7f5cd01f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 -- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cd006f410 msgr2=0x7f5cd00c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cd006f410 0x7f5cd00c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 -- 172.21.15.66:0/1670309927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd01f6430 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd485a640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 0x7f5cd00ca980 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800b9e0 tx=0x7f5cc800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8003b70 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8003d10 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd00c6390 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.770+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800cae0 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.771+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd00c4db0 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.771+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd006a220 con 0x7f5cd00cf240 2024-05-10T11:21:58.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.772+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5cc800cc80 con 0x7f5cd00cf240 2024-05-10T11:21:58.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.773+0000 7f5cccff9640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5cbc0762d0 0x7f5cbc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:58.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.773+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f5cc80971a0 con 0x7f5cd00cf240 2024-05-10T11:21:58.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.773+0000 7f5ccffff640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5cbc0762d0 0x7f5cbc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:58.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.773+0000 7f5ccffff640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5cbc0762d0 0x7f5cbc078790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0036000 tx=0x7f5cc0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:58.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.777+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5cd00c6390 con 0x7f5cd00cf240 2024-05-10T11:21:58.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.967+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5cd00cf020 con 0x7f5cd00cf240 2024-05-10T11:21:58.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.967+0000 7f5cccff9640 1 -- 172.21.15.66:0/1670309927 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) ==== 93+0+10 (secure 0 0 0) 0x7f5cd01f6430 con 0x7f5cd00cf240 2024-05-10T11:21:58.967 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-05-10T11:21:58.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.969+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5cbc0762d0 msgr2=0x7f5cbc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.969+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5cbc0762d0 0x7f5cbc078790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0036000 tx=0x7f5cc0030000 comp rx=0 tx=0).stop 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.969+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 msgr2=0x7f5cd00ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 0x7f5cd00ca980 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800b9e0 tx=0x7f5cc800bea0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 shutdown_connections 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5cbc0762d0 0x7f5cbc078790 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cd00cf240 0x7f5cd00ca980 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cd006f410 0x7f5cd00c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 --2- 172.21.15.66:0/1670309927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cd006f030 0x7f5cd01f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:58.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 >> 172.21.15.66:0/1670309927 conn(0x7f5cd00d0c90 msgr2=0x7f5cd00cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:58.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 shutdown_connections 2024-05-10T11:21:58.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:58.970+0000 7f5cd62bd640 1 -- 172.21.15.66:0/1670309927 wait complete. 2024-05-10T11:21:58.980 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-05-10T11:21:59.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.085+0000 7feb9979e640 1 Processor -- start 2024-05-10T11:21:59.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.085+0000 7feb9979e640 1 -- start start 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb9979e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feb94070550 0x7feb940ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb9979e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb940709b0 0x7feb940ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb9979e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb94073d70 con 0x7feb9406c2c0 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb9979e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7feb9415fb90 con 0x7feb94070550 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb9979e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb9415fe70 con 0x7feb940709b0 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feb94070550 0x7feb940ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feb94070550 0x7feb940ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43600/0 (socket says 172.21.15.66:43600) 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb93fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7feb9406c2c0 0x7feb9406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40228/0 (socket says 172.21.15.66:40228) 2024-05-10T11:21:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 -- 172.21.15.66:0/360952002 learned_addr learned my addr 172.21.15.66:0/360952002 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb98f9d640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb940709b0 0x7feb940ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 -- 172.21.15.66:0/360952002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb940709b0 msgr2=0x7feb940ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb940709b0 0x7feb940ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 -- 172.21.15.66:0/360952002 >> v1:172.21.15.66:6789/0 conn(0x7feb9406c2c0 legacy=0x7feb9406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb92ffd640 1 -- 172.21.15.66:0/360952002 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510298783 0 0) 0x7feb84001110 con 0x7feb9406c2c0 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb937fe640 1 -- 172.21.15.66:0/360952002 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb94160150 con 0x7feb94070550 2024-05-10T11:21:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.086+0000 7feb98f9d640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb940709b0 0x7feb940ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:21:59.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.087+0000 7feb937fe640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb94070550 0x7feb940ce610 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ff5b2b9b7a0487 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:59.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.087+0000 7feb92ffd640 1 -- 172.21.15.66:0/360952002 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88037070 con 0x7feb94070550 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.087+0000 7feb92ffd640 1 -- 172.21.15.66:0/360952002 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb88032440 con 0x7feb94070550 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.087+0000 7feb92ffd640 1 -- 172.21.15.66:0/360952002 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88032810 con 0x7feb94070550 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 -- 172.21.15.66:0/360952002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb94070550 msgr2=0x7feb940ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb94070550 0x7feb940ce610 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8802a1c0 comp rx=0 tx=0).stop 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 -- 172.21.15.66:0/360952002 shutdown_connections 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb940709b0 0x7feb940ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 --2- 172.21.15.66:0/360952002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb94070550 0x7feb940ce610 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 -- 172.21.15.66:0/360952002 >> 172.21.15.66:0/360952002 conn(0x7feb940b3620 msgr2=0x7feb940b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 -- 172.21.15.66:0/360952002 shutdown_connections 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.088+0000 7feb9979e640 1 -- 172.21.15.66:0/360952002 wait complete. 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.089+0000 7feb9979e640 1 Processor -- start 2024-05-10T11:21:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.089+0000 7feb9979e640 1 -- start start 2024-05-10T11:21:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb9979e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb9406c2c0 0x7feb9414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb9979e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb94070550 0x7feb940cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb9979e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 0x7feb94158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb9979e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb9415f930 con 0x7feb940709b0 2024-05-10T11:21:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb9979e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb9415f7b0 con 0x7feb94070550 2024-05-10T11:21:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb9979e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb940cdbb0 con 0x7feb9406c2c0 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb98f9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 0x7feb94158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb98f9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 0x7feb94158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43616/0 (socket says 172.21.15.66:43616) 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb98f9d640 1 -- 172.21.15.66:0/2602962912 learned_addr learned my addr 172.21.15.66:0/2602962912 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb93fff640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb9406c2c0 0x7feb9414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.090+0000 7feb937fe640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb94070550 0x7feb940cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb98f9d640 1 -- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb9406c2c0 msgr2=0x7feb9414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb98f9d640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb9406c2c0 0x7feb9414ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb98f9d640 1 -- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb94070550 msgr2=0x7feb940cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:21:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb98f9d640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb94070550 0x7feb940cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb98f9d640 1 -- 172.21.15.66:0/2602962912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb940ca260 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb98f9d640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 0x7feb94158e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7feb8c007ec0 tx=0x7feb8c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c01a070 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c003b90 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c004030 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb940ca540 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.091+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb940cab00 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.092+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb94076680 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.093+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb8c01d070 con 0x7feb940709b0 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.093+0000 7feb90ff9640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb800762d0 0x7feb80078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:21:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.093+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7feb8c097790 con 0x7feb940709b0 2024-05-10T11:21:59.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.093+0000 7feb93fff640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb800762d0 0x7feb80078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:21:59.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.094+0000 7feb93fff640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb800762d0 0x7feb80078790 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7feb84007fd0 tx=0x7feb84007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:21:59.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.097+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7feb8c010070 con 0x7feb940709b0 2024-05-10T11:21:59.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:21:59.365+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7feb940b33d0 con 0x7feb940709b0 2024-05-10T11:22:00.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.323+0000 7feb90ff9640 1 -- 172.21.15.66:0/2602962912 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v440) ==== 147+0+0 (secure 0 0 0) 0x7feb8c069070 con 0x7feb940709b0 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb800762d0 msgr2=0x7feb80078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb800762d0 0x7feb80078790 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7feb84007fd0 tx=0x7feb84007de0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 msgr2=0x7feb94158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 0x7feb94158e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7feb8c007ec0 tx=0x7feb8c00d4a0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 shutdown_connections 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb800762d0 0x7feb80078790 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb940709b0 0x7feb94158e20 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb94070550 0x7feb940cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 --2- 172.21.15.66:0/2602962912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb9406c2c0 0x7feb9414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.327+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 >> 172.21.15.66:0/2602962912 conn(0x7feb940b3620 msgr2=0x7feb940b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:00.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.328+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 shutdown_connections 2024-05-10T11:22:00.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.328+0000 7feb9979e640 1 -- 172.21.15.66:0/2602962912 wait complete. 2024-05-10T11:22:00.342 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T11:22:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 Processor -- start 2024-05-10T11:22:00.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 -- start start 2024-05-10T11:22:00.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde1815f410 0x7fde180d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde180b56a0 0x7fde180d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde180d2800 con 0x7fde180d0f10 2024-05-10T11:22:00.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fde180d2ae0 con 0x7fde180b56a0 2024-05-10T11:22:00.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.459+0000 7fde1e787640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fde180d01d0 con 0x7fde1815f410 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde180b56a0 0x7fde180d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde180b56a0 0x7fde180d36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43622/0 (socket says 172.21.15.66:43622) 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 -- 172.21.15.66:0/3420622742 learned_addr learned my addr 172.21.15.66:0/3420622742 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde17fff640 1 --2- 172.21.15.66:0/3420622742 >> v2:172.21.15.190:3300/0 conn(0x7fde1815f410 0x7fde180d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 -- 172.21.15.66:0/3420622742 >> v2:172.21.15.190:3300/0 conn(0x7fde1815f410 msgr2=0x7fde180d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 --2- 172.21.15.66:0/3420622742 >> v2:172.21.15.190:3300/0 conn(0x7fde1815f410 0x7fde180d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 -- 172.21.15.66:0/3420622742 >> v1:172.21.15.190:6789/0 conn(0x7fde180d0f10 legacy=0x7fde180b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:00.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.460+0000 7fde1cd24640 1 -- 172.21.15.66:0/3420622742 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde180d04b0 con 0x7fde180b56a0 2024-05-10T11:22:00.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.461+0000 7fde1cd24640 1 --2- 172.21.15.66:0/3420622742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde180b56a0 0x7fde180d36d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fde1808f160 tx=0x7fde1002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4f0eab0f5eed4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:00.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.461+0000 7fde177fe640 1 -- 172.21.15.66:0/3420622742 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10036070 con 0x7fde180b56a0 2024-05-10T11:22:00.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.461+0000 7fde177fe640 1 -- 172.21.15.66:0/3420622742 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde10031600 con 0x7fde180b56a0 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.461+0000 7fde177fe640 1 -- 172.21.15.66:0/3420622742 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100319d0 con 0x7fde180b56a0 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.461+0000 7fde1e787640 1 -- 172.21.15.66:0/3420622742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde180b56a0 msgr2=0x7fde180d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.461+0000 7fde1e787640 1 --2- 172.21.15.66:0/3420622742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde180b56a0 0x7fde180d36d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fde1808f160 tx=0x7fde1002a660 comp rx=0 tx=0).stop 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.462+0000 7fde1e787640 1 -- 172.21.15.66:0/3420622742 shutdown_connections 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.462+0000 7fde1e787640 1 --2- 172.21.15.66:0/3420622742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde180b56a0 0x7fde180d36d0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.462+0000 7fde1e787640 1 --2- 172.21.15.66:0/3420622742 >> v2:172.21.15.190:3300/0 conn(0x7fde1815f410 0x7fde180d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.462+0000 7fde1e787640 1 -- 172.21.15.66:0/3420622742 >> 172.21.15.66:0/3420622742 conn(0x7fde1808ed30 msgr2=0x7fde1809e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.462+0000 7fde1e787640 1 -- 172.21.15.66:0/3420622742 shutdown_connections 2024-05-10T11:22:00.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.462+0000 7fde1e787640 1 -- 172.21.15.66:0/3420622742 wait complete. 2024-05-10T11:22:00.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.463+0000 7fde1e787640 1 Processor -- start 2024-05-10T11:22:00.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.463+0000 7fde1e787640 1 -- start start 2024-05-10T11:22:00.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.463+0000 7fde1e787640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde180d0f10 0x7fde180ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.463+0000 7fde1e787640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 0x7fde1814df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1e787640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde180b2910 0x7fde180b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1e787640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde180cffb0 con 0x7fde1815f410 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1e787640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde180cfe30 con 0x7fde180b2910 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1e787640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fde180d3c10 con 0x7fde180d0f10 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 0x7fde1814df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 0x7fde1814df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43624/0 (socket says 172.21.15.66:43624) 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 -- 172.21.15.66:0/2119314816 learned_addr learned my addr 172.21.15.66:0/2119314816 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde17fff640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde180d0f10 0x7fde180ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1cd24640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde180b2910 0x7fde180b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 -- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde180d0f10 msgr2=0x7fde180ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde180d0f10 0x7fde180ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 -- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde180b2910 msgr2=0x7fde180b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde180b2910 0x7fde180b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 -- 172.21.15.66:0/2119314816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1814ca30 con 0x7fde1815f410 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde0ffff640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 0x7fde1814df80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c430 tx=0x7fde0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:00.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00011790 con 0x7fde1815f410 2024-05-10T11:22:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde00017070 con 0x7fde1815f410 2024-05-10T11:22:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00011bb0 con 0x7fde1815f410 2024-05-10T11:22:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde180cea60 con 0x7fde1815f410 2024-05-10T11:22:00.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.464+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde180cf020 con 0x7fde1815f410 2024-05-10T11:22:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.465+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1806a220 con 0x7fde1815f410 2024-05-10T11:22:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.466+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde0001c460 con 0x7fde1815f410 2024-05-10T11:22:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.466+0000 7fde157fa640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddf80762d0 0x7fddf8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.467+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fde00097230 con 0x7fde1815f410 2024-05-10T11:22:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.467+0000 7fde17fff640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddf80762d0 0x7fddf8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.467+0000 7fde17fff640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddf80762d0 0x7fddf8078790 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fde080079a0 tx=0x7fde08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:00.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.471+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fde00060660 con 0x7fde1815f410 2024-05-10T11:22:00.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.661+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fde180d6090 con 0x7fde1815f410 2024-05-10T11:22:00.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.665+0000 7fde157fa640 1 -- 172.21.15.66:0/2119314816 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fde00064960 con 0x7fde1815f410 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddf80762d0 msgr2=0x7fddf8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddf80762d0 0x7fddf8078790 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fde080079a0 tx=0x7fde08008040 comp rx=0 tx=0).stop 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 msgr2=0x7fde1814df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 0x7fde1814df80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c430 tx=0x7fde0000c8f0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 shutdown_connections 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fddf80762d0 0x7fddf8078790 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde180b2910 0x7fde180b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde1815f410 0x7fde1814df80 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 --2- 172.21.15.66:0/2119314816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde180d0f10 0x7fde180ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 >> 172.21.15.66:0/2119314816 conn(0x7fde1808ed30 msgr2=0x7fde180b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:00.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 shutdown_connections 2024-05-10T11:22:00.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.667+0000 7fde1e787640 1 -- 172.21.15.66:0/2119314816 wait complete. 2024-05-10T11:22:00.678 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:22:00.678 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:22:00.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:22:00.766 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:22:00.767 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:00.767 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:00.783 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:22:00.783 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:22:00.784 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:00.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:22:00.801 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:00.801 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:00.843 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:22:00.843 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:22:00.843 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:00.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:22:00.861 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T11:22:00.861 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:00.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.986+0000 7fd33441c640 1 Processor -- start 2024-05-10T11:22:00.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.987+0000 7fd33441c640 1 -- start start 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.987+0000 7fd33441c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd32c15f4e0 0x7fd32c06d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.987+0000 7fd33441c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd32c15f8c0 0x7fd32c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.987+0000 7fd33441c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c0b3540 con 0x7fd32c06e450 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.987+0000 7fd33441c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c0b23f0 con 0x7fd32c15f4e0 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.987+0000 7fd33441c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c0b4150 con 0x7fd32c15f8c0 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd32c15f4e0 0x7fd32c06d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd32c15f4e0 0x7fd32c06d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43626/0 (socket says 172.21.15.66:43626) 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 -- 172.21.15.66:0/4170305596 learned_addr learned my addr 172.21.15.66:0/4170305596 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3319b7640 1 --2- 172.21.15.66:0/4170305596 >> v2:172.21.15.190:3300/0 conn(0x7fd32c15f8c0 0x7fd32c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 -- 172.21.15.66:0/4170305596 >> v2:172.21.15.190:3300/0 conn(0x7fd32c15f8c0 msgr2=0x7fd32c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 --2- 172.21.15.66:0/4170305596 >> v2:172.21.15.190:3300/0 conn(0x7fd32c15f8c0 0x7fd32c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 -- 172.21.15.66:0/4170305596 >> v1:172.21.15.190:6789/0 conn(0x7fd32c06e450 legacy=0x7fd32c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3321b8640 1 -- 172.21.15.66:0/4170305596 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c0b3820 con 0x7fd32c15f4e0 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.988+0000 7fd3319b7640 1 --2- 172.21.15.66:0/4170305596 >> v2:172.21.15.190:3300/0 conn(0x7fd32c15f8c0 0x7fd32c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.989+0000 7fd3321b8640 1 --2- 172.21.15.66:0/4170305596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c15f4e0 0x7fd32c06d9d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd32c069930 tx=0x7fd32802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6358f59dbd68462d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.989+0000 7fd3311b6640 1 -- 172.21.15.66:0/4170305596 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328037070 con 0x7fd32c15f4e0 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.989+0000 7fd3311b6640 1 -- 172.21.15.66:0/4170305596 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd328032440 con 0x7fd32c15f4e0 2024-05-10T11:22:00.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.989+0000 7fd3311b6640 1 -- 172.21.15.66:0/4170305596 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328032810 con 0x7fd32c15f4e0 2024-05-10T11:22:00.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.989+0000 7fd33441c640 1 -- 172.21.15.66:0/4170305596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c15f4e0 msgr2=0x7fd32c06d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.989+0000 7fd33441c640 1 --2- 172.21.15.66:0/4170305596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c15f4e0 0x7fd32c06d9d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd32c069930 tx=0x7fd32802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.990+0000 7fd33441c640 1 -- 172.21.15.66:0/4170305596 shutdown_connections 2024-05-10T11:22:00.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.990+0000 7fd33441c640 1 --2- 172.21.15.66:0/4170305596 >> v2:172.21.15.190:3300/0 conn(0x7fd32c15f8c0 0x7fd32c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.990+0000 7fd33441c640 1 --2- 172.21.15.66:0/4170305596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c15f4e0 0x7fd32c06d9d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.990+0000 7fd33441c640 1 -- 172.21.15.66:0/4170305596 >> 172.21.15.66:0/4170305596 conn(0x7fd32c0d2df0 msgr2=0x7fd32c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:00.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.990+0000 7fd33441c640 1 -- 172.21.15.66:0/4170305596 shutdown_connections 2024-05-10T11:22:00.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.990+0000 7fd33441c640 1 -- 172.21.15.66:0/4170305596 wait complete. 2024-05-10T11:22:00.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.991+0000 7fd33441c640 1 Processor -- start 2024-05-10T11:22:00.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.991+0000 7fd33441c640 1 -- start start 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 0x7fd32c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd32c15f4e0 0x7fd32c157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd32c15f8c0 0x7fd32c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c06e870 con 0x7fd32c06e450 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0b3de0 con 0x7fd32c15f8c0 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c0b45e0 con 0x7fd32c15f4e0 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 0x7fd32c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 0x7fd32c14b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43636/0 (socket says 172.21.15.66:43636) 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 -- 172.21.15.66:0/2474380087 learned_addr learned my addr 172.21.15.66:0/2474380087 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3329b9640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd32c15f8c0 0x7fd32c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3319b7640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd32c15f4e0 0x7fd32c157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 -- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd32c15f4e0 msgr2=0x7fd32c157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd32c15f4e0 0x7fd32c157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 -- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd32c15f8c0 msgr2=0x7fd32c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd32c15f8c0 0x7fd32c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 -- 172.21.15.66:0/2474380087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c1591c0 con 0x7fd32c06e450 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd3321b8640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 0x7fd32c14b310 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd32802a220 tx=0x7fd3280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328041020 con 0x7fd32c06e450 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3280306c0 con 0x7fd32c06e450 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c1594a0 con 0x7fd32c06e450 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328037040 con 0x7fd32c06e450 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.992+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c159a60 con 0x7fd32c06e450 2024-05-10T11:22:00.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.993+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c06a220 con 0x7fd32c06e450 2024-05-10T11:22:00.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.994+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd328044020 con 0x7fd32c06e450 2024-05-10T11:22:00.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.994+0000 7fd322ffd640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd310076300 0x7fd3100787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:00.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.995+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fd3280b7c50 con 0x7fd32c06e450 2024-05-10T11:22:00.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.995+0000 7fd3319b7640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd310076300 0x7fd3100787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:00.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.995+0000 7fd3319b7640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd310076300 0x7fd3100787c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd32c15bce0 tx=0x7fd31c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:00.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:00.999+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd3280bd020 con 0x7fd32c06e450 2024-05-10T11:22:01.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.232+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd32c0713a0 con 0x7fd32c06e450 2024-05-10T11:22:01.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.233+0000 7fd322ffd640 1 -- 172.21.15.66:0/2474380087 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+3872 (secure 0 0 0) 0x7fd32804b030 con 0x7fd32c06e450 2024-05-10T11:22:01.233 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:01.233 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2398917108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2398917108},{"type":"v1","addr":"172.21.15.190:6836","nonce":2398917108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2203361236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":2203361236},{"type":"v1","addr":"172.21.15.190:6837","nonce":2203361236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/215935494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":215935494},{"type":"v1","addr":"172.21.15.66:6833","nonce":215935494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1427513472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1427513472},{"type":"v1","addr":"172.21.15.66:6835","nonce":1427513472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[]} 2024-05-10T11:22:01.233 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 93 2024-05-10T11:22:01.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd310076300 msgr2=0x7fd3100787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:01.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd310076300 0x7fd3100787c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd32c15bce0 tx=0x7fd31c008040 comp rx=0 tx=0).stop 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 msgr2=0x7fd32c14b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 0x7fd32c14b310 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd32802a220 tx=0x7fd3280046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 shutdown_connections 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd310076300 0x7fd3100787c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd32c15f8c0 0x7fd32c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd32c15f4e0 0x7fd32c157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 --2- 172.21.15.66:0/2474380087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd32c06e450 0x7fd32c14b310 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 >> 172.21.15.66:0/2474380087 conn(0x7fd32c0d2df0 msgr2=0x7fd32c0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 shutdown_connections 2024-05-10T11:22:01.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.235+0000 7fd33441c640 1 -- 172.21.15.66:0/2474380087 wait complete. 2024-05-10T11:22:01.246 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T11:22:01.246 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T11:22:01.246 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:22:01.249 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:22:01.249 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T11:22:01.249 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T11:22:01.250 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:22:01.250 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:22:01.250 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T11:22:01.250 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T11:22:01.250 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:22:01.250 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:22:01.250 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T11:22:01.251 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T11:22:01.251 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:22:01.251 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:22:01.255 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:22:01.255 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T11:22:01.259 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:22:01.259 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T11:22:01.262 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:22:01.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T11:22:01.263 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:22:01.263 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T11:22:01.301 INFO:tasks.ceph.mds.a:Started 2024-05-10T11:22:01.301 DEBUG:teuthology.parallel:result is None 2024-05-10T11:22:01.302 INFO:tasks.ceph.mds.c:Started 2024-05-10T11:22:01.302 DEBUG:teuthology.parallel:result is None 2024-05-10T11:22:01.305 INFO:tasks.ceph.mds.b:Started 2024-05-10T11:22:01.305 DEBUG:teuthology.parallel:result is None 2024-05-10T11:22:01.305 INFO:tasks.ceph.mds.d:Started 2024-05-10T11:22:01.306 DEBUG:teuthology.parallel:result is None 2024-05-10T11:22:01.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T11:22:01.380 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-05-10T11:22:01.381 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:22:01.387 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:22:01.387 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-05-10T11:22:01.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.416+0000 7f4c7e26d640 1 Processor -- start 2024-05-10T11:22:01.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.417+0000 7f4c7e26d640 1 -- start start 2024-05-10T11:22:01.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.417+0000 7f4c7e26d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c7815ce60 0x7f4c780cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:01.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.417+0000 7f4c7e26d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c780c65f0 0x7f4c78160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.417+0000 7f4c7e26d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c780c6a60 con 0x7f4c78161010 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.417+0000 7f4c7e26d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4c78161480 con 0x7f4c780c65f0 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.417+0000 7f4c7e26d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4c780cd090 con 0x7f4c7815ce60 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c7c80a640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4c78161010 0x7f4c780add50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40242/0 (socket says 172.21.15.66:40242) 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c7c80a640 1 -- 172.21.15.66:0/3657553664 learned_addr learned my addr 172.21.15.66:0/3657553664 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c777fe640 1 --2- 172.21.15.66:0/3657553664 >> v2:172.21.15.66:3300/0 conn(0x7f4c780c65f0 0x7f4c78160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c77fff640 1 --2- 172.21.15.66:0/3657553664 >> v2:172.21.15.190:3300/0 conn(0x7f4c7815ce60 0x7f4c780cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c76ffd640 1 -- 172.21.15.66:0/3657553664 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648418833 0 0) 0x7f4c780c6a60 con 0x7f4c78161010 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c76ffd640 1 -- 172.21.15.66:0/3657553664 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c60003520 con 0x7f4c78161010 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c777fe640 1 -- 172.21.15.66:0/3657553664 >> v2:172.21.15.190:3300/0 conn(0x7f4c7815ce60 msgr2=0x7f4c780cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c777fe640 1 --2- 172.21.15.66:0/3657553664 >> v2:172.21.15.190:3300/0 conn(0x7f4c7815ce60 0x7f4c780cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c777fe640 1 -- 172.21.15.66:0/3657553664 >> v1:172.21.15.66:6789/0 conn(0x7f4c78161010 legacy=0x7f4c780add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:01.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.418+0000 7f4c777fe640 1 -- 172.21.15.66:0/3657553664 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c780cd370 con 0x7f4c780c65f0 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.419+0000 7f4c777fe640 1 --2- 172.21.15.66:0/3657553664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c780c65f0 0x7f4c78160ad0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f4c78070280 tx=0x7f4c6c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d083ca2db93c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.419+0000 7f4c76ffd640 1 -- 172.21.15.66:0/3657553664 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c037070 con 0x7f4c780c65f0 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.419+0000 7f4c76ffd640 1 -- 172.21.15.66:0/3657553664 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c032440 con 0x7f4c780c65f0 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.419+0000 7f4c76ffd640 1 -- 172.21.15.66:0/3657553664 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c02ae60 con 0x7f4c780c65f0 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3657553664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c780c65f0 msgr2=0x7f4c78160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3657553664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c780c65f0 0x7f4c78160ad0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f4c78070280 tx=0x7f4c6c02a110 comp rx=0 tx=0).stop 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3657553664 shutdown_connections 2024-05-10T11:22:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3657553664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c780c65f0 0x7f4c78160ad0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3657553664 >> v2:172.21.15.190:3300/0 conn(0x7f4c7815ce60 0x7f4c780cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3657553664 >> 172.21.15.66:0/3657553664 conn(0x7f4c780b2900 msgr2=0x7f4c780b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:01.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3657553664 shutdown_connections 2024-05-10T11:22:01.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.420+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3657553664 wait complete. 2024-05-10T11:22:01.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.421+0000 7f4c7e26d640 1 Processor -- start 2024-05-10T11:22:01.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.421+0000 7f4c7e26d640 1 -- start start 2024-05-10T11:22:01.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7e26d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c780c65f0 0x7f4c7815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:01.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7e26d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c7815ce60 0x7f4c7815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:01.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7e26d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 0x7f4c78152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7e26d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780ccd60 con 0x7f4c78161010 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7e26d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780cd930 con 0x7f4c7815ce60 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7e26d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7815e250 con 0x7f4c780c65f0 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 0x7f4c78152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 0x7f4c78152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43682/0 (socket says 172.21.15.66:43682) 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 -- 172.21.15.66:0/3623882374 learned_addr learned my addr 172.21.15.66:0/3623882374 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c777fe640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c7815ce60 0x7f4c7815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c77fff640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c780c65f0 0x7f4c7815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 -- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c780c65f0 msgr2=0x7f4c7815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c780c65f0 0x7f4c7815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 -- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c7815ce60 msgr2=0x7f4c7815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c7815ce60 0x7f4c7815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:01.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 -- 172.21.15.66:0/3623882374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7815bfc0 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.422+0000 7f4c7c80a640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 0x7f4c78152420 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000cb40 tx=0x7f4c7000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.423+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70017070 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.423+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7000aca0 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.423+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7815c2a0 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.423+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70012620 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.423+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c78153410 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.424+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7806a220 con 0x7f4c78161010 2024-05-10T11:22:01.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.424+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c7001a070 con 0x7f4c78161010 2024-05-10T11:22:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.425+0000 7f4c74ff9640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c64076320 0x7f4c640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.425+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f4c70097150 con 0x7f4c78161010 2024-05-10T11:22:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.425+0000 7f4c77fff640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c64076320 0x7f4c640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:01.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.426+0000 7f4c77fff640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c64076320 0x7f4c640787e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009b40 tx=0x7f4c68009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:01.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.430+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4c700606f0 con 0x7f4c78161010 2024-05-10T11:22:01.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:01.633+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4c7815c470 con 0x7f4c78161010 2024-05-10T11:22:02.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.337+0000 7f4c74ff9640 1 -- 172.21.15.66:0/3623882374 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v112) ==== 97+0+0 (secure 0 0 0) 0x7f4c700649f0 con 0x7f4c78161010 2024-05-10T11:22:02.336 INFO:teuthology.orchestra.run.smithi066.stderr: removed all blocklist entries 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.339+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c64076320 msgr2=0x7f4c640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.339+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c64076320 0x7f4c640787e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009b40 tx=0x7f4c68009190 comp rx=0 tx=0).stop 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.339+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 msgr2=0x7f4c78152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.339+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 0x7f4c78152420 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000cb40 tx=0x7f4c7000a060 comp rx=0 tx=0).stop 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 shutdown_connections 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c64076320 0x7f4c640787e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c78161010 0x7f4c78152420 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c7815ce60 0x7f4c7815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 --2- 172.21.15.66:0/3623882374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c780c65f0 0x7f4c7815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 >> 172.21.15.66:0/3623882374 conn(0x7f4c780b2900 msgr2=0x7f4c780cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 shutdown_connections 2024-05-10T11:22:02.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.340+0000 7f4c7e26d640 1 -- 172.21.15.66:0/3623882374 wait complete. 2024-05-10T11:22:02.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T11:22:02.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.465+0000 7fd69a037640 1 Processor -- start 2024-05-10T11:22:02.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.465+0000 7fd69a037640 1 -- start start 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.465+0000 7fd69a037640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd69415f790 0x7fd6940cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd69a037640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6940d30b0 con 0x7fd6940d5d30 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd69a037640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6940d3390 con 0x7fd69415f3b0 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd69a037640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd6940c8c80 con 0x7fd69415f790 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd692ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd69415f790 0x7fd6940cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd693fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd6940d5d30 0x7fd6940d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40248/0 (socket says 172.21.15.66:40248) 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd693fff640 1 -- 172.21.15.66:0/3717617751 learned_addr learned my addr 172.21.15.66:0/3717617751 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd692ffd640 1 -- 172.21.15.66:0/3717617751 >> v1:172.21.15.190:6789/0 conn(0x7fd69415f3b0 legacy=0x7fd6940d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd692ffd640 1 -- 172.21.15.66:0/3717617751 >> v1:172.21.15.66:6789/0 conn(0x7fd6940d5d30 legacy=0x7fd6940d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.466+0000 7fd692ffd640 1 -- 172.21.15.66:0/3717617751 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6940c8f60 con 0x7fd69415f790 2024-05-10T11:22:02.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.467+0000 7fd692ffd640 1 --2- 172.21.15.66:0/3717617751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f790 0x7fd6940cfcd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd6880097a0 tx=0x7fd68802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43288a15a8623633 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:02.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.467+0000 7fd6927fc640 1 -- 172.21.15.66:0/3717617751 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688037070 con 0x7fd69415f790 2024-05-10T11:22:02.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.467+0000 7fd6927fc640 1 -- 172.21.15.66:0/3717617751 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688032440 con 0x7fd69415f790 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.467+0000 7fd6927fc640 1 -- 172.21.15.66:0/3717617751 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688032810 con 0x7fd69415f790 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 -- 172.21.15.66:0/3717617751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f790 msgr2=0x7fd6940cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 --2- 172.21.15.66:0/3717617751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f790 0x7fd6940cfcd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd6880097a0 tx=0x7fd68802a230 comp rx=0 tx=0).stop 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 -- 172.21.15.66:0/3717617751 shutdown_connections 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 --2- 172.21.15.66:0/3717617751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f790 0x7fd6940cfcd0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 -- 172.21.15.66:0/3717617751 >> 172.21.15.66:0/3717617751 conn(0x7fd6940d5130 msgr2=0x7fd6940d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 -- 172.21.15.66:0/3717617751 shutdown_connections 2024-05-10T11:22:02.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.468+0000 7fd69a037640 1 -- 172.21.15.66:0/3717617751 wait complete. 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 Processor -- start 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 -- start start 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6940d5d30 0x7fd69415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 0x7fd6940b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd69415cd40 0x7fd6940b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6940d3f80 con 0x7fd69415f3b0 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd6940d3e00 con 0x7fd6940d5d30 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.470+0000 7fd69a037640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd6940ca770 con 0x7fd69415cd40 2024-05-10T11:22:02.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 0x7fd6940b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 0x7fd6940b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43708/0 (socket says 172.21.15.66:43708) 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 -- 172.21.15.66:0/1740460913 learned_addr learned my addr 172.21.15.66:0/1740460913 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd6937fe640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6940d5d30 0x7fd69415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd693fff640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd69415cd40 0x7fd6940b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 -- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd69415cd40 msgr2=0x7fd6940b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd69415cd40 0x7fd6940b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 -- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6940d5d30 msgr2=0x7fd69415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6940d5d30 0x7fd69415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 -- 172.21.15.66:0/1740460913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6940bac20 con 0x7fd69415f3b0 2024-05-10T11:22:02.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd692ffd640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 0x7fd6940b7d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd6880098c0 tx=0x7fd6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688037040 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688030770 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6940ccef0 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688030b40 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.471+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6940cd4b0 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.472+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6940cd6b0 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.473+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd688044020 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.473+0000 7fd67bfff640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6800762d0 0x7fd680078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.474+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5249+0+0 (secure 0 0 0) 0x7fd6880b78f0 con 0x7fd69415f3b0 2024-05-10T11:22:02.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.474+0000 7fd6937fe640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6800762d0 0x7fd680078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.474+0000 7fd6937fe640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6800762d0 0x7fd680078790 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd684001780 tx=0x7fd684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:02.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.478+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd6940cd6b0 con 0x7fd69415f3b0 2024-05-10T11:22:02.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.740+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd69406a220 con 0x7fd69415f3b0 2024-05-10T11:22:02.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.740+0000 7fd67bfff640 1 -- 172.21.15.66:0/1740460913 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fd688032e20 con 0x7fd69415f3b0 2024-05-10T11:22:02.742 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:02.742 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:02.742 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_dump": [ 2024-05-10T11:22:02.742 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.a", 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mR4fzIBAAqnTq4FGvwD7GLsmfVnj3Ng==", 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:22:02.743 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.b", 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mObreLBAACjISQmfUiCyQ1NsFSbROPA==", 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.744 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.c", 2024-05-10T11:22:02.745 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mkmoZKBAABng7gKe0HEKKEgNTB6uuyg==", 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.747 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.747 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mds.d", 2024-05-10T11:22:02.747 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mjLTwMxAA1a79ywYQ8bznbn+Uh4E4KA==", 2024-05-10T11:22:02.747 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.747 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.747 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.0", 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDpAD5mSaHCGRAAZ+QgNSucr5VKwDZZMdY8Ag==", 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.748 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.1", 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDsAD5mOXM6GBAAq0syLZySZT7gUUI0OXHYJw==", 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.2", 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDvAD5mZ7F+FhAAtW0JUm1pV7hse+A1L+Mlcw==", 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.750 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.3", 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDyAD5mXXimFRAAr1pcPxDhFTIKpLx80rJ7yQ==", 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.4", 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD4AD5m6FFqHRAA4XYEcGYQsjP6UdBhW7xONg==", 2024-05-10T11:22:02.751 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.5", 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD7AD5mN6INHBAA+rXD6qr/H6uzC/zb18SFog==", 2024-05-10T11:22:02.752 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.753 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.753 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.753 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.753 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.753 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.754 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.754 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.6", 2024-05-10T11:22:02.754 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQD+AD5mV5/ZGhAA1KPpMlyQwNAazxEi+3dKfA==", 2024-05-10T11:22:02.754 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.754 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.755 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.755 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.755 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.755 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.755 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.755 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "osd.7", 2024-05-10T11:22:02.756 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQABAT5mxcjPGRAABgfnZThOemueYb9HU0iYXA==", 2024-05-10T11:22:02.756 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.756 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow profile osd", 2024-05-10T11:22:02.756 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile osd", 2024-05-10T11:22:02.756 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.756 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.0", 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A==", 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.757 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow r", 2024-05-10T11:22:02.758 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T11:22:02.758 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.758 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.758 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.758 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.1", 2024-05-10T11:22:02.758 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mUHNUBRAAE40bRkDmHWHOYnEWAJ3ZDg==", 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.759 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.2", 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mQu4eAhAAC5RLmfISJ6SLWSwIqZ9ulQ==", 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.760 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.3", 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDmAD5mP53gChAAyjFI2+wmcnasVf0pTJLipw==", 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow", 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow r", 2024-05-10T11:22:02.761 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow rw", 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow rwx" 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "client.admin", 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mid6sBBAAK/i78Vh79zs+pg2sb7ZC+g==", 2024-05-10T11:22:02.762 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": "allow *", 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow *", 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.763 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.x", 2024-05-10T11:22:02.764 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mORucHRAAiBVsWuT6acDalEAc+XWH0g==", 2024-05-10T11:22:02.764 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.764 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:22:02.764 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:22:02.764 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.764 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: "entity": "mgr.y", 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "AQDlAD5mk2mtGRAAKiMdTwM6lFvTW8gGav/BfA==", 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": { 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": "allow *", 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": "allow profile mgr", 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": "allow *" 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.765 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:02.766 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-10T11:22:02.766 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:02.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6800762d0 msgr2=0x7fd680078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6800762d0 0x7fd680078790 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd684001780 tx=0x7fd684009040 comp rx=0 tx=0).stop 2024-05-10T11:22:02.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 msgr2=0x7fd6940b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 0x7fd6940b7d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd6880098c0 tx=0x7fd6880046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 shutdown_connections 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd6800762d0 0x7fd680078790 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd69415cd40 0x7fd6940b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd69415f3b0 0x7fd6940b7d20 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 --2- 172.21.15.66:0/1740460913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6940d5d30 0x7fd69415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 >> 172.21.15.66:0/1740460913 conn(0x7fd6940d5130 msgr2=0x7fd69406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 shutdown_connections 2024-05-10T11:22:02.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.742+0000 7fd69a037640 1 -- 172.21.15.66:0/1740460913 wait complete. 2024-05-10T11:22:02.770 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T11:22:02.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.875+0000 7f8de88c4640 1 Processor -- start 2024-05-10T11:22:02.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.876+0000 7f8de88c4640 1 -- start start 2024-05-10T11:22:02.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.876+0000 7f8de88c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415f3b0 0x7f8de40d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.876+0000 7f8de88c4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8de40d5d30 0x7f8de40d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.876+0000 7f8de88c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de40d30b0 con 0x7f8de415f790 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.876+0000 7f8de88c4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f8de40d3390 con 0x7f8de40d5d30 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.876+0000 7f8de88c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40c8c80 con 0x7f8de415f3b0 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8de40d5d30 0x7f8de40d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8de40d5d30 0x7f8de40d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43710/0 (socket says 172.21.15.66:43710) 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 -- 172.21.15.66:0/2622469689 learned_addr learned my addr 172.21.15.66:0/2622469689 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:02.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de259c640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415f3b0 0x7f8de40d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 -- 172.21.15.66:0/2622469689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415f3b0 msgr2=0x7f8de40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415f3b0 0x7f8de40d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 -- 172.21.15.66:0/2622469689 >> v1:172.21.15.190:6789/0 conn(0x7f8de415f790 legacy=0x7f8de40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de2d9d640 1 -- 172.21.15.66:0/2622469689 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de40c8f60 con 0x7f8de40d5d30 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.877+0000 7f8de259c640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415f3b0 0x7f8de40d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de2d9d640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40d3c30 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dfb5bdaead45f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:02.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de159a640 1 -- 172.21.15.66:0/2622469689 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc037070 con 0x7f8de40d5d30 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de159a640 1 -- 172.21.15.66:0/2622469689 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ddc032440 con 0x7f8de40d5d30 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de159a640 1 -- 172.21.15.66:0/2622469689 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc032810 con 0x7f8de40d5d30 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de88c4640 1 -- 172.21.15.66:0/2622469689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 msgr2=0x7f8de40d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de88c4640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40d3c30 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc02a270 comp rx=0 tx=0).stop 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de88c4640 1 -- 172.21.15.66:0/2622469689 shutdown_connections 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de88c4640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40d3c30 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de88c4640 1 --2- 172.21.15.66:0/2622469689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415f3b0 0x7f8de40d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.878+0000 7f8de88c4640 1 -- 172.21.15.66:0/2622469689 >> 172.21.15.66:0/2622469689 conn(0x7f8de40d5130 msgr2=0x7f8de40d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.879+0000 7f8de88c4640 1 -- 172.21.15.66:0/2622469689 shutdown_connections 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.879+0000 7f8de88c4640 1 -- 172.21.15.66:0/2622469689 wait complete. 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.880+0000 7f8de88c4640 1 Processor -- start 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.880+0000 7f8de88c4640 1 -- start start 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de88c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de88c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8de415f3b0 0x7f8de4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de88c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415ca60 0x7f8de4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de88c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40d0e60 con 0x7f8de40d5d30 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de88c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40d0ce0 con 0x7f8de415f3b0 2024-05-10T11:22:02.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de88c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40d0fe0 con 0x7f8de415ca60 2024-05-10T11:22:02.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43722/0 (socket says 172.21.15.66:43722) 2024-05-10T11:22:02.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 -- 172.21.15.66:0/3800877810 learned_addr learned my addr 172.21.15.66:0/3800877810 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:02.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 -- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415ca60 msgr2=0x7f8de4156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415ca60 0x7f8de4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 -- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8de415f3b0 msgr2=0x7f8de4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de1d9b640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8de415f3b0 0x7f8de4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8de415f3b0 0x7f8de4157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 -- 172.21.15.66:0/3800877810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de40b21d0 con 0x7f8de40d5d30 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de1d9b640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8de415f3b0 0x7f8de4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:02.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8de259c640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40b1c90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009fc0 tx=0x7f8dd400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:02.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd401a070 con 0x7f8de40d5d30 2024-05-10T11:22:02.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.881+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4003bb0 con 0x7f8de40d5d30 2024-05-10T11:22:02.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.882+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de415d000 con 0x7f8de40d5d30 2024-05-10T11:22:02.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.882+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4004030 con 0x7f8de40d5d30 2024-05-10T11:22:02.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.882+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de415a8c0 con 0x7f8de40d5d30 2024-05-10T11:22:02.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.882+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de415a3d0 con 0x7f8de40d5d30 2024-05-10T11:22:02.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.883+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8dd401d070 con 0x7f8de40d5d30 2024-05-10T11:22:02.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.884+0000 7f8ddaffd640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8dc4076300 0x7f8dc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:02.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.884+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5249+0+0 (secure 0 0 0) 0x7f8dd40976a0 con 0x7f8de40d5d30 2024-05-10T11:22:02.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.884+0000 7f8de1d9b640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8dc4076300 0x7f8dc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:02.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.884+0000 7f8de1d9b640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8dc4076300 0x7f8dc40787c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8de415e5d0 tx=0x7f8dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:02.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:02.888+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8dd4010070 con 0x7f8de40d5d30 2024-05-10T11:22:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.084+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8de406a220 con 0x7f8de40d5d30 2024-05-10T11:22:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.085+0000 7f8ddaffd640 1 -- 172.21.15.66:0/3800877810 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v114) ==== 84+0+65 (secure 0 0 0) 0x7f8dd4097090 con 0x7f8de40d5d30 2024-05-10T11:22:03.084 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:03.085 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-05-10T11:22:03.085 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-05-10T11:22:03.085 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-05-10T11:22:03.085 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-05-10T11:22:03.085 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-10T11:22:03.085 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8dc4076300 msgr2=0x7f8dc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8dc4076300 0x7f8dc40787c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8de415e5d0 tx=0x7f8dcc009040 comp rx=0 tx=0).stop 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 msgr2=0x7f8de40b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40b1c90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009fc0 tx=0x7f8dd400d560 comp rx=0 tx=0).stop 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 shutdown_connections 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8dc4076300 0x7f8dc40787c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8de415ca60 0x7f8de4156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8de415f3b0 0x7f8de4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 --2- 172.21.15.66:0/3800877810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de40d5d30 0x7f8de40b1c90 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 >> 172.21.15.66:0/3800877810 conn(0x7f8de40d5130 msgr2=0x7f8de4075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 shutdown_connections 2024-05-10T11:22:03.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.087+0000 7f8de88c4640 1 -- 172.21.15.66:0/3800877810 wait complete. 2024-05-10T11:22:03.097 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T11:22:03.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T11:22:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.208+0000 7fa05f59e640 1 Processor -- start 2024-05-10T11:22:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.208+0000 7fa05f59e640 1 -- start start 2024-05-10T11:22:03.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05f59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0600b0890 0x7fa0600b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:03.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05f59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa060068110 0x7fa0600b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:03.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05f59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa060074730 con 0x7fa06015d250 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05f59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa060068810 con 0x7fa060068110 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05f59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa06015d630 con 0x7fa0600b0890 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05ed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa060068110 0x7fa0600b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.209+0000 7fa05e59c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa06015d250 0x7fa0600ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:40254/0 (socket says 172.21.15.66:40254) 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05e59c640 1 -- 172.21.15.66:0/4254831234 learned_addr learned my addr 172.21.15.66:0/4254831234 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05dd9b640 1 --2- 172.21.15.66:0/4254831234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0600b0890 0x7fa0600b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05ed9d640 1 -- 172.21.15.66:0/4254831234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0600b0890 msgr2=0x7fa0600b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05ed9d640 1 --2- 172.21.15.66:0/4254831234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0600b0890 0x7fa0600b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05ed9d640 1 -- 172.21.15.66:0/4254831234 >> v1:172.21.15.66:6789/0 conn(0x7fa06015d250 legacy=0x7fa0600ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:03.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05d59a640 1 -- 172.21.15.66:0/4254831234 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459152100 0 0) 0x7fa060074730 con 0x7fa06015d250 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.210+0000 7fa05ed9d640 1 -- 172.21.15.66:0/4254831234 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0600cdeb0 con 0x7fa060068110 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05ed9d640 1 --2- 172.21.15.66:0/4254831234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa060068110 0x7fa0600b65f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fa058009d90 tx=0x7fa05802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d16225c1bfd5edb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05d59a640 1 -- 172.21.15.66:0/4254831234 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058007740 con 0x7fa060068110 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05d59a640 1 -- 172.21.15.66:0/4254831234 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0580078e0 con 0x7fa060068110 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05d59a640 1 -- 172.21.15.66:0/4254831234 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058007cb0 con 0x7fa060068110 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 -- 172.21.15.66:0/4254831234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa060068110 msgr2=0x7fa0600b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:03.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 --2- 172.21.15.66:0/4254831234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa060068110 0x7fa0600b65f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fa058009d90 tx=0x7fa05802a660 comp rx=0 tx=0).stop 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 -- 172.21.15.66:0/4254831234 shutdown_connections 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 --2- 172.21.15.66:0/4254831234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa060068110 0x7fa0600b65f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 --2- 172.21.15.66:0/4254831234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0600b0890 0x7fa0600b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 -- 172.21.15.66:0/4254831234 >> 172.21.15.66:0/4254831234 conn(0x7fa060073a70 msgr2=0x7fa060073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 -- 172.21.15.66:0/4254831234 shutdown_connections 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.211+0000 7fa05f59e640 1 -- 172.21.15.66:0/4254831234 wait complete. 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 Processor -- start 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 -- start start 2024-05-10T11:22:03.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060068110 0x7fa0600cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600b0890 0x7fa0601f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 0x7fa0600c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600b6b30 con 0x7fa06015d250 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600cdc60 con 0x7fa0600b0890 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.213+0000 7fa05f59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa0600b6cb0 con 0x7fa060068110 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 0x7fa0600c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 0x7fa0600c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43734/0 (socket says 172.21.15.66:43734) 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 -- 172.21.15.66:0/2448995234 learned_addr learned my addr 172.21.15.66:0/2448995234 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:03.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05e59c640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060068110 0x7fa0600cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05dd9b640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600b0890 0x7fa0601f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 -- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060068110 msgr2=0x7fa0600cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060068110 0x7fa0600cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 -- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600b0890 msgr2=0x7fa0601f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600b0890 0x7fa0601f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 -- 172.21.15.66:0/2448995234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0600cf670 con 0x7fa06015d250 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05ed9d640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 0x7fa0600c6d10 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fa05802ac50 tx=0x7fa058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058040070 con 0x7fa06015d250 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa058031bc0 con 0x7fa06015d250 2024-05-10T11:22:03.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0600cf950 con 0x7fa06015d250 2024-05-10T11:22:03.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058045460 con 0x7fa06015d250 2024-05-10T11:22:03.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.214+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0600cff10 con 0x7fa06015d250 2024-05-10T11:22:03.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.215+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0600732d0 con 0x7fa06015d250 2024-05-10T11:22:03.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.216+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa058039040 con 0x7fa06015d250 2024-05-10T11:22:03.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.217+0000 7fa04effd640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0400762d0 0x7fa040078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:03.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.217+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5249+0+0 (secure 0 0 0) 0x7fa0580b8db0 con 0x7fa06015d250 2024-05-10T11:22:03.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.217+0000 7fa05e59c640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0400762d0 0x7fa040078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:03.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.217+0000 7fa05e59c640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0400762d0 0x7fa040078790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f60 tx=0x7fa050007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:03.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.221+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa0600732d0 con 0x7fa06015d250 2024-05-10T11:22:03.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:22:03.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:22:03.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:03.414+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa0600693f0 con 0x7fa06015d250 2024-05-10T11:22:04.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.339+0000 7fa04effd640 1 -- 172.21.15.66:0/2448995234 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v115) ==== 138+0+0 (secure 0 0 0) 0x7fa0580828d0 con 0x7fa06015d250 2024-05-10T11:22:04.339 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-05-10T11:22:04.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0400762d0 msgr2=0x7fa040078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:04.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0400762d0 0x7fa040078790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f60 tx=0x7fa050007c00 comp rx=0 tx=0).stop 2024-05-10T11:22:04.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 msgr2=0x7fa0600c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:04.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 0x7fa0600c6d10 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fa05802ac50 tx=0x7fa058004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 shutdown_connections 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa0400762d0 0x7fa040078790 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa06015d250 0x7fa0600c6d10 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600b0890 0x7fa0601f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 --2- 172.21.15.66:0/2448995234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060068110 0x7fa0600cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 >> 172.21.15.66:0/2448995234 conn(0x7fa060073a70 msgr2=0x7fa0600cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 shutdown_connections 2024-05-10T11:22:04.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.343+0000 7fa05f59e640 1 -- 172.21.15.66:0/2448995234 wait complete. 2024-05-10T11:22:04.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T11:22:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.478+0000 7f50d4c54640 1 Processor -- start 2024-05-10T11:22:04.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.478+0000 7f50d4c54640 1 -- start start 2024-05-10T11:22:04.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50d4c54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d00b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:04.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50d4c54640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50d00b4e20 0x7f50d00d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:04.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50d4c54640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d00d4190 con 0x7f50d0162900 2024-05-10T11:22:04.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50d4c54640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f50d00cfc40 con 0x7f50d00b4e20 2024-05-10T11:22:04.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50d4c54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00d3eb0 con 0x7f50d0162ce0 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50d00b4e20 0x7f50d00d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50c5d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d00b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50d00b4e20 0x7f50d00d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:37042/0 (socket says 172.21.15.66:37042) 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ce59c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f50d0162900 0x7f50d00d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:49744/0 (socket says 172.21.15.66:49744) 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50c5d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d00b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:50144/0 (socket says 172.21.15.66:50144) 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 -- 172.21.15.66:0/1337841954 learned_addr learned my addr 172.21.15.66:0/1337841954 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 -- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 msgr2=0x7f50d00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:04.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 --2- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d00b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 -- 172.21.15.66:0/1337841954 >> v1:172.21.15.190:6789/0 conn(0x7f50d0162900 legacy=0x7f50d00d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:04.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50cdd9b640 1 -- 172.21.15.66:0/1337841954 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185818423 0 0) 0x7f50c0001110 con 0x7f50d0162900 2024-05-10T11:22:04.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50ced9d640 1 -- 172.21.15.66:0/1337841954 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00cfee0 con 0x7f50d00b4e20 2024-05-10T11:22:04.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.479+0000 7f50c5d9b640 1 --2- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d00b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.480+0000 7f50ced9d640 1 --2- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d00d09c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009e50 tx=0x7f50c802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331b5246c100d53f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.480+0000 7f50cdd9b640 1 -- 172.21.15.66:0/1337841954 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8036070 con 0x7f50d00b4e20 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.480+0000 7f50cdd9b640 1 -- 172.21.15.66:0/1337841954 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c8031600 con 0x7f50d00b4e20 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.480+0000 7f50cdd9b640 1 -- 172.21.15.66:0/1337841954 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c80319d0 con 0x7f50d00b4e20 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 -- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 msgr2=0x7f50d00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 --2- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d00d09c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009e50 tx=0x7f50c802a680 comp rx=0 tx=0).stop 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 -- 172.21.15.66:0/1337841954 shutdown_connections 2024-05-10T11:22:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 --2- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d00d09c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 --2- 172.21.15.66:0/1337841954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d00b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 -- 172.21.15.66:0/1337841954 >> 172.21.15.66:0/1337841954 conn(0x7f50d009e430 msgr2=0x7f50d00d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 -- 172.21.15.66:0/1337841954 shutdown_connections 2024-05-10T11:22:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.481+0000 7f50d4c54640 1 -- 172.21.15.66:0/1337841954 wait complete. 2024-05-10T11:22:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 Processor -- start 2024-05-10T11:22:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 -- start start 2024-05-10T11:22:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d0153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 0x7f50d01f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d0160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00b4180 con 0x7f50d0162900 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00d3b20 con 0x7f50d00b4e20 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.483+0000 7f50d4c54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00b4300 con 0x7f50d0162ce0 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 0x7f50d01f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 0x7f50d01f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43736/0 (socket says 172.21.15.66:43736) 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 -- 172.21.15.66:0/305263950 learned_addr learned my addr 172.21.15.66:0/305263950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50ce59c640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d0153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50ced9d640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d0160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 -- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 msgr2=0x7f50d0160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d0160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 -- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 msgr2=0x7f50d0153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d0153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 -- 172.21.15.66:0/305263950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00cb890 con 0x7f50d0162900 2024-05-10T11:22:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50ce59c640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:04.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c5d9b640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 0x7f50d01f54f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f50b800ebe0 tx=0x7f50b800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:04.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8017070 con 0x7f50d0162900 2024-05-10T11:22:04.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b800cc30 con 0x7f50d0162900 2024-05-10T11:22:04.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d00cbb30 con 0x7f50d0162900 2024-05-10T11:22:04.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8013470 con 0x7f50d0162900 2024-05-10T11:22:04.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.484+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d00b9a20 con 0x7f50d0162900 2024-05-10T11:22:04.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.486+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d00b9830 con 0x7f50d0162900 2024-05-10T11:22:04.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.486+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50b801a070 con 0x7f50d0162900 2024-05-10T11:22:04.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.487+0000 7f50c77fe640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50b00762d0 0x7f50b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:04.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.487+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5619+0+0 (secure 0 0 0) 0x7f50b80974f0 con 0x7f50d0162900 2024-05-10T11:22:04.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.487+0000 7f50ce59c640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50b00762d0 0x7f50b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:04.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.488+0000 7f50ce59c640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50b00762d0 0x7f50b0078790 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f50c0000f60 tx=0x7f50c0007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:04.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.491+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f50b8060ea0 con 0x7f50d0162900 2024-05-10T11:22:04.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:04.682+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f50d006a220 con 0x7f50d0162900 2024-05-10T11:22:05.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.342+0000 7f50c77fe640 1 -- 172.21.15.66:0/305263950 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v116) ==== 170+0+0 (secure 0 0 0) 0x7f50b80607a0 con 0x7f50d0162900 2024-05-10T11:22:05.341 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50b00762d0 msgr2=0x7f50b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50b00762d0 0x7f50b0078790 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f50c0000f60 tx=0x7f50c0007ca0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 msgr2=0x7f50d01f54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 0x7f50d01f54f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f50b800ebe0 tx=0x7f50b800c520 comp rx=0 tx=0).stop 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 shutdown_connections 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f50b00762d0 0x7f50b0078790 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50d0162ce0 0x7f50d0160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50d0162900 0x7f50d01f54f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 --2- 172.21.15.66:0/305263950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d00b4e20 0x7f50d0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 >> 172.21.15.66:0/305263950 conn(0x7f50d009e430 msgr2=0x7f50d0161450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 shutdown_connections 2024-05-10T11:22:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.345+0000 7f50d4c54640 1 -- 172.21.15.66:0/305263950 wait complete. 2024-05-10T11:22:05.373 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T11:22:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.486+0000 7f4684647640 1 Processor -- start 2024-05-10T11:22:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.486+0000 7f4684647640 1 -- start start 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4684647640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cffd0 0x7f467c0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4684647640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c06e720 con 0x7f467c0cd500 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4684647640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c06de80 con 0x7f467c0cf3e0 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4684647640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f467c06e160 con 0x7f467c0cffd0 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4682be4640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f467c0cd500 0x7f467c0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34900/0 (socket says 172.21.15.66:34900) 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4682be4640 1 -- 172.21.15.66:0/3142660298 learned_addr learned my addr 172.21.15.66:0/3142660298 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f4681be2640 1 --2- 172.21.15.66:0/3142660298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cffd0 0x7f467c0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2667232005 0 0) 0x7f467c06e720 con 0x7f467c0cd500 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4668003520 con 0x7f467c0cd500 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970868049 0 0) 0x7f467c06de80 con 0x7f467c0cf3e0 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.487+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f467c06e720 con 0x7f467c0cf3e0 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.488+0000 7f4681be2640 1 -- 172.21.15.66:0/3142660298 >> v1:172.21.15.190:6789/0 conn(0x7f467c0cf3e0 legacy=0x7f467c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.488+0000 7f4681be2640 1 -- 172.21.15.66:0/3142660298 >> v1:172.21.15.66:6789/0 conn(0x7f467c0cd500 legacy=0x7f467c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.488+0000 7f4681be2640 1 -- 172.21.15.66:0/3142660298 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c06e440 con 0x7f467c0cffd0 2024-05-10T11:22:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.488+0000 7f4681be2640 1 --2- 172.21.15.66:0/3142660298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cffd0 0x7f467c0b3de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097d0 tx=0x7f466c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6728616e7b896780 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c037070 con 0x7f467c0cffd0 2024-05-10T11:22:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466c032440 con 0x7f467c0cffd0 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f46813e1640 1 -- 172.21.15.66:0/3142660298 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c032810 con 0x7f467c0cffd0 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 -- 172.21.15.66:0/3142660298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cffd0 msgr2=0x7f467c0b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 --2- 172.21.15.66:0/3142660298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cffd0 0x7f467c0b3de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097d0 tx=0x7f466c02a210 comp rx=0 tx=0).stop 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 -- 172.21.15.66:0/3142660298 shutdown_connections 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 --2- 172.21.15.66:0/3142660298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cffd0 0x7f467c0b3de0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 -- 172.21.15.66:0/3142660298 >> 172.21.15.66:0/3142660298 conn(0x7f467c0d2eb0 msgr2=0x7f467c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 -- 172.21.15.66:0/3142660298 shutdown_connections 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.489+0000 7f4684647640 1 -- 172.21.15.66:0/3142660298 wait complete. 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.490+0000 7f4684647640 1 Processor -- start 2024-05-10T11:22:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.490+0000 7f4684647640 1 -- start start 2024-05-10T11:22:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4684647640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cd500 0x7f467c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4684647640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467c0cf3e0 0x7f467c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4684647640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 0x7f467c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4684647640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0d1890 con 0x7f467c0cffd0 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4684647640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0b4510 con 0x7f467c0cf3e0 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4684647640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f467c0d1a10 con 0x7f467c0cd500 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4682be4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 0x7f467c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4682be4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 0x7f467c0b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48544/0 (socket says 172.21.15.66:48544) 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f4682be4640 1 -- 172.21.15.66:0/1520784774 learned_addr learned my addr 172.21.15.66:0/1520784774 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.491+0000 7f46823e3640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cd500 0x7f467c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4681be2640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467c0cf3e0 0x7f467c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4682be4640 1 -- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cd500 msgr2=0x7f467c0c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4682be4640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cd500 0x7f467c0c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4682be4640 1 -- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467c0cf3e0 msgr2=0x7f467c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4682be4640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467c0cf3e0 0x7f467c156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4682be4640 1 -- 172.21.15.66:0/1520784774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c1567c0 con 0x7f467c0cffd0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f46823e3640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cd500 0x7f467c0c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4682be4640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 0x7f467c0b03d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f467400cba0 tx=0x7f467400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674017070 con 0x7f467c0cffd0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467400ace0 con 0x7f467c0cffd0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674012620 con 0x7f467c0cffd0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c09cec0 con 0x7f467c0cffd0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.492+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c0c73c0 con 0x7f467c0cffd0 2024-05-10T11:22:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.493+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467c06a220 con 0x7f467c0cffd0 2024-05-10T11:22:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.494+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f467401a070 con 0x7f467c0cffd0 2024-05-10T11:22:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.494+0000 7f4672ffd640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46600762d0 0x7f4660078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.494+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6001+0+0 (secure 0 0 0) 0x7f4674097500 con 0x7f467c0cffd0 2024-05-10T11:22:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.495+0000 7f46823e3640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46600762d0 0x7f4660078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.495+0000 7f46823e3640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46600762d0 0x7f4660078790 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4678001710 tx=0x7f4678009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:05.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.499+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4674060650 con 0x7f467c0cffd0 2024-05-10T11:22:05.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:05.730+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f467c0b39a0 con 0x7f467c0cffd0 2024-05-10T11:22:06.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.362+0000 7f4672ffd640 1 -- 172.21.15.66:0/1520784774 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v96) ==== 174+0+0 (secure 0 0 0) 0x7f4674064950 con 0x7f467c0cffd0 2024-05-10T11:22:06.362 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 17 and data pool 18 2024-05-10T11:22:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.368+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46600762d0 msgr2=0x7f4660078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.368+0000 7f4684647640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46600762d0 0x7f4660078790 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4678001710 tx=0x7f4678009040 comp rx=0 tx=0).stop 2024-05-10T11:22:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.368+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 msgr2=0x7f467c0b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.368+0000 7f4684647640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 0x7f467c0b03d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f467400cba0 tx=0x7f467400a430 comp rx=0 tx=0).stop 2024-05-10T11:22:06.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.370+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 shutdown_connections 2024-05-10T11:22:06.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.370+0000 7f4684647640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46600762d0 0x7f4660078790 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.370+0000 7f4684647640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f467c0cffd0 0x7f467c0b03d0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.370+0000 7f4684647640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467c0cf3e0 0x7f467c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.370+0000 7f4684647640 1 --2- 172.21.15.66:0/1520784774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467c0cd500 0x7f467c0c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.370+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 >> 172.21.15.66:0/1520784774 conn(0x7f467c0d2eb0 msgr2=0x7f467c0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:06.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.373+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 shutdown_connections 2024-05-10T11:22:06.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.374+0000 7f4684647640 1 -- 172.21.15.66:0/1520784774 wait complete. 2024-05-10T11:22:06.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:22:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.500+0000 7f7b56e08640 1 Processor -- start 2024-05-10T11:22:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.500+0000 7f7b56e08640 1 -- start start 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b56e08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 0x7f7b500ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b56e08640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b50163bc0 con 0x7f7b500cad80 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b56e08640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b50160240 con 0x7f7b5006fa60 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b56e08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7b500cb1d0 con 0x7f7b50163730 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b553a5640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7b500cad80 0x7f7b5006c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34908/0 (socket says 172.21.15.66:34908) 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b553a5640 1 -- 172.21.15.66:0/709332526 learned_addr learned my addr 172.21.15.66:0/709332526 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807115520 0 0) 0x7f7b50163bc0 con 0x7f7b500cad80 2024-05-10T11:22:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b47fff640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 0x7f7b500ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b38003520 con 0x7f7b500cad80 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1748542376 0 0) 0x7f7b38003520 con 0x7f7b500cad80 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 msgr2=0x7f7b500ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 0x7f7b500ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 >> v1:172.21.15.190:6789/0 conn(0x7f7b5006fa60 legacy=0x7f7b5015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b50160520 con 0x7f7b500cad80 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f7b480019f0 con 0x7f7b500cad80 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 >> v1:172.21.15.66:6789/0 conn(0x7f7b500cad80 legacy=0x7f7b5006c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.501+0000 7f7b477fe640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b380039e0 0x7f7b38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b477fe640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 0x7f7b38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b477fe640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b38004d40 0x7f7b380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b500cb1d0 con 0x7f7b380039e0 2024-05-10T11:22:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3800baa0 con 0x7f7b38004d40 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3800bca0 con 0x7f7b50163730 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b380039e0 0x7f7b38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b47fff640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 0x7f7b38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b553a5640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b38004d40 0x7f7b380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b54ba4640 1 -- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 msgr2=0x7f7b38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b50163730 0x7f7b38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b54ba4640 1 -- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b38004d40 msgr2=0x7f7b380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b38004d40 0x7f7b380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.502+0000 7f7b54ba4640 1 -- 172.21.15.66:0/709332526 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b38003520 con 0x7f7b380039e0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b380039e0 0x7f7b38003dc0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c001860 tx=0x7f7b38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e6c1e989ef342c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c037070 con 0x7f7b380039e0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c02ac30 con 0x7f7b380039e0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b477fe640 1 -- 172.21.15.66:0/709332526 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c001430 con 0x7f7b380039e0 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b56e08640 1 -- 172.21.15.66:0/709332526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b380039e0 msgr2=0x7f7b38003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b56e08640 1 --2- 172.21.15.66:0/709332526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b380039e0 0x7f7b38003dc0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c001860 tx=0x7f7b38005830 comp rx=0 tx=0).stop 2024-05-10T11:22:06.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b553a5640 1 -- 172.21.15.66:0/709332526 reap_dead start 2024-05-10T11:22:06.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b56e08640 1 -- 172.21.15.66:0/709332526 shutdown_connections 2024-05-10T11:22:06.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b56e08640 1 -- 172.21.15.66:0/709332526 >> 172.21.15.66:0/709332526 conn(0x7f7b500d1510 msgr2=0x7f7b500d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:06.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b56e08640 1 -- 172.21.15.66:0/709332526 shutdown_connections 2024-05-10T11:22:06.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.503+0000 7f7b56e08640 1 -- 172.21.15.66:0/709332526 wait complete. 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.505+0000 7f7b56e08640 1 Processor -- start 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.505+0000 7f7b56e08640 1 -- start start 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.505+0000 7f7b56e08640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b380039e0 0x7f7b500acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.505+0000 7f7b56e08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b501f2570 0x7f7b501f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.505+0000 7f7b56e08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 0x7f7b5006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.505+0000 7f7b56e08640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5006eae0 con 0x7f7b501f89b0 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b56e08640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50163210 con 0x7f7b380039e0 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b56e08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5015fe40 con 0x7f7b501f2570 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 0x7f7b5006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 0x7f7b5006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48576/0 (socket says 172.21.15.66:48576) 2024-05-10T11:22:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 -- 172.21.15.66:0/3258950221 learned_addr learned my addr 172.21.15.66:0/3258950221 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b47fff640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b501f2570 0x7f7b501f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b380039e0 0x7f7b500acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 -- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b501f2570 msgr2=0x7f7b501f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b501f2570 0x7f7b501f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 -- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b380039e0 msgr2=0x7f7b500acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b380039e0 0x7f7b500acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 -- 172.21.15.66:0/3258950221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b501f8e50 con 0x7f7b501f89b0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b553a5640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 0x7f7b5006c7c0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f7b5015d300 tx=0x7f7b48007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48017020 con 0x7f7b501f89b0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4800ab80 con 0x7f7b501f89b0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b501f9130 con 0x7f7b501f89b0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b480133f0 con 0x7f7b501f89b0 2024-05-10T11:22:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.506+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b500ac9e0 con 0x7f7b501f89b0 2024-05-10T11:22:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.508+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5006a220 con 0x7f7b501f89b0 2024-05-10T11:22:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.508+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b4801a020 con 0x7f7b501f89b0 2024-05-10T11:22:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.509+0000 7f7b457fa640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.509+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f7b48097dc0 con 0x7f7b501f89b0 2024-05-10T11:22:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.509+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.509+0000 7f7b54ba4640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034000 tx=0x7f7b4c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:06.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.513+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7b48021020 con 0x7f7b501f89b0 2024-05-10T11:22:06.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.706+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b500b27a0 con 0x7f7b501f89b0 2024-05-10T11:22:06.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.708+0000 7f7b457fa640 1 -- 172.21.15.66:0/3258950221 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16965 (secure 0 0 0) 0x7f7b48061620 con 0x7f7b501f89b0 2024-05-10T11:22:06.707 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:06.707 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":117,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:22:05.730989+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:22:03.418261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T11:22:04.686944+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:22:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 msgr2=0x7f7b3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034000 tx=0x7f7b4c009030 comp rx=0 tx=0).stop 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 msgr2=0x7f7b5006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 0x7f7b5006c7c0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f7b5015d300 tx=0x7f7b48007a40 comp rx=0 tx=0).stop 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 shutdown_connections 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7b3c0762d0 0x7f7b3c078790 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b501f89b0 0x7f7b5006c7c0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b501f2570 0x7f7b501f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 --2- 172.21.15.66:0/3258950221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b380039e0 0x7f7b500acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 >> 172.21.15.66:0/3258950221 conn(0x7f7b500d1510 msgr2=0x7f7b5015dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 shutdown_connections 2024-05-10T11:22:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.710+0000 7f7b56e08640 1 -- 172.21.15.66:0/3258950221 wait complete. 2024-05-10T11:22:06.721 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:22:06.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.826+0000 7fc0a2df9640 1 Processor -- start 2024-05-10T11:22:06.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.826+0000 7fc0a2df9640 1 -- start start 2024-05-10T11:22:06.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a2df9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc09c162750 0x7fc09c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a2df9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc09c162b30 0x7fc09c0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a2df9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09c0b45f0 con 0x7fc09c0d5cb0 2024-05-10T11:22:06.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a2df9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc09c0b4f20 con 0x7fc09c162b30 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a2df9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc09c0d0fe0 con 0x7fc09c162750 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc09c162b30 0x7fc09c0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc09c162b30 0x7fc09c0b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48586/0 (socket says 172.21.15.66:48586) 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 -- 172.21.15.66:0/989984824 learned_addr learned my addr 172.21.15.66:0/989984824 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a0b95640 1 --2- 172.21.15.66:0/989984824 >> v2:172.21.15.190:3300/0 conn(0x7fc09c162750 0x7fc09c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 -- 172.21.15.66:0/989984824 >> v2:172.21.15.190:3300/0 conn(0x7fc09c162750 msgr2=0x7fc09c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 --2- 172.21.15.66:0/989984824 >> v2:172.21.15.190:3300/0 conn(0x7fc09c162750 0x7fc09c0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 -- 172.21.15.66:0/989984824 >> v1:172.21.15.190:6789/0 conn(0x7fc09c0d5cb0 legacy=0x7fc09c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.827+0000 7fc0a1396640 1 -- 172.21.15.66:0/989984824 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c0b48d0 con 0x7fc09c162b30 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.828+0000 7fc0a1396640 1 --2- 172.21.15.66:0/989984824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0b53b0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0b7c40 tx=0x7fc09402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd538c65bb023b00 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.828+0000 7fc09b7fe640 1 -- 172.21.15.66:0/989984824 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094036070 con 0x7fc09c162b30 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.828+0000 7fc09b7fe640 1 -- 172.21.15.66:0/989984824 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc094031600 con 0x7fc09c162b30 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.828+0000 7fc09b7fe640 1 -- 172.21.15.66:0/989984824 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0940319d0 con 0x7fc09c162b30 2024-05-10T11:22:06.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 -- 172.21.15.66:0/989984824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 msgr2=0x7fc09c0b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/989984824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0b53b0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0b7c40 tx=0x7fc09402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 -- 172.21.15.66:0/989984824 shutdown_connections 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/989984824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0b53b0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/989984824 >> v2:172.21.15.190:3300/0 conn(0x7fc09c162750 0x7fc09c0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 -- 172.21.15.66:0/989984824 >> 172.21.15.66:0/989984824 conn(0x7fc09c09e3b0 msgr2=0x7fc09c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 -- 172.21.15.66:0/989984824 shutdown_connections 2024-05-10T11:22:06.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.829+0000 7fc0a2df9640 1 -- 172.21.15.66:0/989984824 wait complete. 2024-05-10T11:22:06.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.830+0000 7fc0a2df9640 1 Processor -- start 2024-05-10T11:22:06.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.830+0000 7fc0a2df9640 1 -- start start 2024-05-10T11:22:06.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a2df9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc09c162750 0x7fc09c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a2df9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a2df9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc09c154f30 0x7fc09c0ba070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a2df9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c0d0d30 con 0x7fc09c162b30 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a2df9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c0d0bb0 con 0x7fc09c162750 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a2df9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc09c0d3d40 con 0x7fc09c154f30 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0a27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48602/0 (socket says 172.21.15.66:48602) 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 -- 172.21.15.66:0/3644103857 learned_addr learned my addr 172.21.15.66:0/3644103857 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a0b95640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc09c162750 0x7fc09c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a1396640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc09c154f30 0x7fc09c0ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 -- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc09c154f30 msgr2=0x7fc09c0ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc09c154f30 0x7fc09c0ba070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 -- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc09c162750 msgr2=0x7fc09c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:06.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc09c162750 0x7fc09c1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc09bfff640 1 -- 172.21.15.66:0/3644103857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c0ce5e0 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.831+0000 7fc0a1396640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc09c154f30 0x7fc09c0ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.832+0000 7fc09bfff640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0a27a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c3d0 tx=0x7fc09000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.832+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0900052d0 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.832+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc090005490 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.832+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09c09edc0 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.832+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090007260 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.832+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09c09f380 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.833+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09c06a220 con 0x7fc09c162b30 2024-05-10T11:22:06.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.833+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc090007400 con 0x7fc09c162b30 2024-05-10T11:22:06.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.834+0000 7fc0997fa640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0880762d0 0x7fc088078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:06.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.834+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fc090096ba0 con 0x7fc09c162b30 2024-05-10T11:22:06.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.834+0000 7fc0a0b95640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0880762d0 0x7fc088078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:06.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.835+0000 7fc0a0b95640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0880762d0 0x7fc088078790 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc08c006fd0 tx=0x7fc08c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:06.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:06.838+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc09005fd20 con 0x7fc09c162b30 2024-05-10T11:22:07.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.034+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc09c0b6420 con 0x7fc09c162b30 2024-05-10T11:22:07.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.035+0000 7fc0997fa640 1 -- 172.21.15.66:0/3644103857 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16965 (secure 0 0 0) 0x7fc090066030 con 0x7fc09c162b30 2024-05-10T11:22:07.034 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:07.034 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":117,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:22:05.730989+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:22:03.418261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T11:22:04.686944+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0880762d0 msgr2=0x7fc088078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0880762d0 0x7fc088078790 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc08c006fd0 tx=0x7fc08c008040 comp rx=0 tx=0).stop 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 msgr2=0x7fc09c0a27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0a27a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c3d0 tx=0x7fc09000c890 comp rx=0 tx=0).stop 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 shutdown_connections 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc0880762d0 0x7fc088078790 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc09c154f30 0x7fc09c0ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc09c162b30 0x7fc09c0a27a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 --2- 172.21.15.66:0/3644103857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc09c162750 0x7fc09c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 >> 172.21.15.66:0/3644103857 conn(0x7fc09c09e3b0 msgr2=0x7fc09c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 shutdown_connections 2024-05-10T11:22:07.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.037+0000 7fc0a2df9640 1 -- 172.21.15.66:0/3644103857 wait complete. 2024-05-10T11:22:07.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T11:22:07.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.157+0000 7f63258c5640 1 Processor -- start 2024-05-10T11:22:07.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.157+0000 7f63258c5640 1 -- start start 2024-05-10T11:22:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f63258c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f63200b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f63258c5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 0x7f632015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f63258c5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6320163a20 con 0x7f63200b1390 2024-05-10T11:22:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f63258c5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f63200b11f0 con 0x7f632006c9d0 2024-05-10T11:22:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f63258c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f63200b6b80 con 0x7f632015f190 2024-05-10T11:22:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f631f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 0x7f632015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f631effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f63200b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f631e7fc640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f63200b1390 0x7f632006c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:38970/0 (socket says 172.21.15.66:38970) 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f631effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f63200b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:48360/0 (socket says 172.21.15.66:48360) 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f631e7fc640 1 -- 172.21.15.66:0/2887937788 learned_addr learned my addr 172.21.15.66:0/2887937788 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.158+0000 7f631f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 0x7f632015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:35530/0 (socket says 172.21.15.66:35530) 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631dffb640 1 -- 172.21.15.66:0/2887937788 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424260799 0 0) 0x7f6320163a20 con 0x7f63200b1390 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631dffb640 1 -- 172.21.15.66:0/2887937788 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f630c003520 con 0x7f63200b1390 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631effd640 1 -- 172.21.15.66:0/2887937788 >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 msgr2=0x7f632015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631effd640 1 --2- 172.21.15.66:0/2887937788 >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 0x7f632015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631effd640 1 -- 172.21.15.66:0/2887937788 >> v1:172.21.15.190:6789/0 conn(0x7f63200b1390 legacy=0x7f632006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631effd640 1 -- 172.21.15.66:0/2887937788 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63200b6e60 con 0x7f632015f190 2024-05-10T11:22:07.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.159+0000 7f631f7fe640 1 --2- 172.21.15.66:0/2887937788 >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 0x7f632015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f631effd640 1 --2- 172.21.15.66:0/2887937788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f63200b0cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6318009d90 tx=0x7f631802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da3570e0ec39345b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f631dffb640 1 -- 172.21.15.66:0/2887937788 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318031600 con 0x7f632015f190 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f631dffb640 1 -- 172.21.15.66:0/2887937788 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180317a0 con 0x7f632015f190 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f631dffb640 1 -- 172.21.15.66:0/2887937788 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318031b70 con 0x7f632015f190 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 -- 172.21.15.66:0/2887937788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 msgr2=0x7f63200b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 --2- 172.21.15.66:0/2887937788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f63200b0cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6318009d90 tx=0x7f631802a5d0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 -- 172.21.15.66:0/2887937788 shutdown_connections 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 --2- 172.21.15.66:0/2887937788 >> v2:172.21.15.190:3300/0 conn(0x7f632006c9d0 0x7f632015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 --2- 172.21.15.66:0/2887937788 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f63200b0cb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 -- 172.21.15.66:0/2887937788 >> 172.21.15.66:0/2887937788 conn(0x7f63200d1ed0 msgr2=0x7f63200d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 -- 172.21.15.66:0/2887937788 shutdown_connections 2024-05-10T11:22:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.160+0000 7f63258c5640 1 -- 172.21.15.66:0/2887937788 wait complete. 2024-05-10T11:22:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.162+0000 7f63258c5640 1 Processor -- start 2024-05-10T11:22:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.162+0000 7f63258c5640 1 -- start start 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f632006c9d0 0x7f6320157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 0x7f63200d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f632015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63200b52e0 con 0x7f63200b1390 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f63200b5160 con 0x7f632006c9d0 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f63200b5460 con 0x7f632015f190 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 0x7f63200d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 0x7f63200d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48614/0 (socket says 172.21.15.66:48614) 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 -- 172.21.15.66:0/3155282741 learned_addr learned my addr 172.21.15.66:0/3155282741 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631f7fe640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f632015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631effd640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f632006c9d0 0x7f6320157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 -- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 msgr2=0x7f632015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f632015c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 -- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f632006c9d0 msgr2=0x7f6320157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f632006c9d0 0x7f6320157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 -- 172.21.15.66:0/3155282741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63200d0cd0 con 0x7f63200b1390 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f631e7fc640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 0x7f63200d0330 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f630800c430 tx=0x7f630800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308017070 con 0x7f63200b1390 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6308005ce0 con 0x7f63200b1390 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63200cdf90 con 0x7f63200b1390 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.163+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080072f0 con 0x7f63200b1390 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.164+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63200ce550 con 0x7f63200b1390 2024-05-10T11:22:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.164+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63200693f0 con 0x7f63200b1390 2024-05-10T11:22:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.165+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f630801a070 con 0x7f63200b1390 2024-05-10T11:22:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.166+0000 7f6317fff640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63000762d0 0x7f6300078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.166+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f6308096c10 con 0x7f63200b1390 2024-05-10T11:22:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.166+0000 7f631effd640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63000762d0 0x7f6300078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.167+0000 7f631effd640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63000762d0 0x7f6300078790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6318034000 tx=0x7f6318033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:07.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.170+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f63080603f0 con 0x7f63200b1390 2024-05-10T11:22:07.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:07.402+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f63200ce9e0 con 0x7f63200b1390 2024-05-10T11:22:08.341 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-05-10T11:22:08.342+0000 7f692edf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:22:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.376+0000 7f6317fff640 1 -- 172.21.15.66:0/3155282741 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v98) ==== 118+0+0 (secure 0 0 0) 0x7f630805fcf0 con 0x7f63200b1390 2024-05-10T11:22:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63000762d0 msgr2=0x7f6300078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63000762d0 0x7f6300078790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6318034000 tx=0x7f6318033040 comp rx=0 tx=0).stop 2024-05-10T11:22:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 msgr2=0x7f63200d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 0x7f63200d0330 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f630800c430 tx=0x7f630800c8f0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 shutdown_connections 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f63000762d0 0x7f6300078790 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f632015f190 0x7f632015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63200b1390 0x7f63200d0330 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 --2- 172.21.15.66:0/3155282741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f632006c9d0 0x7f6320157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 >> 172.21.15.66:0/3155282741 conn(0x7f63200d1ed0 msgr2=0x7f632006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 shutdown_connections 2024-05-10T11:22:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.379+0000 7f63258c5640 1 -- 172.21.15.66:0/3155282741 wait complete. 2024-05-10T11:22:08.392 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T11:22:08.392 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T11:22:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.506+0000 7ff522724640 1 Processor -- start 2024-05-10T11:22:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.506+0000 7ff522724640 1 -- start start 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff522724640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff522724640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff51c06c6a0 0x7ff51c0739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff522724640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff51c073f20 0x7ff51c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff522724640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7ff51c161990 con 0x7ff51c06c6a0 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff522724640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff51c157a40 con 0x7ff51c073f20 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff522724640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c160d80 con 0x7ff51c06c2c0 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff51b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff51c06c6a0 0x7ff51c0739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff51b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff51c06c6a0 0x7ff51c0739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48630/0 (socket says 172.21.15.66:48630) 2024-05-10T11:22:08.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff51b7fe640 1 -- 172.21.15.66:0/1610730685 learned_addr learned my addr 172.21.15.66:0/1610730685 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff51bfff640 1 --2- 172.21.15.66:0/1610730685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.507+0000 7ff520cc1640 1 --2- 172.21.15.66:0/1610730685 >> v2:172.21.15.190:3300/0 conn(0x7ff51c073f20 0x7ff51c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51b7fe640 1 -- 172.21.15.66:0/1610730685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 msgr2=0x7ff51c06df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51b7fe640 1 --2- 172.21.15.66:0/1610730685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c06df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51b7fe640 1 -- 172.21.15.66:0/1610730685 >> v2:172.21.15.190:3300/0 conn(0x7ff51c073f20 msgr2=0x7ff51c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51b7fe640 1 --2- 172.21.15.66:0/1610730685 >> v2:172.21.15.190:3300/0 conn(0x7ff51c073f20 0x7ff51c15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51b7fe640 1 -- 172.21.15.66:0/1610730685 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c161060 con 0x7ff51c06c6a0 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51b7fe640 1 --2- 172.21.15.66:0/1610730685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c0739e0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0b3840 tx=0x7ff51002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670c0291eecb2626 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51affd640 1 -- 172.21.15.66:0/1610730685 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510037070 con 0x7ff51c06c6a0 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.508+0000 7ff51affd640 1 -- 172.21.15.66:0/1610730685 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510032440 con 0x7ff51c06c6a0 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff51affd640 1 -- 172.21.15.66:0/1610730685 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510032810 con 0x7ff51c06c6a0 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 -- 172.21.15.66:0/1610730685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 msgr2=0x7ff51c0739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 --2- 172.21.15.66:0/1610730685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c0739e0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0b3840 tx=0x7ff51002a1e0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 -- 172.21.15.66:0/1610730685 shutdown_connections 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 --2- 172.21.15.66:0/1610730685 >> v2:172.21.15.190:3300/0 conn(0x7ff51c073f20 0x7ff51c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 --2- 172.21.15.66:0/1610730685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c0739e0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 --2- 172.21.15.66:0/1610730685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c06df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 -- 172.21.15.66:0/1610730685 >> 172.21.15.66:0/1610730685 conn(0x7ff51c0d0c90 msgr2=0x7ff51c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 -- 172.21.15.66:0/1610730685 shutdown_connections 2024-05-10T11:22:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.509+0000 7ff522724640 1 -- 172.21.15.66:0/1610730685 wait complete. 2024-05-10T11:22:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.510+0000 7ff522724640 1 Processor -- start 2024-05-10T11:22:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 -- start start 2024-05-10T11:22:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff51c073f20 0x7ff51c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c0cd440 con 0x7ff51c06c6a0 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c161620 con 0x7ff51c073f20 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff522724640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c06cb20 con 0x7ff51c06c2c0 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48644/0 (socket says 172.21.15.66:48644) 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.511+0000 7ff51b7fe640 1 -- 172.21.15.66:0/4074191014 learned_addr learned my addr 172.21.15.66:0/4074191014 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51bfff640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff520cc1640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff51c073f20 0x7ff51c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51b7fe640 1 -- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 msgr2=0x7ff51c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51b7fe640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51b7fe640 1 -- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff51c073f20 msgr2=0x7ff51c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51b7fe640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff51c073f20 0x7ff51c154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51b7fe640 1 -- 172.21.15.66:0/4074191014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c0c5fe0 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff51b7fe640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c1545c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff51002a220 tx=0x7ff5100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510041020 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5100306c0 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c15c160 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510037040 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.512+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c15c720 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.513+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c06a220 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.514+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff510044020 con 0x7ff51c06c6a0 2024-05-10T11:22:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.514+0000 7ff518ff9640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5080762d0 0x7ff508078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.514+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7ff5100b7ef0 con 0x7ff51c06c6a0 2024-05-10T11:22:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.515+0000 7ff51bfff640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5080762d0 0x7ff508078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.515+0000 7ff51bfff640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5080762d0 0x7ff508078790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006fd0 tx=0x7ff50c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.519+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff51004b030 con 0x7ff51c06c6a0 2024-05-10T11:22:08.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:08.748+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff51c06f510 con 0x7ff51c06c6a0 2024-05-10T11:22:09.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.377+0000 7ff518ff9640 1 -- 172.21.15.66:0/4074191014 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v99) ==== 122+0+0 (secure 0 0 0) 0x7ff510081750 con 0x7ff51c06c6a0 2024-05-10T11:22:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5080762d0 msgr2=0x7ff508078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5080762d0 0x7ff508078790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006fd0 tx=0x7ff50c008040 comp rx=0 tx=0).stop 2024-05-10T11:22:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 msgr2=0x7ff51c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c1545c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff51002a220 tx=0x7ff5100046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 shutdown_connections 2024-05-10T11:22:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7ff5080762d0 0x7ff508078790 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff51c073f20 0x7ff51c154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51c06c6a0 0x7ff51c1545c0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 --2- 172.21.15.66:0/4074191014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff51c06c2c0 0x7ff51c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.379+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 >> 172.21.15.66:0/4074191014 conn(0x7ff51c0d0c90 msgr2=0x7ff51c0b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.380+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 shutdown_connections 2024-05-10T11:22:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.380+0000 7ff522724640 1 -- 172.21.15.66:0/4074191014 wait complete. 2024-05-10T11:22:09.391 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T11:22:09.392 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:09.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.500+0000 7f64aede4640 1 Processor -- start 2024-05-10T11:22:09.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.500+0000 7f64aede4640 1 -- start start 2024-05-10T11:22:09.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64aede4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64a80d5cb0 0x7f64a80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64aede4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80b45f0 con 0x7f64a8162b30 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64aede4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80b48d0 con 0x7f64a8162750 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64aede4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f64a80b4f20 con 0x7f64a80d5cb0 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64ad381640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f64a8162b30 0x7f64a80b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34918/0 (socket says 172.21.15.66:34918) 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64ad381640 1 -- 172.21.15.66:0/399968727 learned_addr learned my addr 172.21.15.66:0/399968727 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.501+0000 7f64a7fff640 1 --2- 172.21.15.66:0/399968727 >> v2:172.21.15.190:3300/0 conn(0x7f64a80d5cb0 0x7f64a80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021867517 0 0) 0x7f64a80b45f0 con 0x7f64a8162b30 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6494003520 con 0x7f64a8162b30 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029422809 0 0) 0x7f64a80b48d0 con 0x7f64a8162750 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64a80b45f0 con 0x7f64a8162750 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891761770 0 0) 0x7f6494003520 con 0x7f64a8162b30 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 >> v2:172.21.15.190:3300/0 conn(0x7f64a80d5cb0 msgr2=0x7f64a80d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:09.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 --2- 172.21.15.66:0/399968727 >> v2:172.21.15.190:3300/0 conn(0x7f64a80d5cb0 0x7f64a80d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 >> v1:172.21.15.190:6789/0 conn(0x7f64a8162750 legacy=0x7f64a80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80b4bb0 con 0x7f64a8162b30 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f64a00019f0 con 0x7f64a8162b30 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 >> v1:172.21.15.66:6789/0 conn(0x7f64a8162b30 legacy=0x7f64a80b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6494003b90 0x7f6494003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6494004800 0x7f6494004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f649400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80b4f20 con 0x7f6494005210 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f649400c140 con 0x7f6494003b90 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f649400c340 con 0x7f6494004800 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64ad381640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f649400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64a7fff640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6494004800 0x7f6494004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64acb80640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6494003b90 0x7f6494003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64ad381640 1 -- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6494004800 msgr2=0x7f6494004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64ad381640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6494004800 0x7f6494004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64ad381640 1 -- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6494003b90 msgr2=0x7f6494003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64ad381640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6494003b90 0x7f6494003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.502+0000 7f64ad381640 1 -- 172.21.15.66:0/399968727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6494003520 con 0x7f6494005210 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.503+0000 7f64ad381640 1 -- 172.21.15.66:0/399968727 reap_dead start 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.503+0000 7f64ad381640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f649400b9c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f64a000a720 tx=0x7f6494005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc885ebcc80e9a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.503+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000a370 con 0x7f6494005210 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.503+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a002f070 con 0x7f6494005210 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.503+0000 7f64a77fe640 1 -- 172.21.15.66:0/399968727 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a002bbc0 con 0x7f6494005210 2024-05-10T11:22:09.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 -- 172.21.15.66:0/399968727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 msgr2=0x7f649400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f649400b9c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f64a000a720 tx=0x7f6494005830 comp rx=0 tx=0).stop 2024-05-10T11:22:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 -- 172.21.15.66:0/399968727 shutdown_connections 2024-05-10T11:22:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 --2- 172.21.15.66:0/399968727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f649400b9c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 -- 172.21.15.66:0/399968727 >> 172.21.15.66:0/399968727 conn(0x7f64a809e3b0 msgr2=0x7f64a80d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 -- 172.21.15.66:0/399968727 shutdown_connections 2024-05-10T11:22:09.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.504+0000 7f64aede4640 1 -- 172.21.15.66:0/399968727 wait complete. 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.505+0000 7f64aede4640 1 Processor -- start 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.505+0000 7f64aede4640 1 -- start start 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64aede4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f64a815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64aede4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a815e5f0 0x7f64a80ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64aede4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80cd020 0x7f64a80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64aede4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80d0a00 con 0x7f6494005210 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64aede4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80d0880 con 0x7f64a815e5f0 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64aede4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f64a80d0b80 con 0x7f64a80cd020 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64acb80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f64a815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64acb80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f64a815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48650/0 (socket says 172.21.15.66:48650) 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64acb80640 1 -- 172.21.15.66:0/21266749 learned_addr learned my addr 172.21.15.66:0/21266749 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64a7fff640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a815e5f0 0x7f64a80ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64ad381640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80cd020 0x7f64a80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.506+0000 7f64acb80640 1 -- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80cd020 msgr2=0x7f64a80ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64acb80640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80cd020 0x7f64a80ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64acb80640 1 -- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a815e5f0 msgr2=0x7f64a80ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64acb80640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a815e5f0 0x7f64a80ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64acb80640 1 -- 172.21.15.66:0/21266749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a815d330 con 0x7f6494005210 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64a7fff640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a815e5f0 0x7f64a80ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64acb80640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f64a815e0b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f649800f7a0 tx=0x7f649800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649801a070 con 0x7f6494005210 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6498005320 con 0x7f6494005210 2024-05-10T11:22:09.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498007270 con 0x7f6494005210 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a815d5d0 con 0x7f6494005210 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.507+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a80cd580 con 0x7f6494005210 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.508+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a806a220 con 0x7f6494005210 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.509+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f649801d070 con 0x7f6494005210 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.509+0000 7f64a57fa640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6488076300 0x7f64880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.509+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f6498096f20 con 0x7f6494005210 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.509+0000 7f64a7fff640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6488076300 0x7f64880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.510+0000 7f64a7fff640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6488076300 0x7f64880787c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f64a815e9d0 tx=0x7f6490008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:09.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.513+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6498060780 con 0x7f6494005210 2024-05-10T11:22:09.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.743+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64a80b3c70 con 0x7f6494005210 2024-05-10T11:22:09.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.744+0000 7f64a57fa640 1 -- 172.21.15.66:0/21266749 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5189 (secure 0 0 0) 0x7f6498060080 con 0x7f6494005210 2024-05-10T11:22:09.743 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:09.743 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:08.749534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7093":{"gid":7093,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3723690401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3723690401},{"type":"v1","addr":"172.21.15.190:6836","nonce":3723690401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7093,"qdb_cluster":[7093]},"id":8}]} 2024-05-10T11:22:09.744 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 99 2024-05-10T11:22:09.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6488076300 msgr2=0x7f64880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6488076300 0x7f64880787c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f64a815e9d0 tx=0x7f6490008040 comp rx=0 tx=0).stop 2024-05-10T11:22:09.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 msgr2=0x7f64a815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f64a815e0b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f649800f7a0 tx=0x7f649800fc60 comp rx=0 tx=0).stop 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 shutdown_connections 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6488076300 0x7f64880787c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80cd020 0x7f64a80ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a815e5f0 0x7f64a80ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 --2- 172.21.15.66:0/21266749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6494005210 0x7f64a815e0b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 >> 172.21.15.66:0/21266749 conn(0x7f64a809e3b0 msgr2=0x7f64a80b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 shutdown_connections 2024-05-10T11:22:09.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.746+0000 7f64aede4640 1 -- 172.21.15.66:0/21266749 wait complete. 2024-05-10T11:22:09.758 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:22:09.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.862+0000 7f6a74b19640 1 Processor -- start 2024-05-10T11:22:09.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.862+0000 7f6a74b19640 1 -- start start 2024-05-10T11:22:09.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a74b19640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6a700b6a10 0x7f6a70161550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a74b19640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6a7006d720 0x7f6a7015d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a74b19640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a700b0a90 con 0x7f6a700b6df0 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a74b19640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f6a700b0d70 con 0x7f6a7006d720 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a74b19640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6a7006dc10 con 0x7f6a700b6a10 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a67fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6a700b6df0 0x7f6a700cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34934/0 (socket says 172.21.15.66:34934) 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a67fff640 1 -- 172.21.15.66:0/3248861249 learned_addr learned my addr 172.21.15.66:0/3248861249 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6ed9d640 1 --2- 172.21.15.66:0/3248861249 >> v2:172.21.15.66:3300/0 conn(0x7f6a7006d720 0x7f6a7015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6e59c640 1 --2- 172.21.15.66:0/3248861249 >> v2:172.21.15.190:3300/0 conn(0x7f6a700b6a10 0x7f6a70161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6dd9b640 1 -- 172.21.15.66:0/3248861249 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239743350 0 0) 0x7f6a700b0a90 con 0x7f6a700b6df0 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6dd9b640 1 -- 172.21.15.66:0/3248861249 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a5c003520 con 0x7f6a700b6df0 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/3248861249 >> v2:172.21.15.190:3300/0 conn(0x7f6a700b6a10 msgr2=0x7f6a70161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6ed9d640 1 --2- 172.21.15.66:0/3248861249 >> v2:172.21.15.190:3300/0 conn(0x7f6a700b6a10 0x7f6a70161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/3248861249 >> v1:172.21.15.66:6789/0 conn(0x7f6a700b6df0 legacy=0x7f6a700cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.863+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/3248861249 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a700cbd10 con 0x7f6a7006d720 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.864+0000 7f6a6ed9d640 1 --2- 172.21.15.66:0/3248861249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a7006d720 0x7f6a7015d550 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009d90 tx=0x7f6a6802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19c3e44cb0a1252 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.864+0000 7f6a6dd9b640 1 -- 172.21.15.66:0/3248861249 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007740 con 0x7f6a7006d720 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.864+0000 7f6a6dd9b640 1 -- 172.21.15.66:0/3248861249 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a680078e0 con 0x7f6a7006d720 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.864+0000 7f6a6dd9b640 1 -- 172.21.15.66:0/3248861249 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007cb0 con 0x7f6a7006d720 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 -- 172.21.15.66:0/3248861249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a7006d720 msgr2=0x7f6a7015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 --2- 172.21.15.66:0/3248861249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a7006d720 0x7f6a7015d550 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009d90 tx=0x7f6a6802a6a0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 -- 172.21.15.66:0/3248861249 shutdown_connections 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 --2- 172.21.15.66:0/3248861249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a7006d720 0x7f6a7015d550 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 --2- 172.21.15.66:0/3248861249 >> v2:172.21.15.190:3300/0 conn(0x7f6a700b6a10 0x7f6a70161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 -- 172.21.15.66:0/3248861249 >> 172.21.15.66:0/3248861249 conn(0x7f6a700d1510 msgr2=0x7f6a700d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 -- 172.21.15.66:0/3248861249 shutdown_connections 2024-05-10T11:22:09.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.865+0000 7f6a74b19640 1 -- 172.21.15.66:0/3248861249 wait complete. 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.866+0000 7f6a74b19640 1 Processor -- start 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.866+0000 7f6a74b19640 1 -- start start 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a74b19640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a7006d720 0x7f6a700c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a74b19640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a700b6a10 0x7f6a701f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a74b19640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 0x7f6a701f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a74b19640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7015dc10 con 0x7f6a700b6df0 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a74b19640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7015da90 con 0x7f6a700b6a10 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a74b19640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7015dd90 con 0x7f6a7006d720 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 0x7f6a701f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 0x7f6a701f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48668/0 (socket says 172.21.15.66:48668) 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/2709157688 learned_addr learned my addr 172.21.15.66:0/2709157688 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6e59c640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a7006d720 0x7f6a700c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a67fff640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a700b6a10 0x7f6a701f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a7006d720 msgr2=0x7f6a700c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a7006d720 0x7f6a700c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a700b6a10 msgr2=0x7f6a701f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a700b6a10 0x7f6a701f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.867+0000 7f6a6ed9d640 1 -- 172.21.15.66:0/2709157688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a700ca120 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.868+0000 7f6a6ed9d640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 0x7f6a701f64c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6a6802ac90 tx=0x7f6a68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.868+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68040070 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.868+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a68031bc0 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.868+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a700ca400 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.868+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68009450 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.868+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a700ca9c0 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.869+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7006a220 con 0x7f6a700b6df0 2024-05-10T11:22:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.870+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a68039040 con 0x7f6a700b6df0 2024-05-10T11:22:09.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.870+0000 7f6a66ffd640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:09.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.870+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f6a680b8d90 con 0x7f6a700b6df0 2024-05-10T11:22:09.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.870+0000 7f6a6e59c640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:09.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.871+0000 7f6a6e59c640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009b40 tx=0x7f6a60009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:09.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:09.874+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6a68081f10 con 0x7f6a700b6df0 2024-05-10T11:22:10.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.068+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a7006cbd0 con 0x7f6a700b6df0 2024-05-10T11:22:10.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.069+0000 7f6a66ffd640 1 -- 172.21.15.66:0/2709157688 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16952 (secure 0 0 0) 0x7f6a68086210 con 0x7f6a700b6df0 2024-05-10T11:22:10.069 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:10.069 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":118,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:22:07.361489+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:22:03.418261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T11:22:04.686944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 msgr2=0x7f6a50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009b40 tx=0x7f6a60009190 comp rx=0 tx=0).stop 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 msgr2=0x7f6a701f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 0x7f6a701f64c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6a6802ac90 tx=0x7f6a68004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 shutdown_connections 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6a500762d0 0x7f6a50078790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700b6df0 0x7f6a701f64c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a700b6a10 0x7f6a701f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 --2- 172.21.15.66:0/2709157688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a7006d720 0x7f6a700c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 >> 172.21.15.66:0/2709157688 conn(0x7f6a700d1510 msgr2=0x7f6a7015e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 shutdown_connections 2024-05-10T11:22:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.071+0000 7f6a74b19640 1 -- 172.21.15.66:0/2709157688 wait complete. 2024-05-10T11:22:10.082 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:22:10.082 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:22:10.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.187+0000 7f07b59b6640 1 Processor -- start 2024-05-10T11:22:10.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.188+0000 7f07b59b6640 1 -- start start 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.188+0000 7f07b59b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f07b006c2c0 0x7f07b0146750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.188+0000 7f07b59b6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b00719d0 con 0x7f07b006c6a0 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.188+0000 7f07b59b6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b0071410 con 0x7f07b00af930 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.188+0000 7f07b59b6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f07b00af4a0 con 0x7f07b006c2c0 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07ae7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f07b006c6a0 0x7f07b0070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34950/0 (socket says 172.21.15.66:34950) 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07ae7fc640 1 -- 172.21.15.66:0/1673155108 learned_addr learned my addr 172.21.15.66:0/1673155108 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07aeffd640 1 --2- 172.21.15.66:0/1673155108 >> v2:172.21.15.190:3300/0 conn(0x7f07b006c2c0 0x7f07b0146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305797602 0 0) 0x7f07b00719d0 con 0x7f07b006c6a0 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f079c003520 con 0x7f07b006c6a0 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3667481536 0 0) 0x7f079c003520 con 0x7f07b006c6a0 2024-05-10T11:22:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 >> v2:172.21.15.190:3300/0 conn(0x7f07b006c2c0 msgr2=0x7f07b0146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 --2- 172.21.15.66:0/1673155108 >> v2:172.21.15.190:3300/0 conn(0x7f07b006c2c0 0x7f07b0146750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 >> v1:172.21.15.190:6789/0 conn(0x7f07b00af930 legacy=0x7f07b00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b00716f0 con 0x7f07b006c6a0 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f0798001670 con 0x7f07b006c6a0 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 >> v1:172.21.15.66:6789/0 conn(0x7f07b006c6a0 legacy=0x7f07b0070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0039b0 0x7f079c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f079c004800 0x7f079c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0051c0 0x7f079c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07b00af4a0 con 0x7f079c004800 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f079c00c060 con 0x7f079c0039b0 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f079c00c260 con 0x7f079c0051c0 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07ae7fc640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f079c004800 0x7f079c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07aeffd640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0039b0 0x7f079c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.189+0000 7f07af7fe640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0051c0 0x7f079c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07ae7fc640 1 -- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0051c0 msgr2=0x7f079c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07ae7fc640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0051c0 0x7f079c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07ae7fc640 1 -- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0039b0 msgr2=0x7f079c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07ae7fc640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0039b0 0x7f079c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07ae7fc640 1 -- 172.21.15.66:0/1673155108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c003520 con 0x7f079c004800 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07af7fe640 1 -- 172.21.15.66:0/1673155108 reap_dead start 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07ae7fc640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f079c004800 0x7f079c004c80 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f079800c240 tx=0x7f079c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bdcab7b399cba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798007d10 con 0x7f079c004800 2024-05-10T11:22:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980058d0 con 0x7f079c004800 2024-05-10T11:22:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.190+0000 7f07adffb640 1 -- 172.21.15.66:0/1673155108 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798005d40 con 0x7f079c004800 2024-05-10T11:22:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 -- 172.21.15.66:0/1673155108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f079c004800 msgr2=0x7f079c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f079c004800 0x7f079c004c80 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f079800c240 tx=0x7f079c005830 comp rx=0 tx=0).stop 2024-05-10T11:22:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 -- 172.21.15.66:0/1673155108 shutdown_connections 2024-05-10T11:22:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 --2- 172.21.15.66:0/1673155108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f079c004800 0x7f079c004c80 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 -- 172.21.15.66:0/1673155108 >> 172.21.15.66:0/1673155108 conn(0x7f07b00d1d70 msgr2=0x7f07b00d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 -- 172.21.15.66:0/1673155108 shutdown_connections 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.191+0000 7f07b59b6640 1 -- 172.21.15.66:0/1673155108 wait complete. 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.192+0000 7f07b59b6640 1 Processor -- start 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 -- start start 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c004800 0x7f07b00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07b00b61e0 0x7f07b009f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 0x7f07b01f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07b00b1530 con 0x7f07b01f8280 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f07b006cb30 con 0x7f079c004800 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07b59b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f07b00b16b0 con 0x7f07b00b61e0 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07af7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 0x7f07b01f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07af7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 0x7f07b01f8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48678/0 (socket says 172.21.15.66:48678) 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.193+0000 7f07af7fe640 1 -- 172.21.15.66:0/694812449 learned_addr learned my addr 172.21.15.66:0/694812449 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07ae7fc640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07b00b61e0 0x7f07b009f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07aeffd640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c004800 0x7f07b00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07af7fe640 1 -- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07b00b61e0 msgr2=0x7f07b009f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07af7fe640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07b00b61e0 0x7f07b009f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07af7fe640 1 -- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c004800 msgr2=0x7f07b00cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07af7fe640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c004800 0x7f07b00cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07af7fe640 1 -- 172.21.15.66:0/694812449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b009f850 con 0x7f07b01f8280 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07af7fe640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 0x7f07b01f8700 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f07b006d0a0 tx=0x7f07a000f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00053a0 con 0x7f07b01f8280 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0018070 con 0x7f07b01f8280 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b00b5140 con 0x7f07b01f8280 2024-05-10T11:22:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0003830 con 0x7f07b01f8280 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.194+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b00b5700 con 0x7f07b01f8280 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.195+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b00693f0 con 0x7f07b01f8280 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.196+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07a00039d0 con 0x7f07b01f8280 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.196+0000 7f07a7fff640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0790076300 0x7f07900787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.196+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f07a00971b0 con 0x7f07b01f8280 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.196+0000 7f07aeffd640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0790076300 0x7f07900787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.197+0000 7f07aeffd640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0790076300 0x7f07900787c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f07b0052040 tx=0x7f07a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.201+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f07a0060980 con 0x7f07b01f8280 2024-05-10T11:22:10.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.388+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07b00b25d0 con 0x7f0790076300 2024-05-10T11:22:10.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.395+0000 7f07a7fff640 1 -- 172.21.15.66:0/694812449 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252445 (secure 0 0 0) 0x7f07b00b25d0 con 0x7f0790076300 2024-05-10T11:22:10.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:10.399 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:22:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0790076300 msgr2=0x7f07900787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0790076300 0x7f07900787c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f07b0052040 tx=0x7f07a800b040 comp rx=0 tx=0).stop 2024-05-10T11:22:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 msgr2=0x7f07b01f8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 0x7f07b01f8700 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f07b006d0a0 tx=0x7f07a000f900 comp rx=0 tx=0).stop 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 shutdown_connections 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0790076300 0x7f07900787c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b01f8280 0x7f07b01f8700 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07b00b61e0 0x7f07b009f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 --2- 172.21.15.66:0/694812449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c004800 0x7f07b00cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.398+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 >> 172.21.15.66:0/694812449 conn(0x7f07b00d1d70 msgr2=0x7f07b0073920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.399+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 shutdown_connections 2024-05-10T11:22:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.399+0000 7f07b59b6640 1 -- 172.21.15.66:0/694812449 wait complete. 2024-05-10T11:22:10.409 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-05-10T11:22:09.833246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262076,"kb_used_data":12600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712644,"statfs":{"total":773094113280,"available":772825747456,"internally_reserved":0,"allocated":12902400,"data_stored":6606972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.492605"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270398+0000","last_change":"2024-05-10T11:22:06.364627+0000","last_active":"2024-05-10T11:22:08.270398+0000","last_peered":"2024-05-10T11:22:08.270398+0000","last_clean":"2024-05-10T11:22:08.270398+0000","last_became_active":"2024-05-10T11:22:06.364330+0000","last_became_peered":"2024-05-10T11:22:06.364330+0000","last_unstale":"2024-05-10T11:22:08.270398+0000","last_undegraded":"2024-05-10T11:22:08.270398+0000","last_fullsized":"2024-05-10T11:22:08.270398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:54.133480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366208+0000","last_change":"2024-05-10T11:22:06.384297+0000","last_active":"2024-05-10T11:22:07.366208+0000","last_peered":"2024-05-10T11:22:07.366208+0000","last_clean":"2024-05-10T11:22:07.366208+0000","last_became_active":"2024-05-10T11:22:06.383990+0000","last_became_peered":"2024-05-10T11:22:06.383990+0000","last_unstale":"2024-05-10T11:22:07.366208+0000","last_undegraded":"2024-05-10T11:22:07.366208+0000","last_fullsized":"2024-05-10T11:22:07.366208+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:52.457311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366003+0000","last_change":"2024-05-10T11:22:06.374521+0000","last_active":"2024-05-10T11:22:07.366003+0000","last_peered":"2024-05-10T11:22:07.366003+0000","last_clean":"2024-05-10T11:22:07.366003+0000","last_became_active":"2024-05-10T11:22:06.374064+0000","last_became_peered":"2024-05-10T11:22:06.374064+0000","last_unstale":"2024-05-10T11:22:07.366003+0000","last_undegraded":"2024-05-10T11:22:07.366003+0000","last_fullsized":"2024-05-10T11:22:07.366003+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:04.667246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.387699+0000","last_change":"2024-05-10T11:22:06.383724+0000","last_active":"2024-05-10T11:22:06.387699+0000","last_peered":"2024-05-10T11:22:06.387699+0000","last_clean":"2024-05-10T11:22:06.387699+0000","last_became_active":"2024-05-10T11:22:06.383421+0000","last_became_peered":"2024-05-10T11:22:06.383421+0000","last_unstale":"2024-05-10T11:22:06.387699+0000","last_undegraded":"2024-05-10T11:22:06.387699+0000","last_fullsized":"2024-05-10T11:22:06.387699+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:48.363039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270168+0000","last_change":"2024-05-10T11:22:06.372238+0000","last_active":"2024-05-10T11:22:08.270168+0000","last_peered":"2024-05-10T11:22:08.270168+0000","last_clean":"2024-05-10T11:22:08.270168+0000","last_became_active":"2024-05-10T11:22:06.371942+0000","last_became_peered":"2024-05-10T11:22:06.371942+0000","last_unstale":"2024-05-10T11:22:08.270168+0000","last_undegraded":"2024-05-10T11:22:08.270168+0000","last_fullsized":"2024-05-10T11:22:08.270168+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:02.371585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375210+0000","last_change":"2024-05-10T11:22:06.373991+0000","last_active":"2024-05-10T11:22:07.375210+0000","last_peered":"2024-05-10T11:22:07.375210+0000","last_clean":"2024-05-10T11:22:07.375210+0000","last_became_active":"2024-05-10T11:22:06.373695+0000","last_became_peered":"2024-05-10T11:22:06.373695+0000","last_unstale":"2024-05-10T11:22:07.375210+0000","last_undegraded":"2024-05-10T11:22:07.375210+0000","last_fullsized":"2024-05-10T11:22:07.375210+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:57.139389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375241+0000","last_change":"2024-05-10T11:22:06.384007+0000","last_active":"2024-05-10T11:22:07.375241+0000","last_peered":"2024-05-10T11:22:07.375241+0000","last_clean":"2024-05-10T11:22:07.375241+0000","last_became_active":"2024-05-10T11:22:06.383491+0000","last_became_peered":"2024-05-10T11:22:06.383491+0000","last_unstale":"2024-05-10T11:22:07.375241+0000","last_undegraded":"2024-05-10T11:22:07.375241+0000","last_fullsized":"2024-05-10T11:22:07.375241+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:22:58.930353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365463+0000","last_change":"2024-05-10T11:22:06.378258+0000","last_active":"2024-05-10T11:22:07.365463+0000","last_peered":"2024-05-10T11:22:07.365463+0000","last_clean":"2024-05-10T11:22:07.365463+0000","last_became_active":"2024-05-10T11:22:06.377779+0000","last_became_peered":"2024-05-10T11:22:06.377779+0000","last_unstale":"2024-05-10T11:22:07.365463+0000","last_undegraded":"2024-05-10T11:22:07.365463+0000","last_fullsized":"2024-05-10T11:22:07.365463+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:45.004957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389150+0000","last_change":"2024-05-10T11:22:06.385999+0000","last_active":"2024-05-10T11:22:06.389150+0000","last_peered":"2024-05-10T11:22:06.389150+0000","last_clean":"2024-05-10T11:22:06.389150+0000","last_became_active":"2024-05-10T11:22:06.385488+0000","last_became_peered":"2024-05-10T11:22:06.385488+0000","last_unstale":"2024-05-10T11:22:06.389150+0000","last_undegraded":"2024-05-10T11:22:06.389150+0000","last_fullsized":"2024-05-10T11:22:06.389150+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:02.371585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.366634+0000","last_change":"2024-05-10T11:22:06.363958+0000","last_active":"2024-05-10T11:22:06.366634+0000","last_peered":"2024-05-10T11:22:06.366634+0000","last_clean":"2024-05-10T11:22:06.366634+0000","last_became_active":"2024-05-10T11:22:06.363626+0000","last_became_peered":"2024-05-10T11:22:06.363626+0000","last_unstale":"2024-05-10T11:22:06.366634+0000","last_undegraded":"2024-05-10T11:22:06.366634+0000","last_fullsized":"2024-05-10T11:22:06.366634+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:26.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270315+0000","last_change":"2024-05-10T11:22:06.380774+0000","last_active":"2024-05-10T11:22:08.270315+0000","last_peered":"2024-05-10T11:22:08.270315+0000","last_clean":"2024-05-10T11:22:08.270315+0000","last_became_active":"2024-05-10T11:22:06.380512+0000","last_became_peered":"2024-05-10T11:22:06.380512+0000","last_unstale":"2024-05-10T11:22:08.270315+0000","last_undegraded":"2024-05-10T11:22:08.270315+0000","last_fullsized":"2024-05-10T11:22:08.270315+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:51.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375566+0000","last_change":"2024-05-10T11:22:06.371792+0000","last_active":"2024-05-10T11:22:07.375566+0000","last_peered":"2024-05-10T11:22:07.375566+0000","last_clean":"2024-05-10T11:22:07.375566+0000","last_became_active":"2024-05-10T11:22:06.371456+0000","last_became_peered":"2024-05-10T11:22:06.371456+0000","last_unstale":"2024-05-10T11:22:07.375566+0000","last_undegraded":"2024-05-10T11:22:07.375566+0000","last_fullsized":"2024-05-10T11:22:07.375566+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:51:13.655987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.375818+0000","last_change":"2024-05-10T11:22:06.372251+0000","last_active":"2024-05-10T11:22:06.375818+0000","last_peered":"2024-05-10T11:22:06.375818+0000","last_clean":"2024-05-10T11:22:06.375818+0000","last_became_active":"2024-05-10T11:22:06.371958+0000","last_became_peered":"2024-05-10T11:22:06.371958+0000","last_unstale":"2024-05-10T11:22:06.375818+0000","last_undegraded":"2024-05-10T11:22:06.375818+0000","last_fullsized":"2024-05-10T11:22:06.375818+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:00.481963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365731+0000","last_change":"2024-05-10T11:22:06.373673+0000","last_active":"2024-05-10T11:22:07.365731+0000","last_peered":"2024-05-10T11:22:07.365731+0000","last_clean":"2024-05-10T11:22:07.365731+0000","last_became_active":"2024-05-10T11:22:06.373393+0000","last_became_peered":"2024-05-10T11:22:06.373393+0000","last_unstale":"2024-05-10T11:22:07.365731+0000","last_undegraded":"2024-05-10T11:22:07.365731+0000","last_fullsized":"2024-05-10T11:22:07.365731+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:39.092773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270009+0000","last_change":"2024-05-10T11:22:06.380120+0000","last_active":"2024-05-10T11:22:08.270009+0000","last_peered":"2024-05-10T11:22:08.270009+0000","last_clean":"2024-05-10T11:22:08.270009+0000","last_became_active":"2024-05-10T11:22:06.379847+0000","last_became_peered":"2024-05-10T11:22:06.379847+0000","last_unstale":"2024-05-10T11:22:08.270009+0000","last_undegraded":"2024-05-10T11:22:08.270009+0000","last_fullsized":"2024-05-10T11:22:08.270009+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:48.363039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375087+0000","last_change":"2024-05-10T11:22:06.369282+0000","last_active":"2024-05-10T11:22:07.375087+0000","last_peered":"2024-05-10T11:22:07.375087+0000","last_clean":"2024-05-10T11:22:07.375087+0000","last_became_active":"2024-05-10T11:22:06.368995+0000","last_became_peered":"2024-05-10T11:22:06.368995+0000","last_unstale":"2024-05-10T11:22:07.375087+0000","last_undegraded":"2024-05-10T11:22:07.375087+0000","last_fullsized":"2024-05-10T11:22:07.375087+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:10.084219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378520+0000","last_change":"2024-05-10T11:22:06.372277+0000","last_active":"2024-05-10T11:22:06.378520+0000","last_peered":"2024-05-10T11:22:06.378520+0000","last_clean":"2024-05-10T11:22:06.378520+0000","last_became_active":"2024-05-10T11:22:06.371990+0000","last_became_peered":"2024-05-10T11:22:06.371990+0000","last_unstale":"2024-05-10T11:22:06.378520+0000","last_undegraded":"2024-05-10T11:22:06.378520+0000","last_fullsized":"2024-05-10T11:22:06.378520+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:41.080802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365777+0000","last_change":"2024-05-10T11:22:06.383552+0000","last_active":"2024-05-10T11:22:07.365777+0000","last_peered":"2024-05-10T11:22:07.365777+0000","last_clean":"2024-05-10T11:22:07.365777+0000","last_became_active":"2024-05-10T11:22:06.381959+0000","last_became_peered":"2024-05-10T11:22:06.381959+0000","last_unstale":"2024-05-10T11:22:07.365777+0000","last_undegraded":"2024-05-10T11:22:07.365777+0000","last_fullsized":"2024-05-10T11:22:07.365777+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:34.048986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373475+0000","last_change":"2024-05-10T11:22:06.377987+0000","last_active":"2024-05-10T11:22:07.373475+0000","last_peered":"2024-05-10T11:22:07.373475+0000","last_clean":"2024-05-10T11:22:07.373475+0000","last_became_active":"2024-05-10T11:22:06.377334+0000","last_became_peered":"2024-05-10T11:22:06.377334+0000","last_unstale":"2024-05-10T11:22:07.373475+0000","last_undegraded":"2024-05-10T11:22:07.373475+0000","last_fullsized":"2024-05-10T11:22:07.373475+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:46.930797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367224+0000","last_change":"2024-05-10T11:22:06.369920+0000","last_active":"2024-05-10T11:22:07.367224+0000","last_peered":"2024-05-10T11:22:07.367224+0000","last_clean":"2024-05-10T11:22:07.367224+0000","last_became_active":"2024-05-10T11:22:06.369660+0000","last_became_peered":"2024-05-10T11:22:06.369660+0000","last_unstale":"2024-05-10T11:22:07.367224+0000","last_undegraded":"2024-05-10T11:22:07.367224+0000","last_fullsized":"2024-05-10T11:22:07.367224+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:17.011084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389415+0000","last_change":"2024-05-10T11:22:06.387933+0000","last_active":"2024-05-10T11:22:06.389415+0000","last_peered":"2024-05-10T11:22:06.389415+0000","last_clean":"2024-05-10T11:22:06.389415+0000","last_became_active":"2024-05-10T11:22:06.387590+0000","last_became_peered":"2024-05-10T11:22:06.387590+0000","last_unstale":"2024-05-10T11:22:06.389415+0000","last_undegraded":"2024-05-10T11:22:06.389415+0000","last_fullsized":"2024-05-10T11:22:06.389415+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:01.887164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270183+0000","last_change":"2024-05-10T11:22:06.373735+0000","last_active":"2024-05-10T11:22:08.270183+0000","last_peered":"2024-05-10T11:22:08.270183+0000","last_clean":"2024-05-10T11:22:08.270183+0000","last_became_active":"2024-05-10T11:22:06.373473+0000","last_became_peered":"2024-05-10T11:22:06.373473+0000","last_unstale":"2024-05-10T11:22:08.270183+0000","last_undegraded":"2024-05-10T11:22:08.270183+0000","last_fullsized":"2024-05-10T11:22:08.270183+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:20.096561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389092+0000","last_change":"2024-05-10T11:22:06.385909+0000","last_active":"2024-05-10T11:22:06.389092+0000","last_peered":"2024-05-10T11:22:06.389092+0000","last_clean":"2024-05-10T11:22:06.389092+0000","last_became_active":"2024-05-10T11:22:06.385625+0000","last_became_peered":"2024-05-10T11:22:06.385625+0000","last_unstale":"2024-05-10T11:22:06.389092+0000","last_undegraded":"2024-05-10T11:22:06.389092+0000","last_fullsized":"2024-05-10T11:22:06.389092+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:02.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381362+0000","last_change":"2024-05-10T11:22:06.378340+0000","last_active":"2024-05-10T11:22:06.381362+0000","last_peered":"2024-05-10T11:22:06.381362+0000","last_clean":"2024-05-10T11:22:06.381362+0000","last_became_active":"2024-05-10T11:22:06.377836+0000","last_became_peered":"2024-05-10T11:22:06.377836+0000","last_unstale":"2024-05-10T11:22:06.381362+0000","last_undegraded":"2024-05-10T11:22:06.381362+0000","last_fullsized":"2024-05-10T11:22:06.381362+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:00.481963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378936+0000","last_change":"2024-05-10T11:22:06.373905+0000","last_active":"2024-05-10T11:22:06.378936+0000","last_peered":"2024-05-10T11:22:06.378936+0000","last_clean":"2024-05-10T11:22:06.378936+0000","last_became_active":"2024-05-10T11:22:06.373562+0000","last_became_peered":"2024-05-10T11:22:06.373562+0000","last_unstale":"2024-05-10T11:22:06.378936+0000","last_undegraded":"2024-05-10T11:22:06.378936+0000","last_fullsized":"2024-05-10T11:22:06.378936+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:26.876158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367291+0000","last_change":"2024-05-10T11:22:06.365454+0000","last_active":"2024-05-10T11:22:07.367291+0000","last_peered":"2024-05-10T11:22:07.367291+0000","last_clean":"2024-05-10T11:22:07.367291+0000","last_became_active":"2024-05-10T11:22:06.365145+0000","last_became_peered":"2024-05-10T11:22:06.365145+0000","last_unstale":"2024-05-10T11:22:07.367291+0000","last_undegraded":"2024-05-10T11:22:07.367291+0000","last_fullsized":"2024-05-10T11:22:07.367291+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:01.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373529+0000","last_change":"2024-05-10T11:22:06.378249+0000","last_active":"2024-05-10T11:22:07.373529+0000","last_peered":"2024-05-10T11:22:07.373529+0000","last_clean":"2024-05-10T11:22:07.373529+0000","last_became_active":"2024-05-10T11:22:06.377706+0000","last_became_peered":"2024-05-10T11:22:06.377706+0000","last_unstale":"2024-05-10T11:22:07.373529+0000","last_undegraded":"2024-05-10T11:22:07.373529+0000","last_fullsized":"2024-05-10T11:22:07.373529+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:48.363039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375587+0000","last_change":"2024-05-10T11:22:06.382739+0000","last_active":"2024-05-10T11:22:07.375587+0000","last_peered":"2024-05-10T11:22:07.375587+0000","last_clean":"2024-05-10T11:22:07.375587+0000","last_became_active":"2024-05-10T11:22:06.382444+0000","last_became_peered":"2024-05-10T11:22:06.382444+0000","last_unstale":"2024-05-10T11:22:07.375587+0000","last_undegraded":"2024-05-10T11:22:07.375587+0000","last_fullsized":"2024-05-10T11:22:07.375587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:02.161053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367016+0000","last_change":"2024-05-10T11:22:06.371641+0000","last_active":"2024-05-10T11:22:07.367016+0000","last_peered":"2024-05-10T11:22:07.367016+0000","last_clean":"2024-05-10T11:22:07.367016+0000","last_became_active":"2024-05-10T11:22:06.371368+0000","last_became_peered":"2024-05-10T11:22:06.371368+0000","last_unstale":"2024-05-10T11:22:07.367016+0000","last_undegraded":"2024-05-10T11:22:07.367016+0000","last_fullsized":"2024-05-10T11:22:07.367016+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:20.368181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365858+0000","last_change":"2024-05-10T11:22:06.369656+0000","last_active":"2024-05-10T11:22:07.365858+0000","last_peered":"2024-05-10T11:22:07.365858+0000","last_clean":"2024-05-10T11:22:07.365858+0000","last_became_active":"2024-05-10T11:22:06.369363+0000","last_became_peered":"2024-05-10T11:22:06.369363+0000","last_unstale":"2024-05-10T11:22:07.365858+0000","last_undegraded":"2024-05-10T11:22:07.365858+0000","last_fullsized":"2024-05-10T11:22:07.365858+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:09.281609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.379015+0000","last_change":"2024-05-10T11:22:06.377151+0000","last_active":"2024-05-10T11:22:06.379015+0000","last_peered":"2024-05-10T11:22:06.379015+0000","last_clean":"2024-05-10T11:22:06.379015+0000","last_became_active":"2024-05-10T11:22:06.376886+0000","last_became_peered":"2024-05-10T11:22:06.376886+0000","last_unstale":"2024-05-10T11:22:06.379015+0000","last_undegraded":"2024-05-10T11:22:06.379015+0000","last_fullsized":"2024-05-10T11:22:06.379015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:26.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.380512+0000","last_change":"2024-05-10T11:22:06.378094+0000","last_active":"2024-05-10T11:22:06.380512+0000","last_peered":"2024-05-10T11:22:06.380512+0000","last_clean":"2024-05-10T11:22:06.380512+0000","last_became_active":"2024-05-10T11:22:06.377493+0000","last_became_peered":"2024-05-10T11:22:06.377493+0000","last_unstale":"2024-05-10T11:22:06.380512+0000","last_undegraded":"2024-05-10T11:22:06.380512+0000","last_fullsized":"2024-05-10T11:22:06.380512+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:36.901392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378559+0000","last_change":"2024-05-10T11:22:06.373953+0000","last_active":"2024-05-10T11:22:06.378559+0000","last_peered":"2024-05-10T11:22:06.378559+0000","last_clean":"2024-05-10T11:22:06.378559+0000","last_became_active":"2024-05-10T11:22:06.373662+0000","last_became_peered":"2024-05-10T11:22:06.373662+0000","last_unstale":"2024-05-10T11:22:06.378559+0000","last_undegraded":"2024-05-10T11:22:06.378559+0000","last_fullsized":"2024-05-10T11:22:06.378559+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:48.572591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"117'4","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373344+0000","last_change":"2024-05-10T11:22:05.362629+0000","last_active":"2024-05-10T11:22:07.373344+0000","last_peered":"2024-05-10T11:22:07.373344+0000","last_clean":"2024-05-10T11:22:07.373344+0000","last_became_active":"2024-05-10T11:22:05.362352+0000","last_became_peered":"2024-05-10T11:22:05.362352+0000","last_unstale":"2024-05-10T11:22:07.373344+0000","last_undegraded":"2024-05-10T11:22:07.373344+0000","last_fullsized":"2024-05-10T11:22:07.373344+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:58.918763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375436+0000","last_change":"2024-05-10T11:22:06.373253+0000","last_active":"2024-05-10T11:22:07.375436+0000","last_peered":"2024-05-10T11:22:07.375436+0000","last_clean":"2024-05-10T11:22:07.375436+0000","last_became_active":"2024-05-10T11:22:06.372986+0000","last_became_peered":"2024-05-10T11:22:06.372986+0000","last_unstale":"2024-05-10T11:22:07.375436+0000","last_undegraded":"2024-05-10T11:22:07.375436+0000","last_fullsized":"2024-05-10T11:22:07.375436+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:46.790833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"117'1","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.383806+0000","last_change":"2024-05-10T11:22:05.364193+0000","last_active":"2024-05-10T11:22:06.383806+0000","last_peered":"2024-05-10T11:22:06.383806+0000","last_clean":"2024-05-10T11:22:06.383806+0000","last_became_active":"2024-05-10T11:22:05.363897+0000","last_became_peered":"2024-05-10T11:22:05.363897+0000","last_unstale":"2024-05-10T11:22:06.383806+0000","last_undegraded":"2024-05-10T11:22:06.383806+0000","last_fullsized":"2024-05-10T11:22:06.383806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:25.871105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381479+0000","last_change":"2024-05-10T11:22:06.380173+0000","last_active":"2024-05-10T11:22:06.381479+0000","last_peered":"2024-05-10T11:22:06.381479+0000","last_clean":"2024-05-10T11:22:06.381479+0000","last_became_active":"2024-05-10T11:22:06.379878+0000","last_became_peered":"2024-05-10T11:22:06.379878+0000","last_unstale":"2024-05-10T11:22:06.381479+0000","last_undegraded":"2024-05-10T11:22:06.381479+0000","last_fullsized":"2024-05-10T11:22:06.381479+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.285104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"117'2","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.387748+0000","last_change":"2024-05-10T11:22:05.363911+0000","last_active":"2024-05-10T11:22:06.387748+0000","last_peered":"2024-05-10T11:22:06.387748+0000","last_clean":"2024-05-10T11:22:06.387748+0000","last_became_active":"2024-05-10T11:22:05.363443+0000","last_became_peered":"2024-05-10T11:22:05.363443+0000","last_unstale":"2024-05-10T11:22:06.387748+0000","last_undegraded":"2024-05-10T11:22:06.387748+0000","last_fullsized":"2024-05-10T11:22:06.387748+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:19:59.273609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389386+0000","last_change":"2024-05-10T11:22:06.387655+0000","last_active":"2024-05-10T11:22:06.389386+0000","last_peered":"2024-05-10T11:22:06.389386+0000","last_clean":"2024-05-10T11:22:06.389386+0000","last_became_active":"2024-05-10T11:22:06.387327+0000","last_became_peered":"2024-05-10T11:22:06.387327+0000","last_unstale":"2024-05-10T11:22:06.389386+0000","last_undegraded":"2024-05-10T11:22:06.389386+0000","last_fullsized":"2024-05-10T11:22:06.389386+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:51.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"117'2","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.385522+0000","last_change":"2024-05-10T11:22:05.361470+0000","last_active":"2024-05-10T11:22:06.385522+0000","last_peered":"2024-05-10T11:22:06.385522+0000","last_clean":"2024-05-10T11:22:06.385522+0000","last_became_active":"2024-05-10T11:22:05.361130+0000","last_became_peered":"2024-05-10T11:22:05.361130+0000","last_unstale":"2024-05-10T11:22:06.385522+0000","last_undegraded":"2024-05-10T11:22:06.385522+0000","last_fullsized":"2024-05-10T11:22:06.385522+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:52.682138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.371607+0000","last_change":"2024-05-10T11:22:06.370571+0000","last_active":"2024-05-10T11:22:06.371607+0000","last_peered":"2024-05-10T11:22:06.371607+0000","last_clean":"2024-05-10T11:22:06.371607+0000","last_became_active":"2024-05-10T11:22:06.370272+0000","last_became_peered":"2024-05-10T11:22:06.370272+0000","last_unstale":"2024-05-10T11:22:06.371607+0000","last_undegraded":"2024-05-10T11:22:06.371607+0000","last_fullsized":"2024-05-10T11:22:06.371607+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:36.901392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"117'1","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270007+0000","last_change":"2024-05-10T11:22:05.359804+0000","last_active":"2024-05-10T11:22:08.270007+0000","last_peered":"2024-05-10T11:22:08.270007+0000","last_clean":"2024-05-10T11:22:08.270007+0000","last_became_active":"2024-05-10T11:22:05.359515+0000","last_became_peered":"2024-05-10T11:22:05.359515+0000","last_unstale":"2024-05-10T11:22:08.270007+0000","last_undegraded":"2024-05-10T11:22:08.270007+0000","last_fullsized":"2024-05-10T11:22:08.270007+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:21.599786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270039+0000","last_change":"2024-05-10T11:22:06.376572+0000","last_active":"2024-05-10T11:22:08.270039+0000","last_peered":"2024-05-10T11:22:08.270039+0000","last_clean":"2024-05-10T11:22:08.270039+0000","last_became_active":"2024-05-10T11:22:06.376316+0000","last_became_peered":"2024-05-10T11:22:06.376316+0000","last_unstale":"2024-05-10T11:22:08.270039+0000","last_undegraded":"2024-05-10T11:22:08.270039+0000","last_fullsized":"2024-05-10T11:22:08.270039+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:02.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"117'1","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375234+0000","last_change":"2024-05-10T11:22:05.357587+0000","last_active":"2024-05-10T11:22:07.375234+0000","last_peered":"2024-05-10T11:22:07.375234+0000","last_clean":"2024-05-10T11:22:07.375234+0000","last_became_active":"2024-05-10T11:22:05.356820+0000","last_became_peered":"2024-05-10T11:22:05.356820+0000","last_unstale":"2024-05-10T11:22:07.375234+0000","last_undegraded":"2024-05-10T11:22:07.375234+0000","last_fullsized":"2024-05-10T11:22:07.375234+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:42:25.912608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365879+0000","last_change":"2024-05-10T11:22:06.371984+0000","last_active":"2024-05-10T11:22:07.365879+0000","last_peered":"2024-05-10T11:22:07.365879+0000","last_clean":"2024-05-10T11:22:07.365879+0000","last_became_active":"2024-05-10T11:22:06.371701+0000","last_became_peered":"2024-05-10T11:22:06.371701+0000","last_unstale":"2024-05-10T11:22:07.365879+0000","last_undegraded":"2024-05-10T11:22:07.365879+0000","last_fullsized":"2024-05-10T11:22:07.365879+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:25.433234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.364637+0000","last_change":"2024-05-10T11:22:05.357246+0000","last_active":"2024-05-10T11:22:06.364637+0000","last_peered":"2024-05-10T11:22:06.364637+0000","last_clean":"2024-05-10T11:22:06.364637+0000","last_became_active":"2024-05-10T11:22:05.356942+0000","last_became_peered":"2024-05-10T11:22:05.356942+0000","last_unstale":"2024-05-10T11:22:06.364637+0000","last_undegraded":"2024-05-10T11:22:06.364637+0000","last_fullsized":"2024-05-10T11:22:06.364637+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:58.166848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381097+0000","last_change":"2024-05-10T11:22:06.376817+0000","last_active":"2024-05-10T11:22:06.381097+0000","last_peered":"2024-05-10T11:22:06.381097+0000","last_clean":"2024-05-10T11:22:06.381097+0000","last_became_active":"2024-05-10T11:22:06.376423+0000","last_became_peered":"2024-05-10T11:22:06.376423+0000","last_unstale":"2024-05-10T11:22:06.381097+0000","last_undegraded":"2024-05-10T11:22:06.381097+0000","last_fullsized":"2024-05-10T11:22:06.381097+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375231+0000","last_change":"2024-05-10T11:22:05.368723+0000","last_active":"2024-05-10T11:22:07.375231+0000","last_peered":"2024-05-10T11:22:07.375231+0000","last_clean":"2024-05-10T11:22:07.375231+0000","last_became_active":"2024-05-10T11:22:05.368313+0000","last_became_peered":"2024-05-10T11:22:05.368313+0000","last_unstale":"2024-05-10T11:22:07.375231+0000","last_undegraded":"2024-05-10T11:22:07.375231+0000","last_fullsized":"2024-05-10T11:22:07.375231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:39.936139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373270+0000","last_change":"2024-05-10T11:22:06.377519+0000","last_active":"2024-05-10T11:22:07.373270+0000","last_peered":"2024-05-10T11:22:07.373270+0000","last_clean":"2024-05-10T11:22:07.373270+0000","last_became_active":"2024-05-10T11:22:06.377221+0000","last_became_peered":"2024-05-10T11:22:06.377221+0000","last_unstale":"2024-05-10T11:22:07.373270+0000","last_undegraded":"2024-05-10T11:22:07.373270+0000","last_fullsized":"2024-05-10T11:22:07.373270+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:36.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373351+0000","last_change":"2024-05-10T11:22:05.354737+0000","last_active":"2024-05-10T11:22:07.373351+0000","last_peered":"2024-05-10T11:22:07.373351+0000","last_clean":"2024-05-10T11:22:07.373351+0000","last_became_active":"2024-05-10T11:22:05.354438+0000","last_became_peered":"2024-05-10T11:22:05.354438+0000","last_unstale":"2024-05-10T11:22:07.373351+0000","last_undegraded":"2024-05-10T11:22:07.373351+0000","last_fullsized":"2024-05-10T11:22:07.373351+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:49:52.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.374075+0000","last_change":"2024-05-10T11:22:06.373167+0000","last_active":"2024-05-10T11:22:06.374075+0000","last_peered":"2024-05-10T11:22:06.374075+0000","last_clean":"2024-05-10T11:22:06.374075+0000","last_became_active":"2024-05-10T11:22:06.372882+0000","last_became_peered":"2024-05-10T11:22:06.372882+0000","last_unstale":"2024-05-10T11:22:06.374075+0000","last_undegraded":"2024-05-10T11:22:06.374075+0000","last_fullsized":"2024-05-10T11:22:06.374075+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:53.687190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.363521+0000","last_change":"2024-05-10T11:22:05.364595+0000","last_active":"2024-05-10T11:22:06.363521+0000","last_peered":"2024-05-10T11:22:06.363521+0000","last_clean":"2024-05-10T11:22:06.363521+0000","last_became_active":"2024-05-10T11:22:05.364170+0000","last_became_peered":"2024-05-10T11:22:05.364170+0000","last_unstale":"2024-05-10T11:22:06.363521+0000","last_undegraded":"2024-05-10T11:22:06.363521+0000","last_fullsized":"2024-05-10T11:22:06.363521+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:52.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365950+0000","last_change":"2024-05-10T11:22:06.377404+0000","last_active":"2024-05-10T11:22:07.365950+0000","last_peered":"2024-05-10T11:22:07.365950+0000","last_clean":"2024-05-10T11:22:07.365950+0000","last_became_active":"2024-05-10T11:22:06.377113+0000","last_became_peered":"2024-05-10T11:22:06.377113+0000","last_unstale":"2024-05-10T11:22:07.365950+0000","last_undegraded":"2024-05-10T11:22:07.365950+0000","last_fullsized":"2024-05-10T11:22:07.365950+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:37.399334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"117'3","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.388616+0000","last_change":"2024-05-10T11:22:05.362552+0000","last_active":"2024-05-10T11:22:06.388616+0000","last_peered":"2024-05-10T11:22:06.388616+0000","last_clean":"2024-05-10T11:22:06.388616+0000","last_became_active":"2024-05-10T11:22:05.362293+0000","last_became_peered":"2024-05-10T11:22:05.362293+0000","last_unstale":"2024-05-10T11:22:06.388616+0000","last_undegraded":"2024-05-10T11:22:06.388616+0000","last_fullsized":"2024-05-10T11:22:06.388616+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:12.464722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381495+0000","last_change":"2024-05-10T11:22:06.379773+0000","last_active":"2024-05-10T11:22:06.381495+0000","last_peered":"2024-05-10T11:22:06.381495+0000","last_clean":"2024-05-10T11:22:06.381495+0000","last_became_active":"2024-05-10T11:22:06.378761+0000","last_became_peered":"2024-05-10T11:22:06.378761+0000","last_unstale":"2024-05-10T11:22:06.381495+0000","last_undegraded":"2024-05-10T11:22:06.381495+0000","last_fullsized":"2024-05-10T11:22:06.381495+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:48.572591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"117'6","reported_seq":20,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366144+0000","last_change":"2024-05-10T11:22:05.357376+0000","last_active":"2024-05-10T11:22:07.366144+0000","last_peered":"2024-05-10T11:22:07.366144+0000","last_clean":"2024-05-10T11:22:07.366144+0000","last_became_active":"2024-05-10T11:22:05.357063+0000","last_became_peered":"2024-05-10T11:22:05.357063+0000","last_unstale":"2024-05-10T11:22:07.366144+0000","last_undegraded":"2024-05-10T11:22:07.366144+0000","last_fullsized":"2024-05-10T11:22:07.366144+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:58.166848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373314+0000","last_change":"2024-05-10T11:22:06.376425+0000","last_active":"2024-05-10T11:22:07.373314+0000","last_peered":"2024-05-10T11:22:07.373314+0000","last_clean":"2024-05-10T11:22:07.373314+0000","last_became_active":"2024-05-10T11:22:06.376153+0000","last_became_peered":"2024-05-10T11:22:06.376153+0000","last_unstale":"2024-05-10T11:22:07.373314+0000","last_undegraded":"2024-05-10T11:22:07.373314+0000","last_fullsized":"2024-05-10T11:22:07.373314+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:01.065184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365698+0000","last_change":"2024-05-10T11:22:05.365435+0000","last_active":"2024-05-10T11:22:07.365698+0000","last_peered":"2024-05-10T11:22:07.365698+0000","last_clean":"2024-05-10T11:22:07.365698+0000","last_became_active":"2024-05-10T11:22:05.365172+0000","last_became_peered":"2024-05-10T11:22:05.365172+0000","last_unstale":"2024-05-10T11:22:07.365698+0000","last_undegraded":"2024-05-10T11:22:07.365698+0000","last_fullsized":"2024-05-10T11:22:07.365698+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:12.464722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.384291+0000","last_change":"2024-05-10T11:22:06.381585+0000","last_active":"2024-05-10T11:22:06.384291+0000","last_peered":"2024-05-10T11:22:06.384291+0000","last_clean":"2024-05-10T11:22:06.384291+0000","last_became_active":"2024-05-10T11:22:06.381281+0000","last_became_peered":"2024-05-10T11:22:06.381281+0000","last_unstale":"2024-05-10T11:22:06.384291+0000","last_undegraded":"2024-05-10T11:22:06.384291+0000","last_fullsized":"2024-05-10T11:22:06.384291+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:36.111380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366031+0000","last_change":"2024-05-10T11:22:05.360080+0000","last_active":"2024-05-10T11:22:07.366031+0000","last_peered":"2024-05-10T11:22:07.366031+0000","last_clean":"2024-05-10T11:22:07.366031+0000","last_became_active":"2024-05-10T11:22:05.359798+0000","last_became_peered":"2024-05-10T11:22:05.359798+0000","last_unstale":"2024-05-10T11:22:07.366031+0000","last_undegraded":"2024-05-10T11:22:07.366031+0000","last_fullsized":"2024-05-10T11:22:07.366031+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:25.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366982+0000","last_change":"2024-05-10T11:22:06.365493+0000","last_active":"2024-05-10T11:22:07.366982+0000","last_peered":"2024-05-10T11:22:07.366982+0000","last_clean":"2024-05-10T11:22:07.366982+0000","last_became_active":"2024-05-10T11:22:06.365176+0000","last_became_peered":"2024-05-10T11:22:06.365176+0000","last_unstale":"2024-05-10T11:22:07.366982+0000","last_undegraded":"2024-05-10T11:22:07.366982+0000","last_fullsized":"2024-05-10T11:22:07.366982+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:56:57.885688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365921+0000","last_change":"2024-05-10T11:22:05.359273+0000","last_active":"2024-05-10T11:22:07.365921+0000","last_peered":"2024-05-10T11:22:07.365921+0000","last_clean":"2024-05-10T11:22:07.365921+0000","last_became_active":"2024-05-10T11:22:05.359008+0000","last_became_peered":"2024-05-10T11:22:05.359008+0000","last_unstale":"2024-05-10T11:22:07.365921+0000","last_undegraded":"2024-05-10T11:22:07.365921+0000","last_fullsized":"2024-05-10T11:22:07.365921+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:25.871105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381428+0000","last_change":"2024-05-10T11:22:06.379463+0000","last_active":"2024-05-10T11:22:06.381428+0000","last_peered":"2024-05-10T11:22:06.381428+0000","last_clean":"2024-05-10T11:22:06.381428+0000","last_became_active":"2024-05-10T11:22:06.379195+0000","last_became_peered":"2024-05-10T11:22:06.379195+0000","last_unstale":"2024-05-10T11:22:06.381428+0000","last_undegraded":"2024-05-10T11:22:06.381428+0000","last_fullsized":"2024-05-10T11:22:06.381428+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:41.080802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"117'1","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.384915+0000","last_change":"2024-05-10T11:22:05.369041+0000","last_active":"2024-05-10T11:22:06.384915+0000","last_peered":"2024-05-10T11:22:06.384915+0000","last_clean":"2024-05-10T11:22:06.384915+0000","last_became_active":"2024-05-10T11:22:05.368732+0000","last_became_peered":"2024-05-10T11:22:05.368732+0000","last_unstale":"2024-05-10T11:22:06.384915+0000","last_undegraded":"2024-05-10T11:22:06.384915+0000","last_fullsized":"2024-05-10T11:22:06.384915+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:06.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270371+0000","last_change":"2024-05-10T11:22:06.373030+0000","last_active":"2024-05-10T11:22:08.270371+0000","last_peered":"2024-05-10T11:22:08.270371+0000","last_clean":"2024-05-10T11:22:08.270371+0000","last_became_active":"2024-05-10T11:22:06.372765+0000","last_became_peered":"2024-05-10T11:22:06.372765+0000","last_unstale":"2024-05-10T11:22:08.270371+0000","last_undegraded":"2024-05-10T11:22:08.270371+0000","last_fullsized":"2024-05-10T11:22:08.270371+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:01.887164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367381+0000","last_change":"2024-05-10T11:22:05.366525+0000","last_active":"2024-05-10T11:22:07.367381+0000","last_peered":"2024-05-10T11:22:07.367381+0000","last_clean":"2024-05-10T11:22:07.367381+0000","last_became_active":"2024-05-10T11:22:05.366228+0000","last_became_peered":"2024-05-10T11:22:05.366228+0000","last_unstale":"2024-05-10T11:22:07.367381+0000","last_undegraded":"2024-05-10T11:22:07.367381+0000","last_fullsized":"2024-05-10T11:22:07.367381+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:52.061097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375433+0000","last_change":"2024-05-10T11:22:06.374791+0000","last_active":"2024-05-10T11:22:07.375433+0000","last_peered":"2024-05-10T11:22:07.375433+0000","last_clean":"2024-05-10T11:22:07.375433+0000","last_became_active":"2024-05-10T11:22:06.374505+0000","last_became_peered":"2024-05-10T11:22:06.374505+0000","last_unstale":"2024-05-10T11:22:07.375433+0000","last_undegraded":"2024-05-10T11:22:07.375433+0000","last_fullsized":"2024-05-10T11:22:07.375433+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:44.764940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"117'1","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.390014+0000","last_change":"2024-05-10T11:22:05.361947+0000","last_active":"2024-05-10T11:22:06.390014+0000","last_peered":"2024-05-10T11:22:06.390014+0000","last_clean":"2024-05-10T11:22:06.390014+0000","last_became_active":"2024-05-10T11:22:05.361635+0000","last_became_peered":"2024-05-10T11:22:05.361635+0000","last_unstale":"2024-05-10T11:22:06.390014+0000","last_undegraded":"2024-05-10T11:22:06.390014+0000","last_fullsized":"2024-05-10T11:22:06.390014+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:35.514927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381994+0000","last_change":"2024-05-10T11:22:06.381210+0000","last_active":"2024-05-10T11:22:06.381994+0000","last_peered":"2024-05-10T11:22:06.381994+0000","last_clean":"2024-05-10T11:22:06.381994+0000","last_became_active":"2024-05-10T11:22:06.380791+0000","last_became_peered":"2024-05-10T11:22:06.380791+0000","last_unstale":"2024-05-10T11:22:06.381994+0000","last_undegraded":"2024-05-10T11:22:06.381994+0000","last_fullsized":"2024-05-10T11:22:06.381994+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.371192+0000","last_change":"2024-05-10T11:22:05.369738+0000","last_active":"2024-05-10T11:22:06.371192+0000","last_peered":"2024-05-10T11:22:06.371192+0000","last_clean":"2024-05-10T11:22:06.371192+0000","last_became_active":"2024-05-10T11:22:05.369490+0000","last_became_peered":"2024-05-10T11:22:05.369490+0000","last_unstale":"2024-05-10T11:22:06.371192+0000","last_undegraded":"2024-05-10T11:22:06.371192+0000","last_fullsized":"2024-05-10T11:22:06.371192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:08.100815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375118+0000","last_change":"2024-05-10T11:22:06.378600+0000","last_active":"2024-05-10T11:22:07.375118+0000","last_peered":"2024-05-10T11:22:07.375118+0000","last_clean":"2024-05-10T11:22:07.375118+0000","last_became_active":"2024-05-10T11:22:06.378259+0000","last_became_peered":"2024-05-10T11:22:06.378259+0000","last_unstale":"2024-05-10T11:22:07.375118+0000","last_undegraded":"2024-05-10T11:22:07.375118+0000","last_fullsized":"2024-05-10T11:22:07.375118+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:13.806544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375334+0000","last_change":"2024-05-10T11:22:05.366313+0000","last_active":"2024-05-10T11:22:07.375334+0000","last_peered":"2024-05-10T11:22:07.375334+0000","last_clean":"2024-05-10T11:22:07.375334+0000","last_became_active":"2024-05-10T11:22:05.365989+0000","last_became_peered":"2024-05-10T11:22:05.365989+0000","last_unstale":"2024-05-10T11:22:07.375334+0000","last_undegraded":"2024-05-10T11:22:07.375334+0000","last_fullsized":"2024-05-10T11:22:07.375334+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:10.845067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365670+0000","last_change":"2024-05-10T11:22:06.380403+0000","last_active":"2024-05-10T11:22:07.365670+0000","last_peered":"2024-05-10T11:22:07.365670+0000","last_clean":"2024-05-10T11:22:07.365670+0000","last_became_active":"2024-05-10T11:22:06.380133+0000","last_became_peered":"2024-05-10T11:22:06.380133+0000","last_unstale":"2024-05-10T11:22:07.365670+0000","last_undegraded":"2024-05-10T11:22:07.365670+0000","last_fullsized":"2024-05-10T11:22:07.365670+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:54.925372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.371970+0000","last_change":"2024-05-10T11:22:05.361953+0000","last_active":"2024-05-10T11:22:06.371970+0000","last_peered":"2024-05-10T11:22:06.371970+0000","last_clean":"2024-05-10T11:22:06.371970+0000","last_became_active":"2024-05-10T11:22:05.361666+0000","last_became_peered":"2024-05-10T11:22:05.361666+0000","last_unstale":"2024-05-10T11:22:06.371970+0000","last_undegraded":"2024-05-10T11:22:06.371970+0000","last_fullsized":"2024-05-10T11:22:06.371970+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:02.982258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366169+0000","last_change":"2024-05-10T11:22:06.372998+0000","last_active":"2024-05-10T11:22:07.366169+0000","last_peered":"2024-05-10T11:22:07.366169+0000","last_clean":"2024-05-10T11:22:07.366169+0000","last_became_active":"2024-05-10T11:22:06.372710+0000","last_became_peered":"2024-05-10T11:22:06.372710+0000","last_unstale":"2024-05-10T11:22:07.366169+0000","last_undegraded":"2024-05-10T11:22:07.366169+0000","last_fullsized":"2024-05-10T11:22:07.366169+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:18.796829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366012+0000","last_change":"2024-05-10T11:22:05.352144+0000","last_active":"2024-05-10T11:22:07.366012+0000","last_peered":"2024-05-10T11:22:07.366012+0000","last_clean":"2024-05-10T11:22:07.366012+0000","last_became_active":"2024-05-10T11:22:05.351882+0000","last_became_peered":"2024-05-10T11:22:05.351882+0000","last_unstale":"2024-05-10T11:22:07.366012+0000","last_undegraded":"2024-05-10T11:22:07.366012+0000","last_fullsized":"2024-05-10T11:22:07.366012+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:06.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378998+0000","last_change":"2024-05-10T11:22:06.373922+0000","last_active":"2024-05-10T11:22:06.378998+0000","last_peered":"2024-05-10T11:22:06.378998+0000","last_clean":"2024-05-10T11:22:06.378998+0000","last_became_active":"2024-05-10T11:22:06.373632+0000","last_became_peered":"2024-05-10T11:22:06.373632+0000","last_unstale":"2024-05-10T11:22:06.378998+0000","last_undegraded":"2024-05-10T11:22:06.378998+0000","last_fullsized":"2024-05-10T11:22:06.378998+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:07.936141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.372162+0000","last_change":"2024-05-10T11:22:05.366481+0000","last_active":"2024-05-10T11:22:06.372162+0000","last_peered":"2024-05-10T11:22:06.372162+0000","last_clean":"2024-05-10T11:22:06.372162+0000","last_became_active":"2024-05-10T11:22:05.366232+0000","last_became_peered":"2024-05-10T11:22:05.366232+0000","last_unstale":"2024-05-10T11:22:06.372162+0000","last_undegraded":"2024-05-10T11:22:06.372162+0000","last_fullsized":"2024-05-10T11:22:06.372162+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:52.897472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375732+0000","last_change":"2024-05-10T11:22:06.370417+0000","last_active":"2024-05-10T11:22:07.375732+0000","last_peered":"2024-05-10T11:22:07.375732+0000","last_clean":"2024-05-10T11:22:07.375732+0000","last_became_active":"2024-05-10T11:22:06.369844+0000","last_became_peered":"2024-05-10T11:22:06.369844+0000","last_unstale":"2024-05-10T11:22:07.375732+0000","last_undegraded":"2024-05-10T11:22:07.375732+0000","last_fullsized":"2024-05-10T11:22:07.375732+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:31.584334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375736+0000","last_change":"2024-05-10T11:22:05.356474+0000","last_active":"2024-05-10T11:22:07.375736+0000","last_peered":"2024-05-10T11:22:07.375736+0000","last_clean":"2024-05-10T11:22:07.375736+0000","last_became_active":"2024-05-10T11:22:05.356026+0000","last_became_peered":"2024-05-10T11:22:05.356026+0000","last_unstale":"2024-05-10T11:22:07.375736+0000","last_undegraded":"2024-05-10T11:22:07.375736+0000","last_fullsized":"2024-05-10T11:22:07.375736+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:00.271068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381208+0000","last_change":"2024-05-10T11:22:06.377582+0000","last_active":"2024-05-10T11:22:06.381208+0000","last_peered":"2024-05-10T11:22:06.381208+0000","last_clean":"2024-05-10T11:22:06.381208+0000","last_became_active":"2024-05-10T11:22:06.377330+0000","last_became_peered":"2024-05-10T11:22:06.377330+0000","last_unstale":"2024-05-10T11:22:06.381208+0000","last_undegraded":"2024-05-10T11:22:06.381208+0000","last_fullsized":"2024-05-10T11:22:06.381208+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:28.845313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"118'1","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.374645+0000","last_change":"2024-05-10T11:22:05.360534+0000","last_active":"2024-05-10T11:22:07.374645+0000","last_peered":"2024-05-10T11:22:07.374645+0000","last_clean":"2024-05-10T11:22:07.374645+0000","last_became_active":"2024-05-10T11:22:05.360257+0000","last_became_peered":"2024-05-10T11:22:05.360257+0000","last_unstale":"2024-05-10T11:22:07.374645+0000","last_undegraded":"2024-05-10T11:22:07.374645+0000","last_fullsized":"2024-05-10T11:22:07.374645+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:21.599786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.385538+0000","last_change":"2024-05-10T11:22:06.383517+0000","last_active":"2024-05-10T11:22:06.385538+0000","last_peered":"2024-05-10T11:22:06.385538+0000","last_clean":"2024-05-10T11:22:06.385538+0000","last_became_active":"2024-05-10T11:22:06.383245+0000","last_became_peered":"2024-05-10T11:22:06.383245+0000","last_unstale":"2024-05-10T11:22:06.385538+0000","last_undegraded":"2024-05-10T11:22:06.385538+0000","last_fullsized":"2024-05-10T11:22:06.385538+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:46.930797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373539+0000","last_change":"2024-05-10T11:22:05.365326+0000","last_active":"2024-05-10T11:22:07.373539+0000","last_peered":"2024-05-10T11:22:07.373539+0000","last_clean":"2024-05-10T11:22:07.373539+0000","last_became_active":"2024-05-10T11:22:05.364978+0000","last_became_peered":"2024-05-10T11:22:05.364978+0000","last_unstale":"2024-05-10T11:22:07.373539+0000","last_undegraded":"2024-05-10T11:22:07.373539+0000","last_fullsized":"2024-05-10T11:22:07.373539+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:08.100815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367390+0000","last_change":"2024-05-10T11:22:06.379853+0000","last_active":"2024-05-10T11:22:07.367390+0000","last_peered":"2024-05-10T11:22:07.367390+0000","last_clean":"2024-05-10T11:22:07.367390+0000","last_became_active":"2024-05-10T11:22:06.379555+0000","last_became_peered":"2024-05-10T11:22:06.379555+0000","last_unstale":"2024-05-10T11:22:07.367390+0000","last_undegraded":"2024-05-10T11:22:07.367390+0000","last_fullsized":"2024-05-10T11:22:07.367390+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:22.753390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375737+0000","last_change":"2024-05-10T11:22:05.368879+0000","last_active":"2024-05-10T11:22:07.375737+0000","last_peered":"2024-05-10T11:22:07.375737+0000","last_clean":"2024-05-10T11:22:07.375737+0000","last_became_active":"2024-05-10T11:22:05.368374+0000","last_became_peered":"2024-05-10T11:22:05.368374+0000","last_unstale":"2024-05-10T11:22:07.375737+0000","last_undegraded":"2024-05-10T11:22:07.375737+0000","last_fullsized":"2024-05-10T11:22:07.375737+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.498094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375268+0000","last_change":"2024-05-10T11:22:06.369817+0000","last_active":"2024-05-10T11:22:07.375268+0000","last_peered":"2024-05-10T11:22:07.375268+0000","last_clean":"2024-05-10T11:22:07.375268+0000","last_became_active":"2024-05-10T11:22:06.369256+0000","last_became_peered":"2024-05-10T11:22:06.369256+0000","last_unstale":"2024-05-10T11:22:07.375268+0000","last_undegraded":"2024-05-10T11:22:07.375268+0000","last_fullsized":"2024-05-10T11:22:07.375268+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:03.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270142+0000","last_change":"2024-05-10T11:22:05.363823+0000","last_active":"2024-05-10T11:22:08.270142+0000","last_peered":"2024-05-10T11:22:08.270142+0000","last_clean":"2024-05-10T11:22:08.270142+0000","last_became_active":"2024-05-10T11:22:05.363546+0000","last_became_peered":"2024-05-10T11:22:05.363546+0000","last_unstale":"2024-05-10T11:22:08.270142+0000","last_undegraded":"2024-05-10T11:22:08.270142+0000","last_fullsized":"2024-05-10T11:22:08.270142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:58.918763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365822+0000","last_change":"2024-05-10T11:22:06.377496+0000","last_active":"2024-05-10T11:22:07.365822+0000","last_peered":"2024-05-10T11:22:07.365822+0000","last_clean":"2024-05-10T11:22:07.365822+0000","last_became_active":"2024-05-10T11:22:06.377217+0000","last_became_peered":"2024-05-10T11:22:06.377217+0000","last_unstale":"2024-05-10T11:22:07.365822+0000","last_undegraded":"2024-05-10T11:22:07.365822+0000","last_fullsized":"2024-05-10T11:22:07.365822+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:15.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270152+0000","last_change":"2024-05-10T11:22:05.356849+0000","last_active":"2024-05-10T11:22:08.270152+0000","last_peered":"2024-05-10T11:22:08.270152+0000","last_clean":"2024-05-10T11:22:08.270152+0000","last_became_active":"2024-05-10T11:22:05.356560+0000","last_became_peered":"2024-05-10T11:22:05.356560+0000","last_unstale":"2024-05-10T11:22:08.270152+0000","last_undegraded":"2024-05-10T11:22:08.270152+0000","last_fullsized":"2024-05-10T11:22:08.270152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:14.946460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.385559+0000","last_change":"2024-05-10T11:22:06.382886+0000","last_active":"2024-05-10T11:22:06.385559+0000","last_peered":"2024-05-10T11:22:06.385559+0000","last_clean":"2024-05-10T11:22:06.385559+0000","last_became_active":"2024-05-10T11:22:06.382580+0000","last_became_peered":"2024-05-10T11:22:06.382580+0000","last_unstale":"2024-05-10T11:22:06.385559+0000","last_undegraded":"2024-05-10T11:22:06.385559+0000","last_fullsized":"2024-05-10T11:22:06.385559+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:01.065184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375304+0000","last_change":"2024-05-10T11:22:05.365916+0000","last_active":"2024-05-10T11:22:07.375304+0000","last_peered":"2024-05-10T11:22:07.375304+0000","last_clean":"2024-05-10T11:22:07.375304+0000","last_became_active":"2024-05-10T11:22:05.365539+0000","last_became_peered":"2024-05-10T11:22:05.365539+0000","last_unstale":"2024-05-10T11:22:07.375304+0000","last_undegraded":"2024-05-10T11:22:07.375304+0000","last_fullsized":"2024-05-10T11:22:07.375304+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:40.436529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381045+0000","last_change":"2024-05-10T11:22:06.375922+0000","last_active":"2024-05-10T11:22:06.381045+0000","last_peered":"2024-05-10T11:22:06.381045+0000","last_clean":"2024-05-10T11:22:06.381045+0000","last_became_active":"2024-05-10T11:22:06.375654+0000","last_became_peered":"2024-05-10T11:22:06.375654+0000","last_unstale":"2024-05-10T11:22:06.381045+0000","last_undegraded":"2024-05-10T11:22:06.381045+0000","last_fullsized":"2024-05-10T11:22:06.381045+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.285104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.372297+0000","last_change":"2024-05-10T11:22:05.362651+0000","last_active":"2024-05-10T11:22:06.372297+0000","last_peered":"2024-05-10T11:22:06.372297+0000","last_clean":"2024-05-10T11:22:06.372297+0000","last_became_active":"2024-05-10T11:22:05.362135+0000","last_became_peered":"2024-05-10T11:22:05.362135+0000","last_unstale":"2024-05-10T11:22:06.372297+0000","last_undegraded":"2024-05-10T11:22:06.372297+0000","last_fullsized":"2024-05-10T11:22:06.372297+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:34.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389243+0000","last_change":"2024-05-10T11:22:06.387356+0000","last_active":"2024-05-10T11:22:06.389243+0000","last_peered":"2024-05-10T11:22:06.389243+0000","last_clean":"2024-05-10T11:22:06.389243+0000","last_became_active":"2024-05-10T11:22:06.386027+0000","last_became_peered":"2024-05-10T11:22:06.386027+0000","last_unstale":"2024-05-10T11:22:06.389243+0000","last_undegraded":"2024-05-10T11:22:06.389243+0000","last_fullsized":"2024-05-10T11:22:06.389243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:20.096561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"117'8","reported_seq":22,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365493+0000","last_change":"2024-05-10T11:22:05.364753+0000","last_active":"2024-05-10T11:22:07.365493+0000","last_peered":"2024-05-10T11:22:07.365493+0000","last_clean":"2024-05-10T11:22:07.365493+0000","last_became_active":"2024-05-10T11:22:05.363409+0000","last_became_peered":"2024-05-10T11:22:05.363409+0000","last_unstale":"2024-05-10T11:22:07.365493+0000","last_undegraded":"2024-05-10T11:22:07.365493+0000","last_fullsized":"2024-05-10T11:22:07.365493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:52.682138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.372459+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:22:06.372459+0000","last_peered":"2024-05-10T11:22:06.372459+0000","last_clean":"2024-05-10T11:22:06.372459+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:06.372459+0000","last_undegraded":"2024-05-10T11:22:06.372459+0000","last_fullsized":"2024-05-10T11:22:06.372459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509563,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":1265475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509563,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":681605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":682635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542266,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":675977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542267,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1462272,"data_stored":681023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":674353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542266,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2060288,"data_stored":1271413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":674491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:22:10.413 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:22:10.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.553+0000 7f65ef3b6640 1 Processor -- start 2024-05-10T11:22:10.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ef3b6640 1 -- start start 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ef3b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65e815f3b0 0x7f65e80d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ef3b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65e815f790 0x7f65e80d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ef3b6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e80d30b0 con 0x7f65e80d5d30 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ef3b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f65e80d3390 con 0x7f65e815f3b0 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ef3b6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f65e80c8c80 con 0x7f65e815f790 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ed152640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65e815f3b0 0x7f65e80d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ed953640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f65e80d5d30 0x7f65e80c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34960/0 (socket says 172.21.15.66:34960) 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.554+0000 7f65ed953640 1 -- 172.21.15.66:0/3017405005 learned_addr learned my addr 172.21.15.66:0/3017405005 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.555+0000 7f65ed152640 1 -- 172.21.15.66:0/3017405005 >> v2:172.21.15.190:3300/0 conn(0x7f65e815f790 msgr2=0x7f65e80d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:10.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.555+0000 7f65ed152640 1 --2- 172.21.15.66:0/3017405005 >> v2:172.21.15.190:3300/0 conn(0x7f65e815f790 0x7f65e80d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.555+0000 7f65ed152640 1 -- 172.21.15.66:0/3017405005 >> v1:172.21.15.66:6789/0 conn(0x7f65e80d5d30 legacy=0x7f65e80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.555+0000 7f65ed152640 1 -- 172.21.15.66:0/3017405005 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e80c8f60 con 0x7f65e815f3b0 2024-05-10T11:22:10.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.555+0000 7f65dffff640 1 -- 172.21.15.66:0/3017405005 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669243643 0 0) 0x7f65e80d30b0 con 0x7f65e80d5d30 2024-05-10T11:22:10.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.555+0000 7f65ed152640 1 --2- 172.21.15.66:0/3017405005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e815f3b0 0x7f65e80d36f0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f65e80c8c00 tx=0x7f65e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3370ebf82764d5c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65dffff640 1 -- 172.21.15.66:0/3017405005 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0037070 con 0x7f65e815f3b0 2024-05-10T11:22:10.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65dffff640 1 -- 172.21.15.66:0/3017405005 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0032440 con 0x7f65e815f3b0 2024-05-10T11:22:10.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65dffff640 1 -- 172.21.15.66:0/3017405005 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0032810 con 0x7f65e815f3b0 2024-05-10T11:22:10.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3017405005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e815f3b0 msgr2=0x7f65e80d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3017405005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e815f3b0 0x7f65e80d36f0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f65e80c8c00 tx=0x7f65e002a1a0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3017405005 shutdown_connections 2024-05-10T11:22:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3017405005 >> v2:172.21.15.190:3300/0 conn(0x7f65e815f790 0x7f65e80d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3017405005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e815f3b0 0x7f65e80d36f0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3017405005 >> 172.21.15.66:0/3017405005 conn(0x7f65e80d5130 msgr2=0x7f65e80d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3017405005 shutdown_connections 2024-05-10T11:22:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.556+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3017405005 wait complete. 2024-05-10T11:22:10.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 Processor -- start 2024-05-10T11:22:10.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 -- start start 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 0x7f65e80b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65e815f3b0 0x7f65e8157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8157dd0 0x7f65e80b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65e80d0e60 con 0x7f65e80d5d30 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65e80d0ce0 con 0x7f65e8157dd0 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ef3b6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f65e80d0fe0 con 0x7f65e815f3b0 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ed152640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 0x7f65e80b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ed152640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 0x7f65e80b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48696/0 (socket says 172.21.15.66:48696) 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.558+0000 7f65ed152640 1 -- 172.21.15.66:0/3140263010 learned_addr learned my addr 172.21.15.66:0/3140263010 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ec951640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65e815f3b0 0x7f65e8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed953640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8157dd0 0x7f65e80b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed152640 1 -- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65e815f3b0 msgr2=0x7f65e8157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed152640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65e815f3b0 0x7f65e8157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed152640 1 -- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8157dd0 msgr2=0x7f65e80b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed152640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8157dd0 0x7f65e80b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed152640 1 -- 172.21.15.66:0/3140263010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e8158310 con 0x7f65e80d5d30 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed953640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8157dd0 0x7f65e80b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ec951640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65e815f3b0 0x7f65e8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ed152640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 0x7f65e80b9ce0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f65e0035040 tx=0x7f65e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0037040 con 0x7f65e80d5d30 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0004230 con 0x7f65e80d5d30 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0032e20 con 0x7f65e80d5d30 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e81585f0 con 0x7f65e80d5d30 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.559+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e8158bb0 con 0x7f65e80d5d30 2024-05-10T11:22:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.560+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e806a220 con 0x7f65e80d5d30 2024-05-10T11:22:10.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.561+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f65e0030770 con 0x7f65e80d5d30 2024-05-10T11:22:10.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.561+0000 7f65ddffb640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65cc0762d0 0x7f65cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.561+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f65e00b8a40 con 0x7f65e80d5d30 2024-05-10T11:22:10.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.562+0000 7f65ec951640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65cc0762d0 0x7f65cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.562+0000 7f65ec951640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65cc0762d0 0x7f65cc078790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f65e80d2240 tx=0x7f65d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.566+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f65e0082210 con 0x7f65e80d5d30 2024-05-10T11:22:10.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.751+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65e80d40c0 con 0x7f65cc0762d0 2024-05-10T11:22:10.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.758+0000 7f65ddffb640 1 -- 172.21.15.66:0/3140263010 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252445 (secure 0 0 0) 0x7f65e80d40c0 con 0x7f65cc0762d0 2024-05-10T11:22:10.759 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:10.761 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:22:10.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65cc0762d0 msgr2=0x7f65cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65cc0762d0 0x7f65cc078790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f65e80d2240 tx=0x7f65d8008040 comp rx=0 tx=0).stop 2024-05-10T11:22:10.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 msgr2=0x7f65e80b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 0x7f65e80b9ce0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f65e0035040 tx=0x7f65e00046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 shutdown_connections 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f65cc0762d0 0x7f65cc078790 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8157dd0 0x7f65e80b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65e815f3b0 0x7f65e8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 --2- 172.21.15.66:0/3140263010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65e80d5d30 0x7f65e80b9ce0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.760+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 >> 172.21.15.66:0/3140263010 conn(0x7f65e80d5130 msgr2=0x7f65e80b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.761+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 shutdown_connections 2024-05-10T11:22:10.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.761+0000 7f65ef3b6640 1 -- 172.21.15.66:0/3140263010 wait complete. 2024-05-10T11:22:10.771 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-05-10T11:22:09.833246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262076,"kb_used_data":12600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712644,"statfs":{"total":773094113280,"available":772825747456,"internally_reserved":0,"allocated":12902400,"data_stored":6606972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.492605"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270398+0000","last_change":"2024-05-10T11:22:06.364627+0000","last_active":"2024-05-10T11:22:08.270398+0000","last_peered":"2024-05-10T11:22:08.270398+0000","last_clean":"2024-05-10T11:22:08.270398+0000","last_became_active":"2024-05-10T11:22:06.364330+0000","last_became_peered":"2024-05-10T11:22:06.364330+0000","last_unstale":"2024-05-10T11:22:08.270398+0000","last_undegraded":"2024-05-10T11:22:08.270398+0000","last_fullsized":"2024-05-10T11:22:08.270398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:54.133480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366208+0000","last_change":"2024-05-10T11:22:06.384297+0000","last_active":"2024-05-10T11:22:07.366208+0000","last_peered":"2024-05-10T11:22:07.366208+0000","last_clean":"2024-05-10T11:22:07.366208+0000","last_became_active":"2024-05-10T11:22:06.383990+0000","last_became_peered":"2024-05-10T11:22:06.383990+0000","last_unstale":"2024-05-10T11:22:07.366208+0000","last_undegraded":"2024-05-10T11:22:07.366208+0000","last_fullsized":"2024-05-10T11:22:07.366208+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:52.457311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366003+0000","last_change":"2024-05-10T11:22:06.374521+0000","last_active":"2024-05-10T11:22:07.366003+0000","last_peered":"2024-05-10T11:22:07.366003+0000","last_clean":"2024-05-10T11:22:07.366003+0000","last_became_active":"2024-05-10T11:22:06.374064+0000","last_became_peered":"2024-05-10T11:22:06.374064+0000","last_unstale":"2024-05-10T11:22:07.366003+0000","last_undegraded":"2024-05-10T11:22:07.366003+0000","last_fullsized":"2024-05-10T11:22:07.366003+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:09:04.667246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.387699+0000","last_change":"2024-05-10T11:22:06.383724+0000","last_active":"2024-05-10T11:22:06.387699+0000","last_peered":"2024-05-10T11:22:06.387699+0000","last_clean":"2024-05-10T11:22:06.387699+0000","last_became_active":"2024-05-10T11:22:06.383421+0000","last_became_peered":"2024-05-10T11:22:06.383421+0000","last_unstale":"2024-05-10T11:22:06.387699+0000","last_undegraded":"2024-05-10T11:22:06.387699+0000","last_fullsized":"2024-05-10T11:22:06.387699+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:48.363039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270168+0000","last_change":"2024-05-10T11:22:06.372238+0000","last_active":"2024-05-10T11:22:08.270168+0000","last_peered":"2024-05-10T11:22:08.270168+0000","last_clean":"2024-05-10T11:22:08.270168+0000","last_became_active":"2024-05-10T11:22:06.371942+0000","last_became_peered":"2024-05-10T11:22:06.371942+0000","last_unstale":"2024-05-10T11:22:08.270168+0000","last_undegraded":"2024-05-10T11:22:08.270168+0000","last_fullsized":"2024-05-10T11:22:08.270168+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:02.371585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375210+0000","last_change":"2024-05-10T11:22:06.373991+0000","last_active":"2024-05-10T11:22:07.375210+0000","last_peered":"2024-05-10T11:22:07.375210+0000","last_clean":"2024-05-10T11:22:07.375210+0000","last_became_active":"2024-05-10T11:22:06.373695+0000","last_became_peered":"2024-05-10T11:22:06.373695+0000","last_unstale":"2024-05-10T11:22:07.375210+0000","last_undegraded":"2024-05-10T11:22:07.375210+0000","last_fullsized":"2024-05-10T11:22:07.375210+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:57.139389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375241+0000","last_change":"2024-05-10T11:22:06.384007+0000","last_active":"2024-05-10T11:22:07.375241+0000","last_peered":"2024-05-10T11:22:07.375241+0000","last_clean":"2024-05-10T11:22:07.375241+0000","last_became_active":"2024-05-10T11:22:06.383491+0000","last_became_peered":"2024-05-10T11:22:06.383491+0000","last_unstale":"2024-05-10T11:22:07.375241+0000","last_undegraded":"2024-05-10T11:22:07.375241+0000","last_fullsized":"2024-05-10T11:22:07.375241+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:22:58.930353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365463+0000","last_change":"2024-05-10T11:22:06.378258+0000","last_active":"2024-05-10T11:22:07.365463+0000","last_peered":"2024-05-10T11:22:07.365463+0000","last_clean":"2024-05-10T11:22:07.365463+0000","last_became_active":"2024-05-10T11:22:06.377779+0000","last_became_peered":"2024-05-10T11:22:06.377779+0000","last_unstale":"2024-05-10T11:22:07.365463+0000","last_undegraded":"2024-05-10T11:22:07.365463+0000","last_fullsized":"2024-05-10T11:22:07.365463+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:45.004957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389150+0000","last_change":"2024-05-10T11:22:06.385999+0000","last_active":"2024-05-10T11:22:06.389150+0000","last_peered":"2024-05-10T11:22:06.389150+0000","last_clean":"2024-05-10T11:22:06.389150+0000","last_became_active":"2024-05-10T11:22:06.385488+0000","last_became_peered":"2024-05-10T11:22:06.385488+0000","last_unstale":"2024-05-10T11:22:06.389150+0000","last_undegraded":"2024-05-10T11:22:06.389150+0000","last_fullsized":"2024-05-10T11:22:06.389150+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:02.371585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.366634+0000","last_change":"2024-05-10T11:22:06.363958+0000","last_active":"2024-05-10T11:22:06.366634+0000","last_peered":"2024-05-10T11:22:06.366634+0000","last_clean":"2024-05-10T11:22:06.366634+0000","last_became_active":"2024-05-10T11:22:06.363626+0000","last_became_peered":"2024-05-10T11:22:06.363626+0000","last_unstale":"2024-05-10T11:22:06.366634+0000","last_undegraded":"2024-05-10T11:22:06.366634+0000","last_fullsized":"2024-05-10T11:22:06.366634+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:26.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270315+0000","last_change":"2024-05-10T11:22:06.380774+0000","last_active":"2024-05-10T11:22:08.270315+0000","last_peered":"2024-05-10T11:22:08.270315+0000","last_clean":"2024-05-10T11:22:08.270315+0000","last_became_active":"2024-05-10T11:22:06.380512+0000","last_became_peered":"2024-05-10T11:22:06.380512+0000","last_unstale":"2024-05-10T11:22:08.270315+0000","last_undegraded":"2024-05-10T11:22:08.270315+0000","last_fullsized":"2024-05-10T11:22:08.270315+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:51.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375566+0000","last_change":"2024-05-10T11:22:06.371792+0000","last_active":"2024-05-10T11:22:07.375566+0000","last_peered":"2024-05-10T11:22:07.375566+0000","last_clean":"2024-05-10T11:22:07.375566+0000","last_became_active":"2024-05-10T11:22:06.371456+0000","last_became_peered":"2024-05-10T11:22:06.371456+0000","last_unstale":"2024-05-10T11:22:07.375566+0000","last_undegraded":"2024-05-10T11:22:07.375566+0000","last_fullsized":"2024-05-10T11:22:07.375566+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:51:13.655987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.375818+0000","last_change":"2024-05-10T11:22:06.372251+0000","last_active":"2024-05-10T11:22:06.375818+0000","last_peered":"2024-05-10T11:22:06.375818+0000","last_clean":"2024-05-10T11:22:06.375818+0000","last_became_active":"2024-05-10T11:22:06.371958+0000","last_became_peered":"2024-05-10T11:22:06.371958+0000","last_unstale":"2024-05-10T11:22:06.375818+0000","last_undegraded":"2024-05-10T11:22:06.375818+0000","last_fullsized":"2024-05-10T11:22:06.375818+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:00.481963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365731+0000","last_change":"2024-05-10T11:22:06.373673+0000","last_active":"2024-05-10T11:22:07.365731+0000","last_peered":"2024-05-10T11:22:07.365731+0000","last_clean":"2024-05-10T11:22:07.365731+0000","last_became_active":"2024-05-10T11:22:06.373393+0000","last_became_peered":"2024-05-10T11:22:06.373393+0000","last_unstale":"2024-05-10T11:22:07.365731+0000","last_undegraded":"2024-05-10T11:22:07.365731+0000","last_fullsized":"2024-05-10T11:22:07.365731+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:21:39.092773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270009+0000","last_change":"2024-05-10T11:22:06.380120+0000","last_active":"2024-05-10T11:22:08.270009+0000","last_peered":"2024-05-10T11:22:08.270009+0000","last_clean":"2024-05-10T11:22:08.270009+0000","last_became_active":"2024-05-10T11:22:06.379847+0000","last_became_peered":"2024-05-10T11:22:06.379847+0000","last_unstale":"2024-05-10T11:22:08.270009+0000","last_undegraded":"2024-05-10T11:22:08.270009+0000","last_fullsized":"2024-05-10T11:22:08.270009+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:48.363039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375087+0000","last_change":"2024-05-10T11:22:06.369282+0000","last_active":"2024-05-10T11:22:07.375087+0000","last_peered":"2024-05-10T11:22:07.375087+0000","last_clean":"2024-05-10T11:22:07.375087+0000","last_became_active":"2024-05-10T11:22:06.368995+0000","last_became_peered":"2024-05-10T11:22:06.368995+0000","last_unstale":"2024-05-10T11:22:07.375087+0000","last_undegraded":"2024-05-10T11:22:07.375087+0000","last_fullsized":"2024-05-10T11:22:07.375087+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:10.084219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378520+0000","last_change":"2024-05-10T11:22:06.372277+0000","last_active":"2024-05-10T11:22:06.378520+0000","last_peered":"2024-05-10T11:22:06.378520+0000","last_clean":"2024-05-10T11:22:06.378520+0000","last_became_active":"2024-05-10T11:22:06.371990+0000","last_became_peered":"2024-05-10T11:22:06.371990+0000","last_unstale":"2024-05-10T11:22:06.378520+0000","last_undegraded":"2024-05-10T11:22:06.378520+0000","last_fullsized":"2024-05-10T11:22:06.378520+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:41.080802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365777+0000","last_change":"2024-05-10T11:22:06.383552+0000","last_active":"2024-05-10T11:22:07.365777+0000","last_peered":"2024-05-10T11:22:07.365777+0000","last_clean":"2024-05-10T11:22:07.365777+0000","last_became_active":"2024-05-10T11:22:06.381959+0000","last_became_peered":"2024-05-10T11:22:06.381959+0000","last_unstale":"2024-05-10T11:22:07.365777+0000","last_undegraded":"2024-05-10T11:22:07.365777+0000","last_fullsized":"2024-05-10T11:22:07.365777+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:53:34.048986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373475+0000","last_change":"2024-05-10T11:22:06.377987+0000","last_active":"2024-05-10T11:22:07.373475+0000","last_peered":"2024-05-10T11:22:07.373475+0000","last_clean":"2024-05-10T11:22:07.373475+0000","last_became_active":"2024-05-10T11:22:06.377334+0000","last_became_peered":"2024-05-10T11:22:06.377334+0000","last_unstale":"2024-05-10T11:22:07.373475+0000","last_undegraded":"2024-05-10T11:22:07.373475+0000","last_fullsized":"2024-05-10T11:22:07.373475+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:46.930797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367224+0000","last_change":"2024-05-10T11:22:06.369920+0000","last_active":"2024-05-10T11:22:07.367224+0000","last_peered":"2024-05-10T11:22:07.367224+0000","last_clean":"2024-05-10T11:22:07.367224+0000","last_became_active":"2024-05-10T11:22:06.369660+0000","last_became_peered":"2024-05-10T11:22:06.369660+0000","last_unstale":"2024-05-10T11:22:07.367224+0000","last_undegraded":"2024-05-10T11:22:07.367224+0000","last_fullsized":"2024-05-10T11:22:07.367224+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:17.011084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389415+0000","last_change":"2024-05-10T11:22:06.387933+0000","last_active":"2024-05-10T11:22:06.389415+0000","last_peered":"2024-05-10T11:22:06.389415+0000","last_clean":"2024-05-10T11:22:06.389415+0000","last_became_active":"2024-05-10T11:22:06.387590+0000","last_became_peered":"2024-05-10T11:22:06.387590+0000","last_unstale":"2024-05-10T11:22:06.389415+0000","last_undegraded":"2024-05-10T11:22:06.389415+0000","last_fullsized":"2024-05-10T11:22:06.389415+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:01.887164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270183+0000","last_change":"2024-05-10T11:22:06.373735+0000","last_active":"2024-05-10T11:22:08.270183+0000","last_peered":"2024-05-10T11:22:08.270183+0000","last_clean":"2024-05-10T11:22:08.270183+0000","last_became_active":"2024-05-10T11:22:06.373473+0000","last_became_peered":"2024-05-10T11:22:06.373473+0000","last_unstale":"2024-05-10T11:22:08.270183+0000","last_undegraded":"2024-05-10T11:22:08.270183+0000","last_fullsized":"2024-05-10T11:22:08.270183+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:20.096561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389092+0000","last_change":"2024-05-10T11:22:06.385909+0000","last_active":"2024-05-10T11:22:06.389092+0000","last_peered":"2024-05-10T11:22:06.389092+0000","last_clean":"2024-05-10T11:22:06.389092+0000","last_became_active":"2024-05-10T11:22:06.385625+0000","last_became_peered":"2024-05-10T11:22:06.385625+0000","last_unstale":"2024-05-10T11:22:06.389092+0000","last_undegraded":"2024-05-10T11:22:06.389092+0000","last_fullsized":"2024-05-10T11:22:06.389092+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:02.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381362+0000","last_change":"2024-05-10T11:22:06.378340+0000","last_active":"2024-05-10T11:22:06.381362+0000","last_peered":"2024-05-10T11:22:06.381362+0000","last_clean":"2024-05-10T11:22:06.381362+0000","last_became_active":"2024-05-10T11:22:06.377836+0000","last_became_peered":"2024-05-10T11:22:06.377836+0000","last_unstale":"2024-05-10T11:22:06.381362+0000","last_undegraded":"2024-05-10T11:22:06.381362+0000","last_fullsized":"2024-05-10T11:22:06.381362+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:00.481963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378936+0000","last_change":"2024-05-10T11:22:06.373905+0000","last_active":"2024-05-10T11:22:06.378936+0000","last_peered":"2024-05-10T11:22:06.378936+0000","last_clean":"2024-05-10T11:22:06.378936+0000","last_became_active":"2024-05-10T11:22:06.373562+0000","last_became_peered":"2024-05-10T11:22:06.373562+0000","last_unstale":"2024-05-10T11:22:06.378936+0000","last_undegraded":"2024-05-10T11:22:06.378936+0000","last_fullsized":"2024-05-10T11:22:06.378936+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:26.876158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367291+0000","last_change":"2024-05-10T11:22:06.365454+0000","last_active":"2024-05-10T11:22:07.367291+0000","last_peered":"2024-05-10T11:22:07.367291+0000","last_clean":"2024-05-10T11:22:07.367291+0000","last_became_active":"2024-05-10T11:22:06.365145+0000","last_became_peered":"2024-05-10T11:22:06.365145+0000","last_unstale":"2024-05-10T11:22:07.367291+0000","last_undegraded":"2024-05-10T11:22:07.367291+0000","last_fullsized":"2024-05-10T11:22:07.367291+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:01.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373529+0000","last_change":"2024-05-10T11:22:06.378249+0000","last_active":"2024-05-10T11:22:07.373529+0000","last_peered":"2024-05-10T11:22:07.373529+0000","last_clean":"2024-05-10T11:22:07.373529+0000","last_became_active":"2024-05-10T11:22:06.377706+0000","last_became_peered":"2024-05-10T11:22:06.377706+0000","last_unstale":"2024-05-10T11:22:07.373529+0000","last_undegraded":"2024-05-10T11:22:07.373529+0000","last_fullsized":"2024-05-10T11:22:07.373529+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:48.363039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375587+0000","last_change":"2024-05-10T11:22:06.382739+0000","last_active":"2024-05-10T11:22:07.375587+0000","last_peered":"2024-05-10T11:22:07.375587+0000","last_clean":"2024-05-10T11:22:07.375587+0000","last_became_active":"2024-05-10T11:22:06.382444+0000","last_became_peered":"2024-05-10T11:22:06.382444+0000","last_unstale":"2024-05-10T11:22:07.375587+0000","last_undegraded":"2024-05-10T11:22:07.375587+0000","last_fullsized":"2024-05-10T11:22:07.375587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:02.161053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367016+0000","last_change":"2024-05-10T11:22:06.371641+0000","last_active":"2024-05-10T11:22:07.367016+0000","last_peered":"2024-05-10T11:22:07.367016+0000","last_clean":"2024-05-10T11:22:07.367016+0000","last_became_active":"2024-05-10T11:22:06.371368+0000","last_became_peered":"2024-05-10T11:22:06.371368+0000","last_unstale":"2024-05-10T11:22:07.367016+0000","last_undegraded":"2024-05-10T11:22:07.367016+0000","last_fullsized":"2024-05-10T11:22:07.367016+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:40:20.368181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365858+0000","last_change":"2024-05-10T11:22:06.369656+0000","last_active":"2024-05-10T11:22:07.365858+0000","last_peered":"2024-05-10T11:22:07.365858+0000","last_clean":"2024-05-10T11:22:07.365858+0000","last_became_active":"2024-05-10T11:22:06.369363+0000","last_became_peered":"2024-05-10T11:22:06.369363+0000","last_unstale":"2024-05-10T11:22:07.365858+0000","last_undegraded":"2024-05-10T11:22:07.365858+0000","last_fullsized":"2024-05-10T11:22:07.365858+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:46:09.281609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.379015+0000","last_change":"2024-05-10T11:22:06.377151+0000","last_active":"2024-05-10T11:22:06.379015+0000","last_peered":"2024-05-10T11:22:06.379015+0000","last_clean":"2024-05-10T11:22:06.379015+0000","last_became_active":"2024-05-10T11:22:06.376886+0000","last_became_peered":"2024-05-10T11:22:06.376886+0000","last_unstale":"2024-05-10T11:22:06.379015+0000","last_undegraded":"2024-05-10T11:22:06.379015+0000","last_fullsized":"2024-05-10T11:22:06.379015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:26.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.380512+0000","last_change":"2024-05-10T11:22:06.378094+0000","last_active":"2024-05-10T11:22:06.380512+0000","last_peered":"2024-05-10T11:22:06.380512+0000","last_clean":"2024-05-10T11:22:06.380512+0000","last_became_active":"2024-05-10T11:22:06.377493+0000","last_became_peered":"2024-05-10T11:22:06.377493+0000","last_unstale":"2024-05-10T11:22:06.380512+0000","last_undegraded":"2024-05-10T11:22:06.380512+0000","last_fullsized":"2024-05-10T11:22:06.380512+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:36.901392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378559+0000","last_change":"2024-05-10T11:22:06.373953+0000","last_active":"2024-05-10T11:22:06.378559+0000","last_peered":"2024-05-10T11:22:06.378559+0000","last_clean":"2024-05-10T11:22:06.378559+0000","last_became_active":"2024-05-10T11:22:06.373662+0000","last_became_peered":"2024-05-10T11:22:06.373662+0000","last_unstale":"2024-05-10T11:22:06.378559+0000","last_undegraded":"2024-05-10T11:22:06.378559+0000","last_fullsized":"2024-05-10T11:22:06.378559+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:48.572591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"117'4","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373344+0000","last_change":"2024-05-10T11:22:05.362629+0000","last_active":"2024-05-10T11:22:07.373344+0000","last_peered":"2024-05-10T11:22:07.373344+0000","last_clean":"2024-05-10T11:22:07.373344+0000","last_became_active":"2024-05-10T11:22:05.362352+0000","last_became_peered":"2024-05-10T11:22:05.362352+0000","last_unstale":"2024-05-10T11:22:07.373344+0000","last_undegraded":"2024-05-10T11:22:07.373344+0000","last_fullsized":"2024-05-10T11:22:07.373344+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:58.918763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375436+0000","last_change":"2024-05-10T11:22:06.373253+0000","last_active":"2024-05-10T11:22:07.375436+0000","last_peered":"2024-05-10T11:22:07.375436+0000","last_clean":"2024-05-10T11:22:07.375436+0000","last_became_active":"2024-05-10T11:22:06.372986+0000","last_became_peered":"2024-05-10T11:22:06.372986+0000","last_unstale":"2024-05-10T11:22:07.375436+0000","last_undegraded":"2024-05-10T11:22:07.375436+0000","last_fullsized":"2024-05-10T11:22:07.375436+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:46.790833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"117'1","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.383806+0000","last_change":"2024-05-10T11:22:05.364193+0000","last_active":"2024-05-10T11:22:06.383806+0000","last_peered":"2024-05-10T11:22:06.383806+0000","last_clean":"2024-05-10T11:22:06.383806+0000","last_became_active":"2024-05-10T11:22:05.363897+0000","last_became_peered":"2024-05-10T11:22:05.363897+0000","last_unstale":"2024-05-10T11:22:06.383806+0000","last_undegraded":"2024-05-10T11:22:06.383806+0000","last_fullsized":"2024-05-10T11:22:06.383806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:25.871105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381479+0000","last_change":"2024-05-10T11:22:06.380173+0000","last_active":"2024-05-10T11:22:06.381479+0000","last_peered":"2024-05-10T11:22:06.381479+0000","last_clean":"2024-05-10T11:22:06.381479+0000","last_became_active":"2024-05-10T11:22:06.379878+0000","last_became_peered":"2024-05-10T11:22:06.379878+0000","last_unstale":"2024-05-10T11:22:06.381479+0000","last_undegraded":"2024-05-10T11:22:06.381479+0000","last_fullsized":"2024-05-10T11:22:06.381479+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.285104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"117'2","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.387748+0000","last_change":"2024-05-10T11:22:05.363911+0000","last_active":"2024-05-10T11:22:06.387748+0000","last_peered":"2024-05-10T11:22:06.387748+0000","last_clean":"2024-05-10T11:22:06.387748+0000","last_became_active":"2024-05-10T11:22:05.363443+0000","last_became_peered":"2024-05-10T11:22:05.363443+0000","last_unstale":"2024-05-10T11:22:06.387748+0000","last_undegraded":"2024-05-10T11:22:06.387748+0000","last_fullsized":"2024-05-10T11:22:06.387748+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:19:59.273609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389386+0000","last_change":"2024-05-10T11:22:06.387655+0000","last_active":"2024-05-10T11:22:06.389386+0000","last_peered":"2024-05-10T11:22:06.389386+0000","last_clean":"2024-05-10T11:22:06.389386+0000","last_became_active":"2024-05-10T11:22:06.387327+0000","last_became_peered":"2024-05-10T11:22:06.387327+0000","last_unstale":"2024-05-10T11:22:06.389386+0000","last_undegraded":"2024-05-10T11:22:06.389386+0000","last_fullsized":"2024-05-10T11:22:06.389386+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:51.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"117'2","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.385522+0000","last_change":"2024-05-10T11:22:05.361470+0000","last_active":"2024-05-10T11:22:06.385522+0000","last_peered":"2024-05-10T11:22:06.385522+0000","last_clean":"2024-05-10T11:22:06.385522+0000","last_became_active":"2024-05-10T11:22:05.361130+0000","last_became_peered":"2024-05-10T11:22:05.361130+0000","last_unstale":"2024-05-10T11:22:06.385522+0000","last_undegraded":"2024-05-10T11:22:06.385522+0000","last_fullsized":"2024-05-10T11:22:06.385522+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:52.682138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.371607+0000","last_change":"2024-05-10T11:22:06.370571+0000","last_active":"2024-05-10T11:22:06.371607+0000","last_peered":"2024-05-10T11:22:06.371607+0000","last_clean":"2024-05-10T11:22:06.371607+0000","last_became_active":"2024-05-10T11:22:06.370272+0000","last_became_peered":"2024-05-10T11:22:06.370272+0000","last_unstale":"2024-05-10T11:22:06.371607+0000","last_undegraded":"2024-05-10T11:22:06.371607+0000","last_fullsized":"2024-05-10T11:22:06.371607+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:36.901392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"117'1","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270007+0000","last_change":"2024-05-10T11:22:05.359804+0000","last_active":"2024-05-10T11:22:08.270007+0000","last_peered":"2024-05-10T11:22:08.270007+0000","last_clean":"2024-05-10T11:22:08.270007+0000","last_became_active":"2024-05-10T11:22:05.359515+0000","last_became_peered":"2024-05-10T11:22:05.359515+0000","last_unstale":"2024-05-10T11:22:08.270007+0000","last_undegraded":"2024-05-10T11:22:08.270007+0000","last_fullsized":"2024-05-10T11:22:08.270007+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:21.599786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270039+0000","last_change":"2024-05-10T11:22:06.376572+0000","last_active":"2024-05-10T11:22:08.270039+0000","last_peered":"2024-05-10T11:22:08.270039+0000","last_clean":"2024-05-10T11:22:08.270039+0000","last_became_active":"2024-05-10T11:22:06.376316+0000","last_became_peered":"2024-05-10T11:22:06.376316+0000","last_unstale":"2024-05-10T11:22:08.270039+0000","last_undegraded":"2024-05-10T11:22:08.270039+0000","last_fullsized":"2024-05-10T11:22:08.270039+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:02.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"117'1","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375234+0000","last_change":"2024-05-10T11:22:05.357587+0000","last_active":"2024-05-10T11:22:07.375234+0000","last_peered":"2024-05-10T11:22:07.375234+0000","last_clean":"2024-05-10T11:22:07.375234+0000","last_became_active":"2024-05-10T11:22:05.356820+0000","last_became_peered":"2024-05-10T11:22:05.356820+0000","last_unstale":"2024-05-10T11:22:07.375234+0000","last_undegraded":"2024-05-10T11:22:07.375234+0000","last_fullsized":"2024-05-10T11:22:07.375234+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:42:25.912608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365879+0000","last_change":"2024-05-10T11:22:06.371984+0000","last_active":"2024-05-10T11:22:07.365879+0000","last_peered":"2024-05-10T11:22:07.365879+0000","last_clean":"2024-05-10T11:22:07.365879+0000","last_became_active":"2024-05-10T11:22:06.371701+0000","last_became_peered":"2024-05-10T11:22:06.371701+0000","last_unstale":"2024-05-10T11:22:07.365879+0000","last_undegraded":"2024-05-10T11:22:07.365879+0000","last_fullsized":"2024-05-10T11:22:07.365879+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:25.433234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.364637+0000","last_change":"2024-05-10T11:22:05.357246+0000","last_active":"2024-05-10T11:22:06.364637+0000","last_peered":"2024-05-10T11:22:06.364637+0000","last_clean":"2024-05-10T11:22:06.364637+0000","last_became_active":"2024-05-10T11:22:05.356942+0000","last_became_peered":"2024-05-10T11:22:05.356942+0000","last_unstale":"2024-05-10T11:22:06.364637+0000","last_undegraded":"2024-05-10T11:22:06.364637+0000","last_fullsized":"2024-05-10T11:22:06.364637+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:58.166848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381097+0000","last_change":"2024-05-10T11:22:06.376817+0000","last_active":"2024-05-10T11:22:06.381097+0000","last_peered":"2024-05-10T11:22:06.381097+0000","last_clean":"2024-05-10T11:22:06.381097+0000","last_became_active":"2024-05-10T11:22:06.376423+0000","last_became_peered":"2024-05-10T11:22:06.376423+0000","last_unstale":"2024-05-10T11:22:06.381097+0000","last_undegraded":"2024-05-10T11:22:06.381097+0000","last_fullsized":"2024-05-10T11:22:06.381097+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375231+0000","last_change":"2024-05-10T11:22:05.368723+0000","last_active":"2024-05-10T11:22:07.375231+0000","last_peered":"2024-05-10T11:22:07.375231+0000","last_clean":"2024-05-10T11:22:07.375231+0000","last_became_active":"2024-05-10T11:22:05.368313+0000","last_became_peered":"2024-05-10T11:22:05.368313+0000","last_unstale":"2024-05-10T11:22:07.375231+0000","last_undegraded":"2024-05-10T11:22:07.375231+0000","last_fullsized":"2024-05-10T11:22:07.375231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:39.936139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373270+0000","last_change":"2024-05-10T11:22:06.377519+0000","last_active":"2024-05-10T11:22:07.373270+0000","last_peered":"2024-05-10T11:22:07.373270+0000","last_clean":"2024-05-10T11:22:07.373270+0000","last_became_active":"2024-05-10T11:22:06.377221+0000","last_became_peered":"2024-05-10T11:22:06.377221+0000","last_unstale":"2024-05-10T11:22:07.373270+0000","last_undegraded":"2024-05-10T11:22:07.373270+0000","last_fullsized":"2024-05-10T11:22:07.373270+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:36.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373351+0000","last_change":"2024-05-10T11:22:05.354737+0000","last_active":"2024-05-10T11:22:07.373351+0000","last_peered":"2024-05-10T11:22:07.373351+0000","last_clean":"2024-05-10T11:22:07.373351+0000","last_became_active":"2024-05-10T11:22:05.354438+0000","last_became_peered":"2024-05-10T11:22:05.354438+0000","last_unstale":"2024-05-10T11:22:07.373351+0000","last_undegraded":"2024-05-10T11:22:07.373351+0000","last_fullsized":"2024-05-10T11:22:07.373351+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:49:52.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.374075+0000","last_change":"2024-05-10T11:22:06.373167+0000","last_active":"2024-05-10T11:22:06.374075+0000","last_peered":"2024-05-10T11:22:06.374075+0000","last_clean":"2024-05-10T11:22:06.374075+0000","last_became_active":"2024-05-10T11:22:06.372882+0000","last_became_peered":"2024-05-10T11:22:06.372882+0000","last_unstale":"2024-05-10T11:22:06.374075+0000","last_undegraded":"2024-05-10T11:22:06.374075+0000","last_fullsized":"2024-05-10T11:22:06.374075+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:53.687190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.363521+0000","last_change":"2024-05-10T11:22:05.364595+0000","last_active":"2024-05-10T11:22:06.363521+0000","last_peered":"2024-05-10T11:22:06.363521+0000","last_clean":"2024-05-10T11:22:06.363521+0000","last_became_active":"2024-05-10T11:22:05.364170+0000","last_became_peered":"2024-05-10T11:22:05.364170+0000","last_unstale":"2024-05-10T11:22:06.363521+0000","last_undegraded":"2024-05-10T11:22:06.363521+0000","last_fullsized":"2024-05-10T11:22:06.363521+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:52.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365950+0000","last_change":"2024-05-10T11:22:06.377404+0000","last_active":"2024-05-10T11:22:07.365950+0000","last_peered":"2024-05-10T11:22:07.365950+0000","last_clean":"2024-05-10T11:22:07.365950+0000","last_became_active":"2024-05-10T11:22:06.377113+0000","last_became_peered":"2024-05-10T11:22:06.377113+0000","last_unstale":"2024-05-10T11:22:07.365950+0000","last_undegraded":"2024-05-10T11:22:07.365950+0000","last_fullsized":"2024-05-10T11:22:07.365950+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:37.399334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"117'3","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.388616+0000","last_change":"2024-05-10T11:22:05.362552+0000","last_active":"2024-05-10T11:22:06.388616+0000","last_peered":"2024-05-10T11:22:06.388616+0000","last_clean":"2024-05-10T11:22:06.388616+0000","last_became_active":"2024-05-10T11:22:05.362293+0000","last_became_peered":"2024-05-10T11:22:05.362293+0000","last_unstale":"2024-05-10T11:22:06.388616+0000","last_undegraded":"2024-05-10T11:22:06.388616+0000","last_fullsized":"2024-05-10T11:22:06.388616+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:12.464722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381495+0000","last_change":"2024-05-10T11:22:06.379773+0000","last_active":"2024-05-10T11:22:06.381495+0000","last_peered":"2024-05-10T11:22:06.381495+0000","last_clean":"2024-05-10T11:22:06.381495+0000","last_became_active":"2024-05-10T11:22:06.378761+0000","last_became_peered":"2024-05-10T11:22:06.378761+0000","last_unstale":"2024-05-10T11:22:06.381495+0000","last_undegraded":"2024-05-10T11:22:06.381495+0000","last_fullsized":"2024-05-10T11:22:06.381495+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:48.572591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"117'6","reported_seq":20,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366144+0000","last_change":"2024-05-10T11:22:05.357376+0000","last_active":"2024-05-10T11:22:07.366144+0000","last_peered":"2024-05-10T11:22:07.366144+0000","last_clean":"2024-05-10T11:22:07.366144+0000","last_became_active":"2024-05-10T11:22:05.357063+0000","last_became_peered":"2024-05-10T11:22:05.357063+0000","last_unstale":"2024-05-10T11:22:07.366144+0000","last_undegraded":"2024-05-10T11:22:07.366144+0000","last_fullsized":"2024-05-10T11:22:07.366144+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:54:58.166848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373314+0000","last_change":"2024-05-10T11:22:06.376425+0000","last_active":"2024-05-10T11:22:07.373314+0000","last_peered":"2024-05-10T11:22:07.373314+0000","last_clean":"2024-05-10T11:22:07.373314+0000","last_became_active":"2024-05-10T11:22:06.376153+0000","last_became_peered":"2024-05-10T11:22:06.376153+0000","last_unstale":"2024-05-10T11:22:07.373314+0000","last_undegraded":"2024-05-10T11:22:07.373314+0000","last_fullsized":"2024-05-10T11:22:07.373314+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:01.065184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365698+0000","last_change":"2024-05-10T11:22:05.365435+0000","last_active":"2024-05-10T11:22:07.365698+0000","last_peered":"2024-05-10T11:22:07.365698+0000","last_clean":"2024-05-10T11:22:07.365698+0000","last_became_active":"2024-05-10T11:22:05.365172+0000","last_became_peered":"2024-05-10T11:22:05.365172+0000","last_unstale":"2024-05-10T11:22:07.365698+0000","last_undegraded":"2024-05-10T11:22:07.365698+0000","last_fullsized":"2024-05-10T11:22:07.365698+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:12.464722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.384291+0000","last_change":"2024-05-10T11:22:06.381585+0000","last_active":"2024-05-10T11:22:06.384291+0000","last_peered":"2024-05-10T11:22:06.384291+0000","last_clean":"2024-05-10T11:22:06.384291+0000","last_became_active":"2024-05-10T11:22:06.381281+0000","last_became_peered":"2024-05-10T11:22:06.381281+0000","last_unstale":"2024-05-10T11:22:06.384291+0000","last_undegraded":"2024-05-10T11:22:06.384291+0000","last_fullsized":"2024-05-10T11:22:06.384291+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:30:36.111380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366031+0000","last_change":"2024-05-10T11:22:05.360080+0000","last_active":"2024-05-10T11:22:07.366031+0000","last_peered":"2024-05-10T11:22:07.366031+0000","last_clean":"2024-05-10T11:22:07.366031+0000","last_became_active":"2024-05-10T11:22:05.359798+0000","last_became_peered":"2024-05-10T11:22:05.359798+0000","last_unstale":"2024-05-10T11:22:07.366031+0000","last_undegraded":"2024-05-10T11:22:07.366031+0000","last_fullsized":"2024-05-10T11:22:07.366031+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:25.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366982+0000","last_change":"2024-05-10T11:22:06.365493+0000","last_active":"2024-05-10T11:22:07.366982+0000","last_peered":"2024-05-10T11:22:07.366982+0000","last_clean":"2024-05-10T11:22:07.366982+0000","last_became_active":"2024-05-10T11:22:06.365176+0000","last_became_peered":"2024-05-10T11:22:06.365176+0000","last_unstale":"2024-05-10T11:22:07.366982+0000","last_undegraded":"2024-05-10T11:22:07.366982+0000","last_fullsized":"2024-05-10T11:22:07.366982+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:56:57.885688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365921+0000","last_change":"2024-05-10T11:22:05.359273+0000","last_active":"2024-05-10T11:22:07.365921+0000","last_peered":"2024-05-10T11:22:07.365921+0000","last_clean":"2024-05-10T11:22:07.365921+0000","last_became_active":"2024-05-10T11:22:05.359008+0000","last_became_peered":"2024-05-10T11:22:05.359008+0000","last_unstale":"2024-05-10T11:22:07.365921+0000","last_undegraded":"2024-05-10T11:22:07.365921+0000","last_fullsized":"2024-05-10T11:22:07.365921+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:35:25.871105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381428+0000","last_change":"2024-05-10T11:22:06.379463+0000","last_active":"2024-05-10T11:22:06.381428+0000","last_peered":"2024-05-10T11:22:06.381428+0000","last_clean":"2024-05-10T11:22:06.381428+0000","last_became_active":"2024-05-10T11:22:06.379195+0000","last_became_peered":"2024-05-10T11:22:06.379195+0000","last_unstale":"2024-05-10T11:22:06.381428+0000","last_undegraded":"2024-05-10T11:22:06.381428+0000","last_fullsized":"2024-05-10T11:22:06.381428+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:41.080802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"117'1","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.384915+0000","last_change":"2024-05-10T11:22:05.369041+0000","last_active":"2024-05-10T11:22:06.384915+0000","last_peered":"2024-05-10T11:22:06.384915+0000","last_clean":"2024-05-10T11:22:06.384915+0000","last_became_active":"2024-05-10T11:22:05.368732+0000","last_became_peered":"2024-05-10T11:22:05.368732+0000","last_unstale":"2024-05-10T11:22:06.384915+0000","last_undegraded":"2024-05-10T11:22:06.384915+0000","last_fullsized":"2024-05-10T11:22:06.384915+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:06.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270371+0000","last_change":"2024-05-10T11:22:06.373030+0000","last_active":"2024-05-10T11:22:08.270371+0000","last_peered":"2024-05-10T11:22:08.270371+0000","last_clean":"2024-05-10T11:22:08.270371+0000","last_became_active":"2024-05-10T11:22:06.372765+0000","last_became_peered":"2024-05-10T11:22:06.372765+0000","last_unstale":"2024-05-10T11:22:08.270371+0000","last_undegraded":"2024-05-10T11:22:08.270371+0000","last_fullsized":"2024-05-10T11:22:08.270371+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:01.887164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367381+0000","last_change":"2024-05-10T11:22:05.366525+0000","last_active":"2024-05-10T11:22:07.367381+0000","last_peered":"2024-05-10T11:22:07.367381+0000","last_clean":"2024-05-10T11:22:07.367381+0000","last_became_active":"2024-05-10T11:22:05.366228+0000","last_became_peered":"2024-05-10T11:22:05.366228+0000","last_unstale":"2024-05-10T11:22:07.367381+0000","last_undegraded":"2024-05-10T11:22:07.367381+0000","last_fullsized":"2024-05-10T11:22:07.367381+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:52.061097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375433+0000","last_change":"2024-05-10T11:22:06.374791+0000","last_active":"2024-05-10T11:22:07.375433+0000","last_peered":"2024-05-10T11:22:07.375433+0000","last_clean":"2024-05-10T11:22:07.375433+0000","last_became_active":"2024-05-10T11:22:06.374505+0000","last_became_peered":"2024-05-10T11:22:06.374505+0000","last_unstale":"2024-05-10T11:22:07.375433+0000","last_undegraded":"2024-05-10T11:22:07.375433+0000","last_fullsized":"2024-05-10T11:22:07.375433+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:44.764940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"117'1","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.390014+0000","last_change":"2024-05-10T11:22:05.361947+0000","last_active":"2024-05-10T11:22:06.390014+0000","last_peered":"2024-05-10T11:22:06.390014+0000","last_clean":"2024-05-10T11:22:06.390014+0000","last_became_active":"2024-05-10T11:22:05.361635+0000","last_became_peered":"2024-05-10T11:22:05.361635+0000","last_unstale":"2024-05-10T11:22:06.390014+0000","last_undegraded":"2024-05-10T11:22:06.390014+0000","last_fullsized":"2024-05-10T11:22:06.390014+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:35.514927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381994+0000","last_change":"2024-05-10T11:22:06.381210+0000","last_active":"2024-05-10T11:22:06.381994+0000","last_peered":"2024-05-10T11:22:06.381994+0000","last_clean":"2024-05-10T11:22:06.381994+0000","last_became_active":"2024-05-10T11:22:06.380791+0000","last_became_peered":"2024-05-10T11:22:06.380791+0000","last_unstale":"2024-05-10T11:22:06.381994+0000","last_undegraded":"2024-05-10T11:22:06.381994+0000","last_fullsized":"2024-05-10T11:22:06.381994+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.371192+0000","last_change":"2024-05-10T11:22:05.369738+0000","last_active":"2024-05-10T11:22:06.371192+0000","last_peered":"2024-05-10T11:22:06.371192+0000","last_clean":"2024-05-10T11:22:06.371192+0000","last_became_active":"2024-05-10T11:22:05.369490+0000","last_became_peered":"2024-05-10T11:22:05.369490+0000","last_unstale":"2024-05-10T11:22:06.371192+0000","last_undegraded":"2024-05-10T11:22:06.371192+0000","last_fullsized":"2024-05-10T11:22:06.371192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:08.100815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375118+0000","last_change":"2024-05-10T11:22:06.378600+0000","last_active":"2024-05-10T11:22:07.375118+0000","last_peered":"2024-05-10T11:22:07.375118+0000","last_clean":"2024-05-10T11:22:07.375118+0000","last_became_active":"2024-05-10T11:22:06.378259+0000","last_became_peered":"2024-05-10T11:22:06.378259+0000","last_unstale":"2024-05-10T11:22:07.375118+0000","last_undegraded":"2024-05-10T11:22:07.375118+0000","last_fullsized":"2024-05-10T11:22:07.375118+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:44:13.806544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375334+0000","last_change":"2024-05-10T11:22:05.366313+0000","last_active":"2024-05-10T11:22:07.375334+0000","last_peered":"2024-05-10T11:22:07.375334+0000","last_clean":"2024-05-10T11:22:07.375334+0000","last_became_active":"2024-05-10T11:22:05.365989+0000","last_became_peered":"2024-05-10T11:22:05.365989+0000","last_unstale":"2024-05-10T11:22:07.375334+0000","last_undegraded":"2024-05-10T11:22:07.375334+0000","last_fullsized":"2024-05-10T11:22:07.375334+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:10.845067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365670+0000","last_change":"2024-05-10T11:22:06.380403+0000","last_active":"2024-05-10T11:22:07.365670+0000","last_peered":"2024-05-10T11:22:07.365670+0000","last_clean":"2024-05-10T11:22:07.365670+0000","last_became_active":"2024-05-10T11:22:06.380133+0000","last_became_peered":"2024-05-10T11:22:06.380133+0000","last_unstale":"2024-05-10T11:22:07.365670+0000","last_undegraded":"2024-05-10T11:22:07.365670+0000","last_fullsized":"2024-05-10T11:22:07.365670+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:54.925372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.371970+0000","last_change":"2024-05-10T11:22:05.361953+0000","last_active":"2024-05-10T11:22:06.371970+0000","last_peered":"2024-05-10T11:22:06.371970+0000","last_clean":"2024-05-10T11:22:06.371970+0000","last_became_active":"2024-05-10T11:22:05.361666+0000","last_became_peered":"2024-05-10T11:22:05.361666+0000","last_unstale":"2024-05-10T11:22:06.371970+0000","last_undegraded":"2024-05-10T11:22:06.371970+0000","last_fullsized":"2024-05-10T11:22:06.371970+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:02.982258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366169+0000","last_change":"2024-05-10T11:22:06.372998+0000","last_active":"2024-05-10T11:22:07.366169+0000","last_peered":"2024-05-10T11:22:07.366169+0000","last_clean":"2024-05-10T11:22:07.366169+0000","last_became_active":"2024-05-10T11:22:06.372710+0000","last_became_peered":"2024-05-10T11:22:06.372710+0000","last_unstale":"2024-05-10T11:22:07.366169+0000","last_undegraded":"2024-05-10T11:22:07.366169+0000","last_fullsized":"2024-05-10T11:22:07.366169+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:18.796829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.366012+0000","last_change":"2024-05-10T11:22:05.352144+0000","last_active":"2024-05-10T11:22:07.366012+0000","last_peered":"2024-05-10T11:22:07.366012+0000","last_clean":"2024-05-10T11:22:07.366012+0000","last_became_active":"2024-05-10T11:22:05.351882+0000","last_became_peered":"2024-05-10T11:22:05.351882+0000","last_unstale":"2024-05-10T11:22:07.366012+0000","last_undegraded":"2024-05-10T11:22:07.366012+0000","last_fullsized":"2024-05-10T11:22:07.366012+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:06.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.378998+0000","last_change":"2024-05-10T11:22:06.373922+0000","last_active":"2024-05-10T11:22:06.378998+0000","last_peered":"2024-05-10T11:22:06.378998+0000","last_clean":"2024-05-10T11:22:06.378998+0000","last_became_active":"2024-05-10T11:22:06.373632+0000","last_became_peered":"2024-05-10T11:22:06.373632+0000","last_unstale":"2024-05-10T11:22:06.378998+0000","last_undegraded":"2024-05-10T11:22:06.378998+0000","last_fullsized":"2024-05-10T11:22:06.378998+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:07.936141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.372162+0000","last_change":"2024-05-10T11:22:05.366481+0000","last_active":"2024-05-10T11:22:06.372162+0000","last_peered":"2024-05-10T11:22:06.372162+0000","last_clean":"2024-05-10T11:22:06.372162+0000","last_became_active":"2024-05-10T11:22:05.366232+0000","last_became_peered":"2024-05-10T11:22:05.366232+0000","last_unstale":"2024-05-10T11:22:06.372162+0000","last_undegraded":"2024-05-10T11:22:06.372162+0000","last_fullsized":"2024-05-10T11:22:06.372162+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:22:52.897472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375732+0000","last_change":"2024-05-10T11:22:06.370417+0000","last_active":"2024-05-10T11:22:07.375732+0000","last_peered":"2024-05-10T11:22:07.375732+0000","last_clean":"2024-05-10T11:22:07.375732+0000","last_became_active":"2024-05-10T11:22:06.369844+0000","last_became_peered":"2024-05-10T11:22:06.369844+0000","last_unstale":"2024-05-10T11:22:07.375732+0000","last_undegraded":"2024-05-10T11:22:07.375732+0000","last_fullsized":"2024-05-10T11:22:07.375732+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:03:31.584334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"117'2","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375736+0000","last_change":"2024-05-10T11:22:05.356474+0000","last_active":"2024-05-10T11:22:07.375736+0000","last_peered":"2024-05-10T11:22:07.375736+0000","last_clean":"2024-05-10T11:22:07.375736+0000","last_became_active":"2024-05-10T11:22:05.356026+0000","last_became_peered":"2024-05-10T11:22:05.356026+0000","last_unstale":"2024-05-10T11:22:07.375736+0000","last_undegraded":"2024-05-10T11:22:07.375736+0000","last_fullsized":"2024-05-10T11:22:07.375736+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:00.271068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381208+0000","last_change":"2024-05-10T11:22:06.377582+0000","last_active":"2024-05-10T11:22:06.381208+0000","last_peered":"2024-05-10T11:22:06.381208+0000","last_clean":"2024-05-10T11:22:06.381208+0000","last_became_active":"2024-05-10T11:22:06.377330+0000","last_became_peered":"2024-05-10T11:22:06.377330+0000","last_unstale":"2024-05-10T11:22:06.381208+0000","last_undegraded":"2024-05-10T11:22:06.381208+0000","last_fullsized":"2024-05-10T11:22:06.381208+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:28.845313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"118'1","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.374645+0000","last_change":"2024-05-10T11:22:05.360534+0000","last_active":"2024-05-10T11:22:07.374645+0000","last_peered":"2024-05-10T11:22:07.374645+0000","last_clean":"2024-05-10T11:22:07.374645+0000","last_became_active":"2024-05-10T11:22:05.360257+0000","last_became_peered":"2024-05-10T11:22:05.360257+0000","last_unstale":"2024-05-10T11:22:07.374645+0000","last_undegraded":"2024-05-10T11:22:07.374645+0000","last_fullsized":"2024-05-10T11:22:07.374645+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:21.599786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.385538+0000","last_change":"2024-05-10T11:22:06.383517+0000","last_active":"2024-05-10T11:22:06.385538+0000","last_peered":"2024-05-10T11:22:06.385538+0000","last_clean":"2024-05-10T11:22:06.385538+0000","last_became_active":"2024-05-10T11:22:06.383245+0000","last_became_peered":"2024-05-10T11:22:06.383245+0000","last_unstale":"2024-05-10T11:22:06.385538+0000","last_undegraded":"2024-05-10T11:22:06.385538+0000","last_fullsized":"2024-05-10T11:22:06.385538+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:46.930797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.373539+0000","last_change":"2024-05-10T11:22:05.365326+0000","last_active":"2024-05-10T11:22:07.373539+0000","last_peered":"2024-05-10T11:22:07.373539+0000","last_clean":"2024-05-10T11:22:07.373539+0000","last_became_active":"2024-05-10T11:22:05.364978+0000","last_became_peered":"2024-05-10T11:22:05.364978+0000","last_unstale":"2024-05-10T11:22:07.373539+0000","last_undegraded":"2024-05-10T11:22:07.373539+0000","last_fullsized":"2024-05-10T11:22:07.373539+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:08.100815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.367390+0000","last_change":"2024-05-10T11:22:06.379853+0000","last_active":"2024-05-10T11:22:07.367390+0000","last_peered":"2024-05-10T11:22:07.367390+0000","last_clean":"2024-05-10T11:22:07.367390+0000","last_became_active":"2024-05-10T11:22:06.379555+0000","last_became_peered":"2024-05-10T11:22:06.379555+0000","last_unstale":"2024-05-10T11:22:07.367390+0000","last_undegraded":"2024-05-10T11:22:07.367390+0000","last_fullsized":"2024-05-10T11:22:07.367390+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:22.753390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375737+0000","last_change":"2024-05-10T11:22:05.368879+0000","last_active":"2024-05-10T11:22:07.375737+0000","last_peered":"2024-05-10T11:22:07.375737+0000","last_clean":"2024-05-10T11:22:07.375737+0000","last_became_active":"2024-05-10T11:22:05.368374+0000","last_became_peered":"2024-05-10T11:22:05.368374+0000","last_unstale":"2024-05-10T11:22:07.375737+0000","last_undegraded":"2024-05-10T11:22:07.375737+0000","last_fullsized":"2024-05-10T11:22:07.375737+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.498094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375268+0000","last_change":"2024-05-10T11:22:06.369817+0000","last_active":"2024-05-10T11:22:07.375268+0000","last_peered":"2024-05-10T11:22:07.375268+0000","last_clean":"2024-05-10T11:22:07.375268+0000","last_became_active":"2024-05-10T11:22:06.369256+0000","last_became_peered":"2024-05-10T11:22:06.369256+0000","last_unstale":"2024-05-10T11:22:07.375268+0000","last_undegraded":"2024-05-10T11:22:07.375268+0000","last_fullsized":"2024-05-10T11:22:07.375268+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:03.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270142+0000","last_change":"2024-05-10T11:22:05.363823+0000","last_active":"2024-05-10T11:22:08.270142+0000","last_peered":"2024-05-10T11:22:08.270142+0000","last_clean":"2024-05-10T11:22:08.270142+0000","last_became_active":"2024-05-10T11:22:05.363546+0000","last_became_peered":"2024-05-10T11:22:05.363546+0000","last_unstale":"2024-05-10T11:22:08.270142+0000","last_undegraded":"2024-05-10T11:22:08.270142+0000","last_fullsized":"2024-05-10T11:22:08.270142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:58.918763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365822+0000","last_change":"2024-05-10T11:22:06.377496+0000","last_active":"2024-05-10T11:22:07.365822+0000","last_peered":"2024-05-10T11:22:07.365822+0000","last_clean":"2024-05-10T11:22:07.365822+0000","last_became_active":"2024-05-10T11:22:06.377217+0000","last_became_peered":"2024-05-10T11:22:06.377217+0000","last_unstale":"2024-05-10T11:22:07.365822+0000","last_undegraded":"2024-05-10T11:22:07.365822+0000","last_fullsized":"2024-05-10T11:22:07.365822+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:15.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:08.270152+0000","last_change":"2024-05-10T11:22:05.356849+0000","last_active":"2024-05-10T11:22:08.270152+0000","last_peered":"2024-05-10T11:22:08.270152+0000","last_clean":"2024-05-10T11:22:08.270152+0000","last_became_active":"2024-05-10T11:22:05.356560+0000","last_became_peered":"2024-05-10T11:22:05.356560+0000","last_unstale":"2024-05-10T11:22:08.270152+0000","last_undegraded":"2024-05-10T11:22:08.270152+0000","last_fullsized":"2024-05-10T11:22:08.270152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:14.946460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.385559+0000","last_change":"2024-05-10T11:22:06.382886+0000","last_active":"2024-05-10T11:22:06.385559+0000","last_peered":"2024-05-10T11:22:06.385559+0000","last_clean":"2024-05-10T11:22:06.385559+0000","last_became_active":"2024-05-10T11:22:06.382580+0000","last_became_peered":"2024-05-10T11:22:06.382580+0000","last_unstale":"2024-05-10T11:22:06.385559+0000","last_undegraded":"2024-05-10T11:22:06.385559+0000","last_fullsized":"2024-05-10T11:22:06.385559+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:01.065184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.375304+0000","last_change":"2024-05-10T11:22:05.365916+0000","last_active":"2024-05-10T11:22:07.375304+0000","last_peered":"2024-05-10T11:22:07.375304+0000","last_clean":"2024-05-10T11:22:07.375304+0000","last_became_active":"2024-05-10T11:22:05.365539+0000","last_became_peered":"2024-05-10T11:22:05.365539+0000","last_unstale":"2024-05-10T11:22:07.375304+0000","last_undegraded":"2024-05-10T11:22:07.375304+0000","last_fullsized":"2024-05-10T11:22:07.375304+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:40.436529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.381045+0000","last_change":"2024-05-10T11:22:06.375922+0000","last_active":"2024-05-10T11:22:06.381045+0000","last_peered":"2024-05-10T11:22:06.381045+0000","last_clean":"2024-05-10T11:22:06.381045+0000","last_became_active":"2024-05-10T11:22:06.375654+0000","last_became_peered":"2024-05-10T11:22:06.375654+0000","last_unstale":"2024-05-10T11:22:06.381045+0000","last_undegraded":"2024-05-10T11:22:06.381045+0000","last_fullsized":"2024-05-10T11:22:06.381045+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.285104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.372297+0000","last_change":"2024-05-10T11:22:05.362651+0000","last_active":"2024-05-10T11:22:06.372297+0000","last_peered":"2024-05-10T11:22:06.372297+0000","last_clean":"2024-05-10T11:22:06.372297+0000","last_became_active":"2024-05-10T11:22:05.362135+0000","last_became_peered":"2024-05-10T11:22:05.362135+0000","last_unstale":"2024-05-10T11:22:06.372297+0000","last_undegraded":"2024-05-10T11:22:06.372297+0000","last_fullsized":"2024-05-10T11:22:06.372297+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:34.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.389243+0000","last_change":"2024-05-10T11:22:06.387356+0000","last_active":"2024-05-10T11:22:06.389243+0000","last_peered":"2024-05-10T11:22:06.389243+0000","last_clean":"2024-05-10T11:22:06.389243+0000","last_became_active":"2024-05-10T11:22:06.386027+0000","last_became_peered":"2024-05-10T11:22:06.386027+0000","last_unstale":"2024-05-10T11:22:06.389243+0000","last_undegraded":"2024-05-10T11:22:06.389243+0000","last_fullsized":"2024-05-10T11:22:06.389243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:05.339886+0000","last_clean_scrub_stamp":"2024-05-10T11:22:05.339886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:20.096561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"117'8","reported_seq":22,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-05-10T11:22:07.365493+0000","last_change":"2024-05-10T11:22:05.364753+0000","last_active":"2024-05-10T11:22:07.365493+0000","last_peered":"2024-05-10T11:22:07.365493+0000","last_clean":"2024-05-10T11:22:07.365493+0000","last_became_active":"2024-05-10T11:22:05.363409+0000","last_became_peered":"2024-05-10T11:22:05.363409+0000","last_unstale":"2024-05-10T11:22:07.365493+0000","last_undegraded":"2024-05-10T11:22:07.365493+0000","last_fullsized":"2024-05-10T11:22:07.365493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:22:04.334834+0000","last_clean_scrub_stamp":"2024-05-10T11:22:04.334834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:52.682138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T11:22:06.372459+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:22:06.372459+0000","last_peered":"2024-05-10T11:22:06.372459+0000","last_clean":"2024-05-10T11:22:06.372459+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:06.372459+0000","last_undegraded":"2024-05-10T11:22:06.372459+0000","last_fullsized":"2024-05-10T11:22:06.372459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509563,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":1265475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509563,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":681605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":682635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542266,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":675977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542267,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1462272,"data_stored":681023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":674353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542266,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2060288,"data_stored":1271413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":674491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:22:10.775 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:22:10.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T11:22:10.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.922+0000 7fd34c875640 1 Processor -- start 2024-05-10T11:22:10.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.922+0000 7fd34c875640 1 -- start start 2024-05-10T11:22:10.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.923+0000 7fd34c875640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd3480b4f90 0x7fd3480b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.923+0000 7fd34c875640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3480d2800 con 0x7fd34815f410 2024-05-10T11:22:10.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.923+0000 7fd34c875640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3480d2ae0 con 0x7fd3480d36d0 2024-05-10T11:22:10.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.923+0000 7fd34c875640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd3480d01d0 con 0x7fd3480b4f90 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.923+0000 7fd34659c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd34815f410 0x7fd3480d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34974/0 (socket says 172.21.15.66:34974) 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.923+0000 7fd34659c640 1 -- 172.21.15.66:0/3177901009 learned_addr learned my addr 172.21.15.66:0/3177901009 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.924+0000 7fd345d9b640 1 --2- 172.21.15.66:0/3177901009 >> v2:172.21.15.190:3300/0 conn(0x7fd3480b4f90 0x7fd3480b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.924+0000 7fd34559a640 1 -- 172.21.15.66:0/3177901009 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689958107 0 0) 0x7fd3480d2800 con 0x7fd34815f410 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.924+0000 7fd34559a640 1 -- 172.21.15.66:0/3177901009 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd334003520 con 0x7fd34815f410 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.924+0000 7fd345d9b640 1 -- 172.21.15.66:0/3177901009 >> v1:172.21.15.190:6789/0 conn(0x7fd3480d36d0 legacy=0x7fd3480d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.924+0000 7fd345d9b640 1 -- 172.21.15.66:0/3177901009 >> v1:172.21.15.66:6789/0 conn(0x7fd34815f410 legacy=0x7fd3480d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.924+0000 7fd345d9b640 1 -- 172.21.15.66:0/3177901009 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3480d04b0 con 0x7fd3480b4f90 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.925+0000 7fd345d9b640 1 --2- 172.21.15.66:0/3177901009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd3480b5410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3300097a0 tx=0x7fd33002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ccc9fa548d99e99 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.925+0000 7fd34559a640 1 -- 172.21.15.66:0/3177901009 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330037070 con 0x7fd3480b4f90 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.925+0000 7fd34559a640 1 -- 172.21.15.66:0/3177901009 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd330032440 con 0x7fd3480b4f90 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.925+0000 7fd34559a640 1 -- 172.21.15.66:0/3177901009 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3300327f0 con 0x7fd3480b4f90 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.925+0000 7fd34c875640 1 -- 172.21.15.66:0/3177901009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 msgr2=0x7fd3480b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.925+0000 7fd34c875640 1 --2- 172.21.15.66:0/3177901009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd3480b5410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3300097a0 tx=0x7fd33002a1a0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.926+0000 7fd34c875640 1 -- 172.21.15.66:0/3177901009 shutdown_connections 2024-05-10T11:22:10.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.926+0000 7fd34c875640 1 --2- 172.21.15.66:0/3177901009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd3480b5410 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.926+0000 7fd34c875640 1 -- 172.21.15.66:0/3177901009 >> 172.21.15.66:0/3177901009 conn(0x7fd34808ed30 msgr2=0x7fd34809e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:10.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.926+0000 7fd34c875640 1 -- 172.21.15.66:0/3177901009 shutdown_connections 2024-05-10T11:22:10.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.926+0000 7fd34c875640 1 -- 172.21.15.66:0/3177901009 wait complete. 2024-05-10T11:22:10.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.927+0000 7fd34c875640 1 Processor -- start 2024-05-10T11:22:10.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.927+0000 7fd34c875640 1 -- start start 2024-05-10T11:22:10.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34c875640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd34814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34c875640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3480d36d0 0x7fd3480cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34c875640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 0x7fd3480ba970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34c875640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd3480cffb0 con 0x7fd34815f410 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34c875640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3480cfe30 con 0x7fd3480b4f90 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34c875640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd3480d10e0 con 0x7fd3480d36d0 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 0x7fd3480ba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 0x7fd3480ba970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48700/0 (socket says 172.21.15.66:48700) 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 -- 172.21.15.66:0/1068819027 learned_addr learned my addr 172.21.15.66:0/1068819027 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd345d9b640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3480d36d0 0x7fd3480cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34659c640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd34814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 -- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3480d36d0 msgr2=0x7fd3480cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3480d36d0 0x7fd3480cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 -- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 msgr2=0x7fd34814b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd34814b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd346d9d640 1 -- 172.21.15.66:0/1068819027 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3480ca0f0 con 0x7fd34815f410 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.928+0000 7fd34659c640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd34814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.929+0000 7fd346d9d640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 0x7fd3480ba970 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fd33800c390 tx=0x7fd33800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.929+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338017070 con 0x7fd34815f410 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.929+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3380052d0 con 0x7fd34815f410 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.929+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338003810 con 0x7fd34815f410 2024-05-10T11:22:10.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.929+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3480ca3d0 con 0x7fd34815f410 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.929+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3480ca990 con 0x7fd34815f410 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.930+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34806a220 con 0x7fd34815f410 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.930+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd33801a070 con 0x7fd34815f410 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.931+0000 7fd33effd640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd3280762d0 0x7fd328078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.931+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fd338096a00 con 0x7fd34815f410 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.931+0000 7fd34659c640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd3280762d0 0x7fd328078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:10.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.931+0000 7fd34659c640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd3280762d0 0x7fd328078790 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd340001560 tx=0x7fd340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:10.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:10.935+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd338060260 con 0x7fd34815f410 2024-05-10T11:22:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.200+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd34815edc0 con 0x7fd34815f410 2024-05-10T11:22:11.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.202+0000 7fd33effd640 1 -- 172.21.15.66:0/1068819027 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fd338068250 con 0x7fd34815f410 2024-05-10T11:22:11.201 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-05-10T11:22:11.201 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlAD5mPuYPOBAABvT/f7RRPnrMfZ9/F6wO2A== 2024-05-10T11:22:11.202 INFO:teuthology.orchestra.run.smithi066.stdout: caps mds = "allow" 2024-05-10T11:22:11.202 INFO:teuthology.orchestra.run.smithi066.stdout: caps mon = "allow r" 2024-05-10T11:22:11.202 INFO:teuthology.orchestra.run.smithi066.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T11:22:11.202 INFO:teuthology.orchestra.run.smithi066.stderr:updated caps for client.0 2024-05-10T11:22:11.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd3280762d0 msgr2=0x7fd328078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd3280762d0 0x7fd328078790 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd340001560 tx=0x7fd340009040 comp rx=0 tx=0).stop 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 msgr2=0x7fd3480ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 0x7fd3480ba970 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fd33800c390 tx=0x7fd33800c850 comp rx=0 tx=0).stop 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 shutdown_connections 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd3280762d0 0x7fd328078790 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34815f410 0x7fd3480ba970 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3480d36d0 0x7fd3480cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 --2- 172.21.15.66:0/1068819027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3480b4f90 0x7fd34814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 >> 172.21.15.66:0/1068819027 conn(0x7fd34808ed30 msgr2=0x7fd34806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 shutdown_connections 2024-05-10T11:22:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.205+0000 7fd34c875640 1 -- 172.21.15.66:0/1068819027 wait complete. 2024-05-10T11:22:11.215 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 Processor -- start 2024-05-10T11:22:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 -- start start 2024-05-10T11:22:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f13dc0d5cb0 0x7f13dc0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13dc0b45f0 con 0x7f13dc162b30 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc0b4f20 con 0x7f13dc0d5cb0 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.321+0000 7f13e171b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13dc0d0fe0 con 0x7f13dc162750 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13daffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13da7fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f13dc0d5cb0 0x7f13dc0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13db7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f13dc162b30 0x7f13dc0d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:38996/0 (socket says 172.21.15.66:38996) 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13db7fe640 1 -- 172.21.15.66:0/3070712501 learned_addr learned my addr 172.21.15.66:0/3070712501 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13da7fc640 1 -- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 msgr2=0x7f13dc0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13da7fc640 1 --2- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13da7fc640 1 -- 172.21.15.66:0/3070712501 >> v1:172.21.15.190:6789/0 conn(0x7f13dc162b30 legacy=0x7f13dc0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13d9ffb640 1 -- 172.21.15.66:0/3070712501 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682427868 0 0) 0x7f13dc0b45f0 con 0x7f13dc162b30 2024-05-10T11:22:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13da7fc640 1 -- 172.21.15.66:0/3070712501 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc0b48d0 con 0x7f13dc0d5cb0 2024-05-10T11:22:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.322+0000 7f13daffd640 1 --2- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.323+0000 7f13da7fc640 1 --2- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0d5cb0 0x7f13dc0d3630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f13d00097a0 tx=0x7f13d002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d62b3c000849be3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.323+0000 7f13d9ffb640 1 -- 172.21.15.66:0/3070712501 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0037070 con 0x7f13dc0d5cb0 2024-05-10T11:22:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.323+0000 7f13d9ffb640 1 -- 172.21.15.66:0/3070712501 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d002ae50 con 0x7f13dc0d5cb0 2024-05-10T11:22:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.323+0000 7f13d9ffb640 1 -- 172.21.15.66:0/3070712501 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0032660 con 0x7f13dc0d5cb0 2024-05-10T11:22:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 -- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0d5cb0 msgr2=0x7f13dc0d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 --2- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0d5cb0 0x7f13dc0d3630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f13d00097a0 tx=0x7f13d002a100 comp rx=0 tx=0).stop 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 -- 172.21.15.66:0/3070712501 shutdown_connections 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 --2- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0d5cb0 0x7f13dc0d3630 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 --2- 172.21.15.66:0/3070712501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 -- 172.21.15.66:0/3070712501 >> 172.21.15.66:0/3070712501 conn(0x7f13dc09e3b0 msgr2=0x7f13dc0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 -- 172.21.15.66:0/3070712501 shutdown_connections 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.324+0000 7f13e171b640 1 -- 172.21.15.66:0/3070712501 wait complete. 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.325+0000 7f13e171b640 1 Processor -- start 2024-05-10T11:22:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.325+0000 7f13e171b640 1 -- start start 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13e171b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13e171b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc162b30 0x7f13dc15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13e171b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 0x7f13dc0ba430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13e171b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc0d0d30 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13e171b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc0d0bb0 con 0x7f13dc162b30 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13e171b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13dc0b63c0 con 0x7f13dc162750 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 0x7f13dc0ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:11.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 0x7f13dc0ba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48716/0 (socket says 172.21.15.66:48716) 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 -- 172.21.15.66:0/3687466814 learned_addr learned my addr 172.21.15.66:0/3687466814 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13daffd640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13da7fc640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc162b30 0x7f13dc15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 -- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 msgr2=0x7f13dc15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 -- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc162b30 msgr2=0x7f13dc15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc162b30 0x7f13dc15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.326+0000 7f13db7fe640 1 -- 172.21.15.66:0/3687466814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc15aa60 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.327+0000 7f13db7fe640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 0x7f13dc0ba430 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c700 tx=0x7f13d400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.327+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4018070 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.327+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d400ce10 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.327+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d400a800 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.327+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc0b7de0 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.327+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc0b83a0 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.328+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13dc0b4580 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.328+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13d401b070 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.329+0000 7f13c37fe640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13c80762d0 0x7f13c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.329+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f13d4096b90 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.329+0000 7f13daffd640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13c80762d0 0x7f13c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.330+0000 7f13daffd640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13c80762d0 0x7f13c8078790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009560 tx=0x7f13cc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:11.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.333+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f13dc0b4580 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.563+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13dc06a220 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.563+0000 7f13c37fe640 1 -- 172.21.15.66:0/3687466814 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5189 (secure 0 0 0) 0x7f13d405fda0 con 0x7f13dc0b9fa0 2024-05-10T11:22:11.563 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:11.563 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:08.749534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7093":{"gid":7093,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6836/3723690401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3723690401},{"type":"v1","addr":"172.21.15.190:6836","nonce":3723690401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7093,"qdb_cluster":[7093]},"id":8}]} 2024-05-10T11:22:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 99 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13c80762d0 msgr2=0x7f13c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13c80762d0 0x7f13c8078790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009560 tx=0x7f13cc009190 comp rx=0 tx=0).stop 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 msgr2=0x7f13dc0ba430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 0x7f13dc0ba430 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c700 tx=0x7f13d400cbc0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 shutdown_connections 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f13c80762d0 0x7f13c8078790 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13dc0b9fa0 0x7f13dc0ba430 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc162b30 0x7f13dc15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 --2- 172.21.15.66:0/3687466814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc162750 0x7f13dc15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:11.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 >> 172.21.15.66:0/3687466814 conn(0x7f13dc09e3b0 msgr2=0x7f13dc0d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 shutdown_connections 2024-05-10T11:22:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:11.565+0000 7f13e171b640 1 -- 172.21.15.66:0/3687466814 wait complete. 2024-05-10T11:22:11.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:08.749534+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7093}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7093': {'gid': 7093, 'name': 'b', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.190:6836/3723690401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 3723690401}, {'type': 'v1', 'addr': '172.21.15.190:6836', 'nonce': 3723690401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7093, 'qdb_cluster': [7093]} 2024-05-10T11:22:11.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:22:11.979 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T11:22:12.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.087+0000 7fdeae3da640 1 Processor -- start 2024-05-10T11:22:12.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.087+0000 7fdeae3da640 1 -- start start 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdeae3da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdea806c990 0x7fdea8163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdeae3da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdeae3da640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea8163ba0 con 0x7fdea815f620 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdeae3da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fdea806cd70 con 0x7fdea806c990 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdeae3da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdea8160190 con 0x7fdea8070bd0 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdea806c990 0x7fdea8163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdea806c990 0x7fdea8163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48728/0 (socket says 172.21.15.66:48728) 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 -- 172.21.15.66:0/3574672186 learned_addr learned my addr 172.21.15.66:0/3574672186 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdeac977640 1 --2- 172.21.15.66:0/3574672186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 -- 172.21.15.66:0/3574672186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 msgr2=0x7fdea815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 --2- 172.21.15.66:0/3574672186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 -- 172.21.15.66:0/3574672186 >> v1:172.21.15.190:6789/0 conn(0x7fdea815f620 legacy=0x7fdea80704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.088+0000 7fdea7fff640 1 -- 172.21.15.66:0/3574672186 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea8160470 con 0x7fdea806c990 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.089+0000 7fdea7fff640 1 --2- 172.21.15.66:0/3574672186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea806c990 0x7fdea8163660 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fdea806cf10 tx=0x7fde9802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc9956183b6d55c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.089+0000 7fdea77fe640 1 -- 172.21.15.66:0/3574672186 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98037070 con 0x7fdea806c990 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.089+0000 7fdea77fe640 1 -- 172.21.15.66:0/3574672186 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde98032440 con 0x7fdea806c990 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.089+0000 7fdea77fe640 1 -- 172.21.15.66:0/3574672186 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98032810 con 0x7fdea806c990 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 -- 172.21.15.66:0/3574672186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea806c990 msgr2=0x7fdea8163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 --2- 172.21.15.66:0/3574672186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea806c990 0x7fdea8163660 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fdea806cf10 tx=0x7fde9802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 -- 172.21.15.66:0/3574672186 shutdown_connections 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 --2- 172.21.15.66:0/3574672186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 --2- 172.21.15.66:0/3574672186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea806c990 0x7fdea8163660 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 -- 172.21.15.66:0/3574672186 >> 172.21.15.66:0/3574672186 conn(0x7fdea80b3980 msgr2=0x7fdea80b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 -- 172.21.15.66:0/3574672186 shutdown_connections 2024-05-10T11:22:12.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.090+0000 7fdeae3da640 1 -- 172.21.15.66:0/3574672186 wait complete. 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.091+0000 7fdeae3da640 1 Processor -- start 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.091+0000 7fdeae3da640 1 -- start start 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeae3da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdea806c990 0x7fdea80b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeae3da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeae3da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 0x7fdea81f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeae3da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdea8073e70 con 0x7fdea815f620 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeae3da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdea8163140 con 0x7fdea806c990 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeae3da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdea80cf920 con 0x7fdea8070bd0 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 0x7fdea81f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 0x7fdea81f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48738/0 (socket says 172.21.15.66:48738) 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 -- 172.21.15.66:0/2572323292 learned_addr learned my addr 172.21.15.66:0/2572323292 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdea806c990 0x7fdea80b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 -- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 msgr2=0x7fdea814cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fde9ffff640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea814cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 -- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdea806c990 msgr2=0x7fdea80b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdea806c990 0x7fdea80b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdeac977640 1 -- 172.21.15.66:0/2572323292 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea80b4e50 con 0x7fdea815f620 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdea806c990 0x7fdea80b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.092+0000 7fde9ffff640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.093+0000 7fdeac977640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 0x7fdea81f5010 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdea000cd70 tx=0x7fdea000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.093+0000 7fdea57fa640 1 -- 172.21.15.66:0/2572323292 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0003b90 con 0x7fdea815f620 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.093+0000 7fdea57fa640 1 -- 172.21.15.66:0/2572323292 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea0003d30 con 0x7fdea815f620 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.093+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea80b5130 con 0x7fdea815f620 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.093+0000 7fdea57fa640 1 -- 172.21.15.66:0/2572323292 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0004240 con 0x7fdea815f620 2024-05-10T11:22:12.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.093+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea80b56f0 con 0x7fdea815f620 2024-05-10T11:22:12.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.094+0000 7fdea57fa640 1 -- 172.21.15.66:0/2572323292 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdea00043e0 con 0x7fdea815f620 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.095+0000 7fdea57fa640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde880762d0 0x7fde88078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.095+0000 7fdea57fa640 1 -- 172.21.15.66:0/2572323292 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fdea00981d0 con 0x7fdea815f620 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.095+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde880762d0 0x7fde88078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 Processor -- start 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde880762d0 0x7fde88078790 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fde98034000 tx=0x7fde9802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 -- start start 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea15c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea1596bb0 0x557ea159a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557ea15008d0 con 0x557ea15c3f50 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557ea14b9c10 con 0x557ea15c4330 2024-05-10T11:22:12.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557ea14fc890 con 0x557ea1596bb0 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdea7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea15c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdea7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea15c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48750/0 (socket says 172.21.15.66:48750) 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.096+0000 7fdea7fff640 1 -- 172.21.15.66:0/2877845493 learned_addr learned my addr 172.21.15.66:0/2877845493 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fde9ffff640 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdeac977640 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea1596bb0 0x557ea159a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdea7fff640 1 -- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea1596bb0 msgr2=0x557ea159a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea1596bb0 0x557ea159a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdea7fff640 1 -- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 msgr2=0x557ea15c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdea7fff640 1 -- 172.21.15.66:0/2877845493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea14c15d0 con 0x557ea15c3f50 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fde9ffff640 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fdea7fff640 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea15c6760 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fde980090b0 tx=0x7fde9802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8288fdac556aa928 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fde9dffb640 1 -- 172.21.15.66:0/2877845493 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9804d070 con 0x557ea15c3f50 2024-05-10T11:22:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fde9dffb640 1 -- 172.21.15.66:0/2877845493 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9803c460 con 0x557ea15c3f50 2024-05-10T11:22:12.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.097+0000 7fde9dffb640 1 -- 172.21.15.66:0/2877845493 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98037040 con 0x557ea15c3f50 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 -- 172.21.15.66:0/2877845493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 msgr2=0x557ea15c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea15c6760 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fde980090b0 tx=0x7fde9802c000 comp rx=0 tx=0).stop 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 -- 172.21.15.66:0/2877845493 shutdown_connections 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea1596bb0 0x557ea159a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/2877845493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea15c6760 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 -- 172.21.15.66:0/2877845493 >> 172.21.15.66:0/2877845493 conn(0x557ea1598e20 msgr2=0x557ea15e1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 -- 172.21.15.66:0/2877845493 shutdown_connections 2024-05-10T11:22:12.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 -- 172.21.15.66:0/2877845493 wait complete. 2024-05-10T11:22:12.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 -- start start 2024-05-10T11:22:12.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.098+0000 7fdeb11cc740 1 Processor -- start 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15c3f50 0x557ea15e5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15d93c0 0x557ea15dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557ea159bfd0 con 0x557ea15c4330 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557ea14bd760 con 0x557ea15d93c0 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557ea159c2b0 con 0x557ea15c3f50 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fdeb11cc740 10 client.0 _ll_register_callbacks cb 0x557ea14f6cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:12.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15dd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48764/0 (socket says 172.21.15.66:48764) 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.099+0000 7fde9ffff640 1 -- 172.21.15.66:0/1021628371 learned_addr learned my addr 172.21.15.66:0/1021628371 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeac977640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15d93c0 0x557ea15dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15c3f50 0x557ea15e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde9ffff640 1 -- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15c3f50 msgr2=0x557ea15e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15c3f50 0x557ea15e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde9ffff640 1 -- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15d93c0 msgr2=0x557ea15dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15d93c0 0x557ea15dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde9ffff640 1 -- 172.21.15.66:0/1021628371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea12122d0 con 0x557ea15c4330 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeac977640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15d93c0 0x557ea15dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15c3f50 0x557ea15e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15dd9d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fde9000e200 tx=0x7fde9000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4ce9d709e6026c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:12.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde86ffd640 1 -- 172.21.15.66:0/1021628371 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90018020 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde86ffd640 1 -- 172.21.15.66:0/1021628371 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fde90013660 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde9803c460 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde86ffd640 1 -- 172.21.15.66:0/1021628371 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fde90022050 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 10 client.8352 fetch_fsmap learned FSMap version 99 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x557ea12dc6b0 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde86ffd640 1 -- 172.21.15.66:0/1021628371 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9803c460 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fde86ffd640 1 -- 172.21.15.66:0/1021628371 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 99) ==== 3494+0+0 (secure 0 0 0) 0x7fde90004020 con 0x557ea15c4330 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 10 client.8352 fetch_fsmap finished waiting for FSMap version 99 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 10 client.8352 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 20 client.8352 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15e3070 0x557ea15ff950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 4 client.8352 mds_command: new command op to 7093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.100+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 --> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ea1484760 con 0x557ea15e3070 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.101+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15e3070 0x557ea15ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.101+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15e3070 0x557ea15ff950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba782267606131e server_cookie=f1d452b00db3c111 in_seq=0 out_seq=0 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.101+0000 7fde86ffd640 10 client.8352 ms_handle_connect on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fde86ffd640 1 -- 172.21.15.66:0/1021628371 <== mds.0 v2:172.21.15.190:6834/3723690401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557ea1484760 con 0x557ea15e3070 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fde86ffd640 10 client.8352 handle_command_reply: tid=0 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 client.8352 shutdown 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 msgr2=0x557ea15dd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15dd9d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fde9000e200 tx=0x7fde9000e6c0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 shutdown_connections 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15e3070 0x557ea15ff950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15d93c0 0x557ea15dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15dd9d0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fde86ffd640 0 client.8352 ms_handle_reset on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1021628371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15c3f50 0x557ea15e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 >> 172.21.15.66:0/1021628371 conn(0x557ea1596bb0 msgr2=0x557ea159b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 shutdown_connections 2024-05-10T11:22:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.102+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1021628371 wait complete. 2024-05-10T11:22:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.103+0000 7fdeb11cc740 20 client.8352 trim_cache size 0 max 16384 2024-05-10T11:22:12.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.121+0000 7fdeb11cc740 1 Processor -- start 2024-05-10T11:22:12.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.121+0000 7fdeb11cc740 1 -- start start 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c3f50 0x557ea15c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15d8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdea8201060 con 0x557ea15c4330 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80b0820 con 0x557ea15c3f50 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdea80b3230 con 0x557ea15d93c0 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15d8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15d8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48780/0 (socket says 172.21.15.66:48780) 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 -- 172.21.15.66:0/1358485367 learned_addr learned my addr 172.21.15.66:0/1358485367 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c3f50 0x557ea15c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 -- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 msgr2=0x557ea15d8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeac977640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 -- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c3f50 msgr2=0x557ea15c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c3f50 0x557ea15c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 -- 172.21.15.66:0/1358485367 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea15dc100 con 0x557ea15c4330 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c3f50 0x557ea15c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fdeac977640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.122+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15d8800 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fde9000cb70 tx=0x7fde90014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6854006d24b93f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fde9d7fa640 1 -- 172.21.15.66:0/1358485367 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9002b070 con 0x557ea15c4330 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fde9d7fa640 1 -- 172.21.15.66:0/1358485367 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde90013860 con 0x557ea15c4330 2024-05-10T11:22:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fde9d7fa640 1 -- 172.21.15.66:0/1358485367 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90018040 con 0x557ea15c4330 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1358485367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 msgr2=0x557ea15d8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15d8800 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fde9000cb70 tx=0x7fde90014000 comp rx=0 tx=0).stop 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1358485367 shutdown_connections 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c4330 0x557ea15d8800 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1358485367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c3f50 0x557ea15c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1358485367 >> 172.21.15.66:0/1358485367 conn(0x557ea1596bb0 msgr2=0x557ea15c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1358485367 shutdown_connections 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.123+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1358485367 wait complete. 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.124+0000 7fdeb11cc740 1 -- start start 2024-05-10T11:22:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.124+0000 7fdeb11cc740 1 Processor -- start 2024-05-10T11:22:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea165f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15d87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557ea15e2ef0 con 0x557ea15c3f50 2024-05-10T11:22:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557ea15d9840 con 0x557ea15c4330 2024-05-10T11:22:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557ea15e34b0 con 0x557ea15d93c0 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 10 client.0 _ll_register_callbacks cb 0x7fde90006e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea165f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea165f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48796/0 (socket says 172.21.15.66:48796) 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 -- 172.21.15.66:0/1875225108 learned_addr learned my addr 172.21.15.66:0/1875225108 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeac977640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15d87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 -- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 msgr2=0x557ea15d8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 -- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 msgr2=0x557ea15d87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15d87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 -- 172.21.15.66:0/1875225108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea15daf90 con 0x557ea15c3f50 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeac977640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15d87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdea7fff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea165f090 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fde98009630 tx=0x7fde9802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb028224576b688 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fde86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fde86ffd640 1 -- 172.21.15.66:0/1875225108 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9804d040 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fde86ffd640 1 -- 172.21.15.66:0/1875225108 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fde98043040 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.125+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde90013860 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fde86ffd640 1 -- 172.21.15.66:0/1875225108 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fde9805e050 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 10 client.8358 fetch_fsmap learned FSMap version 99 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x557ea15bb340 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fde86ffd640 1 -- 172.21.15.66:0/1875225108 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde90013860 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fde86ffd640 1 -- 172.21.15.66:0/1875225108 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 99) ==== 3494+0+0 (secure 0 0 0) 0x7fde98061020 con 0x557ea15c3f50 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 10 client.8358 fetch_fsmap finished waiting for FSMap version 99 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 10 client.8358 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 20 client.8358 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15c20c0 0x557ea15d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 4 client.8358 mds_command: new command op to 7093 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 --> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] -- command(tid 0: {"prefix": "status"}) -- 0x557ea150e4e0 con 0x557ea15c20c0 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15c20c0 0x557ea15d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fde86ffd640 10 client.8358 ms_handle_connect on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.126+0000 7fde9ffff640 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15c20c0 0x557ea15d70f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4be13fce32eb2a9 server_cookie=8b04cffc25d46cfc in_seq=0 out_seq=0 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fde86ffd640 1 -- 172.21.15.66:0/1875225108 <== mds.0 v2:172.21.15.190:6834/3723690401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557ea150e4e0 con 0x557ea15c20c0 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fde86ffd640 10 client.8358 handle_command_reply: tid=0 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 client.8358 shutdown 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 msgr2=0x557ea165f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea165f090 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fde98009630 tx=0x7fde9802c070 comp rx=0 tx=0).stop 2024-05-10T11:22:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 shutdown_connections 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x557ea15c20c0 0x557ea15d70f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557ea15d93c0 0x557ea15d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ea15c4330 0x557ea15d87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 --2- 172.21.15.66:0/1875225108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557ea15c3f50 0x557ea165f090 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fde86ffd640 0 client.8358 ms_handle_reset on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 >> 172.21.15.66:0/1875225108 conn(0x557ea1596bb0 msgr2=0x557ea159a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 shutdown_connections 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 1 -- 172.21.15.66:0/1875225108 wait complete. 2024-05-10T11:22:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeb11cc740 20 client.8358 trim_cache size 0 max 16384 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 7093, 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 5.7640103659999999, 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 99, 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 118, 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 118, 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 10.737108719 2024-05-10T11:22:12.134 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde880762d0 msgr2=0x7fde88078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeae3da640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde880762d0 0x7fde88078790 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fde98034000 tx=0x7fde9802e000 comp rx=0 tx=0).stop 2024-05-10T11:22:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 msgr2=0x7fdea81f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.127+0000 7fdeae3da640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 0x7fdea81f5010 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdea000cd70 tx=0x7fdea000a660 comp rx=0 tx=0).stop 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 shutdown_connections 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fde880762d0 0x7fde88078790 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdea815f620 0x7fdea81f5010 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdea8070bd0 0x7fdea814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 --2- 172.21.15.66:0/2572323292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdea806c990 0x7fdea80b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 >> 172.21.15.66:0/2572323292 conn(0x7fdea80b3980 msgr2=0x7fdea80704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 shutdown_connections 2024-05-10T11:22:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.128+0000 7fdeae3da640 1 -- 172.21.15.66:0/2572323292 wait complete. 2024-05-10T11:22:12.138 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:22:12.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.242+0000 7f437d01c640 1 Processor -- start 2024-05-10T11:22:12.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.243+0000 7f437d01c640 1 -- start start 2024-05-10T11:22:12.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.243+0000 7f437d01c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f43780d5d30 0x7f437816a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.243+0000 7f437d01c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780d30b0 con 0x7f437815f3b0 2024-05-10T11:22:12.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.243+0000 7f437d01c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780d3390 con 0x7f437815f790 2024-05-10T11:22:12.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.243+0000 7f437d01c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f43780c8c80 con 0x7f43780d5d30 2024-05-10T11:22:12.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.243+0000 7f437759e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f43780d5d30 0x7f437816a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.244+0000 7f4376d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f437815f3b0 0x7f43780d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34976/0 (socket says 172.21.15.66:34976) 2024-05-10T11:22:12.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.244+0000 7f4376d9d640 1 -- 172.21.15.66:0/409703383 learned_addr learned my addr 172.21.15.66:0/409703383 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:12.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.244+0000 7f437759e640 1 -- 172.21.15.66:0/409703383 >> v1:172.21.15.190:6789/0 conn(0x7f437815f790 legacy=0x7f43780cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.244+0000 7f437759e640 1 -- 172.21.15.66:0/409703383 >> v1:172.21.15.66:6789/0 conn(0x7f437815f3b0 legacy=0x7f43780d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.244+0000 7f4375d9b640 1 -- 172.21.15.66:0/409703383 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792987551 0 0) 0x7f43780d30b0 con 0x7f437815f3b0 2024-05-10T11:22:12.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.244+0000 7f437759e640 1 -- 172.21.15.66:0/409703383 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43780c8f60 con 0x7f43780d5d30 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437759e640 1 --2- 172.21.15.66:0/409703383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f437816a0c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4370009d90 tx=0x7f437002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a54302a90fe0538 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f4375d9b640 1 -- 172.21.15.66:0/409703383 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370007740 con 0x7f43780d5d30 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f4375d9b640 1 -- 172.21.15.66:0/409703383 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43700078e0 con 0x7f43780d5d30 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f4375d9b640 1 -- 172.21.15.66:0/409703383 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370007cb0 con 0x7f43780d5d30 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 -- 172.21.15.66:0/409703383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 msgr2=0x7f437816a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 --2- 172.21.15.66:0/409703383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f437816a0c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4370009d90 tx=0x7f437002a6f0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 -- 172.21.15.66:0/409703383 shutdown_connections 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 --2- 172.21.15.66:0/409703383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f437816a0c0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 -- 172.21.15.66:0/409703383 >> 172.21.15.66:0/409703383 conn(0x7f43780d5130 msgr2=0x7f43780d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 -- 172.21.15.66:0/409703383 shutdown_connections 2024-05-10T11:22:12.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.245+0000 7f437d01c640 1 -- 172.21.15.66:0/409703383 wait complete. 2024-05-10T11:22:12.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.247+0000 7f437d01c640 1 Processor -- start 2024-05-10T11:22:12.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.247+0000 7f437d01c640 1 -- start start 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.247+0000 7f437d01c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f43780ba780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f437815f3b0 0x7f4378161e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43780cec50 0x7f43780cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43780d3f80 con 0x7f43780d5d30 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43780d3e00 con 0x7f43780cec50 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43780ca770 con 0x7f437815f3b0 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f43780ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f43780ba780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48818/0 (socket says 172.21.15.66:48818) 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 -- 172.21.15.66:0/1837158763 learned_addr learned my addr 172.21.15.66:0/1837158763 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:12.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 -- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f437815f3b0 msgr2=0x7f4378161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f437815f3b0 0x7f4378161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 -- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43780cec50 msgr2=0x7f43780cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43780cec50 0x7f43780cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 -- 172.21.15.66:0/1837158763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4378160d70 con 0x7f43780d5d30 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f4376d9d640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f43780ba780 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f436800c4a0 tx=0x7f436800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368018070 con 0x7f43780d5d30 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43680074e0 con 0x7f43780d5d30 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4378161050 con 0x7f43780d5d30 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368004a20 con 0x7f43780d5d30 2024-05-10T11:22:12.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.248+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4378161610 con 0x7f43780d5d30 2024-05-10T11:22:12.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.249+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43780d3150 con 0x7f43780d5d30 2024-05-10T11:22:12.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.250+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f436801b070 con 0x7f43780d5d30 2024-05-10T11:22:12.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.251+0000 7f435f7fe640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43640762d0 0x7f4364078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:12.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.251+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f4368096af0 con 0x7f43780d5d30 2024-05-10T11:22:12.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.251+0000 7f437659c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43640762d0 0x7f4364078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:12.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.252+0000 7f437659c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43640762d0 0x7f4364078790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f436c000f60 tx=0x7f436c0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:12.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.255+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f43780d3150 con 0x7f43780d5d30 2024-05-10T11:22:12.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.490+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f437806a220 con 0x7f43780d5d30 2024-05-10T11:22:12.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.491+0000 7f435f7fe640 1 -- 172.21.15.66:0/1837158763 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v99) ==== 53+0+73 (secure 0 0 0) 0x7f43680602c0 con 0x7f43780d5d30 2024-05-10T11:22:12.490 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:22:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43640762d0 msgr2=0x7f4364078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43640762d0 0x7f4364078790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f436c000f60 tx=0x7f436c0079b0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 msgr2=0x7f43780ba780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f43780ba780 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f436800c4a0 tx=0x7f436800c960 comp rx=0 tx=0).stop 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 shutdown_connections 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f43640762d0 0x7f4364078790 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43780cec50 0x7f43780cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f437815f3b0 0x7f4378161e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 --2- 172.21.15.66:0/1837158763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43780d5d30 0x7f43780ba780 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 >> 172.21.15.66:0/1837158763 conn(0x7f43780d5130 msgr2=0x7f437806e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 shutdown_connections 2024-05-10T11:22:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12.493+0000 7f437d01c640 1 -- 172.21.15.66:0/1837158763 wait complete. 2024-05-10T11:22:12.503 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:22:12.503 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:22:12.504 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:12.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:12.504 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42161sec preferred_lft 42161sec 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:22:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:22:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:12.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:12.524 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:22:12.586 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:12.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:12.587 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:22:12.644 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:22:12.644 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:22:12.644 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:22:12.644 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:22:12.644 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:22:12.645 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:22:12.645 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:22:12.645 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:22:12.645 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:22:12.645 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:22:12.645 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:22:12.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:22:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:12.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:12.774 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:22:12.790 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:22:12.790 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:22:12.790 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:12.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:12.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:22:12.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:12.857 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:12.913 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:12.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:12.914 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:12.969 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:22:12.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:12.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:13.054 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:13.055 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:13.055 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:13.063 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:13.064 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:13.064 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:13.064 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:13.064 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:13.071 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:13.071 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:13.071 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:13.071 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:13.072 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:13.072 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:22:13.072 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:22:13.072 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:22:13.072 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:22:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:22:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:22:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:22:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:22:13.074 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:22:13.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:13.074 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:13.101 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:22:13.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:22:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:13.206 INFO:teuthology.orchestra.run.smithi066.stdout:client6569 2024-05-10T11:22:13.207 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:13.207 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> parent = os.path.join(mount_point, "parent") 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> os.mkdir(parent) 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> flushed = os.path.join(parent, "flushed") 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> os.mkdir(flushed) 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> for f in ["alpha", "bravo", "charlie"]: 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-05-10T11:22:13.225 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:13.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:13.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:13.353 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T11:22:13.415 INFO:teuthology.orchestra.run.smithi066.stdout:./ 2024-05-10T11:22:13.415 INFO:teuthology.orchestra.run.smithi066.stdout:./parent 2024-05-10T11:22:13.415 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed 2024-05-10T11:22:13.415 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/charlie 2024-05-10T11:22:13.415 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/alpha 2024-05-10T11:22:13.415 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/bravo 2024-05-10T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:13.523 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:13.533 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:13.533 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:13.533 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:13.533 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:13.533 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-05-10T11:22:13.533 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:13.641 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:22:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:13.650 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:13.651 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:13.651 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:13.651 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:13.651 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-05-10T11:22:13.651 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:13.759 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:22:13.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:13.768 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:13.768 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:13.768 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:13.768 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:13.768 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-05-10T11:22:13.768 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:13.876 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628280 2024-05-10T11:22:13.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:13.885 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:13.885 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:13.885 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:13.886 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:13.886 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-05-10T11:22:13.886 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:13.993 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627778 2024-05-10T11:22:13.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:14.003 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:14.003 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:14.003 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:14.003 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:14.003 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-05-10T11:22:14.003 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:14.111 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628279 2024-05-10T11:22:14.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:14.120 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:14.120 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:14.177 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:14.177 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:14.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:22:14.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.380+0000 7f04863dd640 1 Processor -- start 2024-05-10T11:22:14.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.380+0000 7f04863dd640 1 -- start start 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f04863dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f790 0x7f04800cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f04863dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f04800d5d30 0x7f04800d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f04863dd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04800d30b0 con 0x7f048015f3b0 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f04863dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f04800d3390 con 0x7f04800d5d30 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f04863dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f04800c8c80 con 0x7f048015f790 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f047ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f048015f3b0 0x7f04800d36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34984/0 (socket says 172.21.15.66:34984) 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f047ffff640 1 -- 172.21.15.66:0/3845255314 learned_addr learned my addr 172.21.15.66:0/3845255314 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f047f7fe640 1 --2- 172.21.15.66:0/3845255314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f790 0x7f04800cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f048497a640 1 --2- 172.21.15.66:0/3845255314 >> v2:172.21.15.190:3300/0 conn(0x7f04800d5d30 0x7f04800d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f047effd640 1 -- 172.21.15.66:0/3845255314 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163251077 0 0) 0x7f04800d30b0 con 0x7f048015f3b0 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.381+0000 7f047effd640 1 -- 172.21.15.66:0/3845255314 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0468003520 con 0x7f048015f3b0 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.382+0000 7f047f7fe640 1 -- 172.21.15.66:0/3845255314 >> v2:172.21.15.190:3300/0 conn(0x7f04800d5d30 msgr2=0x7f04800d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.382+0000 7f047f7fe640 1 --2- 172.21.15.66:0/3845255314 >> v2:172.21.15.190:3300/0 conn(0x7f04800d5d30 0x7f04800d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.382+0000 7f047f7fe640 1 -- 172.21.15.66:0/3845255314 >> v1:172.21.15.66:6789/0 conn(0x7f048015f3b0 legacy=0x7f04800d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.382+0000 7f047f7fe640 1 -- 172.21.15.66:0/3845255314 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04800c8f60 con 0x7f048015f790 2024-05-10T11:22:14.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.382+0000 7f048497a640 1 --2- 172.21.15.66:0/3845255314 >> v2:172.21.15.190:3300/0 conn(0x7f04800d5d30 0x7f04800d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:14.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.382+0000 7f047f7fe640 1 --2- 172.21.15.66:0/3845255314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f790 0x7f04800cfcd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f04740097a0 tx=0x7f047402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a458e8a3026150 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f047effd640 1 -- 172.21.15.66:0/3845255314 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474037070 con 0x7f048015f790 2024-05-10T11:22:14.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f047effd640 1 -- 172.21.15.66:0/3845255314 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0474032440 con 0x7f048015f790 2024-05-10T11:22:14.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f047effd640 1 -- 172.21.15.66:0/3845255314 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740327f0 con 0x7f048015f790 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 -- 172.21.15.66:0/3845255314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f790 msgr2=0x7f04800cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 --2- 172.21.15.66:0/3845255314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f790 0x7f04800cfcd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f04740097a0 tx=0x7f047402a180 comp rx=0 tx=0).stop 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 -- 172.21.15.66:0/3845255314 shutdown_connections 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 --2- 172.21.15.66:0/3845255314 >> v2:172.21.15.190:3300/0 conn(0x7f04800d5d30 0x7f04800d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 --2- 172.21.15.66:0/3845255314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f790 0x7f04800cfcd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 -- 172.21.15.66:0/3845255314 >> 172.21.15.66:0/3845255314 conn(0x7f04800d5130 msgr2=0x7f04800d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 -- 172.21.15.66:0/3845255314 shutdown_connections 2024-05-10T11:22:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.383+0000 7f04863dd640 1 -- 172.21.15.66:0/3845255314 wait complete. 2024-05-10T11:22:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.385+0000 7f04863dd640 1 Processor -- start 2024-05-10T11:22:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.385+0000 7f04863dd640 1 -- start start 2024-05-10T11:22:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 0x7f0480158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f3b0 0x7f04800cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04801f41c0 0x7f04800caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04800d3f80 con 0x7f04800d5d30 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f04800d3e00 con 0x7f04801f41c0 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f04800ca770 con 0x7f048015f3b0 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 0x7f0480158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 0x7f0480158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48828/0 (socket says 172.21.15.66:48828) 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 -- 172.21.15.66:0/1983204861 learned_addr learned my addr 172.21.15.66:0/1983204861 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047f7fe640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f3b0 0x7f04800cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f048497a640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04801f41c0 0x7f04800caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 -- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f3b0 msgr2=0x7f04800cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f3b0 0x7f04800cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 -- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04801f41c0 msgr2=0x7f04800caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04801f41c0 0x7f04800caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 -- 172.21.15.66:0/1983204861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0480158e30 con 0x7f04800d5d30 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f048497a640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04801f41c0 0x7f04800caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047ffff640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 0x7f0480158690 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f047000c430 tx=0x7f047000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470017070 con 0x7f04800d5d30 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0470005ce0 con 0x7f04800d5d30 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0480159110 con 0x7f04800d5d30 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.386+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04700072f0 con 0x7f04800d5d30 2024-05-10T11:22:14.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.387+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04801596d0 con 0x7f04800d5d30 2024-05-10T11:22:14.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.388+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048006a220 con 0x7f04800d5d30 2024-05-10T11:22:14.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.388+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f047001a070 con 0x7f04800d5d30 2024-05-10T11:22:14.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.389+0000 7f047cff9640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f046c0762d0 0x7f046c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.389+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f0470096b50 con 0x7f04800d5d30 2024-05-10T11:22:14.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.389+0000 7f047f7fe640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f046c0762d0 0x7f046c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.389+0000 7f047f7fe640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f046c0762d0 0x7f046c078790 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0474034000 tx=0x7f047402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.393+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f047005fcd0 con 0x7f04800d5d30 2024-05-10T11:22:14.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.598+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f04800d1ce0 con 0x7f04800d5d30 2024-05-10T11:22:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.598+0000 7f047cff9640 1 -- 172.21.15.66:0/1983204861 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f0470063fd0 con 0x7f04800d5d30 2024-05-10T11:22:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:22:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f046c0762d0 msgr2=0x7f046c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f046c0762d0 0x7f046c078790 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0474034000 tx=0x7f047402e000 comp rx=0 tx=0).stop 2024-05-10T11:22:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 msgr2=0x7f0480158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 0x7f0480158690 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f047000c430 tx=0x7f047000c8f0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 shutdown_connections 2024-05-10T11:22:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f046c0762d0 0x7f046c078790 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04801f41c0 0x7f04800caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048015f3b0 0x7f04800cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 --2- 172.21.15.66:0/1983204861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04800d5d30 0x7f0480158690 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 >> 172.21.15.66:0/1983204861 conn(0x7f04800d5130 msgr2=0x7f04800d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 shutdown_connections 2024-05-10T11:22:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.600+0000 7f04863dd640 1 -- 172.21.15.66:0/1983204861 wait complete. 2024-05-10T11:22:14.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:22:14.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:14.611 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:14.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:22:14.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:14.673 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:22:14.695 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-05-10T11:22:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.843+0000 7f82f2566640 1 Processor -- start 2024-05-10T11:22:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.843+0000 7f82f2566640 1 -- start start 2024-05-10T11:22:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.843+0000 7f82f2566640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f82ec0cffd0 0x7f82ec0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82f2566640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ec06e720 con 0x7f82ec0cd500 2024-05-10T11:22:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82f2566640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ec06de80 con 0x7f82ec0cf3e0 2024-05-10T11:22:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82f2566640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f82ec06e160 con 0x7f82ec0cffd0 2024-05-10T11:22:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82eb7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f82ec0cffd0 0x7f82ec0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82f0b03640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f82ec0cd500 0x7f82ec0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36764/0 (socket says 172.21.15.66:36764) 2024-05-10T11:22:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82f0b03640 1 -- 172.21.15.66:0/1916906618 learned_addr learned my addr 172.21.15.66:0/1916906618 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82eb7fe640 1 -- 172.21.15.66:0/1916906618 >> v1:172.21.15.190:6789/0 conn(0x7f82ec0cf3e0 legacy=0x7f82ec0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82eb7fe640 1 -- 172.21.15.66:0/1916906618 >> v1:172.21.15.66:6789/0 conn(0x7f82ec0cd500 legacy=0x7f82ec0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.844+0000 7f82eb7fe640 1 -- 172.21.15.66:0/1916906618 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec06e440 con 0x7f82ec0cffd0 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.845+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/1916906618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec0b3de0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f82e00097a0 tx=0x7f82e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cf1b1b90bd96a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.845+0000 7f82eaffd640 1 -- 172.21.15.66:0/1916906618 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0037070 con 0x7f82ec0cffd0 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.845+0000 7f82eaffd640 1 -- 172.21.15.66:0/1916906618 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e0032440 con 0x7f82ec0cffd0 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.845+0000 7f82eaffd640 1 -- 172.21.15.66:0/1916906618 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0032810 con 0x7f82ec0cffd0 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.845+0000 7f82f2566640 1 -- 172.21.15.66:0/1916906618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 msgr2=0x7f82ec0b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.845+0000 7f82f2566640 1 --2- 172.21.15.66:0/1916906618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec0b3de0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f82e00097a0 tx=0x7f82e002a1e0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.846+0000 7f82f2566640 1 -- 172.21.15.66:0/1916906618 shutdown_connections 2024-05-10T11:22:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.846+0000 7f82f2566640 1 --2- 172.21.15.66:0/1916906618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec0b3de0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.846+0000 7f82f2566640 1 -- 172.21.15.66:0/1916906618 >> 172.21.15.66:0/1916906618 conn(0x7f82ec0d2eb0 msgr2=0x7f82ec0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.846+0000 7f82f2566640 1 -- 172.21.15.66:0/1916906618 shutdown_connections 2024-05-10T11:22:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.846+0000 7f82f2566640 1 -- 172.21.15.66:0/1916906618 wait complete. 2024-05-10T11:22:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.847+0000 7f82f2566640 1 Processor -- start 2024-05-10T11:22:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.847+0000 7f82f2566640 1 -- start start 2024-05-10T11:22:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f2566640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82ec0cd500 0x7f82ec0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f2566640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82ec0cf3e0 0x7f82ec160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f2566640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec1610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f2566640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec0d1890 con 0x7f82ec0cffd0 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f2566640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec0b4510 con 0x7f82ec0cf3e0 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f2566640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f82ec0d1a10 con 0x7f82ec0cd500 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec1610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec1610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45616/0 (socket says 172.21.15.66:45616) 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 -- 172.21.15.66:0/4125943155 learned_addr learned my addr 172.21.15.66:0/4125943155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82ec0cf3e0 0x7f82ec160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82ebfff640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82ec0cd500 0x7f82ec0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 -- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82ec0cd500 msgr2=0x7f82ec0c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82ec0cd500 0x7f82ec0c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 -- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82ec0cf3e0 msgr2=0x7f82ec160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82ec0cf3e0 0x7f82ec160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 -- 172.21.15.66:0/4125943155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec0c7ed0 con 0x7f82ec0cffd0 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82ec0cf3e0 0x7f82ec160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82ebfff640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82ec0cd500 0x7f82ec0c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82f0b03640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec1610f0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f82e400cb20 tx=0x7f82e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.848+0000 7f82e8ff9640 1 -- 172.21.15.66:0/4125943155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4017070 con 0x7f82ec0cffd0 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.849+0000 7f82e8ff9640 1 -- 172.21.15.66:0/4125943155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e400aca0 con 0x7f82ec0cffd0 2024-05-10T11:22:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.849+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ec0c81b0 con 0x7f82ec0cffd0 2024-05-10T11:22:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.849+0000 7f82e8ff9640 1 -- 172.21.15.66:0/4125943155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4012600 con 0x7f82ec0cffd0 2024-05-10T11:22:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.849+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ec0c8770 con 0x7f82ec0cffd0 2024-05-10T11:22:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.850+0000 7f82e8ff9640 1 -- 172.21.15.66:0/4125943155 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82e401a070 con 0x7f82ec0cffd0 2024-05-10T11:22:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.851+0000 7f82e8ff9640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f82d80762d0 0x7f82d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.851+0000 7f82e8ff9640 1 -- 172.21.15.66:0/4125943155 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f82e40973e0 con 0x7f82ec0cffd0 2024-05-10T11:22:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.851+0000 7f82ebfff640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f82d80762d0 0x7f82d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 Processor -- start 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 -- start start 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82ebfff640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f82d80762d0 0x7f82d8078790 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f82dc007fd0 tx=0x7f82dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1d9b40 0x56525d1ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56525d176690 con 0x56525d1da280 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56525d113f30 con 0x56525d1f7160 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56525d0ccb20 con 0x56525d1d9b40 2024-05-10T11:22:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45622/0 (socket says 172.21.15.66:45622) 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.852+0000 7f82eb7fe640 1 -- 172.21.15.66:0/2610105009 learned_addr learned my addr 172.21.15.66:0/2610105009 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82ebfff640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82f0b03640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1d9b40 0x56525d1ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82eb7fe640 1 -- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1d9b40 msgr2=0x56525d1ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1d9b40 0x56525d1ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82eb7fe640 1 -- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 msgr2=0x56525d1a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82eb7fe640 1 -- 172.21.15.66:0/2610105009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56525d0c4e60 con 0x56525d1da280 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82ebfff640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82f0b03640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1d9b40 0x56525d1ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d9600 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f82e00098c0 tx=0x7f82e002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3515cc2f7ff5e7e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82d1ffb640 1 -- 172.21.15.66:0/2610105009 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0037040 con 0x56525d1da280 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82d1ffb640 1 -- 172.21.15.66:0/2610105009 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e0032740 con 0x56525d1da280 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.853+0000 7f82d1ffb640 1 -- 172.21.15.66:0/2610105009 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0032b10 con 0x56525d1da280 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 -- 172.21.15.66:0/2610105009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 msgr2=0x56525d1d9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d9600 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f82e00098c0 tx=0x7f82e002c000 comp rx=0 tx=0).stop 2024-05-10T11:22:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 -- 172.21.15.66:0/2610105009 shutdown_connections 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1d9b40 0x56525d1ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d9600 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 --2- 172.21.15.66:0/2610105009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 -- 172.21.15.66:0/2610105009 >> 172.21.15.66:0/2610105009 conn(0x56525d1abd60 msgr2=0x56525d1f4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 -- 172.21.15.66:0/2610105009 shutdown_connections 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 -- 172.21.15.66:0/2610105009 wait complete. 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.854+0000 7f82f527f740 1 -- start start 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 Processor -- start 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56525d0d05e0 con 0x56525d1da280 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56525d10fef0 con 0x56525d1f7160 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56525d1adf10 con 0x56525d1eb920 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82f527f740 10 client.0 _ll_register_callbacks cb 0x56525d0cb320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82ebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82ebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45626/0 (socket says 172.21.15.66:45626) 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.855+0000 7f82ebfff640 1 -- 172.21.15.66:0/2718486276 learned_addr learned my addr 172.21.15.66:0/2718486276 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82f0b03640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82ebfff640 1 -- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 msgr2=0x56525d1c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82ebfff640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82ebfff640 1 -- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 msgr2=0x56525d1eb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82ebfff640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1eb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82ebfff640 1 -- 172.21.15.66:0/2718486276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56525ceef7d0 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82f0b03640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82ebfff640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d6860 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00ddd0 tx=0x7f82dc000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d4dd1770ada8a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82caffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82caffd640 1 -- 172.21.15.66:0/2718486276 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc026060 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82caffd640 1 -- 172.21.15.66:0/2718486276 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f82dc021c20 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e0032740 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82caffd640 1 -- 172.21.15.66:0/2718486276 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f82dc021e20 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82f527f740 10 client.8388 fetch_fsmap learned FSMap version 99 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x56525ce253f0 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.856+0000 7f82caffd640 1 -- 172.21.15.66:0/2718486276 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e0032740 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82caffd640 1 -- 172.21.15.66:0/2718486276 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 99) ==== 3494+0+0 (secure 0 0 0) 0x7f82dc021460 con 0x56525d1da280 2024-05-10T11:22:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82f527f740 10 client.8388 fetch_fsmap finished waiting for FSMap version 99 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82f527f740 10 client.8388 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82f527f740 20 client.8388 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82f527f740 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d1c79f0 0x56525d1dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82f527f740 4 client.8388 mds_command: new command op to 7093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 --> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56525d121b40 con 0x56525d1c79f0 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d1c79f0 0x56525d1dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82caffd640 10 client.8388 ms_handle_connect on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.857+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d1c79f0 0x56525d1dcef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640caeba69155ea2 server_cookie=bb83922a07d68bac in_seq=0 out_seq=0 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82caffd640 1 -- 172.21.15.66:0/2718486276 <== mds.0 v2:172.21.15.190:6834/3723690401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56525d121b40 con 0x56525d1c79f0 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82caffd640 10 client.8388 handle_command_reply: tid=0 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 client.8388 shutdown 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 msgr2=0x56525d1d6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d6860 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00ddd0 tx=0x7f82dc000fb0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 shutdown_connections 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d1c79f0 0x56525d1dcef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1f7160 0x56525d1eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 --2- 172.21.15.66:0/2718486276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1d6860 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82caffd640 0 client.8388 ms_handle_reset on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 >> 172.21.15.66:0/2718486276 conn(0x56525d1d9b40 msgr2=0x56525d1a9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 shutdown_connections 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 1 -- 172.21.15.66:0/2718486276 wait complete. 2024-05-10T11:22:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.858+0000 7f82f527f740 20 client.8388 trim_cache size 0 max 16384 2024-05-10T11:22:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.873+0000 7f82f527f740 1 Processor -- start 2024-05-10T11:22:14.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 -- start start 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1da280 0x56525d1dced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1dd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 0x56525d1aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec201fd0 con 0x56525d1f7160 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec200ff0 con 0x56525d1da280 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f82ec0b77e0 con 0x56525d1eb920 2024-05-10T11:22:14.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f0b03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 0x56525d1aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f0b03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 0x56525d1aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45630/0 (socket says 172.21.15.66:45630) 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82f0b03640 1 -- 172.21.15.66:0/269887565 learned_addr learned my addr 172.21.15.66:0/269887565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82ebfff640 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1da280 0x56525d1dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.874+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f0b03640 1 -- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 msgr2=0x56525d1dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f0b03640 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1dd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f0b03640 1 -- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1da280 msgr2=0x56525d1dced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f0b03640 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1da280 0x56525d1dced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f0b03640 1 -- 172.21.15.66:0/269887565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56525cde50f0 con 0x56525d1f7160 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82ebfff640 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1da280 0x56525d1dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f0b03640 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 0x56525d1aee90 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f82e4060260 tx=0x7f82e405fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330381df8a79a0bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82d17fa640 1 -- 172.21.15.66:0/269887565 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e405c7f0 con 0x56525d1f7160 2024-05-10T11:22:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82d17fa640 1 -- 172.21.15.66:0/269887565 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e4068df0 con 0x56525d1f7160 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82d17fa640 1 -- 172.21.15.66:0/269887565 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4095ba0 con 0x56525d1f7160 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 -- 172.21.15.66:0/269887565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 msgr2=0x56525d1aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 0x56525d1aee90 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f82e4060260 tx=0x7f82e405fe00 comp rx=0 tx=0).stop 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 -- 172.21.15.66:0/269887565 shutdown_connections 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1f7160 0x56525d1aee90 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1eb920 0x56525d1dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 --2- 172.21.15.66:0/269887565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1da280 0x56525d1dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 -- 172.21.15.66:0/269887565 >> 172.21.15.66:0/269887565 conn(0x56525d1d9b40 msgr2=0x56525d1a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 -- 172.21.15.66:0/269887565 shutdown_connections 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.875+0000 7f82f527f740 1 -- 172.21.15.66:0/269887565 wait complete. 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.876+0000 7f82f527f740 1 -- start start 2024-05-10T11:22:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.876+0000 7f82f527f740 1 Processor -- start 2024-05-10T11:22:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1eb920 0x56525d217100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1f7160 0x56525d206d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec2009a0 con 0x56525d1da280 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56525d0d2920 con 0x56525d1eb920 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56525d217c60 con 0x56525d1f7160 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f527f740 10 client.0 _ll_register_callbacks cb 0x7f82dc001ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45634/0 (socket says 172.21.15.66:45634) 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 -- 172.21.15.66:0/3763792909 learned_addr learned my addr 172.21.15.66:0/3763792909 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82f0b03640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1f7160 0x56525d206d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1eb920 0x56525d217100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 -- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1f7160 msgr2=0x56525d206d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1f7160 0x56525d206d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 -- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1eb920 msgr2=0x56525d217100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1eb920 0x56525d217100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.877+0000 7f82ebfff640 1 -- 172.21.15.66:0/3763792909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56525d1f2b70 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82ebfff640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1f2630 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00d6d0 tx=0x7f82dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fab5abf97251a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82caffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82caffd640 1 -- 172.21.15.66:0/3763792909 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0219b0 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82caffd640 1 -- 172.21.15.66:0/3763792909 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f82dc021b50 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e4068df0 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82caffd640 1 -- 172.21.15.66:0/3763792909 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f82dc03c050 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 10 client.8394 fetch_fsmap learned FSMap version 99 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x56525d1ebeb0 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82caffd640 1 -- 172.21.15.66:0/3763792909 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e4068df0 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82caffd640 1 -- 172.21.15.66:0/3763792909 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 99) ==== 3494+0+0 (secure 0 0 0) 0x7f82dc02c400 con 0x56525d1da280 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 10 client.8394 fetch_fsmap finished waiting for FSMap version 99 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 10 client.8394 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-05-10T11:22:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 20 client.8394 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:14.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d2751c0 0x56525d207260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:14.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 4 client.8394 mds_command: new command op to 7093 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T11:22:14.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 --> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56525d11b9b0 con 0x56525d2751c0 2024-05-10T11:22:14.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.878+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d2751c0 0x56525d207260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:14.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.879+0000 7f82caffd640 10 client.8394 ms_handle_connect on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:14.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.879+0000 7f82eb7fe640 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d2751c0 0x56525d207260 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c440b6b7d84b4d0 server_cookie=254f91f200afaf86 in_seq=0 out_seq=0 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82caffd640 1 -- 172.21.15.66:0/3763792909 <== mds.0 v2:172.21.15.190:6834/3723690401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56525d11b9b0 con 0x56525d2751c0 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82caffd640 10 client.8394 handle_command_reply: tid=0 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 client.8394 shutdown 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 msgr2=0x56525d1f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1f2630 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00d6d0 tx=0x7f82dc012000 comp rx=0 tx=0).stop 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 shutdown_connections 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:6834/3723690401,v1:172.21.15.190:6836/3723690401] conn(0x56525d2751c0 0x56525d207260 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56525d1f7160 0x56525d206d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56525d1eb920 0x56525d217100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 --2- 172.21.15.66:0/3763792909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56525d1da280 0x56525d1f2630 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82caffd640 0 client.8394 ms_handle_reset on v2:172.21.15.190:6834/3723690401 2024-05-10T11:22:14.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 >> 172.21.15.66:0/3763792909 conn(0x56525d1d9b40 msgr2=0x56525d1c34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 shutdown_connections 2024-05-10T11:22:14.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 1 -- 172.21.15.66:0/3763792909 wait complete. 2024-05-10T11:22:14.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.892+0000 7f82f527f740 20 client.8394 trim_cache size 0 max 16384 2024-05-10T11:22:14.893 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:14.894 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "", 2024-05-10T11:22:14.894 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0 2024-05-10T11:22:14.894 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f82d80762d0 msgr2=0x7f82d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f82d80762d0 0x7f82d8078790 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f82dc007fd0 tx=0x7f82dc009040 comp rx=0 tx=0).stop 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 msgr2=0x7f82ec1610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec1610f0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f82e400cb20 tx=0x7f82e400a060 comp rx=0 tx=0).stop 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 shutdown_connections 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f82d80762d0 0x7f82d8078790 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82ec0cffd0 0x7f82ec1610f0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82ec0cf3e0 0x7f82ec160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 --2- 172.21.15.66:0/4125943155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82ec0cd500 0x7f82ec0c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 >> 172.21.15.66:0/4125943155 conn(0x7f82ec0d2eb0 msgr2=0x7f82ec070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:14.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 shutdown_connections 2024-05-10T11:22:14.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:14.893+0000 7f82f2566640 1 -- 172.21.15.66:0/4125943155 wait complete. 2024-05-10T11:22:14.903 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:22:15.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.008+0000 7f5287f46640 1 Processor -- start 2024-05-10T11:22:15.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.008+0000 7f5287f46640 1 -- start start 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5287f46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f528015d650 0x7f52800cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5287f46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 0x7f52800cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5287f46640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800ce590 con 0x7f52800cffc0 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5287f46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f528015da30 con 0x7f528015d650 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5287f46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f52800d0500 con 0x7f52800d3980 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f52864e3640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f52800cffc0 0x7f52800d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36772/0 (socket says 172.21.15.66:36772) 2024-05-10T11:22:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f52864e3640 1 -- 172.21.15.66:0/535014209 learned_addr learned my addr 172.21.15.66:0/535014209 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982869660 0 0) 0x7f5278001490 con 0x7f52800cffc0 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f52854e1640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 0x7f52800cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5285ce2640 1 --2- 172.21.15.66:0/535014209 >> v2:172.21.15.190:3300/0 conn(0x7f528015d650 0x7f52800cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f526c003520 con 0x7f52800cffc0 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116024951 0 0) 0x7f526c003520 con 0x7f52800cffc0 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 msgr2=0x7f52800cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 0x7f52800cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 >> v2:172.21.15.190:3300/0 conn(0x7f528015d650 msgr2=0x7f52800cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 --2- 172.21.15.66:0/535014209 >> v2:172.21.15.190:3300/0 conn(0x7f528015d650 0x7f52800cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52800ce810 con 0x7f52800cffc0 2024-05-10T11:22:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f5278001bc0 con 0x7f52800cffc0 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 >> v1:172.21.15.66:6789/0 conn(0x7f52800cffc0 legacy=0x7f52800d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f526c0039b0 0x7f526c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 0x7f526c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f526c004d40 0x7f526c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.009+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52800d0500 con 0x7f526c0039b0 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f526c00b9c0 con 0x7f526c004d40 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f526c00bb40 con 0x7f52800d3980 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5285ce2640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f526c0039b0 0x7f526c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f52854e1640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 0x7f526c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f52864e3640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f526c004d40 0x7f526c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5285ce2640 1 -- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 msgr2=0x7f526c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5285ce2640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52800d3980 0x7f526c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5285ce2640 1 -- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f526c004d40 msgr2=0x7f526c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5285ce2640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f526c004d40 0x7f526c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f5285ce2640 1 -- 172.21.15.66:0/535014209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c003520 con 0x7f526c0039b0 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.010+0000 7f52864e3640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f526c004d40 0x7f526c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5285ce2640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f526c0039b0 0x7f526c003dd0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ac0 tx=0x7f526c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee62eea788bc7994 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c036070 con 0x7f526c0039b0 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c031400 con 0x7f526c0039b0 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5284ce0640 1 -- 172.21.15.66:0/535014209 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c009690 con 0x7f526c0039b0 2024-05-10T11:22:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5287f46640 1 -- 172.21.15.66:0/535014209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f526c0039b0 msgr2=0x7f526c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5287f46640 1 --2- 172.21.15.66:0/535014209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f526c0039b0 0x7f526c003dd0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ac0 tx=0x7f526c005830 comp rx=0 tx=0).stop 2024-05-10T11:22:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f52864e3640 1 -- 172.21.15.66:0/535014209 reap_dead start 2024-05-10T11:22:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5287f46640 1 -- 172.21.15.66:0/535014209 shutdown_connections 2024-05-10T11:22:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5287f46640 1 -- 172.21.15.66:0/535014209 >> 172.21.15.66:0/535014209 conn(0x7f52800d2df0 msgr2=0x7f52800d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5287f46640 1 -- 172.21.15.66:0/535014209 shutdown_connections 2024-05-10T11:22:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.011+0000 7f5287f46640 1 -- 172.21.15.66:0/535014209 wait complete. 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 Processor -- start 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 -- start start 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f526c0039b0 0x7f52801503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 0x7f528015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5280158b70 0x7f5280158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52800b3170 con 0x7f52800c85a0 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f52800cedd0 con 0x7f5280158b70 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f5287f46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f52800b32f0 con 0x7f526c0039b0 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f52854e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 0x7f528015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f52854e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 0x7f528015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45648/0 (socket says 172.21.15.66:45648) 2024-05-10T11:22:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.013+0000 7f52854e1640 1 -- 172.21.15.66:0/460232869 learned_addr learned my addr 172.21.15.66:0/460232869 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f5285ce2640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f526c0039b0 0x7f52801503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52864e3640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5280158b70 0x7f5280158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52854e1640 1 -- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f526c0039b0 msgr2=0x7f52801503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52854e1640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f526c0039b0 0x7f52801503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52854e1640 1 -- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5280158b70 msgr2=0x7f5280158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52854e1640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5280158b70 0x7f5280158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52854e1640 1 -- 172.21.15.66:0/460232869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528015e260 con 0x7f52800c85a0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f5285ce2640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f526c0039b0 0x7f52801503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52854e1640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 0x7f528015da30 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f52700119a0 tx=0x7f5270011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527000fa90 con 0x7f52800c85a0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527000fc30 con 0x7f52800c85a0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270014440 con 0x7f52800c85a0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528015e540 con 0x7f52800c85a0 2024-05-10T11:22:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.014+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528015df70 con 0x7f52800c85a0 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.015+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528015ea60 con 0x7f52800c85a0 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.016+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5270012040 con 0x7f52800c85a0 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.016+0000 7f52767fc640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5264076300 0x7f52640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.016+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f5270097d70 con 0x7f52800c85a0 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.017+0000 7f5285ce2640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5264076300 0x7f52640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.017+0000 7f5285ce2640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5264076300 0x7f52640787c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f527c033000 tx=0x7f527c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.021+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f528015ea60 con 0x7f52800c85a0 2024-05-10T11:22:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.249+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f528006a220 con 0x7f52800c85a0 2024-05-10T11:22:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.250+0000 7f52767fc640 1 -- 172.21.15.66:0/460232869 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v99) ==== 53+0+73 (secure 0 0 0) 0x7f5270019030 con 0x7f52800c85a0 2024-05-10T11:22:15.249 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:22:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5264076300 msgr2=0x7f52640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5264076300 0x7f52640787c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f527c033000 tx=0x7f527c008030 comp rx=0 tx=0).stop 2024-05-10T11:22:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 msgr2=0x7f528015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 0x7f528015da30 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f52700119a0 tx=0x7f5270011e60 comp rx=0 tx=0).stop 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 shutdown_connections 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f5264076300 0x7f52640787c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5280158b70 0x7f5280158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800c85a0 0x7f528015da30 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 --2- 172.21.15.66:0/460232869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f526c0039b0 0x7f52801503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 >> 172.21.15.66:0/460232869 conn(0x7f52800d2df0 msgr2=0x7f52800cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 shutdown_connections 2024-05-10T11:22:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15.252+0000 7f5287f46640 1 -- 172.21.15.66:0/460232869 wait complete. 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:22:15.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:22:15.263 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:15.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.263 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.280 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42158sec preferred_lft 42158sec 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:22:15.281 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:22:15.282 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.283 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:22:15.345 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:15.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.347 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:22:15.404 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:22:15.404 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:22:15.404 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:22:15.405 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:22:15.405 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:22:15.405 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:22:15.405 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:22:15.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:22:15.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:22:15.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:22:15.406 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:22:15.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:22:15.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:15.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.536 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:22:15.552 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:22:15.552 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:22:15.553 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:15.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.553 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:22:15.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:15.619 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:15.675 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:15.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:15.675 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:15.731 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:22:15.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:15.816 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:15.816 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:15.816 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:15.825 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:15.825 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:15.825 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:15.825 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:15.825 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:15.830 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:15.830 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:15.830 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:15.830 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:15.830 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:15.830 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:22:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:22:15.833 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:22:15.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.833 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:15.858 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:22:15.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:22:15.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:15.958 INFO:teuthology.orchestra.run.smithi066.stdout:client8403 2024-05-10T11:22:15.958 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:15.958 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:15.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:15.974 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-05-10T11:22:16.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:16.036 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-05-10T11:22:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:8+0 records in 2024-05-10T11:22:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:8+0 records out 2024-05-10T11:22:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0230983 s, 363 MB/s 2024-05-10T11:22:16.117 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:16.117 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:16.117 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:16.117 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:16.117 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-05-10T11:22:16.117 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:16.225 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627779 2024-05-10T11:22:16.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:16.234 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:16.234 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:16.234 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:16.234 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:16.235 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-05-10T11:22:16.235 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:16.341 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627780 2024-05-10T11:22:16.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:16.351 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:16.351 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:16.408 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:16.408 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:16.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:22:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.611+0000 7faa0539e640 1 Processor -- start 2024-05-10T11:22:16.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.611+0000 7faa0539e640 1 -- start start 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.611+0000 7faa0539e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7faa000ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.611+0000 7faa0539e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa000d0ac0 con 0x7faa0015ceb0 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.611+0000 7faa0539e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa000d0220 con 0x7faa000d1640 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.611+0000 7faa0539e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faa000d0870 con 0x7faa000d37c0 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9fffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7faa0015ceb0 0x7faa000d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36788/0 (socket says 172.21.15.66:36788) 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9fffff640 1 -- 172.21.15.66:0/2915307754 learned_addr learned my addr 172.21.15.66:0/2915307754 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7faa04b9d640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7faa000ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3068204600 0 0) 0x7faa000d0ac0 con 0x7faa0015ceb0 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9e8003520 con 0x7faa0015ceb0 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743642110 0 0) 0x7fa9e8003520 con 0x7faa0015ceb0 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 msgr2=0x7faa000ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7faa000ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 >> v1:172.21.15.190:6789/0 conn(0x7faa000d1640 legacy=0x7faa000cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa00070060 con 0x7faa0015ceb0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fa9f0001690 con 0x7faa0015ceb0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 >> v1:172.21.15.66:6789/0 conn(0x7faa0015ceb0 legacy=0x7faa000d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e80039e0 0x7fa9e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7fa9e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e8004d40 0x7fa9e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa000d0870 con 0x7fa9e8004d40 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e800baf0 con 0x7fa9e80039e0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e800bcf0 con 0x7faa000d37c0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7faa04b9d640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e8004d40 0x7fa9e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9fffff640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e80039e0 0x7fa9e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.612+0000 7fa9ff7fe640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7fa9e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7faa04b9d640 1 -- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 msgr2=0x7fa9e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7faa04b9d640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7fa9e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7faa04b9d640 1 -- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e80039e0 msgr2=0x7fa9e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7faa04b9d640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e80039e0 0x7fa9e8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7faa04b9d640 1 -- 172.21.15.66:0/2915307754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e8003520 con 0x7fa9e8004d40 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7fa9fffff640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e80039e0 0x7fa9e8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7fa9ff7fe640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa000d37c0 0x7fa9e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.613+0000 7faa04b9d640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e8004d40 0x7fa9e80051c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009fc0 tx=0x7fa9e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7ad0f4946f2b48 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8009c10 con 0x7fa9e8004d40 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f8036070 con 0x7fa9e8004d40 2024-05-10T11:22:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7fa9feffd640 1 -- 172.21.15.66:0/2915307754 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8031880 con 0x7fa9e8004d40 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa0539e640 1 -- 172.21.15.66:0/2915307754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e8004d40 msgr2=0x7fa9e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa0539e640 1 --2- 172.21.15.66:0/2915307754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e8004d40 0x7fa9e80051c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009fc0 tx=0x7fa9e8005830 comp rx=0 tx=0).stop 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa04b9d640 1 -- 172.21.15.66:0/2915307754 reap_dead start 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa0539e640 1 -- 172.21.15.66:0/2915307754 shutdown_connections 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa0539e640 1 -- 172.21.15.66:0/2915307754 >> 172.21.15.66:0/2915307754 conn(0x7faa000d2ca0 msgr2=0x7faa000d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa0539e640 1 -- 172.21.15.66:0/2915307754 shutdown_connections 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.614+0000 7faa0539e640 1 -- 172.21.15.66:0/2915307754 wait complete. 2024-05-10T11:22:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.615+0000 7faa0539e640 1 Processor -- start 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 -- start start 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8004d40 0x7faa001e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 0x7faa001e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa001e87e0 0x7faa0015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa0015d290 con 0x7faa0014c0d0 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa000d0500 con 0x7faa001e87e0 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.616+0000 7faa0539e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faa0015d410 con 0x7fa9e8004d40 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 0x7faa001e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 0x7faa001e82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45670/0 (socket says 172.21.15.66:45670) 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 -- 172.21.15.66:0/1008482831 learned_addr learned my addr 172.21.15.66:0/1008482831 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7faa04b9d640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa001e87e0 0x7faa0015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9fffff640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8004d40 0x7faa001e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 -- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8004d40 msgr2=0x7faa001e7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8004d40 0x7faa001e7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 -- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa001e87e0 msgr2=0x7faa0015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa001e87e0 0x7faa0015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 -- 172.21.15.66:0/1008482831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa001e6960 con 0x7faa0014c0d0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7faa04b9d640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa001e87e0 0x7faa0015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9ff7fe640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 0x7faa001e82a0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400e630 tx=0x7fa9f400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40052e0 con 0x7faa0014c0d0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4018070 con 0x7faa0014c0d0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4003810 con 0x7faa0014c0d0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.617+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa001e6c40 con 0x7faa0014c0d0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.618+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa001e7200 con 0x7faa0014c0d0 2024-05-10T11:22:16.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.618+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa000693f0 con 0x7faa0014c0d0 2024-05-10T11:22:16.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.619+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa9f40039b0 con 0x7faa0014c0d0 2024-05-10T11:22:16.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.620+0000 7fa9fcff9640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9ec076300 0x7fa9ec0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:16.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.620+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fa9f4097470 con 0x7faa0014c0d0 2024-05-10T11:22:16.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.620+0000 7fa9fffff640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9ec076300 0x7fa9ec0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:16.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.621+0000 7fa9fffff640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9ec076300 0x7fa9ec0787c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001eb0 tx=0x7fa9f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:16.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.624+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa9f4060cd0 con 0x7faa0014c0d0 2024-05-10T11:22:16.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.829+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faa000b8c20 con 0x7faa0014c0d0 2024-05-10T11:22:16.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.829+0000 7fa9fcff9640 1 -- 172.21.15.66:0/1008482831 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7fa9f40605d0 con 0x7faa0014c0d0 2024-05-10T11:22:16.828 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9ec076300 msgr2=0x7fa9ec0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9ec076300 0x7fa9ec0787c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001eb0 tx=0x7fa9f0009040 comp rx=0 tx=0).stop 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 msgr2=0x7faa001e82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 0x7faa001e82a0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400e630 tx=0x7fa9f400eaf0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 shutdown_connections 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9ec076300 0x7fa9ec0787c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa001e87e0 0x7faa0015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa0014c0d0 0x7faa001e82a0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 --2- 172.21.15.66:0/1008482831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8004d40 0x7faa001e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:16.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 >> 172.21.15.66:0/1008482831 conn(0x7faa000d2ca0 msgr2=0x7faa00070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:16.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 shutdown_connections 2024-05-10T11:22:16.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:16.831+0000 7faa0539e640 1 -- 172.21.15.66:0/1008482831 wait complete. 2024-05-10T11:22:16.841 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:22:16.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:16.842 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:16.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:22:16.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:16.908 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:22:16.936 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:16.936 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:16.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:22:16.993 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:22:16.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:16.993 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:22:17.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:22:17.049 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-10T11:22:17.049 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:22:17.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.195+0000 7f9aad9f7640 1 Processor -- start 2024-05-10T11:22:17.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.195+0000 7f9aad9f7640 1 -- start start 2024-05-10T11:22:17.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aad9f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa80d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aad9f7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9aa80cf3b0 0x7f9aa80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aad9f7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa8160c90 con 0x7f9aa81608b0 2024-05-10T11:22:17.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aad9f7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa80ce5f0 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aad9f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa80ce8d0 con 0x7f9aa80b3910 2024-05-10T11:22:17.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aa67fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa80d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aa77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9aa80cf3b0 0x7f9aa80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aa6ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9aa81608b0 0x7f9aa80d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:35374/0 (socket says 172.21.15.66:35374) 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.196+0000 7f9aa6ffd640 1 -- 172.21.15.66:0/32570910 learned_addr learned my addr 172.21.15.66:0/32570910 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa5ffb640 1 -- 172.21.15.66:0/32570910 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661897295 0 0) 0x7f9a98001110 con 0x7f9aa81608b0 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa5ffb640 1 -- 172.21.15.66:0/32570910 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a94003520 con 0x7f9aa81608b0 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa67fc640 1 -- 172.21.15.66:0/32570910 >> v2:172.21.15.190:3300/0 conn(0x7f9aa80cf3b0 msgr2=0x7f9aa80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa67fc640 1 --2- 172.21.15.66:0/32570910 >> v2:172.21.15.190:3300/0 conn(0x7f9aa80cf3b0 0x7f9aa80cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa67fc640 1 -- 172.21.15.66:0/32570910 >> v1:172.21.15.190:6789/0 conn(0x7f9aa81608b0 legacy=0x7f9aa80d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa67fc640 1 -- 172.21.15.66:0/32570910 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa80cebb0 con 0x7f9aa80b3910 2024-05-10T11:22:17.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.197+0000 7f9aa77fe640 1 --2- 172.21.15.66:0/32570910 >> v2:172.21.15.190:3300/0 conn(0x7f9aa80cf3b0 0x7f9aa80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:17.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aa67fc640 1 --2- 172.21.15.66:0/32570910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa80d1400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a900097a0 tx=0x7f9a9002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae6fb373954d173 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aa5ffb640 1 -- 172.21.15.66:0/32570910 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90037070 con 0x7f9aa80b3910 2024-05-10T11:22:17.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aa5ffb640 1 -- 172.21.15.66:0/32570910 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a90032440 con 0x7f9aa80b3910 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aa5ffb640 1 -- 172.21.15.66:0/32570910 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a900327f0 con 0x7f9aa80b3910 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aad9f7640 1 -- 172.21.15.66:0/32570910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 msgr2=0x7f9aa80d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/32570910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa80d1400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a900097a0 tx=0x7f9a9002a180 comp rx=0 tx=0).stop 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aad9f7640 1 -- 172.21.15.66:0/32570910 shutdown_connections 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/32570910 >> v2:172.21.15.190:3300/0 conn(0x7f9aa80cf3b0 0x7f9aa80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/32570910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa80d1400 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.198+0000 7f9aad9f7640 1 -- 172.21.15.66:0/32570910 >> 172.21.15.66:0/32570910 conn(0x7f9aa80d2df0 msgr2=0x7f9aa80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.199+0000 7f9aad9f7640 1 -- 172.21.15.66:0/32570910 shutdown_connections 2024-05-10T11:22:17.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.199+0000 7f9aad9f7640 1 -- 172.21.15.66:0/32570910 wait complete. 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.200+0000 7f9aad9f7640 1 Processor -- start 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.200+0000 7f9aad9f7640 1 -- start start 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa8157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 0x7f9aa80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa81608b0 0x7f9aa80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80d1f10 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80d1d90 con 0x7f9aa81608b0 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa80d1940 con 0x7f9aa80b3910 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 0x7f9aa80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 0x7f9aa80c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45686/0 (socket says 172.21.15.66:45686) 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 -- 172.21.15.66:0/358004468 learned_addr learned my addr 172.21.15.66:0/358004468 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa77fe640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa81608b0 0x7f9aa80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa6ffd640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa8157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 -- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 msgr2=0x7f9aa8157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa8157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 -- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa81608b0 msgr2=0x7f9aa80c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa81608b0 0x7f9aa80c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 -- 172.21.15.66:0/358004468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa80b0020 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aa67fc640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 0x7f9aa80c72e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9a9002a1c0 tx=0x7f9a900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90037050 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a90043070 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa8157860 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.201+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90006e10 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.202+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa80b05a0 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.203+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa806a220 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.203+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a90032a30 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.204+0000 7f9a9ffff640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a880762d0 0x7f9a88078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.204+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f9a900b8360 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.204+0000 7f9aa6ffd640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a880762d0 0x7f9a88078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.204+0000 7f9aa6ffd640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a880762d0 0x7f9a88078790 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9a980012b0 tx=0x7f9a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.208+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9a90081bc0 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.438+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9aa80b0ff0 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.438 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:22:17.439+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:22:17.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.442+0000 7f9a9ffff640 1 -- 172.21.15.66:0/358004468 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) ==== 161+0+0 (secure 0 0 0) 0x7f9a900814c0 con 0x7f9aa80cf3b0 2024-05-10T11:22:17.441 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:22:17.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a880762d0 msgr2=0x7f9a88078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a880762d0 0x7f9a88078790 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9a980012b0 tx=0x7f9a98009040 comp rx=0 tx=0).stop 2024-05-10T11:22:17.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 msgr2=0x7f9aa80c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 0x7f9aa80c72e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9a9002a1c0 tx=0x7f9a900046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 shutdown_connections 2024-05-10T11:22:17.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9a880762d0 0x7f9a88078790 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa81608b0 0x7f9aa80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9aa80cf3b0 0x7f9aa80c72e0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 --2- 172.21.15.66:0/358004468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa80b3910 0x7f9aa8157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 >> 172.21.15.66:0/358004468 conn(0x7f9aa80d2df0 msgr2=0x7f9aa815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:17.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 shutdown_connections 2024-05-10T11:22:17.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.445+0000 7f9aad9f7640 1 -- 172.21.15.66:0/358004468 wait complete. 2024-05-10T11:22:17.452 INFO:tasks.ceph.mds.b.smithi190.stderr: -8401> 2024-05-10T11:22:08.342+0000 7f692edf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:22:17.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:17.458 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:17.487 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-05-10T11:22:17.502 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:17.503 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:17.504 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-05-10T11:22:17.505 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.506 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:17.507 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-05-10T11:22:17.508 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.509 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.510 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.511 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.512 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:17.513 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: mon down mkfs grace = 300 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:17.514 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2024-05-10T11:22:17.515 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = False 2024-05-10T11:22:17.516 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:17.517 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.517 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.517 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-05-10T11:22:17.517 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-05-10T11:22:17.518 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:17.519 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.520 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.521 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.522 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.523 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-05-10T11:22:17.524 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.525 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-05-10T11:22:17.526 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:17.527 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:17.528 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-05-10T11:22:17.529 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-05-10T11:22:17.530 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = False 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.531 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.534 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:17.575 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:17.618 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-05-10T11:22:17.618 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-05-10T11:22:17.618 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:17.619 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-05-10T11:22:17.619 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.619 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-05-10T11:22:17.619 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:17.622 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:17.623 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:17.624 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.625 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-05-10T11:22:17.626 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-05-10T11:22:17.626 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-05-10T11:22:17.626 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:17.626 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2024-05-10T11:22:17.626 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:17.626 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:17.627 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:17.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-05-10T11:22:17.629 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:17.630 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.631 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:17.632 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: mon down mkfs grace = 300 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:17.633 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-05-10T11:22:17.634 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = False 2024-05-10T11:22:17.635 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2024-05-10T11:22:17.636 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = False 2024-05-10T11:22:17.636 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:17.636 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.636 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.638 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-05-10T11:22:17.638 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-05-10T11:22:17.638 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:17.638 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-05-10T11:22:17.638 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.639 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-05-10T11:22:17.639 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.639 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:17.639 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.639 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:17.640 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:17.641 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.642 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-05-10T11:22:17.643 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.644 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-05-10T11:22:17.645 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-05-10T11:22:17.646 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:17.648 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-05-10T11:22:17.649 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.650 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-05-10T11:22:17.651 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:17.652 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-05-10T11:22:17.653 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = False 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = False 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:17.654 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:17.655 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-05-10T11:22:17.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.724+0000 7f23def16f40 1 Processor -- start 2024-05-10T11:22:17.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.724+0000 7f23def16f40 1 -- start start 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23def16f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc002820 0x55eae1569250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23def16f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae1611b50 0x55eae16096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23def16f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 0x55eae15fb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23def16f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eae1539320 con 0x55eae15fb120 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23def16f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55eae14e1f50 con 0x55eae1611b50 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23def16f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55eae1583810 con 0x7f23cc002820 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 0x55eae15fb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 0x55eae15fb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45710/0 (socket says 172.21.15.66:45710) 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 -- 172.21.15.66:0/1680627401 learned_addr learned my addr 172.21.15.66:0/1680627401 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dca12640 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc002820 0x55eae1569250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23d7fff640 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae1611b50 0x55eae16096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 -- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc002820 msgr2=0x55eae1569250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc002820 0x55eae1569250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 -- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae1611b50 msgr2=0x55eae16096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae1611b50 0x55eae16096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 -- 172.21.15.66:0/1680627401 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae15fbae0 con 0x55eae15fb120 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23d7fff640 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae1611b50 0x55eae16096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.725+0000 7f23dd213640 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 0x55eae15fb5a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x55eae16153c0 tx=0x7f23d8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c830702fa76c1a10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23d6ffd640 1 -- 172.21.15.66:0/1680627401 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8018070 con 0x55eae15fb120 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23d6ffd640 1 -- 172.21.15.66:0/1680627401 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d80104c0 con 0x55eae15fb120 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23d6ffd640 1 -- 172.21.15.66:0/1680627401 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8010870 con 0x55eae15fb120 2024-05-10T11:22:17.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 -- 172.21.15.66:0/1680627401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 msgr2=0x55eae15fb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 0x55eae15fb5a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x55eae16153c0 tx=0x7f23d8006430 comp rx=0 tx=0).stop 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 -- 172.21.15.66:0/1680627401 shutdown_connections 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eae15fb120 0x55eae15fb5a0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae1611b50 0x55eae16096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 --2- 172.21.15.66:0/1680627401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc002820 0x55eae1569250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 -- 172.21.15.66:0/1680627401 >> 172.21.15.66:0/1680627401 conn(0x55eae1566880 msgr2=0x55eae1565eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 -- 172.21.15.66:0/1680627401 shutdown_connections 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.726+0000 7f23def16f40 1 -- 172.21.15.66:0/1680627401 wait complete. 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 Processor -- start 2024-05-10T11:22:17.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 -- start start 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae15fb120 0x55eae1580d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eae1611b50 0x55eae15f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc002820 0x55eae16132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eae15671c0 con 0x7f23cc002820 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55eae1566c90 con 0x55eae15fb120 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.727+0000 7f23def16f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55eae1566ee0 con 0x55eae1611b50 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc002820 0x55eae16132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc002820 0x55eae16132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45714/0 (socket says 172.21.15.66:45714) 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 -- 172.21.15.66:0/668287611 learned_addr learned my addr 172.21.15.66:0/668287611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dca12640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae15fb120 0x55eae1580d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23d7fff640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eae1611b50 0x55eae15f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 -- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eae1611b50 msgr2=0x55eae15f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eae1611b50 0x55eae15f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 -- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae15fb120 msgr2=0x55eae1580d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eae15fb120 0x55eae1580d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 -- 172.21.15.66:0/668287611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae15fa6c0 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23d7fff640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eae1611b50 0x55eae15f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23dd213640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc002820 0x55eae16132e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f23d8001be0 tx=0x7f23d8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23d5ffb640 1 -- 172.21.15.66:0/668287611 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8023070 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23d5ffb640 1 -- 172.21.15.66:0/668287611 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d8003650 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eae15fa9a0 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23d5ffb640 1 -- 172.21.15.66:0/668287611 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8018040 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.728+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eae160aa50 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.730+0000 7f23d5ffb640 1 -- 172.21.15.66:0/668287611 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f23d8026070 con 0x7f23cc002820 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.730+0000 7f23d5ffb640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23c0074cb0 0x7f23c0077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.730+0000 7f23d5ffb640 1 -- 172.21.15.66:0/668287611 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f23d8096c50 con 0x7f23cc002820 2024-05-10T11:22:17.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.730+0000 7f23dca12640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23c0074cb0 0x7f23c0077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.730+0000 7f23def16f40 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55eae160f730 0x55eae157e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.730+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55eae15fa2d0 con 0x55eae160f730 2024-05-10T11:22:17.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.731+0000 7f23d7fff640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55eae160f730 0x55eae157e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.731+0000 7f23dca12640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23c0074cb0 0x7f23c0077170 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f23d0005cf0 tx=0x7f23d000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.731+0000 7f23d7fff640 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55eae160f730 0x55eae157e410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23d7fff640 1 -- 172.21.15.66:0/668287611 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v119'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f23c804f880 con 0x55eae160f730 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55eae160f730 msgr2=0x55eae157e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55eae160f730 0x55eae157e410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23c0074cb0 msgr2=0x7f23c0077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23c0074cb0 0x7f23c0077170 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f23d0005cf0 tx=0x7f23d000c040 comp rx=0 tx=0).stop 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc002820 msgr2=0x55eae16132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 --2- 172.21.15.66:0/668287611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc002820 0x55eae16132e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f23d8001be0 tx=0x7f23d8001dc0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23dd213640 1 -- 172.21.15.66:0/668287611 reap_dead start 2024-05-10T11:22:17.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 shutdown_connections 2024-05-10T11:22:17.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 >> 172.21.15.66:0/668287611 conn(0x55eae1566880 msgr2=0x55eae1566050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:17.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 shutdown_connections 2024-05-10T11:22:17.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.732+0000 7f23def16f40 1 -- 172.21.15.66:0/668287611 wait complete. 2024-05-10T11:22:17.738 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T11:22:17.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.846+0000 7fcbe5d40640 1 Processor -- start 2024-05-10T11:22:17.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbe5d40640 1 -- start start 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbe5d40640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcbe015d140 0x7fcbe00ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbe5d40640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcbe00d2c10 0x7fcbe00d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbe5d40640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe00d35c0 con 0x7fcbe00d0e80 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbe5d40640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00d1e90 con 0x7fcbe00d2c10 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbe5d40640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00d1bb0 con 0x7fcbe015d140 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbdeffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcbe00d2c10 0x7fcbe00d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.847+0000 7fcbdffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fcbe00d0e80 0x7fcbe00d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36808/0 (socket says 172.21.15.66:36808) 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbdffff640 1 -- 172.21.15.66:0/950687423 learned_addr learned my addr 172.21.15.66:0/950687423 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbdf7fe640 1 --2- 172.21.15.66:0/950687423 >> v2:172.21.15.190:3300/0 conn(0x7fcbe015d140 0x7fcbe00ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbdeffd640 1 -- 172.21.15.66:0/950687423 >> v2:172.21.15.190:3300/0 conn(0x7fcbe015d140 msgr2=0x7fcbe00ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:17.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbdeffd640 1 --2- 172.21.15.66:0/950687423 >> v2:172.21.15.190:3300/0 conn(0x7fcbe015d140 0x7fcbe00ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbdeffd640 1 -- 172.21.15.66:0/950687423 >> v1:172.21.15.66:6789/0 conn(0x7fcbe00d0e80 legacy=0x7fcbe00d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbdeffd640 1 -- 172.21.15.66:0/950687423 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00cdc80 con 0x7fcbe00d2c10 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.848+0000 7fcbde7fc640 1 -- 172.21.15.66:0/950687423 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470395617 0 0) 0x7fcbe00d35c0 con 0x7fcbe00d0e80 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbdeffd640 1 --2- 172.21.15.66:0/950687423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d2c10 0x7fcbe00d3080 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0072c10 tx=0x7fcbc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c1e201b8b362fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbde7fc640 1 -- 172.21.15.66:0/950687423 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8037070 con 0x7fcbe00d2c10 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbde7fc640 1 -- 172.21.15.66:0/950687423 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc8032440 con 0x7fcbe00d2c10 2024-05-10T11:22:17.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbde7fc640 1 -- 172.21.15.66:0/950687423 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8032810 con 0x7fcbe00d2c10 2024-05-10T11:22:17.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 -- 172.21.15.66:0/950687423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d2c10 msgr2=0x7fcbe00d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/950687423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d2c10 0x7fcbe00d3080 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0072c10 tx=0x7fcbc802a1a0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 -- 172.21.15.66:0/950687423 shutdown_connections 2024-05-10T11:22:17.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/950687423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d2c10 0x7fcbe00d3080 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/950687423 >> v2:172.21.15.190:3300/0 conn(0x7fcbe015d140 0x7fcbe00ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 -- 172.21.15.66:0/950687423 >> 172.21.15.66:0/950687423 conn(0x7fcbe009ba00 msgr2=0x7fcbe009be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:17.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 -- 172.21.15.66:0/950687423 shutdown_connections 2024-05-10T11:22:17.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.849+0000 7fcbe5d40640 1 -- 172.21.15.66:0/950687423 wait complete. 2024-05-10T11:22:17.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.851+0000 7fcbe5d40640 1 Processor -- start 2024-05-10T11:22:17.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.851+0000 7fcbe5d40640 1 -- start start 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.851+0000 7fcbe5d40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 0x7fcbe01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbe00d2c10 0x7fcbe0152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe015d140 0x7fcbe0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe015d520 con 0x7fcbe00d0e80 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00ce240 con 0x7fcbe00d2c10 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00ceca0 con 0x7fcbe015d140 2024-05-10T11:22:17.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 0x7fcbe01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 0x7fcbe01581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45732/0 (socket says 172.21.15.66:45732) 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 -- 172.21.15.66:0/146523371 learned_addr learned my addr 172.21.15.66:0/146523371 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdffff640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe015d140 0x7fcbe0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdeffd640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbe00d2c10 0x7fcbe0152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 -- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe015d140 msgr2=0x7fcbe0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe015d140 0x7fcbe0159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 -- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbe00d2c10 msgr2=0x7fcbe0152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbe00d2c10 0x7fcbe0152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 -- 172.21.15.66:0/146523371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe0156a10 con 0x7fcbe00d0e80 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbdf7fe640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 0x7fcbe01581d0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000e9e0 tx=0x7fcbd000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0017070 con 0x7fcbe00d0e80 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd000c9d0 con 0x7fcbe00d0e80 2024-05-10T11:22:17.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe0156cf0 con 0x7fcbe00d0e80 2024-05-10T11:22:17.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000cdc0 con 0x7fcbe00d0e80 2024-05-10T11:22:17.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.852+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01572b0 con 0x7fcbe00d0e80 2024-05-10T11:22:17.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.853+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe0069b10 con 0x7fcbe00d0e80 2024-05-10T11:22:17.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.854+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcbd001a070 con 0x7fcbe00d0e80 2024-05-10T11:22:17.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.854+0000 7fcbd7fff640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbc00762d0 0x7fcbc0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:17.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.854+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fcbd0097b90 con 0x7fcbe00d0e80 2024-05-10T11:22:17.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.854+0000 7fcbdeffd640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbc00762d0 0x7fcbc0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:17.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.855+0000 7fcbdeffd640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbc00762d0 0x7fcbc0078790 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8034000 tx=0x7fcbc802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:17.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:17.859+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcbd0061310 con 0x7fcbe00d0e80 2024-05-10T11:22:18.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.090+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fcbe00d3cc0 con 0x7fcbe00d0e80 2024-05-10T11:22:18.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.449+0000 7fcbd7fff640 1 -- 172.21.15.66:0/146523371 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v101) ==== 162+0+0 (secure 0 0 0) 0x7fcbd0060c10 con 0x7fcbe00d0e80 2024-05-10T11:22:18.448 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbc00762d0 msgr2=0x7fcbc0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbc00762d0 0x7fcbc0078790 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8034000 tx=0x7fcbc802e000 comp rx=0 tx=0).stop 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 msgr2=0x7fcbe01581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 0x7fcbe01581d0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000e9e0 tx=0x7fcbd000eea0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 shutdown_connections 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fcbc00762d0 0x7fcbc0078790 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe015d140 0x7fcbe0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbe00d2c10 0x7fcbe0152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 --2- 172.21.15.66:0/146523371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe00d0e80 0x7fcbe01581d0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 >> 172.21.15.66:0/146523371 conn(0x7fcbe009ba00 msgr2=0x7fcbe009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 shutdown_connections 2024-05-10T11:22:18.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.451+0000 7fcbe5d40640 1 -- 172.21.15.66:0/146523371 wait complete. 2024-05-10T11:22:18.464 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:18.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.569+0000 7fd691f19640 1 Processor -- start 2024-05-10T11:22:18.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.569+0000 7fd691f19640 1 -- start start 2024-05-10T11:22:18.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd691f19640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd68c15f3e0 0x7fd68c0d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:18.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd691f19640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd68c0b54d0 0x7fd68c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:18.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd691f19640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c0d0ff0 con 0x7fd68c0d0750 2024-05-10T11:22:18.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd691f19640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c0d0d10 con 0x7fd68c0b54d0 2024-05-10T11:22:18.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd691f19640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c0b49f0 con 0x7fd68c15f3e0 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd68c0b54d0 0x7fd68c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd68c0b54d0 0x7fd68c0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45746/0 (socket says 172.21.15.66:45746) 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 -- 172.21.15.66:0/2096738330 learned_addr learned my addr 172.21.15.66:0/2096738330 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68b7fe640 1 --2- 172.21.15.66:0/2096738330 >> v2:172.21.15.190:3300/0 conn(0x7fd68c15f3e0 0x7fd68c0d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 -- 172.21.15.66:0/2096738330 >> v2:172.21.15.190:3300/0 conn(0x7fd68c15f3e0 msgr2=0x7fd68c0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 --2- 172.21.15.66:0/2096738330 >> v2:172.21.15.190:3300/0 conn(0x7fd68c15f3e0 0x7fd68c0d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 -- 172.21.15.66:0/2096738330 >> v1:172.21.15.190:6789/0 conn(0x7fd68c0d0750 legacy=0x7fd68c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68bfff640 1 -- 172.21.15.66:0/2096738330 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c0b4cd0 con 0x7fd68c0b54d0 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.570+0000 7fd68b7fe640 1 --2- 172.21.15.66:0/2096738330 >> v2:172.21.15.190:3300/0 conn(0x7fd68c15f3e0 0x7fd68c0d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.571+0000 7fd68bfff640 1 --2- 172.21.15.66:0/2096738330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0b5920 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fd68c08d0f0 tx=0x7fd68402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f9cade01080eab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.571+0000 7fd68a7fc640 1 -- 172.21.15.66:0/2096738330 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684036070 con 0x7fd68c0b54d0 2024-05-10T11:22:18.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.571+0000 7fd68a7fc640 1 -- 172.21.15.66:0/2096738330 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd684031600 con 0x7fd68c0b54d0 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.571+0000 7fd68a7fc640 1 -- 172.21.15.66:0/2096738330 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840319d0 con 0x7fd68c0b54d0 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 -- 172.21.15.66:0/2096738330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c0b54d0 msgr2=0x7fd68c0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 --2- 172.21.15.66:0/2096738330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0b5920 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fd68c08d0f0 tx=0x7fd68402a6f0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 -- 172.21.15.66:0/2096738330 shutdown_connections 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 --2- 172.21.15.66:0/2096738330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0b5920 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 --2- 172.21.15.66:0/2096738330 >> v2:172.21.15.190:3300/0 conn(0x7fd68c15f3e0 0x7fd68c0d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 -- 172.21.15.66:0/2096738330 >> 172.21.15.66:0/2096738330 conn(0x7fd68c0d4ff0 msgr2=0x7fd68c0d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 -- 172.21.15.66:0/2096738330 shutdown_connections 2024-05-10T11:22:18.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.572+0000 7fd691f19640 1 -- 172.21.15.66:0/2096738330 wait complete. 2024-05-10T11:22:18.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.573+0000 7fd691f19640 1 Processor -- start 2024-05-10T11:22:18.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.573+0000 7fd691f19640 1 -- start start 2024-05-10T11:22:18.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd691f19640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:18.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd691f19640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd68c0d0750 0x7fd68c161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:18.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd691f19640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 0x7fd68c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd691f19640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c15f7c0 con 0x7fd68c15f3e0 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd691f19640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0d3f90 con 0x7fd68c0b54d0 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd691f19640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c15f940 con 0x7fd68c0d0750 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 0x7fd68c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 0x7fd68c15b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45748/0 (socket says 172.21.15.66:45748) 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 -- 172.21.15.66:0/186116742 learned_addr learned my addr 172.21.15.66:0/186116742 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68b7fe640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68affd640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd68c0d0750 0x7fd68c161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 -- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd68c0d0750 msgr2=0x7fd68c161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd68c0d0750 0x7fd68c161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 -- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd68c0b54d0 msgr2=0x7fd68c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.574+0000 7fd68bfff640 1 -- 172.21.15.66:0/186116742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c0cd820 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.575+0000 7fd68bfff640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 0x7fd68c15b4f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd684009f40 tx=0x7fd684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.575+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684036050 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.575+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd684042070 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.575+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c0cdb00 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.575+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684009510 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.575+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c0ce0c0 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.576+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68c069400 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.576+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd684007c50 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.577+0000 7fd673fff640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd678076300 0x7fd6780787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.577+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fd6840b8660 con 0x7fd68c15f3e0 2024-05-10T11:22:18.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.577+0000 7fd68b7fe640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd678076300 0x7fd6780787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:18.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.578+0000 7fd68b7fe640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd678076300 0x7fd6780787c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00ab60 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:18.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.581+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd684081820 con 0x7fd68c15f3e0 2024-05-10T11:22:18.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.812+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd68c0d4320 con 0x7fd68c15f3e0 2024-05-10T11:22:18.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.813+0000 7fd673fff640 1 -- 172.21.15.66:0/186116742 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5187 (secure 0 0 0) 0x7fd684085b20 con 0x7fd68c15f3e0 2024-05-10T11:22:18.812 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:18.812 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":102,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:18.451553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7231":{"gid":7231,"name":"b","rank":0,"incarnation":102,"state":"up:replay","state_seq":1,"addr":"172.21.15.190:6836/1055415762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1055415762},{"type":"v1","addr":"172.21.15.190:6836","nonce":1055415762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T11:22:18.813 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 102 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd678076300 msgr2=0x7fd6780787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd678076300 0x7fd6780787c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00ab60 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 msgr2=0x7fd68c15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 0x7fd68c15b4f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd684009f40 tx=0x7fd684004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 shutdown_connections 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd678076300 0x7fd6780787c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd68c15f3e0 0x7fd68c15b4f0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd68c0d0750 0x7fd68c161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 --2- 172.21.15.66:0/186116742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd68c0b54d0 0x7fd68c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:18.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 >> 172.21.15.66:0/186116742 conn(0x7fd68c0d4ff0 msgr2=0x7fd68c0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:18.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 shutdown_connections 2024-05-10T11:22:18.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:18.815+0000 7fd691f19640 1 -- 172.21.15.66:0/186116742 wait complete. 2024-05-10T11:22:19.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:18.451553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7231': {'gid': 7231, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.190:6836/1055415762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 1055415762}, {'type': 'v1', 'addr': '172.21.15.190:6836', 'nonce': 1055415762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:22:19.229 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7231:up:replay 2024-05-10T11:22:20.230 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:20.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.348+0000 7fef9951b640 1 Processor -- start 2024-05-10T11:22:20.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.348+0000 7fef9951b640 1 -- start start 2024-05-10T11:22:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.349+0000 7fef9951b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef9415f1a0 0x7fef940d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.349+0000 7fef9951b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef94163510 0x7fef940b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.349+0000 7fef9951b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef940d0f90 con 0x7fef940d3a20 2024-05-10T11:22:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.349+0000 7fef9951b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fef940b1c20 con 0x7fef94163510 2024-05-10T11:22:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.349+0000 7fef9951b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fef940b1f00 con 0x7fef9415f1a0 2024-05-10T11:22:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef937fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef94163510 0x7fef940b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef927fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fef940d3a20 0x7fef94162e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36820/0 (socket says 172.21.15.66:36820) 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef927fc640 1 -- 172.21.15.66:0/103581119 learned_addr learned my addr 172.21.15.66:0/103581119 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef937fe640 1 -- 172.21.15.66:0/103581119 >> v2:172.21.15.190:3300/0 conn(0x7fef9415f1a0 msgr2=0x7fef940d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef92ffd640 1 --2- 172.21.15.66:0/103581119 >> v2:172.21.15.190:3300/0 conn(0x7fef9415f1a0 0x7fef940d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef937fe640 1 --2- 172.21.15.66:0/103581119 >> v2:172.21.15.190:3300/0 conn(0x7fef9415f1a0 0x7fef940d34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef937fe640 1 -- 172.21.15.66:0/103581119 >> v1:172.21.15.66:6789/0 conn(0x7fef940d3a20 legacy=0x7fef94162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef91ffb640 1 -- 172.21.15.66:0/103581119 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089548649 0 0) 0x7fef940d0f90 con 0x7fef940d3a20 2024-05-10T11:22:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.350+0000 7fef937fe640 1 -- 172.21.15.66:0/103581119 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef940b21e0 con 0x7fef94163510 2024-05-10T11:22:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef937fe640 1 --2- 172.21.15.66:0/103581119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef94163510 0x7fef940b29e0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0097a0 tx=0x7fef8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6b952d7a72d936 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef91ffb640 1 -- 172.21.15.66:0/103581119 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c037070 con 0x7fef94163510 2024-05-10T11:22:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef91ffb640 1 -- 172.21.15.66:0/103581119 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c032440 con 0x7fef94163510 2024-05-10T11:22:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef91ffb640 1 -- 172.21.15.66:0/103581119 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c032810 con 0x7fef94163510 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef9951b640 1 -- 172.21.15.66:0/103581119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef94163510 msgr2=0x7fef940b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef9951b640 1 --2- 172.21.15.66:0/103581119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef94163510 0x7fef940b29e0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0097a0 tx=0x7fef8c02a1e0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef9951b640 1 -- 172.21.15.66:0/103581119 shutdown_connections 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef9951b640 1 --2- 172.21.15.66:0/103581119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef94163510 0x7fef940b29e0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef9951b640 1 --2- 172.21.15.66:0/103581119 >> v2:172.21.15.190:3300/0 conn(0x7fef9415f1a0 0x7fef940d34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.351+0000 7fef9951b640 1 -- 172.21.15.66:0/103581119 >> 172.21.15.66:0/103581119 conn(0x7fef940d4f90 msgr2=0x7fef940d53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.352+0000 7fef9951b640 1 -- 172.21.15.66:0/103581119 shutdown_connections 2024-05-10T11:22:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.352+0000 7fef9951b640 1 -- 172.21.15.66:0/103581119 wait complete. 2024-05-10T11:22:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.353+0000 7fef9951b640 1 Processor -- start 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.353+0000 7fef9951b640 1 -- start start 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef9951b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 0x7fef94153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef9951b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9415f1a0 0x7fef940cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef9951b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94163510 0x7fef940cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef9951b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef9415f580 con 0x7fef940d3a20 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef9951b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef940d4050 con 0x7fef9415f1a0 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef9951b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef9415f700 con 0x7fef94163510 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 0x7fef94153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 0x7fef94153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45754/0 (socket says 172.21.15.66:45754) 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 -- 172.21.15.66:0/2088315950 learned_addr learned my addr 172.21.15.66:0/2088315950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef927fc640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9415f1a0 0x7fef940cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef937fe640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94163510 0x7fef940cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 -- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94163510 msgr2=0x7fef940cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94163510 0x7fef940cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 -- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9415f1a0 msgr2=0x7fef940cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9415f1a0 0x7fef940cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 -- 172.21.15.66:0/2088315950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef940cdcb0 con 0x7fef940d3a20 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef92ffd640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 0x7fef94153860 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fef8400ce40 tx=0x7fef8400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.354+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84003b90 con 0x7fef940d3a20 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.355+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef84003d30 con 0x7fef940d3a20 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.355+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef940cdf90 con 0x7fef940d3a20 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.355+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84004240 con 0x7fef940d3a20 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.355+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef940ce550 con 0x7fef940d3a20 2024-05-10T11:22:20.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.356+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef94069400 con 0x7fef940d3a20 2024-05-10T11:22:20.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.356+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef840043e0 con 0x7fef940d3a20 2024-05-10T11:22:20.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.357+0000 7fef8b7fe640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef740762d0 0x7fef74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:20.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.357+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fef84098280 con 0x7fef940d3a20 2024-05-10T11:22:20.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.357+0000 7fef927fc640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef740762d0 0x7fef74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:20.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.358+0000 7fef927fc640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef740762d0 0x7fef74078790 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fef940d1ca0 tx=0x7fef7c007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:20.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.361+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fef84061440 con 0x7fef940d3a20 2024-05-10T11:22:20.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.595+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef9408d040 con 0x7fef940d3a20 2024-05-10T11:22:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.596+0000 7fef8b7fe640 1 -- 172.21.15.66:0/2088315950 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5187 (secure 0 0 0) 0x7fef84065740 con 0x7fef940d3a20 2024-05-10T11:22:20.595 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:20.595 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":104,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:19.458385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7231":{"gid":7231,"name":"b","rank":0,"incarnation":102,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.190:6836/1055415762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1055415762},{"type":"v1","addr":"172.21.15.190:6836","nonce":1055415762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T11:22:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 104 2024-05-10T11:22:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef740762d0 msgr2=0x7fef74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef740762d0 0x7fef74078790 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fef940d1ca0 tx=0x7fef7c007b50 comp rx=0 tx=0).stop 2024-05-10T11:22:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 msgr2=0x7fef94153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 0x7fef94153860 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fef8400ce40 tx=0x7fef8400a660 comp rx=0 tx=0).stop 2024-05-10T11:22:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 shutdown_connections 2024-05-10T11:22:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fef740762d0 0x7fef74078790 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94163510 0x7fef940cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9415f1a0 0x7fef940cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 --2- 172.21.15.66:0/2088315950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef940d3a20 0x7fef94153860 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 >> 172.21.15.66:0/2088315950 conn(0x7fef940d4f90 msgr2=0x7fef940d5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 shutdown_connections 2024-05-10T11:22:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:20.598+0000 7fef9951b640 1 -- 172.21.15.66:0/2088315950 wait complete. 2024-05-10T11:22:21.011 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:19.458385+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7231': {'gid': 7231, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.190:6836/1055415762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 1055415762}, {'type': 'v1', 'addr': '172.21.15.190:6836', 'nonce': 1055415762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:22:21.011 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7231:up:rejoin 2024-05-10T11:22:22.012 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.129+0000 7f77bba9c640 1 Processor -- start 2024-05-10T11:22:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.129+0000 7f77bba9c640 1 -- start start 2024-05-10T11:22:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77bba9c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77b415f2c0 0x7f77b4163a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77bba9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 0x7f77b4073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77bba9c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b40cc3a0 con 0x7f77b40c6de0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77bba9c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f77b4073710 con 0x7f77b415f2c0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77bba9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77b40739f0 con 0x7f77b40ce290 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77b9037640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f77b40c6de0 0x7f77b40cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36826/0 (socket says 172.21.15.66:36826) 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.130+0000 7f77b9037640 1 -- 172.21.15.66:0/1114473936 learned_addr learned my addr 172.21.15.66:0/1114473936 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b9838640 1 --2- 172.21.15.66:0/1114473936 >> v2:172.21.15.190:3300/0 conn(0x7f77b415f2c0 0x7f77b4163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77ba039640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 0x7f77b4073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701042373 0 0) 0x7f77b40cc3a0 con 0x7f77b40c6de0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a0003520 con 0x7f77b40c6de0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2923310726 0 0) 0x7f77a0003520 con 0x7f77b40c6de0 2024-05-10T11:22:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 msgr2=0x7f77b4073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 0x7f77b4073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 >> v2:172.21.15.190:3300/0 conn(0x7f77b415f2c0 msgr2=0x7f77b4163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 --2- 172.21.15.66:0/1114473936 >> v2:172.21.15.190:3300/0 conn(0x7f77b415f2c0 0x7f77b4163a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b4073cd0 con 0x7f77b40c6de0 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f77a4001670 con 0x7f77b40c6de0 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 >> v1:172.21.15.66:6789/0 conn(0x7f77b40c6de0 legacy=0x7f77b40cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 0x7f77a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77b4073710 con 0x7f77a0004d40 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77b40739f0 con 0x7f77a0003a20 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77a000ba40 con 0x7f77b40ce290 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77ba039640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b9838640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.131+0000 7f77b9037640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 0x7f77a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77ba039640 1 -- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 msgr2=0x7f77a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77ba039640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b40ce290 0x7f77a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77ba039640 1 -- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77a0003a20 msgr2=0x7f77a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77ba039640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77ba039640 1 -- 172.21.15.66:0/1114473936 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a0003520 con 0x7f77a0004d40 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77ba039640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77a00051c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009fc0 tx=0x7f77a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9a4ad2b6e619a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac009c10 con 0x7f77a0004d40 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac036070 con 0x7f77a0004d40 2024-05-10T11:22:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.132+0000 7f77b8836640 1 -- 172.21.15.66:0/1114473936 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac031880 con 0x7f77a0004d40 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77bba9c640 1 -- 172.21.15.66:0/1114473936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 msgr2=0x7f77a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77bba9c640 1 --2- 172.21.15.66:0/1114473936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77a00051c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009fc0 tx=0x7f77a0005830 comp rx=0 tx=0).stop 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77ba039640 1 -- 172.21.15.66:0/1114473936 reap_dead start 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77bba9c640 1 -- 172.21.15.66:0/1114473936 shutdown_connections 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77bba9c640 1 -- 172.21.15.66:0/1114473936 >> 172.21.15.66:0/1114473936 conn(0x7f77b40d1d50 msgr2=0x7f77b40d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77bba9c640 1 -- 172.21.15.66:0/1114473936 shutdown_connections 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.133+0000 7f77bba9c640 1 -- 172.21.15.66:0/1114473936 wait complete. 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.134+0000 7f77bba9c640 1 Processor -- start 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.134+0000 7f77bba9c640 1 -- start start 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77bba9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77b40cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77bba9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77b4160790 0x7f77b41579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77bba9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b4161f70 0x7f77b41623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77bba9c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77b415f820 con 0x7f77a0004d40 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77bba9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77b415f6a0 con 0x7f77b4160790 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77bba9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77b4073000 con 0x7f77b4161f70 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77b9838640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77b40cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77b9838640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77b40cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45772/0 (socket says 172.21.15.66:45772) 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.135+0000 7f77b9838640 1 -- 172.21.15.66:0/4199651048 learned_addr learned my addr 172.21.15.66:0/4199651048 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77ba039640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b4161f70 0x7f77b41623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9037640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77b4160790 0x7f77b41579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9838640 1 -- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b4161f70 msgr2=0x7f77b41623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9838640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b4161f70 0x7f77b41623f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9838640 1 -- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77b4160790 msgr2=0x7f77b41579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9838640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77b4160790 0x7f77b41579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9838640 1 -- 172.21.15.66:0/4199651048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b415ac00 con 0x7f77a0004d40 2024-05-10T11:22:22.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9037640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77b4160790 0x7f77b41579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77b9838640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77b40cb3e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f77b0011960 tx=0x7f77b0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b000faf0 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b000fc90 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b4160e70 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0014440 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.136+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b4161430 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.137+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b406ff00 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.138+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f77b0012040 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.138+0000 7f77aa7fc640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f77980762d0 0x7f7798078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.139+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f77b0097de0 con 0x7f77a0004d40 2024-05-10T11:22:22.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.139+0000 7f77b9037640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f77980762d0 0x7f7798078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.139+0000 7f77b9037640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f77980762d0 0x7f7798078790 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000fb0 tx=0x7f77a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.143+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f77b406ff00 con 0x7f77a0004d40 2024-05-10T11:22:22.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.374+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77b4069400 con 0x7f77a0004d40 2024-05-10T11:22:22.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.374+0000 7f77aa7fc640 1 -- 172.21.15.66:0/4199651048 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) ==== 95+0+5194 (secure 0 0 0) 0x7f77b0019030 con 0x7f77a0004d40 2024-05-10T11:22:22.374 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:22.374 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":105,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:21.460384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7231":{"gid":7231,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":4,"addr":"172.21.15.190:6836/1055415762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1055415762},{"type":"v1","addr":"172.21.15.190:6836","nonce":1055415762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7231,"qdb_cluster":[7231]},"id":8}]} 2024-05-10T11:22:22.374 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 105 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f77980762d0 msgr2=0x7f7798078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f77980762d0 0x7f7798078790 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000fb0 tx=0x7f77a4009040 comp rx=0 tx=0).stop 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 msgr2=0x7f77b40cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77b40cb3e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f77b0011960 tx=0x7f77b0011e20 comp rx=0 tx=0).stop 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 shutdown_connections 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f77980762d0 0x7f7798078790 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77b4161f70 0x7f77b41623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77b4160790 0x7f77b41579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 --2- 172.21.15.66:0/4199651048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a0004d40 0x7f77b40cb3e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 >> 172.21.15.66:0/4199651048 conn(0x7f77b40d1d50 msgr2=0x7f77b40703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.376+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 shutdown_connections 2024-05-10T11:22:22.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.377+0000 7f77bba9c640 1 -- 172.21.15.66:0/4199651048 wait complete. 2024-05-10T11:22:22.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:21.460384+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7231': {'gid': 7231, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.190:6836/1055415762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 1055415762}, {'type': 'v1', 'addr': '172.21.15.190:6836', 'nonce': 1055415762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7231, 'qdb_cluster': [7231]} 2024-05-10T11:22:22.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:22:22.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T11:22:22.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.898+0000 7f55bc1c1640 1 Processor -- start 2024-05-10T11:22:22.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.898+0000 7f55bc1c1640 1 -- start start 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55bc1c1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55b40d0750 0x7f55b40d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55bc1c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40b54d0 0x7f55b40b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55bc1c1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b40d0ff0 con 0x7f55b415f3e0 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55bc1c1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f55b40d0d10 con 0x7f55b40d0750 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55bc1c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55b40b49f0 con 0x7f55b40b54d0 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55b40d0750 0x7f55b40d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55b40d0750 0x7f55b40d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45776/0 (socket says 172.21.15.66:45776) 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 -- 172.21.15.66:0/2367290444 learned_addr learned my addr 172.21.15.66:0/2367290444 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55ba75e640 1 --2- 172.21.15.66:0/2367290444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40b54d0 0x7f55b40b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 -- 172.21.15.66:0/2367290444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40b54d0 msgr2=0x7f55b40b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 --2- 172.21.15.66:0/2367290444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40b54d0 0x7f55b40b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 -- 172.21.15.66:0/2367290444 >> v1:172.21.15.190:6789/0 conn(0x7f55b415f3e0 legacy=0x7f55b40d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.899+0000 7f55b975c640 1 -- 172.21.15.66:0/2367290444 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b40b4cd0 con 0x7f55b40d0750 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.900+0000 7f55b975c640 1 --2- 172.21.15.66:0/2367290444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40d2110 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42a13761c22ceb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.900+0000 7f55b8f5b640 1 -- 172.21.15.66:0/2367290444 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4037070 con 0x7f55b40d0750 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.900+0000 7f55b8f5b640 1 -- 172.21.15.66:0/2367290444 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a4032440 con 0x7f55b40d0750 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.900+0000 7f55b8f5b640 1 -- 172.21.15.66:0/2367290444 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4032810 con 0x7f55b40d0750 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2367290444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 msgr2=0x7f55b40d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2367290444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40d2110 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a402a210 comp rx=0 tx=0).stop 2024-05-10T11:22:22.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2367290444 shutdown_connections 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2367290444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b40b54d0 0x7f55b40b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2367290444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40d2110 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2367290444 >> 172.21.15.66:0/2367290444 conn(0x7f55b40d4ff0 msgr2=0x7f55b40d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2367290444 shutdown_connections 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.901+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2367290444 wait complete. 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.902+0000 7f55bc1c1640 1 Processor -- start 2024-05-10T11:22:22.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.902+0000 7f55bc1c1640 1 -- start start 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55bc1c1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40b54d0 0x7f55b41546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55bc1c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55bc1c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b415f3e0 0x7f55b40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55bc1c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55b415f7c0 con 0x7f55b40d0750 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55bc1c1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40d3f90 con 0x7f55b40b54d0 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55bc1c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55b415f940 con 0x7f55b415f3e0 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45790/0 (socket says 172.21.15.66:45790) 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 -- 172.21.15.66:0/2387550938 learned_addr learned my addr 172.21.15.66:0/2387550938 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40b54d0 0x7f55b41546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55ba75e640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b415f3e0 0x7f55b40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 -- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b415f3e0 msgr2=0x7f55b40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b415f3e0 0x7f55b40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 -- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40b54d0 msgr2=0x7f55b41546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40b54d0 0x7f55b41546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 -- 172.21.15.66:0/2387550938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b4154c30 con 0x7f55b40d0750 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40b54d0 0x7f55b41546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.903+0000 7f55b975c640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40cc0c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.904+0000 7f55aa7fc640 1 -- 172.21.15.66:0/2387550938 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4041020 con 0x7f55b40d0750 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.904+0000 7f55aa7fc640 1 -- 172.21.15.66:0/2387550938 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a4030970 con 0x7f55b40d0750 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.904+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b40ba7c0 con 0x7f55b40d0750 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.904+0000 7f55aa7fc640 1 -- 172.21.15.66:0/2387550938 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4037040 con 0x7f55b40d0750 2024-05-10T11:22:22.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.904+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b40ccf10 con 0x7f55b40d0750 2024-05-10T11:22:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.905+0000 7f55aa7fc640 1 -- 172.21.15.66:0/2387550938 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55a4044020 con 0x7f55b40d0750 2024-05-10T11:22:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.906+0000 7f55aa7fc640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55980762d0 0x7f5598078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.906+0000 7f55aa7fc640 1 -- 172.21.15.66:0/2387550938 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f55a40b8260 con 0x7f55b40d0750 2024-05-10T11:22:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.906+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55980762d0 0x7f5598078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.907+0000 7f55befbb740 1 Processor -- start 2024-05-10T11:22:22.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.907+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55980762d0 0x7f5598078790 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006fd0 tx=0x7f55b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.907+0000 7f55befbb740 1 -- start start 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55befbb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 0x55ac9b042760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b042ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b012bb0 0x55ac9b0163c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55befbb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac9af7c8d0 con 0x55ac9b03ff50 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ac9af35c10 con 0x55ac9b012bb0 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ac9af78890 con 0x55ac9b040330 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 0x55ac9b042760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 0x55ac9b042760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45804/0 (socket says 172.21.15.66:45804) 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 -- 172.21.15.66:0/2511459236 learned_addr learned my addr 172.21.15.66:0/2511459236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b975c640 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b042ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55ba75e640 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b012bb0 0x55ac9b0163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 -- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 msgr2=0x55ac9b042ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b042ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 -- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b012bb0 msgr2=0x55ac9b0163c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b012bb0 0x55ac9b0163c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 -- 172.21.15.66:0/2511459236 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9af3d5d0 con 0x55ac9b03ff50 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b975c640 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b042ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 0x55ac9b042760 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d8e0 tx=0x7f55b0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd69a1f84ea6358 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55977fe640 1 -- 172.21.15.66:0/2511459236 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0024070 con 0x55ac9b03ff50 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55977fe640 1 -- 172.21.15.66:0/2511459236 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00149b0 con 0x55ac9b03ff50 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.908+0000 7f55977fe640 1 -- 172.21.15.66:0/2511459236 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0014d80 con 0x55ac9b03ff50 2024-05-10T11:22:22.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 -- 172.21.15.66:0/2511459236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 msgr2=0x55ac9b042760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 0x55ac9b042760 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d8e0 tx=0x7f55b0010000 comp rx=0 tx=0).stop 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 -- 172.21.15.66:0/2511459236 shutdown_connections 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b012bb0 0x55ac9b0163c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b042ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 --2- 172.21.15.66:0/2511459236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b03ff50 0x55ac9b042760 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 -- 172.21.15.66:0/2511459236 >> 172.21.15.66:0/2511459236 conn(0x55ac9b014e20 msgr2=0x55ac9b05d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 -- 172.21.15.66:0/2511459236 shutdown_connections 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.909+0000 7f55befbb740 1 -- 172.21.15.66:0/2511459236 wait complete. 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.910+0000 7f55befbb740 1 -- start start 2024-05-10T11:22:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.910+0000 7f55befbb740 1 Processor -- start 2024-05-10T11:22:22.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b05c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 0x55ac9b05ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b062920 0x55ac9b0458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac9b017fd0 con 0x55ac9b040330 2024-05-10T11:22:22.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ac9af39760 con 0x55ac9b03ff50 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ac9b0182b0 con 0x55ac9b062920 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 10 client.0 _ll_register_callbacks cb 0x55ac9af72cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 0x55ac9b05ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 0x55ac9b05ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45814/0 (socket says 172.21.15.66:45814) 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 -- 172.21.15.66:0/1329286969 learned_addr learned my addr 172.21.15.66:0/1329286969 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55ba75e640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b062920 0x55ac9b0458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b05c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 -- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b062920 msgr2=0x55ac9b0458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b062920 0x55ac9b0458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 -- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 msgr2=0x55ac9b05c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b05c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 -- 172.21.15.66:0/1329286969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9ac8e2d0 con 0x55ac9b040330 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55ba75e640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b062920 0x55ac9b0458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b05c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55b975c640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 0x55ac9b05ce30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f55a40b64b0 tx=0x7f55a4030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad6cf2bae1d8f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f5594ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f5594ff9640 1 -- 172.21.15.66:0/1329286969 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4080d50 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f5594ff9640 1 -- 172.21.15.66:0/1329286969 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f55a4085120 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.911+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b00149b0 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f5594ff9640 1 -- 172.21.15.66:0/1329286969 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) ==== 24+0+0 (secure 0 0 0) 0x7f55a4081940 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 10 client.8472 fetch_fsmap learned FSMap version 105 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) -- 0x55ac9ad586b0 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f5594ff9640 1 -- 172.21.15.66:0/1329286969 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00149b0 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f5594ff9640 1 -- 172.21.15.66:0/1329286969 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 105) ==== 3494+0+0 (secure 0 0 0) 0x7f55a403a030 con 0x55ac9b040330 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 10 client.8472 fetch_fsmap finished waiting for FSMap version 105 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 10 client.8472 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 20 client.8472 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b05fd10 0x55ac9b0600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 4 client.8472 mds_command: new command op to 7231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 --> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac9af00760 con 0x55ac9b05fd10 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.912+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b05fd10 0x55ac9b0600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.913+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b05fd10 0x55ac9b0600f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a60eac0902490d20 server_cookie=93604029daaa6cdb in_seq=0 out_seq=0 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.913+0000 7f5594ff9640 10 client.8472 ms_handle_connect on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.913+0000 7f5594ff9640 1 -- 172.21.15.66:0/1329286969 <== mds.0 v2:172.21.15.190:6834/1055415762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ac9af00760 con 0x55ac9b05fd10 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.913+0000 7f5594ff9640 10 client.8472 handle_command_reply: tid=0 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.913+0000 7f55befbb740 1 client.8472 shutdown 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 msgr2=0x55ac9b05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 0x55ac9b05ce30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f55a40b64b0 tx=0x7f55a4030f90 comp rx=0 tx=0).stop 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 shutdown_connections 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b05fd10 0x55ac9b0600f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b062920 0x55ac9b0458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b040330 0x55ac9b05ce30 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f5594ff9640 0 client.8472 ms_handle_reset on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 --2- 172.21.15.66:0/1329286969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b05c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 >> 172.21.15.66:0/1329286969 conn(0x55ac9b012bb0 msgr2=0x55ac9b011a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 shutdown_connections 2024-05-10T11:22:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 1 -- 172.21.15.66:0/1329286969 wait complete. 2024-05-10T11:22:22.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.914+0000 7f55befbb740 20 client.8472 trim_cache size 0 max 16384 2024-05-10T11:22:22.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.932+0000 7f55befbb740 1 Processor -- start 2024-05-10T11:22:22.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 -- start start 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b03f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b0162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b016800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4200fb0 con 0x55ac9b00d2d0 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41528d0 con 0x55ac9b03ff50 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f55b4152f20 con 0x55ac9b040330 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55ba75e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b016800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55ba75e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b016800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45822/0 (socket says 172.21.15.66:45822) 2024-05-10T11:22:22.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55ba75e640 1 -- 172.21.15.66:0/3748000688 learned_addr learned my addr 172.21.15.66:0/3748000688 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.933+0000 7f55b975c640 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b0162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b03f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55ba75e640 1 -- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 msgr2=0x55ac9b0162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55ba75e640 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b0162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55ba75e640 1 -- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 msgr2=0x55ac9b03f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55ba75e640 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b03f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55ba75e640 1 -- 172.21.15.66:0/3748000688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9b019160 con 0x55ac9b00d2d0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55ba75e640 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b016800 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x55ac9b061510 tx=0x7f55ac00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967bbe69d237ae8b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f5596ffd640 1 -- 172.21.15.66:0/3748000688 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac01e070 con 0x55ac9b00d2d0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f5596ffd640 1 -- 172.21.15.66:0/3748000688 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac004030 con 0x55ac9b00d2d0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f5596ffd640 1 -- 172.21.15.66:0/3748000688 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac003e60 con 0x55ac9b00d2d0 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 -- 172.21.15.66:0/3748000688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 msgr2=0x55ac9b016800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b016800 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x55ac9b061510 tx=0x7f55ac00f7d0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 -- 172.21.15.66:0/3748000688 shutdown_connections 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b016800 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b0162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 --2- 172.21.15.66:0/3748000688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b03f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.934+0000 7f55befbb740 1 -- 172.21.15.66:0/3748000688 >> 172.21.15.66:0/3748000688 conn(0x55ac9b012bb0 msgr2=0x55ac9b0466f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.935+0000 7f55befbb740 1 -- 172.21.15.66:0/3748000688 shutdown_connections 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.935+0000 7f55befbb740 1 -- 172.21.15.66:0/3748000688 wait complete. 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.935+0000 7f55befbb740 1 -- start start 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.935+0000 7f55befbb740 1 Processor -- start 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b053a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b016230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b016770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac9b043290 con 0x55ac9b00d2d0 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ac9ad586b0 con 0x55ac9b03ff50 2024-05-10T11:22:22.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55ac9b045e30 con 0x55ac9b040330 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55befbb740 10 client.0 _ll_register_callbacks cb 0x7f55a40b80b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b053a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b053a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45824/0 (socket says 172.21.15.66:45824) 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 -- 172.21.15.66:0/1953811274 learned_addr learned my addr 172.21.15.66:0/1953811274 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b975c640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b016230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55ba75e640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b016770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 -- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 msgr2=0x55ac9b016770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b016770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 -- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 msgr2=0x55ac9b016230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b016230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b9f5d640 1 -- 172.21.15.66:0/1953811274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9b053270 con 0x55ac9b00d2d0 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.936+0000 7f55b975c640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b016230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:22.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55b9f5d640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b053a50 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d530 tx=0x7f55b0004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a3964f1934349b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f5594ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f5594ff9640 1 -- 172.21.15.66:0/1953811274 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0032060 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f5594ff9640 1 -- 172.21.15.66:0/1953811274 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f55b002b480 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55ac004030 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f5594ff9640 1 -- 172.21.15.66:0/1953811274 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) ==== 24+0+0 (secure 0 0 0) 0x7f55b0024040 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 10 client.8478 fetch_fsmap learned FSMap version 105 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) -- 0x55ac9b012630 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f5594ff9640 1 -- 172.21.15.66:0/1953811274 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac004030 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f5594ff9640 1 -- 172.21.15.66:0/1953811274 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 105) ==== 3494+0+0 (secure 0 0 0) 0x7f55b0013070 con 0x55ac9b00d2d0 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 10 client.8478 fetch_fsmap finished waiting for FSMap version 105 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 10 client.8478 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 20 client.8478 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b012110 0x55ac9b05e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:22.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 4 client.8478 mds_command: new command op to 7231 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.937+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 --> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] -- command(tid 0: {"prefix": "status"}) -- 0x55ac9af8a4e0 con 0x55ac9b012110 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55b975c640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b012110 0x55ac9b05e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f5594ff9640 10 client.8478 ms_handle_connect on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55b975c640 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b012110 0x55ac9b05e890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42e17e1ab8e11b1 server_cookie=b797234de8c3e80e in_seq=0 out_seq=0 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f5594ff9640 1 -- 172.21.15.66:0/1953811274 <== mds.0 v2:172.21.15.190:6834/1055415762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55ac9af8a4e0 con 0x55ac9b012110 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f5594ff9640 10 client.8478 handle_command_reply: tid=0 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 client.8478 shutdown 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 msgr2=0x55ac9b053a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b053a50 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d530 tx=0x7f55b0004680 comp rx=0 tx=0).stop 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 shutdown_connections 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x55ac9b012110 0x55ac9b05e890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ac9b040330 0x55ac9b016770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac9b03ff50 0x55ac9b016230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 --2- 172.21.15.66:0/1953811274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac9b00d2d0 0x55ac9b053a50 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f5594ff9640 0 client.8478 ms_handle_reset on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 >> 172.21.15.66:0/1953811274 conn(0x55ac9b012bb0 msgr2=0x55ac9b036ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 shutdown_connections 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.938+0000 7f55befbb740 1 -- 172.21.15.66:0/1953811274 wait complete. 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55befbb740 20 client.8478 trim_cache size 0 max 16384 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 7231, 2024-05-10T11:22:22.945 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 4.4832836269999996, 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 105, 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 119, 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 119, 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 5.4492448810000003 2024-05-10T11:22:22.946 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55980762d0 msgr2=0x7f5598078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55980762d0 0x7f5598078790 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006fd0 tx=0x7f55b0008040 comp rx=0 tx=0).stop 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 msgr2=0x7f55b40cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40cc0c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a40046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 shutdown_connections 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f55980762d0 0x7f5598078790 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55b415f3e0 0x7f55b40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b40d0750 0x7f55b40cc0c0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 --2- 172.21.15.66:0/2387550938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55b40b54d0 0x7f55b41546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:22.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 >> 172.21.15.66:0/2387550938 conn(0x7f55b40d4ff0 msgr2=0x7f55b40b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:22.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 shutdown_connections 2024-05-10T11:22:22.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:22.939+0000 7f55bc1c1640 1 -- 172.21.15.66:0/2387550938 wait complete. 2024-05-10T11:22:22.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:22:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.054+0000 7fd6325a4640 1 Processor -- start 2024-05-10T11:22:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.054+0000 7fd6325a4640 1 -- start start 2024-05-10T11:22:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.054+0000 7fd6325a4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd62c06e5b0 0x7fd62c0d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd6325a4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c06d760 con 0x7fd62c15f330 2024-05-10T11:22:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd6325a4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c06da40 con 0x7fd62c0d38f0 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd6325a4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c0cd930 con 0x7fd62c06e5b0 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd62bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd62c15f330 0x7fd62c06dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:36842/0 (socket says 172.21.15.66:36842) 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd62bfff640 1 -- 172.21.15.66:0/1824073006 learned_addr learned my addr 172.21.15.66:0/1824073006 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd630b41640 1 --2- 172.21.15.66:0/1824073006 >> v2:172.21.15.190:3300/0 conn(0x7fd62c06e5b0 0x7fd62c0d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd62b7fe640 1 -- 172.21.15.66:0/1824073006 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597612501 0 0) 0x7fd62c06d760 con 0x7fd62c15f330 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd62b7fe640 1 -- 172.21.15.66:0/1824073006 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd618003520 con 0x7fd62c15f330 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd630b41640 1 -- 172.21.15.66:0/1824073006 >> v1:172.21.15.190:6789/0 conn(0x7fd62c0d38f0 legacy=0x7fd62c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd630b41640 1 -- 172.21.15.66:0/1824073006 >> v1:172.21.15.66:6789/0 conn(0x7fd62c15f330 legacy=0x7fd62c06dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.055+0000 7fd630b41640 1 -- 172.21.15.66:0/1824073006 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c0cd5c0 con 0x7fd62c06e5b0 2024-05-10T11:22:23.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.056+0000 7fd630b41640 1 --2- 172.21.15.66:0/1824073006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0d1810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd62402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b5869db65e3724 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:23.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.056+0000 7fd62b7fe640 1 -- 172.21.15.66:0/1824073006 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624007740 con 0x7fd62c06e5b0 2024-05-10T11:22:23.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.056+0000 7fd62b7fe640 1 -- 172.21.15.66:0/1824073006 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6240078e0 con 0x7fd62c06e5b0 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.056+0000 7fd62b7fe640 1 -- 172.21.15.66:0/1824073006 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624007c90 con 0x7fd62c06e5b0 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 -- 172.21.15.66:0/1824073006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 msgr2=0x7fd62c0d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 --2- 172.21.15.66:0/1824073006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0d1810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd62402a660 comp rx=0 tx=0).stop 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 -- 172.21.15.66:0/1824073006 shutdown_connections 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 --2- 172.21.15.66:0/1824073006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0d1810 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 -- 172.21.15.66:0/1824073006 >> 172.21.15.66:0/1824073006 conn(0x7fd62c0d2dd0 msgr2=0x7fd62c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 -- 172.21.15.66:0/1824073006 shutdown_connections 2024-05-10T11:22:23.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.057+0000 7fd6325a4640 1 -- 172.21.15.66:0/1824073006 wait complete. 2024-05-10T11:22:23.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.058+0000 7fd6325a4640 1 Processor -- start 2024-05-10T11:22:23.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.058+0000 7fd6325a4640 1 -- start start 2024-05-10T11:22:23.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd6325a4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd6325a4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd62c0d38f0 0x7fd62c09ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd6325a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 0x7fd62c15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd6325a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0d0710 con 0x7fd62c15f330 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd6325a4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0d0590 con 0x7fd62c06e5b0 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd6325a4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0cedd0 con 0x7fd62c0d38f0 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 0x7fd62c15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 0x7fd62c15de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45826/0 (socket says 172.21.15.66:45826) 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 -- 172.21.15.66:0/4020649553 learned_addr learned my addr 172.21.15.66:0/4020649553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd62bfff640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd623fff640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd62c0d38f0 0x7fd62c09ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 -- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd62c0d38f0 msgr2=0x7fd62c09ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd62c0d38f0 0x7fd62c09ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 -- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 msgr2=0x7fd62c0b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 -- 172.21.15.66:0/4020649553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c0a0460 con 0x7fd62c15f330 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.059+0000 7fd630b41640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 0x7fd62c15de40 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd624004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.060+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624040070 con 0x7fd62c15f330 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.060+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd624031c40 con 0x7fd62c15f330 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.060+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c09df30 con 0x7fd62c15f330 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.060+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624009450 con 0x7fd62c15f330 2024-05-10T11:22:23.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.060+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c09e4f0 con 0x7fd62c15f330 2024-05-10T11:22:23.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.061+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c069400 con 0x7fd62c15f330 2024-05-10T11:22:23.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.061+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd624039040 con 0x7fd62c15f330 2024-05-10T11:22:23.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.062+0000 7fd6297fa640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd60c0762d0 0x7fd60c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:23.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.062+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fd6240b8930 con 0x7fd62c15f330 2024-05-10T11:22:23.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.062+0000 7fd62bfff640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd60c0762d0 0x7fd60c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:23.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.063+0000 7fd62bfff640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd60c0762d0 0x7fd60c078790 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0011e0 tx=0x7fd61c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:23.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.066+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd624081a60 con 0x7fd62c15f330 2024-05-10T11:22:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.296+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd62c06e040 con 0x7fd62c15f330 2024-05-10T11:22:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.296+0000 7fd6297fa640 1 -- 172.21.15.66:0/4020649553 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v105) ==== 53+0+73 (secure 0 0 0) 0x7fd624085d60 con 0x7fd62c15f330 2024-05-10T11:22:23.295 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd60c0762d0 msgr2=0x7fd60c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd60c0762d0 0x7fd60c078790 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0011e0 tx=0x7fd61c007d30 comp rx=0 tx=0).stop 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 msgr2=0x7fd62c15de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 0x7fd62c15de40 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd624004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 shutdown_connections 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd60c0762d0 0x7fd60c078790 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd62c15f330 0x7fd62c15de40 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd62c0d38f0 0x7fd62c09ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 --2- 172.21.15.66:0/4020649553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62c06e5b0 0x7fd62c0b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 >> 172.21.15.66:0/4020649553 conn(0x7fd62c0d2dd0 msgr2=0x7fd62c0d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 shutdown_connections 2024-05-10T11:22:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23.298+0000 7fd6325a4640 1 -- 172.21.15.66:0/4020649553 wait complete. 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:22:23.309 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:23.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.310 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:22:23.327 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:22:23.327 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:22:23.327 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:22:23.327 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:22:23.328 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42150sec preferred_lft 42150sec 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:23.329 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:22:23.330 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:22:23.330 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:23.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.330 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:22:23.393 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:23.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.395 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:22:23.452 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:22:23.452 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:22:23.452 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:22:23.452 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:22:23.452 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:22:23.453 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:22:23.453 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:22:23.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:22:23.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:22:23.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:22:23.453 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:22:23.455 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-05-10T11:22:23.456+0000 7f1328843640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:22:23.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:22:23.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:23.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.584 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:22:23.600 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:22:23.600 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:22:23.600 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:23.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.601 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:22:23.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:23.667 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:23.723 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:23.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:23.723 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:23.779 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:22:23.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.779 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:23.864 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:23.864 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:23.864 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:23.873 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:23.873 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:23.873 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:23.873 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:23.874 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:23.880 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:23.880 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:23.880 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:23.880 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:23.880 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:23.880 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:22:23.881 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:22:23.883 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:22:23.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:23.883 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:23.908 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:22:24.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:22:24.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.009 INFO:teuthology.orchestra.run.smithi066.stdout:client6638 2024-05-10T11:22:24.009 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:24.009 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:24.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:24.026 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T11:22:24.086 INFO:teuthology.orchestra.run.smithi066.stdout:./ 2024-05-10T11:22:24.086 INFO:teuthology.orchestra.run.smithi066.stdout:./parent 2024-05-10T11:22:24.086 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed 2024-05-10T11:22:24.086 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/charlie 2024-05-10T11:22:24.086 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/alpha 2024-05-10T11:22:24.087 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/unflushed 2024-05-10T11:22:24.087 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/unflushed/jfile 2024-05-10T11:22:24.087 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.087 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.087 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.087 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.087 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T11:22:24.087 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.193 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:24.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.202 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.202 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.203 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.203 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.203 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-05-10T11:22:24.203 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.311 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:22:24.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.320 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.320 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.320 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.321 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.321 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-05-10T11:22:24.321 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.429 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:22:24.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.439 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.439 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.439 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.439 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.439 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-05-10T11:22:24.439 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.546 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628280 2024-05-10T11:22:24.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.556 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.557 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.557 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.557 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.557 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-05-10T11:22:24.557 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.665 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627778 2024-05-10T11:22:24.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.674 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.674 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.675 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.675 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.675 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-05-10T11:22:24.675 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.783 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627779 2024-05-10T11:22:24.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.792 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:24.792 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:24.792 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:24.792 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:24.792 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-05-10T11:22:24.793 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:24.900 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627780 2024-05-10T11:22:24.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:24.909 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:24.909 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:24.966 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:24.966 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:25.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:22:25.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.168+0000 7f414ab40640 1 Processor -- start 2024-05-10T11:22:25.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.168+0000 7f414ab40640 1 -- start start 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f414ab40640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f414413ff40 0x7f4144145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f414ab40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4144072600 0x7f41440c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f414ab40640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4144146900 con 0x7f41441463a0 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f414ab40640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4144140320 con 0x7f414413ff40 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f414ab40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f414415de40 con 0x7f4144072600 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f41488dc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f414413ff40 0x7f4144145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f41490dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4144072600 0x7f41440c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f4143fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f41441463a0 0x7f4144071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:38836/0 (socket says 172.21.15.66:38836) 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.169+0000 7f4143fff640 1 -- 172.21.15.66:0/1684133680 learned_addr learned my addr 172.21.15.66:0/1684133680 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.170+0000 7f41488dc640 1 -- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4144072600 msgr2=0x7f41440c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.170+0000 7f41488dc640 1 --2- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4144072600 0x7f41440c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.170+0000 7f41488dc640 1 -- 172.21.15.66:0/1684133680 >> v1:172.21.15.190:6789/0 conn(0x7f41441463a0 legacy=0x7f4144071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.170+0000 7f41488dc640 1 -- 172.21.15.66:0/1684133680 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414415d7f0 con 0x7f414413ff40 2024-05-10T11:22:25.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.170+0000 7f41490dd640 1 --2- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4144072600 0x7f41440c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f41488dc640 1 --2- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f4144145e60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097a0 tx=0x7f413c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=468118eaf112c3d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f41437fe640 1 -- 172.21.15.66:0/1684133680 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c037070 con 0x7f414413ff40 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f41437fe640 1 -- 172.21.15.66:0/1684133680 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c032440 con 0x7f414413ff40 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f41437fe640 1 -- 172.21.15.66:0/1684133680 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c032810 con 0x7f414413ff40 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 -- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 msgr2=0x7f4144145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 --2- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f4144145e60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097a0 tx=0x7f413c02a180 comp rx=0 tx=0).stop 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 -- 172.21.15.66:0/1684133680 shutdown_connections 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 --2- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4144072600 0x7f41440c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 --2- 172.21.15.66:0/1684133680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f4144145e60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 -- 172.21.15.66:0/1684133680 >> 172.21.15.66:0/1684133680 conn(0x7f41440d0c30 msgr2=0x7f41440d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:25.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 -- 172.21.15.66:0/1684133680 shutdown_connections 2024-05-10T11:22:25.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.171+0000 7f414ab40640 1 -- 172.21.15.66:0/1684133680 wait complete. 2024-05-10T11:22:25.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.173+0000 7f414ab40640 1 Processor -- start 2024-05-10T11:22:25.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.173+0000 7f414ab40640 1 -- start start 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.173+0000 7f414ab40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 0x7f414406dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.173+0000 7f414ab40640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f41440b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.173+0000 7f414ab40640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41441463a0 0x7f41441f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f414ab40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f414415d4a0 con 0x7f4144072600 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f414ab40640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4144161910 con 0x7f414413ff40 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f414ab40640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f414415e2d0 con 0x7f41441463a0 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 0x7f414406dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 0x7f414406dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40964/0 (socket says 172.21.15.66:40964) 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 -- 172.21.15.66:0/3498446327 learned_addr learned my addr 172.21.15.66:0/3498446327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41490dd640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41441463a0 0x7f41441f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f4143fff640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f41440b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 -- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41441463a0 msgr2=0x7f41441f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41441463a0 0x7f41441f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 -- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 msgr2=0x7f41440b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f41440b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 -- 172.21.15.66:0/3498446327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414406e350 con 0x7f4144072600 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41488dc640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 0x7f414406dc70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f413c035040 tx=0x7f413c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c037040 con 0x7f4144072600 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c030500 con 0x7f4144072600 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414406e630 con 0x7f4144072600 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c030910 con 0x7f4144072600 2024-05-10T11:22:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.174+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414406ebf0 con 0x7f4144072600 2024-05-10T11:22:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.175+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4144069400 con 0x7f4144072600 2024-05-10T11:22:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.176+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f413c044020 con 0x7f4144072600 2024-05-10T11:22:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.176+0000 7f41417fa640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f41240762d0 0x7f4124078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.176+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f413c0b7ac0 con 0x7f4144072600 2024-05-10T11:22:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.177+0000 7f4143fff640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f41240762d0 0x7f4124078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.177+0000 7f4143fff640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f41240762d0 0x7f4124078790 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f414415b350 tx=0x7f412c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:25.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.181+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f413c081250 con 0x7f4144072600 2024-05-10T11:22:25.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.385+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41440c7970 con 0x7f4144072600 2024-05-10T11:22:25.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.386+0000 7f41417fa640 1 -- 172.21.15.66:0/3498446327 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v119) ==== 80+0+124 (secure 0 0 0) 0x7f413c080b50 con 0x7f4144072600 2024-05-10T11:22:25.385 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6836/3723690401 2024-05-11T11:22:17.439456+0000 2024-05-10T11:22:25.385 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6834/3723690401 2024-05-11T11:22:17.439456+0000 2024-05-10T11:22:25.386 INFO:teuthology.orchestra.run.smithi066.stderr:listed 2 entries 2024-05-10T11:22:25.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f41240762d0 msgr2=0x7f4124078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f41240762d0 0x7f4124078790 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f414415b350 tx=0x7f412c009040 comp rx=0 tx=0).stop 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 msgr2=0x7f414406dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 0x7f414406dc70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f413c035040 tx=0x7f413c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 shutdown_connections 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f41240762d0 0x7f4124078790 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41441463a0 0x7f41441f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414413ff40 0x7f41440b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 --2- 172.21.15.66:0/3498446327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4144072600 0x7f414406dc70 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 >> 172.21.15.66:0/3498446327 conn(0x7f41440d0c30 msgr2=0x7f414413e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 shutdown_connections 2024-05-10T11:22:25.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.388+0000 7f414ab40640 1 -- 172.21.15.66:0/3498446327 wait complete. 2024-05-10T11:22:25.398 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:22:25.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:25.399 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:25.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:22:25.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:25.429 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:22:25.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:25.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.630+0000 7f613bfa4640 1 Processor -- start 2024-05-10T11:22:25.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.630+0000 7f613bfa4640 1 -- start start 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f613bfa4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61340cf660 0x7f61340cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f613bfa4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f613415f5f0 0x7f613406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f613bfa4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340d3900 0x7f613406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f613bfa4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f61340d0760 con 0x7f61340cf660 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f613bfa4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f61340cff80 con 0x7f613415f5f0 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f613bfa4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f61340d1d70 con 0x7f61340d3900 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f6139d40640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61340cf660 0x7f61340cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f6139d40640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61340cf660 0x7f61340cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40972/0 (socket says 172.21.15.66:40972) 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.631+0000 7f6139d40640 1 -- 172.21.15.66:0/335342707 learned_addr learned my addr 172.21.15.66:0/335342707 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f6139d40640 1 -- 172.21.15.66:0/335342707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340d3900 msgr2=0x7f613406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f613a541640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340d3900 0x7f613406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f613953f640 1 --2- 172.21.15.66:0/335342707 >> v2:172.21.15.190:3300/0 conn(0x7f613415f5f0 0x7f613406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f6139d40640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340d3900 0x7f613406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f6139d40640 1 -- 172.21.15.66:0/335342707 >> v2:172.21.15.190:3300/0 conn(0x7f613415f5f0 msgr2=0x7f613406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f6139d40640 1 --2- 172.21.15.66:0/335342707 >> v2:172.21.15.190:3300/0 conn(0x7f613415f5f0 0x7f613406d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f6139d40640 1 -- 172.21.15.66:0/335342707 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61340d2050 con 0x7f61340cf660 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f613a541640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340d3900 0x7f613406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.632+0000 7f6139d40640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340cf660 0x7f61340cfa40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f6134073110 tx=0x7f613002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc713a7a09aab776 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f6138d3e640 1 -- 172.21.15.66:0/335342707 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037070 con 0x7f61340cf660 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f6138d3e640 1 -- 172.21.15.66:0/335342707 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613002ae00 con 0x7f61340cf660 2024-05-10T11:22:25.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f6138d3e640 1 -- 172.21.15.66:0/335342707 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130032660 con 0x7f61340cf660 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 -- 172.21.15.66:0/335342707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340cf660 msgr2=0x7f61340cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340cf660 0x7f61340cfa40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f6134073110 tx=0x7f613002a0b0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 -- 172.21.15.66:0/335342707 shutdown_connections 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340d3900 0x7f613406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 --2- 172.21.15.66:0/335342707 >> v2:172.21.15.190:3300/0 conn(0x7f613415f5f0 0x7f613406d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 --2- 172.21.15.66:0/335342707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340cf660 0x7f61340cfa40 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 -- 172.21.15.66:0/335342707 >> 172.21.15.66:0/335342707 conn(0x7f61340d2de0 msgr2=0x7f61340d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:25.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 -- 172.21.15.66:0/335342707 shutdown_connections 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.633+0000 7f613bfa4640 1 -- 172.21.15.66:0/335342707 wait complete. 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.634+0000 7f613bfa4640 1 Processor -- start 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 -- start start 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340cf660 0x7f61340cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61340d3900 0x7f61340b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 0x7f613415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f613406e1d0 con 0x7f613415f5f0 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f61340b1ef0 con 0x7f61340d3900 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613bfa4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f613406e350 con 0x7f61340cf660 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613a541640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 0x7f613415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613a541640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 0x7f613415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40974/0 (socket says 172.21.15.66:40974) 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.635+0000 7f613a541640 1 -- 172.21.15.66:0/1888180098 learned_addr learned my addr 172.21.15.66:0/1888180098 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f6139d40640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340cf660 0x7f61340cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613953f640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61340d3900 0x7f61340b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613a541640 1 -- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340cf660 msgr2=0x7f61340cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613a541640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340cf660 0x7f61340cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613a541640 1 -- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61340d3900 msgr2=0x7f61340b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613a541640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61340d3900 0x7f61340b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613a541640 1 -- 172.21.15.66:0/1888180098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61340b3a50 con 0x7f613415f5f0 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f6139d40640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340cf660 0x7f61340cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613953f640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61340d3900 0x7f61340b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613a541640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 0x7f613415b290 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f612c00ced0 tx=0x7f612c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c003b90 con 0x7f613415f5f0 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612c003d50 con 0x7f613415f5f0 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61340b3d30 con 0x7f613415f5f0 2024-05-10T11:22:25.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c004260 con 0x7f613415f5f0 2024-05-10T11:22:25.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.636+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61340b42f0 con 0x7f613415f5f0 2024-05-10T11:22:25.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.637+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6134069400 con 0x7f613415f5f0 2024-05-10T11:22:25.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.638+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f612c004400 con 0x7f613415f5f0 2024-05-10T11:22:25.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.638+0000 7f612a7fc640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6118076300 0x7f61180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:25.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.639+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f612c098130 con 0x7f613415f5f0 2024-05-10T11:22:25.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.639+0000 7f6139d40640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6118076300 0x7f61180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:25.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.639+0000 7f6139d40640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6118076300 0x7f61180787c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6130034000 tx=0x7f613002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:25.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.643+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f612c061970 con 0x7f613415f5f0 2024-05-10T11:22:25.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.875+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6134070300 con 0x7f613415f5f0 2024-05-10T11:22:25.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.876+0000 7f612a7fc640 1 -- 172.21.15.66:0/1888180098 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) ==== 95+0+5194 (secure 0 0 0) 0x7f612c061270 con 0x7f613415f5f0 2024-05-10T11:22:25.876 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:25.876 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":105,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:21.460384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7231":{"gid":7231,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":4,"addr":"172.21.15.190:6836/1055415762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1055415762},{"type":"v1","addr":"172.21.15.190:6836","nonce":1055415762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7231,"qdb_cluster":[7231]},"id":8}]} 2024-05-10T11:22:25.876 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 105 2024-05-10T11:22:25.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6118076300 msgr2=0x7f61180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6118076300 0x7f61180787c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6130034000 tx=0x7f613002e000 comp rx=0 tx=0).stop 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 msgr2=0x7f613415b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 0x7f613415b290 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f612c00ced0 tx=0x7f612c00a710 comp rx=0 tx=0).stop 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 shutdown_connections 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6118076300 0x7f61180787c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613415f5f0 0x7f613415b290 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61340d3900 0x7f61340b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 --2- 172.21.15.66:0/1888180098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61340cf660 0x7f61340cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 >> 172.21.15.66:0/1888180098 conn(0x7f61340d2de0 msgr2=0x7f613415e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 shutdown_connections 2024-05-10T11:22:25.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:25.878+0000 7f613bfa4640 1 -- 172.21.15.66:0/1888180098 wait complete. 2024-05-10T11:22:25.889 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json tag path /parent mytag123 2024-05-10T11:22:26.021 INFO:teuthology.orchestra.run.smithi190.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-05-10T11:22:26.021 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-05-10T11:22:26.022 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-05-10T11:22:26.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.068+0000 7f0fb8677f40 1 Processor -- start 2024-05-10T11:22:26.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.068+0000 7f0fb8677f40 1 -- start start 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.068+0000 7f0fb8677f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b5930b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.068+0000 7f0fb8677f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 0x55b5931d7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb8677f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5930b26c0 0x55b5931d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb8677f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b5930b9ea0 con 0x55b5931455f0 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb8677f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b593017f50 con 0x55b5930b26c0 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb8677f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b5930b98e0 con 0x55b59309f900 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 0x55b5931d7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 0x55b5931d7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40980/0 (socket says 172.21.15.66:40980) 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 -- 172.21.15.66:0/1314192212 learned_addr learned my addr 172.21.15.66:0/1314192212 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb6171640 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b5930b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb6972640 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5930b26c0 0x55b5931d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 -- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 msgr2=0x55b5930b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b5930b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 -- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5930b26c0 msgr2=0x55b5931d8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5930b26c0 0x55b5931d8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 -- 172.21.15.66:0/1314192212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5931328d0 con 0x55b5931455f0 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb6972640 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5930b26c0 0x55b5931d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb5970640 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 0x55b5931d7ad0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0fac025bc0 tx=0x7f0fac04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d09d6f5edd8648c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb496e640 1 -- 172.21.15.66:0/1314192212 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac059040 con 0x55b5931455f0 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb496e640 1 -- 172.21.15.66:0/1314192212 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac065070 con 0x55b5931455f0 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.069+0000 7f0fb496e640 1 -- 172.21.15.66:0/1314192212 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac054c30 con 0x55b5931455f0 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 -- 172.21.15.66:0/1314192212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 msgr2=0x55b5931d7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 0x55b5931d7ad0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0fac025bc0 tx=0x7f0fac04e000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 -- 172.21.15.66:0/1314192212 shutdown_connections 2024-05-10T11:22:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5930b26c0 0x55b5931d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5931455f0 0x55b5931d7ad0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/1314192212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b5930b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 -- 172.21.15.66:0/1314192212 >> 172.21.15.66:0/1314192212 conn(0x55b59306f420 msgr2=0x55b5930b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 -- 172.21.15.66:0/1314192212 shutdown_connections 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 -- 172.21.15.66:0/1314192212 wait complete. 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.070+0000 7f0fb8677f40 1 Processor -- start 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 -- start start 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b59309ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5930b26c0 0x55b5931cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5931455f0 0x55b5931cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b5930b05d0 con 0x55b5930b26c0 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b59306e5d0 con 0x55b5931455f0 2024-05-10T11:22:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb8677f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b59306e820 con 0x55b59309f900 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb5970640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5930b26c0 0x55b5931cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb5970640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5930b26c0 0x55b5931cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40984/0 (socket says 172.21.15.66:40984) 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb5970640 1 -- 172.21.15.66:0/3408017814 learned_addr learned my addr 172.21.15.66:0/3408017814 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb6171640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b59309ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.071+0000 7f0fb6972640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5931455f0 0x55b5931cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb5970640 1 -- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 msgr2=0x55b59309ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb5970640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b59309f900 0x55b59309ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb5970640 1 -- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5931455f0 msgr2=0x55b5931cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb5970640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5931455f0 0x55b5931cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb5970640 1 -- 172.21.15.66:0/3408017814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5930b5f50 con 0x55b5930b26c0 2024-05-10T11:22:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb5970640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5930b26c0 0x55b5931cf410 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x55b5930a0050 tx=0x7f0fac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fa77fe640 1 -- 172.21.15.66:0/3408017814 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac070070 con 0x55b5930b26c0 2024-05-10T11:22:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fa77fe640 1 -- 172.21.15.66:0/3408017814 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac054d50 con 0x55b5930b26c0 2024-05-10T11:22:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5931310a0 con 0x55b5930b26c0 2024-05-10T11:22:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fa77fe640 1 -- 172.21.15.66:0/3408017814 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac059040 con 0x55b5930b26c0 2024-05-10T11:22:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.072+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59306fd60 con 0x55b5930b26c0 2024-05-10T11:22:26.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:22:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fa77fe640 1 -- 172.21.15.66:0/3408017814 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fac073070 con 0x55b5930b26c0 2024-05-10T11:22:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fa77fe640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f98074d00 0x7f0f980771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fa77fe640 1 -- 172.21.15.66:0/3408017814 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f0fac0dadb0 con 0x55b5930b26c0 2024-05-10T11:22:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fb6171640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f98074d00 0x7f0f980771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55b593142fd0 0x55b593071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55b593099a10 con 0x55b593142fd0 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.074+0000 7f0fb6972640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55b593142fd0 0x55b593071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb6972640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55b593142fd0 0x55b593071510 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb6171640 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f98074d00 0x7f0f980771c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005fd0 tx=0x7f0fa8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb6972640 1 -- 172.21.15.66:0/3408017814 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f0fb000c3c0 con 0x55b593142fd0 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55b593142fd0 msgr2=0x55b593071510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55b593142fd0 0x55b593071510 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f98074d00 msgr2=0x7f0f980771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0f98074d00 0x7f0f980771c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005fd0 tx=0x7f0fa8007040 comp rx=0 tx=0).stop 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5930b26c0 msgr2=0x55b5931cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 --2- 172.21.15.66:0/3408017814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5930b26c0 0x55b5931cf410 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x55b5930a0050 tx=0x7f0fac002fb0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb6972640 1 -- 172.21.15.66:0/3408017814 reap_dead start 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 shutdown_connections 2024-05-10T11:22:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 >> 172.21.15.66:0/3408017814 conn(0x55b59306f420 msgr2=0x55b593144570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 shutdown_connections 2024-05-10T11:22:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.075+0000 7f0fb8677f40 1 -- 172.21.15.66:0/3408017814 wait complete. 2024-05-10T11:22:26.081 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-05-10T11:22:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.126+0000 7fedd870ff40 1 Processor -- start 2024-05-10T11:22:26.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.126+0000 7fedd870ff40 1 -- start start 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd870ff40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8986fa0 0x55fde8a52680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd870ff40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 0x55fde89b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd870ff40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde8a5c8b0 0x55fde89b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd870ff40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fde8a5cc90 con 0x55fde89b4d30 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd870ff40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fde892cf50 con 0x55fde8986fa0 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd870ff40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55fde8985fc0 con 0x55fde8a5c8b0 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 0x55fde89b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 0x55fde89b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40988/0 (socket says 172.21.15.66:40988) 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 -- 172.21.15.66:0/1364055714 learned_addr learned my addr 172.21.15.66:0/1364055714 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd620b640 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8986fa0 0x55fde8a52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd6a0c640 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde8a5c8b0 0x55fde89b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 -- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde8a5c8b0 msgr2=0x55fde89b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde8a5c8b0 0x55fde89b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 -- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8986fa0 msgr2=0x55fde8a52680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8986fa0 0x55fde8a52680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 -- 172.21.15.66:0/1364055714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fde8a52fc0 con 0x55fde89b4d30 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.127+0000 7fedd5a0a640 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 0x55fde89b41e0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00a4f0 tx=0x7fedcc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d0c1529947cc85 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd4a08640 1 -- 172.21.15.66:0/1364055714 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc059040 con 0x55fde89b4d30 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd4a08640 1 -- 172.21.15.66:0/1364055714 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc064070 con 0x55fde89b4d30 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd4a08640 1 -- 172.21.15.66:0/1364055714 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc054bf0 con 0x55fde89b4d30 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 -- 172.21.15.66:0/1364055714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 msgr2=0x55fde89b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 0x55fde89b41e0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00a4f0 tx=0x7fedcc04e000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 -- 172.21.15.66:0/1364055714 shutdown_connections 2024-05-10T11:22:26.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde8a5c8b0 0x55fde89b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde89b4d30 0x55fde89b41e0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 --2- 172.21.15.66:0/1364055714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8986fa0 0x55fde8a52680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 -- 172.21.15.66:0/1364055714 >> 172.21.15.66:0/1364055714 conn(0x55fde89b2920 msgr2=0x55fde89b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 -- 172.21.15.66:0/1364055714 shutdown_connections 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.128+0000 7fedd870ff40 1 -- 172.21.15.66:0/1364055714 wait complete. 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 Processor -- start 2024-05-10T11:22:26.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 -- start start 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde8986fa0 0x55fde8a3c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde89b4d30 0x55fde8a4df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8a5c8b0 0x55fde8a4e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fde8a5f4c0 con 0x55fde8986fa0 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fde8a5eda0 con 0x55fde8a5c8b0 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.129+0000 7fedd870ff40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55fde8a5ab40 con 0x55fde89b4d30 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde8986fa0 0x55fde8a3c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde8986fa0 0x55fde8a3c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41000/0 (socket says 172.21.15.66:41000) 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 -- 172.21.15.66:0/3726558791 learned_addr learned my addr 172.21.15.66:0/3726558791 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd5a0a640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde89b4d30 0x55fde8a4df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd6a0c640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8a5c8b0 0x55fde8a4e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 -- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde89b4d30 msgr2=0x55fde8a4df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fde89b4d30 0x55fde8a4df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 -- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8a5c8b0 msgr2=0x55fde8a4e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde8a5c8b0 0x55fde8a4e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 -- 172.21.15.66:0/3726558791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fde8a4f3b0 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd620b640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde8986fa0 0x55fde8a3c320 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fedc80086a0 tx=0x7fedc8008790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedc77fe640 1 -- 172.21.15.66:0/3726558791 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8019020 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedc77fe640 1 -- 172.21.15.66:0/3726558791 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc8015880 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedc77fe640 1 -- 172.21.15.66:0/3726558791 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8015c50 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fde8a4f690 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.130+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fde8a3c860 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.132+0000 7fedc77fe640 1 -- 172.21.15.66:0/3726558791 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fedc801c020 con 0x55fde8986fa0 2024-05-10T11:22:26.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.132+0000 7fedc77fe640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fedb8074cb0 0x7fedb8077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.132+0000 7fedc77fe640 1 -- 172.21.15.66:0/3726558791 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fedc8096b90 con 0x55fde8986fa0 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.132+0000 7fedd5a0a640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fedb8074cb0 0x7fedb8077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55fde8a52b80 0x55fde8a50680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55fde8a4b580 con 0x55fde8a52b80 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd6a0c640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55fde8a52b80 0x55fde8a50680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd5a0a640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fedb8074cb0 0x7fedb8077170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fedcc060000 tx=0x7fedcc051000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd6a0c640 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55fde8a52b80 0x55fde8a50680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd6a0c640 1 -- 172.21.15.66:0/3726558791 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fedd0003450 con 0x55fde8a52b80 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55fde8a52b80 msgr2=0x55fde8a50680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55fde8a52b80 0x55fde8a50680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fedb8074cb0 msgr2=0x7fedb8077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fedb8074cb0 0x7fedb8077170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fedcc060000 tx=0x7fedcc051000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde8986fa0 msgr2=0x55fde8a3c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd870ff40 1 --2- 172.21.15.66:0/3726558791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde8986fa0 0x55fde8a3c320 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fedc80086a0 tx=0x7fedc8008790 comp rx=0 tx=0).stop 2024-05-10T11:22:26.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.133+0000 7fedd6a0c640 1 -- 172.21.15.66:0/3726558791 reap_dead start 2024-05-10T11:22:26.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.134+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 shutdown_connections 2024-05-10T11:22:26.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.134+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 >> 172.21.15.66:0/3726558791 conn(0x55fde89b2920 msgr2=0x55fde89b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.134+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 shutdown_connections 2024-05-10T11:22:26.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.134+0000 7fedd870ff40 1 -- 172.21.15.66:0/3726558791 wait complete. 2024-05-10T11:22:26.138 INFO:teuthology.orchestra.run.smithi066.stdout:mytag123 2024-05-10T11:22:26.138 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-05-10T11:22:26.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.183+0000 7fd38e4adf40 1 Processor -- start 2024-05-10T11:22:26.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.183+0000 7fd38e4adf40 1 -- start start 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38e4adf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 0x560e09cea510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38e4adf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c5d740 0x560e09c5c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38e4adf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09d03510 0x560e09c5cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38e4adf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560e09c77460 con 0x560e09c2c120 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38e4adf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560e09bd5f50 con 0x560e09d03510 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38e4adf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560e09c5db60 con 0x560e09c5d740 2024-05-10T11:22:26.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 0x560e09cea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 0x560e09cea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41010/0 (socket says 172.21.15.66:41010) 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 -- 172.21.15.66:0/174818417 learned_addr learned my addr 172.21.15.66:0/174818417 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38b7a6640 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c5d740 0x560e09c5c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38c7a8640 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09d03510 0x560e09c5cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 -- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c5d740 msgr2=0x560e09c5c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c5d740 0x560e09c5c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 -- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09d03510 msgr2=0x560e09c5cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09d03510 0x560e09c5cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 -- 172.21.15.66:0/174818417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e09c781a0 con 0x560e09c2c120 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38c7a8640 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09d03510 0x560e09c5cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.184+0000 7fd38bfa7640 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 0x560e09cea510 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00b780 tx=0x7fd37c00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68406e989b39b4c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38a7a4640 1 -- 172.21.15.66:0/174818417 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c016020 con 0x560e09c2c120 2024-05-10T11:22:26.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38a7a4640 1 -- 172.21.15.66:0/174818417 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c00d960 con 0x560e09c2c120 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38a7a4640 1 -- 172.21.15.66:0/174818417 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00dd50 con 0x560e09c2c120 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 -- 172.21.15.66:0/174818417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 msgr2=0x560e09cea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 0x560e09cea510 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00b780 tx=0x7fd37c00bc40 comp rx=0 tx=0).stop 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 -- 172.21.15.66:0/174818417 shutdown_connections 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09d03510 0x560e09c5cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c5d740 0x560e09c5c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/174818417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09c2c120 0x560e09cea510 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 -- 172.21.15.66:0/174818417 >> 172.21.15.66:0/174818417 conn(0x560e09c2d420 msgr2=0x560e09d04940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 -- 172.21.15.66:0/174818417 shutdown_connections 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.185+0000 7fd38e4adf40 1 -- 172.21.15.66:0/174818417 wait complete. 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 Processor -- start 2024-05-10T11:22:26.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 -- start start 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c2c120 0x560e09c30a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09c5d740 0x560e09ce9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09d03510 0x560e09ce98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560e09d05db0 con 0x560e09d03510 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560e09d057f0 con 0x560e09c5d740 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.186+0000 7fd38e4adf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560e09c2d9a0 con 0x560e09c2c120 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09d03510 0x560e09ce98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09d03510 0x560e09ce98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41018/0 (socket says 172.21.15.66:41018) 2024-05-10T11:22:26.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 -- 172.21.15.66:0/1079030596 learned_addr learned my addr 172.21.15.66:0/1079030596 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38bfa7640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c2c120 0x560e09c30a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38b7a6640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09c5d740 0x560e09ce9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 -- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c2c120 msgr2=0x560e09c30a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560e09c2c120 0x560e09c30a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 -- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09c5d740 msgr2=0x560e09ce9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e09c5d740 0x560e09ce9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 -- 172.21.15.66:0/1079030596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e09d046d0 con 0x560e09d03510 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38c7a8640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09d03510 0x560e09ce98a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd38400df80 tx=0x7fd384001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd3897a2640 1 -- 172.21.15.66:0/1079030596 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384014020 con 0x560e09d03510 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd3897a2640 1 -- 172.21.15.66:0/1079030596 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd384010620 con 0x560e09d03510 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e09c2ee70 con 0x560e09d03510 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd3897a2640 1 -- 172.21.15.66:0/1079030596 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384008030 con 0x560e09d03510 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.187+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e09c2f410 con 0x560e09d03510 2024-05-10T11:22:26.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.189+0000 7fd3897a2640 1 -- 172.21.15.66:0/1079030596 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd384017020 con 0x560e09d03510 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.189+0000 7fd3897a2640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd36c074ce0 0x7fd36c0771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.189+0000 7fd3897a2640 1 -- 172.21.15.66:0/1079030596 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fd384096300 con 0x560e09d03510 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.190+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x560e09d00bd0 0x560e09c73250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.190+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:1 18.19 18:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x560e09c73790 con 0x560e09d00bd0 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.190+0000 7fd38bfa7640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd36c074ce0 0x7fd36c0771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.190+0000 7fd38b7a6640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x560e09d00bd0 0x560e09c73250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.190+0000 7fd38bfa7640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd36c074ce0 0x7fd36c0771a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd37c000f80 tx=0x7fd37c007030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.190+0000 7fd38b7a6640 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x560e09d00bd0 0x560e09c73250 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38b7a6640 1 -- 172.21.15.66:0/1079030596 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fd37405c040 con 0x560e09d00bd0 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x560e09d00bd0 msgr2=0x560e09c73250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x560e09d00bd0 0x560e09c73250 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd36c074ce0 msgr2=0x7fd36c0771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd36c074ce0 0x7fd36c0771a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd37c000f80 tx=0x7fd37c007030 comp rx=0 tx=0).stop 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09d03510 msgr2=0x560e09ce98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 --2- 172.21.15.66:0/1079030596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e09d03510 0x560e09ce98a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd38400df80 tx=0x7fd384001e90 comp rx=0 tx=0).stop 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38c7a8640 1 -- 172.21.15.66:0/1079030596 reap_dead start 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 shutdown_connections 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 >> 172.21.15.66:0/1079030596 conn(0x560e09c2d420 msgr2=0x560e09c5c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 shutdown_connections 2024-05-10T11:22:26.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.191+0000 7fd38e4adf40 1 -- 172.21.15.66:0/1079030596 wait complete. 2024-05-10T11:22:26.198 INFO:teuthology.orchestra.run.smithi066.stdout:mytag123 2024-05-10T11:22:26.198 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-05-10T11:22:26.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 Processor -- start 2024-05-10T11:22:26.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 -- start start 2024-05-10T11:22:26.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 0x55edf26f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26b1c60 0x55edf26dc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf2787690 0x55edf2770690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55edf26af320 con 0x55edf26aeef0 2024-05-10T11:22:26.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55edf2657f50 con 0x55edf26b1c60 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd51febf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55edf26f9810 con 0x55edf2787690 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd4fae5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 0x55edf26f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd4fae5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 0x55edf26f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41022/0 (socket says 172.21.15.66:41022) 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.244+0000 7fbd4fae5640 1 -- 172.21.15.66:0/2965319007 learned_addr learned my addr 172.21.15.66:0/2965319007 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4fae5640 1 -- 172.21.15.66:0/2965319007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf2787690 msgr2=0x55edf2770690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4fae5640 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf2787690 0x55edf2770690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4fae5640 1 -- 172.21.15.66:0/2965319007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26b1c60 msgr2=0x55edf26dc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4fae5640 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26b1c60 0x55edf26dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4fae5640 1 -- 172.21.15.66:0/2965319007 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf2786260 con 0x55edf26aeef0 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4fae5640 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 0x55edf26f5ba0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbd40057040 tx=0x7fbd4004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f195422b360ff24 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4eae3640 1 -- 172.21.15.66:0/2965319007 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40065070 con 0x55edf26aeef0 2024-05-10T11:22:26.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4eae3640 1 -- 172.21.15.66:0/2965319007 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd400549f0 con 0x55edf26aeef0 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd4eae3640 1 -- 172.21.15.66:0/2965319007 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40059040 con 0x55edf26aeef0 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 -- 172.21.15.66:0/2965319007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 msgr2=0x55edf26f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 0x55edf26f5ba0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbd40057040 tx=0x7fbd4004e000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 -- 172.21.15.66:0/2965319007 shutdown_connections 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf2787690 0x55edf2770690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26b1c60 0x55edf26dc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 --2- 172.21.15.66:0/2965319007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf26aeef0 0x55edf26f5ba0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 -- 172.21.15.66:0/2965319007 >> 172.21.15.66:0/2965319007 conn(0x55edf26dc880 msgr2=0x55edf26f3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.245+0000 7fbd51febf40 1 -- 172.21.15.66:0/2965319007 shutdown_connections 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.246+0000 7fbd51febf40 1 -- 172.21.15.66:0/2965319007 wait complete. 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.246+0000 7fbd51febf40 1 Processor -- start 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.246+0000 7fbd51febf40 1 -- start start 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd51febf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26aeef0 0x55edf2787a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd51febf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf26b1c60 0x55edf2767490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd51febf40 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf2787690 0x55edf26f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd51febf40 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55edf277f030 con 0x55edf2787690 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd51febf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55edf2786010 con 0x55edf26aeef0 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd51febf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55edf26dcdd0 con 0x55edf26b1c60 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf2787690 0x55edf26f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf2787690 0x55edf26f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41030/0 (socket says 172.21.15.66:41030) 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 -- 172.21.15.66:0/1300528628 learned_addr learned my addr 172.21.15.66:0/1300528628 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd47fff640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf26b1c60 0x55edf2767490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd4fae5640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26aeef0 0x55edf2787a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 -- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf26b1c60 msgr2=0x55edf2767490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55edf26b1c60 0x55edf2767490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 -- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26aeef0 msgr2=0x55edf2787a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55edf26aeef0 0x55edf2787a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 -- 172.21.15.66:0/1300528628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf2783980 con 0x55edf2787690 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.247+0000 7fbd502e6640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf2787690 0x55edf26f59f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbd480021f0 tx=0x7fbd4800b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.248+0000 7fbd4dae1640 1 -- 172.21.15.66:0/1300528628 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48016070 con 0x55edf2787690 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.248+0000 7fbd4dae1640 1 -- 172.21.15.66:0/1300528628 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd480062d0 con 0x55edf2787690 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.248+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edf26da8e0 con 0x55edf2787690 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.248+0000 7fbd4dae1640 1 -- 172.21.15.66:0/1300528628 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48004760 con 0x55edf2787690 2024-05-10T11:22:26.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.248+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf2770cd0 con 0x55edf2787690 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.249+0000 7fbd4dae1640 1 -- 172.21.15.66:0/1300528628 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd48019070 con 0x55edf2787690 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd4dae1640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd30074cb0 0x7fbd30077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd4dae1640 1 -- 172.21.15.66:0/1300528628 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fbd480956d0 con 0x55edf2787690 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd51febf40 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55edf26f6730 0x55edf26db0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55edf26db600 con 0x55edf26f6730 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd4fae5640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd30074cb0 0x7fbd30077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd47fff640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55edf26f6730 0x55edf26db0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd47fff640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55edf26f6730 0x55edf26db0c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.250+0000 7fbd4fae5640 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd30074cb0 0x7fbd30077170 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000a4f0 tx=0x7fbd40051000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd47fff640 1 -- 172.21.15.66:0/1300528628 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fbd38009910 con 0x55edf26f6730 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55edf26f6730 msgr2=0x55edf26db0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55edf26f6730 0x55edf26db0c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd30074cb0 msgr2=0x7fbd30077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd30074cb0 0x7fbd30077170 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000a4f0 tx=0x7fbd40051000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf2787690 msgr2=0x55edf26f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 --2- 172.21.15.66:0/1300528628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55edf2787690 0x55edf26f59f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbd480021f0 tx=0x7fbd4800b570 comp rx=0 tx=0).stop 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd502e6640 1 -- 172.21.15.66:0/1300528628 reap_dead start 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 shutdown_connections 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 >> 172.21.15.66:0/1300528628 conn(0x55edf26dc880 msgr2=0x55edf27712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 shutdown_connections 2024-05-10T11:22:26.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.251+0000 7fbd51febf40 1 -- 172.21.15.66:0/1300528628 wait complete. 2024-05-10T11:22:26.255 INFO:teuthology.orchestra.run.smithi066.stdout:mytag123 2024-05-10T11:22:26.255 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-05-10T11:22:26.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.362+0000 7f396bcda640 1 Processor -- start 2024-05-10T11:22:26.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.362+0000 7f396bcda640 1 -- start start 2024-05-10T11:22:26.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f396bcda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f396415bde0 0x7f39640cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f396bcda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f39640cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f396bcda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3964073760 con 0x7f39640cc860 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f396bcda640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f3964073a40 con 0x7f396415bde0 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f396bcda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3964073d20 con 0x7f396406fd00 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969a76640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f396415bde0 0x7f39640cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969275640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f39640cc860 0x7f396406f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52612/0 (socket says 172.21.15.66:52612) 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969275640 1 -- 172.21.15.66:0/3492195548 learned_addr learned my addr 172.21.15.66:0/3492195548 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969a76640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f396415bde0 0x7f39640cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41046/0 (socket says 172.21.15.66:41046) 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f396a277640 1 --2- 172.21.15.66:0/3492195548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f39640cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969a76640 1 -- 172.21.15.66:0/3492195548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 msgr2=0x7f39640cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969a76640 1 --2- 172.21.15.66:0/3492195548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f39640cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969a76640 1 -- 172.21.15.66:0/3492195548 >> v1:172.21.15.66:6789/0 conn(0x7f39640cc860 legacy=0x7f396406f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3969a76640 1 -- 172.21.15.66:0/3492195548 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3964074000 con 0x7f396415bde0 2024-05-10T11:22:26.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.363+0000 7f3968a74640 1 -- 172.21.15.66:0/3492195548 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492092000 0 0) 0x7f3964073760 con 0x7f39640cc860 2024-05-10T11:22:26.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.364+0000 7f3969a76640 1 --2- 172.21.15.66:0/3492195548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640cc320 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f396000ba40 tx=0x7f396002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fca3c672d60dbde server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.364+0000 7f3968a74640 1 -- 172.21.15.66:0/3492195548 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960032750 con 0x7f396415bde0 2024-05-10T11:22:26.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.364+0000 7f3968a74640 1 -- 172.21.15.66:0/3492195548 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960030050 con 0x7f396415bde0 2024-05-10T11:22:26.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.364+0000 7f3968a74640 1 -- 172.21.15.66:0/3492195548 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960032b10 con 0x7f396415bde0 2024-05-10T11:22:26.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 -- 172.21.15.66:0/3492195548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 msgr2=0x7f39640cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 --2- 172.21.15.66:0/3492195548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640cc320 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f396000ba40 tx=0x7f396002c850 comp rx=0 tx=0).stop 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 -- 172.21.15.66:0/3492195548 shutdown_connections 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 --2- 172.21.15.66:0/3492195548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f39640cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 --2- 172.21.15.66:0/3492195548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640cc320 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 -- 172.21.15.66:0/3492195548 >> 172.21.15.66:0/3492195548 conn(0x7f39640d0c50 msgr2=0x7f39640d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 -- 172.21.15.66:0/3492195548 shutdown_connections 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.365+0000 7f396bcda640 1 -- 172.21.15.66:0/3492195548 wait complete. 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.366+0000 7f396bcda640 1 Processor -- start 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.366+0000 7f396bcda640 1 -- start start 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396bcda640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f3964152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396bcda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39640cc860 0x7f39640c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396bcda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396bcda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3964073510 con 0x7f396415bde0 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396bcda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3964073390 con 0x7f39640cc860 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396bcda640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39640cf190 con 0x7f396406fd00 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41056/0 (socket says 172.21.15.66:41056) 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 -- 172.21.15.66:0/1987202716 learned_addr learned my addr 172.21.15.66:0/1987202716 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f3969a76640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f3964152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f3969275640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39640cc860 0x7f39640c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 -- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 msgr2=0x7f3964152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f3964152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 -- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39640cc860 msgr2=0x7f39640c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39640cc860 0x7f39640c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f396a277640 1 -- 172.21.15.66:0/1987202716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39640c42a0 con 0x7f396415bde0 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.367+0000 7f3969275640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39640cc860 0x7f39640c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.368+0000 7f396a277640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640c9590 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f395c00ef90 tx=0x7f395c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.368+0000 7f395a7fc640 1 -- 172.21.15.66:0/1987202716 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c018020 con 0x7f396415bde0 2024-05-10T11:22:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.368+0000 7f395a7fc640 1 -- 172.21.15.66:0/1987202716 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395c014480 con 0x7f396415bde0 2024-05-10T11:22:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.368+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39640c4580 con 0x7f396415bde0 2024-05-10T11:22:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.368+0000 7f395a7fc640 1 -- 172.21.15.66:0/1987202716 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c014870 con 0x7f396415bde0 2024-05-10T11:22:26.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.368+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39640c4b40 con 0x7f396415bde0 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.369+0000 7f395a7fc640 1 -- 172.21.15.66:0/1987202716 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f395c005d10 con 0x7f396415bde0 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.370+0000 7f395a7fc640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39480762d0 0x7f3948078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.370+0000 7f395a7fc640 1 -- 172.21.15.66:0/1987202716 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f395c098630 con 0x7f396415bde0 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.370+0000 7f3969a76640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39480762d0 0x7f3948078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.371+0000 7f3969a76640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39480762d0 0x7f3948078790 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3960037000 tx=0x7f3960032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.371+0000 7f396e9f8740 1 Processor -- start 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.371+0000 7f396e9f8740 1 -- start start 2024-05-10T11:22:26.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2762160 0x562bf2714af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2744600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2744b40 0x562bf2719950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396e9f8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562bf26e1690 con 0x562bf2745280 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562bf267ef30 con 0x562bf2762160 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562bf2637b20 con 0x562bf2744b40 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2744600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396a277640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2744b40 0x562bf2719950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2744600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41068/0 (socket says 172.21.15.66:41068) 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 -- 172.21.15.66:0/835858560 learned_addr learned my addr 172.21.15.66:0/835858560 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969a76640 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2762160 0x562bf2714af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 -- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2744b40 msgr2=0x562bf2719950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2744b40 0x562bf2719950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 -- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2762160 msgr2=0x562bf2714af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2762160 0x562bf2714af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 -- 172.21.15.66:0/835858560 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf262fe60 con 0x562bf2745280 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f396a277640 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2744b40 0x562bf2719950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.372+0000 7f3969275640 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2744600 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f39540074d0 tx=0x7f3954005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a601028b809ad64b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f39477fe640 1 -- 172.21.15.66:0/835858560 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954019070 con 0x562bf2745280 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f39477fe640 1 -- 172.21.15.66:0/835858560 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954001890 con 0x562bf2745280 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f39477fe640 1 -- 172.21.15.66:0/835858560 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954001c40 con 0x562bf2745280 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 -- 172.21.15.66:0/835858560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 msgr2=0x562bf2744600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2744600 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f39540074d0 tx=0x7f3954005bc0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 -- 172.21.15.66:0/835858560 shutdown_connections 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2744b40 0x562bf2719950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2744600 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 --2- 172.21.15.66:0/835858560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2762160 0x562bf2714af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 -- 172.21.15.66:0/835858560 >> 172.21.15.66:0/835858560 conn(0x562bf2716d60 msgr2=0x562bf275f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 -- 172.21.15.66:0/835858560 shutdown_connections 2024-05-10T11:22:26.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.373+0000 7f396e9f8740 1 -- 172.21.15.66:0/835858560 wait complete. 2024-05-10T11:22:26.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.374+0000 7f396e9f8740 1 -- start start 2024-05-10T11:22:26.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.374+0000 7f396e9f8740 1 Processor -- start 2024-05-10T11:22:26.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2719e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2747250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2734a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562bf263b5e0 con 0x562bf2745280 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562bf267aef0 con 0x562bf2747790 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562bf2718f10 con 0x562bf2762160 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396e9f8740 10 client.0 _ll_register_callbacks cb 0x562bf2636320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2719e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2719e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41082/0 (socket says 172.21.15.66:41082) 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 -- 172.21.15.66:0/4208642754 learned_addr learned my addr 172.21.15.66:0/4208642754 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969275640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2747250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f396a277640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2734a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 -- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 msgr2=0x562bf2747250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2747250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 -- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 msgr2=0x562bf2734a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2734a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969a76640 1 -- 172.21.15.66:0/4208642754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf245a7d0 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.375+0000 7f3969275640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2747250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3969a76640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2719e30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f396000bb60 tx=0x7f3960004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12281e53c746dab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3944ff9640 1 -- 172.21.15.66:0/4208642754 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960059060 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3944ff9640 1 -- 172.21.15.66:0/4208642754 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f3960040640 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3954001890 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3944ff9640 1 -- 172.21.15.66:0/4208642754 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) ==== 24+0+0 (secure 0 0 0) 0x7f396005f050 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 10 client.8541 fetch_fsmap learned FSMap version 105 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) -- 0x562bf23903f0 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3944ff9640 1 -- 172.21.15.66:0/4208642754 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954001890 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3944ff9640 1 -- 172.21.15.66:0/4208642754 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 105) ==== 3494+0+0 (secure 0 0 0) 0x7f3960062020 con 0x562bf2745280 2024-05-10T11:22:26.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 10 client.8541 fetch_fsmap finished waiting for FSMap version 105 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 10 client.8541 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 20 client.8541 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2745770 0x562bf2745b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 4 client.8541 mds_command: new command op to 7231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 --> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bf268cb40 con 0x562bf2745770 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.376+0000 7f3969275640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2745770 0x562bf2745b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.377+0000 7f3969275640 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2745770 0x562bf2745b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e26ce5b32d1f089 server_cookie=752ed4fbd688454a in_seq=0 out_seq=0 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.377+0000 7f3944ff9640 10 client.8541 ms_handle_connect on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.377+0000 7f3944ff9640 1 -- 172.21.15.66:0/4208642754 <== mds.0 v2:172.21.15.190:6834/1055415762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562bf268cb40 con 0x562bf2745770 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.377+0000 7f3944ff9640 10 client.8541 handle_command_reply: tid=0 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.377+0000 7f396e9f8740 1 client.8541 shutdown 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 msgr2=0x562bf2719e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2719e30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f396000bb60 tx=0x7f3960004730 comp rx=0 tx=0).stop 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 shutdown_connections 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2745770 0x562bf2745b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2734a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2747250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f3944ff9640 0 client.8541 ms_handle_reset on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 --2- 172.21.15.66:0/4208642754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf2719e30 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 >> 172.21.15.66:0/4208642754 conn(0x562bf2744b40 msgr2=0x562bf2714230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 shutdown_connections 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 1 -- 172.21.15.66:0/4208642754 wait complete. 2024-05-10T11:22:26.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.378+0000 7f396e9f8740 20 client.8541 trim_cache size 0 max 16384 2024-05-10T11:22:26.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.393+0000 7f396e9f8740 1 Processor -- start 2024-05-10T11:22:26.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.393+0000 7f396e9f8740 1 -- start start 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf27833c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2710040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2719c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396e9f8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39641fd900 con 0x562bf2745280 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39641fc930 con 0x562bf2747790 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39640c6050 con 0x562bf2762160 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf27833c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf27833c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41098/0 (socket says 172.21.15.66:41098) 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 -- 172.21.15.66:0/2399900345 learned_addr learned my addr 172.21.15.66:0/2399900345 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396a277640 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2719c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969275640 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2710040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 -- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 msgr2=0x562bf2719c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2719c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 -- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 msgr2=0x562bf2710040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2710040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 -- 172.21.15.66:0/2399900345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf23500f0 con 0x562bf2745280 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f396a277640 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2719c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.394+0000 7f3969a76640 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf27833c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f3960040900 tx=0x7f396004d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705415787f4c99cc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f3946ffd640 1 -- 172.21.15.66:0/2399900345 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960040bc0 con 0x562bf2745280 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f3946ffd640 1 -- 172.21.15.66:0/2399900345 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960030070 con 0x562bf2745280 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f3946ffd640 1 -- 172.21.15.66:0/2399900345 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396004a3f0 con 0x562bf2745280 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 -- 172.21.15.66:0/2399900345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 msgr2=0x562bf27833c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf27833c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f3960040900 tx=0x7f396004d070 comp rx=0 tx=0).stop 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 -- 172.21.15.66:0/2399900345 shutdown_connections 2024-05-10T11:22:26.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf2719c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2747790 0x562bf2710040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2399900345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2745280 0x562bf27833c0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 -- 172.21.15.66:0/2399900345 >> 172.21.15.66:0/2399900345 conn(0x562bf2744b40 msgr2=0x562bf2733fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 -- 172.21.15.66:0/2399900345 shutdown_connections 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.395+0000 7f396e9f8740 1 -- 172.21.15.66:0/2399900345 wait complete. 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.396+0000 7f396e9f8740 1 -- start start 2024-05-10T11:22:26.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.396+0000 7f396e9f8740 1 Processor -- start 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2745280 0x562bf2782670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 0x562bf276dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf276e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562bf275fea0 con 0x562bf2747790 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39640c66a0 con 0x562bf2745280 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562bf27600c0 con 0x562bf2762160 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396e9f8740 10 client.0 _ll_register_callbacks cb 0x7f3960032850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 0x562bf276dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 0x562bf276dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41114/0 (socket says 172.21.15.66:41114) 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 -- 172.21.15.66:0/2331343826 learned_addr learned my addr 172.21.15.66:0/2331343826 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f396a277640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf276e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969a76640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2745280 0x562bf2782670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 -- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 msgr2=0x562bf276e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf276e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 -- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2745280 msgr2=0x562bf2782670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2745280 0x562bf2782670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 -- 172.21.15.66:0/2331343826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf2718f10 con 0x562bf2747790 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969a76640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2745280 0x562bf2782670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3969275640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 0x562bf276dd00 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f3954013000 tx=0x7f3954000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40c166c1afab66 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.397+0000 7f3944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f3944ff9640 1 -- 172.21.15.66:0/2331343826 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954019040 con 0x562bf2747790 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f3944ff9640 1 -- 172.21.15.66:0/2331343826 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7f3954001830 con 0x562bf2747790 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3960030070 con 0x562bf2747790 2024-05-10T11:22:26.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f3944ff9640 1 -- 172.21.15.66:0/2331343826 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) ==== 24+0+0 (secure 0 0 0) 0x7f3954035050 con 0x562bf2747790 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 10 client.8547 fetch_fsmap learned FSMap version 105 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) -- 0x562bf27e1d90 con 0x562bf2747790 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f3944ff9640 1 -- 172.21.15.66:0/2331343826 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960030070 con 0x562bf2747790 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f3944ff9640 1 -- 172.21.15.66:0/2331343826 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 105) ==== 3494+0+0 (secure 0 0 0) 0x7f3954038020 con 0x562bf2747790 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 10 client.8547 fetch_fsmap finished waiting for FSMap version 105 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 10 client.8547 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 20 client.8547 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2779050 0x562bf27e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 4 client.8547 mds_command: new command op to 7231 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 --> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562bf26869b0 con 0x562bf2779050 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.398+0000 7f3969a76640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2779050 0x562bf27e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.399+0000 7f3969a76640 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2779050 0x562bf27e0e10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa71221529275517 server_cookie=d64650a56b9b6c9f in_seq=0 out_seq=0 2024-05-10T11:22:26.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.399+0000 7f3944ff9640 10 client.8547 ms_handle_connect on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.413+0000 7f3944ff9640 1 -- 172.21.15.66:0/2331343826 <== mds.0 v2:172.21.15.190:6834/1055415762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562bf26869b0 con 0x562bf2779050 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.413+0000 7f3944ff9640 10 client.8547 handle_command_reply: tid=0 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 client.8547 shutdown 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 msgr2=0x562bf276dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 0x562bf276dd00 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f3954013000 tx=0x7f3954000ed0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 shutdown_connections 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:6834/1055415762,v1:172.21.15.190:6836/1055415762] conn(0x562bf2779050 0x562bf27e0e10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562bf2762160 0x562bf276e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f3944ff9640 0 client.8547 ms_handle_reset on v2:172.21.15.190:6834/1055415762 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bf2747790 0x562bf276dd00 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 --2- 172.21.15.66:0/2331343826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562bf2745280 0x562bf2782670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 >> 172.21.15.66:0/2331343826 conn(0x562bf2744b40 msgr2=0x562bf2783190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 shutdown_connections 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 1 -- 172.21.15.66:0/2331343826 wait complete. 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.414+0000 7f396e9f8740 20 client.8547 trim_cache size 0 max 16384 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "", 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0 2024-05-10T11:22:26.415 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:26.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39480762d0 msgr2=0x7f3948078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39480762d0 0x7f3948078790 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3960037000 tx=0x7f3960032000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 msgr2=0x7f39640c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640c9590 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f395c00ef90 tx=0x7f395c00c490 comp rx=0 tx=0).stop 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 shutdown_connections 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f39480762d0 0x7f3948078790 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f396415bde0 0x7f39640c9590 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39640cc860 0x7f39640c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 --2- 172.21.15.66:0/1987202716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f396406fd00 0x7f3964152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 >> 172.21.15.66:0/1987202716 conn(0x7f39640d0c50 msgr2=0x7f396415b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 shutdown_connections 2024-05-10T11:22:26.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.415+0000 7f396bcda640 1 -- 172.21.15.66:0/1987202716 wait complete. 2024-05-10T11:22:26.425 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:22:26.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.531+0000 7fd29d7dd640 1 Processor -- start 2024-05-10T11:22:26.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.531+0000 7fd29d7dd640 1 -- start start 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd29d7dd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2980cf660 0x7fd2980cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd29d7dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2980ce800 0x7fd29806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd29d7dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2980cff80 con 0x7fd29815f5f0 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd29d7dd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd2980d0760 con 0x7fd2980cf660 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd29d7dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd2980d1d70 con 0x7fd2980ce800 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2980cf660 0x7fd2980cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2980cf660 0x7fd2980cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41120/0 (socket says 172.21.15.66:41120) 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 -- 172.21.15.66:0/3264073801 learned_addr learned my addr 172.21.15.66:0/3264073801 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd2977fe640 1 --2- 172.21.15.66:0/3264073801 >> v2:172.21.15.190:3300/0 conn(0x7fd2980ce800 0x7fd29806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 -- 172.21.15.66:0/3264073801 >> v2:172.21.15.190:3300/0 conn(0x7fd2980ce800 msgr2=0x7fd29806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 --2- 172.21.15.66:0/3264073801 >> v2:172.21.15.190:3300/0 conn(0x7fd2980ce800 0x7fd29806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 -- 172.21.15.66:0/3264073801 >> v1:172.21.15.190:6789/0 conn(0x7fd29815f5f0 legacy=0x7fd29806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.532+0000 7fd296ffd640 1 -- 172.21.15.66:0/3264073801 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2980d2050 con 0x7fd2980cf660 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.533+0000 7fd296ffd640 1 --2- 172.21.15.66:0/3264073801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cfa40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd298072ff0 tx=0x7fd28802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cdaddd1b6eb8f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.533+0000 7fd295ffb640 1 -- 172.21.15.66:0/3264073801 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288037070 con 0x7fd2980cf660 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.533+0000 7fd295ffb640 1 -- 172.21.15.66:0/3264073801 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd288032440 con 0x7fd2980cf660 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.533+0000 7fd295ffb640 1 -- 172.21.15.66:0/3264073801 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288032810 con 0x7fd2980cf660 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3264073801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 msgr2=0x7fd2980cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3264073801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cfa40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd298072ff0 tx=0x7fd28802a150 comp rx=0 tx=0).stop 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3264073801 shutdown_connections 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3264073801 >> v2:172.21.15.190:3300/0 conn(0x7fd2980ce800 0x7fd29806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3264073801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cfa40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3264073801 >> 172.21.15.66:0/3264073801 conn(0x7fd2980d2de0 msgr2=0x7fd2980d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3264073801 shutdown_connections 2024-05-10T11:22:26.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.534+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3264073801 wait complete. 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.535+0000 7fd29d7dd640 1 Processor -- start 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.535+0000 7fd29d7dd640 1 -- start start 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd29d7dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2980ce800 0x7fd298155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd29d7dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd29d7dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd29815f5f0 0x7fd2980cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd29d7dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2980d3900 con 0x7fd2980cf660 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd29d7dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd2980b1ef0 con 0x7fd29815f5f0 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd29d7dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd2980d3a80 con 0x7fd2980ce800 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41134/0 (socket says 172.21.15.66:41134) 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 -- 172.21.15.66:0/3734242008 learned_addr learned my addr 172.21.15.66:0/3734242008 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd296ffd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2980ce800 0x7fd298155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2977fe640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd29815f5f0 0x7fd2980cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 -- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2980ce800 msgr2=0x7fd298155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2980ce800 0x7fd298155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 -- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd29815f5f0 msgr2=0x7fd2980cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd29815f5f0 0x7fd2980cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.536+0000 7fd2967fc640 1 -- 172.21.15.66:0/3734242008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2980cac90 con 0x7fd2980cf660 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.537+0000 7fd2967fc640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cc0c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c400 tx=0x7fd28c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.537+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0052d0 con 0x7fd2980cf660 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.537+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c005490 con 0x7fd2980cf660 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.537+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2980caf70 con 0x7fd2980cf660 2024-05-10T11:22:26.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.537+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c007260 con 0x7fd2980cf660 2024-05-10T11:22:26.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.537+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2980cb530 con 0x7fd2980cf660 2024-05-10T11:22:26.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.538+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd298069400 con 0x7fd2980cf660 2024-05-10T11:22:26.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.538+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd28c007400 con 0x7fd2980cf660 2024-05-10T11:22:26.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.539+0000 7fd27f7fe640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd284076300 0x7fd2840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.539+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6187+0+0 (secure 0 0 0) 0x7fd28c096c30 con 0x7fd2980cf660 2024-05-10T11:22:26.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.539+0000 7fd296ffd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd284076300 0x7fd2840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.540+0000 7fd296ffd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd284076300 0x7fd2840787c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd288034000 tx=0x7fd28802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.543+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd28c05fd60 con 0x7fd2980cf660 2024-05-10T11:22:26.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.777+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd29806edd0 con 0x7fd2980cf660 2024-05-10T11:22:26.776 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:22:26.777+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:22:26.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.778+0000 7fd27f7fe640 1 -- 172.21.15.66:0/3734242008 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v106) ==== 161+0+0 (secure 0 0 0) 0x7fd28c064060 con 0x7fd2980cf660 2024-05-10T11:22:26.778 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:22:26.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd284076300 msgr2=0x7fd2840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd284076300 0x7fd2840787c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd288034000 tx=0x7fd28802e000 comp rx=0 tx=0).stop 2024-05-10T11:22:26.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 msgr2=0x7fd2980cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cc0c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c400 tx=0x7fd28c00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 shutdown_connections 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd284076300 0x7fd2840787c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd29815f5f0 0x7fd2980cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2980cf660 0x7fd2980cc0c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 --2- 172.21.15.66:0/3734242008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2980ce800 0x7fd298155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 >> 172.21.15.66:0/3734242008 conn(0x7fd2980d2de0 msgr2=0x7fd2980712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 shutdown_connections 2024-05-10T11:22:26.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.781+0000 7fd29d7dd640 1 -- 172.21.15.66:0/3734242008 wait complete. 2024-05-10T11:22:26.783 INFO:tasks.ceph.mds.b.smithi190.stderr: -1669> 2024-05-10T11:22:23.456+0000 7f1328843640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:22:26.792 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-05-10T11:22:26.809 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-05-10T11:22:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.836+0000 7f5a0811c280 1 -- start start 2024-05-10T11:22:26.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.836+0000 7f5a0811c280 1 Processor -- start 2024-05-10T11:22:26.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebd47cc00 0x555ebe24a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 0x555ebe24a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebd47dc00 0x555ebe24ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21a180 con 0x555ebd47d800 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21a300 con 0x555ebd47dc00 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555ebe21a480 con 0x555ebd47cc00 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 0x555ebe24a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 0x555ebe24a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41152/0 (socket says 172.21.15.66:41152) 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 -- 172.21.15.66:0/4279227078 learned_addr learned my addr 172.21.15.66:0/4279227078 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05e19640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebd47cc00 0x555ebe24a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0661a640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebd47dc00 0x555ebe24ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 -- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebd47cc00 msgr2=0x555ebe24a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebd47cc00 0x555ebe24a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 -- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebd47dc00 msgr2=0x555ebe24ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebd47dc00 0x555ebe24ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 -- 172.21.15.66:0/4279227078 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ebd4b2780 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05e19640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebd47cc00 0x555ebe24a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0661a640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebd47dc00 0x555ebe24ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a05618640 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 0x555ebe24a580 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x555ebe2a1740 tx=0x555ebe21df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727bec9e81ecd62 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a03614640 1 -- 172.21.15.66:0/4279227078 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a29c0 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a03614640 1 -- 172.21.15.66:0/4279227078 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555ebd4a8fc0 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a03614640 1 -- 172.21.15.66:0/4279227078 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a2680 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ebd4b23c0 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x555ebd4b3680 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.837+0000 7f5a0811c280 4 waiting for MDS map... 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a03614640 1 -- 172.21.15.66:0/4279227078 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x555ebe34e200 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a03614640 1 -- 172.21.15.66:0/4279227078 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 106) ==== 2885+0+0 (secure 0 0 0) 0x555ebd4d7180 con 0x555ebd47d800 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a0811c280 4 Got MDS map 106 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a0811c280 10 main: JournalTool::main 2024-05-10T11:22:26.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a0811c280 4 main: JournalTool: connecting to RADOS... 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a0811c280 1 Processor -- start 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.838+0000 7f5a0811c280 1 -- start start 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0811c280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21a600 con 0x555ebe3b2000 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21a780 con 0x555ebe3b2400 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555ebe21a900 con 0x555ebe3b2800 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41164/0 (socket says 172.21.15.66:41164) 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 -- 172.21.15.66:0/1516643231 learned_addr learned my addr 172.21.15.66:0/1516643231 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a05618640 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a05e19640 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 -- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2800 msgr2=0x555ebe24bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 -- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 msgr2=0x555ebe24b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.839+0000 7f5a0661a640 1 -- 172.21.15.66:0/1516643231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ebd4b34a0 con 0x555ebe3b2000 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0661a640 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 0x555ebe24b080 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x555ebe252810 tx=0x555ebe360d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f206cb6b701299f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a01610640 1 -- 172.21.15.66:0/1516643231 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a29c0 con 0x555ebe3b2000 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a01610640 1 -- 172.21.15.66:0/1516643231 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555ebd4a8a80 con 0x555ebe3b2000 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a01610640 1 -- 172.21.15.66:0/1516643231 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a2680 con 0x555ebe3b2000 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 -- 172.21.15.66:0/1516643231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 msgr2=0x555ebe24b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 0x555ebe24b080 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x555ebe252810 tx=0x555ebe360d80 comp rx=0 tx=0).stop 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 -- 172.21.15.66:0/1516643231 shutdown_connections 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 --2- 172.21.15.66:0/1516643231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 -- 172.21.15.66:0/1516643231 >> 172.21.15.66:0/1516643231 conn(0x555ebe269c00 msgr2=0x555ebd577000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 -- 172.21.15.66:0/1516643231 shutdown_connections 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.840+0000 7f5a0811c280 1 -- 172.21.15.66:0/1516643231 wait complete. 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 Processor -- start 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 -- start start 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21bc80 con 0x555ebe3b2800 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21bb00 con 0x555ebe3b2400 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555ebe21b980 con 0x555ebe3b2000 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a05618640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a05618640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41180/0 (socket says 172.21.15.66:41180) 2024-05-10T11:22:26.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a05618640 1 -- 172.21.15.66:0/3658153706 learned_addr learned my addr 172.21.15.66:0/3658153706 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a0661a640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.841+0000 7f5a05e19640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a05618640 1 -- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2000 msgr2=0x555ebe24b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a05618640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a05618640 1 -- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 msgr2=0x555ebe24b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a05618640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a05618640 1 -- 172.21.15.66:0/3658153706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ebd4b2000 con 0x555ebe3b2800 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a05618640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 0x555ebe24bb80 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x555ebe2a1d40 tx=0x555ebe21c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f59ffe0d640 1 -- 172.21.15.66:0/3658153706 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a2b60 con 0x555ebe3b2800 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f59ffe0d640 1 -- 172.21.15.66:0/3658153706 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555ebd4a8e00 con 0x555ebe3b2800 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ebd4b2960 con 0x555ebe3b2800 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f59ffe0d640 1 -- 172.21.15.66:0/3658153706 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a2820 con 0x555ebe3b2800 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ebd4b3860 con 0x555ebe3b2800 2024-05-10T11:22:26.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.842+0000 7f5a0811c280 4 main: JournalTool: resolving pool 17 2024-05-10T11:22:26.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.843+0000 7f59ffe0d640 1 -- 172.21.15.66:0/3658153706 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x555ebe264c00 con 0x555ebe3b2800 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f59ffe0d640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x555ebe267000 0x555ebe24c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f59ffe0d640 1 -- 172.21.15.66:0/3658153706 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x555ebe3b9200 con 0x555ebe3b2800 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f5a0811c280 4 main: JournalTool: creating IoCtx.. 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f5a0811c280 4 main: Executing for rank 0 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f5a0661a640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x555ebe267000 0x555ebe24c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f5a0661a640 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x555ebe267000 0x555ebe24c100 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x555ebe252810 tx=0x555ebe360c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f5a0811c280 1 -- start start 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.844+0000 7f5a0811c280 1 Processor -- start 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 0x555ebe24c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe267400 0x555ebe24cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0811c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe267800 0x555ebe24d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0811c280 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21b680 con 0x555ebe3b3000 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555ebe21a600 con 0x555ebe267800 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0811c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555ebe21a780 con 0x555ebe267400 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 0x555ebe24c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 0x555ebe24c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41184/0 (socket says 172.21.15.66:41184) 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 -- 172.21.15.66:0/2946020296 learned_addr learned my addr 172.21.15.66:0/2946020296 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a05e19640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe267400 0x555ebe24cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a05618640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe267800 0x555ebe24d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe267400 msgr2=0x555ebe24cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe267400 0x555ebe24cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe267800 msgr2=0x555ebe24d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.845+0000 7f5a0661a640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe267800 0x555ebe24d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0661a640 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ebd4b3a40 con 0x555ebe3b3000 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0661a640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 0x555ebe24c680 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x555ebd79b950 tx=0x555ebe360c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65b36a6e3580984 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f59fce07640 1 -- 172.21.15.66:0/2946020296 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebd4a24e0 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f59fce07640 1 -- 172.21.15.66:0/2946020296 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555ebd4a8c40 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ebd4b2780 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x555ebd4b23c0 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0811c280 4 waiting for MDS map... 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f59fce07640 1 -- 172.21.15.66:0/2946020296 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555ebe3f6000 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f59fce07640 1 -- 172.21.15.66:0/2946020296 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x555ebd86e000 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f59fce07640 1 -- 172.21.15.66:0/2946020296 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 106) ==== 2885+0+0 (secure 0 0 0) 0x555ebd4d7500 con 0x555ebe3b3000 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0811c280 4 Got MDS map 106 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x555ebe267c00 0x555ebe24d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd869400 con 0x555ebe267c00 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.846+0000 7f5a05e19640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x555ebe267c00 0x555ebe24d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.847+0000 7f5a05e19640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x555ebe267c00 0x555ebe24d700 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=feb9f49049ea7ab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.850+0000 7f5a05e19640 1 -- 172.21.15.66:0/2946020296 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v120'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a000 con 0x555ebe267c00 2024-05-10T11:22:26.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.850+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x555ebd869800 0x555ebd896000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.850+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd869c00 con 0x555ebd869800 2024-05-10T11:22:26.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.850+0000 7f5a05618640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x555ebd869800 0x555ebd896000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.850+0000 7f5a05618640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x555ebd869800 0x555ebd896000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=b8fafe09688f162e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a05618640 1 -- 172.21.15.66:0/2946020296 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v120'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a500 con 0x555ebd869800 2024-05-10T11:22:26.857 INFO:teuthology.orchestra.run.smithi066.stdout:writing EResetJournal entry 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd89e000 con 0x555ebd869800 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x555ebd89e400 0x555ebd896580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd89e800 con 0x555ebd89e400 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x555ebd89ec00 0x555ebd896b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd89f000 con 0x555ebd89ec00 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x555ebd89f400 0x555ebd897080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd89f800 con 0x555ebd89f400 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd89fc00 con 0x555ebd89ec00 2024-05-10T11:22:26.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd8a4000 con 0x555ebe267c00 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a05e19640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x555ebd89ec00 0x555ebd896b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a0661a640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x555ebd89e400 0x555ebd896580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a05618640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x555ebd89f400 0x555ebd897080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.852+0000 7f5a05e19640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x555ebd89ec00 0x555ebd896b00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=b3a81867f3170b89 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.853+0000 7f5a0661a640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x555ebd89e400 0x555ebd896580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=5a1350996bd53bdd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.853+0000 7f5a05618640 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x555ebd89f400 0x555ebd897080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=66de9a9ba577f536 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.853+0000 7f5a05618640 1 -- 172.21.15.66:0/2946020296 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(3 200.00000001 [delete] v120'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a500 con 0x555ebd869800 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.854+0000 7f5a05e19640 1 -- 172.21.15.66:0/2946020296 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(5 200.00000003 [delete] v120'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a000 con 0x555ebd89ec00 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.854+0000 7f5a05e19640 1 -- 172.21.15.66:0/2946020296 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(7 200.00000005 [delete] v120'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a000 con 0x555ebd89ec00 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.854+0000 7f5a05e19640 1 -- 172.21.15.66:0/2946020296 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(8 200.00000006 [delete] v120'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a000 con 0x555ebe267c00 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.855+0000 7f5a0661a640 1 -- 172.21.15.66:0/2946020296 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(4 200.00000002 [delete] v120'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a780 con 0x555ebd89e400 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.855+0000 7f59fb604640 1 -- 172.21.15.66:0/2946020296 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x555ebd869400 con 0x555ebd869800 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a05618640 1 -- 172.21.15.66:0/2946020296 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(6 200.00000004 [delete] v120'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a500 con 0x555ebd89f400 2024-05-10T11:22:26.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a05618640 1 -- 172.21.15.66:0/2946020296 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v120'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x555ebd58a500 con 0x555ebd869800 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x555ebd89ec00 msgr2=0x555ebd896b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x555ebd89ec00 0x555ebd896b00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x555ebe267c00 msgr2=0x555ebe24d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x555ebe267c00 0x555ebe24d700 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x555ebd869800 msgr2=0x555ebd896000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x555ebd869800 0x555ebd896000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x555ebd89e400 msgr2=0x555ebd896580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x555ebd89e400 0x555ebd896580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x555ebd89f400 msgr2=0x555ebd897080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x555ebd89f400 0x555ebd897080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a05e19640 1 -- 172.21.15.66:0/2946020296 reap_dead start 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a05e19640 1 -- 172.21.15.66:0/2946020296 reap_dead start 2024-05-10T11:22:26.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 msgr2=0x555ebe24c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 0x555ebe24c680 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x555ebd79b950 tx=0x555ebe360c60 comp rx=0 tx=0).stop 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 shutdown_connections 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.856+0000 7f5a0811c280 1 --2- 172.21.15.66:0/2946020296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b3000 0x555ebe24c680 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 >> 172.21.15.66:0/2946020296 conn(0x555ebe3b2c00 msgr2=0x555ebd577800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 shutdown_connections 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/2946020296 wait complete. 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x555ebe267000 msgr2=0x555ebe24c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x555ebe267000 0x555ebe24c100 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x555ebe252810 tx=0x555ebe360c00 comp rx=0 tx=0).stop 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 msgr2=0x555ebe24bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 0x555ebe24bb80 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x555ebe2a1d40 tx=0x555ebe21c660 comp rx=0 tx=0).stop 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 shutdown_connections 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x555ebe267000 0x555ebe24c100 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebe3b2800 0x555ebe24bb80 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebe3b2400 0x555ebe24b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/3658153706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebe3b2000 0x555ebe24b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 >> 172.21.15.66:0/3658153706 conn(0x555ebe269c00 msgr2=0x555ebd577000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 shutdown_connections 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/3658153706 wait complete. 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 msgr2=0x555ebe24a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 0x555ebe24a580 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x555ebe2a1740 tx=0x555ebe21df20 comp rx=0 tx=0).stop 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 shutdown_connections 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555ebd47dc00 0x555ebe24ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555ebd47d800 0x555ebe24a580 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 --2- 172.21.15.66:0/4279227078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555ebd47cc00 0x555ebe24a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 >> 172.21.15.66:0/4279227078 conn(0x555ebd47d000 msgr2=0x555ebd576800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 shutdown_connections 2024-05-10T11:22:26.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.857+0000 7f5a0811c280 1 -- 172.21.15.66:0/4279227078 wait complete. 2024-05-10T11:22:26.867 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.074917, result: writing EResetJournal entry 2024-05-10T11:22:26.867 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-05-10T11:22:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.944+0000 7fcc4081a740 1 -- start start 2024-05-10T11:22:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.944+0000 7fcc4081a740 1 Processor -- start 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 0x55bf5200c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf51233800 0x55bf5200c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf51233c00 0x55bf5200cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc4081a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf5202c180 con 0x55bf51232c00 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc4081a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bf5202c300 con 0x55bf51233c00 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc4081a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bf5202c480 con 0x55bf51233800 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 0x55bf5200c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 0x55bf5200c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41202/0 (socket says 172.21.15.66:41202) 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 -- 172.21.15.66:0/966907942 learned_addr learned my addr 172.21.15.66:0/966907942 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf51233c00 0x55bf5200cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf51233800 0x55bf5200c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 -- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf51233800 msgr2=0x55bf5200c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf51233800 0x55bf5200c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 -- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf51233c00 msgr2=0x55bf5200cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf51233c00 0x55bf5200cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 -- 172.21.15.66:0/966907942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf5125f680 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf51233c00 0x55bf5200cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3e439640 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 0x55bf5200c000 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x55bf5205db90 tx=0x55bf51fd8a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7c8d6d6262a94c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.945+0000 7fcc3bc34640 1 -- 172.21.15.66:0/966907942 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bf512589c0 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc3bc34640 1 -- 172.21.15.66:0/966907942 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bf5127ae00 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc3bc34640 1 -- 172.21.15.66:0/966907942 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bf51258680 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf5125f860 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55bf5125f2c0 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 4 waiting for MDS map... 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc3bc34640 1 -- 172.21.15.66:0/966907942 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x55bf5211a600 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc3bc34640 1 -- 172.21.15.66:0/966907942 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 106) ==== 2885+0+0 (secure 0 0 0) 0x55bf5128b180 con 0x55bf51232c00 2024-05-10T11:22:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 4 Got MDS map 106 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 4 datascan.main: Using metadata pool output 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 4 datascan.main: connecting to RADOS... 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.946+0000 7fcc4081a740 1 Processor -- start 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 -- start start 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf5202c600 con 0x55bf5217a000 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bf5202c780 con 0x55bf5217a800 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc4081a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bf5202c900 con 0x55bf5217a400 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41210/0 (socket says 172.21.15.66:41210) 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/1152416731 learned_addr learned my addr 172.21.15.66:0/1152416731 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3e439640 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a400 msgr2=0x55bf5200d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a800 msgr2=0x55bf5200db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.947+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/1152416731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf5125f4a0 con 0x55bf5217a000 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x55bf5210d170 tx=0x55bf52132c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09a68f5905bc066 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc39c30640 1 -- 172.21.15.66:0/1152416731 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bf512589c0 con 0x55bf5217a000 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc39c30640 1 -- 172.21.15.66:0/1152416731 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bf5127a540 con 0x55bf5217a000 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc39c30640 1 -- 172.21.15.66:0/1152416731 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bf51258680 con 0x55bf5217a000 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 -- 172.21.15.66:0/1152416731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 msgr2=0x55bf5200d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x55bf5210d170 tx=0x55bf52132c00 comp rx=0 tx=0).stop 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 -- 172.21.15.66:0/1152416731 shutdown_connections 2024-05-10T11:22:26.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 --2- 172.21.15.66:0/1152416731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 -- 172.21.15.66:0/1152416731 >> 172.21.15.66:0/1152416731 conn(0x55bf52029c00 msgr2=0x55bf51fb1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 -- 172.21.15.66:0/1152416731 shutdown_connections 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.948+0000 7fcc4081a740 1 -- 172.21.15.66:0/1152416731 wait complete. 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 Processor -- start 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 -- start start 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf5202dc80 con 0x55bf5217a000 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bf5202db00 con 0x55bf5217a400 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.949+0000 7fcc4081a740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55bf5202d980 con 0x55bf5217a800 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41214/0 (socket says 172.21.15.66:41214) 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 learned_addr learned my addr 172.21.15.66:0/3858104717 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a800 msgr2=0x55bf5200db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf5217a800 0x55bf5200db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a400 msgr2=0x55bf5200d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf5125f0e0 con 0x55bf5217a000 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf5217a400 0x55bf5200d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x55bf5210de30 tx=0x55bf513029c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3842d640 1 -- 172.21.15.66:0/3858104717 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bf512584e0 con 0x55bf5217a000 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3842d640 1 -- 172.21.15.66:0/3858104717 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bf5127aa80 con 0x55bf5217a000 2024-05-10T11:22:26.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc3842d640 1 -- 172.21.15.66:0/3858104717 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bf512589c0 con 0x55bf5217a000 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf5125fa40 con 0x55bf5217a000 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf5125e3c0 con 0x55bf5217a000 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.950+0000 7fcc4081a740 4 datascan.init: resolving metadata pool 17 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc3842d640 1 -- 172.21.15.66:0/3858104717 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55bf52116c00 con 0x55bf5217a000 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc3842d640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55bf52199000 0x55bf5200e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc3842d640 1 -- 172.21.15.66:0/3858104717 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x55bf52181400 con 0x55bf5217a000 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc4081a740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc4081a740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc4081a740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55bf5217ac00 0x55bf5200e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf5217b000 con 0x55bf5217ac00 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55bf52199000 0x55bf5200e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55bf5217ac00 0x55bf5200e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.952+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55bf5217ac00 0x55bf5200e680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.953+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55bf52199000 0x55bf5200e100 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55bf5205dbf0 tx=0x55bf51fd8720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.953+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(1 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.953+0000 7fcc3942f640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55bf52199400 0x55bf515de000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.953+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52199800 con 0x55bf52199400 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.953+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55bf52199400 0x55bf515de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.953+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55bf52199400 0x55bf515de000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.954+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(2 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.954+0000 7fcc39c30640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55bf51552000 0x55bf515de580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.954+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552400 con 0x55bf51552000 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.954+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55bf51552000 0x55bf515de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.954+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55bf51552000 0x55bf515de580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.954+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(3 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51552000 2024-05-10T11:22:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52199c00 con 0x55bf5217ac00 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(4 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552800 con 0x55bf5217ac00 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(5 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552c00 con 0x55bf52199400 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== osd_op_reply(6 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc39c30640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55bf51553000 0x55bf515deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553400 con 0x55bf51553000 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.955+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55bf51553000 0x55bf515deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.956+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55bf51553000 0x55bf515deb00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.956+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(7 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.956+0000 7fcc3942f640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55bf52199c00 0x55bf515df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.956+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:8 18.38 18:1c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf5217b000 con 0x55bf52199c00 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.956+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55bf52199c00 0x55bf515df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.956+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55bf52199c00 0x55bf515df600 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(8 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:9 18.4 18:20000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553800 con 0x55bf5217ac00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 4 ==== osd_op_reply(9 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:10 18.24 18:24000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552800 con 0x55bf5217ac00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 5 ==== osd_op_reply(10 [pgnls start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:11 18.14 18:28000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf51552000 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(11 [pgnls start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51552000 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.957+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:12 18.34 18:2c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553400 con 0x55bf5217ac00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 6 ==== osd_op_reply(12 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:13 18.c 18:30000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606400 con 0x55bf52199400 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 3 ==== osd_op_reply(13 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc3942f640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55bf51553800 0x55bf515dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:14 18.2c 18:34000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553c00 con 0x55bf51553800 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55bf51553800 0x55bf515dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.958+0000 7fcc3e439640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55bf51553800 0x55bf515dfb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(14 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:15 18.1c 18:38000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606800 con 0x55bf51553000 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(15 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc3942f640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55bf51606400 0x55bf515e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:16 18.3c 18:3c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607000 con 0x55bf51606400 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55bf51606400 0x55bf515e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.959+0000 7fcc3dc38640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55bf51606400 0x55bf515e0100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(16 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:17 18.2 18:40000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606c00 con 0x55bf51606400 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== osd_op_reply(17 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:18 18.22 18:44000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf5217b000 con 0x55bf52199c00 2024-05-10T11:22:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(18 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:19 18.12 18:48000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606800 con 0x55bf51553800 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== osd_op_reply(19 [pgnls start_epoch 120 out=81b] v119'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.960+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:20 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607800 con 0x55bf51553800 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.961+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 3 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.961+0000 7fcc4081a740 10 datascan.operator(): handling object 1099511627778.0 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.961+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:21 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607c00 con 0x55bf51553800 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 4 ==== osd_op_reply(21 10000000002.00000000 [call] v120'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:22 18.32 18:4c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf52199c00 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(22 [pgnls start_epoch 120 out=49b] v118'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:23 18.a 18:50000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607000 con 0x55bf52199c00 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 4 ==== osd_op_reply(23 [pgnls start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc3942f640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55bf51552c00 0x55bf515e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:24 18.2a 18:54000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52199800 con 0x55bf51552c00 2024-05-10T11:22:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.962+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55bf51552c00 0x55bf515e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.963+0000 7fcc3ec3a640 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55bf51552c00 0x55bf515e0680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.963+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(24 [pgnls start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.963+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:25 18.1a 18:58000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607400 con 0x55bf52199c00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.963+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 5 ==== osd_op_reply(25 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.963+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:26 18.3a 18:5c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf5217ac00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 7 ==== osd_op_reply(26 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:27 18.6 18:60000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552800 con 0x55bf51606400 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 3 ==== osd_op_reply(27 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:28 18.26 18:64000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607000 con 0x55bf51553800 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 5 ==== osd_op_reply(28 [pgnls start_epoch 120 out=49b] v118'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:29 18.16 18:68000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553400 con 0x55bf52199c00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 6 ==== osd_op_reply(29 [pgnls start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.964+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:30 18.36 18:6c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607400 con 0x55bf51553000 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.965+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 3 ==== osd_op_reply(30 [pgnls start_epoch 120 out=81b] v118'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.965+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:31 18.36 18:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606800 con 0x55bf51553000 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.965+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 4 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.965+0000 7fcc4081a740 10 datascan.operator(): handling object 1099511628279.0 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.965+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:32 18.36 18:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607800 con 0x55bf51553000 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.966+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 5 ==== osd_op_reply(32 100000001f7.00000000 [call] v120'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.966+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:33 18.e 18:70000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552400 con 0x55bf5217ac00 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.966+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 8 ==== osd_op_reply(33 [pgnls start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.966+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:34 18.2e 18:74000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52199800 con 0x55bf52199c00 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.967+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 7 ==== osd_op_reply(34 [pgnls start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.967+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:35 18.1e 18:78000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606c00 con 0x55bf52199400 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.967+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 4 ==== osd_op_reply(35 [pgnls start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.967+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:36 18.3e 18:7c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf5217b000 con 0x55bf52199c00 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.967+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 8 ==== osd_op_reply(36 [pgnls start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.967+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:37 18.1 18:80000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf52199c00 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.968+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 9 ==== osd_op_reply(37 [pgnls start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.968+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:38 18.21 18:84000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618000 con 0x55bf52199400 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.968+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 5 ==== osd_op_reply(38 [pgnls start_epoch 120 out=49b] v118'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.968+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:39 18.11 18:88000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607400 con 0x55bf51553000 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.968+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 6 ==== osd_op_reply(39 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.968+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:40 18.31 18:8c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618400 con 0x55bf51552c00 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.969+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(40 [pgnls start_epoch 120 out=81b] v118'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.969+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:41 18.31 18:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553c00 con 0x55bf51552c00 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.969+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.969+0000 7fcc4081a740 10 datascan.operator(): handling object 1099511627780.1 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.969+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:42 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55bf52198c00 con 0x55bf51553000 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 7 ==== osd_op_reply(42 10000000004.00000000 [call] v120'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618000 con 0x55bf52199c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 10 ==== osd_op_reply(43 [pgnls start_epoch 120 out=49b] v118'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618800 con 0x55bf51606400 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 4 ==== osd_op_reply(44 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606800 con 0x55bf51552c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(45 [pgnls start_epoch 120 out=81b] v119'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.971+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:46 18.19 18:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55bf51619c00 con 0x55bf51552c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.972+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 5 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.972+0000 7fcc4081a740 10 datascan.operator(): handling object 1099511628280.0 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.972+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:47 18.19 18:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606c00 con 0x55bf51552c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.973+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 6 ==== osd_op_reply(47 100000001f8.00000000 [call] v120'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.973+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:48 18.39 18:9c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf5217ac00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.973+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 9 ==== osd_op_reply(48 [pgnls start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.973+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:49 18.5 18:a0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552800 con 0x55bf51553000 2024-05-10T11:22:26.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.974+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 8 ==== osd_op_reply(49 [pgnls start_epoch 120 out=81b] v120'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.974+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:50 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55bf5217b000 con 0x55bf51553000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.974+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 9 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.974+0000 7fcc4081a740 10 datascan.operator(): handling object 1099511627780.0 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.974+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:51 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55bf52199800 con 0x55bf51553000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.975+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 10 ==== osd_op_reply(51 10000000004.00000000 [call] v120'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.975+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:52 18.25 18:a4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553400 con 0x55bf51552000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.975+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(52 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51552000 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.975+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607800 con 0x55bf52199400 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.975+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 6 ==== osd_op_reply(53 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618c00 con 0x55bf51552c00 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 7 ==== osd_op_reply(54 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607400 con 0x55bf51552c00 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 8 ==== osd_op_reply(55 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51619000 con 0x55bf51552000 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.6 v2:172.21.15.190:6808/4182602787 4 ==== osd_op_reply(56 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51552000 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.976+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf5217ac00 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.977+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.0 v2:172.21.15.66:6800/1407218537 10 ==== osd_op_reply(57 [pgnls start_epoch 120 out=49b] v118'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf5217ac00 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.977+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51619400 con 0x55bf52199c00 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.977+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.3 v2:172.21.15.66:6824/286653269 11 ==== osd_op_reply(58 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199c00 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.977+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618800 con 0x55bf51553000 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.977+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 11 ==== osd_op_reply(59 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.977+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51619800 con 0x55bf51553800 2024-05-10T11:22:26.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 6 ==== osd_op_reply(60 [pgnls start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52198c00 con 0x55bf51606400 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 5 ==== osd_op_reply(61 [pgnls start_epoch 120 out=49b] v118'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606800 con 0x55bf51553000 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 12 ==== osd_op_reply(62 [pgnls start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51552400 con 0x55bf52199400 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 7 ==== osd_op_reply(63 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.978+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606c00 con 0x55bf51606400 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.979+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 6 ==== osd_op_reply(64 [pgnls start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.979+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606000 con 0x55bf51553000 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.979+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 13 ==== osd_op_reply(65 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.979+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51607800 con 0x55bf51552c00 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.979+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 9 ==== osd_op_reply(66 [pgnls start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.979+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51606800 con 0x55bf51553800 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc3e439640 1 -- 172.21.15.66:0/3858104717 <== osd.2 v2:172.21.15.66:6816/3859729948 7 ==== osd_op_reply(67 [pgnls start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4780 con 0x55bf51553800 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618400 con 0x55bf52199400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 8 ==== osd_op_reply(68 [pgnls start_epoch 120 out=49b] v118'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52199800 con 0x55bf52199400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 9 ==== osd_op_reply(69 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618000 con 0x55bf51606400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 7 ==== osd_op_reply(70 [pgnls start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.980+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf52198c00 con 0x55bf52199400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.981+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.5 v2:172.21.15.190:6800/4020203147 10 ==== osd_op_reply(71 [pgnls start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf52199400 2024-05-10T11:22:26.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.981+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51619c00 con 0x55bf51553000 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.981+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.1 v2:172.21.15.66:6808/2096128619 14 ==== osd_op_reply(72 [pgnls start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51553000 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.981+0000 7fcc39c30640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51618800 con 0x55bf51606400 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.981+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 <== osd.7 v2:172.21.15.190:6824/1531895533 8 ==== osd_op_reply(73 [pgnls start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4000 con 0x55bf51606400 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.981+0000 7fcc3942f640 1 -- 172.21.15.66:0/3858104717 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55bf51553c00 con 0x55bf51552c00 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc3ec3a640 1 -- 172.21.15.66:0/3858104717 <== osd.4 v2:172.21.15.190:6816/1866487272 10 ==== osd_op_reply(74 [pgnls start_epoch 120 out=49b] v118'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bf51fc4500 con 0x55bf51552c00 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55bf5217ac00 msgr2=0x55bf5200e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55bf5217ac00 0x55bf5200e680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55bf51553000 msgr2=0x55bf515deb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55bf51553000 0x55bf515deb00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55bf51553800 msgr2=0x55bf515dfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55bf51553800 0x55bf515dfb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55bf52199c00 msgr2=0x55bf515df600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55bf52199c00 0x55bf515df600 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55bf51552c00 msgr2=0x55bf515e0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55bf51552c00 0x55bf515e0680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55bf52199400 msgr2=0x55bf515de000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55bf52199400 0x55bf515de000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55bf51552000 msgr2=0x55bf515de580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55bf51552000 0x55bf515de580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55bf51606400 msgr2=0x55bf515e0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 reap_dead start 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55bf51606400 0x55bf515e0100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc3dc38640 1 -- 172.21.15.66:0/3858104717 reap_dead start 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55bf52199000 msgr2=0x55bf5200e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55bf52199000 0x55bf5200e100 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55bf5205dbf0 tx=0x55bf51fd8720 comp rx=0 tx=0).stop 2024-05-10T11:22:27.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 msgr2=0x55bf5200d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x55bf5210de30 tx=0x55bf513029c0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 shutdown_connections 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55bf51606400 0x55bf515e0100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55bf52199000 0x55bf5200e100 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/3858104717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf5217a000 0x55bf5200d080 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 >> 172.21.15.66:0/3858104717 conn(0x55bf52029c00 msgr2=0x55bf51fb1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 shutdown_connections 2024-05-10T11:22:27.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/3858104717 wait complete. 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 msgr2=0x55bf5200c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 0x55bf5200c000 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x55bf5205db90 tx=0x55bf51fd8a20 comp rx=0 tx=0).stop 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 shutdown_connections 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bf51233c00 0x55bf5200cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55bf51233800 0x55bf5200c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 --2- 172.21.15.66:0/966907942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf51232c00 0x55bf5200c000 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 >> 172.21.15.66:0/966907942 conn(0x55bf51233000 msgr2=0x55bf51fb0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 shutdown_connections 2024-05-10T11:22:27.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:26.982+0000 7fcc4081a740 1 -- 172.21.15.66:0/966907942 wait complete. 2024-05-10T11:22:27.003 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.136382, result: 2024-05-10T11:22:27.004 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-05-10T11:22:27.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.080+0000 7fc2fac3c740 1 -- start start 2024-05-10T11:22:27.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.080+0000 7fc2fac3c740 1 Processor -- start 2024-05-10T11:22:27.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e636e36c00 0x55e637c02000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e636e37800 0x55e637c02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 0x55e637c02b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e636f3a600 con 0x55e636e37c00 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e636f3a480 con 0x55e636e36c00 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e636f3a300 con 0x55e636e37800 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2f8d40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 0x55e637c02b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2f8d40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 0x55e637c02b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41218/0 (socket says 172.21.15.66:41218) 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2f8d40640 1 -- 172.21.15.66:0/1378567393 learned_addr learned my addr 172.21.15.66:0/1378567393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2f853f640 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e636e36c00 0x55e637c02000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e636e37800 0x55e637c02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.081+0000 7fc2f8d40640 1 -- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e636e37800 msgr2=0x55e637c02580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e636e37800 0x55e637c02580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f8d40640 1 -- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e636e36c00 msgr2=0x55e637c02000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e636e36c00 0x55e637c02000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f8d40640 1 -- 172.21.15.66:0/1378567393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e636e63680 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f853f640 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e636e36c00 0x55e637c02000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 0x55e637c02b00 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x55e637c53b60 tx=0x55e636f06120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4919ca3ad3f1b5fd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f5d3a640 1 -- 172.21.15.66:0/1378567393 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e636e5c680 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f5d3a640 1 -- 172.21.15.66:0/1378567393 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e636e7ec40 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f5d3a640 1 -- 172.21.15.66:0/1378567393 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e636e5cb60 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e636e63860 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e636e632c0 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 4 waiting for MDS map... 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f5d3a640 1 -- 172.21.15.66:0/1378567393 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x55e637c16a00 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2f5d3a640 1 -- 172.21.15.66:0/1378567393 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 106) ==== 2885+0+0 (secure 0 0 0) 0x55e636e8f180 con 0x55e636e37c00 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 4 Got MDS map 106 2024-05-10T11:22:27.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 4 datascan.main: Using metadata pool output 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.082+0000 7fc2fac3c740 4 datascan.main: connecting to RADOS... 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 Processor -- start 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 -- start start 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 0x55e637c03080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637d78000 0x55e637c03600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d78400 0x55e637c03b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e636f3a180 con 0x55e637c2fc00 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e636e96480 con 0x55e637d78000 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e636e96900 con 0x55e637d78400 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.083+0000 7fc2f7d3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 0x55e637c03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 0x55e637c03080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41224/0 (socket says 172.21.15.66:41224) 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/1908073645 learned_addr learned my addr 172.21.15.66:0/1908073645 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f853f640 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637d78000 0x55e637c03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d78400 0x55e637c03b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d78400 msgr2=0x55e637c03b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d78400 0x55e637c03b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637d78000 msgr2=0x55e637c03600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637d78000 0x55e637c03600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/1908073645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e636e634a0 con 0x55e637c2fc00 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 0x55e637c03080 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x55e637c32f60 tx=0x55e637bdc660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ee902a32bcdf0b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f3d36640 1 -- 172.21.15.66:0/1908073645 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e636e5c9c0 con 0x55e637c2fc00 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f3d36640 1 -- 172.21.15.66:0/1908073645 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e636e7f340 con 0x55e637c2fc00 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.084+0000 7fc2f3d36640 1 -- 172.21.15.66:0/1908073645 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e636e5c680 con 0x55e637c2fc00 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1908073645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 msgr2=0x55e637c03080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 0x55e637c03080 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x55e637c32f60 tx=0x55e637bdc660 comp rx=0 tx=0).stop 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1908073645 shutdown_connections 2024-05-10T11:22:27.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d78400 0x55e637c03b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637d78000 0x55e637c03600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1908073645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637c2fc00 0x55e637c03080 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1908073645 >> 172.21.15.66:0/1908073645 conn(0x55e637c2f800 msgr2=0x55e637bb2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1908073645 shutdown_connections 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1908073645 wait complete. 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 Processor -- start 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.085+0000 7fc2fac3c740 1 -- start start 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637c2f800 0x55e637c03080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d04000 0x55e637c03600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637d04400 0x55e637c03b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e636f3b200 con 0x55e637d04400 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e636f3a180 con 0x55e637c2f800 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e636f3b380 con 0x55e637d04000 2024-05-10T11:22:27.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637d04400 0x55e637c03b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637d04400 0x55e637c03b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41228/0 (socket says 172.21.15.66:41228) 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 learned_addr learned my addr 172.21.15.66:0/2175055611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d04000 0x55e637c03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637c2f800 0x55e637c03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d04000 msgr2=0x55e637c03600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e637d04000 0x55e637c03600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637c2f800 msgr2=0x55e637c03080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e637c2f800 0x55e637c03080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e636e63680 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637d04400 0x55e637c03b80 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x55e637c33c20 tx=0x55e637bdc6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f2533640 1 -- 172.21.15.66:0/2175055611 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e636e5cb60 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f2533640 1 -- 172.21.15.66:0/2175055611 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e636e7f500 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2f2533640 1 -- 172.21.15.66:0/2175055611 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e636e5c4e0 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.086+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e636e63860 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.087+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e636e632c0 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.087+0000 7fc2fac3c740 4 datascan.init: resolving metadata pool 17 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2f2533640 1 -- 172.21.15.66:0/2175055611 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55e637d78c00 con 0x55e637d04400 2024-05-10T11:22:27.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2f2533640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e6371e8000 0x55e637c04100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2f2533640 1 -- 172.21.15.66:0/2175055611 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x55e637d9a600 con 0x55e637d04400 2024-05-10T11:22:27.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2fac3c740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T11:22:27.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2fac3c740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-05-10T11:22:27.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2fac3c740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T11:22:27.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e6371e8000 0x55e637c04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e637d04800 0x55e637c04680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e637d04c00 con 0x55e637d04800 2024-05-10T11:22:27.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.088+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e637d04800 0x55e637c04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.089+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e6371e8000 0x55e637c04100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55e637bdf1d0 tx=0x55e63716e840 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.089+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e637d04800 0x55e637c04680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.089+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv33 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.089+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e637d05000 0x55e637c04c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.089+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e637d05400 con 0x55e637d05000 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.089+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e637d05000 0x55e637c04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.090+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e637d05000 0x55e637c04c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.090+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.090+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e637d05800 0x55e637c05180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.090+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d05c00 con 0x55e637d05800 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.090+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e637d05800 0x55e637c05180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.090+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e637d05800 0x55e637c05180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f3535640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e6371e8c00 0x55e637202000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9000 con 0x55e6371e8c00 2024-05-10T11:22:27.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e6371e8c00 0x55e637202000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e6371e8c00 0x55e637202000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.091+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9800 con 0x55e637d05000 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9400 con 0x55e637d05800 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9c00 con 0x55e637d05800 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(7 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206000 con 0x55e6371e8c00 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f3d36640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e637206c00 0x55e637202580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.092+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207000 con 0x55e637206c00 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.093+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e637206c00 0x55e637202580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.093+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e637206c00 0x55e637202580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.093+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.093+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206400 con 0x55e637d04800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.093+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.093+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207400 con 0x55e637d05800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206800 con 0x55e637d05800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 5 ==== osd_op_reply(12 [pgnls-filter start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d05c00 con 0x55e637d05000 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9400 con 0x55e637d05800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.094+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 6 ==== osd_op_reply(14 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c2f000 con 0x55e6371e8c00 2024-05-10T11:22:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f3535640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e6371e9c00 0x55e637202b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d04c00 con 0x55e6371e9c00 2024-05-10T11:22:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e6371e9c00 0x55e637202b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f853f640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e6371e9c00 0x55e637202b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.095+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c2ec00 con 0x55e637206c00 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.096+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.096+0000 7fc2f3535640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e637d05400 0x55e637203080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.096+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207400 con 0x55e637d05400 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.096+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e637d05400 0x55e637203080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.096+0000 7fc2f7d3e640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e637d05400 0x55e637203080 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c1d400 con 0x55e637d05400 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206000 con 0x55e637d04800 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207000 con 0x55e6371e9c00 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 120 out=81b] v120'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.097+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a000 con 0x55e637d05800 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207800 con 0x55e6371e8c00 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206400 con 0x55e637d05000 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207c00 con 0x55e637d05800 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.098+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9000 con 0x55e637d05800 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 9 ==== osd_op_reply(26 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a000 con 0x55e6371e8c00 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9800 con 0x55e637206c00 2024-05-10T11:22:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206800 con 0x55e637d04800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.099+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a000 con 0x55e637d05800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 10 ==== osd_op_reply(30 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207000 con 0x55e637d05800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 11 ==== osd_op_reply(31 [pgnls-filter start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207400 con 0x55e637d05000 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d04c00 con 0x55e637d05800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 12 ==== osd_op_reply(33 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.100+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206000 con 0x55e6371e8c00 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.101+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.101+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9400 con 0x55e6371e9c00 2024-05-10T11:22:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.101+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.101+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207800 con 0x55e637206c00 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.101+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.101+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206400 con 0x55e637d05400 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 3 ==== osd_op_reply(37 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c1d400 con 0x55e637d05400 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207400 con 0x55e637d04800 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c2f000 con 0x55e6371e9c00 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 120 out=49b] v120'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207800 con 0x55e637d04800 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.102+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 120 out=49b] v118'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.103+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:42 18.a 18:50000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9800 con 0x55e637d04800 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.103+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 7 ==== osd_op_reply(42 [pgnls-filter start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.103+0000 7fc2f3d36640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e637207c00 0x55e637203600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.103+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:43 18.2a 18:54000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207000 con 0x55e637207c00 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.103+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e637207c00 0x55e637203600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.103+0000 7fc2f8d40640 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e637207c00 0x55e637203600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(43 [pgnls-filter start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:44 18.1a 18:58000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9000 con 0x55e637d04800 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 8 ==== osd_op_reply(44 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:45 18.3a 18:5c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a000 con 0x55e637d05800 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 13 ==== osd_op_reply(45 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:46 18.6 18:60000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9400 con 0x55e637d05400 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 5 ==== osd_op_reply(46 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.104+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:47 18.26 18:64000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c2ec00 con 0x55e6371e9c00 2024-05-10T11:22:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 5 ==== osd_op_reply(47 [pgnls-filter start_epoch 120 out=49b] v118'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:48 18.16 18:68000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d05c00 con 0x55e637d04800 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:49 18.36 18:6c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9800 con 0x55e637206c00 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 120 out=81b] v120'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2fac3c740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2fac3c740 10 datascan.operator(): handling object 100000001f7.0 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:50 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a800 con 0x55e637206c00 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 6 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2fac3c740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2fac3c740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.105+0000 7fc2fac3c740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:51 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e63721ac00 con 0x55e637d05800 2024-05-10T11:22:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 14 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:52 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e63721b000 con 0x55e637d04800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 10 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) ==== 164+0+585 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 20 datascan.get_frag_of: frag is * 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:53 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e63721b400 con 0x55e637d05800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 15 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.106+0000 7fc2fac3c740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.107+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:54 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55e63721b800 con 0x55e637d05800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.107+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 16 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.107+0000 7fc2fac3c740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-05-10T11:22:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.107+0000 7fc2fac3c740 20 datascan.read_dentry: bravo_head not found in result 2024-05-10T11:22:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.107+0000 7fc2fac3c740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-05-10T11:22:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.107+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:55 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55e63721bc00 con 0x55e637d05800 2024-05-10T11:22:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 17 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v120'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2fac3c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-05-10T11:22:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a000 con 0x55e637d05800 2024-05-10T11:22:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 18 ==== osd_op_reply(56 [pgnls-filter start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206800 con 0x55e637d04800 2024-05-10T11:22:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 11 ==== osd_op_reply(57 [pgnls-filter start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.108+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d04c00 con 0x55e6371e8c00 2024-05-10T11:22:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.109+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.109+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206000 con 0x55e637d04800 2024-05-10T11:22:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.109+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 12 ==== osd_op_reply(59 [pgnls-filter start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.109+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722e000 con 0x55e637d04800 2024-05-10T11:22:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.109+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 13 ==== osd_op_reply(60 [pgnls-filter start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.109+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206400 con 0x55e6371e8c00 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.110+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 8 ==== osd_op_reply(61 [pgnls-filter start_epoch 120 out=49b] v118'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.110+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722e400 con 0x55e637206c00 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.110+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 7 ==== osd_op_reply(62 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.110+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207400 con 0x55e637207c00 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.110+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(63 [pgnls-filter start_epoch 120 out=49b] v118'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.110+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722e800 con 0x55e637d04800 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.111+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 14 ==== osd_op_reply(64 [pgnls-filter start_epoch 120 out=49b] v118'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.111+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207800 con 0x55e637d05400 2024-05-10T11:22:27.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.111+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.111+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722ec00 con 0x55e637207c00 2024-05-10T11:22:27.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.111+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(66 [pgnls-filter start_epoch 120 out=49b] v120'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.111+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637c1d400 con 0x55e637d05800 2024-05-10T11:22:27.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 19 ==== osd_op_reply(67 [pgnls-filter start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722f000 con 0x55e637206c00 2024-05-10T11:22:27.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 120 out=49b] v120'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207000 con 0x55e637d05000 2024-05-10T11:22:27.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722f400 con 0x55e6371e8c00 2024-05-10T11:22:27.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.112+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d05c00 con 0x55e637207c00 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(71 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722f800 con 0x55e637207c00 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637d04c00 con 0x55e637d05000 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.6 v2:172.21.15.190:6808/4182602787 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637d05000 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.113+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722fc00 con 0x55e637d05800 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.0 v2:172.21.15.66:6800/1407218537 20 ==== osd_op_reply(74 [pgnls-filter start_epoch 120 out=49b] v118'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e637d05800 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a800 con 0x55e637d04800 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.3 v2:172.21.15.66:6824/286653269 15 ==== osd_op_reply(75 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d04800 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722e400 con 0x55e637206c00 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 9 ==== osd_op_reply(76 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721a400 con 0x55e6371e9c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 6 ==== osd_op_reply(77 [pgnls-filter start_epoch 120 out=49b] v118'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.114+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722ec00 con 0x55e637d05400 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.115+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 120 out=49b] v118'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.115+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63721b000 con 0x55e637206c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.115+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 10 ==== osd_op_reply(79 [pgnls-filter start_epoch 120 out=49b] v118'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.115+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722e000 con 0x55e6371e8c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.115+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 10 ==== osd_op_reply(80 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.115+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9800 con 0x55e637d05400 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207400 con 0x55e637206c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9000 con 0x55e637207c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 6 ==== osd_op_reply(83 [pgnls-filter start_epoch 120 out=49b] v118'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206800 con 0x55e6371e9c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.116+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 <== osd.2 v2:172.21.15.66:6816/3859729948 7 ==== osd_op_reply(84 [pgnls-filter start_epoch 120 out=49b] v118'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8780 con 0x55e6371e9c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e6371e9400 con 0x55e6371e8c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 11 ==== osd_op_reply(85 [pgnls-filter start_epoch 120 out=49b] v118'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206000 con 0x55e6371e8c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 12 ==== osd_op_reply(86 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722e800 con 0x55e637d05400 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 9 ==== osd_op_reply(87 [pgnls-filter start_epoch 120 out=49b] v118'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.117+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637206400 con 0x55e6371e8c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.118+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.5 v2:172.21.15.190:6800/4020203147 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 120 out=49b] v118'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e6371e8c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.118+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722f400 con 0x55e637206c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.118+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.1 v2:172.21.15.66:6808/2096128619 12 ==== osd_op_reply(89 [pgnls-filter start_epoch 120 out=49b] v118'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637206c00 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.118+0000 7fc2f3535640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e637207800 con 0x55e637d05400 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.118+0000 7fc2f7d3e640 1 -- 172.21.15.66:0/2175055611 <== osd.7 v2:172.21.15.190:6824/1531895533 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 120 out=49b] v118'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8000 con 0x55e637d05400 2024-05-10T11:22:27.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.118+0000 7fc2f3d36640 1 -- 172.21.15.66:0/2175055611 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55e63722ec00 con 0x55e637207c00 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2f8d40640 1 -- 172.21.15.66:0/2175055611 <== osd.4 v2:172.21.15.190:6816/1866487272 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 120 out=49b] v118'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e637bc8500 con 0x55e637207c00 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e637d05800 msgr2=0x55e637c05180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55e637d05800 0x55e637c05180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e637206c00 msgr2=0x55e637202580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55e637206c00 0x55e637202580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e6371e9c00 msgr2=0x55e637202b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55e6371e9c00 0x55e637202b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e637d04800 msgr2=0x55e637c04680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55e637d04800 0x55e637c04680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e637207c00 msgr2=0x55e637203600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55e637207c00 0x55e637203600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 reap_dead start 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 reap_dead start 2024-05-10T11:22:27.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e6371e8c00 msgr2=0x55e637202000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55e6371e8c00 0x55e637202000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e637d05000 msgr2=0x55e637c04c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55e637d05000 0x55e637c04c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e637d05400 msgr2=0x55e637203080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55e637d05400 0x55e637203080 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e6371e8000 msgr2=0x55e637c04100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55e6371e8000 0x55e637c04100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55e637bdf1d0 tx=0x55e63716e840 comp rx=0 tx=0).stop 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637d04400 msgr2=0x55e637c03b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/2175055611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e637d04400 0x55e637c03b80 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x55e637c33c20 tx=0x55e637bdc6c0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2f853f640 1 -- 172.21.15.66:0/2175055611 reap_dead start 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 shutdown_connections 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 >> 172.21.15.66:0/2175055611 conn(0x55e637c2fc00 msgr2=0x55e637bb2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 shutdown_connections 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/2175055611 wait complete. 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 msgr2=0x55e637c02b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 0x55e637c02b00 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x55e637c53b60 tx=0x55e636f06120 comp rx=0 tx=0).stop 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 shutdown_connections 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e636e37c00 0x55e637c02b00 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e636e37800 0x55e637c02580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 --2- 172.21.15.66:0/1378567393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e636e36c00 0x55e637c02000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.119+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 >> 172.21.15.66:0/1378567393 conn(0x55e636e37000 msgr2=0x55e637bb3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.120+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 shutdown_connections 2024-05-10T11:22:27.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.120+0000 7fc2fac3c740 1 -- 172.21.15.66:0/1378567393 wait complete. 2024-05-10T11:22:27.147 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.143874, result: 2024-05-10T11:22:27.148 DEBUG:teuthology.orchestra.run.smithi066:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.209+0000 7fcb83c17740 1 -- start start 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.209+0000 7fcb83c17740 1 Processor -- start 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.209+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 0x55debf1e4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debe40b800 0x55debf1e4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debe40bc00 0x55debf1e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55debf204180 con 0x55debe40ac00 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55debe46a900 con 0x55debe40bc00 2024-05-10T11:22:27.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55debe46a480 con 0x55debe40b800 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 0x55debf1e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 0x55debf1e4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41238/0 (socket says 172.21.15.66:41238) 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 -- 172.21.15.66:0/4060107969 learned_addr learned my addr 172.21.15.66:0/4060107969 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8210f640 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debe40bc00 0x55debf1e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8110d640 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debe40b800 0x55debf1e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 -- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debe40b800 msgr2=0x55debf1e4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debe40b800 0x55debf1e4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 -- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debe40bc00 msgr2=0x55debf1e4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debe40bc00 0x55debf1e4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 -- 172.21.15.66:0/4060107969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55debe437680 con 0x55debe40ac00 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb8190e640 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 0x55debf1e4000 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x55debf243f50 tx=0x55debe4da000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d744fe2d0805ed4f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb7f109640 1 -- 172.21.15.66:0/4060107969 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55debe430680 con 0x55debe40ac00 2024-05-10T11:22:27.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb7f109640 1 -- 172.21.15.66:0/4060107969 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55debe4521c0 con 0x55debe40ac00 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb7f109640 1 -- 172.21.15.66:0/4060107969 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55debe430b60 con 0x55debe40ac00 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55debe437860 con 0x55debe40ac00 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55debe4372c0 con 0x55debe40ac00 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb83c17740 4 waiting for MDS map... 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.210+0000 7fcb7f109640 1 -- 172.21.15.66:0/4060107969 <== mon.0 v2:172.21.15.66:3300/0 4 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x55debf2e4600 con 0x55debe40ac00 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.211+0000 7fcb7f109640 1 -- 172.21.15.66:0/4060107969 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 106) ==== 2885+0+0 (secure 0 0 0) 0x55debe463180 con 0x55debe40ac00 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.211+0000 7fcb83c17740 4 Got MDS map 106 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.211+0000 7fcb83c17740 4 datascan.main: Using metadata pool output 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.211+0000 7fcb83c17740 4 datascan.main: connecting to RADOS... 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.211+0000 7fcb83c17740 1 Processor -- start 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.211+0000 7fcb83c17740 1 -- start start 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb83c17740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55debe46a180 con 0x55debf1f5400 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb83c17740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55debf204d80 con 0x55debf1f5800 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb83c17740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55debf204f00 con 0x55debf1f5c00 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41246/0 (socket says 172.21.15.66:41246) 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 -- 172.21.15.66:0/1565058485 learned_addr learned my addr 172.21.15.66:0/1565058485 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8190e640 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8110d640 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 -- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 msgr2=0x55debf1e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 -- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 msgr2=0x55debf1e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 -- 172.21.15.66:0/1565058485 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55debe4374a0 con 0x55debf1f5400 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb8210f640 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x55debf1f74d0 tx=0x55debf2fd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d69f19e3760ca2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.212+0000 7fcb7d105640 1 -- 172.21.15.66:0/1565058485 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55debe430680 con 0x55debf1f5400 2024-05-10T11:22:27.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb7d105640 1 -- 172.21.15.66:0/1565058485 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55debe452e00 con 0x55debf1f5400 2024-05-10T11:22:27.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb7d105640 1 -- 172.21.15.66:0/1565058485 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55debe430b60 con 0x55debf1f5400 2024-05-10T11:22:27.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 -- 172.21.15.66:0/1565058485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 msgr2=0x55debf1e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x55debf1f74d0 tx=0x55debf2fd800 comp rx=0 tx=0).stop 2024-05-10T11:22:27.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 -- 172.21.15.66:0/1565058485 shutdown_connections 2024-05-10T11:22:27.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 --2- 172.21.15.66:0/1565058485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 -- 172.21.15.66:0/1565058485 >> 172.21.15.66:0/1565058485 conn(0x55debf1f5000 msgr2=0x55debf189000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 -- 172.21.15.66:0/1565058485 shutdown_connections 2024-05-10T11:22:27.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.213+0000 7fcb83c17740 1 -- 172.21.15.66:0/1565058485 wait complete. 2024-05-10T11:22:27.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 Processor -- start 2024-05-10T11:22:27.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 -- start start 2024-05-10T11:22:27.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55debf205200 con 0x55debf1f5400 2024-05-10T11:22:27.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55debf205080 con 0x55debf1f5800 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb83c17740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55debf205380 con 0x55debf1f5c00 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb8210f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb8210f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41250/0 (socket says 172.21.15.66:41250) 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 learned_addr learned my addr 172.21.15.66:0/25872199 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.214+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 msgr2=0x55debf1e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 msgr2=0x55debf1e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debf1f5800 0x55debf1e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55debe437680 con 0x55debf1f5400 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debf1f5c00 0x55debf1e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x55debf368090 tx=0x55debf1b09c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb7b902640 1 -- 172.21.15.66:0/25872199 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55debe4304e0 con 0x55debf1f5400 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb7b902640 1 -- 172.21.15.66:0/25872199 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55debe452540 con 0x55debf1f5400 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55debe437860 con 0x55debf1f5400 2024-05-10T11:22:27.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb7b902640 1 -- 172.21.15.66:0/25872199 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55debe430680 con 0x55debf1f5400 2024-05-10T11:22:27.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55debe4370e0 con 0x55debf1f5400 2024-05-10T11:22:27.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.215+0000 7fcb83c17740 4 datascan.init: resolving metadata pool 17 2024-05-10T11:22:27.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.216+0000 7fcb7b902640 1 -- 172.21.15.66:0/25872199 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55debf364c00 con 0x55debf1f5400 2024-05-10T11:22:27.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.216+0000 7fcb7b902640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55debf35cc00 0x55debf1e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb7b902640 1 -- 172.21.15.66:0/25872199 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x55debf35ea00 con 0x55debf1f5400 2024-05-10T11:22:27.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb83c17740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T11:22:27.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb83c17740 4 datascan.main: resolving metadata pool 17 2024-05-10T11:22:27.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55debf35d000 0x55debf1e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55debf35cc00 0x55debf1e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf35d400 con 0x55debf35d000 2024-05-10T11:22:27.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55debf35d000 0x55debf1e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55debf35cc00 0x55debf1e6100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55debf1f6450 tx=0x55debf1b0a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55debf35d000 0x55debf1e6680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== osd_op_reply(1 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55debf35d400 0x55debe7b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.217+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20b400 con 0x55debf35d400 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.218+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55debf35d400 0x55debe7b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.218+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55debf35d400 0x55debe7b8000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.218+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== osd_op_reply(2 [pgnls start_epoch 120 out=177b] v119'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.218+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20b400 con 0x55debf35d000 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.218+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== osd_op_reply(3 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.218+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55debf20b400 0x55debe7b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.219+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20b000 con 0x55debf20b400 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.219+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55debf20b400 0x55debe7b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.219+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55debf20b400 0x55debe7b8580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.219+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== osd_op_reply(4 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.219+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20b000 con 0x55debf20b400 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== osd_op_reply(5 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20b000 con 0x55debf35d400 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== osd_op_reply(6 [pgnls start_epoch 120 out=149b] v120'40 uv40 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20b000 con 0x55debf35d000 2024-05-10T11:22:27.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 3 ==== osd_op_reply(7 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55debf20b000 0x55debe7b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20a800 con 0x55debf20b000 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.220+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55debf20b000 0x55debe7b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.221+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55debf20b000 0x55debe7b8b00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.221+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== osd_op_reply(8 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.221+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55debf20a800 0x55debe7b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.221+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20ac00 con 0x55debf20a800 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.221+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55debf20a800 0x55debe7b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.221+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55debf20a800 0x55debe7b9080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.222+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== osd_op_reply(9 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf20a800 2024-05-10T11:22:27.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.222+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20ac00 con 0x55debf35d400 2024-05-10T11:22:27.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.222+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 3 ==== osd_op_reply(10 [pgnls start_epoch 120 out=81b] v119'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.222+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20ac00 con 0x55debf35d000 2024-05-10T11:22:27.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.222+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 4 ==== osd_op_reply(11 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.222+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debf20ac00 con 0x55debf20b400 2024-05-10T11:22:27.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 3 ==== osd_op_reply(12 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55debf20ac00 0x55debe7ba100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72a400 con 0x55debf20ac00 2024-05-10T11:22:27.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55debf20ac00 0x55debe7ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55debf20ac00 0x55debe7ba100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== osd_op_reply(13 [pgnls start_epoch 120 out=77b] v119'10 uv10 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55debe72a400 0x55debe7ba680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.223+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72a800 con 0x55debe72a400 2024-05-10T11:22:27.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55debe72a400 0x55debe7ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55debe72a400 0x55debe7ba680 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== osd_op_reply(14 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8110d640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55debe72a800 0x55debe7b9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debe72a800 2024-05-10T11:22:27.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55debe72a800 0x55debe7b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.224+0000 7fcb8210f640 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55debe72a800 0x55debe7b9600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.225+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== osd_op_reply(15 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c500 con 0x55debe72a800 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.225+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20b000 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.225+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== osd_op_reply(16 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.225+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20b400 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.225+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 4 ==== osd_op_reply(17 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.225+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf35d400 2024-05-10T11:22:27.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 4 ==== osd_op_reply(18 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf35d400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 5 ==== osd_op_reply(19 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debe72a400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== osd_op_reply(20 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20ac00 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== osd_op_reply(21 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.226+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debe72a400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.227+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 3 ==== osd_op_reply(22 [pgnls start_epoch 120 out=97b] v119'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.227+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf35d000 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.227+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 5 ==== osd_op_reply(23 [pgnls start_epoch 120 out=74b] v117'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.227+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf35d000 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.227+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 6 ==== osd_op_reply(24 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.227+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20a800 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== osd_op_reply(25 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf20a800 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf35d400 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 6 ==== osd_op_reply(26 [pgnls start_epoch 120 out=98b] v119'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20b400 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 5 ==== osd_op_reply(27 [pgnls start_epoch 120 out=76b] v120'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20a800 2024-05-10T11:22:27.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.4 v2:172.21.15.190:6816/1866487272 3 ==== osd_op_reply(28 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf20a800 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.228+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20b400 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.229+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 6 ==== osd_op_reply(29 [pgnls start_epoch 120 out=105b] v120'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.229+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20ac00 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.229+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 3 ==== osd_op_reply(30 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.229+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20b000 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.229+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 3 ==== osd_op_reply(31 [pgnls start_epoch 120 out=73b] v120'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.229+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b000 con 0x55debf20ac00 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 4 ==== osd_op_reply(32 [pgnls start_epoch 120 out=101b] v120'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debf35d800 con 0x55debf35d400 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-05-10T11:22:27.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debf35dc00 con 0x55debf35d400 2024-05-10T11:22:27.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.230+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-05-10T11:22:27.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc000 con 0x55debf35d400 2024-05-10T11:22:27.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc400 con 0x55debf35d400 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d400 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-05-10T11:22:27.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.231+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dcc00 con 0x55debf35d400 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv35 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd000 con 0x55debf20b000 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:40 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd400 con 0x55debf35d400 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 13 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-05-10T11:22:27.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:41 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc000 con 0x55debe72a800 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debe72a800 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.232+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc400 con 0x55debe72a400 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.233+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd800 con 0x55debf35d000 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7ddc00 con 0x55debf35d400 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 14 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debf35d800 con 0x55debf20b400 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.234+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debf35dc00 con 0x55debf20b400 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 20 datascan.scan_links: injected ino detected 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20ac00 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dcc00 con 0x55debf35d000 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 8 ==== osd_op_reply(48 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.235+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dcc00 con 0x55debf35d400 2024-05-10T11:22:27.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.236+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 15 ==== osd_op_reply(49 [pgnls start_epoch 120 out=177b] v119'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.236+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dcc00 con 0x55debf35d000 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.236+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 9 ==== osd_op_reply(50 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.236+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dcc00 con 0x55debf20b400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.236+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 9 ==== osd_op_reply(51 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 10 ==== osd_op_reply(52 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 16 ==== osd_op_reply(53 [pgnls start_epoch 120 out=149b] v120'40 uv40 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d000 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 10 ==== osd_op_reply(54 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.237+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b000 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.238+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 5 ==== osd_op_reply(55 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.238+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20a800 2024-05-10T11:22:27.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.238+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.4 v2:172.21.15.190:6816/1866487272 4 ==== osd_op_reply(56 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf20a800 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.238+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d400 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.238+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 17 ==== osd_op_reply(57 [pgnls start_epoch 120 out=81b] v119'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.238+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d000 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 11 ==== osd_op_reply(58 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b400 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 11 ==== osd_op_reply(59 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20ac00 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 6 ==== osd_op_reply(60 [pgnls start_epoch 120 out=77b] v119'10 uv10 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debe72a400 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 5 ==== osd_op_reply(61 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.239+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debe72a800 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.2 v2:172.21.15.66:6816/3859729948 3 ==== osd_op_reply(62 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c500 con 0x55debe72a800 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b000 2024-05-10T11:22:27.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 6 ==== osd_op_reply(63 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 12 ==== osd_op_reply(64 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 18 ==== osd_op_reply(65 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.240+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.241+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 19 ==== osd_op_reply(66 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.241+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debe72a400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.241+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 6 ==== osd_op_reply(67 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.241+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20ac00 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.241+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 7 ==== osd_op_reply(68 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.241+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debe72a400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 7 ==== osd_op_reply(69 [pgnls start_epoch 120 out=97b] v119'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d000 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 12 ==== osd_op_reply(70 [pgnls start_epoch 120 out=74b] v117'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d000 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 13 ==== osd_op_reply(71 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20a800 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.4 v2:172.21.15.190:6816/1866487272 5 ==== osd_op_reply(72 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf20a800 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.242+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf35d400 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 20 ==== osd_op_reply(73 [pgnls start_epoch 120 out=98b] v119'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b400 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 13 ==== osd_op_reply(74 [pgnls start_epoch 120 out=76b] v120'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20a800 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.4 v2:172.21.15.190:6816/1866487272 6 ==== osd_op_reply(75 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c500 con 0x55debf20a800 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b400 2024-05-10T11:22:27.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 14 ==== osd_op_reply(76 [pgnls start_epoch 120 out=105b] v120'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.243+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20ac00 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 8 ==== osd_op_reply(77 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20b000 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 7 ==== osd_op_reply(78 [pgnls start_epoch 120 out=73b] v120'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc800 con 0x55debf20ac00 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 9 ==== osd_op_reply(79 [pgnls start_epoch 120 out=101b] v120'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.244+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd400 con 0x55debf35d400 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 21 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-05-10T11:22:27.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc000 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 22 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7ddc00 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 23 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e6000 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 24 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.245+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e6400 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 25 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T11:22:27.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e6800 con 0x55debf35d400 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 26 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv35 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e6c00 con 0x55debf20b000 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.1 v2:172.21.15.66:6808/2096128619 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c000 con 0x55debf20b000 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:87 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e7000 con 0x55debf35d400 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 27 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.246+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- osd_op(unknown.0.0:88 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e7400 con 0x55debe72a800 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.2 v2:172.21.15.66:6816/3859729948 4 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c500 con 0x55debe72a800 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e7800 con 0x55debe72a400 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.5 v2:172.21.15.190:6800/4020203147 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c000 con 0x55debe72a400 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.247+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e7c00 con 0x55debf35d000 2024-05-10T11:22:27.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7e6c00 con 0x55debf35d400 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 28 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd000 con 0x55debf20b400 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc400 con 0x55debf20b400 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.248+0000 7fcb83c17740 20 datascan.scan_links: injected ino detected 2024-05-10T11:22:27.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-05-10T11:22:27.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-05-10T11:22:27.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T11:22:27.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-05-10T11:22:27.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T11:22:27.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-05-10T11:22:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd800 con 0x55debf20ac00 2024-05-10T11:22:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.6 v2:172.21.15.190:6808/4182602787 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x55debf19c780 con 0x55debf20ac00 2024-05-10T11:22:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-05-10T11:22:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-05-10T11:22:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-05-10T11:22:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: processing 1 injected_inos 2024-05-10T11:22:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-05-10T11:22:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-05-10T11:22:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dd400 con 0x55debf20b400 2024-05-10T11:22:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-05-10T11:22:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 20 datascan.scan_links: first is now 2 2024-05-10T11:22:27.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.249+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55debe7dc000 con 0x55debf20b400 2024-05-10T11:22:27.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb8190e640 1 -- 172.21.15.66:0/25872199 <== osd.0 v2:172.21.15.66:6800/1407218537 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v120'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55debf19c780 con 0x55debf20b400 2024-05-10T11:22:27.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb83c17740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-05-10T11:22:27.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb83c17740 10 datascan.scan_links: updating inotable 2024-05-10T11:22:27.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe7ddc00 con 0x55debf35d400 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 29 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb83c17740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb83c17740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.251+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- osd_op(unknown.0.0:98 17.13 17:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55debe72bc00 con 0x55debf35d400 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.252+0000 7fcb8210f640 1 -- 172.21.15.66:0/25872199 <== osd.3 v2:172.21.15.66:6824/286653269 30 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v120'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x55debf19c500 con 0x55debf35d400 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.252+0000 7fcb83c17740 10 datascan.scan_links: updating snaptable 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.252+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- osd_op(unknown.0.0:99 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55debe72b800 con 0x55debf35d000 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.252+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 <== osd.7 v2:172.21.15.190:6824/1531895533 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55debf19c000 con 0x55debf35d000 2024-05-10T11:22:27.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55debf20b400 msgr2=0x55debe7b8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x55debf20b400 0x55debe7b8580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55debf20b000 msgr2=0x55debe7b8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x55debf20b000 0x55debe7b8b00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55debe72a800 msgr2=0x55debe7b9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x55debe72a800 0x55debe7b9600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55debf35d400 msgr2=0x55debe7b8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x55debf35d400 0x55debe7b8000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55debf20a800 msgr2=0x55debe7b9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x55debf20a800 0x55debe7b9080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55debe72a400 msgr2=0x55debe7ba680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x55debe72a400 0x55debe7ba680 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55debf20ac00 msgr2=0x55debe7ba100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x55debf20ac00 0x55debe7ba100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 reap_dead start 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55debf35d000 msgr2=0x55debf1e6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 reap_dead start 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x55debf35d000 0x55debf1e6680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 reap_dead start 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb8110d640 1 -- 172.21.15.66:0/25872199 reap_dead start 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55debf35cc00 msgr2=0x55debf1e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55debf35cc00 0x55debf1e6100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55debf1f6450 tx=0x55debf1b0a80 comp rx=0 tx=0).stop 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 msgr2=0x55debf1e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x55debf368090 tx=0x55debf1b09c0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 shutdown_connections 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x55debf35cc00 0x55debf1e6100 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/25872199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debf1f5400 0x55debf1e5080 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 >> 172.21.15.66:0/25872199 conn(0x55debf1f5000 msgr2=0x55debf189000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 shutdown_connections 2024-05-10T11:22:27.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/25872199 wait complete. 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 msgr2=0x55debf1e4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 0x55debf1e4000 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x55debf243f50 tx=0x55debe4da000 comp rx=0 tx=0).stop 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 shutdown_connections 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55debe40bc00 0x55debf1e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55debe40b800 0x55debf1e4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 --2- 172.21.15.66:0/4060107969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55debe40ac00 0x55debf1e4000 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 >> 172.21.15.66:0/4060107969 conn(0x55debe40b000 msgr2=0x55debf188800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 shutdown_connections 2024-05-10T11:22:27.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.253+0000 7fcb83c17740 1 -- 172.21.15.66:0/4060107969 wait complete. 2024-05-10T11:22:27.293 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.145899, result: 2024-05-10T11:22:27.295 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:27.306 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:27.349 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:27.350 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.351 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-05-10T11:22:27.352 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-05-10T11:22:27.353 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:27.354 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:27.355 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:27.356 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.357 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.358 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: mon down mkfs grace = 300 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2024-05-10T11:22:27.359 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = False 2024-05-10T11:22:27.360 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2024-05-10T11:22:27.361 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2024-05-10T11:22:27.361 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:27.361 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.361 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-05-10T11:22:27.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:27.364 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.365 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-05-10T11:22:27.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-05-10T11:22:27.367 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-05-10T11:22:27.368 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-05-10T11:22:27.370 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-05-10T11:22:27.371 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:27.372 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.373 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-05-10T11:22:27.374 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = False 2024-05-10T11:22:27.374 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-05-10T11:22:27.374 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-05-10T11:22:27.374 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:27.374 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.374 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.375 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:27.406 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T11:22:27.448 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-05-10T11:22:27.448 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-05-10T11:22:27.448 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.449 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:27.450 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.451 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:27.451 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:27.451 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.451 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-05-10T11:22:27.451 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.451 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:27.452 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-05-10T11:22:27.452 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:27.452 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:27.452 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:27.452 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:27.452 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-05-10T11:22:27.453 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:27.453 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:27.453 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:27.453 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.453 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:27.453 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:27.454 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-05-10T11:22:27.455 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.456 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2024-05-10T11:22:27.457 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.458 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-05-10T11:22:27.459 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:27.460 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: mon down mkfs grace = 300 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-05-10T11:22:27.461 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:27.462 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:27.462 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2024-05-10T11:22:27.462 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2024-05-10T11:22:27.462 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.462 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2024-05-10T11:22:27.462 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2024-05-10T11:22:27.463 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2024-05-10T11:22:27.464 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.465 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.466 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-05-10T11:22:27.466 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-05-10T11:22:27.466 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T11:22:27.466 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.467 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-05-10T11:22:27.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-05-10T11:22:27.469 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.66,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 62c58463-bf48-494c-be0a-3a4b427ce317 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-05-10T11:22:27.470 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-05-10T11:22:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-05-10T11:22:27.472 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:27.473 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.474 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-05-10T11:22:27.475 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-05-10T11:22:27.476 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-05-10T11:22:27.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-05-10T11:22:27.478 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-05-10T11:22:27.478 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-05-10T11:22:27.478 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-05-10T11:22:27.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T11:22:27.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.614+0000 7f4c5979e640 1 Processor -- start 2024-05-10T11:22:27.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.614+0000 7f4c5979e640 1 -- start start 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c5979e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c5979e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c540d5a40 0x7f4c540d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c5979e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c540cfbf0 0x7f4c540d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c5979e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4c540b7d70 con 0x7f4c540cfbf0 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c5979e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4c540b8610 con 0x7f4c540d5a40 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c5979e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c540d0b00 con 0x7f4c54162ae0 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c540cfbf0 0x7f4c540d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c540cfbf0 0x7f4c540d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41264/0 (socket says 172.21.15.66:41264) 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 -- 172.21.15.66:0/2062143232 learned_addr learned my addr 172.21.15.66:0/2062143232 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c4bfff640 1 --2- 172.21.15.66:0/2062143232 >> v2:172.21.15.190:3300/0 conn(0x7f4c540d5a40 0x7f4c540d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c53fff640 1 --2- 172.21.15.66:0/2062143232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 -- 172.21.15.66:0/2062143232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 msgr2=0x7f4c540d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 --2- 172.21.15.66:0/2062143232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 -- 172.21.15.66:0/2062143232 >> v2:172.21.15.190:3300/0 conn(0x7f4c540d5a40 msgr2=0x7f4c540d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:27.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 --2- 172.21.15.66:0/2062143232 >> v2:172.21.15.190:3300/0 conn(0x7f4c540d5a40 0x7f4c540d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.615+0000 7f4c58f9d640 1 -- 172.21.15.66:0/2062143232 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c540d22d0 con 0x7f4c540cfbf0 2024-05-10T11:22:27.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.616+0000 7f4c58f9d640 1 --2- 172.21.15.66:0/2062143232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540cfbf0 0x7f4c540d2e20 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4c54068b60 tx=0x7f4c4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6232f6bbf6fef1ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.616+0000 7f4c537fe640 1 -- 172.21.15.66:0/2062143232 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c036070 con 0x7f4c540cfbf0 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.616+0000 7f4c537fe640 1 -- 172.21.15.66:0/2062143232 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c031600 con 0x7f4c540cfbf0 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.616+0000 7f4c537fe640 1 -- 172.21.15.66:0/2062143232 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0319d0 con 0x7f4c540cfbf0 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 -- 172.21.15.66:0/2062143232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540cfbf0 msgr2=0x7f4c540d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 --2- 172.21.15.66:0/2062143232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540cfbf0 0x7f4c540d2e20 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4c54068b60 tx=0x7f4c4c02a6a0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 -- 172.21.15.66:0/2062143232 shutdown_connections 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 --2- 172.21.15.66:0/2062143232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540cfbf0 0x7f4c540d2e20 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 --2- 172.21.15.66:0/2062143232 >> v2:172.21.15.190:3300/0 conn(0x7f4c540d5a40 0x7f4c540d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 --2- 172.21.15.66:0/2062143232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 -- 172.21.15.66:0/2062143232 >> 172.21.15.66:0/2062143232 conn(0x7f4c540d4f20 msgr2=0x7f4c540d5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 -- 172.21.15.66:0/2062143232 shutdown_connections 2024-05-10T11:22:27.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.617+0000 7f4c5979e640 1 -- 172.21.15.66:0/2062143232 wait complete. 2024-05-10T11:22:27.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.618+0000 7f4c5979e640 1 Processor -- start 2024-05-10T11:22:27.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.618+0000 7f4c5979e640 1 -- start start 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c5979e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c540cfbf0 0x7f4c541554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c5979e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 0x7f4c5409ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c5979e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c5979e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540b82a0 con 0x7f4c540d5a40 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c5979e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540b7fc0 con 0x7f4c540cfbf0 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c5979e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c540d3360 con 0x7f4c54162ae0 2024-05-10T11:22:27.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 0x7f4c5409ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 0x7f4c5409ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41272/0 (socket says 172.21.15.66:41272) 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 -- 172.21.15.66:0/4210895869 learned_addr learned my addr 172.21.15.66:0/4210895869 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c53fff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c540cfbf0 0x7f4c541554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c58f9d640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 -- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 msgr2=0x7f4c540cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 -- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c540cfbf0 msgr2=0x7f4c541554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c540cfbf0 0x7f4c541554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c4bfff640 1 -- 172.21.15.66:0/4210895869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c540cc6f0 con 0x7f4c540d5a40 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.619+0000 7f4c53fff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c540cfbf0 0x7f4c541554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.620+0000 7f4c4bfff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 0x7f4c5409ed30 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00e860 tx=0x7f4c3c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.620+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c017070 con 0x7f4c540d5a40 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.620+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00c940 con 0x7f4c540d5a40 2024-05-10T11:22:27.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.620+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c540cc9d0 con 0x7f4c540d5a40 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.620+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00cd10 con 0x7f4c540d5a40 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.620+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c540cd860 con 0x7f4c540d5a40 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.621+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c54076680 con 0x7f4c540d5a40 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.622+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c3c01a070 con 0x7f4c540d5a40 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.622+0000 7f4c517fa640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c34076300 0x7f4c340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.622+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f4c3c097af0 con 0x7f4c540d5a40 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.622+0000 7f4c53fff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c34076300 0x7f4c340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:27.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.623+0000 7f4c53fff640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c34076300 0x7f4c340787c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e90 tx=0x7f4c44009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:27.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.626+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4c3c060d10 con 0x7f4c540d5a40 2024-05-10T11:22:27.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:27.862+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f4c540c8320 con 0x7f4c540d5a40 2024-05-10T11:22:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.784+0000 7f4c517fa640 1 -- 172.21.15.66:0/4210895869 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v108) ==== 162+0+0 (secure 0 0 0) 0x7f4c3c065010 con 0x7f4c540d5a40 2024-05-10T11:22:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T11:22:28.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c34076300 msgr2=0x7f4c340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:28.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c34076300 0x7f4c340787c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e90 tx=0x7f4c44009190 comp rx=0 tx=0).stop 2024-05-10T11:22:28.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 msgr2=0x7f4c5409ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:28.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 0x7f4c5409ed30 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00e860 tx=0x7f4c3c00ed20 comp rx=0 tx=0).stop 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 shutdown_connections 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c34076300 0x7f4c340787c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162ae0 0x7f4c540cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c540d5a40 0x7f4c5409ed30 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 --2- 172.21.15.66:0/4210895869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c540cfbf0 0x7f4c541554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 >> 172.21.15.66:0/4210895869 conn(0x7f4c540d4f20 msgr2=0x7f4c54161320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 shutdown_connections 2024-05-10T11:22:28.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.788+0000 7f4c5979e640 1 -- 172.21.15.66:0/4210895869 wait complete. 2024-05-10T11:22:28.803 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:28.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.915+0000 7f82322e1640 1 Processor -- start 2024-05-10T11:22:28.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.915+0000 7f82322e1640 1 -- start start 2024-05-10T11:22:28.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f82322e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:28.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f82322e1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f822c0d59d0 0x7f822c0d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:28.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f82322e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f822c0d2d20 con 0x7f822c0b47a0 2024-05-10T11:22:28.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f82322e1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f822c162d20 con 0x7f822c0d59d0 2024-05-10T11:22:28.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f82322e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f822c0d3000 con 0x7f822c162940 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f822c0d59d0 0x7f822c0d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f822c0d59d0 0x7f822c0d3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41276/0 (socket says 172.21.15.66:41276) 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 -- 172.21.15.66:0/1256987142 learned_addr learned my addr 172.21.15.66:0/1256987142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822bfff640 1 --2- 172.21.15.66:0/1256987142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 -- 172.21.15.66:0/1256987142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 msgr2=0x7f822c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 --2- 172.21.15.66:0/1256987142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 -- 172.21.15.66:0/1256987142 >> v1:172.21.15.190:6789/0 conn(0x7f822c0b47a0 legacy=0x7f822c162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.916+0000 7f822b7fe640 1 -- 172.21.15.66:0/1256987142 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c0d32e0 con 0x7f822c0d59d0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.917+0000 7f822b7fe640 1 --2- 172.21.15.66:0/1256987142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c0d3670 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f8220009870 tx=0x7f822002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de31cd5db67feb94 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.917+0000 7f822affd640 1 -- 172.21.15.66:0/1256987142 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220037070 con 0x7f822c0d59d0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.917+0000 7f822affd640 1 -- 172.21.15.66:0/1256987142 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8220032440 con 0x7f822c0d59d0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.917+0000 7f822affd640 1 -- 172.21.15.66:0/1256987142 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220032810 con 0x7f822c0d59d0 2024-05-10T11:22:28.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 -- 172.21.15.66:0/1256987142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 msgr2=0x7f822c0d3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 --2- 172.21.15.66:0/1256987142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c0d3670 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f8220009870 tx=0x7f822002a130 comp rx=0 tx=0).stop 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 -- 172.21.15.66:0/1256987142 shutdown_connections 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 --2- 172.21.15.66:0/1256987142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c0d3670 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 --2- 172.21.15.66:0/1256987142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 -- 172.21.15.66:0/1256987142 >> 172.21.15.66:0/1256987142 conn(0x7f822c09e380 msgr2=0x7f822c0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 -- 172.21.15.66:0/1256987142 shutdown_connections 2024-05-10T11:22:28.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.918+0000 7f82322e1640 1 -- 172.21.15.66:0/1256987142 wait complete. 2024-05-10T11:22:28.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.919+0000 7f82322e1640 1 Processor -- start 2024-05-10T11:22:28.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.919+0000 7f82322e1640 1 -- start start 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f82322e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f822c0b47a0 0x7f822c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f82322e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f82322e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f82322e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f822c0d2390 con 0x7f822c0d59d0 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f82322e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f822c0cfc50 con 0x7f822c0b47a0 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f82322e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f822c0d2510 con 0x7f822c162940 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c15ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41278/0 (socket says 172.21.15.66:41278) 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 -- 172.21.15.66:0/2489165524 learned_addr learned my addr 172.21.15.66:0/2489165524 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822bfff640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f822c0b47a0 0x7f822c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f823087e640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 -- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 msgr2=0x7f822c0d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:28.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 -- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f822c0b47a0 msgr2=0x7f822c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f822c0b47a0 0x7f822c0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.920+0000 7f822b7fe640 1 -- 172.21.15.66:0/2489165524 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c15f750 con 0x7f822c0d59d0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.921+0000 7f822b7fe640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c15ff50 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f822002a170 tx=0x7f82200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.921+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220037040 con 0x7f822c0d59d0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.921+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8220042070 con 0x7f822c0d59d0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.921+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c15f470 con 0x7f822c0d59d0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.921+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220030880 con 0x7f822c0d59d0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.921+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c0cc500 con 0x7f822c0d59d0 2024-05-10T11:22:28.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.922+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822c15a8e0 con 0x7f822c0d59d0 2024-05-10T11:22:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.923+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8220030a20 con 0x7f822c0d59d0 2024-05-10T11:22:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.923+0000 7f8228ff9640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8218076300 0x7f82180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.923+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f82200b7ed0 con 0x7f822c0d59d0 2024-05-10T11:22:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.923+0000 7f822bfff640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8218076300 0x7f82180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.924+0000 7f822bfff640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8218076300 0x7f82180787c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f821c009b40 tx=0x7f821c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:28.928+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f822c15a8e0 con 0x7f822c0d59d0 2024-05-10T11:22:29.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.155+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f822c0d2730 con 0x7f822c0d59d0 2024-05-10T11:22:29.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.156+0000 7f8228ff9640 1 -- 172.21.15.66:0/2489165524 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5188 (secure 0 0 0) 0x7f8220080fa0 con 0x7f822c0d59d0 2024-05-10T11:22:29.155 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:29.156 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:28.788120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:replay","state_seq":1,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T11:22:29.156 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 109 2024-05-10T11:22:29.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8218076300 msgr2=0x7f82180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:29.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8218076300 0x7f82180787c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f821c009b40 tx=0x7f821c009190 comp rx=0 tx=0).stop 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 msgr2=0x7f822c15ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c15ff50 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f822002a170 tx=0x7f82200046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 shutdown_connections 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f8218076300 0x7f82180787c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f822c162940 0x7f822c0d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822c0d59d0 0x7f822c15ff50 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 --2- 172.21.15.66:0/2489165524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f822c0b47a0 0x7f822c0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 >> 172.21.15.66:0/2489165524 conn(0x7f822c09e380 msgr2=0x7f822c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 shutdown_connections 2024-05-10T11:22:29.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:29.158+0000 7f82322e1640 1 -- 172.21.15.66:0/2489165524 wait complete. 2024-05-10T11:22:29.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:28.788120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7081}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7081': {'gid': 7081, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/3510752725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6833', 'nonce': 3510752725}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 3510752725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:22:29.572 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7081:up:replay 2024-05-10T11:22:30.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:30.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.691+0000 7fe8255af640 1 Processor -- start 2024-05-10T11:22:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.691+0000 7fe8255af640 1 -- start start 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8255af640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe82015f3b0 0x7fe8200d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8255af640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe82015f790 0x7fe8200d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8255af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe8200c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8255af640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe8200d30b0 con 0x7fe82015f790 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8255af640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe8200d3390 con 0x7fe82015f3b0 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8255af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8200c8c80 con 0x7fe8200d5d30 2024-05-10T11:22:30.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe82015f790 0x7fe8200d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe82015f790 0x7fe8200d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41280/0 (socket says 172.21.15.66:41280) 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 -- 172.21.15.66:0/2860824397 learned_addr learned my addr 172.21.15.66:0/2860824397 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe81f7fe640 1 --2- 172.21.15.66:0/2860824397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe8200c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe81effd640 1 --2- 172.21.15.66:0/2860824397 >> v2:172.21.15.190:3300/0 conn(0x7fe82015f3b0 0x7fe8200d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 -- 172.21.15.66:0/2860824397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 msgr2=0x7fe8200c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 --2- 172.21.15.66:0/2860824397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe8200c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 -- 172.21.15.66:0/2860824397 >> v2:172.21.15.190:3300/0 conn(0x7fe82015f3b0 msgr2=0x7fe8200d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 --2- 172.21.15.66:0/2860824397 >> v2:172.21.15.190:3300/0 conn(0x7fe82015f3b0 0x7fe8200d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.692+0000 7fe8167fc640 1 -- 172.21.15.66:0/2860824397 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8200c8f60 con 0x7fe82015f790 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.693+0000 7fe8167fc640 1 --2- 172.21.15.66:0/2860824397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe82015f790 0x7fe8200d3c30 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fe82008e820 tx=0x7fe80802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13f6ee0121665ef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:30.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.693+0000 7fe81e7fc640 1 -- 172.21.15.66:0/2860824397 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808037070 con 0x7fe82015f790 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.693+0000 7fe81e7fc640 1 -- 172.21.15.66:0/2860824397 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808032440 con 0x7fe82015f790 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.693+0000 7fe81e7fc640 1 -- 172.21.15.66:0/2860824397 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808032810 con 0x7fe82015f790 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 -- 172.21.15.66:0/2860824397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe82015f790 msgr2=0x7fe8200d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 --2- 172.21.15.66:0/2860824397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe82015f790 0x7fe8200d3c30 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fe82008e820 tx=0x7fe80802a1e0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 -- 172.21.15.66:0/2860824397 shutdown_connections 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 --2- 172.21.15.66:0/2860824397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe8200c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 --2- 172.21.15.66:0/2860824397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe82015f790 0x7fe8200d3c30 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 --2- 172.21.15.66:0/2860824397 >> v2:172.21.15.190:3300/0 conn(0x7fe82015f3b0 0x7fe8200d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 -- 172.21.15.66:0/2860824397 >> 172.21.15.66:0/2860824397 conn(0x7fe8200d5130 msgr2=0x7fe8200d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 -- 172.21.15.66:0/2860824397 shutdown_connections 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.694+0000 7fe8255af640 1 -- 172.21.15.66:0/2860824397 wait complete. 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.695+0000 7fe8255af640 1 Processor -- start 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.695+0000 7fe8255af640 1 -- start start 2024-05-10T11:22:30.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8255af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe82015e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8255af640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe82015f3b0 0x7fe8200b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8255af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 0x7fe8200a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8255af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8200c9e20 con 0x7fe8200b94a0 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8255af640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8200c9ca0 con 0x7fe82015f3b0 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8255af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8200c9fa0 con 0x7fe8200d5d30 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 0x7fe8200a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 0x7fe8200a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41290/0 (socket says 172.21.15.66:41290) 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe81f7fe640 1 -- 172.21.15.66:0/3661383861 learned_addr learned my addr 172.21.15.66:0/3661383861 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe81effd640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe82015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.696+0000 7fe8167fc640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe82015f3b0 0x7fe8200b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe81f7fe640 1 -- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 msgr2=0x7fe82015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:30.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe81f7fe640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe82015e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe81f7fe640 1 -- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe82015f3b0 msgr2=0x7fe8200b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe81f7fe640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe82015f3b0 0x7fe8200b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe81f7fe640 1 -- 172.21.15.66:0/3661383861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201f9070 con 0x7fe8200b94a0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe81f7fe640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 0x7fe8200a2460 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fe818007e90 tx=0x7fe81800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818014420 con 0x7fe8200b94a0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe818019070 con 0x7fe8200b94a0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8200a16a0 con 0x7fe8200b94a0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818014820 con 0x7fe8200b94a0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.697+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8200a1c60 con 0x7fe8200b94a0 2024-05-10T11:22:30.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.698+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82006a220 con 0x7fe8200b94a0 2024-05-10T11:22:30.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.699+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8180149c0 con 0x7fe8200b94a0 2024-05-10T11:22:30.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.699+0000 7fe817fff640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8000762d0 0x7fe800078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:30.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.699+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fe818097ed0 con 0x7fe8200b94a0 2024-05-10T11:22:30.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.700+0000 7fe81effd640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8000762d0 0x7fe800078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:30.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.700+0000 7fe81effd640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8000762d0 0x7fe800078790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe810006fd0 tx=0x7fe810008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:30.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.704+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe818061030 con 0x7fe8200b94a0 2024-05-10T11:22:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.943+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe820075990 con 0x7fe8200b94a0 2024-05-10T11:22:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.943+0000 7fe817fff640 1 -- 172.21.15.66:0/3661383861 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+5188 (secure 0 0 0) 0x7fe818065330 con 0x7fe8200b94a0 2024-05-10T11:22:30.943 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:30.943 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:29.801810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T11:22:30.943 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 111 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.945+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8000762d0 msgr2=0x7fe800078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.945+0000 7fe8255af640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8000762d0 0x7fe800078790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe810006fd0 tx=0x7fe810008040 comp rx=0 tx=0).stop 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 msgr2=0x7fe8200a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 0x7fe8200a2460 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fe818007e90 tx=0x7fe81800e4b0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 shutdown_connections 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe8000762d0 0x7fe800078790 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8200b94a0 0x7fe8200a2460 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe82015f3b0 0x7fe8200b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 --2- 172.21.15.66:0/3661383861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8200d5d30 0x7fe82015e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 >> 172.21.15.66:0/3661383861 conn(0x7fe8200d5130 msgr2=0x7fe8200d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 shutdown_connections 2024-05-10T11:22:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:30.946+0000 7fe8255af640 1 -- 172.21.15.66:0/3661383861 wait complete. 2024-05-10T11:22:31.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:29.801810+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7081}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7081': {'gid': 7081, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:rejoin', 'state_seq': 9, 'addr': '172.21.15.66:6835/3510752725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6833', 'nonce': 3510752725}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 3510752725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T11:22:31.359 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7081:up:rejoin 2024-05-10T11:22:32.340 INFO:tasks.ceph.mds.c.smithi066.stderr:2024-05-10T11:22:32.340+0000 7f60cd8e2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:22:32.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:32.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.477+0000 7fda4332b640 1 Processor -- start 2024-05-10T11:22:32.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.477+0000 7fda4332b640 1 -- start start 2024-05-10T11:22:32.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda4332b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:32.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda4332b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fda3c0d0230 0x7fda3c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:32.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda4332b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda3c15fc90 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda4332b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fda3c06ee50 con 0x7fda3c0d0230 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda4332b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c0b8c40 con 0x7fda3c0b8860 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda408c6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fda3c0d0230 0x7fda3c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda418c8640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fda3c0cfbb0 0x7fda3c0d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52636/0 (socket says 172.21.15.66:52636) 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda418c8640 1 -- 172.21.15.66:0/2495463478 learned_addr learned my addr 172.21.15.66:0/2495463478 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda410c7640 1 --2- 172.21.15.66:0/2495463478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda408c6640 1 -- 172.21.15.66:0/2495463478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 msgr2=0x7fda3c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda408c6640 1 --2- 172.21.15.66:0/2495463478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda408c6640 1 -- 172.21.15.66:0/2495463478 >> v1:172.21.15.66:6789/0 conn(0x7fda3c0cfbb0 legacy=0x7fda3c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda2ffff640 1 -- 172.21.15.66:0/2495463478 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205815090 0 0) 0x7fda3c15fc90 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.478+0000 7fda408c6640 1 -- 172.21.15.66:0/2495463478 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c0cd570 con 0x7fda3c0d0230 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.479+0000 7fda408c6640 1 --2- 172.21.15.66:0/2495463478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0d0230 0x7fda3c0cf670 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fda380097a0 tx=0x7fda3802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b299c2504ee5ecc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.479+0000 7fda2ffff640 1 -- 172.21.15.66:0/2495463478 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38037070 con 0x7fda3c0d0230 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.479+0000 7fda2ffff640 1 -- 172.21.15.66:0/2495463478 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3802ae50 con 0x7fda3c0d0230 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.479+0000 7fda2ffff640 1 -- 172.21.15.66:0/2495463478 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38032660 con 0x7fda3c0d0230 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 -- 172.21.15.66:0/2495463478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0d0230 msgr2=0x7fda3c0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 --2- 172.21.15.66:0/2495463478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0d0230 0x7fda3c0cf670 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fda380097a0 tx=0x7fda3802a100 comp rx=0 tx=0).stop 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 -- 172.21.15.66:0/2495463478 shutdown_connections 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 --2- 172.21.15.66:0/2495463478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0d0230 0x7fda3c0cf670 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 --2- 172.21.15.66:0/2495463478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 -- 172.21.15.66:0/2495463478 >> 172.21.15.66:0/2495463478 conn(0x7fda3c0d2df0 msgr2=0x7fda3c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 -- 172.21.15.66:0/2495463478 shutdown_connections 2024-05-10T11:22:32.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.480+0000 7fda4332b640 1 -- 172.21.15.66:0/2495463478 wait complete. 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.481+0000 7fda4332b640 1 Processor -- start 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.481+0000 7fda4332b640 1 -- start start 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda4332b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c1f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda4332b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 0x7fda3c0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda4332b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda3c0d0230 0x7fda3c1f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda4332b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0cde10 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda4332b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0cdb30 con 0x7fda3c0d0230 2024-05-10T11:22:32.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda4332b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c06ea60 con 0x7fda3c0b8860 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 0x7fda3c0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 0x7fda3c0cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41320/0 (socket says 172.21.15.66:41320) 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 -- 172.21.15.66:0/3836471549 learned_addr learned my addr 172.21.15.66:0/3836471549 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda410c7640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c1f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda418c8640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda3c0d0230 0x7fda3c1f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 -- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 msgr2=0x7fda3c1f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c1f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 -- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda3c0d0230 msgr2=0x7fda3c1f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda3c0d0230 0x7fda3c1f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda408c6640 1 -- 172.21.15.66:0/3836471549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c0cac40 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda410c7640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c1f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.482+0000 7fda418c8640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda3c0d0230 0x7fda3c1f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.483+0000 7fda408c6640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 0x7fda3c0cbef0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fda380097a0 tx=0x7fda380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.483+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38037040 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.483+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda38004030 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.483+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38006e10 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.483+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c0caf20 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.483+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c0cb4e0 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.484+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c1f6180 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.485+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda3803d650 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.485+0000 7fda2dffb640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda200762d0 0x7fda20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.485+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fda380b8000 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.485+0000 7fda410c7640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda200762d0 0x7fda20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.486+0000 7fda410c7640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda200762d0 0x7fda20078790 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:32.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.490+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fda3c1f6180 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.718+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda3c0a09b0 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.718+0000 7fda2dffb640 1 -- 172.21.15.66:0/3836471549 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5196 (secure 0 0 0) 0x7fda38042020 con 0x7fda3c0cfbb0 2024-05-10T11:22:32.719 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:32.719 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":112,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:31.802073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7081,"qdb_cluster":[7081]},"id":8}]} 2024-05-10T11:22:32.719 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 112 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda200762d0 msgr2=0x7fda20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda200762d0 0x7fda20078790 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).stop 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 msgr2=0x7fda3c0cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 0x7fda3c0cbef0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fda380097a0 tx=0x7fda380046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 shutdown_connections 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fda200762d0 0x7fda20078790 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda3c0d0230 0x7fda3c1f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c0cfbb0 0x7fda3c0cbef0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 --2- 172.21.15.66:0/3836471549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda3c0b8860 0x7fda3c1f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:32.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 >> 172.21.15.66:0/3836471549 conn(0x7fda3c0d2df0 msgr2=0x7fda3c070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:32.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 shutdown_connections 2024-05-10T11:22:32.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:32.720+0000 7fda4332b640 1 -- 172.21.15.66:0/3836471549 wait complete. 2024-05-10T11:22:33.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T11:22:05.730950+0000', 'modified': '2024-05-10T11:22:31.802073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7081}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7081': {'gid': 7081, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.66:6835/3510752725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6833', 'nonce': 3510752725}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 3510752725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7081, 'qdb_cluster': [7081]} 2024-05-10T11:22:33.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T11:22:33.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T11:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.247+0000 7f47e85af640 1 Processor -- start 2024-05-10T11:22:33.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.247+0000 7f47e85af640 1 -- start start 2024-05-10T11:22:33.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.248+0000 7f47e85af640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 0x7f47e00d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.248+0000 7f47e85af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e00d5cb0 0x7f47e00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.248+0000 7f47e85af640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e00b45f0 con 0x7f47e0162b30 2024-05-10T11:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.248+0000 7f47e85af640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f47e00b4f20 con 0x7f47e0162750 2024-05-10T11:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.248+0000 7f47e85af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f47e00d0fe0 con 0x7f47e00d5cb0 2024-05-10T11:22:33.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e634b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 0x7f47e00d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e5b4a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e00d5cb0 0x7f47e00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e634b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 0x7f47e00d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:45714/0 (socket says 172.21.15.66:45714) 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e634b640 1 -- 172.21.15.66:0/1782824997 learned_addr learned my addr 172.21.15.66:0/1782824997 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e6b4c640 1 --1- 172.21.15.66:0/1782824997 >> v1:172.21.15.190:6789/0 conn(0x7f47e0162b30 0x7f47e00d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:38908/0 (socket says 172.21.15.66:38908) 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1782824997 >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 msgr2=0x7f47e00d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1782824997 >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 0x7f47e00d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1782824997 >> v1:172.21.15.190:6789/0 conn(0x7f47e0162b30 legacy=0x7f47e00d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e5349640 1 -- 172.21.15.66:0/1782824997 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949420828 0 0) 0x7f47e00b45f0 con 0x7f47e0162b30 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1782824997 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e00b48d0 con 0x7f47e00d5cb0 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.249+0000 7f47e634b640 1 --2- 172.21.15.66:0/1782824997 >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 0x7f47e00d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.250+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1782824997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e00d5cb0 0x7f47e00d3630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47d00097a0 tx=0x7f47d002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68666b6a1693fdf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.250+0000 7f47e5349640 1 -- 172.21.15.66:0/1782824997 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0037070 con 0x7f47e00d5cb0 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.250+0000 7f47e5349640 1 -- 172.21.15.66:0/1782824997 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d002ae50 con 0x7f47e00d5cb0 2024-05-10T11:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.250+0000 7f47e5349640 1 -- 172.21.15.66:0/1782824997 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0032660 con 0x7f47e00d5cb0 2024-05-10T11:22:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 -- 172.21.15.66:0/1782824997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e00d5cb0 msgr2=0x7f47e00d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 --2- 172.21.15.66:0/1782824997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e00d5cb0 0x7f47e00d3630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47d00097a0 tx=0x7f47d002a100 comp rx=0 tx=0).stop 2024-05-10T11:22:33.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 -- 172.21.15.66:0/1782824997 shutdown_connections 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 --2- 172.21.15.66:0/1782824997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e00d5cb0 0x7f47e00d3630 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 --2- 172.21.15.66:0/1782824997 >> v2:172.21.15.190:3300/0 conn(0x7f47e0162750 0x7f47e00d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 -- 172.21.15.66:0/1782824997 >> 172.21.15.66:0/1782824997 conn(0x7f47e009e3b0 msgr2=0x7f47e00d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 -- 172.21.15.66:0/1782824997 shutdown_connections 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.251+0000 7f47e85af640 1 -- 172.21.15.66:0/1782824997 wait complete. 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.252+0000 7f47e85af640 1 Processor -- start 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.252+0000 7f47e85af640 1 -- start start 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 0x7f47e015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e0162b30 0x7f47e0155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e0156110 0x7f47e00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47e00d0d30 con 0x7f47e0162750 2024-05-10T11:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f47e00d0bb0 con 0x7f47e0156110 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f47e00b63c0 con 0x7f47e0162b30 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 0x7f47e015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 0x7f47e015fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41326/0 (socket says 172.21.15.66:41326) 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 -- 172.21.15.66:0/1809785769 learned_addr learned my addr 172.21.15.66:0/1809785769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e0156110 0x7f47e00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e0162b30 0x7f47e0155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 -- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e0162b30 msgr2=0x7f47e0155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e0162b30 0x7f47e0155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 -- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e0156110 msgr2=0x7f47e00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e0156110 0x7f47e00b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 -- 172.21.15.66:0/1809785769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e00b2760 con 0x7f47e0162750 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e0162b30 0x7f47e0155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e634b640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 0x7f47e015fee0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00efc0 tx=0x7f47dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47d6ffd640 1 -- 172.21.15.66:0/1809785769 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc014480 con 0x7f47e0162750 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47d6ffd640 1 -- 172.21.15.66:0/1809785769 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc019070 con 0x7f47e0162750 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.253+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e00b2a40 con 0x7f47e0162750 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.254+0000 7f47d6ffd640 1 -- 172.21.15.66:0/1809785769 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc014820 con 0x7f47e0162750 2024-05-10T11:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.254+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e00b7ce0 con 0x7f47e0162750 2024-05-10T11:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.255+0000 7f47d6ffd640 1 -- 172.21.15.66:0/1809785769 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47dc005d10 con 0x7f47e0162750 2024-05-10T11:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.256+0000 7f47d6ffd640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f47c40762d0 0x7f47c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.256+0000 7f47d6ffd640 1 -- 172.21.15.66:0/1809785769 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f47dc097dc0 con 0x7f47e0162750 2024-05-10T11:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.256+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f47c40762d0 0x7f47c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.257+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f47c40762d0 0x7f47c4078790 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f47d0034000 tx=0x7f47d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.257+0000 7f47eb3a4740 1 Processor -- start 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.257+0000 7f47eb3a4740 1 -- start start 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8e85760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8e85ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e55bb0 0x564dd8e593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564dd8dbf8d0 con 0x564dd8e83330 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564dd8d78c10 con 0x564dd8e55bb0 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564dd8dbb890 con 0x564dd8e82f50 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8e85ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8e85ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41338/0 (socket says 172.21.15.66:41338) 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1038591501 learned_addr learned my addr 172.21.15.66:0/1038591501 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e55bb0 0x564dd8e593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e634b640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8e85760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 msgr2=0x564dd8e85760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8e85760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e55bb0 msgr2=0x564dd8e593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e55bb0 0x564dd8e593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1038591501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd8d805d0 con 0x564dd8e83330 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e634b640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8e85760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.258+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e55bb0 0x564dd8e593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8e85ca0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f47d002a140 tx=0x7f47d002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e550801a7c0e2a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47c3fff640 1 -- 172.21.15.66:0/1038591501 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0037040 con 0x564dd8e83330 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47c3fff640 1 -- 172.21.15.66:0/1038591501 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d004d070 con 0x564dd8e83330 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47c3fff640 1 -- 172.21.15.66:0/1038591501 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d003d670 con 0x564dd8e83330 2024-05-10T11:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1038591501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 msgr2=0x564dd8e85ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8e85ca0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f47d002a140 tx=0x7f47d002c000 comp rx=0 tx=0).stop 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1038591501 shutdown_connections 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e55bb0 0x564dd8e593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8e85ca0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1038591501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8e85760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.259+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1038591501 >> 172.21.15.66:0/1038591501 conn(0x564dd8e57e20 msgr2=0x564dd8ea0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.260+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1038591501 shutdown_connections 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.260+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1038591501 wait complete. 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.260+0000 7f47eb3a4740 1 -- start start 2024-05-10T11:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.260+0000 7f47eb3a4740 1 Processor -- start 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8ea6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8ea8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e86ca0 0x564dd8e82440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564dd8e5afd0 con 0x564dd8e83330 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564dd8d7c760 con 0x564dd8e86ca0 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564dd8e5b2b0 con 0x564dd8e82f50 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47eb3a4740 10 client.0 _ll_register_callbacks cb 0x564dd8db5cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8ea8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8ea8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41348/0 (socket says 172.21.15.66:41348) 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1020725208 learned_addr learned my addr 172.21.15.66:0/1020725208 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e634b640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8ea6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e86ca0 0x564dd8e82440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 msgr2=0x564dd8ea6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8ea6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e86ca0 msgr2=0x564dd8e82440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e86ca0 0x564dd8e82440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.261+0000 7f47e5b4a640 1 -- 172.21.15.66:0/1020725208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd8ad12d0 con 0x564dd8e83330 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8ea8940 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f47d00098c0 tx=0x7f47d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb2a463f3c40941 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47c17fa640 1 -- 172.21.15.66:0/1020725208 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0058070 con 0x564dd8e83330 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47c17fa640 1 -- 172.21.15.66:0/1020725208 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f47d0051620 con 0x564dd8e83330 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d004d070 con 0x564dd8e83330 2024-05-10T11:22:33.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47c17fa640 1 -- 172.21.15.66:0/1020725208 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f47d0063050 con 0x564dd8e83330 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 10 client.8649 fetch_fsmap learned FSMap version 112 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x564dd8b9b6b0 con 0x564dd8e83330 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47c17fa640 1 -- 172.21.15.66:0/1020725208 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d004d070 con 0x564dd8e83330 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47c17fa640 1 -- 172.21.15.66:0/1020725208 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 112) ==== 3494+0+0 (secure 0 0 0) 0x7f47d0066020 con 0x564dd8e83330 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 10 client.8649 fetch_fsmap finished waiting for FSMap version 112 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 10 client.8649 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 20 client.8649 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e87a50 0x564dd8ebe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 4 client.8649 mds_command: new command op to 7081 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 --> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dd8d43760 con 0x564dd8e87a50 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.262+0000 7f47e634b640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e87a50 0x564dd8ebe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.263+0000 7f47c17fa640 10 client.8649 ms_handle_connect on v2:172.21.15.66:6833/3510752725 2024-05-10T11:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.263+0000 7f47e634b640 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e87a50 0x564dd8ebe940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605f9c59c8a6a978 server_cookie=91fd82beed31e981 in_seq=0 out_seq=0 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.263+0000 7f47c17fa640 1 -- 172.21.15.66:0/1020725208 <== mds.0 v2:172.21.15.66:6833/3510752725 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564dd8d43760 con 0x564dd8e87a50 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.263+0000 7f47c17fa640 10 client.8649 handle_command_reply: tid=0 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.263+0000 7f47eb3a4740 1 client.8649 shutdown 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 msgr2=0x564dd8ea8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8ea8940 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f47d00098c0 tx=0x7f47d0004730 comp rx=0 tx=0).stop 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 shutdown_connections 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e86ca0 0x564dd8e82440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e87a50 0x564dd8ebe940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e83330 0x564dd8ea8940 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1020725208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e82f50 0x564dd8ea6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47c17fa640 0 client.8649 ms_handle_reset on v2:172.21.15.66:6833/3510752725 2024-05-10T11:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 >> 172.21.15.66:0/1020725208 conn(0x564dd8e55bb0 msgr2=0x564dd8e85720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 shutdown_connections 2024-05-10T11:22:33.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1020725208 wait complete. 2024-05-10T11:22:33.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.264+0000 7f47eb3a4740 20 client.8649 trim_cache size 0 max 16384 2024-05-10T11:22:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 Processor -- start 2024-05-10T11:22:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 -- start start 2024-05-10T11:22:33.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 0x564dd8ea2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e83330 0x564dd8f1dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47e0201d30 con 0x564dd8e82f50 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f47e01f8a30 con 0x564dd8e83330 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.283+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f47e01f4ee0 con 0x564dd8e86ca0 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 0x564dd8ea2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 0x564dd8ea2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41354/0 (socket says 172.21.15.66:41354) 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 -- 172.21.15.66:0/707279060 learned_addr learned my addr 172.21.15.66:0/707279060 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 -- 172.21.15.66:0/707279060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e86ca0 msgr2=0x564dd8e81400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 -- 172.21.15.66:0/707279060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e83330 msgr2=0x564dd8f1dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e83330 0x564dd8f1dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 -- 172.21.15.66:0/707279060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd8e9d790 con 0x564dd8e82f50 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47e634b640 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 0x564dd8ea2a30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f47dc05e030 tx=0x7f47dc01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851a9344930cf360 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47c37fe640 1 -- 172.21.15.66:0/707279060 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc07e070 con 0x564dd8e82f50 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47c37fe640 1 -- 172.21.15.66:0/707279060 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc077030 con 0x564dd8e82f50 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.284+0000 7f47c37fe640 1 -- 172.21.15.66:0/707279060 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0608d0 con 0x564dd8e82f50 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 -- 172.21.15.66:0/707279060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 msgr2=0x564dd8ea2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 0x564dd8ea2a30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f47dc05e030 tx=0x7f47dc01f040 comp rx=0 tx=0).stop 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 -- 172.21.15.66:0/707279060 shutdown_connections 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e83330 0x564dd8f1dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/707279060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e82f50 0x564dd8ea2a30 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 -- 172.21.15.66:0/707279060 >> 172.21.15.66:0/707279060 conn(0x564dd8e55bb0 msgr2=0x564dd8ea60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 -- 172.21.15.66:0/707279060 shutdown_connections 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 -- 172.21.15.66:0/707279060 wait complete. 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 -- start start 2024-05-10T11:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.285+0000 7f47eb3a4740 1 Processor -- start 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e82f50 0x564dd8eb9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e83330 0x564dd8e56840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564dd8e878d0 con 0x564dd8e86ca0 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564dd8ea38b0 con 0x564dd8e82f50 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564dd8e87f20 con 0x564dd8e83330 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47eb3a4740 10 client.0 _ll_register_callbacks cb 0x7f47dc0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47e6b4c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47e6b4c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41370/0 (socket says 172.21.15.66:41370) 2024-05-10T11:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.286+0000 7f47e6b4c640 1 -- 172.21.15.66:0/1554483927 learned_addr learned my addr 172.21.15.66:0/1554483927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e5b4a640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e83330 0x564dd8e56840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e6b4c640 1 -- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e83330 msgr2=0x564dd8e56840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e83330 0x564dd8e56840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e634b640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e82f50 0x564dd8eb9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e6b4c640 1 -- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e82f50 msgr2=0x564dd8eb9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e82f50 0x564dd8eb9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e6b4c640 1 -- 172.21.15.66:0/1554483927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd8e593c0 con 0x564dd8e86ca0 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e634b640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e82f50 0x564dd8eb9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47e6b4c640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 0x564dd8e81400 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f47d8005b30 tx=0x7f47d80132d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dc142bedf20c86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47c17fa640 1 -- 172.21.15.66:0/1554483927 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d801a070 con 0x564dd8e86ca0 2024-05-10T11:22:33.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47c17fa640 1 -- 172.21.15.66:0/1554483927 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f47d8013d50 con 0x564dd8e86ca0 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47dc077030 con 0x564dd8e86ca0 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47c17fa640 1 -- 172.21.15.66:0/1554483927 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f47d8025050 con 0x564dd8e86ca0 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47eb3a4740 10 client.8655 fetch_fsmap learned FSMap version 112 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x564dd8eb32c0 con 0x564dd8e86ca0 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47c17fa640 1 -- 172.21.15.66:0/1554483927 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc077030 con 0x564dd8e86ca0 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47c17fa640 1 -- 172.21.15.66:0/1554483927 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 112) ==== 3494+0+0 (secure 0 0 0) 0x7f47d8028020 con 0x564dd8e86ca0 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.287+0000 7f47eb3a4740 10 client.8655 fetch_fsmap finished waiting for FSMap version 112 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 10 client.8655 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 20 client.8655 populate_metadata read hostname 'smithi066' 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e9f6d0 0x564dd8ea0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 4 client.8655 mds_command: new command op to 7081 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T11:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 --> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] -- command(tid 0: {"prefix": "status"}) -- 0x564dd8dcd4e0 con 0x564dd8e9f6d0 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47e634b640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e9f6d0 0x564dd8ea0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47c17fa640 10 client.8655 ms_handle_connect on v2:172.21.15.66:6833/3510752725 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47e634b640 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e9f6d0 0x564dd8ea0760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8626399a5718a7 server_cookie=eb17a47f0e064cfe in_seq=0 out_seq=0 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47c17fa640 1 -- 172.21.15.66:0/1554483927 <== mds.0 v2:172.21.15.66:6833/3510752725 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x564dd8dcd4e0 con 0x564dd8e9f6d0 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47c17fa640 10 client.8655 handle_command_reply: tid=0 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 client.8655 shutdown 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 msgr2=0x564dd8e81400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 0x564dd8e81400 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f47d8005b30 tx=0x7f47d80132d0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 shutdown_connections 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:6833/3510752725,v1:172.21.15.66:6835/3510752725] conn(0x564dd8e9f6d0 0x564dd8ea0760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564dd8e86ca0 0x564dd8e81400 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564dd8e83330 0x564dd8e56840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 --2- 172.21.15.66:0/1554483927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564dd8e82f50 0x564dd8eb9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 >> 172.21.15.66:0/1554483927 conn(0x564dd8e55bb0 msgr2=0x564dd8ea85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.288+0000 7f47c17fa640 0 client.8655 ms_handle_reset on v2:172.21.15.66:6833/3510752725 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 shutdown_connections 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47eb3a4740 1 -- 172.21.15.66:0/1554483927 wait complete. 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47eb3a4740 20 client.8655 trim_cache size 0 max 16384 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "62c58463-bf48-494c-be0a-3a4b427ce317", 2024-05-10T11:22:33.296 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 7081, 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 4.4957999539999998, 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 112, 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 120, 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 120, 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 31.906225628000001 2024-05-10T11:22:33.297 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f47c40762d0 msgr2=0x7f47c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f47c40762d0 0x7f47c4078790 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f47d0034000 tx=0x7f47d002e000 comp rx=0 tx=0).stop 2024-05-10T11:22:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 msgr2=0x7f47e015fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 0x7f47e015fee0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00efc0 tx=0x7f47dc00c490 comp rx=0 tx=0).stop 2024-05-10T11:22:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 shutdown_connections 2024-05-10T11:22:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f47c40762d0 0x7f47c4078790 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e0156110 0x7f47e00b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e0162b30 0x7f47e0155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 --2- 172.21.15.66:0/1809785769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0162750 0x7f47e015fee0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 >> 172.21.15.66:0/1809785769 conn(0x7f47e009e3b0 msgr2=0x7f47e01ea860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 shutdown_connections 2024-05-10T11:22:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.289+0000 7f47e85af640 1 -- 172.21.15.66:0/1809785769 wait complete. 2024-05-10T11:22:33.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.404+0000 7fae8061c640 1 Processor -- start 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.404+0000 7fae8061c640 1 -- start start 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae8061c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 0x7fae7806e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae8061c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7815fc90 con 0x7fae780cfd80 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae8061c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780b8c40 con 0x7fae780d0230 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae8061c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fae7806ee50 con 0x7fae780b8860 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7ebb9640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fae780cfd80 0x7fae780ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:52650/0 (socket says 172.21.15.66:52650) 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7ebb9640 1 -- 172.21.15.66:0/418355243 learned_addr learned my addr 172.21.15.66:0/418355243 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7e3b8640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 0x7fae7806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454564545 0 0) 0x7fae7815fc90 con 0x7fae780cfd80 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae64003520 con 0x7fae780cfd80 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1990553760 0 0) 0x7fae64003520 con 0x7fae780cfd80 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 msgr2=0x7fae7806e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 0x7fae7806e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 >> v1:172.21.15.190:6789/0 conn(0x7fae780d0230 legacy=0x7fae780cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780cd570 con 0x7fae780cfd80 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fae700019f0 con 0x7fae780cfd80 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 >> v1:172.21.15.66:6789/0 conn(0x7fae780cfd80 legacy=0x7fae780ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.405+0000 7fae7d3b6640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae640039e0 0x7fae64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7d3b6640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 0x7fae64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7d3b6640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae7806ee50 con 0x7fae64004d40 2024-05-10T11:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fae6400baa0 con 0x7fae640039e0 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fae6400bca0 con 0x7fae780b8860 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7ebb9640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7e3b8640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae640039e0 0x7fae64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7dbb7640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 0x7fae64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7ebb9640 1 -- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 msgr2=0x7fae64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7ebb9640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae780b8860 0x7fae64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7ebb9640 1 -- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae640039e0 msgr2=0x7fae64003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7ebb9640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae640039e0 0x7fae64003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.406+0000 7fae7ebb9640 1 -- 172.21.15.66:0/418355243 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae64003520 con 0x7fae64004d40 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae7ebb9640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae640051c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fae780737b0 tx=0x7fae64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960f2dfb2536bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7000a3f0 con 0x7fae64004d40 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7002f070 con 0x7fae64004d40 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae7d3b6640 1 -- 172.21.15.66:0/418355243 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7002bbe0 con 0x7fae64004d40 2024-05-10T11:22:33.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae8061c640 1 -- 172.21.15.66:0/418355243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 msgr2=0x7fae640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae8061c640 1 --2- 172.21.15.66:0/418355243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae640051c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fae780737b0 tx=0x7fae64005830 comp rx=0 tx=0).stop 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae7ebb9640 1 -- 172.21.15.66:0/418355243 reap_dead start 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae8061c640 1 -- 172.21.15.66:0/418355243 shutdown_connections 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae8061c640 1 -- 172.21.15.66:0/418355243 >> 172.21.15.66:0/418355243 conn(0x7fae780d2df0 msgr2=0x7fae780d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.407+0000 7fae8061c640 1 -- 172.21.15.66:0/418355243 shutdown_connections 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.408+0000 7fae8061c640 1 -- 172.21.15.66:0/418355243 wait complete. 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 Processor -- start 2024-05-10T11:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 -- start start 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae78149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae7815e3a0 0x7fae781f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae7815e820 0x7fae781f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae780cde10 con 0x7fae64004d40 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fae780cdb30 con 0x7fae7815e3a0 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.409+0000 7fae8061c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fae780b5c40 con 0x7fae7815e820 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae78149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae78149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41396/0 (socket says 172.21.15.66:41396) 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 -- 172.21.15.66:0/3008559764 learned_addr learned my addr 172.21.15.66:0/3008559764 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 -- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae7815e820 msgr2=0x7fae781f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae7815e820 0x7fae781f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 -- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae7815e3a0 msgr2=0x7fae781f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae7815e3a0 0x7fae781f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 -- 172.21.15.66:0/3008559764 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae781506e0 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae7e3b8640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae78149b80 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fae740119d0 tx=0x7fae74011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7400fad0 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7400fc70 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74014440 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae781f4d00 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.410+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae781f9280 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.411+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7815dfe0 con 0x7fae64004d40 2024-05-10T11:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.412+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae74012040 con 0x7fae64004d40 2024-05-10T11:22:33.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.412+0000 7fae6effd640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae5c0762d0 0x7fae5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:33.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.413+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fae74097dc0 con 0x7fae64004d40 2024-05-10T11:22:33.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.413+0000 7fae7dbb7640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae5c0762d0 0x7fae5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:33.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.413+0000 7fae7dbb7640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae5c0762d0 0x7fae5c078790 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fae780b7b50 tx=0x7fae68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:33.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.417+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fae74019030 con 0x7fae64004d40 2024-05-10T11:22:33.427 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:22:33.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:22:33.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.647+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fae7806a220 con 0x7fae64004d40 2024-05-10T11:22:33.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.647+0000 7fae6effd640 1 -- 172.21.15.66:0/3008559764 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) ==== 53+0+73 (secure 0 0 0) 0x7fae74061570 con 0x7fae64004d40 2024-05-10T11:22:33.647 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T11:22:33.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae5c0762d0 msgr2=0x7fae5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae5c0762d0 0x7fae5c078790 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fae780b7b50 tx=0x7fae68009040 comp rx=0 tx=0).stop 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 msgr2=0x7fae78149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae78149b80 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fae740119d0 tx=0x7fae74011e90 comp rx=0 tx=0).stop 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 shutdown_connections 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fae5c0762d0 0x7fae5c078790 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae7815e820 0x7fae781f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae7815e3a0 0x7fae781f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 --2- 172.21.15.66:0/3008559764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae64004d40 0x7fae78149b80 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 >> 172.21.15.66:0/3008559764 conn(0x7fae780d2df0 msgr2=0x7fae78070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 shutdown_connections 2024-05-10T11:22:33.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33.649+0000 7fae8061c640 1 -- 172.21.15.66:0/3008559764 wait complete. 2024-05-10T11:22:33.660 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T11:22:33.660 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T11:22:33.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-05-10T11:22:33.661 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T11:22:33.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:33.661 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T11:22:33.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T11:22:33.661 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T11:22:33.661 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:33.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:33.661 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-05-10T11:22:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T11:22:33.678 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T11:22:33.678 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T11:22:33.678 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T11:22:33.679 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42140sec preferred_lft 42140sec 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7ca1:9cff:fea8:828f/64 scope link 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:75:87:b0:17:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:22:33.680 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c75:87ff:feb0:1736/64 scope link 2024-05-10T11:22:33.681 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T11:22:33.681 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 2a:84:95:d8:36:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:22:33.681 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::2884:95ff:fed8:36bf/64 scope link 2024-05-10T11:22:33.681 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-05-10T11:22:33.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:33.681 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T11:22:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:33.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:33.745 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-05-10T11:22:33.801 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-05-10T11:22:33.802 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T11:22:33.802 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T11:22:33.802 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T11:22:33.802 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T11:22:33.802 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T11:22:33.802 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-05-10T11:22:33.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T11:22:33.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T11:22:33.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T11:22:33.803 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-05-10T11:22:33.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T11:22:33.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:33.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:33.933 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:22:33.948 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:22:33.949 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:22:33.949 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:33.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:33.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-05-10T11:22:34.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:34.016 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:34.072 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T11:22:34.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T11:22:34.072 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:34.127 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T11:22:34.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:34.128 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:34.212 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:34.213 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:34.213 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:34.221 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:34.221 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:34.221 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:34.221 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:34.222 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790" 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2024-05-10T11:22:34.227 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62c58463-bf48-494c-be0a-3a4b427ce317" will pass to kernel 2024-05-10T11:22:34.228 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T11:22:34.228 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-05-10T11:22:34.228 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T11:22:34.228 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T11:22:34.228 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T11:22:34.229 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T11:22:34.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:34.230 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:34.255 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T11:22:34.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T11:22:34.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:34.354 INFO:teuthology.orchestra.run.smithi066.stdout:client6782 2024-05-10T11:22:34.354 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:34.354 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:34.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:34.371 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./ 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/charlie 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/alpha 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/flushed/bravo 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/unflushed 2024-05-10T11:22:34.432 INFO:teuthology.orchestra.run.smithi066.stdout:./parent/unflushed/jfile 2024-05-10T11:22:34.433 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:34.433 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:34.433 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:34.433 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:34.433 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T11:22:34.433 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:34.540 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-05-10T11:22:34.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:34.549 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:34.549 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:34.550 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:34.550 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:34.550 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-05-10T11:22:34.550 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:34.658 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627776 2024-05-10T11:22:34.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:34.668 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:34.668 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:34.668 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:34.668 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:34.669 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-05-10T11:22:34.669 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:34.776 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627777 2024-05-10T11:22:34.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:34.785 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:34.785 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:34.785 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:34.785 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:34.785 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-05-10T11:22:34.785 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:34.893 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628280 2024-05-10T11:22:34.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:34.902 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:34.902 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:34.902 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:34.902 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:34.902 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-05-10T11:22:34.902 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:35.010 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627778 2024-05-10T11:22:35.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:35.019 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:35.019 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:35.019 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:35.019 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:35.019 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-05-10T11:22:35.019 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:35.127 INFO:teuthology.orchestra.run.smithi066.stdout:1099511628279 2024-05-10T11:22:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:35.139 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:35.139 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:35.139 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:35.139 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:35.139 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-05-10T11:22:35.139 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:35.247 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627779 2024-05-10T11:22:35.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:35.257 DEBUG:teuthology.orchestra.run.smithi066:> stdin-killer -- python3 -c ' 2024-05-10T11:22:35.257 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-05-10T11:22:35.257 DEBUG:teuthology.orchestra.run.smithi066:> import stat 2024-05-10T11:22:35.257 DEBUG:teuthology.orchestra.run.smithi066:> 2024-05-10T11:22:35.257 DEBUG:teuthology.orchestra.run.smithi066:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-05-10T11:22:35.257 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-05-10T11:22:35.366 INFO:teuthology.orchestra.run.smithi066.stdout:1099511627780 2024-05-10T11:22:35.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T11:22:35.375 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T11:22:35.375 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:22:35.466 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T11:22:35.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T11:22:35.517 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:22:35.517 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:35.517 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:35.533 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:35.533 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:35.589 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T11:22:35.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.733+0000 7fe062dc1640 1 Processor -- start 2024-05-10T11:22:35.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.733+0000 7fe062dc1640 1 -- start start 2024-05-10T11:22:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.734+0000 7fe062dc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 0x7fe05c167f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.734+0000 7fe062dc1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe05c160c90 con 0x7fe05c0b3910 2024-05-10T11:22:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.734+0000 7fe062dc1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe05c0d1b10 con 0x7fe05c1608b0 2024-05-10T11:22:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.734+0000 7fe062dc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe05c0ce5f0 con 0x7fe05c0d03c0 2024-05-10T11:22:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.734+0000 7fe05bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe05c0b3910 0x7fe05c0d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45674/0 (socket says 172.21.15.66:45674) 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.734+0000 7fe05bfff640 1 -- 172.21.15.66:0/1707201614 learned_addr learned my addr 172.21.15.66:0/1707201614 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe06135e640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 0x7fe05c167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399439139 0 0) 0x7fe050001110 con 0x7fe05c0b3910 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe044003520 con 0x7fe05c0b3910 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2506200213 0 0) 0x7fe044003520 con 0x7fe05c0b3910 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 msgr2=0x7fe05c167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 0x7fe05c167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 >> v1:172.21.15.190:6789/0 conn(0x7fe05c1608b0 legacy=0x7fe05c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c0ce8d0 con 0x7fe05c0b3910 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7fe050001840 con 0x7fe05c0b3910 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 >> v1:172.21.15.66:6789/0 conn(0x7fe05c0b3910 legacy=0x7fe05c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 0x7fe0440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe044004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe044004d40 0x7fe0440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c0ce5f0 con 0x7fe044003f20 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe04400ba20 con 0x7fe044004d40 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe04400bc20 con 0x7fe05c0d03c0 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05bfff640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe044004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe060b5d640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 0x7fe0440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe06135e640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe044004d40 0x7fe0440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05bfff640 1 -- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 msgr2=0x7fe0440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05bfff640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0d03c0 0x7fe0440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05bfff640 1 -- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe044004d40 msgr2=0x7fe0440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05bfff640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe044004d40 0x7fe0440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.735+0000 7fe05bfff640 1 -- 172.21.15.66:0/1707201614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe044003520 con 0x7fe044003f20 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.736+0000 7fe05bfff640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe044004800 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe05000c490 tx=0x7fe044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ba7ca163b11b98 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.736+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050036070 con 0x7fe044003f20 2024-05-10T11:22:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.736+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe050005af0 con 0x7fe044003f20 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.736+0000 7fe05b7fe640 1 -- 172.21.15.66:0/1707201614 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05000c0e0 con 0x7fe044003f20 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe062dc1640 1 -- 172.21.15.66:0/1707201614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 msgr2=0x7fe044004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe062dc1640 1 --2- 172.21.15.66:0/1707201614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe044004800 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe05000c490 tx=0x7fe044005830 comp rx=0 tx=0).stop 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe06135e640 1 -- 172.21.15.66:0/1707201614 reap_dead start 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe062dc1640 1 -- 172.21.15.66:0/1707201614 shutdown_connections 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe062dc1640 1 -- 172.21.15.66:0/1707201614 >> 172.21.15.66:0/1707201614 conn(0x7fe05c0d2df0 msgr2=0x7fe05c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe062dc1640 1 -- 172.21.15.66:0/1707201614 shutdown_connections 2024-05-10T11:22:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.737+0000 7fe062dc1640 1 -- 172.21.15.66:0/1707201614 wait complete. 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.738+0000 7fe062dc1640 1 Processor -- start 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.738+0000 7fe062dc1640 1 -- start start 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe062dc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe05c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe062dc1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0cc9e0 0x7fe05c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe062dc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05c0cb450 0x7fe05c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe062dc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c0d1d90 con 0x7fe044003f20 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe062dc1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c0b1f50 con 0x7fe05c0cb450 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe062dc1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe05c0d1f10 con 0x7fe05c0cc9e0 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe05c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe05c1512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33410/0 (socket says 172.21.15.66:33410) 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 -- 172.21.15.66:0/615666833 learned_addr learned my addr 172.21.15.66:0/615666833 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe06135e640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05c0cb450 0x7fe05c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe05bfff640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0cc9e0 0x7fe05c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 -- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0cc9e0 msgr2=0x7fe05c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0cc9e0 0x7fe05c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 -- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05c0cb450 msgr2=0x7fe05c15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05c0cb450 0x7fe05c15e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 -- 172.21.15.66:0/615666833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c0cb940 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe06135e640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05c0cb450 0x7fe05c15e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.739+0000 7fe060b5d640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe05c1512e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00f7c0 tx=0x7fe04c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.740+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0052e0 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.740+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c018070 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.740+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00d910 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.740+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c0cbc20 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.740+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c0cc1e0 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.741+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05c06a220 con 0x7fe044003f20 2024-05-10T11:22:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.741+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe04c00dab0 con 0x7fe044003f20 2024-05-10T11:22:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.742+0000 7fe0597fa640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe0480762d0 0x7fe048078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.742+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fe04c097730 con 0x7fe044003f20 2024-05-10T11:22:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.742+0000 7fe05bfff640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe0480762d0 0x7fe048078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.742+0000 7fe05bfff640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe0480762d0 0x7fe048078790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe050033000 tx=0x7fe05002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:35.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.746+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe05c0d1b10 con 0x7fe044003f20 2024-05-10T11:22:35.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.950+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe05c0d2670 con 0x7fe044003f20 2024-05-10T11:22:35.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.950+0000 7fe0597fa640 1 -- 172.21.15.66:0/615666833 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v120) ==== 80+0+248 (secure 0 0 0) 0x7fe04c060ee0 con 0x7fe044003f20 2024-05-10T11:22:35.951 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6836/1055415762 2024-05-11T11:22:26.777731+0000 2024-05-10T11:22:35.951 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6834/1055415762 2024-05-11T11:22:26.777731+0000 2024-05-10T11:22:35.951 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6836/3723690401 2024-05-11T11:22:17.439456+0000 2024-05-10T11:22:35.951 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.190:6834/3723690401 2024-05-11T11:22:17.439456+0000 2024-05-10T11:22:35.951 INFO:teuthology.orchestra.run.smithi066.stderr:listed 4 entries 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe0480762d0 msgr2=0x7fe048078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe0480762d0 0x7fe048078790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe050033000 tx=0x7fe05002e000 comp rx=0 tx=0).stop 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 msgr2=0x7fe05c1512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe05c1512e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00f7c0 tx=0x7fe04c00fc80 comp rx=0 tx=0).stop 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 shutdown_connections 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe0480762d0 0x7fe048078790 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05c0cb450 0x7fe05c15e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe05c0cc9e0 0x7fe05c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 --2- 172.21.15.66:0/615666833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe044003f20 0x7fe05c1512e0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 >> 172.21.15.66:0/615666833 conn(0x7fe05c0d2df0 msgr2=0x7fe05c071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 shutdown_connections 2024-05-10T11:22:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:35.952+0000 7fe062dc1640 1 -- 172.21.15.66:0/615666833 wait complete. 2024-05-10T11:22:35.964 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:22:35.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:35.964 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:22:35.994 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:22:35.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:35.994 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:22:36.050 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:22:36.050 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:22:36.050 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:36.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:22:36.070 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:22:36.070 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:36.070 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:36.107 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:22:36.107 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T11:22:36.107 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:22:36.107 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:36.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:22:36.128 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.250+0000 7fc247854640 1 Processor -- start 2024-05-10T11:22:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.250+0000 7fc247854640 1 -- start start 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc247854640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc240162940 0x7fc2400b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc247854640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2400d59d0 0x7fc2400d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc247854640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc2400b47a0 0x7fc2400d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc247854640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fc240162d20 con 0x7fc2400b47a0 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc247854640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400d2d20 con 0x7fc2400d59d0 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc247854640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400d3000 con 0x7fc240162940 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc2400b47a0 0x7fc2400d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc2400b47a0 0x7fc2400d3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33420/0 (socket says 172.21.15.66:33420) 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 -- 172.21.15.66:0/1228024393 learned_addr learned my addr 172.21.15.66:0/1228024393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:36.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc244def640 1 --2- 172.21.15.66:0/1228024393 >> v2:172.21.15.190:3300/0 conn(0x7fc2400d59d0 0x7fc2400d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 -- 172.21.15.66:0/1228024393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc240162940 msgr2=0x7fc2400b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:36.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 --2- 172.21.15.66:0/1228024393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc240162940 0x7fc2400b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 -- 172.21.15.66:0/1228024393 >> v2:172.21.15.190:3300/0 conn(0x7fc2400d59d0 msgr2=0x7fc2400d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:36.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 --2- 172.21.15.66:0/1228024393 >> v2:172.21.15.190:3300/0 conn(0x7fc2400d59d0 0x7fc2400d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc245df1640 1 -- 172.21.15.66:0/1228024393 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400d32e0 con 0x7fc2400b47a0 2024-05-10T11:22:36.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.251+0000 7fc244def640 1 --2- 172.21.15.66:0/1228024393 >> v2:172.21.15.190:3300/0 conn(0x7fc2400d59d0 0x7fc2400d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.252+0000 7fc245df1640 1 --2- 172.21.15.66:0/1228024393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2400b47a0 0x7fc2400d3bb0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fc24008f8a0 tx=0x7fc23802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08ebaf432f03c89 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.252+0000 7fc237fff640 1 -- 172.21.15.66:0/1228024393 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238036070 con 0x7fc2400b47a0 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.252+0000 7fc237fff640 1 -- 172.21.15.66:0/1228024393 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc238031600 con 0x7fc2400b47a0 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.252+0000 7fc237fff640 1 -- 172.21.15.66:0/1228024393 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2380319d0 con 0x7fc2400b47a0 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 -- 172.21.15.66:0/1228024393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2400b47a0 msgr2=0x7fc2400d3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 --2- 172.21.15.66:0/1228024393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2400b47a0 0x7fc2400d3bb0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fc24008f8a0 tx=0x7fc23802a570 comp rx=0 tx=0).stop 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 -- 172.21.15.66:0/1228024393 shutdown_connections 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 --2- 172.21.15.66:0/1228024393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2400b47a0 0x7fc2400d3bb0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 --2- 172.21.15.66:0/1228024393 >> v2:172.21.15.190:3300/0 conn(0x7fc2400d59d0 0x7fc2400d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 --2- 172.21.15.66:0/1228024393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc240162940 0x7fc2400b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 -- 172.21.15.66:0/1228024393 >> 172.21.15.66:0/1228024393 conn(0x7fc24009e380 msgr2=0x7fc2400d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 -- 172.21.15.66:0/1228024393 shutdown_connections 2024-05-10T11:22:36.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.253+0000 7fc247854640 1 -- 172.21.15.66:0/1228024393 wait complete. 2024-05-10T11:22:36.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.254+0000 7fc247854640 1 Processor -- start 2024-05-10T11:22:36.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.254+0000 7fc247854640 1 -- start start 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc247854640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400b47a0 0x7fc2400c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc247854640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2400d59d0 0x7fc2400caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc247854640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 0x7fc2401f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc247854640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400d2390 con 0x7fc240162940 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc247854640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400cfc50 con 0x7fc2400d59d0 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc247854640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400d2510 con 0x7fc2400b47a0 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc245df1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 0x7fc2401f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc245df1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 0x7fc2401f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33434/0 (socket says 172.21.15.66:33434) 2024-05-10T11:22:36.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc245df1640 1 -- 172.21.15.66:0/3345029188 learned_addr learned my addr 172.21.15.66:0/3345029188 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc244def640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2400d59d0 0x7fc2400caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.255+0000 7fc2455f0640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400b47a0 0x7fc2400c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc245df1640 1 -- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400b47a0 msgr2=0x7fc2400c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc245df1640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400b47a0 0x7fc2400c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc245df1640 1 -- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2400d59d0 msgr2=0x7fc2400caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc245df1640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2400d59d0 0x7fc2400caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc245df1640 1 -- 172.21.15.66:0/3345029188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400b2e90 con 0x7fc240162940 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc245df1640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 0x7fc2401f8a50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc238034040 tx=0x7fc238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238036050 con 0x7fc240162940 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc238042070 con 0x7fc240162940 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2400b3170 con 0x7fc240162940 2024-05-10T11:22:36.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238009510 con 0x7fc240162940 2024-05-10T11:22:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.256+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2400cc560 con 0x7fc240162940 2024-05-10T11:22:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.257+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2400cc760 con 0x7fc240162940 2024-05-10T11:22:36.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.258+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc238007bd0 con 0x7fc240162940 2024-05-10T11:22:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.258+0000 7fc235ffb640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2240762d0 0x7fc224078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.258+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fc2380b8640 con 0x7fc240162940 2024-05-10T11:22:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.259+0000 7fc2455f0640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2240762d0 0x7fc224078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.259+0000 7fc2455f0640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2240762d0 0x7fc224078790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0098e0 tx=0x7fc23c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.263+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc2400cc760 con 0x7fc240162940 2024-05-10T11:22:36.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.496+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc24006a220 con 0x7fc240162940 2024-05-10T11:22:36.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.496+0000 7fc235ffb640 1 -- 172.21.15.66:0/3345029188 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5196 (secure 0 0 0) 0x7fc238081710 con 0x7fc240162940 2024-05-10T11:22:36.497 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:36.497 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":112,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:31.802073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7081,"qdb_cluster":[7081]},"id":8}]} 2024-05-10T11:22:36.497 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 112 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2240762d0 msgr2=0x7fc224078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2240762d0 0x7fc224078790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0098e0 tx=0x7fc23c009060 comp rx=0 tx=0).stop 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 msgr2=0x7fc2401f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 0x7fc2401f8a50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc238034040 tx=0x7fc238004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 shutdown_connections 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fc2240762d0 0x7fc224078790 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.498+0000 7fc247854640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc240162940 0x7fc2401f8a50 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.499+0000 7fc247854640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2400d59d0 0x7fc2400caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.499+0000 7fc247854640 1 --2- 172.21.15.66:0/3345029188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400b47a0 0x7fc2400c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.499+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 >> 172.21.15.66:0/3345029188 conn(0x7fc24009e380 msgr2=0x7fc24015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.499+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 shutdown_connections 2024-05-10T11:22:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.499+0000 7fc247854640 1 -- 172.21.15.66:0/3345029188 wait complete. 2024-05-10T11:22:36.510 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:36.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.614+0000 7f6086674640 1 Processor -- start 2024-05-10T11:22:36.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.614+0000 7f6086674640 1 -- start start 2024-05-10T11:22:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f6086674640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f60800d5cb0 0x7f60800d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f6086674640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60800b45f0 con 0x7f6080162b30 2024-05-10T11:22:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f6086674640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60800b48d0 con 0x7f6080162750 2024-05-10T11:22:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f6086674640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f60800b4f20 con 0x7f60800d5cb0 2024-05-10T11:22:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f6084c11640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6080162b30 0x7f60800b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45676/0 (socket says 172.21.15.66:45676) 2024-05-10T11:22:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f6084c11640 1 -- 172.21.15.66:0/735696367 learned_addr learned my addr 172.21.15.66:0/735696367 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f607f7fe640 1 --2- 172.21.15.66:0/735696367 >> v2:172.21.15.190:3300/0 conn(0x7f60800d5cb0 0x7f60800d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f607effd640 1 -- 172.21.15.66:0/735696367 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401725650 0 0) 0x7f60800b45f0 con 0x7f6080162b30 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.615+0000 7f607effd640 1 -- 172.21.15.66:0/735696367 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6068003520 con 0x7f6080162b30 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.616+0000 7f607effd640 1 -- 172.21.15.66:0/735696367 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 872569994 0 0) 0x7f6068003520 con 0x7f6080162b30 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.616+0000 7f607f7fe640 1 -- 172.21.15.66:0/735696367 >> v1:172.21.15.190:6789/0 conn(0x7f6080162750 legacy=0x7f60800d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.616+0000 7f607f7fe640 1 -- 172.21.15.66:0/735696367 >> v1:172.21.15.66:6789/0 conn(0x7f6080162b30 legacy=0x7f60800b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.616+0000 7f607f7fe640 1 -- 172.21.15.66:0/735696367 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800b4bb0 con 0x7f60800d5cb0 2024-05-10T11:22:36.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.616+0000 7f607f7fe640 1 --2- 172.21.15.66:0/735696367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60800d5cb0 0x7f60800d3630 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60740097a0 tx=0x7f607402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3620afb65f85255 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f607effd640 1 -- 172.21.15.66:0/735696367 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074037070 con 0x7f60800d5cb0 2024-05-10T11:22:36.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f607effd640 1 -- 172.21.15.66:0/735696367 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607402abc0 con 0x7f60800d5cb0 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f607effd640 1 -- 172.21.15.66:0/735696367 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60780019f0 con 0x7f60800d5cb0 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 -- 172.21.15.66:0/735696367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60800d5cb0 msgr2=0x7f60800d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 --2- 172.21.15.66:0/735696367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60800d5cb0 0x7f60800d3630 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60740097a0 tx=0x7f607402a130 comp rx=0 tx=0).stop 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 -- 172.21.15.66:0/735696367 shutdown_connections 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 --2- 172.21.15.66:0/735696367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60800d5cb0 0x7f60800d3630 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 -- 172.21.15.66:0/735696367 >> 172.21.15.66:0/735696367 conn(0x7f608009e3b0 msgr2=0x7f60800d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 -- 172.21.15.66:0/735696367 shutdown_connections 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.617+0000 7f6086674640 1 -- 172.21.15.66:0/735696367 wait complete. 2024-05-10T11:22:36.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.618+0000 7f6086674640 1 Processor -- start 2024-05-10T11:22:36.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 -- start start 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6080162750 0x7f60800cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 0x7f608014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f608014ed60 0x7f60801f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60800d3f40 con 0x7f6080162b30 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f60800d3dc0 con 0x7f6080162750 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.619+0000 7f6086674640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f60800d0fe0 con 0x7f608014ed60 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 0x7f608014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 0x7f608014bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33442/0 (socket says 172.21.15.66:33442) 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 -- 172.21.15.66:0/1388828786 learned_addr learned my addr 172.21.15.66:0/1388828786 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:36.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607ffff640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6080162750 0x7f60800cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f6084c11640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f608014ed60 0x7f60801f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 -- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f608014ed60 msgr2=0x7f60801f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f608014ed60 0x7f60801f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 -- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6080162750 msgr2=0x7f60800cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6080162750 0x7f60800cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 -- 172.21.15.66:0/1388828786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800ce190 con 0x7f6080162b30 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f6084c11640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f608014ed60 0x7f60801f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607f7fe640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 0x7f608014bb70 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f6074035040 tx=0x7f60740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074042020 con 0x7f6080162b30 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607403d670 con 0x7f6080162b30 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60800ce470 con 0x7f6080162b30 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074037040 con 0x7f6080162b30 2024-05-10T11:22:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.620+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60800cea30 con 0x7f6080162b30 2024-05-10T11:22:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.621+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608006a220 con 0x7f6080162b30 2024-05-10T11:22:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.622+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6074045020 con 0x7f6080162b30 2024-05-10T11:22:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.623+0000 7f607cff9640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f606c0762d0 0x7f606c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.623+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f60740b80c0 con 0x7f6080162b30 2024-05-10T11:22:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.623+0000 7f607ffff640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f606c0762d0 0x7f606c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.623+0000 7f607ffff640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f606c0762d0 0x7f606c078790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6070000f60 tx=0x7f6070009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.627+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f607404c030 con 0x7f6080162b30 2024-05-10T11:22:36.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.861+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60800cf1e0 con 0x7f6080162b30 2024-05-10T11:22:36.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.862+0000 7f607cff9640 1 -- 172.21.15.66:0/1388828786 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5196 (secure 0 0 0) 0x7f60740817f0 con 0x7f6080162b30 2024-05-10T11:22:36.863 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:36.863 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":112,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:31.802073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7081,"qdb_cluster":[7081]},"id":8}]} 2024-05-10T11:22:36.863 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 112 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f606c0762d0 msgr2=0x7f606c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f606c0762d0 0x7f606c078790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6070000f60 tx=0x7f6070009040 comp rx=0 tx=0).stop 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 msgr2=0x7f608014bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 0x7f608014bb70 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f6074035040 tx=0x7f60740046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 shutdown_connections 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f606c0762d0 0x7f606c078790 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f608014ed60 0x7f60801f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6080162b30 0x7f608014bb70 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 --2- 172.21.15.66:0/1388828786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6080162750 0x7f60800cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 >> 172.21.15.66:0/1388828786 conn(0x7f608009e3b0 msgr2=0x7f60800b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:36.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 shutdown_connections 2024-05-10T11:22:36.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.864+0000 7f6086674640 1 -- 172.21.15.66:0/1388828786 wait complete. 2024-05-10T11:22:36.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:22:36.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.982+0000 7f9b29847640 1 Processor -- start 2024-05-10T11:22:36.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.982+0000 7f9b29847640 1 -- start start 2024-05-10T11:22:36.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b29847640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b240d1aa0 0x7f9b240d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b29847640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9b240d3340 0x7f9b240ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b29847640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b24072330 con 0x7f9b2415d290 2024-05-10T11:22:36.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b29847640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f9b240d37d0 con 0x7f9b240d1aa0 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b29847640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9b24071d70 con 0x7f9b240d3340 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b227fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b240d1aa0 0x7f9b240d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b22ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9b2415d290 0x7f9b24071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45686/0 (socket says 172.21.15.66:45686) 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.983+0000 7f9b22ffd640 1 -- 172.21.15.66:0/1403873527 learned_addr learned my addr 172.21.15.66:0/1403873527 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.984+0000 7f9b237fe640 1 --2- 172.21.15.66:0/1403873527 >> v2:172.21.15.190:3300/0 conn(0x7f9b240d3340 0x7f9b240ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.984+0000 7f9b227fc640 1 -- 172.21.15.66:0/1403873527 >> v2:172.21.15.190:3300/0 conn(0x7f9b240d3340 msgr2=0x7f9b240ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.984+0000 7f9b227fc640 1 --2- 172.21.15.66:0/1403873527 >> v2:172.21.15.190:3300/0 conn(0x7f9b240d3340 0x7f9b240ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.984+0000 7f9b227fc640 1 -- 172.21.15.66:0/1403873527 >> v1:172.21.15.66:6789/0 conn(0x7f9b2415d290 legacy=0x7f9b24071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.984+0000 7f9b227fc640 1 -- 172.21.15.66:0/1403873527 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b24072050 con 0x7f9b240d1aa0 2024-05-10T11:22:36.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.984+0000 7f9b21ffb640 1 -- 172.21.15.66:0/1403873527 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203520381 0 0) 0x7f9b24072330 con 0x7f9b2415d290 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b227fc640 1 --2- 172.21.15.66:0/1403873527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b240d1aa0 0x7f9b240d2e00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f9b240b2900 tx=0x7f9b0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e427cef8526e77da server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b21ffb640 1 -- 172.21.15.66:0/1403873527 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c037070 con 0x7f9b240d1aa0 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b21ffb640 1 -- 172.21.15.66:0/1403873527 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c032440 con 0x7f9b240d1aa0 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b21ffb640 1 -- 172.21.15.66:0/1403873527 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c032810 con 0x7f9b240d1aa0 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 -- 172.21.15.66:0/1403873527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b240d1aa0 msgr2=0x7f9b240d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 --2- 172.21.15.66:0/1403873527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b240d1aa0 0x7f9b240d2e00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f9b240b2900 tx=0x7f9b0c02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 -- 172.21.15.66:0/1403873527 shutdown_connections 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 --2- 172.21.15.66:0/1403873527 >> v2:172.21.15.190:3300/0 conn(0x7f9b240d3340 0x7f9b240ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 --2- 172.21.15.66:0/1403873527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b240d1aa0 0x7f9b240d2e00 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 -- 172.21.15.66:0/1403873527 >> 172.21.15.66:0/1403873527 conn(0x7f9b2409ba20 msgr2=0x7f9b2409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 -- 172.21.15.66:0/1403873527 shutdown_connections 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.985+0000 7f9b29847640 1 -- 172.21.15.66:0/1403873527 wait complete. 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 Processor -- start 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 -- start start 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b240d1aa0 0x7f9b241e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b240d3340 0x7f9b240cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 0x7f9b241f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b24071a50 con 0x7f9b2415d290 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9b240cdd50 con 0x7f9b240d3340 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.987+0000 7f9b29847640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240ce7b0 con 0x7f9b240d1aa0 2024-05-10T11:22:36.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 0x7f9b241f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 0x7f9b241f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33462/0 (socket says 172.21.15.66:33462) 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 -- 172.21.15.66:0/2271107085 learned_addr learned my addr 172.21.15.66:0/2271107085 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 -- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b240d1aa0 msgr2=0x7f9b241e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b240d1aa0 0x7f9b241e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 -- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b240d3340 msgr2=0x7f9b240cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b240d3340 0x7f9b240cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 -- 172.21.15.66:0/2271107085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b240cc210 con 0x7f9b2415d290 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b237fe640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 0x7f9b241f5430 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00d800 tx=0x7f9b1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00b6c0 con 0x7f9b2415d290 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c019070 con 0x7f9b2415d290 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b240cc4b0 con 0x7f9b2415d290 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00bac0 con 0x7f9b2415d290 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.988+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b240cca70 con 0x7f9b2415d290 2024-05-10T11:22:36.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.989+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b240693f0 con 0x7f9b2415d290 2024-05-10T11:22:36.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.990+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b1c00bc60 con 0x7f9b2415d290 2024-05-10T11:22:36.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.990+0000 7f9b1bfff640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b040762d0 0x7f9b04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:36.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.991+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f9b1c097c40 con 0x7f9b2415d290 2024-05-10T11:22:36.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.991+0000 7f9b22ffd640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b040762d0 0x7f9b04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:36.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.991+0000 7f9b22ffd640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b040762d0 0x7f9b04078790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9b14007fd0 tx=0x7f9b14007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:36.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:36.995+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9b1c0613f0 con 0x7f9b2415d290 2024-05-10T11:22:37.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.185+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b240d2f60 con 0x7f9b2415d290 2024-05-10T11:22:37.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.186+0000 7f9b1bfff640 1 -- 172.21.15.66:0/2271107085 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+17215 (secure 0 0 0) 0x7f9b1c060cf0 con 0x7f9b2415d290 2024-05-10T11:22:37.186 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:37.187 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":120,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:22:26.777754+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:22:03.418261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T11:22:04.686944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.190:6836/1055415762":"2024-05-11T11:22:26.777731+0000","172.21.15.190:6834/1055415762":"2024-05-11T11:22:26.777731+0000","172.21.15.190:6836/3723690401":"2024-05-11T11:22:17.439456+0000","172.21.15.190:6834/3723690401":"2024-05-11T11:22:17.439456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:22:37.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b040762d0 msgr2=0x7f9b04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b040762d0 0x7f9b04078790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9b14007fd0 tx=0x7f9b14007ce0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 msgr2=0x7f9b241f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 0x7f9b241f5430 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00d800 tx=0x7f9b1c00dcc0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 shutdown_connections 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f9b040762d0 0x7f9b04078790 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2415d290 0x7f9b241f5430 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b240d3340 0x7f9b240cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 --2- 172.21.15.66:0/2271107085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b240d1aa0 0x7f9b241e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 >> 172.21.15.66:0/2271107085 conn(0x7f9b2409ba20 msgr2=0x7f9b240b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 shutdown_connections 2024-05-10T11:22:37.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.188+0000 7f9b29847640 1 -- 172.21.15.66:0/2271107085 wait complete. 2024-05-10T11:22:37.200 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:22:37.200 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:37.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.304+0000 7fadf6f78640 1 Processor -- start 2024-05-10T11:22:37.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.305+0000 7fadf6f78640 1 -- start start 2024-05-10T11:22:37.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.305+0000 7fadf6f78640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fadf015f3b0 0x7fadf00d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.305+0000 7fadf6f78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf00d5d30 0x7fadf00d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.305+0000 7fadf6f78640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf00d30b0 con 0x7fadf015f790 2024-05-10T11:22:37.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.305+0000 7fadf6f78640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fadf00d3390 con 0x7fadf015f3b0 2024-05-10T11:22:37.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.305+0000 7fadf6f78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fadf00c8c80 con 0x7fadf00d5d30 2024-05-10T11:22:37.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fadf015f3b0 0x7fadf00d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fadf015f3b0 0x7fadf00d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33474/0 (socket says 172.21.15.66:33474) 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 -- 172.21.15.66:0/3915019510 learned_addr learned my addr 172.21.15.66:0/3915019510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf5515640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf00d5d30 0x7fadf00d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 -- 172.21.15.66:0/3915019510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf00d5d30 msgr2=0x7fadf00d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf00d5d30 0x7fadf00d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 -- 172.21.15.66:0/3915019510 >> v1:172.21.15.190:6789/0 conn(0x7fadf015f790 legacy=0x7fadf00c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf4d14640 1 -- 172.21.15.66:0/3915019510 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf00c8f60 con 0x7fadf015f3b0 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.306+0000 7fadf5515640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf00d5d30 0x7fadf00d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:37.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf4d14640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015f3b0 0x7fadf00d36f0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fade4009870 tx=0x7fade402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0de263d6e0612d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadef7fe640 1 -- 172.21.15.66:0/3915019510 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4037070 con 0x7fadf015f3b0 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadef7fe640 1 -- 172.21.15.66:0/3915019510 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4032440 con 0x7fadf015f3b0 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadef7fe640 1 -- 172.21.15.66:0/3915019510 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4032810 con 0x7fadf015f3b0 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 -- 172.21.15.66:0/3915019510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015f3b0 msgr2=0x7fadf00d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015f3b0 0x7fadf00d36f0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fade4009870 tx=0x7fade402a200 comp rx=0 tx=0).stop 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 -- 172.21.15.66:0/3915019510 shutdown_connections 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf00d5d30 0x7fadf00d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 --2- 172.21.15.66:0/3915019510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015f3b0 0x7fadf00d36f0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 -- 172.21.15.66:0/3915019510 >> 172.21.15.66:0/3915019510 conn(0x7fadf00d5130 msgr2=0x7fadf00d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:37.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 -- 172.21.15.66:0/3915019510 shutdown_connections 2024-05-10T11:22:37.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.307+0000 7fadf6f78640 1 -- 172.21.15.66:0/3915019510 wait complete. 2024-05-10T11:22:37.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.308+0000 7fadf6f78640 1 Processor -- start 2024-05-10T11:22:37.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 -- start start 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadf00d5d30 0x7fadf0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf015f3b0 0x7fadf0159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 0x7fadf0161b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00d0e60 con 0x7fadf015a3f0 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00d0ce0 con 0x7fadf00d5d30 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.309+0000 7fadf6f78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fadf00d0fe0 con 0x7fadf015f3b0 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 0x7fadf0161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 0x7fadf0161b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33486/0 (socket says 172.21.15.66:33486) 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 -- 172.21.15.66:0/4121689588 learned_addr learned my addr 172.21.15.66:0/4121689588 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadeffff640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf015f3b0 0x7fadf0159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf4d14640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadf00d5d30 0x7fadf0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 -- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf015f3b0 msgr2=0x7fadf0159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf015f3b0 0x7fadf0159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 -- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadf00d5d30 msgr2=0x7fadf0158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadf00d5d30 0x7fadf0158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 -- 172.21.15.66:0/4121689588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf0158ad0 con 0x7fadf015a3f0 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadeffff640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf015f3b0 0x7fadf0159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf4d14640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadf00d5d30 0x7fadf0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf5515640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 0x7fadf0161b90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fade800cef0 tx=0x7fade800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade801a070 con 0x7fadf015a3f0 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade800d860 con 0x7fadf015a3f0 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf015a880 con 0x7fadf015a3f0 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade800dc50 con 0x7fadf015a3f0 2024-05-10T11:22:37.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.310+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf015ae40 con 0x7fadf015a3f0 2024-05-10T11:22:37.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.311+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf006a220 con 0x7fadf015a3f0 2024-05-10T11:22:37.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.312+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fade801d070 con 0x7fadf015a3f0 2024-05-10T11:22:37.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.313+0000 7faded7fa640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fadd40762d0 0x7fadd4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.313+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fade8098100 con 0x7fadf015a3f0 2024-05-10T11:22:37.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.313+0000 7fadf4d14640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fadd40762d0 0x7fadd4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.313+0000 7fadf4d14640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fadd40762d0 0x7fadd4078790 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fade4034000 tx=0x7fade402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:37.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.317+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fade80618e0 con 0x7fadf015a3f0 2024-05-10T11:22:37.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.548+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadf00d2340 con 0x7fadf015a3f0 2024-05-10T11:22:37.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.549+0000 7faded7fa640 1 -- 172.21.15.66:0/4121689588 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5196 (secure 0 0 0) 0x7fade80611e0 con 0x7fadf015a3f0 2024-05-10T11:22:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:37.550 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":112,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:31.802073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7081,"qdb_cluster":[7081]},"id":8}]} 2024-05-10T11:22:37.550 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 112 2024-05-10T11:22:37.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fadd40762d0 msgr2=0x7fadd4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fadd40762d0 0x7fadd4078790 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fade4034000 tx=0x7fade402e000 comp rx=0 tx=0).stop 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 msgr2=0x7fadf0161b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 0x7fadf0161b90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fade800cef0 tx=0x7fade800a710 comp rx=0 tx=0).stop 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 shutdown_connections 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fadd40762d0 0x7fadd4078790 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf015a3f0 0x7fadf0161b90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadf015f3b0 0x7fadf0159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 --2- 172.21.15.66:0/4121689588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadf00d5d30 0x7fadf0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 >> 172.21.15.66:0/4121689588 conn(0x7fadf00d5130 msgr2=0x7fadf00c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 shutdown_connections 2024-05-10T11:22:37.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.551+0000 7fadf6f78640 1 -- 172.21.15.66:0/4121689588 wait complete. 2024-05-10T11:22:37.563 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:22:37.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.667+0000 7f4c51746640 1 Processor -- start 2024-05-10T11:22:37.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.667+0000 7f4c51746640 1 -- start start 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c51746640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c4c162750 0x7f4c4c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c51746640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c4c0d5cb0 0x7f4c4c0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c51746640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c162b30 0x7f4c4c0d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c51746640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f4c4c0b4f20 con 0x7f4c4c0d5cb0 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c51746640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4c4c0d0fe0 con 0x7f4c4c162750 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c51746640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c0b45f0 con 0x7f4c4c162b30 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c4a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c4c0d5cb0 0x7f4c4c0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c4a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c4c0d5cb0 0x7f4c4c0d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33488/0 (socket says 172.21.15.66:33488) 2024-05-10T11:22:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.668+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/2671495716 learned_addr learned my addr 172.21.15.66:0/2671495716 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4affd640 1 --2- 172.21.15.66:0/2671495716 >> v2:172.21.15.190:3300/0 conn(0x7f4c4c162750 0x7f4c4c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4b7fe640 1 --2- 172.21.15.66:0/2671495716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c162b30 0x7f4c4c0d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/2671495716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c162b30 msgr2=0x7f4c4c0d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4a7fc640 1 --2- 172.21.15.66:0/2671495716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c162b30 0x7f4c4c0d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/2671495716 >> v2:172.21.15.190:3300/0 conn(0x7f4c4c162750 msgr2=0x7f4c4c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4a7fc640 1 --2- 172.21.15.66:0/2671495716 >> v2:172.21.15.190:3300/0 conn(0x7f4c4c162750 0x7f4c4c0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/2671495716 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c0b48d0 con 0x7f4c4c0d5cb0 2024-05-10T11:22:37.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c4a7fc640 1 --2- 172.21.15.66:0/2671495716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c0d5cb0 0x7f4c4c0d3630 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b7c40 tx=0x7f4c3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d79f4af2d774b97 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:37.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.669+0000 7f4c49ffb640 1 -- 172.21.15.66:0/2671495716 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34037070 con 0x7f4c4c0d5cb0 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c49ffb640 1 -- 172.21.15.66:0/2671495716 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c34032440 con 0x7f4c4c0d5cb0 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c49ffb640 1 -- 172.21.15.66:0/2671495716 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34032810 con 0x7f4c4c0d5cb0 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 -- 172.21.15.66:0/2671495716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c0d5cb0 msgr2=0x7f4c4c0d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 --2- 172.21.15.66:0/2671495716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c0d5cb0 0x7f4c4c0d3630 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b7c40 tx=0x7f4c3402a140 comp rx=0 tx=0).stop 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 -- 172.21.15.66:0/2671495716 shutdown_connections 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 --2- 172.21.15.66:0/2671495716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c162b30 0x7f4c4c0d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 --2- 172.21.15.66:0/2671495716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c0d5cb0 0x7f4c4c0d3630 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 --2- 172.21.15.66:0/2671495716 >> v2:172.21.15.190:3300/0 conn(0x7f4c4c162750 0x7f4c4c0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 -- 172.21.15.66:0/2671495716 >> 172.21.15.66:0/2671495716 conn(0x7f4c4c09e3b0 msgr2=0x7f4c4c0d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 -- 172.21.15.66:0/2671495716 shutdown_connections 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.670+0000 7f4c51746640 1 -- 172.21.15.66:0/2671495716 wait complete. 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.671+0000 7f4c51746640 1 Processor -- start 2024-05-10T11:22:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 -- start start 2024-05-10T11:22:37.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c4c162750 0x7f4c4c1e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 0x7f4c4c1ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c155c10 0x7f4c4c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d0d30 con 0x7f4c4c162b30 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d0bb0 con 0x7f4c4c162750 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c51746640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d1660 con 0x7f4c4c155c10 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c4a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 0x7f4c4c1ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c4a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 0x7f4c4c1ea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33504/0 (socket says 172.21.15.66:33504) 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.672+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/1973907791 learned_addr learned my addr 172.21.15.66:0/1973907791 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4affd640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c4c162750 0x7f4c4c1e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4b7fe640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c155c10 0x7f4c4c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c155c10 msgr2=0x7f4c4c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4a7fc640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c155c10 0x7f4c4c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c4c162750 msgr2=0x7f4c4c1e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4a7fc640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c4c162750 0x7f4c4c1e7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4a7fc640 1 -- 172.21.15.66:0/1973907791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c0cee50 con 0x7f4c4c162b30 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4b7fe640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c155c10 0x7f4c4c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c4a7fc640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 0x7f4c4c1ea7b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f4c3402a180 tx=0x7f4c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34041020 con 0x7f4c4c162b30 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c340306c0 con 0x7f4c4c162b30 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c0b8dc0 con 0x7f4c4c162b30 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34037040 con 0x7f4c4c162b30 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.673+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c0ceb70 con 0x7f4c4c162b30 2024-05-10T11:22:37.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.674+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c06a220 con 0x7f4c4c162b30 2024-05-10T11:22:37.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.675+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c34044020 con 0x7f4c4c162b30 2024-05-10T11:22:37.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.675+0000 7f4c437fe640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c2c0762d0 0x7f4c2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:37.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.675+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7f4c340b7fb0 con 0x7f4c4c162b30 2024-05-10T11:22:37.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.676+0000 7f4c4affd640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c2c0762d0 0x7f4c2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:37.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.676+0000 7f4c4affd640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c2c0762d0 0x7f4c2c078790 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006fd0 tx=0x7f4c3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:37.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.680+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4c3404b030 con 0x7f4c4c162b30 2024-05-10T11:22:37.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.910+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c4c1eaf60 con 0x7f4c4c162b30 2024-05-10T11:22:37.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.910+0000 7f4c437fe640 1 -- 172.21.15.66:0/1973907791 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5196 (secure 0 0 0) 0x7f4c4c0b8dc0 con 0x7f4c4c162b30 2024-05-10T11:22:37.912 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:37.912 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":112,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T11:22:05.730950+0000","modified":"2024-05-10T11:22:31.802073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7081":{"gid":7081,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6835/3510752725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3510752725},{"type":"v1","addr":"172.21.15.66:6835","nonce":3510752725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7081,"qdb_cluster":[7081]},"id":8}]} 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 112 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c2c0762d0 msgr2=0x7f4c2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c2c0762d0 0x7f4c2c078790 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006fd0 tx=0x7f4c3c008040 comp rx=0 tx=0).stop 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 msgr2=0x7f4c4c1ea7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 0x7f4c4c1ea7b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f4c3402a180 tx=0x7f4c340046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 shutdown_connections 2024-05-10T11:22:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f4c2c0762d0 0x7f4c2c078790 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c4c155c10 0x7f4c4c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c4c162b30 0x7f4c4c1ea7b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 --2- 172.21.15.66:0/1973907791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c4c162750 0x7f4c4c1e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:37.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 >> 172.21.15.66:0/1973907791 conn(0x7f4c4c09e3b0 msgr2=0x7f4c4c160870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:37.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 shutdown_connections 2024-05-10T11:22:37.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:37.912+0000 7f4c51746640 1 -- 172.21.15.66:0/1973907791 wait complete. 2024-05-10T11:22:37.926 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:22:38.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 Processor -- start 2024-05-10T11:22:38.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 -- start start 2024-05-10T11:22:38.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdc5c15f3b0 0x7fdc5c0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f790 0x7fdc5c0d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5c0d30b0 con 0x7fdc5c0d5d30 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5c0d3390 con 0x7fdc5c15f3b0 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.031+0000 7fdc62693640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0c8c80 con 0x7fdc5c15f790 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc60c30640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fdc5c0d5d30 0x7fdc5c0c9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45702/0 (socket says 172.21.15.66:45702) 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc60c30640 1 -- 172.21.15.66:0/2529275327 learned_addr learned my addr 172.21.15.66:0/2529275327 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5b7fe640 1 --2- 172.21.15.66:0/2529275327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f790 0x7fdc5c0d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5bfff640 1 --2- 172.21.15.66:0/2529275327 >> v2:172.21.15.190:3300/0 conn(0x7fdc5c15f3b0 0x7fdc5c0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5affd640 1 -- 172.21.15.66:0/2529275327 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862704897 0 0) 0x7fdc5c0d30b0 con 0x7fdc5c0d5d30 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5affd640 1 -- 172.21.15.66:0/2529275327 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc44003520 con 0x7fdc5c0d5d30 2024-05-10T11:22:38.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5affd640 1 -- 172.21.15.66:0/2529275327 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1959244168 0 0) 0x7fdc44003520 con 0x7fdc5c0d5d30 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5b7fe640 1 -- 172.21.15.66:0/2529275327 >> v2:172.21.15.190:3300/0 conn(0x7fdc5c15f3b0 msgr2=0x7fdc5c0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5b7fe640 1 --2- 172.21.15.66:0/2529275327 >> v2:172.21.15.190:3300/0 conn(0x7fdc5c15f3b0 0x7fdc5c0d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5b7fe640 1 -- 172.21.15.66:0/2529275327 >> v1:172.21.15.66:6789/0 conn(0x7fdc5c0d5d30 legacy=0x7fdc5c0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5b7fe640 1 -- 172.21.15.66:0/2529275327 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c0c8f60 con 0x7fdc5c15f790 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.032+0000 7fdc5bfff640 1 --2- 172.21.15.66:0/2529275327 >> v2:172.21.15.190:3300/0 conn(0x7fdc5c15f3b0 0x7fdc5c0d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.033+0000 7fdc5b7fe640 1 --2- 172.21.15.66:0/2529275327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f790 0x7fdc5c0d3c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc500097a0 tx=0x7fdc5002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31807d6f0f54c529 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.033+0000 7fdc5affd640 1 -- 172.21.15.66:0/2529275327 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50037070 con 0x7fdc5c15f790 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.033+0000 7fdc5affd640 1 -- 172.21.15.66:0/2529275327 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5002aba0 con 0x7fdc5c15f790 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.033+0000 7fdc5affd640 1 -- 172.21.15.66:0/2529275327 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc540019f0 con 0x7fdc5c15f790 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 -- 172.21.15.66:0/2529275327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f790 msgr2=0x7fdc5c0d3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 --2- 172.21.15.66:0/2529275327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f790 0x7fdc5c0d3c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc500097a0 tx=0x7fdc5002a110 comp rx=0 tx=0).stop 2024-05-10T11:22:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 -- 172.21.15.66:0/2529275327 shutdown_connections 2024-05-10T11:22:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 --2- 172.21.15.66:0/2529275327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f790 0x7fdc5c0d3c30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 --2- 172.21.15.66:0/2529275327 >> v2:172.21.15.190:3300/0 conn(0x7fdc5c15f3b0 0x7fdc5c0d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 -- 172.21.15.66:0/2529275327 >> 172.21.15.66:0/2529275327 conn(0x7fdc5c0d5130 msgr2=0x7fdc5c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 -- 172.21.15.66:0/2529275327 shutdown_connections 2024-05-10T11:22:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.034+0000 7fdc62693640 1 -- 172.21.15.66:0/2529275327 wait complete. 2024-05-10T11:22:38.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.035+0000 7fdc62693640 1 Processor -- start 2024-05-10T11:22:38.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.035+0000 7fdc62693640 1 -- start start 2024-05-10T11:22:38.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc62693640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc5c0d5d30 0x7fdc5c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc62693640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f3b0 0x7fdc5c0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc62693640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 0x7fdc5c160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc62693640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c0d0e60 con 0x7fdc5c0ce750 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc62693640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c0d0ce0 con 0x7fdc5c0d5d30 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc62693640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0d0fe0 con 0x7fdc5c15f3b0 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 0x7fdc5c160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 0x7fdc5c160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33520/0 (socket says 172.21.15.66:33520) 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 -- 172.21.15.66:0/4008433664 learned_addr learned my addr 172.21.15.66:0/4008433664 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc5bfff640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc5c0d5d30 0x7fdc5c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc5b7fe640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f3b0 0x7fdc5c0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 -- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f3b0 msgr2=0x7fdc5c0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f3b0 0x7fdc5c0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 -- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc5c0d5d30 msgr2=0x7fdc5c1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc5c0d5d30 0x7fdc5c1545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.036+0000 7fdc60c30640 1 -- 172.21.15.66:0/4008433664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c161c20 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.037+0000 7fdc60c30640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 0x7fdc5c160ef0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400cc40 tx=0x7fdc5400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.037+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc54017070 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.037+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5400ce50 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.037+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c161f00 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.037+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc54012620 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.037+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c1624c0 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.038+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5c0cebb0 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.038+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc5401a070 con 0x7fdc5c0ce750 2024-05-10T11:22:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.039+0000 7fdc58ff9640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdc480762d0 0x7fdc48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.039+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7fdc540976f0 con 0x7fdc5c0ce750 2024-05-10T11:22:38.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.039+0000 7fdc5bfff640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdc480762d0 0x7fdc48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.040+0000 7fdc5bfff640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdc480762d0 0x7fdc48078790 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009560 tx=0x7fdc4c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.043+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdc540607c0 con 0x7fdc5c0ce750 2024-05-10T11:22:38.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.234+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc5c0ba840 con 0x7fdc5c0ce750 2024-05-10T11:22:38.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.235+0000 7fdc58ff9640 1 -- 172.21.15.66:0/4008433664 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+17215 (secure 0 0 0) 0x7fdc54064ac0 con 0x7fdc5c0ce750 2024-05-10T11:22:38.236 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:38.236 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":120,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:22:26.777754+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T11:22:03.418261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T11:22:04.686944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.190:6836/1055415762":"2024-05-11T11:22:26.777731+0000","172.21.15.190:6834/1055415762":"2024-05-11T11:22:26.777731+0000","172.21.15.190:6836/3723690401":"2024-05-11T11:22:17.439456+0000","172.21.15.190:6834/3723690401":"2024-05-11T11:22:17.439456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:22:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.237+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdc480762d0 msgr2=0x7fdc48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.237+0000 7fdc62693640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdc480762d0 0x7fdc48078790 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009560 tx=0x7fdc4c009190 comp rx=0 tx=0).stop 2024-05-10T11:22:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 msgr2=0x7fdc5c160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 0x7fdc5c160ef0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400cc40 tx=0x7fdc5400a430 comp rx=0 tx=0).stop 2024-05-10T11:22:38.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 shutdown_connections 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fdc480762d0 0x7fdc48078790 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc5c0ce750 0x7fdc5c160ef0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc5c15f3b0 0x7fdc5c0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 --2- 172.21.15.66:0/4008433664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc5c0d5d30 0x7fdc5c1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 >> 172.21.15.66:0/4008433664 conn(0x7fdc5c0d5130 msgr2=0x7fdc5c0caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 shutdown_connections 2024-05-10T11:22:38.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.238+0000 7fdc62693640 1 -- 172.21.15.66:0/4008433664 wait complete. 2024-05-10T11:22:38.250 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T11:22:38.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.357+0000 7efeecdb6640 1 Processor -- start 2024-05-10T11:22:38.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.357+0000 7efeecdb6640 1 -- start start 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efeecdb6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efee80cf170 0x7efee815f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efeecdb6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efee80cf5d0 0x7efee815f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efeecdb6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee80c74c0 con 0x7efee815b6d0 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efeecdb6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7efee80cc380 con 0x7efee80cf5d0 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efeecdb6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efee80c5d10 con 0x7efee80cf170 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee6d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efee80cf5d0 0x7efee815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee659c640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7efee815b6d0 0x7efee80c6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45718/0 (socket says 172.21.15.66:45718) 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee659c640 1 -- 172.21.15.66:0/241168218 learned_addr learned my addr 172.21.15.66:0/241168218 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efeddd9b640 1 --2- 172.21.15.66:0/241168218 >> v2:172.21.15.190:3300/0 conn(0x7efee80cf170 0x7efee815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee6d9d640 1 -- 172.21.15.66:0/241168218 >> v2:172.21.15.190:3300/0 conn(0x7efee80cf170 msgr2=0x7efee815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee6d9d640 1 --2- 172.21.15.66:0/241168218 >> v2:172.21.15.190:3300/0 conn(0x7efee80cf170 0x7efee815f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee6d9d640 1 -- 172.21.15.66:0/241168218 >> v1:172.21.15.66:6789/0 conn(0x7efee815b6d0 legacy=0x7efee80c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.358+0000 7efee6d9d640 1 -- 172.21.15.66:0/241168218 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee80c5ff0 con 0x7efee80cf5d0 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.359+0000 7efee6d9d640 1 --2- 172.21.15.66:0/241168218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee815f660 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7efee80b3920 tx=0x7efee002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a599869f6fe4e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.359+0000 7efee5d9b640 1 -- 172.21.15.66:0/241168218 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0038070 con 0x7efee80cf5d0 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.359+0000 7efee5d9b640 1 -- 172.21.15.66:0/241168218 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0008640 con 0x7efee80cf5d0 2024-05-10T11:22:38.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.359+0000 7efee5d9b640 1 -- 172.21.15.66:0/241168218 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0008a30 con 0x7efee80cf5d0 2024-05-10T11:22:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.359+0000 7efeecdb6640 1 -- 172.21.15.66:0/241168218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 msgr2=0x7efee815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.359+0000 7efeecdb6640 1 --2- 172.21.15.66:0/241168218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee815f660 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7efee80b3920 tx=0x7efee002b810 comp rx=0 tx=0).stop 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.360+0000 7efeecdb6640 1 -- 172.21.15.66:0/241168218 shutdown_connections 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.360+0000 7efeecdb6640 1 --2- 172.21.15.66:0/241168218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee815f660 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.360+0000 7efeecdb6640 1 --2- 172.21.15.66:0/241168218 >> v2:172.21.15.190:3300/0 conn(0x7efee80cf170 0x7efee815f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.360+0000 7efeecdb6640 1 -- 172.21.15.66:0/241168218 >> 172.21.15.66:0/241168218 conn(0x7efee80b2900 msgr2=0x7efee80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.360+0000 7efeecdb6640 1 -- 172.21.15.66:0/241168218 shutdown_connections 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.360+0000 7efeecdb6640 1 -- 172.21.15.66:0/241168218 wait complete. 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.361+0000 7efeecdb6640 1 Processor -- start 2024-05-10T11:22:38.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.361+0000 7efeecdb6640 1 -- start start 2024-05-10T11:22:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeecdb6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee80cf170 0x7efee80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeecdb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee809e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeecdb6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efee815b6d0 0x7efee80b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeecdb6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efee80c6890 con 0x7efee80cf5d0 2024-05-10T11:22:38.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeecdb6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efee80c65b0 con 0x7efee80cf170 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeecdb6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efee80cd170 con 0x7efee815b6d0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee809e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33534/0 (socket says 172.21.15.66:33534) 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 -- 172.21.15.66:0/2763951909 learned_addr learned my addr 172.21.15.66:0/2763951909 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efee659c640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee80cf170 0x7efee80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 -- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efee815b6d0 msgr2=0x7efee80b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efee815b6d0 0x7efee80b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 -- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee80cf170 msgr2=0x7efee80b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee80cf170 0x7efee80b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 -- 172.21.15.66:0/2763951909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee809e780 con 0x7efee80cf5d0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.362+0000 7efeddd9b640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee809e240 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7efed000d800 tx=0x7efed000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.363+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed000b6c0 con 0x7efee80cf5d0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.363+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed0019070 con 0x7efee80cf5d0 2024-05-10T11:22:38.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.363+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee80b61d0 con 0x7efee80cf5d0 2024-05-10T11:22:38.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.363+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed000ba80 con 0x7efee80cf5d0 2024-05-10T11:22:38.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.363+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee80b6790 con 0x7efee80cf5d0 2024-05-10T11:22:38.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.364+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee80b6990 con 0x7efee80cf5d0 2024-05-10T11:22:38.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.364+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efed000bc20 con 0x7efee80cf5d0 2024-05-10T11:22:38.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.365+0000 7efedf7fe640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efec80762d0 0x7efec8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.365+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6273+0+0 (secure 0 0 0) 0x7efed0097db0 con 0x7efee80cf5d0 2024-05-10T11:22:38.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.365+0000 7efee659c640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efec80762d0 0x7efec8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.366+0000 7efee659c640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efec80762d0 0x7efec8078790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efed8000f60 tx=0x7efed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.370+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efee80b6990 con 0x7efee80cf5d0 2024-05-10T11:22:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.603+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efee806a220 con 0x7efee80cf5d0 2024-05-10T11:22:38.604 INFO:tasks.ceph.mon.a.smithi066.stderr:2024-05-10T11:22:38.604+0000 7fa7d59b0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:22:38.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.605+0000 7efedf7fe640 1 -- 172.21.15.66:0/2763951909 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v113) ==== 161+0+0 (secure 0 0 0) 0x7efed0061440 con 0x7efee80cf5d0 2024-05-10T11:22:38.606 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:22:38.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.608+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efec80762d0 msgr2=0x7efec8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.608+0000 7efeecdb6640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efec80762d0 0x7efec8078790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efed8000f60 tx=0x7efed8009040 comp rx=0 tx=0).stop 2024-05-10T11:22:38.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.608+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 msgr2=0x7efee809e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.608+0000 7efeecdb6640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee809e240 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7efed000d800 tx=0x7efed000dcc0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 shutdown_connections 2024-05-10T11:22:38.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7efec80762d0 0x7efec8078790 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efee815b6d0 0x7efee80b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efee80cf5d0 0x7efee809e240 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 --2- 172.21.15.66:0/2763951909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee80cf170 0x7efee80b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 >> 172.21.15.66:0/2763951909 conn(0x7efee80b2900 msgr2=0x7efee8159640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 shutdown_connections 2024-05-10T11:22:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.609+0000 7efeecdb6640 1 -- 172.21.15.66:0/2763951909 wait complete. 2024-05-10T11:22:38.611 INFO:tasks.ceph.mds.c.smithi066.stderr: -1195> 2024-05-10T11:22:32.340+0000 7f60cd8e2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T11:22:38.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:22:38.639 INFO:tasks.ceph.mds.c.smithi066.stdout:starting mds.c at 2024-05-10T11:22:38.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.729+0000 7feb718cc640 1 Processor -- start 2024-05-10T11:22:38.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb718cc640 1 -- start start 2024-05-10T11:22:38.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb718cc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feb6c162a80 0x7feb6c0d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb718cc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feb6c0cfc00 0x7feb6c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb718cc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb6c0d3410 con 0x7feb6c0d1720 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb718cc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c0b64b0 con 0x7feb6c0cfc00 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb718cc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c0d08d0 con 0x7feb6c162a80 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.730+0000 7feb6a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feb6c0cfc00 0x7feb6c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6a7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feb6c0cfc00 0x7feb6c0d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33556/0 (socket says 172.21.15.66:33556) 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6a7fc640 1 -- 172.21.15.66:0/1498212905 learned_addr learned my addr 172.21.15.66:0/1498212905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6b7fe640 1 --1- 172.21.15.66:0/1498212905 >> v1:172.21.15.66:6789/0 conn(0x7feb6c0d1720 0x7feb6c0d1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45726/0 (socket says 172.21.15.66:45726) 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6affd640 1 --2- 172.21.15.66:0/1498212905 >> v2:172.21.15.190:3300/0 conn(0x7feb6c162a80 0x7feb6c0d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6a7fc640 1 -- 172.21.15.66:0/1498212905 >> v2:172.21.15.190:3300/0 conn(0x7feb6c162a80 msgr2=0x7feb6c0d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6a7fc640 1 --2- 172.21.15.66:0/1498212905 >> v2:172.21.15.190:3300/0 conn(0x7feb6c162a80 0x7feb6c0d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6a7fc640 1 -- 172.21.15.66:0/1498212905 >> v1:172.21.15.66:6789/0 conn(0x7feb6c0d1720 legacy=0x7feb6c0d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6a7fc640 1 -- 172.21.15.66:0/1498212905 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c0d0bb0 con 0x7feb6c0cfc00 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb69ffb640 1 -- 172.21.15.66:0/1498212905 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757283945 0 0) 0x7feb6c0d3410 con 0x7feb6c0d1720 2024-05-10T11:22:38.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.731+0000 7feb6affd640 1 --2- 172.21.15.66:0/1498212905 >> v2:172.21.15.190:3300/0 conn(0x7feb6c162a80 0x7feb6c0d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb6a7fc640 1 --2- 172.21.15.66:0/1498212905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0cfc00 0x7feb6c0d0090 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7feb6c08d6b0 tx=0x7feb5c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fb6edd846cd082 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb69ffb640 1 -- 172.21.15.66:0/1498212905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c037070 con 0x7feb6c0cfc00 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb69ffb640 1 -- 172.21.15.66:0/1498212905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c02ae50 con 0x7feb6c0cfc00 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb69ffb640 1 -- 172.21.15.66:0/1498212905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c032860 con 0x7feb6c0cfc00 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 -- 172.21.15.66:0/1498212905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0cfc00 msgr2=0x7feb6c0d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 --2- 172.21.15.66:0/1498212905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0cfc00 0x7feb6c0d0090 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7feb6c08d6b0 tx=0x7feb5c02a300 comp rx=0 tx=0).stop 2024-05-10T11:22:38.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 -- 172.21.15.66:0/1498212905 shutdown_connections 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 --2- 172.21.15.66:0/1498212905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0cfc00 0x7feb6c0d0090 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 --2- 172.21.15.66:0/1498212905 >> v2:172.21.15.190:3300/0 conn(0x7feb6c162a80 0x7feb6c0d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 -- 172.21.15.66:0/1498212905 >> 172.21.15.66:0/1498212905 conn(0x7feb6c0d50f0 msgr2=0x7feb6c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 -- 172.21.15.66:0/1498212905 shutdown_connections 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.732+0000 7feb718cc640 1 -- 172.21.15.66:0/1498212905 wait complete. 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 Processor -- start 2024-05-10T11:22:38.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 -- start start 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6c0cfc00 0x7feb6c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 0x7feb6c0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6c162a80 0x7feb6c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0b6140 con 0x7feb6c0d1720 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0b6790 con 0x7feb6c162a80 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.734+0000 7feb718cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c0d5e40 con 0x7feb6c0cfc00 2024-05-10T11:22:38.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 0x7feb6c0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 0x7feb6c0b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33562/0 (socket says 172.21.15.66:33562) 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 -- 172.21.15.66:0/2621663502 learned_addr learned my addr 172.21.15.66:0/2621663502 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6b7fe640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6c162a80 0x7feb6c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6affd640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6c0cfc00 0x7feb6c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 -- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6c0cfc00 msgr2=0x7feb6c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6c0cfc00 0x7feb6c15c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 -- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6c162a80 msgr2=0x7feb6c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6c162a80 0x7feb6c0ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 -- 172.21.15.66:0/2621663502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c0c9da0 con 0x7feb6c0d1720 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb6a7fc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 0x7feb6c0b2850 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7feb5c02a340 tx=0x7feb5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c041020 con 0x7feb6c0d1720 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c03c670 con 0x7feb6c0d1720 2024-05-10T11:22:38.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c037040 con 0x7feb6c0d1720 2024-05-10T11:22:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6c0b8ce0 con 0x7feb6c0d1720 2024-05-10T11:22:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.735+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6c0b92a0 con 0x7feb6c0d1720 2024-05-10T11:22:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.736+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6c0693f0 con 0x7feb6c0d1720 2024-05-10T11:22:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.737+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb5c044020 con 0x7feb6c0d1720 2024-05-10T11:22:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.737+0000 7feb63fff640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb4c076300 0x7feb4c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.738+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6359+0+0 (secure 0 0 0) 0x7feb5c0b7ec0 con 0x7feb6c0d1720 2024-05-10T11:22:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.738+0000 7feb6affd640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb4c076300 0x7feb4c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.738+0000 7feb6affd640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb4c076300 0x7feb4c0787c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7feb5400d8b0 tx=0x7feb54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.742+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7feb5c04b030 con 0x7feb6c0d1720 2024-05-10T11:22:38.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:38.973+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feb6c0ca7a0 con 0x7feb6c0d1720 2024-05-10T11:22:39.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.607+0000 7feb63fff640 1 -- 172.21.15.66:0/2621663502 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v114) ==== 104+0+0 (secure 0 0 0) 0x7feb5c081590 con 0x7feb6c0d1720 2024-05-10T11:22:39.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb4c076300 msgr2=0x7feb4c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb4c076300 0x7feb4c0787c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7feb5400d8b0 tx=0x7feb54008040 comp rx=0 tx=0).stop 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 msgr2=0x7feb6c0b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 0x7feb6c0b2850 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7feb5c02a340 tx=0x7feb5c0046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 shutdown_connections 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7feb4c076300 0x7feb4c0787c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6c162a80 0x7feb6c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb6c0d1720 0x7feb6c0b2850 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 --2- 172.21.15.66:0/2621663502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6c0cfc00 0x7feb6c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 >> 172.21.15.66:0/2621663502 conn(0x7feb6c0d50f0 msgr2=0x7feb6c06d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:39.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 shutdown_connections 2024-05-10T11:22:39.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.609+0000 7feb718cc640 1 -- 172.21.15.66:0/2621663502 wait complete. 2024-05-10T11:22:39.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:22:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.776+0000 7f7e36390640 1 Processor -- start 2024-05-10T11:22:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.776+0000 7f7e36390640 1 -- start start 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e36390640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e36390640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e30162e00 0x7f7e30163290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e36390640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e300716f0 con 0x7f7e301639a0 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e36390640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f7e300d2510 con 0x7f7e30162e00 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e36390640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7e30070220 con 0x7f7e3015f370 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e30162e00 0x7f7e30163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e30162e00 0x7f7e30163290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33572/0 (socket says 172.21.15.66:33572) 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 -- 172.21.15.66:0/104450796 learned_addr learned my addr 172.21.15.66:0/104450796 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e2ffff640 1 --2- 172.21.15.66:0/104450796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 -- 172.21.15.66:0/104450796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 msgr2=0x7f7e300d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 --2- 172.21.15.66:0/104450796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 -- 172.21.15.66:0/104450796 >> v1:172.21.15.190:6789/0 conn(0x7f7e301639a0 legacy=0x7f7e30070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.777+0000 7f7e3492d640 1 -- 172.21.15.66:0/104450796 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e30070500 con 0x7f7e30162e00 2024-05-10T11:22:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.778+0000 7f7e3492d640 1 --2- 172.21.15.66:0/104450796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e30162e00 0x7f7e30163290 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009e50 tx=0x7f7e2802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946978805f28fa6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:39.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.778+0000 7f7e2effd640 1 -- 172.21.15.66:0/104450796 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28036070 con 0x7f7e30162e00 2024-05-10T11:22:39.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.778+0000 7f7e2effd640 1 -- 172.21.15.66:0/104450796 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28031600 con 0x7f7e30162e00 2024-05-10T11:22:39.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.778+0000 7f7e2effd640 1 -- 172.21.15.66:0/104450796 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e280319d0 con 0x7f7e30162e00 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 -- 172.21.15.66:0/104450796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e30162e00 msgr2=0x7f7e30163290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 --2- 172.21.15.66:0/104450796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e30162e00 0x7f7e30163290 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009e50 tx=0x7f7e2802a7a0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 -- 172.21.15.66:0/104450796 shutdown_connections 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 --2- 172.21.15.66:0/104450796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e30162e00 0x7f7e30163290 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 --2- 172.21.15.66:0/104450796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 -- 172.21.15.66:0/104450796 >> 172.21.15.66:0/104450796 conn(0x7f7e300d2e10 msgr2=0x7f7e300d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 -- 172.21.15.66:0/104450796 shutdown_connections 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.779+0000 7f7e36390640 1 -- 172.21.15.66:0/104450796 wait complete. 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.780+0000 7f7e36390640 1 Processor -- start 2024-05-10T11:22:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.780+0000 7f7e36390640 1 -- start start 2024-05-10T11:22:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e36390640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e36390640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e30162e00 0x7f7e301f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e36390640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 0x7f7e301f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e36390640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7e300d2200 con 0x7f7e301639a0 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e36390640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7e30070ac0 con 0x7f7e30162e00 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e36390640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7e300cd460 con 0x7f7e3015f370 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 0x7f7e301f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 0x7f7e301f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33574/0 (socket says 172.21.15.66:33574) 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 -- 172.21.15.66:0/3656627102 learned_addr learned my addr 172.21.15.66:0/3656627102 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e2ffff640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e2f7fe640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e30162e00 0x7f7e301f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 -- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 msgr2=0x7f7e300c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 -- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e30162e00 msgr2=0x7f7e301f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e30162e00 0x7f7e301f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.781+0000 7f7e3492d640 1 -- 172.21.15.66:0/3656627102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e300c7190 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.782+0000 7f7e3492d640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 0x7f7e301f5870 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009f70 tx=0x7f7e28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.782+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28036050 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.782+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28042070 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.782+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28009510 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.782+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e300c7470 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.782+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e300c7a30 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.783+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3006a220 con 0x7f7e301639a0 2024-05-10T11:22:39.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.783+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e28007bf0 con 0x7f7e301639a0 2024-05-10T11:22:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.784+0000 7f7e2cff9640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7e1c076300 0x7f7e1c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.784+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6359+0+0 (secure 0 0 0) 0x7f7e280b7d90 con 0x7f7e301639a0 2024-05-10T11:22:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.784+0000 7f7e2ffff640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7e1c076300 0x7f7e1c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.785+0000 7f7e2ffff640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7e1c076300 0x7f7e1c0787c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009b40 tx=0x7f7e20009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:39.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.788+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7e2804b020 con 0x7f7e301639a0 2024-05-10T11:22:39.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:39.980+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e300b8d90 con 0x7f7e301639a0 2024-05-10T11:22:40.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.908+0000 7f7e2cff9640 1 -- 172.21.15.66:0/3656627102 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) ==== 181+0+0 (secure 0 0 0) 0x7f7e28080e10 con 0x7f7e301639a0 2024-05-10T11:22:40.909 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:22:40.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7e1c076300 msgr2=0x7f7e1c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:40.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7e1c076300 0x7f7e1c0787c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009b40 tx=0x7f7e20009190 comp rx=0 tx=0).stop 2024-05-10T11:22:40.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 msgr2=0x7f7e301f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 0x7f7e301f5870 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009f70 tx=0x7f7e28004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 shutdown_connections 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f7e1c076300 0x7f7e1c0787c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e301639a0 0x7f7e301f5870 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e30162e00 0x7f7e301f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 --2- 172.21.15.66:0/3656627102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e3015f370 0x7f7e300c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 >> 172.21.15.66:0/3656627102 conn(0x7f7e300d2e10 msgr2=0x7f7e301631e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 shutdown_connections 2024-05-10T11:22:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:40.912+0000 7f7e36390640 1 -- 172.21.15.66:0/3656627102 wait complete. 2024-05-10T11:22:40.927 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:22:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.041+0000 7faf140da640 1 Processor -- start 2024-05-10T11:22:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.041+0000 7faf140da640 1 -- start start 2024-05-10T11:22:41.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf140da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faf0c1639a0 0x7faf0c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf140da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faf0c071520 0x7faf0c162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf140da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c0d2510 con 0x7faf0c15f370 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf140da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c070220 con 0x7faf0c071520 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf140da640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c070500 con 0x7faf0c1639a0 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf12677640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faf0c071520 0x7faf0c162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf11e76640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7faf0c15f370 0x7faf0c0d1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45734/0 (socket says 172.21.15.66:45734) 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf11e76640 1 -- 172.21.15.66:0/2950569600 learned_addr learned my addr 172.21.15.66:0/2950569600 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf11675640 1 --2- 172.21.15.66:0/2950569600 >> v2:172.21.15.190:3300/0 conn(0x7faf0c1639a0 0x7faf0c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf12677640 1 -- 172.21.15.66:0/2950569600 >> v2:172.21.15.190:3300/0 conn(0x7faf0c1639a0 msgr2=0x7faf0c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf12677640 1 --2- 172.21.15.66:0/2950569600 >> v2:172.21.15.190:3300/0 conn(0x7faf0c1639a0 0x7faf0c070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf12677640 1 -- 172.21.15.66:0/2950569600 >> v1:172.21.15.66:6789/0 conn(0x7faf0c15f370 legacy=0x7faf0c0d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.042+0000 7faf10e74640 1 -- 172.21.15.66:0/2950569600 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137761786 0 0) 0x7faf0c0d2510 con 0x7faf0c15f370 2024-05-10T11:22:41.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.043+0000 7faf12677640 1 -- 172.21.15.66:0/2950569600 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0707e0 con 0x7faf0c071520 2024-05-10T11:22:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.043+0000 7faf11675640 1 --2- 172.21.15.66:0/2950569600 >> v2:172.21.15.190:3300/0 conn(0x7faf0c1639a0 0x7faf0c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.043+0000 7faf12677640 1 --2- 172.21.15.66:0/2950569600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c071520 0x7faf0c162e00 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0c6910 tx=0x7faf0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d167be8c9ea26f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.043+0000 7faf10e74640 1 -- 172.21.15.66:0/2950569600 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04037070 con 0x7faf0c071520 2024-05-10T11:22:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.043+0000 7faf10e74640 1 -- 172.21.15.66:0/2950569600 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf04032440 con 0x7faf0c071520 2024-05-10T11:22:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.043+0000 7faf10e74640 1 -- 172.21.15.66:0/2950569600 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04032810 con 0x7faf0c071520 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 -- 172.21.15.66:0/2950569600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c071520 msgr2=0x7faf0c162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 --2- 172.21.15.66:0/2950569600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c071520 0x7faf0c162e00 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0c6910 tx=0x7faf0402a230 comp rx=0 tx=0).stop 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 -- 172.21.15.66:0/2950569600 shutdown_connections 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 --2- 172.21.15.66:0/2950569600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c071520 0x7faf0c162e00 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 --2- 172.21.15.66:0/2950569600 >> v2:172.21.15.190:3300/0 conn(0x7faf0c1639a0 0x7faf0c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 -- 172.21.15.66:0/2950569600 >> 172.21.15.66:0/2950569600 conn(0x7faf0c0d2e10 msgr2=0x7faf0c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 -- 172.21.15.66:0/2950569600 shutdown_connections 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.044+0000 7faf140da640 1 -- 172.21.15.66:0/2950569600 wait complete. 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.045+0000 7faf140da640 1 Processor -- start 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.045+0000 7faf140da640 1 -- start start 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf140da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf0c15f370 0x7faf0c09cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf140da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 0x7faf0c14c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf140da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf0c0a01f0 0x7faf0c09d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf140da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c1634c0 con 0x7faf0c1639a0 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf140da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c163340 con 0x7faf0c0a01f0 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf140da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c163640 con 0x7faf0c15f370 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf11675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 0x7faf0c14c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf11675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 0x7faf0c14c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33592/0 (socket says 172.21.15.66:33592) 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf11675640 1 -- 172.21.15.66:0/2576135233 learned_addr learned my addr 172.21.15.66:0/2576135233 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:41.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf12677640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf0c0a01f0 0x7faf0c09d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.046+0000 7faf11e76640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf0c15f370 0x7faf0c09cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf11675640 1 -- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf0c15f370 msgr2=0x7faf0c09cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf11675640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf0c15f370 0x7faf0c09cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf11675640 1 -- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf0c0a01f0 msgr2=0x7faf0c09d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf11675640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf0c0a01f0 0x7faf0c09d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf11675640 1 -- 172.21.15.66:0/2576135233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c09d1d0 con 0x7faf0c1639a0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf11675640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 0x7faf0c14c190 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7faf0000c820 tx=0x7faf0000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00015070 con 0x7faf0c1639a0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf00007a30 con 0x7faf0c1639a0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c0a0760 con 0x7faf0c1639a0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00007e00 con 0x7faf0c1639a0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.047+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c15fad0 con 0x7faf0c1639a0 2024-05-10T11:22:41.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.048+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c06a220 con 0x7faf0c1639a0 2024-05-10T11:22:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.049+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf00018070 con 0x7faf0c1639a0 2024-05-10T11:22:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.049+0000 7faf0a7fc640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faef80762d0 0x7faef8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.049+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5921+0+0 (secure 0 0 0) 0x7faf000975a0 con 0x7faf0c1639a0 2024-05-10T11:22:41.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.050+0000 7faf11e76640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faef80762d0 0x7faef8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:41.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.050+0000 7faf11e76640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faef80762d0 0x7faef8078790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faefc0012e0 tx=0x7faefc001700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:41.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.054+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7faf000607d0 con 0x7faf0c1639a0 2024-05-10T11:22:41.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.243+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faf0c0c66f0 con 0x7faf0c1639a0 2024-05-10T11:22:41.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.913+0000 7faf0a7fc640 1 -- 172.21.15.66:0/2576135233 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) ==== 169+0+0 (secure 0 0 0) 0x7faf00064ad0 con 0x7faf0c1639a0 2024-05-10T11:22:41.914 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faef80762d0 msgr2=0x7faef8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faef80762d0 0x7faef8078790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faefc0012e0 tx=0x7faefc001700 comp rx=0 tx=0).stop 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 msgr2=0x7faf0c14c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 0x7faf0c14c190 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7faf0000c820 tx=0x7faf0000cc20 comp rx=0 tx=0).stop 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 shutdown_connections 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7faef80762d0 0x7faef8078790 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf0c0a01f0 0x7faf0c09d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf0c1639a0 0x7faf0c14c190 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 --2- 172.21.15.66:0/2576135233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf0c15f370 0x7faf0c09cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:41.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 >> 172.21.15.66:0/2576135233 conn(0x7faf0c0d2e10 msgr2=0x7faf0c06e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:41.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.917+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 shutdown_connections 2024-05-10T11:22:41.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:41.918+0000 7faf140da640 1 -- 172.21.15.66:0/2576135233 wait complete. 2024-05-10T11:22:41.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T11:22:42.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.042+0000 7f269e845640 1 Processor -- start 2024-05-10T11:22:42.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.042+0000 7f269e845640 1 -- start start 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f269e845640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 0x7f26980b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f269e845640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f26980b4e20 0x7f26980d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f269e845640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26980d4190 con 0x7f2698162900 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f269e845640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f26980cfc40 con 0x7f26980b4e20 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f269e845640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f26980d3eb0 con 0x7f2698162ce0 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2697fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2698162900 0x7f26980d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45748/0 (socket says 172.21.15.66:45748) 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2697fff640 1 -- 172.21.15.66:0/2457770261 learned_addr learned my addr 172.21.15.66:0/2457770261 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:42.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f26977fe640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 0x7f26980b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f269cde2640 1 --2- 172.21.15.66:0/2457770261 >> v2:172.21.15.190:3300/0 conn(0x7f26980b4e20 0x7f26980d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269860175 0 0) 0x7f2688001110 con 0x7f2698162900 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2680003520 con 0x7f2698162900 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2377208989 0 0) 0x7f2680003520 con 0x7f2698162900 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 msgr2=0x7f26980b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 0x7f26980b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 >> v2:172.21.15.190:3300/0 conn(0x7f26980b4e20 msgr2=0x7f26980d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 --2- 172.21.15.66:0/2457770261 >> v2:172.21.15.190:3300/0 conn(0x7f26980b4e20 0x7f26980d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26980cfee0 con 0x7f2698162900 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f2688001840 con 0x7f2698162900 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 >> v1:172.21.15.66:6789/0 conn(0x7f2698162900 legacy=0x7f26980d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26800039b0 0x7f2680003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.043+0000 7f2696ffd640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2680004800 0x7f2680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2696ffd640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 0x7f26800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26980cfc40 con 0x7f26800039b0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f26980d3eb0 con 0x7f2680004800 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f268000b9c0 con 0x7f2698162ce0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2697fff640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26800039b0 0x7f2680003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f26977fe640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2680004800 0x7f2680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f269cde2640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 0x7f26800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2697fff640 1 -- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 msgr2=0x7f26800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2697fff640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698162ce0 0x7f26800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2697fff640 1 -- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2680004800 msgr2=0x7f2680004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2697fff640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2680004800 0x7f2680004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.044+0000 7f2697fff640 1 -- 172.21.15.66:0/2457770261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2680003520 con 0x7f26800039b0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f2697fff640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26800039b0 0x7f2680003dd0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f268800c3e0 tx=0x7f2680005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794c807235d97d44 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268800c0e0 con 0x7f26800039b0 2024-05-10T11:22:42.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2688034070 con 0x7f26800039b0 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f2696ffd640 1 -- 172.21.15.66:0/2457770261 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2688005d10 con 0x7f26800039b0 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269e845640 1 -- 172.21.15.66:0/2457770261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26800039b0 msgr2=0x7f2680003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269e845640 1 --2- 172.21.15.66:0/2457770261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26800039b0 0x7f2680003dd0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f268800c3e0 tx=0x7f2680005830 comp rx=0 tx=0).stop 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269cde2640 1 -- 172.21.15.66:0/2457770261 reap_dead start 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269e845640 1 -- 172.21.15.66:0/2457770261 shutdown_connections 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269e845640 1 -- 172.21.15.66:0/2457770261 >> 172.21.15.66:0/2457770261 conn(0x7f269809e430 msgr2=0x7f26980d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269e845640 1 -- 172.21.15.66:0/2457770261 shutdown_connections 2024-05-10T11:22:42.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.045+0000 7f269e845640 1 -- 172.21.15.66:0/2457770261 wait complete. 2024-05-10T11:22:42.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.047+0000 7f269e845640 1 Processor -- start 2024-05-10T11:22:42.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.047+0000 7f269e845640 1 -- start start 2024-05-10T11:22:42.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.047+0000 7f269e845640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26800039b0 0x7f269815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 0x7f26980b9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f269815e370 0x7f269815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26980b4180 con 0x7f26980b48e0 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f26980d3b20 con 0x7f269815e370 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f26980b4300 con 0x7f26800039b0 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 0x7f26980b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 0x7f26980b9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33610/0 (socket says 172.21.15.66:33610) 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 -- 172.21.15.66:0/1358535445 learned_addr learned my addr 172.21.15.66:0/1358535445 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f2697fff640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26800039b0 0x7f269815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269cde2640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f269815e370 0x7f269815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 -- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26800039b0 msgr2=0x7f269815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26800039b0 0x7f269815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 -- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f269815e370 msgr2=0x7f269815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f269815e370 0x7f269815bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 -- 172.21.15.66:0/1358535445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26980cf130 con 0x7f26980b48e0 2024-05-10T11:22:42.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269cde2640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f269815e370 0x7f269815bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f26977fe640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 0x7f26980b9300 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f268c0118e0 tx=0x7f268c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c00fa90 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c00fc30 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26981f5bc0 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c014440 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.048+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26980b8b00 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.050+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269806a220 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.050+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f268c012040 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.051+0000 7f2694ff9640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2684076300 0x7f26840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.051+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f268c097bd0 con 0x7f26980b48e0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.051+0000 7f2697fff640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2684076300 0x7f26840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.051+0000 7f2697fff640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2684076300 0x7f26840787c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2688033000 tx=0x7f2688009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:42.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.055+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f268c019030 con 0x7f26980b48e0 2024-05-10T11:22:42.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.246+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f269809e840 con 0x7f26980b48e0 2024-05-10T11:22:42.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.249+0000 7f2694ff9640 1 -- 172.21.15.66:0/1358535445 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f268c0615f0 con 0x7f26980b48e0 2024-05-10T11:22:42.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2684076300 msgr2=0x7f26840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2684076300 0x7f26840787c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2688033000 tx=0x7f2688009030 comp rx=0 tx=0).stop 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 msgr2=0x7f26980b9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 0x7f26980b9300 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f268c0118e0 tx=0x7f268c011da0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 shutdown_connections 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2684076300 0x7f26840787c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f269815e370 0x7f269815bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26980b48e0 0x7f26980b9300 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 --2- 172.21.15.66:0/1358535445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26800039b0 0x7f269815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 >> 172.21.15.66:0/1358535445 conn(0x7f269809e430 msgr2=0x7f269806e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 shutdown_connections 2024-05-10T11:22:42.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.251+0000 7f269e845640 1 -- 172.21.15.66:0/1358535445 wait complete. 2024-05-10T11:22:42.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-05-10T11:22:42.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.366+0000 7f6ff7859640 1 Processor -- start 2024-05-10T11:22:42.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.366+0000 7f6ff7859640 1 -- start start 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff7859640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 0x7f6ff00d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff7859640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ff0162b30 0x7f6ff00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff7859640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff00b45f0 con 0x7f6ff00d5cb0 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff7859640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff00b4f20 con 0x7f6ff0162b30 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff7859640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff00d0fe0 con 0x7f6ff0162750 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff55f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 0x7f6ff00d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff5df6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ff0162b30 0x7f6ff00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff55f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 0x7f6ff00d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:41262/0 (socket says 172.21.15.66:41262) 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6ff55f5640 1 -- 172.21.15.66:0/1096509565 learned_addr learned my addr 172.21.15.66:0/1096509565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:42.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.367+0000 7f6fe7fff640 1 -- 172.21.15.66:0/1096509565 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964505298 0 0) 0x7f6ff00b45f0 con 0x7f6ff00d5cb0 2024-05-10T11:22:42.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6fe7fff640 1 -- 172.21.15.66:0/1096509565 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fdc003520 con 0x7f6ff00d5cb0 2024-05-10T11:22:42.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6ff55f5640 1 -- 172.21.15.66:0/1096509565 >> v2:172.21.15.190:3300/0 conn(0x7f6ff0162b30 msgr2=0x7f6ff00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:42.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6ff55f5640 1 --2- 172.21.15.66:0/1096509565 >> v2:172.21.15.190:3300/0 conn(0x7f6ff0162b30 0x7f6ff00b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6ff55f5640 1 -- 172.21.15.66:0/1096509565 >> v1:172.21.15.190:6789/0 conn(0x7f6ff00d5cb0 legacy=0x7f6ff00d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6ff55f5640 1 -- 172.21.15.66:0/1096509565 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00b48d0 con 0x7f6ff0162750 2024-05-10T11:22:42.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6ff5df6640 1 --2- 172.21.15.66:0/1096509565 >> v2:172.21.15.190:3300/0 conn(0x7f6ff0162b30 0x7f6ff00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:42.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.368+0000 7f6ff55f5640 1 --2- 172.21.15.66:0/1096509565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 0x7f6ff00d0670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e50 tx=0x7f6fec02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e421abf32f42d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:42.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6fe7fff640 1 -- 172.21.15.66:0/1096509565 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec036070 con 0x7f6ff0162750 2024-05-10T11:22:42.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6fe7fff640 1 -- 172.21.15.66:0/1096509565 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec031600 con 0x7f6ff0162750 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6fe7fff640 1 -- 172.21.15.66:0/1096509565 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0319b0 con 0x7f6ff0162750 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 -- 172.21.15.66:0/1096509565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 msgr2=0x7f6ff00d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 --2- 172.21.15.66:0/1096509565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 0x7f6ff00d0670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e50 tx=0x7f6fec02a680 comp rx=0 tx=0).stop 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 -- 172.21.15.66:0/1096509565 shutdown_connections 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 --2- 172.21.15.66:0/1096509565 >> v2:172.21.15.190:3300/0 conn(0x7f6ff0162b30 0x7f6ff00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 --2- 172.21.15.66:0/1096509565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff0162750 0x7f6ff00d0670 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 -- 172.21.15.66:0/1096509565 >> 172.21.15.66:0/1096509565 conn(0x7f6ff009e3b0 msgr2=0x7f6ff00d5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 -- 172.21.15.66:0/1096509565 shutdown_connections 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.369+0000 7f6ff7859640 1 -- 172.21.15.66:0/1096509565 wait complete. 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.370+0000 7f6ff7859640 1 Processor -- start 2024-05-10T11:22:42.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.370+0000 7f6ff7859640 1 -- start start 2024-05-10T11:22:42.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff7859640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff0162750 0x7f6ff00cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff7859640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 0x7f6ff00ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff7859640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff00cea80 0x7f6ff014c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff7859640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff00d0d30 con 0x7f6ff0162b30 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff7859640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff00d0bb0 con 0x7f6ff0162750 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff7859640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff00d3d40 con 0x7f6ff00cea80 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff4df4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 0x7f6ff00ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff4df4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 0x7f6ff00ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33614/0 (socket says 172.21.15.66:33614) 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff4df4640 1 -- 172.21.15.66:0/2253479408 learned_addr learned my addr 172.21.15.66:0/2253479408 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff55f5640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff0162750 0x7f6ff00cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.371+0000 7f6ff5df6640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff00cea80 0x7f6ff014c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff4df4640 1 -- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff00cea80 msgr2=0x7f6ff014c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff4df4640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff00cea80 0x7f6ff014c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff4df4640 1 -- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff0162750 msgr2=0x7f6ff00cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff4df4640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff0162750 0x7f6ff00cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff4df4640 1 -- 172.21.15.66:0/2253479408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00cd4a0 con 0x7f6ff0162b30 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff4df4640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 0x7f6ff00ce540 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c500 tx=0x7f6fe000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0017070 con 0x7f6ff0162b30 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe00052f0 con 0x7f6ff0162b30 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff00cd780 con 0x7f6ff0162b30 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0003830 con 0x7f6ff0162b30 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.372+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff00cdd40 con 0x7f6ff0162b30 2024-05-10T11:22:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.373+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff006a220 con 0x7f6ff0162b30 2024-05-10T11:22:42.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.374+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6fe001a070 con 0x7f6ff0162b30 2024-05-10T11:22:42.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.374+0000 7f6fe5ffb640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6fd4076300 0x7f6fd40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:42.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.374+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f6fe00967b0 con 0x7f6ff0162b30 2024-05-10T11:22:42.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.375+0000 7f6ff55f5640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6fd4076300 0x7f6fd40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:42.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.375+0000 7f6ff55f5640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6fd4076300 0x7f6fd40787c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6fec033000 tx=0x7f6fec009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:42.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.379+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6fe005fb80 con 0x7f6ff0162b30 2024-05-10T11:22:42.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.646+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f6ff00cf250 con 0x7f6ff0162b30 2024-05-10T11:22:42.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.914+0000 7f6fe5ffb640 1 -- 172.21.15.66:0/2253479408 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v480) ==== 144+0+0 (secure 0 0 0) 0x7f6fe00681c0 con 0x7f6ff0162b30 2024-05-10T11:22:42.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6fd4076300 msgr2=0x7f6fd40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6fd4076300 0x7f6fd40787c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6fec033000 tx=0x7f6fec009000 comp rx=0 tx=0).stop 2024-05-10T11:22:42.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 msgr2=0x7f6ff00ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:42.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 0x7f6ff00ce540 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c500 tx=0x7f6fe000c900 comp rx=0 tx=0).stop 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 shutdown_connections 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6fd4076300 0x7f6fd40787c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff00cea80 0x7f6ff014c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff0162b30 0x7f6ff00ce540 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 --2- 172.21.15.66:0/2253479408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff0162750 0x7f6ff00cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 >> 172.21.15.66:0/2253479408 conn(0x7f6ff009e3b0 msgr2=0x7f6ff00d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 shutdown_connections 2024-05-10T11:22:42.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:42.917+0000 7f6ff7859640 1 -- 172.21.15.66:0/2253479408 wait complete. 2024-05-10T11:22:42.929 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-05-10T11:22:42.929 INFO:tasks.cephfs_test_runner: 2024-05-10T11:22:42.929 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T11:22:42.929 INFO:tasks.cephfs_test_runner:Ran 7 tests in 582.546s 2024-05-10T11:22:42.929 INFO:tasks.cephfs_test_runner: 2024-05-10T11:22:42.929 INFO:tasks.cephfs_test_runner:OK 2024-05-10T11:22:42.930 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-10T11:22:42.939 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T11:22:42.946 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T11:22:42.947 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:42.947 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:42.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:22:42.964 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-10T11:22:42.964 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:43.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056312,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13669 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T11:22:43.021 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:22:43.021 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:43.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:22:43.041 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-05-10T11:22:43.041 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:22:43.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056337,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16302 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T11:22:43.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.101 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:22:43.122 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T11:22:43.122 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:22:43.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T11:22:43.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:22:43.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.259 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-05-10T11:22:43.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.359 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-05-10T11:22:43.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.376 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-05-10T11:22:43.445 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2024-05-10T11:22:43.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:22:43.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.447 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-05-10T11:22:43.467 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-10T11:22:43.467 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T11:22:43.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.467 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T11:22:43.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.538 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T11:22:43.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.612 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2024-05-10T11:22:43.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.703 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-05-10T11:22:43.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:22:43.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2024-05-10T11:22:43.789 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2024-05-10T11:22:43.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:22:43.791 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T11:22:43.800 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T11:22:43.800 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:22:43.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.908+0000 7f0332719640 1 Processor -- start 2024-05-10T11:22:43.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.908+0000 7f0332719640 1 -- start start 2024-05-10T11:22:43.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0332719640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f032c0cf170 0x7f032c15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0332719640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032c0c74c0 con 0x7f032c0cf5d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0332719640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032c0c5d10 con 0x7f032c15b6d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0332719640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f032c0cc380 con 0x7f032c0cf170 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0330cb6640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f032c0cf5d0 0x7f032c06dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45762/0 (socket says 172.21.15.66:45762) 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0330cb6640 1 -- 172.21.15.66:0/1139123055 learned_addr learned my addr 172.21.15.66:0/1139123055 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f0323fff640 1 --2- 172.21.15.66:0/1139123055 >> v2:172.21.15.190:3300/0 conn(0x7f032c0cf170 0x7f032c15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.909+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034035847 0 0) 0x7f032c0c74c0 con 0x7f032c0cf5d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0318003520 con 0x7f032c0cf5d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248320944 0 0) 0x7f032c0c5d10 con 0x7f032c15b6d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f032c0c74c0 con 0x7f032c15b6d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 337225415 0 0) 0x7f0318003520 con 0x7f032c0cf5d0 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 >> v2:172.21.15.190:3300/0 conn(0x7f032c0cf170 msgr2=0x7f032c15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 --2- 172.21.15.66:0/1139123055 >> v2:172.21.15.190:3300/0 conn(0x7f032c0cf170 0x7f032c15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:43.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 >> v1:172.21.15.190:6789/0 conn(0x7f032c15b6d0 legacy=0x7f032c0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c0c5ff0 con 0x7f032c0cf5d0 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f03240019f0 con 0x7f032c0cf5d0 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 >> v1:172.21.15.66:6789/0 conn(0x7f032c0cf5d0 legacy=0x7f032c06dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0318003b90 0x7f0318003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0318004800 0x7f0318004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03180051c0 0x7f031800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f031800bfb0 con 0x7f0318003b90 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f031800c160 con 0x7f0318004800 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f031800c360 con 0x7f03180051c0 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032bfff640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0318003b90 0x7f0318003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f0323fff640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0318004800 0x7f0318004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f0330cb6640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03180051c0 0x7f031800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032bfff640 1 -- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03180051c0 msgr2=0x7f031800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:43.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032bfff640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03180051c0 0x7f031800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032bfff640 1 -- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0318004800 msgr2=0x7f0318004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032bfff640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0318004800 0x7f0318004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f032bfff640 1 -- 172.21.15.66:0/1139123055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0318003520 con 0x7f0318003b90 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.910+0000 7f0330cb6640 1 -- 172.21.15.66:0/1139123055 reap_dead start 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.911+0000 7f032bfff640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0318003b90 0x7f0318003f90 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f031c0014b0 tx=0x7f0318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ae90133633715c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.911+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c0014f0 con 0x7f0318003b90 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.911+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c02ce50 con 0x7f0318003b90 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.911+0000 7f032b7fe640 1 -- 172.21.15.66:0/1139123055 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c0052d0 con 0x7f0318003b90 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 -- 172.21.15.66:0/1139123055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0318003b90 msgr2=0x7f0318003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0318003b90 0x7f0318003f90 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f031c0014b0 tx=0x7f0318005830 comp rx=0 tx=0).stop 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 -- 172.21.15.66:0/1139123055 shutdown_connections 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 --2- 172.21.15.66:0/1139123055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0318003b90 0x7f0318003f90 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 -- 172.21.15.66:0/1139123055 >> 172.21.15.66:0/1139123055 conn(0x7f032c0b2900 msgr2=0x7f032c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:43.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 -- 172.21.15.66:0/1139123055 shutdown_connections 2024-05-10T11:22:43.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.912+0000 7f0332719640 1 -- 172.21.15.66:0/1139123055 wait complete. 2024-05-10T11:22:43.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.913+0000 7f0332719640 1 Processor -- start 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.913+0000 7f0332719640 1 -- start start 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0332719640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0318003b90 0x7f032c0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0332719640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 0x7f032c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0332719640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c1f5180 0x7f032c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0332719640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f032c0c6890 con 0x7f032c1f7f70 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0332719640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f032c0c65b0 con 0x7f032c1f5180 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0332719640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f032c0cd170 con 0x7f0318003b90 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 0x7f032c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 0x7f032c1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33632/0 (socket says 172.21.15.66:33632) 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 -- 172.21.15.66:0/481940186 learned_addr learned my addr 172.21.15.66:0/481940186 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f032bfff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0318003b90 0x7f032c0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0330cb6640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c1f5180 0x7f032c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 -- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0318003b90 msgr2=0x7f032c0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0318003b90 0x7f032c0ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 -- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c1f5180 msgr2=0x7f032c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c1f5180 0x7f032c06e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 -- 172.21.15.66:0/481940186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c1f83f0 con 0x7f032c1f7f70 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f032bfff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0318003b90 0x7f032c0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0330cb6640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c1f5180 0x7f032c06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.914+0000 7f0323fff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 0x7f032c1560c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f0314011960 tx=0x7f0314011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.915+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031400faf0 con 0x7f032c1f7f70 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.915+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031400fc90 con 0x7f032c1f7f70 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.915+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c1f86a0 con 0x7f032c1f7f70 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.915+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314014440 con 0x7f032c1f7f70 2024-05-10T11:22:43.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.915+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c1f8c60 con 0x7f032c1f7f70 2024-05-10T11:22:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.916+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c06a220 con 0x7f032c1f7f70 2024-05-10T11:22:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.917+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0314012040 con 0x7f032c1f7f70 2024-05-10T11:22:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.917+0000 7f03297fa640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f030c0762d0 0x7f030c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.917+0000 7f032bfff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f030c0762d0 0x7f030c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.918+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f0314096270 con 0x7f032c1f7f70 2024-05-10T11:22:43.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.918+0000 7f032bfff640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f030c0762d0 0x7f030c078790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f031c034000 tx=0x7f031c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:43.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:43.922+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0314019030 con 0x7f032c1f7f70 2024-05-10T11:22:44.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.109+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f032c075250 con 0x7f030c0762d0 2024-05-10T11:22:44.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.111+0000 7f03297fa640 1 -- 172.21.15.66:0/481940186 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7f032c075250 con 0x7f030c0762d0 2024-05-10T11:22:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:44.111 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:22:44.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f030c0762d0 msgr2=0x7f030c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f030c0762d0 0x7f030c078790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f031c034000 tx=0x7f031c009030 comp rx=0 tx=0).stop 2024-05-10T11:22:44.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 msgr2=0x7f032c1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 0x7f032c1560c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f0314011960 tx=0x7f0314011e20 comp rx=0 tx=0).stop 2024-05-10T11:22:44.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 shutdown_connections 2024-05-10T11:22:44.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f030c0762d0 0x7f030c078790 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c1f5180 0x7f032c06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f032c1f7f70 0x7f032c1560c0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 --2- 172.21.15.66:0/481940186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0318003b90 0x7f032c0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 >> 172.21.15.66:0/481940186 conn(0x7f032c0b2900 msgr2=0x7f032c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 shutdown_connections 2024-05-10T11:22:44.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.113+0000 7f0332719640 1 -- 172.21.15.66:0/481940186 wait complete. 2024-05-10T11:22:44.124 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-05-10T11:22:43.842465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":274708,"kb_used_data":25272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754700012,"statfs":{"total":773094113280,"available":772812812288,"internally_reserved":0,"allocated":25878528,"data_stored":19390781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-172,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001658"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-10T11:22:26.854973+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:22:26.854973+0000","last_peered":"2024-05-10T11:22:26.854973+0000","last_clean":"2024-05-10T11:22:26.854973+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:26.854973+0000","last_undegraded":"2024-05-10T11:22:26.854973+0000","last_fullsized":"2024-05-10T11:22:26.854973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509569,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2101248,"data_stored":1285206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509569,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":5552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":5685248,"data_stored":4888941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":5701632,"data_stored":4889488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542273,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":707267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":707272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542273,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2113536,"data_stored":1297640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5709824,"data_stored":4901571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:22:44.125 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:22:44.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.228+0000 7f2e5fa99640 1 Processor -- start 2024-05-10T11:22:44.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.228+0000 7f2e5fa99640 1 -- start start 2024-05-10T11:22:44.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5fa99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580d3450 0x7f2e580d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5fa99640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e580702e0 0x7f2e5806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5fa99640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5806f3c0 con 0x7f2e5815f290 2024-05-10T11:22:44.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5fa99640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f2e580d14c0 con 0x7f2e580702e0 2024-05-10T11:22:44.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5fa99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e580d2300 con 0x7f2e580d3450 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5e036640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e580702e0 0x7f2e5806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5e036640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e580702e0 0x7f2e5806d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33634/0 (socket says 172.21.15.66:33634) 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.229+0000 7f2e5e036640 1 -- 172.21.15.66:0/1567027990 learned_addr learned my addr 172.21.15.66:0/1567027990 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.230+0000 7f2e5d034640 1 --2- 172.21.15.66:0/1567027990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580d3450 0x7f2e580d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.230+0000 7f2e5e036640 1 -- 172.21.15.66:0/1567027990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580d3450 msgr2=0x7f2e580d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.230+0000 7f2e5e036640 1 --2- 172.21.15.66:0/1567027990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580d3450 0x7f2e580d0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.230+0000 7f2e5e036640 1 -- 172.21.15.66:0/1567027990 >> v1:172.21.15.190:6789/0 conn(0x7f2e5815f290 legacy=0x7f2e580d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.230+0000 7f2e5e036640 1 -- 172.21.15.66:0/1567027990 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e580d16f0 con 0x7f2e580702e0 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.230+0000 7f2e5e036640 1 --2- 172.21.15.66:0/1567027990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580702e0 0x7f2e5806d9f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009e50 tx=0x7f2e4802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fa20420ecf703f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5c833640 1 -- 172.21.15.66:0/1567027990 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48036070 con 0x7f2e580702e0 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5c833640 1 -- 172.21.15.66:0/1567027990 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e48031600 con 0x7f2e580702e0 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5c833640 1 -- 172.21.15.66:0/1567027990 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e480319d0 con 0x7f2e580702e0 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1567027990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580702e0 msgr2=0x7f2e5806d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1567027990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580702e0 0x7f2e5806d9f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009e50 tx=0x7f2e4802a7a0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1567027990 shutdown_connections 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1567027990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580702e0 0x7f2e5806d9f0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1567027990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580d3450 0x7f2e580d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1567027990 >> 172.21.15.66:0/1567027990 conn(0x7f2e5809ba20 msgr2=0x7f2e5809be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:44.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1567027990 shutdown_connections 2024-05-10T11:22:44.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.231+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1567027990 wait complete. 2024-05-10T11:22:44.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.232+0000 7f2e5fa99640 1 Processor -- start 2024-05-10T11:22:44.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 -- start start 2024-05-10T11:22:44.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580702e0 0x7f2e581f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 0x7f2e58157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e5815f290 0x7f2e581608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e580d1f90 con 0x7f2e580d3450 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2e580d1cb0 con 0x7f2e5815f290 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5fa99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5815f670 con 0x7f2e580702e0 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5d034640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 0x7f2e58157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5d034640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 0x7f2e58157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33640/0 (socket says 172.21.15.66:33640) 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.233+0000 7f2e5d034640 1 -- 172.21.15.66:0/1248853284 learned_addr learned my addr 172.21.15.66:0/1248853284 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5e036640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e5815f290 0x7f2e581608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d835640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580702e0 0x7f2e581f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d034640 1 -- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580702e0 msgr2=0x7f2e581f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d034640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580702e0 0x7f2e581f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d034640 1 -- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e5815f290 msgr2=0x7f2e581608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d034640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e5815f290 0x7f2e581608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d034640 1 -- 172.21.15.66:0/1248853284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e58158870 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5e036640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e5815f290 0x7f2e581608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5d034640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 0x7f2e58157c20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00e9b0 tx=0x7f2e4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c017070 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00c9a0 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e58158590 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00cd90 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.234+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e580c6ea0 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.235+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e580693f0 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.236+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e4c01a070 con 0x7f2e580d3450 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.236+0000 7f2e567fc640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e440762d0 0x7f2e44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.236+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f2e4c0974f0 con 0x7f2e580d3450 2024-05-10T11:22:44.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.236+0000 7f2e5d835640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e440762d0 0x7f2e44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.237+0000 7f2e5d835640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e440762d0 0x7f2e44078790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2e50007fd0 tx=0x7f2e50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.240+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2e58158870 con 0x7f2e580d3450 2024-05-10T11:22:44.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.426+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e5815b980 con 0x7f2e440762d0 2024-05-10T11:22:44.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.428+0000 7f2e567fc640 1 -- 172.21.15.66:0/1248853284 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7f2e5815b980 con 0x7f2e440762d0 2024-05-10T11:22:44.428 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:44.428 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:22:44.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e440762d0 msgr2=0x7f2e44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e440762d0 0x7f2e44078790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2e50007fd0 tx=0x7f2e50009040 comp rx=0 tx=0).stop 2024-05-10T11:22:44.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 msgr2=0x7f2e58157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 0x7f2e58157c20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00e9b0 tx=0x7f2e4c00ee70 comp rx=0 tx=0).stop 2024-05-10T11:22:44.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 shutdown_connections 2024-05-10T11:22:44.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f2e440762d0 0x7f2e44078790 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e5815f290 0x7f2e581608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e580d3450 0x7f2e58157c20 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 --2- 172.21.15.66:0/1248853284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e580702e0 0x7f2e581f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 >> 172.21.15.66:0/1248853284 conn(0x7f2e5809ba20 msgr2=0x7f2e580d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:44.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 shutdown_connections 2024-05-10T11:22:44.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.430+0000 7f2e5fa99640 1 -- 172.21.15.66:0/1248853284 wait complete. 2024-05-10T11:22:44.441 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-05-10T11:22:43.842465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":274708,"kb_used_data":25272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754700012,"statfs":{"total":773094113280,"available":772812812288,"internally_reserved":0,"allocated":25878528,"data_stored":19390781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-172,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001658"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-10T11:22:26.854973+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:22:26.854973+0000","last_peered":"2024-05-10T11:22:26.854973+0000","last_clean":"2024-05-10T11:22:26.854973+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:26.854973+0000","last_undegraded":"2024-05-10T11:22:26.854973+0000","last_fullsized":"2024-05-10T11:22:26.854973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509569,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2101248,"data_stored":1285206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509569,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":5552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":5685248,"data_stored":4888941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":5701632,"data_stored":4889488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542273,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":707267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":707272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542273,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2113536,"data_stored":1297640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5709824,"data_stored":4901571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:22:44.441 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T11:22:44.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:22:44.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.545+0000 7fa9e73f7640 1 Processor -- start 2024-05-10T11:22:44.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e73f7640 1 -- start start 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e73f7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa9e015f290 0x7fa9e00d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e73f7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9e00702e0 0x7fa9e00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e73f7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e006f3c0 con 0x7fa9e00d3280 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e73f7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fa9e00d36f0 con 0x7fa9e00702e0 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e73f7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa9e00d14c0 con 0x7fa9e015f290 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e4992640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9e00702e0 0x7fa9e00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e4992640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9e00702e0 0x7fa9e00d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33650/0 (socket says 172.21.15.66:33650) 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9e4992640 1 -- 172.21.15.66:0/146626758 learned_addr learned my addr 172.21.15.66:0/146626758 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:44.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.546+0000 7fa9e5994640 1 --1- 172.21.15.66:0/146626758 >> v1:172.21.15.66:6789/0 conn(0x7fa9e00d3280 0x7fa9e00cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45778/0 (socket says 172.21.15.66:45778) 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9e5193640 1 --2- 172.21.15.66:0/146626758 >> v2:172.21.15.190:3300/0 conn(0x7fa9e015f290 0x7fa9e00d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9e4992640 1 -- 172.21.15.66:0/146626758 >> v2:172.21.15.190:3300/0 conn(0x7fa9e015f290 msgr2=0x7fa9e00d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9e4992640 1 --2- 172.21.15.66:0/146626758 >> v2:172.21.15.190:3300/0 conn(0x7fa9e015f290 0x7fa9e00d0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9e4992640 1 -- 172.21.15.66:0/146626758 >> v1:172.21.15.66:6789/0 conn(0x7fa9e00d3280 legacy=0x7fa9e00cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9dffff640 1 -- 172.21.15.66:0/146626758 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963192495 0 0) 0x7fa9e006f3c0 con 0x7fa9e00d3280 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.547+0000 7fa9e4992640 1 -- 172.21.15.66:0/146626758 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e00d16f0 con 0x7fa9e00702e0 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e4992640 1 --2- 172.21.15.66:0/146626758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00702e0 0x7fa9e00d2d40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0072530 tx=0x7fa9d402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e62067fb1aa244a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9dffff640 1 -- 172.21.15.66:0/146626758 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4037070 con 0x7fa9e00702e0 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9dffff640 1 -- 172.21.15.66:0/146626758 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d402ae50 con 0x7fa9e00702e0 2024-05-10T11:22:44.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9dffff640 1 -- 172.21.15.66:0/146626758 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4032860 con 0x7fa9e00702e0 2024-05-10T11:22:44.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 -- 172.21.15.66:0/146626758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00702e0 msgr2=0x7fa9e00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/146626758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00702e0 0x7fa9e00d2d40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0072530 tx=0x7fa9d402a300 comp rx=0 tx=0).stop 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 -- 172.21.15.66:0/146626758 shutdown_connections 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/146626758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00702e0 0x7fa9e00d2d40 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/146626758 >> v2:172.21.15.190:3300/0 conn(0x7fa9e015f290 0x7fa9e00d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 -- 172.21.15.66:0/146626758 >> 172.21.15.66:0/146626758 conn(0x7fa9e009ba20 msgr2=0x7fa9e009be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 -- 172.21.15.66:0/146626758 shutdown_connections 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.548+0000 7fa9e73f7640 1 -- 172.21.15.66:0/146626758 wait complete. 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 Processor -- start 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 -- start start 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e00702e0 0x7fa9e014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 0x7fa9e014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e015f290 0x7fa9e0160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e00d1cb0 con 0x7fa9e00d3280 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e00d2300 con 0x7fa9e015f290 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e73f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e00d1f90 con 0x7fa9e00702e0 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e4992640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 0x7fa9e014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e4992640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 0x7fa9e014e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33654/0 (socket says 172.21.15.66:33654) 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.550+0000 7fa9e4992640 1 -- 172.21.15.66:0/1976877390 learned_addr learned my addr 172.21.15.66:0/1976877390 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e5994640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e015f290 0x7fa9e0160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e5193640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e00702e0 0x7fa9e014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e4992640 1 -- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e00702e0 msgr2=0x7fa9e014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e4992640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e00702e0 0x7fa9e014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e4992640 1 -- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e015f290 msgr2=0x7fa9e0160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e4992640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e015f290 0x7fa9e0160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e4992640 1 -- 172.21.15.66:0/1976877390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e014ef20 con 0x7fa9e00d3280 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e4992640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 0x7fa9e014e460 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40090b0 tx=0x7fa9d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4037040 con 0x7fa9e00d3280 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d4004250 con 0x7fa9e00d3280 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e014f200 con 0x7fa9e00d3280 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4003610 con 0x7fa9e00d3280 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.551+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e015bbb0 con 0x7fa9e00d3280 2024-05-10T11:22:44.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.552+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e014c3d0 con 0x7fa9e00d3280 2024-05-10T11:22:44.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.553+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa9d403a070 con 0x7fa9e00d3280 2024-05-10T11:22:44.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.553+0000 7fa9ddffb640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9cc0762d0 0x7fa9cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.554+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fa9d40b7920 con 0x7fa9e00d3280 2024-05-10T11:22:44.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.554+0000 7fa9e5193640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9cc0762d0 0x7fa9cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.554+0000 7fa9e5193640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9cc0762d0 0x7fa9cc078790 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009ad0 tx=0x7fa9d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.558+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa9d4041020 con 0x7fa9e00d3280 2024-05-10T11:22:44.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.747+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9e00693f0 con 0x7fa9cc0762d0 2024-05-10T11:22:44.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.749+0000 7fa9ddffb640 1 -- 172.21.15.66:0/1976877390 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7fa9e00693f0 con 0x7fa9cc0762d0 2024-05-10T11:22:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:44.749 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9cc0762d0 msgr2=0x7fa9cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9cc0762d0 0x7fa9cc078790 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009ad0 tx=0x7fa9d8008040 comp rx=0 tx=0).stop 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 msgr2=0x7fa9e014e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 0x7fa9e014e460 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40090b0 tx=0x7fa9d40046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 shutdown_connections 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fa9cc0762d0 0x7fa9cc078790 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e015f290 0x7fa9e0160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e00d3280 0x7fa9e014e460 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 --2- 172.21.15.66:0/1976877390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e00702e0 0x7fa9e014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 >> 172.21.15.66:0/1976877390 conn(0x7fa9e009ba20 msgr2=0x7fa9e009be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:44.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 shutdown_connections 2024-05-10T11:22:44.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.751+0000 7fa9e73f7640 1 -- 172.21.15.66:0/1976877390 wait complete. 2024-05-10T11:22:44.762 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-05-10T11:22:43.842465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":274708,"kb_used_data":25272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754700012,"statfs":{"total":773094113280,"available":772812812288,"internally_reserved":0,"allocated":25878528,"data_stored":19390781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-172,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001658"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-10T11:22:26.854973+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:22:26.854973+0000","last_peered":"2024-05-10T11:22:26.854973+0000","last_clean":"2024-05-10T11:22:26.854973+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:26.854973+0000","last_undegraded":"2024-05-10T11:22:26.854973+0000","last_fullsized":"2024-05-10T11:22:26.854973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509569,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2101248,"data_stored":1285206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509569,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":5552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":5685248,"data_stored":4888941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":5701632,"data_stored":4889488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542273,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":707267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":707272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542273,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2113536,"data_stored":1297640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5709824,"data_stored":4901571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:22:44.762 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:22:44.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.866+0000 7f1b6841d640 1 Processor -- start 2024-05-10T11:22:44.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.866+0000 7f1b6841d640 1 -- start start 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b6841d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 0x7f1b600cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b6841d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b6015d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b6841d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b600c6a60 con 0x7f1b600c65f0 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b6841d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1b600cd090 con 0x7f1b6015ce60 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b6841d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b600cd370 con 0x7f1b601611e0 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b661b9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 0x7f1b600cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b669ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b6015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b659b8640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f1b600c65f0 0x7f1b60160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:51148/0 (socket says 172.21.15.66:51148) 2024-05-10T11:22:44.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b659b8640 1 -- 172.21.15.66:0/344119616 learned_addr learned my addr 172.21.15.66:0/344119616 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.867+0000 7f1b661b9640 1 --2- 172.21.15.66:0/344119616 >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 0x7f1b600cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:49566/0 (socket says 172.21.15.66:49566) 2024-05-10T11:22:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.868+0000 7f1b669ba640 1 -- 172.21.15.66:0/344119616 >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 msgr2=0x7f1b600cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.868+0000 7f1b669ba640 1 --2- 172.21.15.66:0/344119616 >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 0x7f1b600cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.868+0000 7f1b669ba640 1 -- 172.21.15.66:0/344119616 >> v1:172.21.15.190:6789/0 conn(0x7f1b600c65f0 legacy=0x7f1b60160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.868+0000 7f1b669ba640 1 -- 172.21.15.66:0/344119616 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b600cd650 con 0x7f1b601611e0 2024-05-10T11:22:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.868+0000 7f1b661b9640 1 --2- 172.21.15.66:0/344119616 >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 0x7f1b600cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:44.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.868+0000 7f1b669ba640 1 --2- 172.21.15.66:0/344119616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b6015d240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009d90 tx=0x7f1b5802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484bfb1e4778416d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b651b7640 1 -- 172.21.15.66:0/344119616 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58031600 con 0x7f1b601611e0 2024-05-10T11:22:44.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b651b7640 1 -- 172.21.15.66:0/344119616 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580317a0 con 0x7f1b601611e0 2024-05-10T11:22:44.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b651b7640 1 -- 172.21.15.66:0/344119616 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58031b70 con 0x7f1b601611e0 2024-05-10T11:22:44.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 -- 172.21.15.66:0/344119616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 msgr2=0x7f1b6015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 --2- 172.21.15.66:0/344119616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b6015d240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009d90 tx=0x7f1b5802a5d0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 -- 172.21.15.66:0/344119616 shutdown_connections 2024-05-10T11:22:44.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 --2- 172.21.15.66:0/344119616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b6015d240 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 --2- 172.21.15.66:0/344119616 >> v2:172.21.15.190:3300/0 conn(0x7f1b6015ce60 0x7f1b600cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 -- 172.21.15.66:0/344119616 >> 172.21.15.66:0/344119616 conn(0x7f1b600b2900 msgr2=0x7f1b600b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:44.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 -- 172.21.15.66:0/344119616 shutdown_connections 2024-05-10T11:22:44.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.869+0000 7f1b6841d640 1 -- 172.21.15.66:0/344119616 wait complete. 2024-05-10T11:22:44.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.870+0000 7f1b6841d640 1 Processor -- start 2024-05-10T11:22:44.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 -- start start 2024-05-10T11:22:44.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b600c65f0 0x7f1b60149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 0x7f1b600b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b601469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600cde50 con 0x7f1b6015ce60 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600ccd60 con 0x7f1b600c65f0 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b6841d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1b600cdfd0 con 0x7f1b601611e0 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b659b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 0x7f1b600b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b659b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 0x7f1b600b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51616/0 (socket says 172.21.15.66:51616) 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.871+0000 7f1b659b8640 1 -- 172.21.15.66:0/1739677516 learned_addr learned my addr 172.21.15.66:0/1739677516 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b661b9640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b600c65f0 0x7f1b60149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b669ba640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b601469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b659b8640 1 -- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 msgr2=0x7f1b601469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b659b8640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b601469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b659b8640 1 -- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b600c65f0 msgr2=0x7f1b60149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b659b8640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b600c65f0 0x7f1b60149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b659b8640 1 -- 172.21.15.66:0/1739677516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b600b4200 con 0x7f1b6015ce60 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b659b8640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 0x7f1b600b39d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c400 tx=0x7f1b5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b6015ce60 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c005ce0 con 0x7f1b6015ce60 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b600b44e0 con 0x7f1b6015ce60 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c007310 con 0x7f1b6015ce60 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.872+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b600b4aa0 con 0x7f1b6015ce60 2024-05-10T11:22:44.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.873+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6006a220 con 0x7f1b6015ce60 2024-05-10T11:22:44.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.874+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b5c01a070 con 0x7f1b6015ce60 2024-05-10T11:22:44.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.874+0000 7f1b56ffd640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b440762d0 0x7f1b44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:44.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.874+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f1b5c096910 con 0x7f1b6015ce60 2024-05-10T11:22:44.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.875+0000 7f1b661b9640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b440762d0 0x7f1b44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:44.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.875+0000 7f1b661b9640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b440762d0 0x7f1b44078790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009560 tx=0x7f1b50009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:44.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:44.879+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1b5c05fc60 con 0x7f1b6015ce60 2024-05-10T11:22:45.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.072+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b600c6df0 con 0x7f1b6015ce60 2024-05-10T11:22:45.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.073+0000 7f1b56ffd640 1 -- 172.21.15.66:0/1739677516 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+13567 (secure 0 0 0) 0x7f1b5c063f60 con 0x7f1b6015ce60 2024-05-10T11:22:45.073 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:45.074 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":123,"fsid":"62c58463-bf48-494c-be0a-3a4b427ce317","created":"2024-05-10T11:12:07.271734+0000","modified":"2024-05-10T11:22:41.910182+0000","last_up_change":"2024-05-10T11:12:18.481266+0000","last_in_change":"2024-05-10T11:12:09.449010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T11:12:17.696465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6cadaf-6a83-4687-a77c-b48d927dcb0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6801","nonce":1407218537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6803","nonce":1407218537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6807","nonce":1407218537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1407218537},{"type":"v1","addr":"172.21.15.66:6805","nonce":1407218537}]},"public_addr":"172.21.15.66:6801/1407218537","cluster_addr":"172.21.15.66:6803/1407218537","heartbeat_back_addr":"172.21.15.66:6807/1407218537","heartbeat_front_addr":"172.21.15.66:6805/1407218537","state":["exists","up"]},{"osd":1,"uuid":"cdb127d7-8507-4ca4-b18a-41dc0755f961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6809","nonce":2096128619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6811","nonce":2096128619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6815","nonce":2096128619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2096128619},{"type":"v1","addr":"172.21.15.66:6813","nonce":2096128619}]},"public_addr":"172.21.15.66:6809/2096128619","cluster_addr":"172.21.15.66:6811/2096128619","heartbeat_back_addr":"172.21.15.66:6815/2096128619","heartbeat_front_addr":"172.21.15.66:6813/2096128619","state":["exists","up"]},{"osd":2,"uuid":"ee6ec6f3-b4ad-4cfe-90f6-2aa939c0d9c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6817","nonce":3859729948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6819","nonce":3859729948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6823","nonce":3859729948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3859729948},{"type":"v1","addr":"172.21.15.66:6821","nonce":3859729948}]},"public_addr":"172.21.15.66:6817/3859729948","cluster_addr":"172.21.15.66:6819/3859729948","heartbeat_back_addr":"172.21.15.66:6823/3859729948","heartbeat_front_addr":"172.21.15.66:6821/3859729948","state":["exists","up"]},{"osd":3,"uuid":"3af283de-9cfe-4cf8-8546-4bb0e32a9094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6825","nonce":286653269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6827","nonce":286653269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6831","nonce":286653269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":286653269},{"type":"v1","addr":"172.21.15.66:6829","nonce":286653269}]},"public_addr":"172.21.15.66:6825/286653269","cluster_addr":"172.21.15.66:6827/286653269","heartbeat_back_addr":"172.21.15.66:6831/286653269","heartbeat_front_addr":"172.21.15.66:6829/286653269","state":["exists","up"]},{"osd":4,"uuid":"31e19cbf-96f8-4397-9cf5-512d3daff538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6817","nonce":1866487272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6819","nonce":1866487272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6823","nonce":1866487272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1866487272},{"type":"v1","addr":"172.21.15.190:6821","nonce":1866487272}]},"public_addr":"172.21.15.190:6817/1866487272","cluster_addr":"172.21.15.190:6819/1866487272","heartbeat_back_addr":"172.21.15.190:6823/1866487272","heartbeat_front_addr":"172.21.15.190:6821/1866487272","state":["exists","up"]},{"osd":5,"uuid":"6d6e4210-fc6b-4850-bd03-884be79c58eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6801","nonce":4020203147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6803","nonce":4020203147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6807","nonce":4020203147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":4020203147},{"type":"v1","addr":"172.21.15.190:6805","nonce":4020203147}]},"public_addr":"172.21.15.190:6801/4020203147","cluster_addr":"172.21.15.190:6803/4020203147","heartbeat_back_addr":"172.21.15.190:6807/4020203147","heartbeat_front_addr":"172.21.15.190:6805/4020203147","state":["exists","up"]},{"osd":6,"uuid":"5059e80f-c0be-4bec-af9d-6917445014e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6809","nonce":4182602787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6811","nonce":4182602787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6815","nonce":4182602787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4182602787},{"type":"v1","addr":"172.21.15.190:6813","nonce":4182602787}]},"public_addr":"172.21.15.190:6809/4182602787","cluster_addr":"172.21.15.190:6811/4182602787","heartbeat_back_addr":"172.21.15.190:6815/4182602787","heartbeat_front_addr":"172.21.15.190:6813/4182602787","state":["exists","up"]},{"osd":7,"uuid":"38cfeccf-7a88-4df2-886c-613c1b72b832","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6825","nonce":1531895533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6827","nonce":1531895533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6831","nonce":1531895533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1531895533},{"type":"v1","addr":"172.21.15.190:6829","nonce":1531895533}]},"public_addr":"172.21.15.190:6825/1531895533","cluster_addr":"172.21.15.190:6827/1531895533","heartbeat_back_addr":"172.21.15.190:6831/1531895533","heartbeat_front_addr":"172.21.15.190:6829/1531895533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.529458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.640206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.635037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.598632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.668020+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.615410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.633073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T11:12:14.641152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:6835/3510752725":"2024-05-11T11:22:38.605624+0000","172.21.15.190:6836/1055415762":"2024-05-11T11:22:26.777731+0000","172.21.15.190:6834/1055415762":"2024-05-11T11:22:26.777731+0000","172.21.15.66:6833/3510752725":"2024-05-11T11:22:38.605624+0000","172.21.15.190:6836/3723690401":"2024-05-11T11:22:17.439456+0000","172.21.15.190:6834/3723690401":"2024-05-11T11:22:17.439456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:22:45.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b440762d0 msgr2=0x7f1b44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b440762d0 0x7f1b44078790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009560 tx=0x7f1b50009190 comp rx=0 tx=0).stop 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 msgr2=0x7f1b600b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 0x7f1b600b39d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c400 tx=0x7f1b5c00c8c0 comp rx=0 tx=0).stop 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 shutdown_connections 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1b440762d0 0x7f1b44078790 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b601611e0 0x7f1b601469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b6015ce60 0x7f1b600b39d0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 --2- 172.21.15.66:0/1739677516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b600c65f0 0x7f1b60149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 >> 172.21.15.66:0/1739677516 conn(0x7f1b600b2900 msgr2=0x7f1b600af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 shutdown_connections 2024-05-10T11:22:45.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:45.075+0000 7f1b6841d640 1 -- 172.21.15.66:0/1739677516 wait complete. 2024-05-10T11:22:46.087 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T11:22:46.088 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:46.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.208+0000 7f15d4ae1640 1 Processor -- start 2024-05-10T11:22:46.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.208+0000 7f15d4ae1640 1 -- start start 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15d4ae1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15d015f370 0x7f15d00d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15d4ae1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 0x7f15d0070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15d4ae1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d00d2510 con 0x7f15d0071520 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15d4ae1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f15d0070220 con 0x7f15d015f370 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15d4ae1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f15d0070500 con 0x7f15d01639a0 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15ce59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15d015f370 0x7f15d00d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15ce59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15d015f370 0x7f15d00d1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51628/0 (socket says 172.21.15.66:51628) 2024-05-10T11:22:46.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.209+0000 7f15ce59c640 1 -- 172.21.15.66:0/2282039900 learned_addr learned my addr 172.21.15.66:0/2282039900 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:46.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15ce59c640 1 -- 172.21.15.66:0/2282039900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 msgr2=0x7f15d0070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:46.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15ce59c640 1 --2- 172.21.15.66:0/2282039900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 0x7f15d0070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15ce59c640 1 -- 172.21.15.66:0/2282039900 >> v1:172.21.15.190:6789/0 conn(0x7f15d0071520 legacy=0x7f15d0162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:46.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15ce59c640 1 -- 172.21.15.66:0/2282039900 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d00707e0 con 0x7f15d015f370 2024-05-10T11:22:46.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15ce59c640 1 --2- 172.21.15.66:0/2282039900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d015f370 0x7f15d00d1cc0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009e50 tx=0x7f15c002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49c8e79922cc632 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15cd59a640 1 -- 172.21.15.66:0/2282039900 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0036070 con 0x7f15d015f370 2024-05-10T11:22:46.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15cd59a640 1 -- 172.21.15.66:0/2282039900 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c0031600 con 0x7f15d015f370 2024-05-10T11:22:46.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.210+0000 7f15cd59a640 1 -- 172.21.15.66:0/2282039900 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00319d0 con 0x7f15d015f370 2024-05-10T11:22:46.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 -- 172.21.15.66:0/2282039900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d015f370 msgr2=0x7f15d00d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 --2- 172.21.15.66:0/2282039900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d015f370 0x7f15d00d1cc0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009e50 tx=0x7f15c002a750 comp rx=0 tx=0).stop 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 -- 172.21.15.66:0/2282039900 shutdown_connections 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 --2- 172.21.15.66:0/2282039900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 0x7f15d0070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 --2- 172.21.15.66:0/2282039900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d015f370 0x7f15d00d1cc0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 -- 172.21.15.66:0/2282039900 >> 172.21.15.66:0/2282039900 conn(0x7f15d00d2e10 msgr2=0x7f15d00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 -- 172.21.15.66:0/2282039900 shutdown_connections 2024-05-10T11:22:46.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.211+0000 7f15d4ae1640 1 -- 172.21.15.66:0/2282039900 wait complete. 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 Processor -- start 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 -- start start 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d015f370 0x7f15d014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 0x7f15d01eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d01eaff0 0x7f15d01e8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0163510 con 0x7f15d01eaff0 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15d00d2200 con 0x7f15d015f370 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15d4ae1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f15d0163690 con 0x7f15d01639a0 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d01eaff0 0x7f15d01e8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.213+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d01eaff0 0x7f15d01e8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51638/0 (socket says 172.21.15.66:51638) 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 -- 172.21.15.66:0/1314655464 learned_addr learned my addr 172.21.15.66:0/1314655464 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ce59c640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d015f370 0x7f15d014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 0x7f15d01eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 -- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 msgr2=0x7f15d01eaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15d01639a0 0x7f15d01eaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 -- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d015f370 msgr2=0x7f15d014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d015f370 0x7f15d014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 -- 172.21.15.66:0/1314655464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d01ea2f0 con 0x7f15d01eaff0 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15ced9d640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d01eaff0 0x7f15d01e8cd0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f15c800b490 tx=0x7f15c800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8015020 con 0x7f15d01eaff0 2024-05-10T11:22:46.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8011850 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d01e9a50 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8011c40 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.214+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01ea010 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.215+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15d006a220 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.216+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f15c8018020 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.216+0000 7f15beffd640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15b00762d0 0x7f15b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.216+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f15c8097200 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15beffd640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7f15b007c8b0 0x7f15b007ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15ce59c640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15b00762d0 0x7f15b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15c8013ec0 con 0x7f15b007c8b0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f15c809e050 con 0x7f15d01eaff0 2024-05-10T11:22:46.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7f15b007c8b0 0x7f15b007ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7f15b007c8b0 0x7f15b007ecf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.217+0000 7f15ce59c640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15b00762d0 0x7f15b0078790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f15c0033000 tx=0x7f15c0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.218+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== osd.0 v2:172.21.15.66:6800/1407218537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15c8013ec0 con 0x7f15b007c8b0 2024-05-10T11:22:46.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.231+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 --> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f15d006f340 con 0x7f15b007c8b0 2024-05-10T11:22:46.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.231+0000 7f15beffd640 1 -- 172.21.15.66:0/1314655464 <== osd.0 v2:172.21.15.66:6800/1407218537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f15d006f340 con 0x7f15b007c8b0 2024-05-10T11:22:46.232 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:46.232 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:46.232 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:46.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7f15b007c8b0 msgr2=0x7f15b007ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:6800/1407218537,v1:172.21.15.66:6801/1407218537] conn(0x7f15b007c8b0 0x7f15b007ecf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15b00762d0 msgr2=0x7f15b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f15b00762d0 0x7f15b0078790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f15c0033000 tx=0x7f15c0009000 comp rx=0 tx=0).stop 2024-05-10T11:22:46.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d01eaff0 msgr2=0x7f15d01e8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 --2- 172.21.15.66:0/1314655464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d01eaff0 0x7f15d01e8cd0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f15c800b490 tx=0x7f15c800b890 comp rx=0 tx=0).stop 2024-05-10T11:22:46.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15ced9d640 1 -- 172.21.15.66:0/1314655464 reap_dead start 2024-05-10T11:22:46.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 shutdown_connections 2024-05-10T11:22:46.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 >> 172.21.15.66:0/1314655464 conn(0x7f15d00d2e10 msgr2=0x7f15d006ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 shutdown_connections 2024-05-10T11:22:46.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.232+0000 7f15d4ae1640 1 -- 172.21.15.66:0/1314655464 wait complete. 2024-05-10T11:22:46.243 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T11:22:46.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.348+0000 7fe124459640 1 Processor -- start 2024-05-10T11:22:46.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.348+0000 7fe124459640 1 -- start start 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe124459640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe11c15ce60 0x7fe11c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe124459640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe11c0c65f0 0x7fe11c160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe124459640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c161010 0x7fe11c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe124459640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fe11c161450 con 0x7fe11c15ce60 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe124459640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe11c0c6a60 con 0x7fe11c0c65f0 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe124459640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe11c0cd090 con 0x7fe11c161010 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe1221f5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe11c15ce60 0x7fe11c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe1221f5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe11c15ce60 0x7fe11c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51644/0 (socket says 172.21.15.66:51644) 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe1221f5640 1 -- 172.21.15.66:0/4249830660 learned_addr learned my addr 172.21.15.66:0/4249830660 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.349+0000 7fe1219f4640 1 --2- 172.21.15.66:0/4249830660 >> v2:172.21.15.190:3300/0 conn(0x7fe11c0c65f0 0x7fe11c160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1229f6640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c161010 0x7fe11c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1221f5640 1 -- 172.21.15.66:0/4249830660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c161010 msgr2=0x7fe11c0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1221f5640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c161010 0x7fe11c0add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1221f5640 1 -- 172.21.15.66:0/4249830660 >> v2:172.21.15.190:3300/0 conn(0x7fe11c0c65f0 msgr2=0x7fe11c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1221f5640 1 --2- 172.21.15.66:0/4249830660 >> v2:172.21.15.190:3300/0 conn(0x7fe11c0c65f0 0x7fe11c160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1221f5640 1 -- 172.21.15.66:0/4249830660 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c0cd370 con 0x7fe11c15ce60 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1229f6640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c161010 0x7fe11c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.350+0000 7fe1221f5640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c15ce60 0x7fe11c0cb300 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe11c074230 tx=0x7fe11802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20726c856e9c1206 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe1211f3640 1 -- 172.21.15.66:0/4249830660 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118037070 con 0x7fe11c15ce60 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe1211f3640 1 -- 172.21.15.66:0/4249830660 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe118032440 con 0x7fe11c15ce60 2024-05-10T11:22:46.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe1211f3640 1 -- 172.21.15.66:0/4249830660 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118032810 con 0x7fe11c15ce60 2024-05-10T11:22:46.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 -- 172.21.15.66:0/4249830660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c15ce60 msgr2=0x7fe11c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c15ce60 0x7fe11c0cb300 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe11c074230 tx=0x7fe11802a140 comp rx=0 tx=0).stop 2024-05-10T11:22:46.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 -- 172.21.15.66:0/4249830660 shutdown_connections 2024-05-10T11:22:46.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c161010 0x7fe11c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 --2- 172.21.15.66:0/4249830660 >> v2:172.21.15.190:3300/0 conn(0x7fe11c0c65f0 0x7fe11c160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 --2- 172.21.15.66:0/4249830660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c15ce60 0x7fe11c0cb300 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 -- 172.21.15.66:0/4249830660 >> 172.21.15.66:0/4249830660 conn(0x7fe11c0b2900 msgr2=0x7fe11c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 -- 172.21.15.66:0/4249830660 shutdown_connections 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.351+0000 7fe124459640 1 -- 172.21.15.66:0/4249830660 wait complete. 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 Processor -- start 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 -- start start 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe11c0c65f0 0x7fe11c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c15ce60 0x7fe11c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 0x7fe11c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c0ccd60 con 0x7fe11c161010 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c0cd930 con 0x7fe11c0c65f0 2024-05-10T11:22:46.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe124459640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe11c0cde50 con 0x7fe11c15ce60 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.353+0000 7fe1229f6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 0x7fe11c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 0x7fe11c0caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51648/0 (socket says 172.21.15.66:51648) 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 -- 172.21.15.66:0/3891180600 learned_addr learned my addr 172.21.15.66:0/3891180600 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1219f4640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c15ce60 0x7fe11c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1221f5640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe11c0c65f0 0x7fe11c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 -- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c15ce60 msgr2=0x7fe11c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c15ce60 0x7fe11c0ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 -- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe11c0c65f0 msgr2=0x7fe11c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe11c0c65f0 0x7fe11c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 -- 172.21.15.66:0/3891180600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c0c8790 con 0x7fe11c161010 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe1229f6640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 0x7fe11c0caa40 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fe114007ef0 tx=0x7fe11400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11401a070 con 0x7fe11c161010 2024-05-10T11:22:46.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe114003b90 con 0x7fe11c161010 2024-05-10T11:22:46.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c154100 con 0x7fe11c161010 2024-05-10T11:22:46.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114004030 con 0x7fe11c161010 2024-05-10T11:22:46.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.354+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c0c8d10 con 0x7fe11c161010 2024-05-10T11:22:46.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.355+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11c06a220 con 0x7fe11c161010 2024-05-10T11:22:46.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.356+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe11401d070 con 0x7fe11c161010 2024-05-10T11:22:46.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.357+0000 7fe112ffd640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1000762d0 0x7fe100078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.357+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fe114097630 con 0x7fe11c161010 2024-05-10T11:22:46.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.357+0000 7fe1221f5640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1000762d0 0x7fe100078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.357+0000 7fe1221f5640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1000762d0 0x7fe100078790 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe118034000 tx=0x7fe11802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.361+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe114010070 con 0x7fe11c161010 2024-05-10T11:22:46.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.552+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe11c0c7300 con 0x7fe1000762d0 2024-05-10T11:22:46.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.553+0000 7fe112ffd640 1 -- 172.21.15.66:0/3891180600 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe11c0c7300 con 0x7fe1000762d0 2024-05-10T11:22:46.553 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1000762d0 msgr2=0x7fe100078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1000762d0 0x7fe100078790 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe118034000 tx=0x7fe11802e000 comp rx=0 tx=0).stop 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 msgr2=0x7fe11c0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 0x7fe11c0caa40 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fe114007ef0 tx=0x7fe11400d4a0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 shutdown_connections 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fe1000762d0 0x7fe100078790 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe11c161010 0x7fe11c0caa40 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe11c15ce60 0x7fe11c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 --2- 172.21.15.66:0/3891180600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe11c0c65f0 0x7fe11c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 >> 172.21.15.66:0/3891180600 conn(0x7fe11c0b2900 msgr2=0x7fe11c06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 shutdown_connections 2024-05-10T11:22:46.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.555+0000 7fe124459640 1 -- 172.21.15.66:0/3891180600 wait complete. 2024-05-10T11:22:46.566 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T11:22:46.567 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.674+0000 7fd25682a640 1 Processor -- start 2024-05-10T11:22:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.674+0000 7fd25682a640 1 -- start start 2024-05-10T11:22:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd25682a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 0x7fd2500b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd25682a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2500b5f30 0x7fd2500d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd25682a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2500d0830 con 0x7fd2500d1aa0 2024-05-10T11:22:46.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd25682a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd2500d10d0 con 0x7fd2500b5f30 2024-05-10T11:22:46.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd25682a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd2500d0b10 con 0x7fd250162990 2024-05-10T11:22:46.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 0x7fd2500b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2500b5f30 0x7fd2500d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd254dc7640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd2500d1aa0 0x7fd2501630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.66:51168/0 (socket says 172.21.15.66:51168) 2024-05-10T11:22:46.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 0x7fd2500b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.66:34286/0 (socket says 172.21.15.66:34286) 2024-05-10T11:22:46.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd254dc7640 1 -- 172.21.15.66:0/2116765031 learned_addr learned my addr 172.21.15.66:0/2116765031 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:46.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24ffff640 1 -- 172.21.15.66:0/2116765031 >> v2:172.21.15.190:3300/0 conn(0x7fd2500b5f30 msgr2=0x7fd2500d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:46.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24ffff640 1 --2- 172.21.15.66:0/2116765031 >> v2:172.21.15.190:3300/0 conn(0x7fd2500b5f30 0x7fd2500d59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24ffff640 1 -- 172.21.15.66:0/2116765031 >> v1:172.21.15.190:6789/0 conn(0x7fd2500d1aa0 legacy=0x7fd2501630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24ffff640 1 -- 172.21.15.66:0/2116765031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2500d0df0 con 0x7fd250162990 2024-05-10T11:22:46.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24effd640 1 -- 172.21.15.66:0/2116765031 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320024352 0 0) 0x7fd2500d0830 con 0x7fd2500d1aa0 2024-05-10T11:22:46.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.675+0000 7fd24f7fe640 1 --2- 172.21.15.66:0/2116765031 >> v2:172.21.15.190:3300/0 conn(0x7fd2500b5f30 0x7fd2500d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:46.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.676+0000 7fd24ffff640 1 --2- 172.21.15.66:0/2116765031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 0x7fd2500b48a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097d0 tx=0x7fd24002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58c513388203eec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.676+0000 7fd24effd640 1 -- 172.21.15.66:0/2116765031 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240037070 con 0x7fd250162990 2024-05-10T11:22:46.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.676+0000 7fd24effd640 1 -- 172.21.15.66:0/2116765031 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd240032440 con 0x7fd250162990 2024-05-10T11:22:46.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.676+0000 7fd24effd640 1 -- 172.21.15.66:0/2116765031 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240032810 con 0x7fd250162990 2024-05-10T11:22:46.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 -- 172.21.15.66:0/2116765031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 msgr2=0x7fd2500b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 --2- 172.21.15.66:0/2116765031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 0x7fd2500b48a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097d0 tx=0x7fd24002a1c0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 -- 172.21.15.66:0/2116765031 shutdown_connections 2024-05-10T11:22:46.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 --2- 172.21.15.66:0/2116765031 >> v2:172.21.15.190:3300/0 conn(0x7fd2500b5f30 0x7fd2500d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 --2- 172.21.15.66:0/2116765031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd250162990 0x7fd2500b48a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 -- 172.21.15.66:0/2116765031 >> 172.21.15.66:0/2116765031 conn(0x7fd25009e3f0 msgr2=0x7fd2500d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 -- 172.21.15.66:0/2116765031 shutdown_connections 2024-05-10T11:22:46.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.677+0000 7fd25682a640 1 -- 172.21.15.66:0/2116765031 wait complete. 2024-05-10T11:22:46.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.678+0000 7fd25682a640 1 Processor -- start 2024-05-10T11:22:46.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.678+0000 7fd25682a640 1 -- start start 2024-05-10T11:22:46.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd25682a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2500b5f30 0x7fd25015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd25682a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2500d1aa0 0x7fd2500c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd25682a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd250162990 0x7fd2500cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd25682a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2500d5ef0 con 0x7fd250162990 2024-05-10T11:22:46.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd25682a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd250162d70 con 0x7fd2500b5f30 2024-05-10T11:22:46.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd25682a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd2500d1f30 con 0x7fd2500d1aa0 2024-05-10T11:22:46.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd250162990 0x7fd2500cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2500b5f30 0x7fd25015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd24f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2500d1aa0 0x7fd2500c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2500b5f30 0x7fd25015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.66:49624/0 (socket says 172.21.15.66:49624) 2024-05-10T11:22:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd250162990 0x7fd2500cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51650/0 (socket says 172.21.15.66:51650) 2024-05-10T11:22:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd24ffff640 1 -- 172.21.15.66:0/1463424187 learned_addr learned my addr 172.21.15.66:0/1463424187 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 -- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2500d1aa0 msgr2=0x7fd2500c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2500d1aa0 0x7fd2500c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 -- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2500b5f30 msgr2=0x7fd25015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2500b5f30 0x7fd25015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd254dc7640 1 -- 172.21.15.66:0/1463424187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2500cc490 con 0x7fd250162990 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd24ffff640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2500b5f30 0x7fd25015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.679+0000 7fd24f7fe640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2500d1aa0 0x7fd2500c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.680+0000 7fd254dc7640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd250162990 0x7fd2500cd530 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c700 tx=0x7fd24800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.680+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248018070 con 0x7fd250162990 2024-05-10T11:22:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.680+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2500cc770 con 0x7fd250162990 2024-05-10T11:22:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.680+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24800ce10 con 0x7fd250162990 2024-05-10T11:22:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.680+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24800a880 con 0x7fd250162990 2024-05-10T11:22:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.680+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2500ccd30 con 0x7fd250162990 2024-05-10T11:22:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.681+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd25006a220 con 0x7fd250162990 2024-05-10T11:22:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd24800aa20 con 0x7fd250162990 2024-05-10T11:22:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24cff9640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd23c0762d0 0x7fd23c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fd248096990 con 0x7fd250162990 2024-05-10T11:22:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24cff9640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7fd23c07c8b0 0x7fd23c07ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24ffff640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd23c0762d0 0x7fd23c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd23c07f3c0 con 0x7fd23c07c8b0 2024-05-10T11:22:46.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7fd24809b2c0 con 0x7fd250162990 2024-05-10T11:22:46.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.682+0000 7fd24f7fe640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7fd23c07c8b0 0x7fd23c07ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.683+0000 7fd24f7fe640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7fd23c07c8b0 0x7fd23c07ecf0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.683+0000 7fd24ffff640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd23c0762d0 0x7fd23c078790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd24002a200 tx=0x7fd24002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.683+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== osd.1 v2:172.21.15.66:6808/2096128619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd23c07f3c0 con 0x7fd23c07c8b0 2024-05-10T11:22:46.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.696+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 --> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd2500d2710 con 0x7fd23c07c8b0 2024-05-10T11:22:46.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd24cff9640 1 -- 172.21.15.66:0/1463424187 <== osd.1 v2:172.21.15.66:6808/2096128619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd2500d2710 con 0x7fd23c07c8b0 2024-05-10T11:22:46.697 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:46.697 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:46.698 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7fd23c07c8b0 msgr2=0x7fd23c07ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:6808/2096128619,v1:172.21.15.66:6809/2096128619] conn(0x7fd23c07c8b0 0x7fd23c07ecf0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd23c0762d0 msgr2=0x7fd23c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd23c0762d0 0x7fd23c078790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd24002a200 tx=0x7fd24002e000 comp rx=0 tx=0).stop 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd250162990 msgr2=0x7fd2500cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 --2- 172.21.15.66:0/1463424187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd250162990 0x7fd2500cd530 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c700 tx=0x7fd24800cbc0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd254dc7640 1 -- 172.21.15.66:0/1463424187 reap_dead start 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 shutdown_connections 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 >> 172.21.15.66:0/1463424187 conn(0x7fd25009e3f0 msgr2=0x7fd2500b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 shutdown_connections 2024-05-10T11:22:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.697+0000 7fd25682a640 1 -- 172.21.15.66:0/1463424187 wait complete. 2024-05-10T11:22:46.708 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.812+0000 7f94f1693640 1 Processor -- start 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.812+0000 7f94f1693640 1 -- start start 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94f1693640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94f1693640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f94ec070bd0 0x7f94ec15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94f1693640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec163ba0 con 0x7f94ec15f620 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94f1693640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec06cd70 con 0x7f94ec070bd0 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94f1693640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec160190 con 0x7f94ec06c990 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94ea7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f94ec15f620 0x7f94ec0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59232/0 (socket says 172.21.15.66:59232) 2024-05-10T11:22:46.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94ea7fc640 1 -- 172.21.15.66:0/2279160360 learned_addr learned my addr 172.21.15.66:0/2279160360 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94eaffd640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.813+0000 7f94eb7fe640 1 --2- 172.21.15.66:0/2279160360 >> v2:172.21.15.190:3300/0 conn(0x7f94ec070bd0 0x7f94ec15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94e9ffb640 1 -- 172.21.15.66:0/2279160360 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837083695 0 0) 0x7f94ec163ba0 con 0x7f94ec15f620 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94e9ffb640 1 -- 172.21.15.66:0/2279160360 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d8003520 con 0x7f94ec15f620 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94eb7fe640 1 -- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 msgr2=0x7f94ec163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94eb7fe640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94eb7fe640 1 -- 172.21.15.66:0/2279160360 >> v1:172.21.15.66:6789/0 conn(0x7f94ec15f620 legacy=0x7f94ec0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94eb7fe640 1 -- 172.21.15.66:0/2279160360 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec160470 con 0x7f94ec070bd0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.814+0000 7f94eaffd640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94eb7fe640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec070bd0 0x7f94ec15fa80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009d90 tx=0x7f94e402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f35797de2c7f4b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94e9ffb640 1 -- 172.21.15.66:0/2279160360 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4007740 con 0x7f94ec070bd0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94e9ffb640 1 -- 172.21.15.66:0/2279160360 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e40078e0 con 0x7f94ec070bd0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94e9ffb640 1 -- 172.21.15.66:0/2279160360 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4007c90 con 0x7f94ec070bd0 2024-05-10T11:22:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 -- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec070bd0 msgr2=0x7f94ec15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec070bd0 0x7f94ec15fa80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009d90 tx=0x7f94e402a660 comp rx=0 tx=0).stop 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 -- 172.21.15.66:0/2279160360 shutdown_connections 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec070bd0 0x7f94ec15fa80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 --2- 172.21.15.66:0/2279160360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 -- 172.21.15.66:0/2279160360 >> 172.21.15.66:0/2279160360 conn(0x7f94ec0b3980 msgr2=0x7f94ec0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 -- 172.21.15.66:0/2279160360 shutdown_connections 2024-05-10T11:22:46.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.815+0000 7f94f1693640 1 -- 172.21.15.66:0/2279160360 wait complete. 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 Processor -- start 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 -- start start 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 0x7f94ec14ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec15f620 0x7f94ec0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec073e70 con 0x7f94ec070bd0 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec163140 con 0x7f94ec15f620 2024-05-10T11:22:46.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94f1693640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0cf920 con 0x7f94ec06c990 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.817+0000 7f94ea7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 0x7f94ec14ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 0x7f94ec14ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51658/0 (socket says 172.21.15.66:51658) 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 -- 172.21.15.66:0/2186618023 learned_addr learned my addr 172.21.15.66:0/2186618023 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94eaffd640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94eb7fe640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec15f620 0x7f94ec0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 -- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 msgr2=0x7f94ec14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 -- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec15f620 msgr2=0x7f94ec0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec15f620 0x7f94ec0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 -- 172.21.15.66:0/2186618023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec160850 con 0x7f94ec070bd0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94ea7fc640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 0x7f94ec14ed10 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f94d40010e0 tx=0x7f94d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4017070 con 0x7f94ec070bd0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d4005d00 con 0x7f94ec070bd0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec0b0a40 con 0x7f94ec070bd0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4007310 con 0x7f94ec070bd0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.818+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec160dd0 con 0x7f94ec070bd0 2024-05-10T11:22:46.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.819+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec06a220 con 0x7f94ec070bd0 2024-05-10T11:22:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.820+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94d401a070 con 0x7f94ec070bd0 2024-05-10T11:22:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.820+0000 7f94e37fe640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94cc076300 0x7f94cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.820+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f94d4096820 con 0x7f94ec070bd0 2024-05-10T11:22:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.820+0000 7f94eaffd640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94cc076300 0x7f94cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:46.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.821+0000 7f94eaffd640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94cc076300 0x7f94cc0787c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009560 tx=0x7f94dc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:46.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:46.824+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f94d405fbf0 con 0x7f94ec070bd0 2024-05-10T11:22:47.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.020+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f94ec073540 con 0x7f94cc076300 2024-05-10T11:22:47.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.020+0000 7f94e37fe640 1 -- 172.21.15.66:0/2186618023 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94ec073540 con 0x7f94cc076300 2024-05-10T11:22:47.021 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94cc076300 msgr2=0x7f94cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94cc076300 0x7f94cc0787c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009560 tx=0x7f94dc009190 comp rx=0 tx=0).stop 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 msgr2=0x7f94ec14ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 0x7f94ec14ed10 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f94d40010e0 tx=0x7f94d400c890 comp rx=0 tx=0).stop 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 shutdown_connections 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f94cc076300 0x7f94cc0787c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94ec15f620 0x7f94ec0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec070bd0 0x7f94ec14ed10 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 --2- 172.21.15.66:0/2186618023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94ec06c990 0x7f94ec14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 >> 172.21.15.66:0/2186618023 conn(0x7f94ec0b3980 msgr2=0x7f94ec0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 shutdown_connections 2024-05-10T11:22:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.022+0000 7f94f1693640 1 -- 172.21.15.66:0/2186618023 wait complete. 2024-05-10T11:22:47.033 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T11:22:47.034 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:47.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.141+0000 7fd98239d640 1 Processor -- start 2024-05-10T11:22:47.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.141+0000 7fd98239d640 1 -- start start 2024-05-10T11:22:47.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.142+0000 7fd98239d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd97c15f490 0x7fd97c0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.142+0000 7fd98239d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.142+0000 7fd98239d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97c0d1080 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.142+0000 7fd98239d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fd97c0b4e70 con 0x7fd97c15f490 2024-05-10T11:22:47.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.142+0000 7fd98239d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c0b4820 con 0x7fd97c0d3d50 2024-05-10T11:22:47.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.142+0000 7fd97bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd97c15f490 0x7fd97c0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97b7fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd97c0d5ca0 0x7fd97c0d3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59242/0 (socket says 172.21.15.66:59242) 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd97c15f490 0x7fd97c0d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51672/0 (socket says 172.21.15.66:51672) 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97b7fe640 1 -- 172.21.15.66:0/2764781154 learned_addr learned my addr 172.21.15.66:0/2764781154 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd98093a640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97bfff640 1 -- 172.21.15.66:0/2764781154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 msgr2=0x7fd97c0b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97bfff640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c0b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97bfff640 1 -- 172.21.15.66:0/2764781154 >> v1:172.21.15.66:6789/0 conn(0x7fd97c0d5ca0 legacy=0x7fd97c0d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97affd640 1 -- 172.21.15.66:0/2764781154 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146712334 0 0) 0x7fd97c0d1080 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd97bfff640 1 -- 172.21.15.66:0/2764781154 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c0b4b00 con 0x7fd97c15f490 2024-05-10T11:22:47.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.143+0000 7fd98093a640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c0b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:47.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd97bfff640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c15f490 0x7fd97c0d2f60 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0097a0 tx=0x7fd96c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd999e2f0a97a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd97affd640 1 -- 172.21.15.66:0/2764781154 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c037070 con 0x7fd97c15f490 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd97affd640 1 -- 172.21.15.66:0/2764781154 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c02ae50 con 0x7fd97c15f490 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd97affd640 1 -- 172.21.15.66:0/2764781154 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c032660 con 0x7fd97c15f490 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 -- 172.21.15.66:0/2764781154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c15f490 msgr2=0x7fd97c0d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c15f490 0x7fd97c0d2f60 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0097a0 tx=0x7fd96c02a100 comp rx=0 tx=0).stop 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 -- 172.21.15.66:0/2764781154 shutdown_connections 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c0b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 --2- 172.21.15.66:0/2764781154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c15f490 0x7fd97c0d2f60 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 -- 172.21.15.66:0/2764781154 >> 172.21.15.66:0/2764781154 conn(0x7fd97c0d50f0 msgr2=0x7fd97c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 -- 172.21.15.66:0/2764781154 shutdown_connections 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.144+0000 7fd98239d640 1 -- 172.21.15.66:0/2764781154 wait complete. 2024-05-10T11:22:47.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.146+0000 7fd98239d640 1 Processor -- start 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.146+0000 7fd98239d640 1 -- start start 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c1f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c0d5ca0 0x7fd97c1f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97c15f490 0x7fd97c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c15f9f0 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c15f870 con 0x7fd97c15f490 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c0b5840 con 0x7fd97c0d3d50 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c0d5ca0 0x7fd97c1f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c0d5ca0 0x7fd97c1f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51678/0 (socket says 172.21.15.66:51678) 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 -- 172.21.15.66:0/762930578 learned_addr learned my addr 172.21.15.66:0/762930578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97bfff640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c1f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98093a640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97c15f490 0x7fd97c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 -- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 msgr2=0x7fd97c1f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd97c0d3d50 0x7fd97c1f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 -- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97c15f490 msgr2=0x7fd97c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97c15f490 0x7fd97c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 -- 172.21.15.66:0/762930578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c1f8d50 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd97b7fe640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c0d5ca0 0x7fd97c1f5740 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd97000c4b0 tx=0x7fd97000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970018070 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd970007500 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c1f9030 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970004a20 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.147+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1f8a40 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.148+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd97c1f5320 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.149+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd97001b070 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.149+0000 7fd978ff9640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd9680762d0 0x7fd968078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fd970096710 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd978ff9640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fd96807c8b0 0x7fd96807ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd97bfff640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd9680762d0 0x7fd968078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd96807f3c0 con 0x7fd96807c8b0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7fd97009d050 con 0x7fd97c0d5ca0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd98093a640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fd96807c8b0 0x7fd96807ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd98093a640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fd96807c8b0 0x7fd96807ecf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.150+0000 7fd97bfff640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd9680762d0 0x7fd968078790 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd96c034000 tx=0x7fd96c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.151+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== osd.2 v2:172.21.15.66:6816/3859729948 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd96807f3c0 con 0x7fd96807c8b0 2024-05-10T11:22:47.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 --> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd97c08d170 con 0x7fd96807c8b0 2024-05-10T11:22:47.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd978ff9640 1 -- 172.21.15.66:0/762930578 <== osd.2 v2:172.21.15.66:6816/3859729948 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd97c08d170 con 0x7fd96807c8b0 2024-05-10T11:22:47.164 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:47.165 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:47.165 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:47.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fd96807c8b0 msgr2=0x7fd96807ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:6816/3859729948,v1:172.21.15.66:6817/3859729948] conn(0x7fd96807c8b0 0x7fd96807ecf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd9680762d0 msgr2=0x7fd968078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd9680762d0 0x7fd968078790 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd96c034000 tx=0x7fd96c02e000 comp rx=0 tx=0).stop 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c0d5ca0 msgr2=0x7fd97c1f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98239d640 1 --2- 172.21.15.66:0/762930578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd97c0d5ca0 0x7fd97c1f5740 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd97000c4b0 tx=0x7fd97000c970 comp rx=0 tx=0).stop 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.164+0000 7fd98093a640 1 -- 172.21.15.66:0/762930578 reap_dead start 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.165+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 shutdown_connections 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.165+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 >> 172.21.15.66:0/762930578 conn(0x7fd97c0d50f0 msgr2=0x7fd97c1e6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.165+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 shutdown_connections 2024-05-10T11:22:47.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.165+0000 7fd98239d640 1 -- 172.21.15.66:0/762930578 wait complete. 2024-05-10T11:22:47.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T11:22:47.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.280+0000 7fd020d9e640 1 Processor -- start 2024-05-10T11:22:47.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.280+0000 7fd020d9e640 1 -- start start 2024-05-10T11:22:47.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd020d9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd020d9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd01c06d5e0 0x7fd01c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd020d9e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01c0cf010 con 0x7fd01c15e850 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd020d9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd01c0cd230 con 0x7fd01c06d5e0 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd020d9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c1604b0 con 0x7fd01c0cec30 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd01bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd01c15e850 0x7fd01c15ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59246/0 (socket says 172.21.15.66:59246) 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd01bfff640 1 -- 172.21.15.66:0/2715799297 learned_addr learned my addr 172.21.15.66:0/2715799297 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd01affd640 1 --2- 172.21.15.66:0/2715799297 >> v2:172.21.15.190:3300/0 conn(0x7fd01c06d5e0 0x7fd01c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd01b7fe640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd01a7fc640 1 -- 172.21.15.66:0/2715799297 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625826102 0 0) 0x7fd01c0cf010 con 0x7fd01c15e850 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.281+0000 7fd01a7fc640 1 -- 172.21.15.66:0/2715799297 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd004003520 con 0x7fd01c15e850 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01affd640 1 -- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 msgr2=0x7fd01c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01affd640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01affd640 1 -- 172.21.15.66:0/2715799297 >> v1:172.21.15.66:6789/0 conn(0x7fd01c15e850 legacy=0x7fd01c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01affd640 1 -- 172.21.15.66:0/2715799297 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c15f8a0 con 0x7fd01c06d5e0 2024-05-10T11:22:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01b7fe640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T11:22:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01affd640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c06d5e0 0x7fd01c06e320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd01002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d82a1f580a52a0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01a7fc640 1 -- 172.21.15.66:0/2715799297 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010037070 con 0x7fd01c06d5e0 2024-05-10T11:22:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.282+0000 7fd01a7fc640 1 -- 172.21.15.66:0/2715799297 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd010032440 con 0x7fd01c06d5e0 2024-05-10T11:22:47.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd01a7fc640 1 -- 172.21.15.66:0/2715799297 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0100327f0 con 0x7fd01c06d5e0 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 -- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c06d5e0 msgr2=0x7fd01c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c06d5e0 0x7fd01c06e320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd01002a180 comp rx=0 tx=0).stop 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 -- 172.21.15.66:0/2715799297 shutdown_connections 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c06d5e0 0x7fd01c06e320 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 --2- 172.21.15.66:0/2715799297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 -- 172.21.15.66:0/2715799297 >> 172.21.15.66:0/2715799297 conn(0x7fd01c0d2be0 msgr2=0x7fd01c0d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 -- 172.21.15.66:0/2715799297 shutdown_connections 2024-05-10T11:22:47.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.283+0000 7fd020d9e640 1 -- 172.21.15.66:0/2715799297 wait complete. 2024-05-10T11:22:47.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.284+0000 7fd020d9e640 1 Processor -- start 2024-05-10T11:22:47.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 -- start start 2024-05-10T11:22:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 0x7fd01c1f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c15e850 0x7fd01c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c160140 con 0x7fd01c06d5e0 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c15fe60 con 0x7fd01c15e850 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd020d9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c06cfb0 con 0x7fd01c0cec30 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd01b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 0x7fd01c1f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd01b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 0x7fd01c1f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51690/0 (socket says 172.21.15.66:51690) 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.285+0000 7fd01b7fe640 1 -- 172.21.15.66:0/581273391 learned_addr learned my addr 172.21.15.66:0/581273391 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01bfff640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c15e850 0x7fd01c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01affd640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01b7fe640 1 -- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 msgr2=0x7fd01c0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01b7fe640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c0b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01b7fe640 1 -- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c15e850 msgr2=0x7fd01c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01b7fe640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c15e850 0x7fd01c15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01b7fe640 1 -- 172.21.15.66:0/581273391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c0c7810 con 0x7fd01c06d5e0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01bfff640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c15e850 0x7fd01c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01affd640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c0b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd01b7fe640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 0x7fd01c1f8880 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00ebe0 tx=0x7fd00c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c017070 con 0x7fd01c06d5e0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c00cc30 con 0x7fd01c06d5e0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c0b0cd0 con 0x7fd01c06d5e0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c013470 con 0x7fd01c06d5e0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.286+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c0c7d90 con 0x7fd01c06d5e0 2024-05-10T11:22:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.287+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c06a220 con 0x7fd01c06d5e0 2024-05-10T11:22:47.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.288+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd00c01a070 con 0x7fd01c06d5e0 2024-05-10T11:22:47.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.288+0000 7fd003fff640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd008076300 0x7fd0080787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.288+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fd00c0973c0 con 0x7fd01c06d5e0 2024-05-10T11:22:47.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.288+0000 7fd01affd640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd008076300 0x7fd0080787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.289+0000 7fd01affd640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd008076300 0x7fd0080787c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd010034000 tx=0x7fd01002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.293+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd00c060e70 con 0x7fd01c06d5e0 2024-05-10T11:22:47.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.484+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd01c074f40 con 0x7fd008076300 2024-05-10T11:22:47.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.484+0000 7fd003fff640 1 -- 172.21.15.66:0/581273391 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd01c074f40 con 0x7fd008076300 2024-05-10T11:22:47.485 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T11:22:47.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd008076300 msgr2=0x7fd0080787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd008076300 0x7fd0080787c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd010034000 tx=0x7fd01002e000 comp rx=0 tx=0).stop 2024-05-10T11:22:47.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 msgr2=0x7fd01c1f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 0x7fd01c1f8880 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00ebe0 tx=0x7fd00c00c520 comp rx=0 tx=0).stop 2024-05-10T11:22:47.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 shutdown_connections 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fd008076300 0x7fd0080787c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd01c15e850 0x7fd01c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd01c0cec30 0x7fd01c0b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 --2- 172.21.15.66:0/581273391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd01c06d5e0 0x7fd01c1f8880 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 >> 172.21.15.66:0/581273391 conn(0x7fd01c0d2be0 msgr2=0x7fd01c06ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 shutdown_connections 2024-05-10T11:22:47.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.487+0000 7fd020d9e640 1 -- 172.21.15.66:0/581273391 wait complete. 2024-05-10T11:22:47.498 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T11:22:47.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:47.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.605+0000 7f3741db6640 1 Processor -- start 2024-05-10T11:22:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.605+0000 7f3741db6640 1 -- start start 2024-05-10T11:22:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f3741db6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f373c15f600 0x7f373c0d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f3741db6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f373c0d0b90 0x7f373c0d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f3741db6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 0x7f373c0d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f3741db6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f373c0b46b0 con 0x7f373c15f600 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f3741db6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f373c0b4990 con 0x7f373c0d0b90 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f3741db6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f373c0b4c70 con 0x7f373c0d3b50 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f373c15f600 0x7f373c0d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f373c15f600 0x7f373c0d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51702/0 (socket says 172.21.15.66:51702) 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 -- 172.21.15.66:0/2175893423 learned_addr learned my addr 172.21.15.66:0/2175893423 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 -- 172.21.15.66:0/2175893423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 msgr2=0x7f373c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 --2- 172.21.15.66:0/2175893423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 0x7f373c0d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 -- 172.21.15.66:0/2175893423 >> v2:172.21.15.190:3300/0 conn(0x7f373c0d0b90 msgr2=0x7f373c0d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 --2- 172.21.15.66:0/2175893423 >> v2:172.21.15.190:3300/0 conn(0x7f373c0d0b90 0x7f373c0d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.606+0000 7f373b7fe640 1 -- 172.21.15.66:0/2175893423 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373c0b4f50 con 0x7f373c15f600 2024-05-10T11:22:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.607+0000 7f373b7fe640 1 --2- 172.21.15.66:0/2175893423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c0d0650 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f373c08e6f0 tx=0x7f372c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acc23a69545ef6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.607+0000 7f373a7fc640 1 -- 172.21.15.66:0/2175893423 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c037070 con 0x7f373c15f600 2024-05-10T11:22:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.607+0000 7f373a7fc640 1 -- 172.21.15.66:0/2175893423 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c032440 con 0x7f373c15f600 2024-05-10T11:22:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.607+0000 7f373a7fc640 1 -- 172.21.15.66:0/2175893423 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c032810 con 0x7f373c15f600 2024-05-10T11:22:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 -- 172.21.15.66:0/2175893423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 msgr2=0x7f373c0d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 --2- 172.21.15.66:0/2175893423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c0d0650 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f373c08e6f0 tx=0x7f372c02a140 comp rx=0 tx=0).stop 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 -- 172.21.15.66:0/2175893423 shutdown_connections 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 --2- 172.21.15.66:0/2175893423 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 0x7f373c0d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 --2- 172.21.15.66:0/2175893423 >> v2:172.21.15.190:3300/0 conn(0x7f373c0d0b90 0x7f373c0d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 --2- 172.21.15.66:0/2175893423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c0d0650 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 -- 172.21.15.66:0/2175893423 >> 172.21.15.66:0/2175893423 conn(0x7f373c09e390 msgr2=0x7f373c0d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 -- 172.21.15.66:0/2175893423 shutdown_connections 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.608+0000 7f3741db6640 1 -- 172.21.15.66:0/2175893423 wait complete. 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.609+0000 7f3741db6640 1 Processor -- start 2024-05-10T11:22:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.609+0000 7f3741db6640 1 -- start start 2024-05-10T11:22:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f3741db6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f373c0d0b90 0x7f373c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f3741db6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 0x7f373c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f3741db6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f3741db6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f373c0d1d20 con 0x7f373c15f600 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f3741db6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f373c0d1ba0 con 0x7f373c0d0b90 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f3741db6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f373c0d1ea0 con 0x7f373c0d3b50 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51710/0 (socket says 172.21.15.66:51710) 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 -- 172.21.15.66:0/312776461 learned_addr learned my addr 172.21.15.66:0/312776461 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373b7fe640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f373c0d0b90 0x7f373c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373affd640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 0x7f373c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 -- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 msgr2=0x7f373c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f373c0d3b50 0x7f373c0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 -- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f373c0d0b90 msgr2=0x7f373c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f373c0d0b90 0x7f373c15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.610+0000 7f373bfff640 1 -- 172.21.15.66:0/312776461 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373c1603e0 con 0x7f373c15f600 2024-05-10T11:22:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.611+0000 7f373bfff640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c15d600 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f373400b9a0 tx=0x7f373400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.611+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734019070 con 0x7f373c15f600 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.611+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373400ca60 con 0x7f373c15f600 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.611+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373c1606c0 con 0x7f373c15f600 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.611+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373400ce50 con 0x7f373c15f600 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.611+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373c160c80 con 0x7f373c15f600 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.612+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f373c068c40 con 0x7f373c15f600 2024-05-10T11:22:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.612+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f373401c070 con 0x7f373c15f600 2024-05-10T11:22:47.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f3723fff640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3728076470 0x7f3728078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f3734097140 con 0x7f373c15f600 2024-05-10T11:22:47.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f3723fff640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7f372807ca50 0x7f372807ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f373b7fe640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3728076470 0x7f3728078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3734018ec0 con 0x7f372807ca50 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f373409e050 con 0x7f373c15f600 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.613+0000 7f373affd640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7f372807ca50 0x7f372807ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.614+0000 7f373affd640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7f372807ca50 0x7f372807ee90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.614+0000 7f373b7fe640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3728076470 0x7f3728078930 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f372c034000 tx=0x7f372c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.614+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== osd.3 v2:172.21.15.66:6824/286653269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3734018ec0 con 0x7f372807ca50 2024-05-10T11:22:47.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.627+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 --> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f373c06a220 con 0x7f372807ca50 2024-05-10T11:22:47.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3723fff640 1 -- 172.21.15.66:0/312776461 <== osd.3 v2:172.21.15.66:6824/286653269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f373c06a220 con 0x7f372807ca50 2024-05-10T11:22:47.628 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:47.628 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:47.628 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:47.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7f372807ca50 msgr2=0x7f372807ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:6824/286653269,v1:172.21.15.66:6825/286653269] conn(0x7f372807ca50 0x7f372807ee90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3728076470 msgr2=0x7f3728078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f3728076470 0x7f3728078930 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f372c034000 tx=0x7f372c02e000 comp rx=0 tx=0).stop 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 msgr2=0x7f373c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 --2- 172.21.15.66:0/312776461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c15f600 0x7f373c15d600 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f373400b9a0 tx=0x7f373400bda0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f373bfff640 1 -- 172.21.15.66:0/312776461 reap_dead start 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 shutdown_connections 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 >> 172.21.15.66:0/312776461 conn(0x7f373c09e390 msgr2=0x7f373c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 shutdown_connections 2024-05-10T11:22:47.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.628+0000 7f3741db6640 1 -- 172.21.15.66:0/312776461 wait complete. 2024-05-10T11:22:47.639 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T11:22:47.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.743+0000 7f6cc1bb6640 1 Processor -- start 2024-05-10T11:22:47.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.743+0000 7f6cc1bb6640 1 -- start start 2024-05-10T11:22:47.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.744+0000 7f6cc1bb6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc1598c0 0x7f6cbc06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.744+0000 7f6cc1bb6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cbc06f1c0 con 0x7f6cbc06ec40 2024-05-10T11:22:47.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.744+0000 7f6cc1bb6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cbc06f4a0 con 0x7f6cbc0c7390 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.744+0000 7f6cc1bb6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6cbc06f780 con 0x7f6cbc1598c0 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.744+0000 7f6cbaffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6cbc06ec40 0x7f6cbc0c6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59248/0 (socket says 172.21.15.66:59248) 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.744+0000 7f6cbaffd640 1 -- 172.21.15.66:0/58072715 learned_addr learned my addr 172.21.15.66:0/58072715 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cbb7fe640 1 --2- 172.21.15.66:0/58072715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc1598c0 0x7f6cbc06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278771744 0 0) 0x7f6cbc06f1c0 con 0x7f6cbc06ec40 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca4003520 con 0x7f6cbc06ec40 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186352844 0 0) 0x7f6cbc06f4a0 con 0x7f6cbc0c7390 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cbc06f1c0 con 0x7f6cbc0c7390 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3561910525 0 0) 0x7f6ca4003520 con 0x7f6cbc06ec40 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/58072715 >> v1:172.21.15.190:6789/0 conn(0x7f6cbc0c7390 legacy=0x7f6cbc0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/58072715 >> v1:172.21.15.66:6789/0 conn(0x7f6cbc06ec40 legacy=0x7f6cbc0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.745+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/58072715 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc06fa60 con 0x7f6cbc1598c0 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cbb7fe640 1 --2- 172.21.15.66:0/58072715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc1598c0 0x7f6cbc06e700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0097d0 tx=0x7f6cac02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28cc63fa6269131 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac037070 con 0x7f6cbc1598c0 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac02ac30 con 0x7f6cbc1598c0 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cba7fc640 1 -- 172.21.15.66:0/58072715 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0001670 con 0x7f6cbc1598c0 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/58072715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc1598c0 msgr2=0x7f6cbc06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/58072715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc1598c0 0x7f6cbc06e700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0097d0 tx=0x7f6cac02a1a0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/58072715 shutdown_connections 2024-05-10T11:22:47.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/58072715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc1598c0 0x7f6cbc06e700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.746+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/58072715 >> 172.21.15.66:0/58072715 conn(0x7f6cbc0b2900 msgr2=0x7f6cbc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.747+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/58072715 shutdown_connections 2024-05-10T11:22:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.747+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/58072715 wait complete. 2024-05-10T11:22:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.748+0000 7f6cc1bb6640 1 Processor -- start 2024-05-10T11:22:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.748+0000 7f6cc1bb6640 1 -- start start 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cc1bb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 0x7f6cbc1f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cc1bb6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc0c7390 0x7f6cbc15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cc1bb6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cbc1598c0 0x7f6cbc0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cc1bb6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc159ca0 con 0x7f6cbc06ec40 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cc1bb6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc15c6e0 con 0x7f6cbc1598c0 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cc1bb6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6cbc159e20 con 0x7f6cbc0c7390 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 0x7f6cbc1f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 0x7f6cbc1f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51720/0 (socket says 172.21.15.66:51720) 2024-05-10T11:22:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/1032580839 learned_addr learned my addr 172.21.15.66:0/1032580839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbaffd640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc0c7390 0x7f6cbc15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbbfff640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cbc1598c0 0x7f6cbc0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc0c7390 msgr2=0x7f6cbc15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc0c7390 0x7f6cbc15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cbc1598c0 msgr2=0x7f6cbc0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cbc1598c0 0x7f6cbc0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 -- 172.21.15.66:0/1032580839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc14d940 con 0x7f6cbc06ec40 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbaffd640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc0c7390 0x7f6cbc15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.749+0000 7f6cbb7fe640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 0x7f6cbc1f7260 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0097d0 tx=0x7f6cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.750+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac042020 con 0x7f6cbc06ec40 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.750+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac003c40 con 0x7f6cbc06ec40 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.750+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cbc1f77a0 con 0x7f6cbc06ec40 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.750+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac037040 con 0x7f6cbc06ec40 2024-05-10T11:22:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.750+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cbc0c7f00 con 0x7f6cbc06ec40 2024-05-10T11:22:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.751+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cbc0c9ff0 con 0x7f6cbc06ec40 2024-05-10T11:22:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.751+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6cac045020 con 0x7f6cbc06ec40 2024-05-10T11:22:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.752+0000 7f6ca3fff640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ca8076300 0x7f6ca80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.752+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f6cac0b7bb0 con 0x7f6cbc06ec40 2024-05-10T11:22:47.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.752+0000 7f6cbaffd640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ca8076300 0x7f6ca80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:47.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.752+0000 7f6cbaffd640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ca8076300 0x7f6ca80787c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc15c200 tx=0x7f6cb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:47.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.756+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6cac04c030 con 0x7f6cbc06ec40 2024-05-10T11:22:47.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.946+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6cbc06a220 con 0x7f6ca8076300 2024-05-10T11:22:47.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.947+0000 7f6ca3fff640 1 -- 172.21.15.66:0/1032580839 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6cbc06a220 con 0x7f6ca8076300 2024-05-10T11:22:47.947 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ca8076300 msgr2=0x7f6ca80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ca8076300 0x7f6ca80787c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc15c200 tx=0x7f6cb0009040 comp rx=0 tx=0).stop 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 msgr2=0x7f6cbc1f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 0x7f6cbc1f7260 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0097d0 tx=0x7f6cac0046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 shutdown_connections 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6ca8076300 0x7f6ca80787c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cbc1598c0 0x7f6cbc0ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cbc0c7390 0x7f6cbc15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 --2- 172.21.15.66:0/1032580839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cbc06ec40 0x7f6cbc1f7260 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 >> 172.21.15.66:0/1032580839 conn(0x7f6cbc0b2900 msgr2=0x7f6cbc0c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 shutdown_connections 2024-05-10T11:22:47.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:47.949+0000 7f6cc1bb6640 1 -- 172.21.15.66:0/1032580839 wait complete. 2024-05-10T11:22:47.961 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T11:22:47.961 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:48.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.068+0000 7f42e394e640 1 Processor -- start 2024-05-10T11:22:48.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.068+0000 7f42e394e640 1 -- start start 2024-05-10T11:22:48.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.069+0000 7f42e394e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f42dc15f490 0x7f42dc0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.069+0000 7f42e394e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42dc0d1080 con 0x7f42dc0d5ca0 2024-05-10T11:22:48.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.069+0000 7f42e394e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42dc0b4820 con 0x7f42dc0d3d50 2024-05-10T11:22:48.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.069+0000 7f42e394e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f42dc0b4e70 con 0x7f42dc15f490 2024-05-10T11:22:48.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.069+0000 7f42e0ee9640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f42dc0d5ca0 0x7f42dc0d3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59264/0 (socket says 172.21.15.66:59264) 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.069+0000 7f42e0ee9640 1 -- 172.21.15.66:0/752967632 learned_addr learned my addr 172.21.15.66:0/752967632 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42e16ea640 1 --2- 172.21.15.66:0/752967632 >> v2:172.21.15.190:3300/0 conn(0x7f42dc15f490 0x7f42dc0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42dbfff640 1 -- 172.21.15.66:0/752967632 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119641666 0 0) 0x7f42dc0d1080 con 0x7f42dc0d5ca0 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42dbfff640 1 -- 172.21.15.66:0/752967632 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c4003520 con 0x7f42dc0d5ca0 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42dbfff640 1 -- 172.21.15.66:0/752967632 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1366474798 0 0) 0x7f42c4003520 con 0x7f42dc0d5ca0 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42e16ea640 1 -- 172.21.15.66:0/752967632 >> v1:172.21.15.190:6789/0 conn(0x7f42dc0d3d50 legacy=0x7f42dc0b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42e16ea640 1 -- 172.21.15.66:0/752967632 >> v1:172.21.15.66:6789/0 conn(0x7f42dc0d5ca0 legacy=0x7f42dc0d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.070+0000 7f42e16ea640 1 -- 172.21.15.66:0/752967632 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc0b4b00 con 0x7f42dc15f490 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.071+0000 7f42e16ea640 1 --2- 172.21.15.66:0/752967632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 0x7f42dc0d2f60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f42d40097a0 tx=0x7f42d402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5380611854ccf6d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.071+0000 7f42dbfff640 1 -- 172.21.15.66:0/752967632 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037070 con 0x7f42dc15f490 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.071+0000 7f42dbfff640 1 -- 172.21.15.66:0/752967632 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d402abc0 con 0x7f42dc15f490 2024-05-10T11:22:48.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.071+0000 7f42dbfff640 1 -- 172.21.15.66:0/752967632 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d00019f0 con 0x7f42dc15f490 2024-05-10T11:22:48.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 -- 172.21.15.66:0/752967632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 msgr2=0x7f42dc0d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 --2- 172.21.15.66:0/752967632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 0x7f42dc0d2f60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f42d40097a0 tx=0x7f42d402a130 comp rx=0 tx=0).stop 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 -- 172.21.15.66:0/752967632 shutdown_connections 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 --2- 172.21.15.66:0/752967632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 0x7f42dc0d2f60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 -- 172.21.15.66:0/752967632 >> 172.21.15.66:0/752967632 conn(0x7f42dc0d50f0 msgr2=0x7f42dc0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 -- 172.21.15.66:0/752967632 shutdown_connections 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.072+0000 7f42e394e640 1 -- 172.21.15.66:0/752967632 wait complete. 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.073+0000 7f42e394e640 1 Processor -- start 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.073+0000 7f42e394e640 1 -- start start 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42dc0d3d50 0x7f42dc151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42dc0d5ca0 0x7f42dc0b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 0x7f42dc0b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc15f9f0 con 0x7f42dc0d3d50 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc15f870 con 0x7f42dc15f490 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f42dc0b5a10 con 0x7f42dc0d5ca0 2024-05-10T11:22:48.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42dc0d3d50 0x7f42dc151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42dc0d3d50 0x7f42dc151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51736/0 (socket says 172.21.15.66:51736) 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 -- 172.21.15.66:0/4059933711 learned_addr learned my addr 172.21.15.66:0/4059933711 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 -- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42dc0d5ca0 msgr2=0x7f42dc0b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42dc0d5ca0 0x7f42dc0b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 -- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 msgr2=0x7f42dc0b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42dc15f490 0x7f42dc0b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 -- 172.21.15.66:0/4059933711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc0b6d10 con 0x7f42dc0d3d50 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e16ea640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42dc0d3d50 0x7f42dc151400 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f42d4035040 tx=0x7f42d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4041070 con 0x7f42dc0d3d50 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d403c670 con 0x7f42dc0d3d50 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc0b6ff0 con 0x7f42dc0d3d50 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.074+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037040 con 0x7f42dc0d3d50 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.075+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc0b75b0 con 0x7f42dc0d3d50 2024-05-10T11:22:48.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.075+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42dc06a220 con 0x7f42dc0d3d50 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.076+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42d4044070 con 0x7f42dc0d3d50 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42d9ffb640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42c8076300 0x7f42c80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f42d40b7bf0 con 0x7f42dc0d3d50 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42d9ffb640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f42c807c8e0 0x7f42c807ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42d404cec0 con 0x7f42c807c8e0 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f42d40ba270 con 0x7f42dc0d3d50 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42e0ee9640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42c8076300 0x7f42c80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.077+0000 7f42e1eeb640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f42c807c8e0 0x7f42c807ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.078+0000 7f42e0ee9640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42c8076300 0x7f42c80787c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001560 tx=0x7f42d00014b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.078+0000 7f42e1eeb640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f42c807c8e0 0x7f42c807ed20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.078+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== osd.4 v2:172.21.15.190:6816/1866487272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42d404cec0 con 0x7f42c807c8e0 2024-05-10T11:22:48.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 --> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42dc0d18b0 con 0x7f42c807c8e0 2024-05-10T11:22:48.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42d9ffb640 1 -- 172.21.15.66:0/4059933711 <== osd.4 v2:172.21.15.190:6816/1866487272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42dc0d18b0 con 0x7f42c807c8e0 2024-05-10T11:22:48.092 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:48.092 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:48.092 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:48.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f42c807c8e0 msgr2=0x7f42c807ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6816/1866487272,v1:172.21.15.190:6817/1866487272] conn(0x7f42c807c8e0 0x7f42c807ed20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42c8076300 msgr2=0x7f42c80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f42c8076300 0x7f42c80787c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001560 tx=0x7f42d00014b0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42dc0d3d50 msgr2=0x7f42dc151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 --2- 172.21.15.66:0/4059933711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42dc0d3d50 0x7f42dc151400 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f42d4035040 tx=0x7f42d40046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e1eeb640 1 -- 172.21.15.66:0/4059933711 reap_dead start 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 shutdown_connections 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.092+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 >> 172.21.15.66:0/4059933711 conn(0x7f42dc0d50f0 msgr2=0x7f42dc075840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.093+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 shutdown_connections 2024-05-10T11:22:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.093+0000 7f42e394e640 1 -- 172.21.15.66:0/4059933711 wait complete. 2024-05-10T11:22:48.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T11:22:48.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 Processor -- start 2024-05-10T11:22:48.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 -- start start 2024-05-10T11:22:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d4c15f790 0x7f0d4c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d4c0d5d30 0x7f0d4c0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4c0d30b0 con 0x7f0d4c15f3b0 2024-05-10T11:22:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f0d4c0d3390 con 0x7f0d4c0d5d30 2024-05-10T11:22:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.208+0000 7f0d52293640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0d4c0c8c80 con 0x7f0d4c15f790 2024-05-10T11:22:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d4c0d5d30 0x7f0d4c0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d4c0d5d30 0x7f0d4c0d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51748/0 (socket says 172.21.15.66:51748) 2024-05-10T11:22:48.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 -- 172.21.15.66:0/959739785 learned_addr learned my addr 172.21.15.66:0/959739785 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:48.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 -- 172.21.15.66:0/959739785 >> v2:172.21.15.190:3300/0 conn(0x7f0d4c15f790 msgr2=0x7f0d4c0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:48.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 --2- 172.21.15.66:0/959739785 >> v2:172.21.15.190:3300/0 conn(0x7f0d4c15f790 0x7f0d4c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 -- 172.21.15.66:0/959739785 >> v1:172.21.15.190:6789/0 conn(0x7f0d4c15f3b0 legacy=0x7f0d4c0d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:48.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.209+0000 7f0d50830640 1 -- 172.21.15.66:0/959739785 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c0c8f60 con 0x7f0d4c0d5d30 2024-05-10T11:22:48.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d50830640 1 --2- 172.21.15.66:0/959739785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c0d0210 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0c8c00 tx=0x7f0d4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9598fed708a41424 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d4affd640 1 -- 172.21.15.66:0/959739785 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44036070 con 0x7f0d4c0d5d30 2024-05-10T11:22:48.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d4affd640 1 -- 172.21.15.66:0/959739785 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d44031600 con 0x7f0d4c0d5d30 2024-05-10T11:22:48.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d4affd640 1 -- 172.21.15.66:0/959739785 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440319d0 con 0x7f0d4c0d5d30 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 -- 172.21.15.66:0/959739785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0d5d30 msgr2=0x7f0d4c0d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 --2- 172.21.15.66:0/959739785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c0d0210 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0c8c00 tx=0x7f0d4402a6f0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 -- 172.21.15.66:0/959739785 shutdown_connections 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 --2- 172.21.15.66:0/959739785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c0d0210 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 --2- 172.21.15.66:0/959739785 >> v2:172.21.15.190:3300/0 conn(0x7f0d4c15f790 0x7f0d4c0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 -- 172.21.15.66:0/959739785 >> 172.21.15.66:0/959739785 conn(0x7f0d4c0d5130 msgr2=0x7f0d4c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 -- 172.21.15.66:0/959739785 shutdown_connections 2024-05-10T11:22:48.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.210+0000 7f0d52293640 1 -- 172.21.15.66:0/959739785 wait complete. 2024-05-10T11:22:48.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.212+0000 7f0d52293640 1 Processor -- start 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.212+0000 7f0d52293640 1 -- start start 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.212+0000 7f0d52293640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d4c15f3b0 0x7f0d4c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 0x7f0d4c0d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c0d3f80 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c0d3e00 con 0x7f0d4c0d5d30 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4c0ca770 con 0x7f0d4c15f3b0 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 0x7f0d4c0d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 0x7f0d4c0d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51752/0 (socket says 172.21.15.66:51752) 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 -- 172.21.15.66:0/4202853720 learned_addr learned my addr 172.21.15.66:0/4202853720 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d4bfff640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d4b7fe640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d4c15f3b0 0x7f0d4c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 -- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d4c15f3b0 msgr2=0x7f0d4c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d4c15f3b0 0x7f0d4c159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 -- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d4c0d5d30 msgr2=0x7f0d4c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 -- 172.21.15.66:0/4202853720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c0cc450 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d4bfff640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d4b7fe640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d4c15f3b0 0x7f0d4c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d50830640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 0x7f0d4c0d0c90 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009f40 tx=0x7f0d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44041020 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d44007800 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44036040 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4c0cc730 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.213+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4c0cccf0 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.214+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d4c06a220 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.215+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d44044020 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.216+0000 7f0d48ff9640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d2c0762d0 0x7f0d2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.216+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f0d440b8360 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.216+0000 7f0d4bfff640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d2c0762d0 0x7f0d2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.217+0000 7f0d4bfff640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d2c0762d0 0x7f0d2c078790 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c007fd0 tx=0x7f0d3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.220+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0d4404b030 con 0x7f0d4c0ba9c0 2024-05-10T11:22:48.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.411+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f0d4c0d3790 con 0x7f0d2c0762d0 2024-05-10T11:22:48.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.412+0000 7f0d48ff9640 1 -- 172.21.15.66:0/4202853720 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0d4c0d3790 con 0x7f0d2c0762d0 2024-05-10T11:22:48.412 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T11:22:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d2c0762d0 msgr2=0x7f0d2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d2c0762d0 0x7f0d2c078790 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c007fd0 tx=0x7f0d3c009040 comp rx=0 tx=0).stop 2024-05-10T11:22:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 msgr2=0x7f0d4c0d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 0x7f0d4c0d0c90 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009f40 tx=0x7f0d44004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 shutdown_connections 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f0d2c0762d0 0x7f0d2c078790 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c0ba9c0 0x7f0d4c0d0c90 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d4c15f3b0 0x7f0d4c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 --2- 172.21.15.66:0/4202853720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d4c0d5d30 0x7f0d4c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 >> 172.21.15.66:0/4202853720 conn(0x7f0d4c0d5130 msgr2=0x7f0d4c0cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 shutdown_connections 2024-05-10T11:22:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.414+0000 7f0d52293640 1 -- 172.21.15.66:0/4202853720 wait complete. 2024-05-10T11:22:48.425 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T11:22:48.425 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:48.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.532+0000 7fb603cbd640 1 Processor -- start 2024-05-10T11:22:48.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.532+0000 7fb603cbd640 1 -- start start 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb603cbd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc15f370 0x7fb5fc0d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb603cbd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5fc162e00 0x7fb5fc163290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb603cbd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc0716f0 con 0x7fb5fc1639a0 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb603cbd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fb5fc0d2510 con 0x7fb5fc162e00 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb603cbd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc070220 con 0x7fb5fc15f370 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb60225a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5fc162e00 0x7fb5fc163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb601258640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb5fc1639a0 0x7fb5fc070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59280/0 (socket says 172.21.15.66:59280) 2024-05-10T11:22:48.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb601258640 1 -- 172.21.15.66:0/1280837418 learned_addr learned my addr 172.21.15.66:0/1280837418 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb60225a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5fc162e00 0x7fb5fc163290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51760/0 (socket says 172.21.15.66:51760) 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.533+0000 7fb601a59640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc15f370 0x7fb5fc0d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb60225a640 1 -- 172.21.15.66:0/1280837418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc15f370 msgr2=0x7fb5fc0d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb60225a640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc15f370 0x7fb5fc0d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb60225a640 1 -- 172.21.15.66:0/1280837418 >> v1:172.21.15.66:6789/0 conn(0x7fb5fc1639a0 legacy=0x7fb5fc070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb60225a640 1 -- 172.21.15.66:0/1280837418 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc070500 con 0x7fb5fc162e00 2024-05-10T11:22:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb601a59640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc15f370 0x7fb5fc0d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:48.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb60225a640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc162e00 0x7fb5fc163290 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009d90 tx=0x7fb5f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0645e28f94e26f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb600a57640 1 -- 172.21.15.66:0/1280837418 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4007740 con 0x7fb5fc162e00 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb600a57640 1 -- 172.21.15.66:0/1280837418 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40078e0 con 0x7fb5fc162e00 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.534+0000 7fb600a57640 1 -- 172.21.15.66:0/1280837418 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4007cb0 con 0x7fb5fc162e00 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 -- 172.21.15.66:0/1280837418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc162e00 msgr2=0x7fb5fc163290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc162e00 0x7fb5fc163290 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009d90 tx=0x7fb5f402a6f0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 -- 172.21.15.66:0/1280837418 shutdown_connections 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc162e00 0x7fb5fc163290 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 --2- 172.21.15.66:0/1280837418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc15f370 0x7fb5fc0d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 -- 172.21.15.66:0/1280837418 >> 172.21.15.66:0/1280837418 conn(0x7fb5fc0d2e10 msgr2=0x7fb5fc0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 -- 172.21.15.66:0/1280837418 shutdown_connections 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.535+0000 7fb603cbd640 1 -- 172.21.15.66:0/1280837418 wait complete. 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.536+0000 7fb603cbd640 1 Processor -- start 2024-05-10T11:22:48.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.536+0000 7fb603cbd640 1 -- start start 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb603cbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc15f370 0x7fb5fc0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb603cbd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc162e00 0x7fb5fc0cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb603cbd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc1639a0 0x7fb5fc0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb603cbd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0d2200 con 0x7fb5fc1639a0 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb603cbd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc070ac0 con 0x7fb5fc15f370 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb603cbd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0cd460 con 0x7fb5fc162e00 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc1639a0 0x7fb5fc0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc1639a0 0x7fb5fc0caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51764/0 (socket says 172.21.15.66:51764) 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 -- 172.21.15.66:0/3474858745 learned_addr learned my addr 172.21.15.66:0/3474858745 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb601a59640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc15f370 0x7fb5fc0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb601258640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc162e00 0x7fb5fc0cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 -- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc162e00 msgr2=0x7fb5fc0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc162e00 0x7fb5fc0cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 -- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc15f370 msgr2=0x7fb5fc0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc15f370 0x7fb5fc0cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb60225a640 1 -- 172.21.15.66:0/3474858745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc0d03a0 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb601a59640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc15f370 0x7fb5fc0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.537+0000 7fb601258640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc162e00 0x7fb5fc0cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.538+0000 7fb60225a640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc1639a0 0x7fb5fc0caef0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb5f402ace0 tx=0x7fb5f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.538+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4040070 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.538+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f4031c80 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.538+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc0ca130 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.538+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4045680 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.538+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc0ca6f0 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.539+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5fc0c9ee0 con 0x7fb5fc1639a0 2024-05-10T11:22:48.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.539+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5f4039040 con 0x7fb5fc1639a0 2024-05-10T11:22:48.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb5f27fc640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5e00762d0 0x7fb5e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fb5f40b9340 con 0x7fb5fc1639a0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb5f27fc640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fb5e007c8b0 0x7fb5e007ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5f400ae60 con 0x7fb5e007c8b0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7fb5f40b97d0 con 0x7fb5fc1639a0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb601a59640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5e00762d0 0x7fb5e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.540+0000 7fb601258640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fb5e007c8b0 0x7fb5e007ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.541+0000 7fb601a59640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5e00762d0 0x7fb5e0078790 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800aa30 tx=0x7fb5f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.541+0000 7fb601258640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fb5e007c8b0 0x7fb5e007ecf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.542+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== osd.5 v2:172.21.15.190:6800/4020203147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5f400ae60 con 0x7fb5e007c8b0 2024-05-10T11:22:48.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.555+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 --> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb5fc06a220 con 0x7fb5e007c8b0 2024-05-10T11:22:48.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.555+0000 7fb5f27fc640 1 -- 172.21.15.66:0/3474858745 <== osd.5 v2:172.21.15.190:6800/4020203147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb5fc06a220 con 0x7fb5e007c8b0 2024-05-10T11:22:48.556 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:48.556 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:48.556 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fb5e007c8b0 msgr2=0x7fb5e007ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6800/4020203147,v1:172.21.15.190:6801/4020203147] conn(0x7fb5e007c8b0 0x7fb5e007ecf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5e00762d0 msgr2=0x7fb5e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fb5e00762d0 0x7fb5e0078790 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800aa30 tx=0x7fb5f8008040 comp rx=0 tx=0).stop 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc1639a0 msgr2=0x7fb5fc0caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 --2- 172.21.15.66:0/3474858745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5fc1639a0 0x7fb5fc0caef0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb5f402ace0 tx=0x7fb5f4004a40 comp rx=0 tx=0).stop 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb60225a640 1 -- 172.21.15.66:0/3474858745 reap_dead start 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 shutdown_connections 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 >> 172.21.15.66:0/3474858745 conn(0x7fb5fc0d2e10 msgr2=0x7fb5fc070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 shutdown_connections 2024-05-10T11:22:48.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.556+0000 7fb603cbd640 1 -- 172.21.15.66:0/3474858745 wait complete. 2024-05-10T11:22:48.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T11:22:48.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.671+0000 7f1e96e64640 1 Processor -- start 2024-05-10T11:22:48.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.671+0000 7f1e96e64640 1 -- start start 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e96e64640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1e900d3d80 0x7f1e900b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e96e64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d59d0 0x7f1e900d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e96e64640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e900d2d20 con 0x7f1e90162940 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e96e64640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1e90162d20 con 0x7f1e900d3d80 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e96e64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1e900d3000 con 0x7f1e900d59d0 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e94c00640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1e90162940 0x7f1e900d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59282/0 (socket says 172.21.15.66:59282) 2024-05-10T11:22:48.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e94c00640 1 -- 172.21.15.66:0/2272079193 learned_addr learned my addr 172.21.15.66:0/2272079193 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e87fff640 1 --2- 172.21.15.66:0/2272079193 >> v2:172.21.15.190:3300/0 conn(0x7f1e900d3d80 0x7f1e900b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e95401640 1 --2- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d59d0 0x7f1e900d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e877fe640 1 -- 172.21.15.66:0/2272079193 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123362515 0 0) 0x7f1e900d2d20 con 0x7f1e90162940 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.672+0000 7f1e877fe640 1 -- 172.21.15.66:0/2272079193 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e78003520 con 0x7f1e90162940 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.673+0000 7f1e87fff640 1 -- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d59d0 msgr2=0x7f1e900d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.673+0000 7f1e87fff640 1 --2- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d59d0 0x7f1e900d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.673+0000 7f1e87fff640 1 -- 172.21.15.66:0/2272079193 >> v1:172.21.15.66:6789/0 conn(0x7f1e90162940 legacy=0x7f1e900d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.673+0000 7f1e87fff640 1 -- 172.21.15.66:0/2272079193 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e900d32e0 con 0x7f1e900d3d80 2024-05-10T11:22:48.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.673+0000 7f1e87fff640 1 --2- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e900d3d80 0x7f1e900b5e20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097a0 tx=0x7f1e8002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68e5b2d7dd26248 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e877fe640 1 -- 172.21.15.66:0/2272079193 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80037070 con 0x7f1e900d3d80 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e877fe640 1 -- 172.21.15.66:0/2272079193 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8002ae50 con 0x7f1e900d3d80 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e877fe640 1 -- 172.21.15.66:0/2272079193 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80032640 con 0x7f1e900d3d80 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 -- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e900d3d80 msgr2=0x7f1e900b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 --2- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e900d3d80 0x7f1e900b5e20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097a0 tx=0x7f1e8002a100 comp rx=0 tx=0).stop 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 -- 172.21.15.66:0/2272079193 shutdown_connections 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 --2- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d59d0 0x7f1e900d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 --2- 172.21.15.66:0/2272079193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e900d3d80 0x7f1e900b5e20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 -- 172.21.15.66:0/2272079193 >> 172.21.15.66:0/2272079193 conn(0x7f1e9009e380 msgr2=0x7f1e900d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 -- 172.21.15.66:0/2272079193 shutdown_connections 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.674+0000 7f1e96e64640 1 -- 172.21.15.66:0/2272079193 wait complete. 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.675+0000 7f1e96e64640 1 Processor -- start 2024-05-10T11:22:48.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.675+0000 7f1e96e64640 1 -- start start 2024-05-10T11:22:48.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e96e64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d3d80 0x7f1e900cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e96e64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 0x7f1e900b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e96e64640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e90162940 0x7f1e900ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e96e64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1e900d2390 con 0x7f1e900d59d0 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e96e64640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1e900cfc50 con 0x7f1e90162940 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e96e64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1e900d2510 con 0x7f1e900d3d80 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e87fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 0x7f1e900b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e87fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 0x7f1e900b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51770/0 (socket says 172.21.15.66:51770) 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.676+0000 7f1e87fff640 1 -- 172.21.15.66:0/3462027576 learned_addr learned my addr 172.21.15.66:0/3462027576 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e95401640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e90162940 0x7f1e900ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e94c00640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d3d80 0x7f1e900cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e87fff640 1 -- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d3d80 msgr2=0x7f1e900cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e87fff640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d3d80 0x7f1e900cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e87fff640 1 -- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e90162940 msgr2=0x7f1e900ba9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e87fff640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e90162940 0x7f1e900ba9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e87fff640 1 -- 172.21.15.66:0/3462027576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e900baee0 con 0x7f1e900d59d0 2024-05-10T11:22:48.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e95401640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e90162940 0x7f1e900ba9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e94c00640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d3d80 0x7f1e900cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e87fff640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 0x7f1e900b1c70 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1e8002a140 tx=0x7f1e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80041070 con 0x7f1e900d59d0 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e900b23e0 con 0x7f1e900d59d0 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8003c460 con 0x7f1e900d59d0 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80037040 con 0x7f1e900d59d0 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.677+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e900b29a0 con 0x7f1e900d59d0 2024-05-10T11:22:48.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.678+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9006a220 con 0x7f1e900d59d0 2024-05-10T11:22:48.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.679+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e80044070 con 0x7f1e900d59d0 2024-05-10T11:22:48.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.679+0000 7f1e857fa640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1e7c0762d0 0x7f1e7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.680+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f1e800b7ba0 con 0x7f1e900d59d0 2024-05-10T11:22:48.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.680+0000 7f1e94c00640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1e7c0762d0 0x7f1e7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.680+0000 7f1e94c00640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1e7c0762d0 0x7f1e7c078790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c005880 tx=0x7f1e8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:48.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.684+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1e80081540 con 0x7f1e900d59d0 2024-05-10T11:22:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.874+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f1e900d2730 con 0x7f1e7c0762d0 2024-05-10T11:22:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.874+0000 7f1e857fa640 1 -- 172.21.15.66:0/3462027576 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1e900d2730 con 0x7f1e7c0762d0 2024-05-10T11:22:48.874 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1e7c0762d0 msgr2=0x7f1e7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1e7c0762d0 0x7f1e7c078790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c005880 tx=0x7f1e8c009040 comp rx=0 tx=0).stop 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 msgr2=0x7f1e900b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 0x7f1e900b1c70 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1e8002a140 tx=0x7f1e800046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 shutdown_connections 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1e7c0762d0 0x7f1e7c078790 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e90162940 0x7f1e900ba9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e900d59d0 0x7f1e900b1c70 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 --2- 172.21.15.66:0/3462027576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e900d3d80 0x7f1e900cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 >> 172.21.15.66:0/3462027576 conn(0x7f1e9009e380 msgr2=0x7f1e9006d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:48.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 shutdown_connections 2024-05-10T11:22:48.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.876+0000 7f1e96e64640 1 -- 172.21.15.66:0/3462027576 wait complete. 2024-05-10T11:22:48.888 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T11:22:48.888 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.996+0000 7fbd94b7f640 1 Processor -- start 2024-05-10T11:22:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.996+0000 7fbd94b7f640 1 -- start start 2024-05-10T11:22:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd94b7f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbd901639a0 0x7fbd90070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd94b7f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbd90071520 0x7fbd90162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd94b7f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd900d2510 con 0x7fbd9015f370 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd94b7f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7fbd90070220 con 0x7fbd901639a0 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd94b7f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbd90070500 con 0x7fbd90071520 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbd901639a0 0x7fbd90070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbd901639a0 0x7fbd90070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51772/0 (socket says 172.21.15.66:51772) 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2797781845 learned_addr learned my addr 172.21.15.66:0/2797781845 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8ed9d640 1 --2- 172.21.15.66:0/2797781845 >> v2:172.21.15.190:3300/0 conn(0x7fbd90071520 0x7fbd90162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2797781845 >> v2:172.21.15.190:3300/0 conn(0x7fbd90071520 msgr2=0x7fbd90162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 --2- 172.21.15.66:0/2797781845 >> v2:172.21.15.190:3300/0 conn(0x7fbd90071520 0x7fbd90162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2797781845 >> v1:172.21.15.190:6789/0 conn(0x7fbd9015f370 legacy=0x7fbd900d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.997+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2797781845 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd900707e0 con 0x7fbd901639a0 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.998+0000 7fbd8dd9b640 1 --2- 172.21.15.66:0/2797781845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90070fe0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fbd90073040 tx=0x7fbd8402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6780b38e47174375 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.998+0000 7fbd8d59a640 1 -- 172.21.15.66:0/2797781845 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84037070 con 0x7fbd901639a0 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.998+0000 7fbd8d59a640 1 -- 172.21.15.66:0/2797781845 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8402ae50 con 0x7fbd901639a0 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.998+0000 7fbd8d59a640 1 -- 172.21.15.66:0/2797781845 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84032860 con 0x7fbd901639a0 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2797781845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 msgr2=0x7fbd90070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 --2- 172.21.15.66:0/2797781845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90070fe0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fbd90073040 tx=0x7fbd8402a300 comp rx=0 tx=0).stop 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2797781845 shutdown_connections 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 --2- 172.21.15.66:0/2797781845 >> v2:172.21.15.190:3300/0 conn(0x7fbd90071520 0x7fbd90162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 --2- 172.21.15.66:0/2797781845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90070fe0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2797781845 >> 172.21.15.66:0/2797781845 conn(0x7fbd900d2e10 msgr2=0x7fbd900d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2797781845 shutdown_connections 2024-05-10T11:22:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:48.999+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2797781845 wait complete. 2024-05-10T11:22:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.000+0000 7fbd94b7f640 1 Processor -- start 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.000+0000 7fbd94b7f640 1 -- start start 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd94b7f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd9015f370 0x7fbd9015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd94b7f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd94b7f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd90161e60 0x7fbd9009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd94b7f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901634c0 con 0x7fbd901639a0 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd94b7f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90163340 con 0x7fbd90161e60 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd94b7f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbd90163640 con 0x7fbd9015f370 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd8dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd8dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51782/0 (socket says 172.21.15.66:51782) 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2385813476 learned_addr learned my addr 172.21.15.66:0/2385813476 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd8ed9d640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd90161e60 0x7fbd9009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.001+0000 7fbd8e59c640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd9015f370 0x7fbd9015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd9015f370 msgr2=0x7fbd9015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8dd9b640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd9015f370 0x7fbd9015a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd90161e60 msgr2=0x7fbd9009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8dd9b640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd90161e60 0x7fbd9009daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8dd9b640 1 -- 172.21.15.66:0/2385813476 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd901e8ce0 con 0x7fbd901639a0 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8ed9d640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd90161e60 0x7fbd9009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd8dd9b640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90161920 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fbd8402a340 tx=0x7fbd840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84041070 con 0x7fbd901639a0 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8403c680 con 0x7fbd901639a0 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd901e9d10 con 0x7fbd901639a0 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84037040 con 0x7fbd901639a0 2024-05-10T11:22:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.002+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd901e9230 con 0x7fbd901639a0 2024-05-10T11:22:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.003+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd9006a220 con 0x7fbd901639a0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd84044070 con 0x7fbd901639a0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd7effd640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd70076300 0x7fbd700787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7fbd840b7ca0 con 0x7fbd901639a0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd7effd640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7fbd7007c8e0 0x7fbd7007ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd84041e70 con 0x7fbd7007c8e0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7fbd840ba3a0 con 0x7fbd901639a0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.004+0000 7fbd8e59c640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd70076300 0x7fbd700787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.005+0000 7fbd8ed9d640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7fbd7007c8e0 0x7fbd7007ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.005+0000 7fbd8e59c640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd70076300 0x7fbd700787c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001640 tx=0x7fbd80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.005+0000 7fbd8ed9d640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7fbd7007c8e0 0x7fbd7007ed20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.006+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== osd.6 v2:172.21.15.190:6808/4182602787 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd84041e70 con 0x7fbd7007c8e0 2024-05-10T11:22:49.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.019+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 --> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd900b1de0 con 0x7fbd7007c8e0 2024-05-10T11:22:49.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd7effd640 1 -- 172.21.15.66:0/2385813476 <== osd.6 v2:172.21.15.190:6808/4182602787 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd900b1de0 con 0x7fbd7007c8e0 2024-05-10T11:22:49.020 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:49.020 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:49.020 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7fbd7007c8e0 msgr2=0x7fbd7007ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6808/4182602787,v1:172.21.15.190:6809/4182602787] conn(0x7fbd7007c8e0 0x7fbd7007ed20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd70076300 msgr2=0x7fbd700787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7fbd70076300 0x7fbd700787c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001640 tx=0x7fbd80009040 comp rx=0 tx=0).stop 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 msgr2=0x7fbd90161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 --2- 172.21.15.66:0/2385813476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd901639a0 0x7fbd90161920 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fbd8402a340 tx=0x7fbd840046c0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd8ed9d640 1 -- 172.21.15.66:0/2385813476 reap_dead start 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 shutdown_connections 2024-05-10T11:22:49.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 >> 172.21.15.66:0/2385813476 conn(0x7fbd900d2e10 msgr2=0x7fbd9006e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 shutdown_connections 2024-05-10T11:22:49.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.020+0000 7fbd94b7f640 1 -- 172.21.15.66:0/2385813476 wait complete. 2024-05-10T11:22:49.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T11:22:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.135+0000 7f983175f640 1 Processor -- start 2024-05-10T11:22:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.135+0000 7f983175f640 1 -- start start 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.135+0000 7f983175f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f982c15f4e0 0x7f982c06d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f983175f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f982c06e620 0x7f982c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f983175f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0b0a90 con 0x7f982c15f8c0 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f983175f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f982c0b23f0 con 0x7f982c06e620 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f983175f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f982c0b4150 con 0x7f982c15f4e0 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f982c06e620 0x7f982c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f982c06e620 0x7f982c0d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51792/0 (socket says 172.21.15.66:51792) 2024-05-10T11:22:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 -- 172.21.15.66:0/1039664965 learned_addr learned my addr 172.21.15.66:0/1039664965 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982affd640 1 --2- 172.21.15.66:0/1039664965 >> v2:172.21.15.190:3300/0 conn(0x7f982c15f4e0 0x7f982c06d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 -- 172.21.15.66:0/1039664965 >> v2:172.21.15.190:3300/0 conn(0x7f982c15f4e0 msgr2=0x7f982c06d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 --2- 172.21.15.66:0/1039664965 >> v2:172.21.15.190:3300/0 conn(0x7f982c15f4e0 0x7f982c06d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 -- 172.21.15.66:0/1039664965 >> v1:172.21.15.190:6789/0 conn(0x7f982c15f8c0 legacy=0x7f982c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.136+0000 7f982b7fe640 1 -- 172.21.15.66:0/1039664965 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0b3540 con 0x7f982c06e620 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.137+0000 7f982b7fe640 1 --2- 172.21.15.66:0/1039664965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c06e620 0x7f982c0d0cf0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f982c068c10 tx=0x7f982402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbcd53a2fb35403 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.137+0000 7f982a7fc640 1 -- 172.21.15.66:0/1039664965 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824036070 con 0x7f982c06e620 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.137+0000 7f982a7fc640 1 -- 172.21.15.66:0/1039664965 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9824031600 con 0x7f982c06e620 2024-05-10T11:22:49.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.137+0000 7f982a7fc640 1 -- 172.21.15.66:0/1039664965 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98240319d0 con 0x7f982c06e620 2024-05-10T11:22:49.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.137+0000 7f983175f640 1 -- 172.21.15.66:0/1039664965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c06e620 msgr2=0x7f982c0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.137+0000 7f983175f640 1 --2- 172.21.15.66:0/1039664965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c06e620 0x7f982c0d0cf0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f982c068c10 tx=0x7f982402a660 comp rx=0 tx=0).stop 2024-05-10T11:22:49.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.138+0000 7f983175f640 1 -- 172.21.15.66:0/1039664965 shutdown_connections 2024-05-10T11:22:49.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.138+0000 7f983175f640 1 --2- 172.21.15.66:0/1039664965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c06e620 0x7f982c0d0cf0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.138+0000 7f983175f640 1 --2- 172.21.15.66:0/1039664965 >> v2:172.21.15.190:3300/0 conn(0x7f982c15f4e0 0x7f982c06d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.138+0000 7f983175f640 1 -- 172.21.15.66:0/1039664965 >> 172.21.15.66:0/1039664965 conn(0x7f982c0d2df0 msgr2=0x7f982c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.138+0000 7f983175f640 1 -- 172.21.15.66:0/1039664965 shutdown_connections 2024-05-10T11:22:49.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.138+0000 7f983175f640 1 -- 172.21.15.66:0/1039664965 wait complete. 2024-05-10T11:22:49.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.139+0000 7f983175f640 1 Processor -- start 2024-05-10T11:22:49.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.139+0000 7f983175f640 1 -- start start 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f983175f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f982c06e620 0x7f982c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f983175f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 0x7f982c0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f983175f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f982c15f8c0 0x7f982c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f983175f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0b3de0 con 0x7f982c15f4e0 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f983175f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0b3b00 con 0x7f982c15f8c0 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f983175f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0b45e0 con 0x7f982c06e620 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 0x7f982c0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 0x7f982c0c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51800/0 (socket says 172.21.15.66:51800) 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 -- 172.21.15.66:0/2786703034 learned_addr learned my addr 172.21.15.66:0/2786703034 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f982affd640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f982c06e620 0x7f982c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f982b7fe640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f982c15f8c0 0x7f982c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 -- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f982c06e620 msgr2=0x7f982c154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f982c06e620 0x7f982c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 -- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f982c15f8c0 msgr2=0x7f982c0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f982c15f8c0 0x7f982c0d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 -- 172.21.15.66:0/2786703034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0c86a0 con 0x7f982c15f4e0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f98227fc640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 0x7f982c0c7ce0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f981400c420 tx=0x7f981400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814007020 con 0x7f982c15f4e0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.140+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98140071c0 con 0x7f982c15f4e0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.141+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c0c8980 con 0x7f982c15f4e0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.141+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814007590 con 0x7f982c15f4e0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.141+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c0c8f40 con 0x7f982c15f4e0 2024-05-10T11:22:49.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.141+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c06a220 con 0x7f982c15f4e0 2024-05-10T11:22:49.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.142+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9814019020 con 0x7f982c15f4e0 2024-05-10T11:22:49.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.143+0000 7f9823fff640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f980c0762d0 0x7f980c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.143+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f9814096d10 con 0x7f982c15f4e0 2024-05-10T11:22:49.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.143+0000 7f982affd640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f980c0762d0 0x7f980c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.143+0000 7f982affd640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f980c0762d0 0x7f980c078790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f981c006fd0 tx=0x7f981c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.147+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9814060730 con 0x7f982c15f4e0 2024-05-10T11:22:49.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.337+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f982c15ea70 con 0x7f980c0762d0 2024-05-10T11:22:49.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.338+0000 7f9823fff640 1 -- 172.21.15.66:0/2786703034 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f982c15ea70 con 0x7f980c0762d0 2024-05-10T11:22:49.338 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f980c0762d0 msgr2=0x7f980c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f980c0762d0 0x7f980c078790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f981c006fd0 tx=0x7f981c008040 comp rx=0 tx=0).stop 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 msgr2=0x7f982c0c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 0x7f982c0c7ce0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f981400c420 tx=0x7f981400c8e0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 shutdown_connections 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f980c0762d0 0x7f980c078790 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f982c15f8c0 0x7f982c0d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f982c15f4e0 0x7f982c0c7ce0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 --2- 172.21.15.66:0/2786703034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f982c06e620 0x7f982c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 >> 172.21.15.66:0/2786703034 conn(0x7f982c0d2df0 msgr2=0x7f982c0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 shutdown_connections 2024-05-10T11:22:49.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.340+0000 7f983175f640 1 -- 172.21.15.66:0/2786703034 wait complete. 2024-05-10T11:22:49.352 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T11:22:49.352 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T11:22:49.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.460+0000 7f46a9589640 1 Processor -- start 2024-05-10T11:22:49.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.460+0000 7f46a9589640 1 -- start start 2024-05-10T11:22:49.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a9589640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f46a4162990 0x7f46a40b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a9589640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46a40b5f30 0x7f46a40d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a9589640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a40d0830 con 0x7f46a40d1aa0 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a9589640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f46a40d10d0 con 0x7f46a4162990 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a9589640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f46a40d0b10 con 0x7f46a40b5f30 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f46a4162990 0x7f46a40b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f46a4162990 0x7f46a40b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51814/0 (socket says 172.21.15.66:51814) 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 -- 172.21.15.66:0/756166708 learned_addr learned my addr 172.21.15.66:0/756166708 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 -- 172.21.15.66:0/756166708 >> v2:172.21.15.190:3300/0 conn(0x7f46a40b5f30 msgr2=0x7f46a40d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f469a7fc640 1 --2- 172.21.15.66:0/756166708 >> v2:172.21.15.190:3300/0 conn(0x7f46a40b5f30 0x7f46a40d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 --2- 172.21.15.66:0/756166708 >> v2:172.21.15.190:3300/0 conn(0x7f46a40b5f30 0x7f46a40d59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 -- 172.21.15.66:0/756166708 >> v1:172.21.15.190:6789/0 conn(0x7f46a40d1aa0 legacy=0x7f46a41630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.461+0000 7f46a2ffd640 1 -- 172.21.15.66:0/756166708 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a40d0df0 con 0x7f46a4162990 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.462+0000 7f46a2ffd640 1 --2- 172.21.15.66:0/756166708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a4162990 0x7f46a40b48a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f46a408f750 tx=0x7f469402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb941a6fa26c492 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.462+0000 7f46a27fc640 1 -- 172.21.15.66:0/756166708 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694037070 con 0x7f46a4162990 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.462+0000 7f46a27fc640 1 -- 172.21.15.66:0/756166708 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4694032440 con 0x7f46a4162990 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.462+0000 7f46a27fc640 1 -- 172.21.15.66:0/756166708 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694032810 con 0x7f46a4162990 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 -- 172.21.15.66:0/756166708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a4162990 msgr2=0x7f46a40b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 --2- 172.21.15.66:0/756166708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a4162990 0x7f46a40b48a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f46a408f750 tx=0x7f469402a230 comp rx=0 tx=0).stop 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 -- 172.21.15.66:0/756166708 shutdown_connections 2024-05-10T11:22:49.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 --2- 172.21.15.66:0/756166708 >> v2:172.21.15.190:3300/0 conn(0x7f46a40b5f30 0x7f46a40d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 --2- 172.21.15.66:0/756166708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a4162990 0x7f46a40b48a0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 -- 172.21.15.66:0/756166708 >> 172.21.15.66:0/756166708 conn(0x7f46a409e3f0 msgr2=0x7f46a40d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 -- 172.21.15.66:0/756166708 shutdown_connections 2024-05-10T11:22:49.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.463+0000 7f46a9589640 1 -- 172.21.15.66:0/756166708 wait complete. 2024-05-10T11:22:49.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.464+0000 7f46a9589640 1 Processor -- start 2024-05-10T11:22:49.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.464+0000 7f46a9589640 1 -- start start 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a9589640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46a40b5f30 0x7f46a40c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a9589640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a40d1aa0 0x7f46a415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a9589640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46a4162990 0x7f46a40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a9589640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40d5ef0 con 0x7f46a40d1aa0 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a9589640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4162d70 con 0x7f46a40b5f30 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a9589640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f46a40d1f30 con 0x7f46a4162990 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a40d1aa0 0x7f46a415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a40d1aa0 0x7f46a415b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51816/0 (socket says 172.21.15.66:51816) 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 -- 172.21.15.66:0/1497693277 learned_addr learned my addr 172.21.15.66:0/1497693277 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f46a2ffd640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46a40b5f30 0x7f46a40c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 -- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46a4162990 msgr2=0x7f46a40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46a4162990 0x7f46a40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 -- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46a40b5f30 msgr2=0x7f46a40c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46a40b5f30 0x7f46a40c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 -- 172.21.15.66:0/1497693277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a40ca2e0 con 0x7f46a40d1aa0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469a7fc640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a40d1aa0 0x7f46a415b430 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c7f0 tx=0x7f468c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.465+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c015070 con 0x7f46a40d1aa0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.466+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468c004240 con 0x7f46a40d1aa0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.466+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c003610 con 0x7f46a40d1aa0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.466+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a40ca5c0 con 0x7f46a40d1aa0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.466+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a40cab80 con 0x7f46a40d1aa0 2024-05-10T11:22:49.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.466+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46a406a220 con 0x7f46a40d1aa0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.467+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f468c0039c0 con 0x7f46a40d1aa0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f469bfff640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46840762d0 0x7f4684078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f468c0974e0 con 0x7f46a40d1aa0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f469bfff640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f468407c8b0 0x7f468407ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f468c014e50 con 0x7f468407c8b0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f468c09e050 con 0x7f46a40d1aa0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f46a2ffd640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46840762d0 0x7f4684078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f46a37fe640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f468407c8b0 0x7f468407ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f46a2ffd640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46840762d0 0x7f4684078790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4694034000 tx=0x7f469402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.468+0000 7f46a37fe640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f468407c8b0 0x7f468407ecf0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.469+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== osd.7 v2:172.21.15.190:6824/1531895533 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f468c014e50 con 0x7f468407c8b0 2024-05-10T11:22:49.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.482+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 --> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f46a40b85b0 con 0x7f468407c8b0 2024-05-10T11:22:49.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f469bfff640 1 -- 172.21.15.66:0/1497693277 <== osd.7 v2:172.21.15.190:6824/1531895533 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f46a40b85b0 con 0x7f468407c8b0 2024-05-10T11:22:49.483 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-10T11:22:49.483 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T11:22:49.483 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-10T11:22:49.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f468407c8b0 msgr2=0x7f468407ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6824/1531895533,v1:172.21.15.190:6825/1531895533] conn(0x7f468407c8b0 0x7f468407ecf0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46840762d0 msgr2=0x7f4684078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f46840762d0 0x7f4684078790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4694034000 tx=0x7f469402e000 comp rx=0 tx=0).stop 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a40d1aa0 msgr2=0x7f46a415b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 --2- 172.21.15.66:0/1497693277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46a40d1aa0 0x7f46a415b430 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c7f0 tx=0x7f468c00ccb0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a37fe640 1 -- 172.21.15.66:0/1497693277 reap_dead start 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 shutdown_connections 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 >> 172.21.15.66:0/1497693277 conn(0x7f46a409e3f0 msgr2=0x7f46a406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.483+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 shutdown_connections 2024-05-10T11:22:49.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.484+0000 7f46a9589640 1 -- 172.21.15.66:0/1497693277 wait complete. 2024-05-10T11:22:49.495 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T11:22:49.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.599+0000 7f1348e17640 1 Processor -- start 2024-05-10T11:22:49.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.599+0000 7f1348e17640 1 -- start start 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1348e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 0x7f134406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1348e17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f134406e620 0x7f13440d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1348e17640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13440b0a90 con 0x7f134415f8c0 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1348e17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f13440b23f0 con 0x7f134406e620 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1348e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13440b4150 con 0x7f134415f4e0 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f133bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f134415f8c0 0x7f134406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59292/0 (socket says 172.21.15.66:59292) 2024-05-10T11:22:49.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f133bfff640 1 -- 172.21.15.66:0/3653326563 learned_addr learned my addr 172.21.15.66:0/3653326563 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1342d9d640 1 --2- 172.21.15.66:0/3653326563 >> v2:172.21.15.190:3300/0 conn(0x7f134406e620 0x7f13440d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f134259c640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 0x7f134406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101709226 0 0) 0x7f13440b0a90 con 0x7f134415f8c0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1330003520 con 0x7f134415f8c0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1916610266 0 0) 0x7f1330003520 con 0x7f134415f8c0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 msgr2=0x7f134406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 0x7f134406d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 >> v2:172.21.15.190:3300/0 conn(0x7f134406e620 msgr2=0x7f13440d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 --2- 172.21.15.66:0/3653326563 >> v2:172.21.15.190:3300/0 conn(0x7f134406e620 0x7f13440d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13440b3540 con 0x7f134415f8c0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.600+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f132c001670 con 0x7f134415f8c0 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 >> v1:172.21.15.66:6789/0 conn(0x7f134415f8c0 legacy=0x7f134406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 0x7f13300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1330003f30 0x7f1330004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13440b23f0 con 0x7f1330003f30 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13440b4150 con 0x7f1330004d40 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f133000ba10 con 0x7f134415f4e0 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f133bfff640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1330003f30 0x7f1330004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f134259c640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 0x7f13300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f1342d9d640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f133bfff640 1 -- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 msgr2=0x7f13300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f133bfff640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134415f4e0 0x7f13300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f133bfff640 1 -- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330004d40 msgr2=0x7f13300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f133bfff640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.601+0000 7f133bfff640 1 -- 172.21.15.66:0/3653326563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1330003520 con 0x7f1330003f30 2024-05-10T11:22:49.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f133bfff640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1330003f30 0x7f1330004800 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c210 tx=0x7f1330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e298397566d719 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c007d50 con 0x7f1330003f30 2024-05-10T11:22:49.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c005af0 con 0x7f1330003f30 2024-05-10T11:22:49.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1341d9b640 1 -- 172.21.15.66:0/3653326563 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c007070 con 0x7f1330003f30 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1348e17640 1 -- 172.21.15.66:0/3653326563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1330003f30 msgr2=0x7f1330004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1348e17640 1 --2- 172.21.15.66:0/3653326563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1330003f30 0x7f1330004800 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c210 tx=0x7f1330005830 comp rx=0 tx=0).stop 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1342d9d640 1 -- 172.21.15.66:0/3653326563 reap_dead start 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1348e17640 1 -- 172.21.15.66:0/3653326563 shutdown_connections 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1348e17640 1 -- 172.21.15.66:0/3653326563 >> 172.21.15.66:0/3653326563 conn(0x7f13440d2df0 msgr2=0x7f13440d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1348e17640 1 -- 172.21.15.66:0/3653326563 shutdown_connections 2024-05-10T11:22:49.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.602+0000 7f1348e17640 1 -- 172.21.15.66:0/3653326563 wait complete. 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.604+0000 7f1348e17640 1 Processor -- start 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.604+0000 7f1348e17640 1 -- start start 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330003f30 0x7f1344140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13440c9000 0x7f1344162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 0x7f1344162960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13440b3de0 con 0x7f13440c9480 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13440b3b00 con 0x7f1330003f30 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13440b45e0 con 0x7f13440c9000 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 0x7f1344162960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 0x7f1344162960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51834/0 (socket says 172.21.15.66:51834) 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 -- 172.21.15.66:0/2498028434 learned_addr learned my addr 172.21.15.66:0/2498028434 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f134259c640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330003f30 0x7f1344140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f133bfff640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13440c9000 0x7f1344162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 -- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13440c9000 msgr2=0x7f1344162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13440c9000 0x7f1344162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 -- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330003f30 msgr2=0x7f1344140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330003f30 0x7f1344140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 -- 172.21.15.66:0/2498028434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13441f93d0 con 0x7f13440c9480 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f134259c640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330003f30 0x7f1344140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1342d9d640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 0x7f1344162960 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1344073ad0 tx=0x7f133c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c00fd80 con 0x7f13440c9480 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c01d070 con 0x7f13440c9480 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134415ba20 con 0x7f13440c9480 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c015670 con 0x7f13440c9480 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.605+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134415bfe0 con 0x7f13440c9480 2024-05-10T11:22:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.606+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134406a220 con 0x7f13440c9480 2024-05-10T11:22:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.607+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f133c015810 con 0x7f13440c9480 2024-05-10T11:22:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.608+0000 7f133affd640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1324076300 0x7f13240787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.608+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f133c097d70 con 0x7f13440c9480 2024-05-10T11:22:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.608+0000 7f134259c640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1324076300 0x7f13240787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.608+0000 7f134259c640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1324076300 0x7f13240787c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1334009ae0 tx=0x7f1334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.612+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f133c010040 con 0x7f13440c9480 2024-05-10T11:22:49.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.803+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f134415e7d0 con 0x7f1324076300 2024-05-10T11:22:49.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.804+0000 7f133affd640 1 -- 172.21.15.66:0/2498028434 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f134415e7d0 con 0x7f1324076300 2024-05-10T11:22:49.804 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T11:22:49.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1324076300 msgr2=0x7f13240787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1324076300 0x7f13240787c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1334009ae0 tx=0x7f1334008040 comp rx=0 tx=0).stop 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 msgr2=0x7f1344162960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 0x7f1344162960 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1344073ad0 tx=0x7f133c00f580 comp rx=0 tx=0).stop 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 shutdown_connections 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f1324076300 0x7f13240787c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13440c9480 0x7f1344162960 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13440c9000 0x7f1344162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 --2- 172.21.15.66:0/2498028434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1330003f30 0x7f1344140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 >> 172.21.15.66:0/2498028434 conn(0x7f13440d2df0 msgr2=0x7f1344070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 shutdown_connections 2024-05-10T11:22:49.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.806+0000 7f1348e17640 1 -- 172.21.15.66:0/2498028434 wait complete. 2024-05-10T11:22:49.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:22:49.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.920+0000 7f23d44da640 1 Processor -- start 2024-05-10T11:22:49.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.920+0000 7f23d44da640 1 -- start start 2024-05-10T11:22:49.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d44da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 0x7f23cc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d44da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f23cc06e620 0x7f23cc0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d44da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23cc0b0a90 con 0x7f23cc15f4e0 2024-05-10T11:22:49.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d44da640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc0b23f0 con 0x7f23cc06e620 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d44da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc0b4150 con 0x7f23cc15f8c0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d2276640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f23cc15f4e0 0x7f23cc06d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:59304/0 (socket says 172.21.15.66:59304) 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d2276640 1 -- 172.21.15.66:0/1316141534 learned_addr learned my addr 172.21.15.66:0/1316141534 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d2a77640 1 --2- 172.21.15.66:0/1316141534 >> v2:172.21.15.190:3300/0 conn(0x7f23cc06e620 0x7f23cc0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d1a75640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 0x7f23cc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870511534 0 0) 0x7f23cc0b0a90 con 0x7f23cc15f4e0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.921+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23b8003520 con 0x7f23cc15f4e0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3618828306 0 0) 0x7f23b8003520 con 0x7f23cc15f4e0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 msgr2=0x7f23cc06e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 0x7f23cc06e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 >> v2:172.21.15.190:3300/0 conn(0x7f23cc06e620 msgr2=0x7f23cc0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 --2- 172.21.15.66:0/1316141534 >> v2:172.21.15.190:3300/0 conn(0x7f23cc06e620 0x7f23cc0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc0b3540 con 0x7f23cc15f4e0 2024-05-10T11:22:49.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 524508528 0 0) 0x7f23c8001670 con 0x7f23cc15f4e0 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 >> v1:172.21.15.66:6789/0 conn(0x7f23cc15f4e0 legacy=0x7f23cc06d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 0x7f23b80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b8003f30 0x7f23b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8004d40 0x7f23b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc0b23f0 con 0x7f23b8003f30 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc0b4150 con 0x7f23b8004d40 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23b800ba10 con 0x7f23cc15f8c0 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1a75640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b8003f30 0x7f23b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d2276640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 0x7f23b80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d2a77640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8004d40 0x7f23b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1a75640 1 -- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 msgr2=0x7f23b80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1a75640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc15f8c0 0x7f23b80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1a75640 1 -- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8004d40 msgr2=0x7f23b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1a75640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8004d40 0x7f23b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.922+0000 7f23d1a75640 1 -- 172.21.15.66:0/1316141534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b8003520 con 0x7f23b8003f30 2024-05-10T11:22:49.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.923+0000 7f23d1a75640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b8003f30 0x7f23b8004800 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009ac0 tx=0x7f23b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250b7bdf15b594c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.923+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc036070 con 0x7f23b8003f30 2024-05-10T11:22:49.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.923+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc031400 con 0x7f23b8003f30 2024-05-10T11:22:49.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.923+0000 7f23d1274640 1 -- 172.21.15.66:0/1316141534 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc009690 con 0x7f23b8003f30 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d44da640 1 -- 172.21.15.66:0/1316141534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b8003f30 msgr2=0x7f23b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d44da640 1 --2- 172.21.15.66:0/1316141534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b8003f30 0x7f23b8004800 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009ac0 tx=0x7f23b8005830 comp rx=0 tx=0).stop 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d2a77640 1 -- 172.21.15.66:0/1316141534 reap_dead start 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d44da640 1 -- 172.21.15.66:0/1316141534 shutdown_connections 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d44da640 1 -- 172.21.15.66:0/1316141534 >> 172.21.15.66:0/1316141534 conn(0x7f23cc0d2df0 msgr2=0x7f23cc0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d44da640 1 -- 172.21.15.66:0/1316141534 shutdown_connections 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.924+0000 7f23d44da640 1 -- 172.21.15.66:0/1316141534 wait complete. 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.925+0000 7f23d44da640 1 Processor -- start 2024-05-10T11:22:49.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.925+0000 7f23d44da640 1 -- start start 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d44da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8003f30 0x7f23cc1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d44da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc162650 0x7f23cc160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d44da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 0x7f23cc161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d44da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc0b3de0 con 0x7f23cc1611f0 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d44da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc0b3b00 con 0x7f23b8003f30 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d44da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc0b45e0 con 0x7f23cc162650 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 0x7f23cc161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 0x7f23cc161670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51852/0 (socket says 172.21.15.66:51852) 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 -- 172.21.15.66:0/1209243812 learned_addr learned my addr 172.21.15.66:0/1209243812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2276640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8003f30 0x7f23cc1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d1a75640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc162650 0x7f23cc160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 -- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc162650 msgr2=0x7f23cc160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc162650 0x7f23cc160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 -- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8003f30 msgr2=0x7f23cc1571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8003f30 0x7f23cc1571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 -- 172.21.15.66:0/1209243812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc156140 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.926+0000 7f23d2a77640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 0x7f23cc161670 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f23c4011bf0 tx=0x7f23c400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.927+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c400fcb0 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.927+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c400fe50 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.927+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4015670 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.927+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23cc156420 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.927+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23cc1569e0 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.928+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23cc06a220 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.928+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f23c4015810 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.929+0000 7f23c2ffd640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23b0076300 0x7f23b00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.929+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f23c4098100 con 0x7f23cc1611f0 2024-05-10T11:22:49.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.929+0000 7f23d2276640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23b0076300 0x7f23b00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:22:49.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.930+0000 7f23d2276640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23b0076300 0x7f23b00787c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0c9490 tx=0x7f23c80078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:22:49.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:49.933+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f23c4019030 con 0x7f23cc1611f0 2024-05-10T11:22:50.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.126+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23cc155e30 con 0x7f23b0076300 2024-05-10T11:22:50.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.128+0000 7f23c2ffd640 1 -- 172.21.15.66:0/1209243812 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13441 (secure 0 0 0) 0x7f23cc155e30 con 0x7f23b0076300 2024-05-10T11:22:50.128 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:22:50.128 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:22:50.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23b0076300 msgr2=0x7f23b00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:50.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23b0076300 0x7f23b00787c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0c9490 tx=0x7f23c80078f0 comp rx=0 tx=0).stop 2024-05-10T11:22:50.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 msgr2=0x7f23cc161670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:22:50.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 0x7f23cc161670 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f23c4011bf0 tx=0x7f23c400f1b0 comp rx=0 tx=0).stop 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 shutdown_connections 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f23b0076300 0x7f23b00787c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23cc1611f0 0x7f23cc161670 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23cc162650 0x7f23cc160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 --2- 172.21.15.66:0/1209243812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b8003f30 0x7f23cc1571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 >> 172.21.15.66:0/1209243812 conn(0x7f23cc0d2df0 msgr2=0x7f23cc15dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 shutdown_connections 2024-05-10T11:22:50.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:22:50.130+0000 7f23d44da640 1 -- 172.21.15.66:0/1209243812 wait complete. 2024-05-10T11:22:50.141 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2024-05-10T11:22:49.843780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262580,"kb_used_data":13128,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712140,"statfs":{"total":773094113280,"available":772825231360,"internally_reserved":0,"allocated":13443072,"data_stored":6887904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.932692"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":302,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-05-10T11:22:43.101573+0000","last_change":"2024-05-10T11:12:19.577852+0000","last_active":"2024-05-10T11:22:43.101573+0000","last_peered":"2024-05-10T11:22:43.101573+0000","last_clean":"2024-05-10T11:22:43.101573+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:43.101573+0000","last_undegraded":"2024-05-10T11:22:43.101573+0000","last_fullsized":"2024-05-10T11:22:43.101573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T11:12:18.481266+0000","last_clean_scrub_stamp":"2024-05-10T11:12:18.481266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:10.601074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2125824,"data_stored":1303764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2125824,"data_stored":1303764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:22:50.144 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T11:12:18.481266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=11, tm_min=22, tm_sec=45, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T11:22:50.144 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T11:23:03.490 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:23:03.494 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:23:10.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T11:23:10.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.263+0000 7f37666cc640 1 Processor -- start 2024-05-10T11:23:10.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.264+0000 7f37666cc640 1 -- start start 2024-05-10T11:23:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.264+0000 7f37666cc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f37600c6c80 0x7f37600c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.264+0000 7f37666cc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376006f1c0 con 0x7f37601598c0 2024-05-10T11:23:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.264+0000 7f37666cc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376006f4a0 con 0x7f37600cee40 2024-05-10T11:23:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.264+0000 7f37666cc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f376006f780 con 0x7f37600c6c80 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375f7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f37600c6c80 0x7f37600c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f37601598c0 0x7f376006e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49588/0 (socket says 172.21.15.66:49588) 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375f7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f37600c6c80 0x7f37600c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49654/0 (socket says 172.21.15.66:49654) 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375ffff640 1 -- 172.21.15.66:0/2225331816 learned_addr learned my addr 172.21.15.66:0/2225331816 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375f7fe640 1 -- 172.21.15.66:0/2225331816 >> v1:172.21.15.190:6789/0 conn(0x7f37600cee40 legacy=0x7f37600cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375f7fe640 1 -- 172.21.15.66:0/2225331816 >> v1:172.21.15.66:6789/0 conn(0x7f37601598c0 legacy=0x7f376006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375f7fe640 1 -- 172.21.15.66:0/2225331816 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376006fa60 con 0x7f37600c6c80 2024-05-10T11:23:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.265+0000 7f375effd640 1 -- 172.21.15.66:0/2225331816 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033137662 0 0) 0x7f376006f1c0 con 0x7f37601598c0 2024-05-10T11:23:10.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.266+0000 7f375f7fe640 1 --2- 172.21.15.66:0/2225331816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37600c6c80 0x7f37600c7110 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f37540097a0 tx=0x7f375402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7aca630f12f166 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.266+0000 7f375effd640 1 -- 172.21.15.66:0/2225331816 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754037070 con 0x7f37600c6c80 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.266+0000 7f375effd640 1 -- 172.21.15.66:0/2225331816 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3754032440 con 0x7f37600c6c80 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.266+0000 7f375effd640 1 -- 172.21.15.66:0/2225331816 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754032810 con 0x7f37600c6c80 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.266+0000 7f37666cc640 1 -- 172.21.15.66:0/2225331816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37600c6c80 msgr2=0x7f37600c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.266+0000 7f37666cc640 1 --2- 172.21.15.66:0/2225331816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37600c6c80 0x7f37600c7110 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f37540097a0 tx=0x7f375402a230 comp rx=0 tx=0).stop 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.267+0000 7f37666cc640 1 -- 172.21.15.66:0/2225331816 shutdown_connections 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.267+0000 7f37666cc640 1 --2- 172.21.15.66:0/2225331816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37600c6c80 0x7f37600c7110 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.267+0000 7f37666cc640 1 -- 172.21.15.66:0/2225331816 >> 172.21.15.66:0/2225331816 conn(0x7f37600b2900 msgr2=0x7f37600b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.267+0000 7f37666cc640 1 -- 172.21.15.66:0/2225331816 shutdown_connections 2024-05-10T11:23:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.267+0000 7f37666cc640 1 -- 172.21.15.66:0/2225331816 wait complete. 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.268+0000 7f37666cc640 1 Processor -- start 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.268+0000 7f37666cc640 1 -- start start 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f37666cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600c6c80 0x7f3760155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f37666cc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600cee40 0x7f37600cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f37666cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 0x7f376015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f37666cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f376006ee10 con 0x7f37601598c0 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f37666cc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f376015c6e0 con 0x7f37600cee40 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f37666cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f37601562b0 con 0x7f37600c6c80 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f3764c69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 0x7f376015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f3764c69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 0x7f376015bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49656/0 (socket says 172.21.15.66:49656) 2024-05-10T11:23:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f3764c69640 1 -- 172.21.15.66:0/517680769 learned_addr learned my addr 172.21.15.66:0/517680769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f375f7fe640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600cee40 0x7f37600cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f375ffff640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600c6c80 0x7f3760155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.269+0000 7f3764c69640 1 -- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600c6c80 msgr2=0x7f3760155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f3764c69640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600c6c80 0x7f3760155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f3764c69640 1 -- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600cee40 msgr2=0x7f37600cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f3764c69640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600cee40 0x7f37600cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f3764c69640 1 -- 172.21.15.66:0/517680769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37600cdc50 con 0x7f37601598c0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f3764c69640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 0x7f376015bba0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f375800c7d0 tx=0x7f375800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758003b70 con 0x7f37601598c0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3758003d30 con 0x7f37601598c0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37600cdf30 con 0x7f37601598c0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375800aa90 con 0x7f37601598c0 2024-05-10T11:23:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.270+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376015b680 con 0x7f37601598c0 2024-05-10T11:23:10.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.271+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f376006a220 con 0x7f37601598c0 2024-05-10T11:23:10.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.272+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f375800ac30 con 0x7f37601598c0 2024-05-10T11:23:10.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.272+0000 7f375cff9640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f374c0762d0 0x7f374c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.272+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f37580972e0 con 0x7f37601598c0 2024-05-10T11:23:10.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.272+0000 7f375ffff640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f374c0762d0 0x7f374c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.273+0000 7f375ffff640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f374c0762d0 0x7f374c078790 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3750000f60 tx=0x7f3750007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.277+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f37580606b0 con 0x7f37601598c0 2024-05-10T11:23:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.466+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 --> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37600cda00 con 0x7f374c0762d0 2024-05-10T11:23:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.467+0000 7f375cff9640 1 -- 172.21.15.66:0/517680769 <== mgr.4100 v2:172.21.15.190:6832/311085521 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7f37600cda00 con 0x7f374c0762d0 2024-05-10T11:23:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:23:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-05-10T11:23:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f374c0762d0 msgr2=0x7f374c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f374c0762d0 0x7f374c078790 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3750000f60 tx=0x7f3750007e40 comp rx=0 tx=0).stop 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 msgr2=0x7f376015bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 0x7f376015bba0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f375800c7d0 tx=0x7f375800cc90 comp rx=0 tx=0).stop 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 shutdown_connections 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f374c0762d0 0x7f374c078790 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37601598c0 0x7f376015bba0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600cee40 0x7f37600cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 --2- 172.21.15.66:0/517680769 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600c6c80 0x7f3760155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 >> 172.21.15.66:0/517680769 conn(0x7f37600b2900 msgr2=0x7f376006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 shutdown_connections 2024-05-10T11:23:10.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.469+0000 7f37666cc640 1 -- 172.21.15.66:0/517680769 wait complete. 2024-05-10T11:23:10.480 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-05-10T11:23:09.847830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262564,"kb_used_data":13128,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712156,"statfs":{"total":773094113280,"available":772825247744,"internally_reserved":0,"allocated":13443072,"data_stored":6887904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002565"},"pg_stats":[{"pgid":"1.0","version":"123'74","reported_seq":313,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-05-10T11:22:50.162144+0000","last_change":"2024-05-10T11:22:50.162180+0000","last_active":"2024-05-10T11:22:50.162144+0000","last_peered":"2024-05-10T11:22:50.162144+0000","last_clean":"2024-05-10T11:22:50.162144+0000","last_became_active":"2024-05-10T11:12:19.577053+0000","last_became_peered":"2024-05-10T11:12:19.577053+0000","last_unstale":"2024-05-10T11:22:50.162144+0000","last_undegraded":"2024-05-10T11:22:50.162144+0000","last_fullsized":"2024-05-10T11:22:50.162144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'74","last_scrub_stamp":"2024-05-10T11:22:50.162062+0000","last_deep_scrub":"123'74","last_deep_scrub_stamp":"2024-05-10T11:22:50.162062+0000","last_clean_scrub_stamp":"2024-05-10T11:22:50.162062+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:22.753302+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509575,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33252,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2125824,"data_stored":1303764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542278,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33252,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2125824,"data_stored":1303764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1531904,"data_stored":713396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T11:23:10.481 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T11:23:10.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.584+0000 7f6d3b2fc640 1 Processor -- start 2024-05-10T11:23:10.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.584+0000 7f6d3b2fc640 1 -- start start 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d3b2fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6d340cf3e0 0x7f6d340cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d3b2fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cd500 0x7f6d340cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d3b2fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d340b2dd0 0x7f6d340b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d3b2fc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3406e720 con 0x7f6d340b2dd0 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d3b2fc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3406de80 con 0x7f6d340cf3e0 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d3b2fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3406e160 con 0x7f6d340cd500 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d340b2dd0 0x7f6d340b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d340b2dd0 0x7f6d340b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49670/0 (socket says 172.21.15.66:49670) 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 -- 172.21.15.66:0/3880506478 learned_addr learned my addr 172.21.15.66:0/3880506478 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:23:10.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39098640 1 --2- 172.21.15.66:0/3880506478 >> v2:172.21.15.190:3300/0 conn(0x7f6d340cf3e0 0x7f6d340cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d38897640 1 --2- 172.21.15.66:0/3880506478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cd500 0x7f6d340cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 -- 172.21.15.66:0/3880506478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cd500 msgr2=0x7f6d340cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:23:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 --2- 172.21.15.66:0/3880506478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cd500 0x7f6d340cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 -- 172.21.15.66:0/3880506478 >> v2:172.21.15.190:3300/0 conn(0x7f6d340cf3e0 msgr2=0x7f6d340cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:23:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 --2- 172.21.15.66:0/3880506478 >> v2:172.21.15.190:3300/0 conn(0x7f6d340cf3e0 0x7f6d340cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.585+0000 7f6d39899640 1 -- 172.21.15.66:0/3880506478 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3406e440 con 0x7f6d340b2dd0 2024-05-10T11:23:10.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.586+0000 7f6d39899640 1 --2- 172.21.15.66:0/3880506478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340b2dd0 0x7f6d340b3260 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f6d3406fed0 tx=0x7f6d2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e490c8e82b7ff2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.586+0000 7f6d33fff640 1 -- 172.21.15.66:0/3880506478 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24036070 con 0x7f6d340b2dd0 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.586+0000 7f6d33fff640 1 -- 172.21.15.66:0/3880506478 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d24031600 con 0x7f6d340b2dd0 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.586+0000 7f6d33fff640 1 -- 172.21.15.66:0/3880506478 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240319d0 con 0x7f6d340b2dd0 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/3880506478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340b2dd0 msgr2=0x7f6d340b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/3880506478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340b2dd0 0x7f6d340b3260 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f6d3406fed0 tx=0x7f6d2402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/3880506478 shutdown_connections 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/3880506478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340b2dd0 0x7f6d340b3260 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/3880506478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cd500 0x7f6d340cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/3880506478 >> v2:172.21.15.190:3300/0 conn(0x7f6d340cf3e0 0x7f6d340cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/3880506478 >> 172.21.15.66:0/3880506478 conn(0x7f6d340d2eb0 msgr2=0x7f6d340d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/3880506478 shutdown_connections 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.587+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/3880506478 wait complete. 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.588+0000 7f6d3b2fc640 1 Processor -- start 2024-05-10T11:23:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.588+0000 7f6d3b2fc640 1 -- start start 2024-05-10T11:23:10.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d3b2fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d340b2dd0 0x7f6d34159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d3b2fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 0x7f6d341f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d3b2fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cf3e0 0x7f6d341f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d3b2fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d340b37a0 con 0x7f6d340cd500 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d3b2fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6d340b4510 con 0x7f6d340b2dd0 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d3b2fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d340b3920 con 0x7f6d340cf3e0 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 0x7f6d341f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 0x7f6d341f8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49682/0 (socket says 172.21.15.66:49682) 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 -- 172.21.15.66:0/1168791685 learned_addr learned my addr 172.21.15.66:0/1168791685 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d39098640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d340b2dd0 0x7f6d34159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d39899640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cf3e0 0x7f6d341f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 -- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cf3e0 msgr2=0x7f6d341f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cf3e0 0x7f6d341f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 -- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d340b2dd0 msgr2=0x7f6d34159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.589+0000 7f6d38897640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d340b2dd0 0x7f6d34159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d38897640 1 -- 172.21.15.66:0/1168791685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d340cc940 con 0x7f6d340cd500 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d38897640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 0x7f6d341f8530 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800e860 tx=0x7f6d2800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28017070 con 0x7f6d340cd500 2024-05-10T11:23:10.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2800c940 con 0x7f6d340cd500 2024-05-10T11:23:10.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800cd10 con 0x7f6d340cd500 2024-05-10T11:23:10.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3415a2d0 con 0x7f6d340cd500 2024-05-10T11:23:10.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.590+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d340cbe60 con 0x7f6d340cd500 2024-05-10T11:23:10.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.591+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3406a220 con 0x7f6d340cd500 2024-05-10T11:23:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.592+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d2801a070 con 0x7f6d340cd500 2024-05-10T11:23:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.593+0000 7f6d31ffb640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d200762d0 0x7f6d20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.593+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f6d28097530 con 0x7f6d340cd500 2024-05-10T11:23:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.593+0000 7f6d39098640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d200762d0 0x7f6d20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.594+0000 7f6d39098640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d200762d0 0x7f6d20078790 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009aa0 tx=0x7f6d2c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.597+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6d28060900 con 0x7f6d340cd500 2024-05-10T11:23:10.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.786+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6d340706d0 con 0x7f6d340cd500 2024-05-10T11:23:10.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.789+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f6d28064c00 con 0x7f6d340cd500 2024-05-10T11:23:10.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.790+0000 7f6d31ffb640 1 -- 172.21.15.66:0/1168791685 <== mon.0 v2:172.21.15.66:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6d28060410 con 0x7f6d340cd500 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d200762d0 msgr2=0x7f6d20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d200762d0 0x7f6d20078790 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009aa0 tx=0x7f6d2c009190 comp rx=0 tx=0).stop 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 msgr2=0x7f6d341f8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 0x7f6d341f8530 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800e860 tx=0x7f6d2800ed20 comp rx=0 tx=0).stop 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 shutdown_connections 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f6d200762d0 0x7f6d20078790 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d340cf3e0 0x7f6d341f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d340cd500 0x7f6d341f8530 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 --2- 172.21.15.66:0/1168791685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d340b2dd0 0x7f6d34159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 >> 172.21.15.66:0/1168791685 conn(0x7f6d340d2eb0 msgr2=0x7f6d340711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:23:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.791+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 shutdown_connections 2024-05-10T11:23:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.792+0000 7f6d3b2fc640 1 -- 172.21.15.66:0/1168791685 wait complete. 2024-05-10T11:23:10.802 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:23:10.803 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T11:23:10.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.906+0000 7f494241d640 1 Processor -- start 2024-05-10T11:23:10.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.906+0000 7f494241d640 1 -- start start 2024-05-10T11:23:10.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f494241d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f493c0d3d80 0x7f493c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f494241d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f493c0d59d0 0x7f493c0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f494241d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493c0d2d20 con 0x7f493c162940 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f494241d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 -- 0x7f493c162d20 con 0x7f493c0d59d0 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f494241d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f493c0d3000 con 0x7f493c0d3d80 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f493c0d59d0 0x7f493c0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f493c0d59d0 0x7f493c0d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49698/0 (socket says 172.21.15.66:49698) 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f493bfff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f493c162940 0x7f493c0d3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:49592/0 (socket says 172.21.15.66:49592) 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 -- 172.21.15.66:0/2637952548 learned_addr learned my addr 172.21.15.66:0/2637952548 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:23:10.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f493b7fe640 1 --2- 172.21.15.66:0/2637952548 >> v2:172.21.15.190:3300/0 conn(0x7f493c0d3d80 0x7f493c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 -- 172.21.15.66:0/2637952548 >> v2:172.21.15.190:3300/0 conn(0x7f493c0d3d80 msgr2=0x7f493c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 --2- 172.21.15.66:0/2637952548 >> v2:172.21.15.190:3300/0 conn(0x7f493c0d3d80 0x7f493c0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 -- 172.21.15.66:0/2637952548 >> v1:172.21.15.66:6789/0 conn(0x7f493c162940 legacy=0x7f493c0d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f493affd640 1 -- 172.21.15.66:0/2637952548 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469332500 0 0) 0x7f493c0d2d20 con 0x7f493c162940 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f49409ba640 1 -- 172.21.15.66:0/2637952548 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c0d32e0 con 0x7f493c0d59d0 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.907+0000 7f493b7fe640 1 --2- 172.21.15.66:0/2637952548 >> v2:172.21.15.190:3300/0 conn(0x7f493c0d3d80 0x7f493c0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.908+0000 7f49409ba640 1 --2- 172.21.15.66:0/2637952548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d59d0 0x7f493c0d01e0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f493c09eab0 tx=0x7f493402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455901c897a83d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.908+0000 7f493affd640 1 -- 172.21.15.66:0/2637952548 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934036070 con 0x7f493c0d59d0 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.908+0000 7f493affd640 1 -- 172.21.15.66:0/2637952548 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4934031600 con 0x7f493c0d59d0 2024-05-10T11:23:10.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.908+0000 7f493affd640 1 -- 172.21.15.66:0/2637952548 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49340319f0 con 0x7f493c0d59d0 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 -- 172.21.15.66:0/2637952548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d59d0 msgr2=0x7f493c0d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 --2- 172.21.15.66:0/2637952548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d59d0 0x7f493c0d01e0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f493c09eab0 tx=0x7f493402a6a0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 -- 172.21.15.66:0/2637952548 shutdown_connections 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 --2- 172.21.15.66:0/2637952548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d59d0 0x7f493c0d01e0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 --2- 172.21.15.66:0/2637952548 >> v2:172.21.15.190:3300/0 conn(0x7f493c0d3d80 0x7f493c0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 -- 172.21.15.66:0/2637952548 >> 172.21.15.66:0/2637952548 conn(0x7f493c09e380 msgr2=0x7f493c0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 -- 172.21.15.66:0/2637952548 shutdown_connections 2024-05-10T11:23:10.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.909+0000 7f494241d640 1 -- 172.21.15.66:0/2637952548 wait complete. 2024-05-10T11:23:10.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.910+0000 7f494241d640 1 Processor -- start 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.910+0000 7f494241d640 1 -- start start 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f494241d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 0x7f493c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f494241d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f493c0d59d0 0x7f493c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f494241d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f493c162940 0x7f493c14b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f494241d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0d2390 con 0x7f493c0d3d80 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f494241d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0cfc50 con 0x7f493c0d59d0 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f494241d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f493c0d2510 con 0x7f493c162940 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 0x7f493c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 0x7f493c15f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49706/0 (socket says 172.21.15.66:49706) 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 -- 172.21.15.66:0/1358646383 learned_addr learned my addr 172.21.15.66:0/1358646383 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-10T11:23:10.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493b7fe640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f493c0d59d0 0x7f493c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f49409ba640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f493c162940 0x7f493c14b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 -- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f493c162940 msgr2=0x7f493c14b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f493c162940 0x7f493c14b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 -- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f493c0d59d0 msgr2=0x7f493c14b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f493c0d59d0 0x7f493c14b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 -- 172.21.15.66:0/1358646383 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c14a610 con 0x7f493c0d3d80 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f49409ba640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f493c162940 0x7f493c14b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493b7fe640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f493c0d59d0 0x7f493c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.911+0000 7f493bfff640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 0x7f493c15f030 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f492c00c430 tx=0x7f492c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.912+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0074e0 con 0x7f493c0d3d80 2024-05-10T11:23:10.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.912+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f492c0047e0 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.912+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c14a8f0 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.912+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c004bf0 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.912+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c14aeb0 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.913+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c06a220 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.913+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f492c011070 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.914+0000 7f4938ff9640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49280762d0 0x7f4928078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.914+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5507+0+0 (secure 0 0 0) 0x7f492c0972a0 con 0x7f493c0d3d80 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.914+0000 7f493b7fe640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49280762d0 0x7f4928078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:23:10.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.915+0000 7f493b7fe640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49280762d0 0x7f4928078790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f493c1f8880 tx=0x7f4930008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:23:10.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:10.918+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f492c060c30 con 0x7f493c0d3d80 2024-05-10T11:23:11.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.150+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f493c0d2730 con 0x7f493c0d3d80 2024-05-10T11:23:11.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.150+0000 7f4938ff9640 1 -- 172.21.15.66:0/1358646383 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+3878 (secure 0 0 0) 0x7f492c060530 con 0x7f493c0d3d80 2024-05-10T11:23:11.151 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-10T11:23:11.151 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":114,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6500,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1303010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1303010036},{"type":"v1","addr":"172.21.15.190:6837","nonce":1303010036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":6704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/2493465336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2493465336},{"type":"v1","addr":"172.21.15.190:6836","nonce":2493465336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4186596581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4186596581},{"type":"v1","addr":"172.21.15.66:6834","nonce":4186596581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2408740616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2408740616},{"type":"v1","addr":"172.21.15.66:6835","nonce":2408740616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[]} 2024-05-10T11:23:11.151 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 114 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49280762d0 msgr2=0x7f4928078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49280762d0 0x7f4928078790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f493c1f8880 tx=0x7f4930008040 comp rx=0 tx=0).stop 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 msgr2=0x7f493c15f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 0x7f493c15f030 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f492c00c430 tx=0x7f492c00c8f0 comp rx=0 tx=0).stop 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 shutdown_connections 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:6832/311085521,v1:172.21.15.190:6833/311085521] conn(0x7f49280762d0 0x7f4928078790 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f493c162940 0x7f493c14b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f493c0d59d0 0x7f493c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 --2- 172.21.15.66:0/1358646383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c0d3d80 0x7f493c15f030 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 >> 172.21.15.66:0/1358646383 conn(0x7f493c09e380 msgr2=0x7f493c162eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 shutdown_connections 2024-05-10T11:23:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-10T11:23:11.152+0000 7f494241d640 1 -- 172.21.15.66:0/1358646383 wait complete. 2024-05-10T11:23:11.164 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-10T11:23:11.164 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T11:23:11.164 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T11:23:11.164 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.173 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T11:23:11.173 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T11:23:11.173 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.222 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T11:23:11.222 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T11:23:11.222 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.234 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T11:23:11.234 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T11:23:11.234 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.286 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T11:23:11.286 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T11:23:11.287 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T11:23:11.287 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.318 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T11:23:11.318 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T11:23:11.318 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.389 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T11:23:11.389 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T11:23:11.389 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.461 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T11:23:11.461 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T11:23:11.461 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-10T11:23:11.533 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T11:23:11.533 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T11:23:11.533 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.573 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T11:23:11.573 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T11:23:11.573 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.640 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T11:23:11.641 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T11:23:11.641 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.711 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T11:23:11.712 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T11:23:11.712 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.791 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T11:23:11.791 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T11:23:11.791 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T11:23:11.791 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.817 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T11:23:11.818 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T11:23:11.818 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.860 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T11:23:11.860 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T11:23:11.860 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T11:23:11.860 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.872 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T11:23:11.873 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T11:23:11.873 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.912 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T11:23:11.912 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T11:23:11.912 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T11:23:11.964 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T11:23:11.964 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T11:23:11.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-05-10T11:23:12.007 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:16:54.538792+0000 mds.a (mds.0) 1 : cluster [WRN] Corrupt dentry 'file_to_be_damaged' in dir frag 0x10000000000: Invalid tag char 'd' pos 0: Malformed input [buffer:3](/subdir) 2024-05-10T11:23:12.007 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-05-10T11:23:12.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-05-10T11:23:12.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-05-10T11:23:12.156 INFO:teuthology.orchestra.run.smithi066.stdout:2024-05-10T11:18:34.411752+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-05-10T11:23:12.157 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:23:12.157 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T11:23:12.379 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:23:12.380 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T11:23:12.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:23:12.462 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T11:23:12.529 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:23:12.529 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T11:23:12.577 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:23:12.577 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T11:23:12.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:23:12.747 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T11:23:12.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:23:12.826 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T11:23:12.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:23:12.869 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T11:23:12.968 INFO:tasks.ceph:Archiving mon data... 2024-05-10T11:23:12.970 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/data/mon.a.tgz 2024-05-10T11:23:12.970 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-05-10T11:23:12.987 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.XuIZRJrCbo 2024-05-10T11:23:12.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XuIZRJrCbo 2024-05-10T11:23:13.168 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.XuIZRJrCbo 2024-05-10T11:23:13.253 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.XuIZRJrCbo is 394KB 2024-05-10T11:23:13.363 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.XuIZRJrCbo 2024-05-10T11:23:13.380 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/data/mon.b.tgz 2024-05-10T11:23:13.381 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-05-10T11:23:13.399 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.egG4OWfFeR 2024-05-10T11:23:13.400 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.egG4OWfFeR 2024-05-10T11:23:13.554 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.egG4OWfFeR 2024-05-10T11:23:13.642 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.egG4OWfFeR is 395KB 2024-05-10T11:23:13.730 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.egG4OWfFeR 2024-05-10T11:23:13.745 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/data/mon.c.tgz 2024-05-10T11:23:13.746 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-05-10T11:23:13.803 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.3s0IoeYLRT 2024-05-10T11:23:13.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3s0IoeYLRT 2024-05-10T11:23:13.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.3s0IoeYLRT 2024-05-10T11:23:14.029 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.3s0IoeYLRT is 395KB 2024-05-10T11:23:14.102 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.3s0IoeYLRT 2024-05-10T11:23:14.117 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T11:23:14.117 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T11:23:14.119 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T11:23:14.202 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T11:23:14.236 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T11:23:14.236 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T11:23:14.238 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/remote/smithi066/crash 2024-05-10T11:23:14.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T11:23:14.270 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/remote/smithi190/crash 2024-05-10T11:23:14.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T11:23:14.300 INFO:tasks.ceph:Shutting down logrotate 2024-05-10T11:23:14.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:23:14.315 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T11:23:14.392 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T11:23:14.418 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T11:23:14.443 INFO:tasks.ceph:Compressing logs... 2024-05-10T11:23:14.443 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T11:23:14.462 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T11:23:14.484 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62470.log 2024-05-10T11:23:14.528 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35422.log 2024-05-10T11:23:14.528 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T11:23:14.528 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35713.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35422.log.gz 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35713.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35713.log.gz 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5/var/log/ceph/ceph-osd.7.log: --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41886.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.3.41886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35633.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41886.log.gz 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41490.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41485.log 2024-05-10T11:23:14.529 INFO:teuthology.orchestra.run.smithi190.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35633.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.1.41490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41490.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5/var/log/ceph/ceph-client.1.41485.log: --verbose -- /var/log/ceph/ceph-mon.c.log 0.0% -- replaced with /var/log/ceph/ceph-client.1.41485.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35502.log 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35593.log 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35502.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35502.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35593.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35593.log.gz 2024-05-10T11:23:14.530 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41890.log 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35673.log 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.3.41890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41890.log.gz 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35673.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35673.log.gz 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-10T11:23:14.531 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.35546.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-05-10T11:23:14.541 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-10T11:23:14.633 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-10T11:23:14.657 INFO:teuthology.orchestra.run.smithi190.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73789.log 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73115.log 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73789.log: 91.2% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62470.log.gz 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73789.log.gz 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.73115.log: -- /var/log/ceph/ceph-client.admin.60473.log 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61645.log 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73115.log.gz 2024-05-10T11:23:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65523.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60473.log.gz 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61817.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65523.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61645.log.gz 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62005.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65523.log.gz 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65691.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.62005.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61817.log.gz 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63841.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62005.log.gz 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65691.log: /var/log/ceph/ceph-client.admin.63841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61304.log 2024-05-10T11:23:14.679 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65691.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46448.log 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63841.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46448.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61304.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57294.log 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46448.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58612.log 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59125.log 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73512.log 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57294.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59125.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.58612.log.gz 2024-05-10T11:23:14.680 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35344.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59125.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71002.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35344.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73512.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46946.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71002.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35344.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45642.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71002.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69447.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45642.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46946.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59624.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45642.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49918.log 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69447.log.gz 2024-05-10T11:23:14.681 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56568.log 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49918.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59624.log.gz 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54119.log 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49918.log.gz 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49535.log 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69363.log 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56568.log.gz 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47677.log 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54119.log.gz 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49535.log.gz 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53516.log 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47677.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69363.log.gz 2024-05-10T11:23:14.682 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54293.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53516.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29316.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53516.log.gz 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54293.log.gz 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph.tmp-client.admin.29316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70304.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29316.log.gz 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70304.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz -5 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47379.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70304.log.gz 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52331.log 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2024-05-10T11:23:14.683 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72378.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52331.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55226.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52331.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.72378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67124.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71086.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72378.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55226.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53012.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41454.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67124.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53012.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.71086.log.gz 2024-05-10T11:23:14.684 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71590.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53012.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74503.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61603.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62428.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71590.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74503.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43026.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74503.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62428.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61603.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50733.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62428.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48145.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43026.log.gz 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2024-05-10T11:23:14.685 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50733.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.48145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55976.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48145.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45744.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55976.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73199.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45744.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54754.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73199.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73747.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73199.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46658.log 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54754.log.gz 2024-05-10T11:23:14.686 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55478.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46658.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73747.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55478.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46658.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55478.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74617.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52121.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51808.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74617.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62362.log 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51808.log.gz 2024-05-10T11:23:14.687 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46237.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64372.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56316.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62362.log.gz 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46237.log.gz 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67962.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71152.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64372.log.gz 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56316.log.gz 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49451.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67962.log.gz 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64414.log/var/log/ceph/ceph-client.admin.71152.log: 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52844.log 2024-05-10T11:23:14.688 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71152.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49451.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5/var/log/ceph/ceph-client.admin.64414.log: --verbose -- /var/log/ceph/ceph-client.admin.74377.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64414.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74377.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52844.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70496.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51224.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74377.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45600.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.70496.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70496.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68843.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45600.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53704.log 2024-05-10T11:23:14.689 INFO:teuthology.orchestra.run.smithi066.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45600.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41140.log 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68843.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.53704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57424.log 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53704.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52629.log 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41140.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56232.log 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72078.log 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.57424.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56232.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52629.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50289.log 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56232.log.gz 86.6% 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T11:23:14.690 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66846.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.72078.log: /var/log/ceph/ceph-client.admin.50289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.66846.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50289.log.gz 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55673.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66846.log.gz 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47425.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.72078.log.gz 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53240.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-osd.2.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55673.log.gz 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73428.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71801.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73428.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53240.log.gz -- 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr: /var/log/ceph/ceph-client.admin.67399.log 2024-05-10T11:23:14.691 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73428.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41708.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58354.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71801.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41708.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67399.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57004.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41708.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57004.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62320.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58354.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59167.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63298.log 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gz 2024-05-10T11:23:14.692 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52247.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.63298.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59167.log.gz 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63252.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63298.log.gz 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68538.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5%/var/log/ceph/ceph-client.admin.63252.log: -- replaced with /var/log/ceph/ceph-client.admin.52247.log.gz 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68538.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63252.log.gz 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49834.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68538.log.gz 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57382.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49834.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz --verbose 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr: -- /var/log/ceph/ceph-client.admin.57336.log 2024-05-10T11:23:14.693 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57382.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49834.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56826.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57382.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73999.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57336.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.56826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55819.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56826.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60683.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55819.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73999.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70161.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55819.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68580.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70161.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60683.log.gz 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51976.log 2024-05-10T11:23:14.694 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70161.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66253.log 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68580.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55184.log 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51976.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.66253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66253.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60725.log 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55184.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65333.log 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60725.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71994.log 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65333.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60725.log.gz 2024-05-10T11:23:14.695 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65333.log.gz 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51892.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57843.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68664.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.71994.log.gz 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51892.log.gz 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53282.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57843.log.gz 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68664.log: gzip/var/log/ceph/ceph-client.admin.53282.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68664.log.gz 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44370.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53282.log.gz 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66315.log 2024-05-10T11:23:14.696 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65775.log 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41540.log: /var/log/ceph/ceph-client.admin.66315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56358.log 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65775.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66315.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55142.log 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56358.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55142.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65775.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69489.log 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55142.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2024-05-10T11:23:14.697 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71690.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69489.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65194.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65194.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71690.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65194.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59540.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50415.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43584.log 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59540.log.gz 2024-05-10T11:23:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45337.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68412.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.2.45337.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43584.log.gz 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45337.log.gz 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72195.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46322.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.72195.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68412.log.gz 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58288.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72195.log.gz 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46532.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46322.log.gz 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65028.log 2024-05-10T11:23:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45341.log 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65028.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46532.log.gz 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58288.log.gz 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65421.log 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65028.log.gz 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.2.45341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74167.log 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45341.log.gz 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74167.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65421.log.gz 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65841.log 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74167.log.gz 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49054.log 2024-05-10T11:23:14.700 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54848.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49054.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65841.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60132.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49054.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65152.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54848.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43245.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65152.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60132.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54335.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65152.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43245.log.gz 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70960.log 2024-05-10T11:23:14.701 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70960.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54335.log.gz 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67551.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51850.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70960.log.gz 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43916.log: /var/log/ceph/ceph-client.admin.67551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67551.log.gz 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58504.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51850.log.gz 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49962.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48141.log 2024-05-10T11:23:14.702 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58504.log.gz 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59032.log 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.48141.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49962.log.gz 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73386.log 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48141.log.gz 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69657.log 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59032.log.gz 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67274.log 2024-05-10T11:23:14.703 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73386.log.gz 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42648.log 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43244.log 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67274.log.gz 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42648.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.69657.log.gz 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63676.log 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42648.log.gz 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43244.log: /var/log/ceph/ceph-client.admin.50373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59967.log 2024-05-10T11:23:14.705 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43244.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.63676.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66033.log 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59967.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.66033.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59967.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63676.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66033.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50331.log 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72290.log 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55394.log 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50331.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.72290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46819.log 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72290.log.gz 2024-05-10T11:23:14.706 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72336.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55394.log: /var/log/ceph/ceph-client.admin.46819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58438.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55394.log.gz 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.72336.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46819.log.gz 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57081.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72336.log.gz 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57081.log: /var/log/ceph/ceph-client.admin.62970.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47200.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.57081.log.gz --verbose 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr: -- /var/log/ceph/ceph-client.0.72650.log 91.2% 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58438.log.gz 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42690.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62970.log: /var/log/ceph/ceph-client.0.72650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49493.log 2024-05-10T11:23:14.707 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72650.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62970.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41264.log 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42690.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71727.log 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49493.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54035.log 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41264.log: /var/log/ceph/ceph-client.admin.71727.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41264.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73241.log 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71727.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71923.log 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54035.log: /var/log/ceph/ceph-client.admin.73241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69279.log 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73241.log.gz 2024-05-10T11:23:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59293.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54035.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71923.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69279.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59293.log: /var/log/ceph/ceph-client.admin.47114.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59293.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69915.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55925.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44286.log: /var/log/ceph/ceph-client.0.69915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64685.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69915.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46861.log 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64685.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55925.log.gz 2024-05-10T11:23:14.709 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50925.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64685.log.gz 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67297.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46861.log: /var/log/ceph/ceph-client.0.50925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55573.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50925.log.gz 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46861.log.gz 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55100.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66582.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.67297.log.gz 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55573.log.gz 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70492.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55100.log.gz 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67036.log 2024-05-10T11:23:14.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.66582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66582.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.70492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64288.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70492.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57678.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64288.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64288.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.67036.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.57678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41350.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57678.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64330.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.41350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58180.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41350.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64727.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62908.log 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64330.log.gz 2024-05-10T11:23:14.711 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58180.log: /var/log/ceph/ceph-client.admin.64727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57143.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64727.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54593.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58180.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69723.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62908.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54593.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57143.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65375.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41792.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54593.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69723.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58072.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50006.log 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65375.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58072.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2024-05-10T11:23:14.712 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69151.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74419.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58072.log.gz 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50006.log.gz 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74209.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69151.log.gz 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59209.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74419.log.gz 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65733.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61109.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74209.log.gz 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2024-05-10T11:23:14.713 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65733.log: /var/log/ceph/ceph-client.0.61109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49752.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61109.log.gz 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65733.log.gz 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52205.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49752.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58842.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49752.log.gz 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60809.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58246.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.58842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58842.log.gz 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60809.log.gz 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58246.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-10T11:23:14.714 INFO:teuthology.orchestra.run.smithi066.stderr:gzip/var/log/ceph/ceph-client.admin.43578.log: -5 87.7% --verbose -- /var/log/ceph/ceph-client.admin.55268.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58246.log.gz 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mgr.y.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67723.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44412.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55268.log.gz 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67985.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57986.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67723.log.gz 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67985.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67985.log.gz 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67639.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73705.log 2024-05-10T11:23:14.715 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68370.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57986.log.gz 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73705.log: 90.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49283.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67639.log.gz 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68370.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73705.log.gz 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68370.log.gz 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63210.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49283.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7%/var/log/ceph/ceph-client.admin.63210.log: -- replaced with /var/log/ceph/ceph-client.admin.49283.log.gz 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67811.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63210.log.gz 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64015.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73157.log 2024-05-10T11:23:14.716 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67811.log: /var/log/ceph/ceph-client.admin.64015.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64015.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.67811.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60048.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55352.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73157.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60048.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60048.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59251.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65238.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56106.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55352.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59251.log.gz 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53156.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2024-05-10T11:23:14.717 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53156.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65238.log.gz 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56106.log.gz 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr:gzip 88.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.57166.log 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53156.log.gz 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57920.log 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73470.log 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57166.log: /var/log/ceph/ceph-client.admin.57920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64948.log 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.57166.log.gz 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50457.log 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57920.log.gz 2024-05-10T11:23:14.718 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73470.log.gz 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61709.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2%/var/log/ceph/ceph-client.admin.50457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46364.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64948.log.gz/var/log/ceph/ceph-client.admin.61709.log: 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50457.log.gz 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69573.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61709.log.gz 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65282.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46364.log.gz -5 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55310.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69573.log: gzip/var/log/ceph/ceph-client.admin.65282.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65282.log.gz 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69573.log.gz 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52713.log 2024-05-10T11:23:14.719 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55310.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49876.log 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52713.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52713.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr: /var/log/ceph/ceph-client.0.44895.log 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49876.log: gzip -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49876.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr: -- /var/log/ceph/ceph-client.admin.58654.log 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.44895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44895.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68328.log 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42513.log 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58654.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68328.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68328.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr: /var/log/ceph/ceph-client.admin.43240.log 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42513.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42513.log.gz 2024-05-10T11:23:14.720 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60515.log 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68748.log 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52802.log 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60515.log.gz 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52468.log 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68748.log.gz 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52802.log: gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52802.log.gz 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr: /var/log/ceph/ceph-client.admin.66394.log 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51934.log 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52468.log.gz 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.66394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43576.log 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66394.log.gz 2024-05-10T11:23:14.721 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68159.log 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51934.log.gz 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63053.log 88.3% 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43576.log.gz 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60851.log 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68159.log.gz/var/log/ceph/ceph-client.admin.63053.log: 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55058.log 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73343.log 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55058.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.60851.log.gz 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr: 92.4% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63053.log.gz 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55058.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63743.log 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71340.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73343.log.gz 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.63743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56018.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.71340.log: 0.0% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63743.log.gz 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.71340.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67724.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:gzip/var/log/ceph/ceph-client.admin.56018.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60557.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56018.log.gz 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52886.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.67724.log.gz 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60557.log: /var/log/ceph/ceph-client.admin.52886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58922.log 2024-05-10T11:23:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47845.log: 88.6% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52886.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60557.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54890.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62254.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58922.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54890.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53708.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62254.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50099.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.53708.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.0.53708.log.gz 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73957.log 2024-05-10T11:23:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41624.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73957.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73957.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64456.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41624.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52970.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41624.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69615.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64456.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41306.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52970.log: /var/log/ceph/ceph-client.admin.69615.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52970.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63406.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69615.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65565.log 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41306.log: /var/log/ceph/ceph-client.admin.63406.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41306.log.gz 2024-05-10T11:23:14.725 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63406.log.gz 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68496.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48819.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65565.log: /var/log/ceph/ceph-client.admin.68496.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65565.log.gz 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68496.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62690.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54401.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48819.log: /var/log/ceph/ceph-client.admin.62690.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62690.log.gz 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48819.log.gz 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48566.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48566.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54401.log.gz 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48566.log.gz 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49672.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73831.log 2024-05-10T11:23:14.726 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47467.log: /var/log/ceph/ceph-client.admin.49672.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49672.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61751.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73831.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73831.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46108.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63949.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61751.log: /var/log/ceph/ceph-client.admin.46108.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46108.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61751.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55735.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57240.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.63949.log: /var/log/ceph/ceph-client.admin.55735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55735.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63949.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67455.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66176.log 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57240.log: /var/log/ceph/ceph-client.admin.67455.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57240.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67455.log.gz 2024-05-10T11:23:14.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67208.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.66176.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66176.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72444.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50583.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67208.log: /var/log/ceph/ceph-client.admin.72444.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72444.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.67208.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62009.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46195.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50583.log: /var/log/ceph/ceph-client.0.62009.log: 0.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50583.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.62009.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63907.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46195.log: /var/log/ceph/ceph-client.admin.63907.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46195.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63907.log.gz 2024-05-10T11:23:14.728 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60221.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41044.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56060.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60221.log: /var/log/ceph/ceph-client.admin.56060.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60221.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56060.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60347.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53324.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47761.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42774.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60347.log: /var/log/ceph/ceph-client.admin.47761.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60347.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57682.log 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47761.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42774.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42774.log.gz 2024-05-10T11:23:14.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.57682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57682.log.gz 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70918.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44244.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53408.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65110.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70918.log: /var/log/ceph/ceph-client.admin.53408.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70918.log.gz 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69321.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65110.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65110.log.gz 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51724.log 2024-05-10T11:23:14.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69321.log: /var/log/ceph/ceph-client.admin.51724.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69321.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51724.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62104.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41496.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61446.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62104.log: /var/log/ceph/ceph-client.admin.61446.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61446.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62104.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46490.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52163.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42324.log: /var/log/ceph/ceph-client.admin.46490.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46490.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66923.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52163.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52163.log.gz 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42984.log 2024-05-10T11:23:14.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64110.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.66923.log: /var/log/ceph/ceph-client.admin.42984.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66923.log.gz 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53366.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64110.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64110.log.gz 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43580.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58546.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53366.log: /var/log/ceph/ceph-client.admin.43580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53366.log.gz 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43580.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43068.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.58546.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58546.log.gz 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49096.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41394.log 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43068.log: /var/log/ceph/ceph-client.admin.49096.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43068.log.gz 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49096.log.gz 2024-05-10T11:23:14.732 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67509.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41394.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41394.log.gz 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62830.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63594.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67509.log: /var/log/ceph/ceph-client.admin.62830.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67509.log.gz 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62830.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.71344.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.63594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63594.log.gz 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56190.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44328.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.71344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71344.log.gz 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60263.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56190.log.gz 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44328.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49012.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68202.log 2024-05-10T11:23:14.733 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60263.log: /var/log/ceph/ceph-client.admin.49012.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60263.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49012.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54932.log 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68202.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68202.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63156.log 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54932.log: /var/log/ceph/ceph-client.admin.40963.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54932.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42858.log 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.63156.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63156.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74083.log 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42858.log: /var/log/ceph/ceph-client.admin.64811.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42858.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-05-10T11:23:14.734 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48745.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74083.log: /var/log/ceph/ceph-client.admin.43917.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74083.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55436.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48745.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48745.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53969.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55436.log: /var/log/ceph/ceph-client.admin.43250.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55436.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gzgzip 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67357.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53969.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53969.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51462.log 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67357.log: /var/log/ceph/ceph-client.admin.47295.log: 90.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67357.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2024-05-10T11:23:14.735 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52373.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54551.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51462.log: /var/log/ceph/ceph-client.admin.52373.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51462.log.gz 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52373.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46280.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54551.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54551.log.gz 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60389.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71857.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46280.log: /var/log/ceph/ceph-client.admin.60389.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46280.log.gz 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74461.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60389.log.gz 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71857.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71857.log.gz 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41222.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54659.log 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74461.log: /var/log/ceph/ceph-client.admin.41222.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74461.log.gz 2024-05-10T11:23:14.736 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41222.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64246.log 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54659.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58138.log 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51396.log 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64246.log: /var/log/ceph/ceph-client.admin.58138.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64246.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58138.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60641.log 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51396.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51396.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67597.log 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64516.log 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60641.log: /var/log/ceph/ceph-client.admin.67597.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60641.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67597.log.gz 2024-05-10T11:23:14.737 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64516.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64516.log.gz 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72654.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51097.log: /var/log/ceph/ceph-client.0.72654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72654.log.gz 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72938.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71044.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43242.log: /var/log/ceph/ceph-client.admin.72938.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72938.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71044.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71044.log.gz 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45516.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54485.log 2024-05-10T11:23:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45828.log: /var/log/ceph/ceph-client.admin.45516.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2024-05-10T11:23:14.739 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45516.log.gzgzip 2024-05-10T11:23:14.739 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.74545.log 2024-05-10T11:23:14.739 INFO:teuthology.orchestra.run.smithi190.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-10T11:23:14.785 INFO:teuthology.orchestra.run.smithi190.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-10T11:23:14.834 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54485.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54485.log.gz 2024-05-10T11:23:14.834 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51766.log 2024-05-10T11:23:14.834 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74545.log: /var/log/ceph/ceph-client.admin.51766.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74545.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51766.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64853.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50141.log: /var/log/ceph/ceph-client.admin.50187.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72248.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68706.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64853.log: /var/log/ceph/ceph-client.admin.72248.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64853.log.gz 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58846.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72248.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68706.log.gz 2024-05-10T11:23:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56148.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.58846.log: /var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47551.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58846.log.gz 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56148.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56484.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56148.log.gz 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41666.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47551.log: /var/log/ceph/ceph-client.admin.56484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47551.log.gz 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56484.log.gz 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52289.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6%/var/log/ceph/ceph-client.admin.43782.log: -- replaced with /var/log/ceph/ceph-client.admin.41666.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-05-10T11:23:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68622.log 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52289.log: /var/log/ceph/ceph-client.admin.45474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51150.log 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68622.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52289.log.gz 88.4% 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68622.log.gz 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35620.log 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54185.log 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51150.log: /var/log/ceph/ceph-client.admin.35620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52036.log 2024-05-10T11:23:14.837 INFO:teuthology.orchestra.run.smithi066.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51150.log.gz 87.0% 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35620.log.gz/var/log/ceph/ceph-client.admin.54185.log: 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69046.log 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54185.log.gz 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69046.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52758.log 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52036.log.gz 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69046.log.gz 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60599.log 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41900.log: /var/log/ceph/ceph-client.admin.52758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51505.log 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60599.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52758.log.gz 2024-05-10T11:23:14.838 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60177.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60599.log.gz 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62732.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51505.log: /var/log/ceph/ceph-client.admin.60177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61550.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: 89.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51505.log.gz 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60177.log.gz 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74293.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69088.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: 90.8%/var/log/ceph/ceph-client.admin.74293.log: -- replaced with /var/log/ceph/ceph-client.admin.62732.log.gz 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61550.log.gz 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68117.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74293.log.gz 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64204.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69088.log: gzip/var/log/ceph/ceph-client.admin.68117.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57490.log 2024-05-10T11:23:14.839 INFO:teuthology.orchestra.run.smithi066.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69088.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68117.log.gz 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46017.log 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64204.log.gz 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.57490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61483.log 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57490.log.gz 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54974.log 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46017.log.gz 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74041.log 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.54974.log: /var/log/ceph/ceph-client.admin.43586.log: 91.5% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61483.log.gz -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2024-05-10T11:23:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43920.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71764.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74041.log.gz 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35711.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43920.log.gz 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59666.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.71764.log: /var/log/ceph/ceph-client.admin.35711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59666.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35711.log.gz 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71764.log.gz 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61381.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59666.log.gz 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73031.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66586.log 2024-05-10T11:23:14.841 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61381.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64643.log 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59582.log 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.66586.log: 0.0% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73031.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.66586.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56400.log 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64643.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55016.log 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59582.log: /var/log/ceph/ceph-client.admin.56400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53072.log 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59582.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56400.log.gz 2024-05-10T11:23:14.842 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51630.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53072.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55016.log.gz 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2%/var/log/ceph/ceph-client.admin.51630.log: -- replaced with /var/log/ceph/ceph-client.admin.53072.log.gz 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47509.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51630.log.gz 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53913.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50057.log: /var/log/ceph/ceph-client.admin.47509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70238.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53913.log: 88.7% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47509.log.gz 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53913.log.gz 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45786.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60767.log 2024-05-10T11:23:14.843 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74335.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70238.log.gz 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45786.log.gz 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73073.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62170.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60767.log.gz 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74335.log.gz/var/log/ceph/ceph-client.admin.73073.log: 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59708.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59887.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73073.log.gz 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44160.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59708.log.gz 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62170.log.gz 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42900.log 2024-05-10T11:23:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69195.log 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59887.log.gz 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42900.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44160.log.gz 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42900.log.gz 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69195.log: /var/log/ceph/ceph-client.admin.43583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56274.log 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69195.log.gz 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2024-05-10T11:23:14.845 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46616.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56274.log: /var/log/ceph/ceph-client.admin.48488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53837.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46616.log: 88.7% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56274.log.gz 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gz 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46616.log.gz 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69911.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53837.log: /var/log/ceph/ceph-client.admin.43913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59498.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.69911.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53837.log.gz 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69911.log.gz 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59750.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50921.log 2024-05-10T11:23:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43571.log 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9%/var/log/ceph/ceph-client.admin.59750.log: -- replaced with /var/log/ceph/ceph-client.admin.59498.log.gz 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.50921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50921.log.gz 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41834.log 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59750.log.gz 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43249.log 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9%/var/log/ceph/ceph-client.admin.41834.log: -- replaced with /var/log/ceph/ceph-client.admin.43571.log.gz 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51054.log 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74657.log 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43249.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41834.log.gz 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52671.log 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43249.log.gz 2024-05-10T11:23:14.847 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51054.log.gz 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53114.log 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74657.log.gz 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53114.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52671.log.gz 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65649.log 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53114.log.gz 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.43922.log: /var/log/ceph/ceph-client.admin.65649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44576.log 2024-05-10T11:23:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mds.a.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65649.log.gz 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68923.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47593.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.44576.log: /var/log/ceph/ceph-client.admin.68923.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44576.log.gz 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0%/var/log/ceph/ceph-client.admin.47593.log: -- replaced with /var/log/ceph/ceph-client.admin.68923.log.gz 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47593.log.gzgzip 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47244.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68286.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47244.log: 88.7% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47244.log.gz 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74699.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.68286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73283.log 2024-05-10T11:23:14.849 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68286.log.gz 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70783.log 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73283.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74699.log.gz 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73283.log.gz 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64559.log 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56634.log 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70783.log: /var/log/ceph/ceph-client.admin.64559.log: 87.8% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70783.log.gz 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64559.log.gz 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48628.log 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56634.log: /var/log/ceph/ceph-client.admin.50625.log 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56634.log.gz 2024-05-10T11:23:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48628.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48628.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50625.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50625.log.gz 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69004.log 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73915.log 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69237.log 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8%/var/log/ceph/ceph-client.admin.73915.log: -- replaced with /var/log/ceph/ceph-client.admin.69004.log.gz 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.73915.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.63340.log 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41750.log 2024-05-10T11:23:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69237.log: /var/log/ceph/ceph-client.admin.63340.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69237.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63340.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60917.log 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59792.log 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.41750.log: /var/log/ceph/ceph-client.admin.60917.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41750.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60917.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68244.log 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47953.log 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59792.log: /var/log/ceph/ceph-client.admin.68244.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59792.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68244.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56822.log 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60090.log 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47953.log: /var/log/ceph/ceph-client.0.56822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56822.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47953.log.gz 2024-05-10T11:23:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74125.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.60090.log: /var/log/ceph/ceph-client.admin.43915.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60090.log.gz 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62536.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69405.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74125.log: /var/log/ceph/ceph-client.admin.62536.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74125.log.gz 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74251.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62536.log.gz 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.69405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.74251.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69405.log.gz 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60431.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74251.log.gz 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59377.log 2024-05-10T11:23:14.853 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz/var/log/ceph/ceph-client.admin.60431.log: 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50499.log 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60431.log.gz 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55881.log 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59377.log.gz/var/log/ceph/ceph-client.admin.50499.log: 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67896.log 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50499.log.gz 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55881.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55881.log.gz 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51225.log 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51312.log 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.67896.log: /var/log/ceph/ceph-client.admin.51225.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51225.log.gz 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67896.log.gz 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2024-05-10T11:23:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.51312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59455.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49138.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51312.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65607.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8%/var/log/ceph/ceph-client.admin.59455.log: -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62624.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59455.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65607.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65607.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50667.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42942.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62624.log: /var/log/ceph/ceph-client.admin.50667.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62624.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50667.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61105.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52548.log 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.42942.log: /var/log/ceph/ceph-client.0.61105.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42942.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61105.log.gz 2024-05-10T11:23:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71946.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56442.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52548.log: /var/log/ceph/ceph-client.admin.71946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52548.log.gz 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70862.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.71946.log.gz/var/log/ceph/ceph-client.admin.56442.log: 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71667.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56442.log.gz 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70862.log: /var/log/ceph/ceph-client.admin.71667.log: 89.5% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.71667.log.gz -- replaced with /var/log/ceph/ceph-client.admin.70862.log.gz 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68454.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47072.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.49367.log: /var/log/ceph/ceph-client.admin.68454.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46903.log 2024-05-10T11:23:14.856 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68454.log.gz 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46903.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47072.log.gz 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46903.log.gz 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.50541.log: /var/log/ceph/ceph-client.admin.47337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60305.log 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49180.log 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.45558.log: /var/log/ceph/ceph-client.admin.60305.log: 88.8% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gz 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60305.log.gz 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56526.log 2024-05-10T11:23:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49180.log: -- /var/log/ceph/ceph-client.admin.66338.log 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49180.log.gz 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.56526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70673.log 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.66338.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56526.log.gz 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.66338.log.gz 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43246.log 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63095.log 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.70673.log: /var/log/ceph/ceph-client.admin.43246.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70673.log.gz 2024-05-10T11:23:14.858 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43246.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61423.log 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.63095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66029.log 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.61423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61423.log.gz 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59335.log 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.63095.log.gz 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.66029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66029.log.gz 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53860.log 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.59335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52079.log 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59335.log.gz 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.53860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69531.log 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52079.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53860.log.gz 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52079.log.gz 2024-05-10T11:23:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55777.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.69531.log: -- /var/log/ceph/ceph-client.admin.72036.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69531.log.gz 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.55777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63598.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.72036.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55777.log.gz 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73873.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.72036.log.gz 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.63598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63598.log.gz 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52928.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.73873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65481.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73873.log.gz 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.52928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62993.log 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.65481.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52928.log.gz 2024-05-10T11:23:14.860 INFO:teuthology.orchestra.run.smithi066.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65481.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64601.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.62993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47719.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64601.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64601.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.62993.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67037.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48970.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.47719.log: /var/log/ceph/ceph-client.admin.67037.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47719.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67037.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44900.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64769.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.44900.log: /var/log/ceph/ceph-client.admin.48970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44900.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48970.log.gz 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46574.log 2024-05-10T11:23:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.64769.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64769.log.gz 2024-05-10T11:23:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.46574.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46574.log.gz 2024-05-10T11:23:14.899 INFO:teuthology.orchestra.run.smithi066.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-10T11:23:14.972 INFO:teuthology.orchestra.run.smithi190.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-10T11:23:15.252 INFO:teuthology.orchestra.run.smithi066.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-10T11:23:15.745 INFO:teuthology.orchestra.run.smithi190.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-10T11:23:15.813 INFO:teuthology.orchestra.run.smithi190.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-10T11:23:15.820 INFO:teuthology.orchestra.run.smithi190.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-10T11:23:15.821 INFO:teuthology.orchestra.run.smithi190.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-10T11:23:15.823 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-05-10T11:23:15.823 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m1.325s 2024-05-10T11:23:15.823 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m5.963s 2024-05-10T11:23:15.823 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.236s 2024-05-10T11:23:15.884 INFO:teuthology.orchestra.run.smithi066.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-10T11:23:15.900 INFO:teuthology.orchestra.run.smithi066.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-10T11:23:15.934 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-10T11:23:16.115 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-10T11:23:16.117 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-10T11:23:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m1.643s 2024-05-10T11:23:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m6.726s 2024-05-10T11:23:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.563s 2024-05-10T11:23:16.118 INFO:tasks.ceph:Archiving logs... 2024-05-10T11:23:16.118 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/remote/smithi066/log 2024-05-10T11:23:16.119 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T11:23:16.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-10T11:23:17.505 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/remote/smithi190/log 2024-05-10T11:23:17.506 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T11:23:18.385 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T11:23:18.393 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T11:23:18.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T11:23:18.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T11:23:18.487 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T11:23:18.496 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T11:23:18.497 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:23:18.499 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:23:18.514 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:23:18.516 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:23:18.519 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:23:18.519 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-05-10T11:23:18.519 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +1306us[+1324us] +/- 54ms 2024-05-10T11:23:18.519 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -1453us[-1436us] +/- 52ms 2024-05-10T11:23:18.519 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +382us[ +400us] +/- 88ms 2024-05-10T11:23:18.519 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:23:18.521 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:23:18.521 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-05-10T11:23:18.521 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +1303us[+1303us] +/- 54ms 2024-05-10T11:23:18.521 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -1446us[-1446us] +/- 52ms 2024-05-10T11:23:18.521 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +386us[ +386us] +/- 88ms 2024-05-10T11:23:18.521 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:23:18.522 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T11:23:18.531 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T11:23:18.531 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T11:23:18.539 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T11:23:18.648 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T11:23:18.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:23:18.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:23:18.748 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:23:18.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:23:18.778 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T11:23:18.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T11:23:18.801 INFO:teuthology.task.internal:Duration was 1067.521987 seconds 2024-05-10T11:23:18.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T11:23:18.810 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T11:23:18.811 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T11:23:18.813 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T11:23:18.851 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:23:18.859 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:23:19.071 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T11:23:19.071 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-05-10T11:23:19.071 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T11:23:19.132 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-05-10T11:23:19.133 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T11:23:19.164 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T11:23:19.165 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T11:23:19.175 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T11:23:19.231 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T11:23:19.231 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T11:23:19.243 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T11:23:19.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T11:23:19.385 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T11:23:19.385 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T11:23:19.411 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T11:23:19.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T11:23:19.446 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:23:19.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:23:19.476 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-05-10T11:23:19.499 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-05-10T11:23:19.512 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:23:19.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:23:19.545 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:23:19.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:23:19.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T11:23:19.577 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T11:23:19.578 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/remote/smithi066 2024-05-10T11:23:19.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T11:23:19.622 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935/remote/smithi190 2024-05-10T11:23:19.622 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T11:23:19.655 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T11:23:19.655 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T11:23:19.663 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T11:23:19.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T11:23:19.717 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T11:23:19.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T11:23:19.727 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T11:23:19.727 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T11:23:19.729 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T11:23:19.742 INFO:teuthology.orchestra.run.smithi066.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 11:23 /home/ubuntu/cephtest 2024-05-10T11:23:19.761 INFO:teuthology.orchestra.run.smithi190.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 11:23 /home/ubuntu/cephtest 2024-05-10T11:23:19.762 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T11:23:19.773 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T11:23:19.793 INFO:teuthology.nuke:Checking targets against current locks 2024-05-10T11:23:19.829 DEBUG:teuthology.nuke:shortname: smithi066 2024-05-10T11:23:19.829 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T11:23:19.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:55:33.693337', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1fE0tuvGUT9r4jLvViOll9QjlGjOcJxgmlcC4ZK1BPbiJsdCTaJ5IeV3G6l8dhLk+RTRPD/uZPQRQ/gme5pbk='} 2024-05-10T11:23:19.886 DEBUG:teuthology.nuke:shortname: smithi190 2024-05-10T11:23:19.887 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T11:23:19.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:38:09-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:55:33.694625', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERzjNu7/gzS5Z7wD4D+sNaH0YQYXaQZLcmzZzJUKMNGVHu1mSgevgaqEeufpMGtfs2yyfEjAP0p7X56bA6itHo='} 2024-05-10T11:23:19.966 INFO:teuthology.orchestra.console.smithi066:Power off 2024-05-10T11:23:19.966 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T11:23:20.015 INFO:teuthology.orchestra.console.smithi190:Power off 2024-05-10T11:23:20.015 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T11:23:20.027 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-05-10T11:23:20.028 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:20.060 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-05-10T11:23:20.065 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-05-10T11:23:20.065 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:20.115 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-05-10T11:23:24.061 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:24.117 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:24.173 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-05-10T11:23:24.229 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-05-10T11:23:28.177 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:28.229 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:28.287 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-05-10T11:23:28.340 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-05-10T11:23:28.440 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-05-10T11:23:32.288 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:23:32.398 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-05-10T11:23:32.499 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-05-10T11:23:32.604 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1067.5219871997833 failure_reason: '"2024-05-10T11:18:34.411752+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir)" in cluster log' flavor: default owner: scheduled_dparmar@teuthology success: false 2024-05-10T11:23:32.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T11:23:32.692 INFO:teuthology.run:FAIL